Why an Ordinal Outcome Needs Its Own Control-Function Model
An ordinal outcome has ordered categories, such as mild, moderate, and severe, but the distances between categories are not measured on a meaningful numerical scale. Treating category labels as ordinary numbers in a linear outcome model therefore imposes an interpretation the data do not supply. An ordered probit instead represents categories as intervals of an underlying continuous latent response.
When treatment \(T\) is endogenous, an ordered probit that simply includes \(T\) need not have a causal interpretation. A control-function approach models the source of treatment variation and includes a function of the first-stage disturbance in the ordinal outcome model. This tutorial develops that construction for a continuous treatment with a linear first stage. The resulting category probabilities depend on treatment, covariates, and the control function; a coefficient in the latent index is not itself a category-probability difference.
Model and Assumptions
Let \(X\) be a vector of observed covariates and \(Z\) a vector of instruments, with \(Z\) excluded from the outcome equation. For a continuous treatment, specify the linear first stage
Here \(V\) is the first-stage disturbance. The latent ordinal outcome model is
where \(\kappa_0=-\infty\), \(\kappa_J=\infty\), and the finite thresholds satisfy \(\kappa_1<\cdots<\kappa_{J-1}\). The treatment coefficient \(\tau\) describes a shift in the latent response, not directly a change in the probability of any particular category.
A sufficient control-function structure for the derivation below is that, conditional on \(X,Z\), \(V\) and \(\varepsilon\) are jointly normal with mean zero, \(\operatorname{Var}(V)=\sigma_V^2>0\), and \(\operatorname{Var}(\varepsilon)=\sigma_\varepsilon^2\). Write
Under joint normality, this decomposition gives \(U\) independent of \(V\); the structural model also requires that the remaining outcome disturbance is independent of the instruments and covariates as specified. Endogeneity corresponds to dependence between \(V\) and \(\varepsilon\), equivalently \(\lambda\ne0\) in this setup. The instruments must be relevant, so \(Z\) contributes variation to \(T\) conditional on \(X\), and valid: they are independent of unobserved outcome determinants conditional on \(X\) and have no direct effect on \(Y^*\). These assumptions, plus adequate support for the treatment comparisons, are substantive requirements, not consequences of fitting the model.
Conditional Probabilities and Threshold Interpretation
Substituting the error decomposition into the latent outcome equation gives \(Y^*=X'\beta+\tau T+\lambda V+U\). Conditional on \(X,T,V\), the remaining error is normal with variance \(\sigma_U^2\). Thus the cumulative probability through category \(j\) is
The division by \(\sigma_U\) matters: the latent error after conditioning on \(V\) need not have variance one. In an ordered probit, location and scale are not separately identified from the observed categories. A common estimation convention fixes the scale and reports normalized thresholds and coefficients, each divided by \(\sigma_U\). Under that convention, the displayed formula is written without the denominator, but all its parameters must be normalized consistently. Do not combine unnormalized parameters with a standard-normal CDF.
Category probabilities are differences between successive cumulative probabilities. Set \(F_0=0\), \(F_J=1\), and for finite thresholds let \(F_j=P(Y\leq j\mid X,T,V)\). Then
A positive \(\tau\), for example, shifts the latent response upward when treatment increases. It lowers the cumulative probabilities \(P(Y\leq j)\) at fixed \(X,V\), but the effect on an individual middle-category probability can be positive or negative: that probability is the difference between two cumulative probabilities. Consequently, interpretation should use predicted category probabilities or contrasts on those probabilities, not just the sign or size of \(\tau\).
Worked Example: Constructing a Control Function
Suppose a hypothetical study models a continuous treatment dose in units of 10 mg. Its fitted first stage is \(\widehat T=0.8+0.4X+0.6Z\), where \(X\) is a measured covariate and \(Z\) is an instrument. For one hypothetical individual, \(X=1\), \(Z=2\), and observed \(T=3.1\) dose units.
The predicted treatment is
The estimated residual is therefore \(\widehat V=T-\widehat T=3.1-2.4=0.7\) dose units. The ordinal second stage includes this residual as a control function alongside \(T\) and \(X\). If, for illustration, its normalized latent index is \(X'\tilde\beta+\tilde\tau T+\tilde\lambda\widehat V\), the residual contribution for this individual is \(0.7\tilde\lambda\). This adjustment is intended to account for the part of treatment variation associated with unobserved outcome determinants under the stated model. It does not turn an invalid instrument into a valid one.
This calculation assumes that the linear first stage is appropriate for the continuous treatment and that the fitted residual estimates the relevant \(V\). In applied work, residuals are estimated rather than observed, and their uncertainty must be reflected in inference.
From Fitted Thresholds to Category Contrasts
The following example uses normalized parameters, so \(\sigma_U\) is absorbed into the thresholds and coefficients. It illustrates how to compute probabilities while holding the control-function value fixed. Suppose there are three categories and, at a specified covariate value, the normalized thresholds are \(\tilde\kappa_1=-0.2\) and \(\tilde\kappa_2=1.1\), with \(\tilde\tau=0.7\) and \(\tilde\lambda=1\). The cumulative-probit arguments are \(\tilde\kappa_j-X'\tilde\beta-\tilde\tau T-\tilde\lambda V\); take \(X'\tilde\beta=0\) for this illustration.
Worked Example: Calculating Category Probabilities
First consider \(T=0,V=0\). The two cumulative probabilities are \(\Phi(-0.2)=0.4207\) and \(\Phi(1.1)=0.8643\). The category probabilities are therefore
For \(T=0,V=1\), the arguments become \(-1.2\) and \(0.1\). Using unrounded CDF values, \(\Phi(-1.2)=0.1150697\) and \(\Phi(0.1)=0.5398278\), giving probabilities \((0.1151,0.4248,0.4602)\). The middle probability is \(0.5398278-0.1150697=0.4247581\), which rounds to 0.4248.
For \(T=1,V=0\), the arguments are \(-0.9\) and \(0.4\). The probabilities are \((0.1841,0.4714,0.3446)\). For \(T=1,V=1\), the arguments are \(-1.9\) and \(-0.6\). Using unrounded values, the probabilities are \((0.0287,0.2455,0.7257)\), since \(0.2742531-0.0287166=0.2455365\). Each vector sums to approximately one; small discrepancies in displayed sums can result from rounding.
To form an illustrative standardized contrast, average over two equally weighted control-function values, \(V=0\) and \(V=1\). For \(T=0\), the category-3 average is \(\{[1-\Phi(1.1)]+[1-\Phi(0.1)]\}/2=0.2979191\), which rounds to 0.2979. Averaging all categories using unrounded probabilities gives \((0.2679,0.4342,0.2979)\). For \(T=1\), the corresponding average is \((0.1064,0.3584,0.5352)\); in particular, the category-2 average is \(\{[\Phi(0.4)-\Phi(-0.9)]+[\Phi(-0.6)-\Phi(-1.9)]\}/2=0.3584491\), which rounds to 0.3584.
The \(T=1\) minus \(T=0\) contrasts are therefore \((-0.1615,-0.0757,0.2372)\), in probability units. In this hypothetical calculation, category 3 is 0.2372 more probable under \(T=1\) than \(T=0\), averaged over the two specified control-function values. The category-specific contrasts sum to approximately zero because the category probabilities sum to one under each treatment value.
What the Contrast Does—and Does Not—Mean
The calculation above changes \(T\) while holding each \(V\) value fixed, then averages over a chosen distribution of \(V\). Under a correctly specified structural model and the required IV assumptions, such a contrast can represent a model-based counterfactual comparison. The averaging distribution must be stated: averaging over an empirical residual distribution, a target population, or a small illustrative set of residual values answers different questions. The two equally weighted values in the example are only a transparent arithmetic illustration, not a population estimate.
A fitted coefficient \(\tilde\tau\) is not itself the average change in the probability of a category. Probability contrasts depend on thresholds, covariates, treatment values, and the control-function value. For a continuous treatment, the contrast between two doses also depends on which doses are compared. If a causal interpretation is intended, the model must support the relevant counterfactual treatment values; extrapolating well beyond observed support is not justified merely because the probit formula returns a number.
The control-function coefficient is also not a standalone test of endogeneity in every specification. Its meaning depends on the assumed first-stage and error structure. A residual-inclusion model is a particular parametric correction, not a general guarantee that all sources of confounding have been removed.
Estimation, Diagnostics, and Common Pitfalls
Regress continuous \(T\) on \(X\) and excluded \(Z\) under the stated linear model, then compute \(\widehat V=T-\widehat T\). Check that the instruments contribute relevant variation conditional on \(X\); weak-instrument diagnostics are important because weak relevance can make estimates unstable.
Estimate an ordered probit including \(X\), \(T\), and \(\widehat V\), with ordered cutpoints. Be explicit about the scale normalization. Standard errors should account for estimating the first-stage residual, for example through a valid bootstrap that refits both stages in each resample.
Verify that the cutpoints are ordered, probabilities are between zero and one and sum to one, and the treatment values being contrasted have support. Present category probabilities and contrasts with their averaging population and units stated.
Diagnostics cannot establish instrument validity, but they can reveal problems. Inspect first-stage strength and the distribution of fitted residuals; examine whether treatment and residual values used in predictions are represented in the data; and check whether model-predicted category frequencies are grossly inconsistent with observed frequencies across relevant covariate and treatment groups. The ordered-probit threshold structure assumes a common latent-index shift across cumulative cutpoints. Poor fit may indicate that this structure, the linear first stage, the normality assumptions, or the control-function form is inadequate.
A common mistake is to use the raw residual from a linear regression as a valid control function for any endogenous treatment. The correction derived here relies on a linear first stage for a continuous treatment and the specified error relationship. For a binary or otherwise nonlinear first stage, the raw residual is generally not the appropriate control function; do not transfer this formula mechanically. A further mistake is to calculate category probabilities using rounded cumulative probabilities and then subtract them. Compute differences and averages using full precision, then round the final results, as in the worked example.
Compared with a standard ordered probit that omits \(\widehat V\), residual inclusion explicitly models dependence between treatment and the latent outcome disturbance, but requires stronger structural assumptions. A linear two-stage substitution that replaces \(T\) with its fitted value is not equivalent: nonlinear outcome probabilities do not generally preserve the required relationship through predictor substitution. A joint latent-variable model can encode dependence directly, but it also requires distributional and functional-form assumptions. No approach removes the need to justify instrument relevance, exclusion, and the outcome model.
Check Your Understanding
Answer each question before reading the brief solutions.
- In the linear first stage \(T=X'\gamma+Z'\pi+V\), what is the estimated control function for an observation with \(T=4.0\) and fitted treatment \(\widehat T=3.3\)?
- Why does the conditional cumulative probability require division by \(\sigma_U\) before scale normalization?
- For three outcome categories, if \(F_1=0.25\) and \(F_2=0.70\), find all three category probabilities.
- Does a positive latent treatment coefficient necessarily increase the probability of the middle category? Explain.
- Why is it unsafe to use the same raw-residual procedure automatically when the first stage is a probit model for binary treatment?
Solutions. (1) \(\widehat V=T-\widehat T=4.0-3.3=0.7\) treatment units. (2) Conditional on \(V\), the remaining latent error \(U\) has variance \(\sigma_U^2\), not necessarily one; a standard-normal CDF therefore requires standardizing the threshold difference by \(\sigma_U\), unless every parameter has been consistently normalized. (3) The probabilities are \(F_1=0.25\), \(F_2-F_1=0.70-0.25=0.45\), and \(1-F_2=0.30\); they sum to one. (4) No. A positive coefficient shifts latent response upward and lowers cumulative probabilities at fixed covariates and control function, but the middle-category probability is the difference of two cumulative probabilities and may rise or fall. (5) A nonlinear first stage has a different disturbance structure, so its raw residual is generally not the control function justified by the linear-first-stage derivation.