Tutorials › Econometrics (Graduate) › Full-Information Estimation of Endogenous Switching

Sample Selection Models · Tutorial 560 of 952

Full-Information Estimation of Endogenous Switching

Learn to construct and maximize a switching-model likelihood that combines each observed outcome density with the probability of its selected regime.

Advanced 12 min read

What You'll Learn

  • Specify a probit regime-choice equation and regime-specific outcome equations with correlated errors.
  • Derive the likelihood contribution for an observation in either regime.
  • Calculate and combine switching-model likelihood contributions on the log scale.
  • Explain how full-information estimation jointly estimates choice and outcome parameters.
  • Recognize why multiplying an unconditional outcome density by a choice probability can be incorrect.

Why Combine Choice and Outcome Information?

In an endogenous switching model, an observed outcome comes from the regime an individual chooses or enters. If the unobserved factors affecting regime choice are related to the factors affecting outcomes, the observed outcomes are not simply random samples from the two regime-specific outcome distributions. A likelihood for the model must therefore account for both which regime is observed and the outcome observed within that regime.

Full-information maximum likelihood (FIML) does this by constructing one joint likelihood from the regime-choice equation and the relevant outcome equation for each observation. “Full information” refers to estimating the model parameters jointly from this likelihood; it does not mean that outcomes in unchosen regimes are observed.

Model: For individual \(i\), let \(D_i\) indicate the observed regime, with \(D_i=1\) if \(D_i^*>0\) and \(D_i=0\) otherwise. The latent choice equation is \(D_i^*=z_i'\gamma+u_i\). The potential outcome in regime \(j\in\{0,1\}\) is \(Y_{ij}=x_{ij}'\beta_j+\varepsilon_{ij}\), and the observed outcome is \(Y_i=D_iY_{i1}+(1-D_i)Y_{i0}\). Normalize \(u_i\sim N(0,1)\). For each regime \(j\), assume \((u_i,\varepsilon_{ij})\) is bivariate normal with \(\operatorname{Var}(\varepsilon_{ij})=\sigma_j^2>0\) and \(\operatorname{Corr}(u_i,\varepsilon_{ij})=\rho_j\), where \(|\rho_j|<1\). Observations are independent across individuals conditional on their covariates.

Here \(z_i\) contains the choice-equation covariates and \(x_{ij}\) contains the outcome covariates for regime \(j\). The two correlations \(\rho_0\) and \(\rho_1\) need not be equal. The likelihood contribution for an individual uses the error pair associated with that individual’s observed regime. A joint distribution linking the two potential-outcome errors is not needed to write this observed-data likelihood.

Deriving the Regime-Specific Contributions

Write \(\eta_i=z_i'\gamma\), and for the observed regime \(j\) define the residual and its standardised value by \(e_{ij}=Y_i-x_{ij}'\beta_j\) and \(t_{ij}=e_{ij}/\sigma_j\). The marginal outcome density at \(Y_i\) is \(\phi(t_{ij})/\sigma_j\). It must be multiplied by the probability that the individual is in the observed regime conditional on that outcome residual.

For a regime-1 observation, choice requires \(u_i>-\eta_i\). Given \(\varepsilon_{i1}=e_{i1}\), bivariate normality gives \(u_i\) a conditional mean of \(\rho_1t_{i1}\) and conditional variance \(1-\rho_1^2\). Thus the conditional choice probability is the upper-tail probability at \(-\eta_i\), which equals the standard normal CDF shown below. For a regime-0 observation, choice requires \(u_i\leq-\eta_i\), and the corresponding conditional probability is a lower-tail probability.

$$ \begin{aligned} f_i(Y_i,D_i=1) &= \frac{1}{\sigma_1}\phi(t_{i1}) \Phi\!\left( \frac{\eta_i+\rho_1t_{i1}}{\sqrt{1-\rho_1^2}} \right),\\[4pt] f_i(Y_i,D_i=0) &= \frac{1}{\sigma_0}\phi(t_{i0}) \Phi\!\left( \frac{-\eta_i-\rho_0t_{i0}}{\sqrt{1-\rho_0^2}} \right). \end{aligned} $$

These are joint densities for the observed outcome and regime indicator, conditional on the covariates. For example, \(f_i(Y_i,D_i=1)\) is a density in \(Y_i\), not a probability that a continuous outcome equals one exact value. The regime indicator’s probability is incorporated through the conditional CDF factor.

Worked Example: A Regime-0 Likelihood Contribution

Consider a hypothetical observation in regime 0. Suppose its choice index is \(\eta_i=0.04\), its regime-0 outcome residual is \(e_{i0}=-0.60\), \(\sigma_0=1.5\), and \(\rho_0=0.30\). These inputs imply \(t_{i0}=-0.60/1.5=-0.40\). Compute its contribution to the likelihood.

The regime-0 formula gives

$$ \begin{aligned} f_i(Y_i,D_i=0) &=\frac{\phi(-0.40)}{1.5} \Phi\!\left( \frac{-0.04-0.30(-0.40)}{\sqrt{1-0.30^2}} \right)\\ &=\frac{0.36827}{1.5} \Phi\!\left(\frac{0.08}{\sqrt{0.91}}\right)\\ &\approx 0.24551\times 0.53342\\ &\approx 0.13096. \end{aligned} $$

The argument of \(\Phi\) is about \(0.0839\). The contribution is a product of the regime-0 outcome density and the conditional probability of selecting regime 0 given that outcome residual. It is not obtained by multiplying the density by the unconditional regime-0 probability unless the selection and outcome errors are independent.

Likelihood: Let \(\theta=(\gamma,\beta_0,\beta_1,\sigma_0,\sigma_1,\rho_0,\rho_1)\), with \(\sigma_j>0\) and \(|\rho_j|<1\). For independent observations, the observed-data likelihood and log-likelihood are \(L(\theta)=\prod_{i=1}^n f_i(Y_i,D_i)\) and \(\ell(\theta)=\sum_{i=1}^n\log f_i(Y_i,D_i)\), where each \(f_i\) is the contribution for the regime actually observed.

Joint Estimation and a Small Likelihood Calculation

FIML estimates the choice parameters, both outcome coefficient vectors, the outcome standard deviations, and the selection-outcome correlations by maximizing \(\ell(\theta)\) jointly. The same parameters determine both the density and conditional probability in each contribution. A change in an outcome coefficient, for instance, changes the residual and can therefore change both factors. Numerical optimization is generally used, with parameterizations or constraints that preserve \(\sigma_j>0\) and \(|\rho_j|<1\).

A practical calculation proceeds observation by observation. First identify the observed regime, then compute that regime’s residual and standardized residual, evaluate its density and conditional CDF, and finally sum the log contributions. The unobserved potential outcome does not receive a separate outcome-density factor.

Worked Example: Combining Contributions for Two Observations

Suppose a hypothetical dataset contains two independent observations, one in each regime. For the regime-0 observation, use the inputs and contribution from the preceding example: \(f_1\approx0.13096\). For the regime-1 observation, suppose \(\eta_2=-0.0848\), \(e_{21}=0.60\), \(\sigma_1=1.5\), and \(\rho_1=0.30\). Then \(t_{21}=0.40\). Compute its contribution and the two-observation log-likelihood at these parameter values.

For the regime-1 observation,

$$ \begin{aligned} f_2(Y_2,D_2=1) &=\frac{\phi(0.40)}{1.5} \Phi\!\left( \frac{-0.0848+0.30(0.40)}{\sqrt{0.91}} \right)\\ &=0.24551\, \Phi\!\left(\frac{0.0352}{0.95394}\right)\\ &\approx0.24551\,\Phi(0.0369)\\ &\approx0.24551(0.5147)\\ &\approx0.12637. \end{aligned} $$

Independence across the two individuals means the likelihood is the product of their contributions. Using the displayed rounded contributions for illustration,

$$ \begin{aligned} L(\theta)&\approx(0.13096)(0.12637),\\ \ell(\theta)&=\log(0.13096)+\log(0.12637)\\ &\approx -2.0329-2.0685\\ &\approx -4.1014. \end{aligned} $$

The log-likelihood is a function of the candidate parameter values, not a goodness-of-fit probability. Estimation searches over admissible values of \(\theta\) to find those giving the largest log-likelihood for the observed sample. In an actual computation, the optimizer uses unrounded contributions; rounding here is only for reporting.

Why the Correlation Changes the Contribution

The correlation parameter affects how informative an observed outcome residual is about regime choice. If \(\rho_j=0\), the selection error and the outcome error in regime \(j\) are independent under the stated joint-normal assumption. The conditional regime probability then does not depend on the outcome residual. If \(\rho_j\neq0\), a residual changes the conditional distribution of the selection error and therefore changes the probability factor in the likelihood.

Worked Example: Independence Versus Correlated Errors

Return to the hypothetical regime-0 observation with \(\eta_i=0.04\), \(t_{i0}=-0.40\), and \(\sigma_0=1.5\). With \(\rho_0=0.30\), its contribution was approximately \(0.13096\). What would the contribution be at the same \(\eta_i\), residual, and standard deviation if \(\rho_0=0\)?

Under independence, the conditional probability of regime 0 is simply \(\Phi(-\eta_i)=\Phi(-0.04)\approx0.48405\). Therefore,

$$ f_i(Y_i,D_i=0) =\frac{\phi(-0.40)}{1.5}\Phi(-0.04) \approx0.24551(0.48405) \approx0.11884. $$

The contribution changes from about \(0.11884\) under independence to \(0.13096\) at \(\rho_0=0.30\), holding the other inputs fixed. This comparison illustrates how dependence enters the likelihood; it is not, by itself, a test of whether the errors are dependent or evidence that changing regimes would cause an outcome change.

Optimization, Inference, and Interpretation

After maximizing the log-likelihood, uncertainty for the estimated parameters is commonly based on the curvature of the log-likelihood at its maximum. Under regularity conditions and local identification, the inverse of the negative observed Hessian provides the usual model-based covariance estimate. The resulting standard errors support inference on parameters such as \(\rho_j\), outcome coefficients, or contrasts built from them. A coefficient in an outcome equation describes the corresponding conditional outcome specification; interpretation should respect its units and the model’s assumptions.

A well-behaved numerical maximum is not enough on its own. The model requires the specified conditional distributions and the covariate variation needed to identify its parameters. In particular, the choice and outcome parameters must be distinguished by the information in the data. Exclusion restrictions and functional-form identification are important issues in that assessment, but the likelihood formula does not make weak identification disappear.

1
Specify the model.
State the regime rule, both outcome equations, the error variances, and the selection-outcome correlations.
2
Build each contribution.
Use only the outcome density and conditional regime probability for the regime observed for that individual.
3
Maximize and assess.
Sum log contributions, maximize jointly over admissible parameter values, and examine uncertainty and identification.

Common Pitfall

The exact factorization is \(f(Y_i\mid D_i=j,\text{covariates})P(D_i=j\mid\text{covariates})\); the conditional outcome density already accounts for selection. In general, multiplying the marginal regime-\(j\) outcome density \(f(Y_{ij}\mid x_{ij})\) by \(P(D_i=j\mid z_i)\) is incorrect when \(\rho_j\neq0\), because the outcome residual and selection error are then dependent. Equivalently, the joint contribution can be written as the marginal outcome density times \(P(D_i=j\mid Y_i,\text{covariates})\), represented by the conditional CDF in the likelihood formula. Another mistake is to include both regime-specific outcome densities for every person: only one outcome is observed, so the unchosen outcome is integrated out rather than entered as if observed.

Key takeaway: In full-information estimation of endogenous switching, each observed record contributes a regime-specific outcome density multiplied by the probability of its observed regime conditional on that outcome residual. Maximizing the sum of these log contributions estimates the choice and outcome parameters jointly.

Check Your Understanding

Answer each question using the model and likelihood developed above.

  1. For an observation in regime 1, what event involving \(u_i\) must hold, and why does its likelihood contribution include an upper-tail conditional probability?
  2. Which two factors make up a regime-0 observation’s likelihood contribution?
  3. What does \(\rho_j=0\) imply about the conditional regime probability’s dependence on the regime-\(j\) outcome residual under the model?
  4. Why is it generally incorrect to multiply an unconditional choice probability by the outcome density when \(\rho_j\neq0\)?
  5. Why does an observed-data contribution not include a density for the individual’s unchosen potential outcome?
Clinical Biostats