Tutorials › Competing Risks and Multi-State Models › Efficiency Gains From Common Transition Effects

Regression for Multi-State Data · Tutorial 350 of 699

Efficiency Gains From Common Transition Effects

See why a common transition coefficient can improve precision when its equality assumption is credible, and how risk-set information determines the gain.

Advanced 12 min read

What You'll Learn

  • Write the common-coefficient transition intensity model while retaining transition-specific baseline hazards.
  • Derive how transition-specific risk-set information contributes to the common coefficient’s precision.
  • Calculate and interpret a pooled estimate and its standard error using information weights.
  • Identify the assumptions that make a precision gain meaningful.
  • Recognize when sparse risk sets, effect heterogeneity, or model misspecification undermine pooling.

Why a Common Effect Can Be More Precise

In a multi-state model, different transitions generally have different eligible individuals, event times, and risk sets. Estimating a separate covariate coefficient for every transition respects those differences, but it also divides the available event information among several estimates. If the covariate has the same effect on each transition, a common coefficient can use information from all of those risk sets to estimate one shared effect. The potential gain is precision, not a guarantee that the model is appropriate.

The central condition is substantive: the coefficient must genuinely be common across transitions, on the same covariate scale and for the same effect specification. The baseline hazards need not be common. Pooling the coefficient does not mean pooling transition risk sets, treating all events as the same event, or assuming that transitions occur at the same rate.

Definition: For transitions \(r=1,\ldots,K\), a common-coefficient transition Cox model specifies \(\lambda_{ir}(t\mid\mathcal{F}_{t-})=Y_{ir}(t)\lambda_{0r}(t)\exp\{\beta^\mathsf{T}X_i(t)\}\). Here \(Y_{ir}(t)\) indicates whether individual \(i\) is at risk for transition \(r\) at time \(t\); \(\lambda_{0r}(t)\) is a transition-specific baseline hazard; \(X_i(t)\) is the covariate vector; and \(\beta\) is shared across transitions. By contrast, transition-specific effects use a coefficient vector \(\beta_r\) for each transition.

The model concerns the intensity of a particular transition among individuals eligible to make it. Its risk set is transition-specific. A person ineligible for transition \(r\) contributes no risk-set information for that transition at that time, even if that person is observed in the study. The separate baseline hazards \(\lambda_{0r}(t)\) allow the underlying rates to differ freely across transitions.

How the Information Adds

For a single covariate, the transition-specific Cox partial likelihood compares the covariate value for each event with values among individuals in that transition’s risk set. At an event time \(t\) for transition \(r\), define the risk-set weighted mean and variance by \( \bar X_r(\beta,t)=S_r^{(1)}(\beta,t)/S_r^{(0)}(\beta,t)\) and \(V_r(\beta,t)=S_r^{(2)}(\beta,t)/S_r^{(0)}(\beta,t)-\{\bar X_r(\beta,t)\}^2\), where \(S_r^{(j)}(\beta,t)=\sum_iY_{ir}(t)\exp\{\beta X_i(t)\}X_i(t)^j\). The risk-set variance measures how much covariate contrast is available to distinguish the event individual from those still at risk.

For a vector covariate, \(V_r\) is the corresponding weighted covariance matrix. The observed information for a transition is obtained by summing these risk-set variances or covariance matrices over that transition’s event times. The common-coefficient model combines the transition-specific score contributions; its information is the sum of the contributions from all transitions.

$$ U_{\mathrm{common}}(\beta)=\sum_{r=1}^{K}U_r(\beta), \qquad I_{\mathrm{common}}(\beta)=\sum_{r=1}^{K}I_r(\beta). $$

This addition explains the precision gain. Under the common-effect model and regularity conditions, the large-sample covariance matrix of the common estimator is approximately \(I_{\mathrm{common}}^{-1}\). Information contributed by one transition can therefore help estimate the same coefficient using events from other transitions. With separate coefficients, the approximate covariance for \(\hat\beta_r\) instead depends on \(I_r^{-1}\) alone.

A short justification follows from the partial-likelihood score. For transition \(r\), each event contributes the event individual’s covariate minus its risk-set weighted mean. The score for a common coefficient is the sum of those transition-specific contributions, since every contribution depends on the same \(\beta\). Differentiating the negative score gives the sum of the transition-specific weighted covariance contributions. Thus the combination is a consequence of imposing one shared parameter, not of combining the risk sets themselves.

$$ -\frac{\partial U_{\mathrm{common}}(\beta)}{\partial\beta^\mathsf{T}} = \sum_{r=1}^{K} \left\{-\frac{\partial U_r(\beta)}{\partial\beta^\mathsf{T}}\right\} = \sum_{r=1}^{K}I_r(\beta). $$

This information calculation supports the usual model-based large-sample standard error when the intensity model is correctly specified and subjects are independent, or when dependence is handled by an appropriate variance estimator. In a multi-state process, transitions from the same person are not separate independent people. The counting-process likelihood accounts for the transition contributions, while uncertainty calculations must respect the sampling and dependence structure. The simple inverse-information expression should not be used blindly when its assumptions fail.

Worked Information and Precision Calculations

Worked Example: Comparing Common and Separate Standard Errors

Hypothetical data. Suppose two transitions have the same true scalar covariate coefficient, and a correctly specified transition-stratified Cox analysis gives observed information \(I_1=12\) and \(I_2=8\), in inverse squared coefficient units. Assume independent subjects, non-informative censoring conditional on the modeled covariates, adequate risk-set covariate variation, and proportional hazards for both transitions. The baseline hazards are allowed to differ.

Under the common-effect constraint, information adds: \(I_{\mathrm{common}}=12+8=20\). The approximate model-based standard error is \(SE(\hat\beta)=\sqrt{1/20}=0.2236\), in coefficient units.

With separate coefficients, the corresponding standard errors are \(SE(\hat\beta_1)=\sqrt{1/12}=0.2887\) and \(SE(\hat\beta_2)=\sqrt{1/8}=0.3536\). Thus, when the common-effect assumption is true, pooling provides more information for estimating the shared coefficient than either transition provides alone. This comparison does not say that the transition-specific event rates are equal: their baseline hazards remain distinct.

Worked Example: An Information-Weighted Estimate

Hypothetical data. Suppose separate transition analyses produce estimates \(\hat\beta_1=0.40\) and \(\hat\beta_2=0.52\), with observed information \(I_1=16\) and \(I_2=9\). Assume the same scalar coefficient truly applies to both transitions and that each transition model satisfies the regularity assumptions described above.

Near their maxima, the separate log partial likelihoods can be approximated by quadratic functions. Combining those approximations gives an information-weighted estimate:

$$ \hat\beta_{\mathrm{common}} \approx \frac{I_1\hat\beta_1+I_2\hat\beta_2}{I_1+I_2} = \frac{16(0.40)+9(0.52)}{16+9} = \frac{6.40+4.68}{25} = 0.4432. $$

The approximate standard error is \(1/\sqrt{25}=0.2000\) coefficient units. The estimate lies closer to \(0.40\), the transition estimate with more information. This weighted-average calculation is a local quadratic approximation; it is not a general exact formula for combining Cox estimates. In practice, the common coefficient is obtained by maximizing the combined partial likelihood.

Worked Example: A Sparse Transition Can Borrow Precision

Hypothetical data. A study observes two transitions for which a common scalar coefficient is scientifically credible. Transition A contributes information \(I_A=18\), while a less frequent transition B contributes \(I_B=2\). Suppose the fitted common coefficient is \(0.30\) and both transition-specific proportional-hazards models, censoring assumptions, and risk-set definitions are adequate.

The combined information is \(18+2=20\), so the approximate standard error is \(1/\sqrt{20}=0.2236\) coefficient units. If transition B were estimated alone, its information-based standard error would be \(1/\sqrt{2}=0.7071\) coefficient units. The combined estimate is much more precise than an estimate based only on B’s sparse events because A also informs the shared coefficient.

That gain is warranted only if B truly has the same coefficient as A. Sparse events in B make its separate estimate imprecise, but do not establish equality. If B’s effect differs, the common estimate may be precise for a compromise that is not the desired transition-specific effect.

Assumptions, Checks, and Failure Modes

The precision argument depends on the model and data structure, not merely on fitting a shared coefficient. Before interpreting a smaller standard error as a gain, check the following conditions:

  • Equal coefficient meaning. The covariates must be measured and coded consistently, and the log-hazard coefficient for each covariate must be shared across the transitions being pooled. Equality is an assumption, not a consequence of using one parameter.
  • Correct transition models. Within each transition, the specified covariate form and proportional-hazards structure must be adequate. A common coefficient does not repair a wrong functional form or time-varying effect.
  • Correct risk sets and observation process. Eligibility for each transition must be represented correctly. Censoring must be non-informative conditional on the modeled information, or its dependence must be handled appropriately.
  • Usable covariate variation. The relevant covariate must vary in the risk sets that contribute events. If a covariate is constant within a transition’s risk sets, that transition supplies no information about its coefficient, regardless of its event count.
  • Appropriate uncertainty calculation. Repeated transitions from one individual do not create independent subjects. When the sampling design or dependence requires it, use a variance estimator that accounts for within-subject clustering rather than relying only on inverse model-based information.

Diagnostics should be transition-specific. Inspect event counts and risk-set covariate distributions, and look for separation or very limited overlap. Compare fitted effects and uncertainty across transitions as a descriptive check, while recognizing that noisy transition-specific estimates can conceal real differences. Examine proportional-hazards and covariate-form diagnostics within each transition; an aggregate check can hide a problem confined to one risk process. A small standard error alone is not evidence that the equality constraint is plausible.

The main alternative is to estimate transition-specific coefficients. This avoids imposing equality but can produce unstable estimates when some transitions have few events or little covariate variation. A common coefficient uses fewer parameters and can be substantially more precise when equality holds. Its cost is bias for transition-specific targets when effects differ. Neither model is universally preferable: the choice depends on the scientific target and the credibility of the common-effect assumption.

The gain also has limits. Information matrices add, but the amount added depends on risk-set covariate variation, not just the total number of observed transitions. Information may be weak for a particular covariate even in a large study. Further, a correctly estimated common coefficient is a shared conditional log-hazard effect; it does not by itself summarize absolute transition probabilities or overall prognosis.

Common mistake: “The common model has a smaller standard error, so it must be better.” A smaller standard error follows partly from restricting several coefficients to be one. If the transition effects differ, the estimate can be biased for each transition-specific effect. First justify the equality assumption; then interpret the precision gain as conditional on that model.
Key takeaway: A common transition coefficient pools score and information contributions across transition-specific risk sets while retaining separate baseline hazards. Its efficiency advantage is meaningful when the coefficient is genuinely common, the transition models and risk sets are correctly specified, and the variance calculation respects the data structure.

Check Your Understanding

Answer each question, then compare your reasoning with the solutions.

  1. In a common-coefficient transition Cox model, must the transition baseline hazards be equal? Explain.
  2. Two transitions contribute information 10 and 15 for a scalar common coefficient. What is the approximate model-based standard error from the combined information?
  3. Why can a transition with many events contribute little information about a covariate coefficient?
  4. A common model gives a smaller standard error than separate transition models. What assumption is essential to interpreting this as a valid precision gain?
  5. Why can inverse observed information be insufficient for uncertainty estimation when individuals contribute multiple transitions?

Solutions. (1) No. Each transition may retain its own baseline hazard; the constraint concerns the covariate coefficient. (2) The combined information is \(10+15=25\), so \(SE\approx\sqrt{1/25}=0.2000\) coefficient units. (3) If the covariate has little or no variation in the event risk sets, the weighted risk-set variance is small, so the events provide little coefficient information. (4) The coefficient must truly be common across the transitions on the same scale and under the same effect specification. (5) Contributions from the same individual may be dependent; the variance estimator must reflect the subject-level sampling and dependence structure when required.

Clinical Biostats