Tutorials › Competing Risks and Multi-State Models › Score Tests for Shared Transition Effects

Regression for Multi-State Data · Tutorial 371 of 699

Score Tests for Shared Transition Effects

Learn how to test whether a covariate has a shared effect across transitions using the restricted fit’s score and efficient information.

Advanced 12 min read

What You'll Learn

  • Express equality of transition-specific coefficients as linear restrictions on a regression parameter.
  • Calculate a score statistic from the restricted model’s score and information.
  • Adjust the information for nuisance parameters using a Schur complement.
  • Determine the test’s degrees of freedom and interpret its p-value.
  • Recognize when sparse events, weak information, or model misspecification undermine the test.
  • Distinguish a score test from Wald and likelihood-ratio approaches.

Why Test for a Shared Transition Effect?

A covariate may have a different association with the hazard of each transition. For example, a treatment indicator might have separate regression coefficients for progression and death. A shared-effect model assumes these coefficients are equal. A score test asks whether the data provide evidence against that restriction, using the fit under the shared-effect assumption rather than fitting the fully transition-specific model.

The test is especially useful when the shared-effect model is relatively simple to fit, while the unrestricted model has many transition-specific parameters. Its central calculation is the score and information evaluated at the restricted fit. The resulting statistic measures how strongly the likelihood points away from the shared-effect restriction, after accounting for nuisance parameters.

Model, Hypothesis, and Assumptions

Definition: Suppose a regression model has coefficient vectors \(\beta_j\) for a covariate on \(K\) transitions. The shared-effect null hypothesis is \(H_0:\beta_1=\cdots=\beta_K\). It imposes \(q=(K-1)p\) independent restrictions when each coefficient vector has \(p\) components and all are estimable. The score test evaluates whether the likelihood has a significant direction of increase away from these restrictions, at the restricted maximum-likelihood estimate.

For clarity, parameterize the unrestricted model with a shared coefficient \(\beta\) and deviations \(\delta_2,\ldots,\delta_K\): set \(\beta_1=\beta\) and \(\beta_j=\beta+\delta_j\) for \(j=2,\ldots,K\). Equality is then the null hypothesis \(\delta=0\), where \(\delta\) stacks all deviation coefficients. Let \(\gamma\) collect nuisance parameters, including the shared coefficient and any transition-specific baseline or other nuisance terms. Write the log likelihood as \(\ell(\gamma,\delta)\).

The score \(U\) is the vector of first derivatives of \(\ell\), and the expected information \(I\) is the negative expected second-derivative matrix. The observed information, the negative Hessian evaluated at the fitted parameters, is also used in standard implementations. The model and information calculation must be specified consistently.

$$ U(\gamma,\delta)= \begin{pmatrix}U_\gamma\\U_\delta\end{pmatrix}, \qquad I(\gamma,\delta)= \begin{pmatrix} I_{\gamma\gamma}&I_{\gamma\delta}\\ I_{\delta\gamma}&I_{\delta\delta} \end{pmatrix}. $$

The usual large-sample score test assumes a correctly specified likelihood, a well-defined restricted maximum-likelihood estimate, differentiability near that estimate, and nonsingular information for the tested directions after nuisance adjustment. Independent subjects, or a correctly specified likelihood for their contributions, are needed for the conventional model-based reference distribution. The transition risk sets and covariate histories must also be represented correctly. In a piecewise-exponential model, for example, the person-time exposure and event counts must correspond to the stated intervals and transition risks.

The restrictions must be identifiable: the data must contain information that distinguishes the transition-specific coefficients. A coefficient for a transition with no events, or with no covariate variation in its risk set, may not be estimable. In that situation, the nominal number of restrictions is not automatically the test’s degrees of freedom.

Deriving the Score Statistic

Fit the model under \(H_0\), obtaining the restricted estimate \(\tilde{\gamma}\) with \(\delta=0\). Because \(\tilde{\gamma}\) maximizes the restricted likelihood, its nuisance score satisfies \(U_\gamma(\tilde{\gamma},0)=0\). The tested score \(U_\delta(\tilde{\gamma},0)\), however, need not be zero: it records the local direction in which freeing the transition deviations could improve fit.

The nuisance parameters can change as the deviations move away from zero. To account for that, use a local quadratic expansion of the log likelihood around the restricted estimate. For small changes \(a\) in \(\gamma\) and \(d\) in \(\delta\), its change is approximately \(U_\delta^\mathsf{T}d-\frac12(a^\mathsf{T}I_{\gamma\gamma}a+2a^\mathsf{T}I_{\gamma\delta}d+d^\mathsf{T}I_{\delta\delta}d)\). Maximizing this quadratic over the nuisance change gives \(a=-I_{\gamma\gamma}^{-1}I_{\gamma\delta}d\). Substitution shows that the information for the tested direction, after allowing nuisance parameters to adjust, is the Schur complement below.

$$ I_{\delta\cdot\gamma} =I_{\delta\delta} -I_{\delta\gamma}I_{\gamma\gamma}^{-1}I_{\gamma\delta}. $$

This adjustment removes information about \(\delta\) that is attributable to its association with nuisance parameters. At the restricted estimate, the nuisance score is zero, so the efficient score for \(\delta\) is \(U_\delta\) itself. The score statistic and its usual large-sample reference distribution are:

Theorem: Under \(H_0\) and the regularity and identifiability conditions above, the score statistic \(Q=U_\delta^\mathsf{T}I_{\delta\cdot\gamma}^{-1}U_\delta\), evaluated at \((\tilde{\gamma},0)\), is approximately distributed as \(\chi^2_q\), where \(q\) is the rank of the tested restriction after nuisance adjustment. Large values count against the shared-effect null. The p-value is the upper-tail probability \(P(\chi^2_q\ge Q)\).

With a scalar tested parameter \(\delta\) and a scalar nuisance parameter \(\theta\), the efficient information is \(I_{\delta\delta}-I_{\delta\theta}^2/I_{\theta\theta}\). This simple form makes clear why using \(I_{\delta\delta}\) alone can give an incorrect statistic: it ignores the nuisance adjustment.

Worked Example: One Restriction With a Nuisance Parameter

In a hypothetical transition-regression analysis, a restricted fit tests one deviation \(\delta\) from a shared coefficient. At the restricted estimate, the data-based score and information summaries are \(U_\delta=2.4\), \(I_{\delta\delta}=13.44\), \(I_{\delta\theta}=13.44\), and \(I_{\theta\theta}=36\), where \(\theta\) is a nuisance parameter. Assume the specified likelihood is appropriate and the information is nonsingular.

First adjust for \(\theta\):

$$ I_{\delta\cdot\theta} =13.44-\frac{13.44^2}{36} =13.44-\frac{180.6336}{36} =13.44-5.0176 =8.4224. $$

The one-degree-of-freedom statistic is \(Q=2.4^2/8.4224=5.76/8.4224\approx0.6839\). Its chi-square upper-tail p-value is approximately \(0.408\). At significance level \(0.05\), this is not evidence against equality. The conclusion is not that the coefficients are proven equal; this test has not found sufficient evidence of a difference.

Worked Tests With Multiple Restrictions

For several restrictions, the efficient information is a matrix and the score statistic combines their directions. The degrees of freedom are the rank of the tested information, not necessarily the number of transitions by itself. They equal \((K-1)p\) only when all the intended transition contrasts are estimable.

Worked Example: Two Transition Contrasts

Suppose a hypothetical model for three transitions tests whether a two-component covariate has the same coefficient vector on all three. The restricted fit yields efficient score \(U_\delta=(1.8,1.2)^\mathsf{T}\) and efficient information \(I_{\delta\cdot\gamma}=\operatorname{diag}(1,1.527)\). These are summaries from the hypothetical fitted likelihood; assume both components are identifiable.

The statistic is:

$$ Q= \begin{pmatrix}1.8&1.2\end{pmatrix} \begin{pmatrix}1&0\\0&1/1.527\end{pmatrix} \begin{pmatrix}1.8\\1.2\end{pmatrix} =3.24+\frac{1.44}{1.527} \approx3.24+0.9430 =4.183. $$

There are two tested components, so the reference distribution is \(\chi^2_2\). For two degrees of freedom, its upper tail is \(e^{-Q/2}\), giving \(p=e^{-4.183/2}\approx0.1235\). At the \(0.05\) level, the result does not reject the shared-effect restriction.

Worked Example: A Three-Degree-of-Freedom Test

In another hypothetical analysis, transition-specific coefficients are compared through three estimable restrictions. At the restricted fit, suppose the efficient information is the identity matrix and the score vector is \((1,1,\sqrt{5.2})^\mathsf{T}\). This simple information structure is assumed for illustration; the restrictions are identifiable and the likelihood assumptions are taken to hold.

The score statistic is:

$$ Q=1^2+1^2+(\sqrt{5.2})^2=1+1+5.2=7.20. $$

Compare this with \(\chi^2_3\), because there are three independent restrictions. The upper-tail p-value is approximately \(0.0658\). Since \(0.0658>0.05\), the test does not reject equality at the \(0.05\) level, although the evidence is closer to that threshold than in the preceding example.

Practical Interpretation, Diagnostics, and Alternatives

The score test is attractive because it requires the restricted fit but not the unrestricted maximum-likelihood estimate. It is a local test: it assesses the likelihood’s slope in the directions that would separate the transition effects. Like other large-sample tests, it can be unreliable when event counts are sparse, when a tested coefficient is near a boundary or poorly identified, or when information is nearly singular. A finite score statistic does not fix these problems.

Check that the restricted model converged, that event and exposure records were constructed correctly for every transition, and that the tested information matrix is positive definite in the directions being tested. Very large standard errors, extreme fitted coefficients, or a rank-deficient information matrix indicate that the nominal chi-square calculation may not be trustworthy. Also check substantive model assumptions such as the chosen baseline hazard form and covariate specification; a score test of equality does not validate those assumptions.

The likelihood-ratio test compares maximized likelihoods under restricted and unrestricted models, while the Wald test evaluates the estimated unrestricted coefficient contrasts relative to their estimated uncertainty. In regular large samples the three tests are often similar, but they can differ in finite samples. The score test avoids relying on a potentially unstable unrestricted estimate, whereas a Wald test requires it. None of these tests makes a poorly specified transition model correct. For clustered or otherwise dependent transition contributions, the model-based information and chi-square calibration may fail unless the likelihood properly represents that dependence; an appropriate variance and testing procedure must be chosen for the sampling structure.

Common pitfall: Using \(U_\delta^\mathsf{T}I_{\delta\delta}^{-1}U_\delta\) without adjusting for nuisance parameters treats those parameters as fixed. The score test generally requires \(I_{\delta\cdot\gamma}\), the Schur complement. Another error is counting all transition coefficients as restrictions: test only the independent equality contrasts, and use their estimable rank for the degrees of freedom.

The p-value is the probability, under the shared-effect null and the stated model assumptions, of a score statistic at least as large as the observed \(Q\). It is not the probability that the null hypothesis is true. A nonsignificant result indicates insufficient evidence against shared effects, not proof that the effects are identical. The test also does not establish that a covariate causes a transition hazard to change.

Check Your Understanding

Answer each question, then compare with the solutions below.

  1. A model tests four independent equality restrictions and obtains \(Q=9.49\). What is the reference distribution, and what does the p-value represent?
  2. Why is the efficient information not generally just \(I_{\delta\delta}\)?
  3. A two-degree-of-freedom test gives \(Q=4.183\). Compute the upper-tail p-value and state the decision at \(\alpha=0.05\).
  4. What should be checked if the tested information matrix is nearly singular?

Solutions. (1) Use \(\chi^2_4\). The p-value is the probability under the null and model assumptions of obtaining a statistic at least \(9.49\). (2) Nuisance parameters can adjust when the tested effects change, so the information must account for their association through \(I_{\delta\gamma}I_{\gamma\gamma}^{-1}I_{\gamma\delta}\). (3) \(p=e^{-4.183/2}\approx0.1235\), so do not reject at \(0.05\). (4) Check convergence, event and risk-set data, covariate variation, and whether the restrictions are identifiable; the nominal chi-square test may not be reliable if information is deficient.

Clinical Biostats