Tutorials › Joint Modeling of Longitudinal and Time-to-Event Data › Clinical Decision Stability Across Link Choices

Sensitivity to the Association Structure · Tutorial 238 of 697

Clinical Decision Stability Across Link Choices

You will learn to compare clinical threshold decisions across association links using a common estimand, uncertainty intervals, and explicit stability categories.

Advanced 12 min read

What You'll Learn

  • Define a common clinical trajectory contrast across candidate association links
  • Translate a prespecified hazard-ratio threshold to the log-hazard scale
  • Distinguish point-estimate decisions from decisions that account for uncertainty
  • Classify conclusions as stable, changing, or indeterminate across links
  • Diagnose misleading comparisons caused by different contrasts or weak model fits
  • Interpret Wald intervals and their limitations in a link-sensitivity analysis

Why Decision Stability Is a Separate Question

Several association links can describe how a longitudinal biomarker relates to event risk. A current-value link, a threshold link, or a slope-based link may give different estimates even when each is scientifically plausible. The practical question here is not which link wins a model comparison, nor which link gives the preferred patient ranking. It is whether the same prespecified clinical conclusion follows under the plausible links.

That question requires more than checking whether estimated coefficients have the same sign. A clinical decision is tied to a particular contrast and a threshold. For example, a decision might concern whether a specified difference between two biomarker trajectories corresponds to a hazard ratio above 1.5 at month 12. Changing the contrast, time point, or threshold changes the question being answered.

Define the Contrast and Decision Rule First

Definition: For candidate link \(k\), let \(A_k(z,t)\) be the association contribution to the log hazard for biomarker trajectory \(z\) at time \(t\). For two prespecified trajectories, a reference trajectory \(z_R\) and a clinically higher-risk trajectory \(z_H\), define the log-hazard contrast at a prespecified time \(t^*\) as \(\delta_k=A_k(z_H,t^*)-A_k(z_R,t^*)\). The corresponding hazard ratio is \(HR_k=\exp(\delta_k)\), comparing \(z_H\) with \(z_R\) at \(t^*\), with other model terms held fixed.

In a shared-random-effects joint model, this contrast is commonly interpreted conditionally on the shared random effects and the specified covariates. It is not automatically a population-marginal hazard ratio. If the scientific question instead targets a marginal contrast, that target and its calculation must be specified consistently for every link.

The two trajectories must be defined in a way that makes sense across the candidate links. For instance, a trajectory contrast can specify both the biomarker values and their time pattern. A difference of 5 mg/L at month 12 is not necessarily a common contrast for a current-value link and a slope link: parallel trajectories can differ in current value while having the same slope. If the links do not represent the same contrast, apparent decision instability may simply mean that different questions were compared.

Suppose the prespecified clinical threshold is \(HR^*=1.5\). On the log-hazard scale, this becomes \(c=\log(1.5)\), approximately 0.4055. A point-estimate rule labels the contrast clinically important when \(\hat{\delta}_k>c\). Because estimates are uncertain, a second, more cautious rule uses an interval: label the contrast above threshold if the entire interval lies above \(c\), below threshold if the entire interval lies below \(c\), and indeterminate if it includes \(c\). These are different decision rules; they should not be interchanged after looking at the results.

Uncertainty and a Practical Stability Classification

For a fitted link \(k\), suppose \(\hat{\delta}_k\) estimates the specified contrast and \(SE_k\) is its standard error. Under the usual large-sample approximation that the estimator is approximately normal with a correctly estimated standard error, a 95% Wald interval on the log scale is

$$ \hat{\delta}_k \pm 1.96 SE_k. $$

The endpoints are symmetric about \(\hat{\delta}_k\). Exponentiating both endpoints gives a 95% interval for the hazard ratio, since the exponential function is increasing. This approximation may be unreliable with weak identification, small samples, poor convergence, or an imprecise standard error; an interval from a different method need not be symmetric on the log scale.

For the interval-based rule, compare each log-scale interval with the same threshold \(c\). Across links, the decision is stable above threshold if every candidate interval lies above \(c\), stable below threshold if every interval lies below \(c\), and not stable if the classifications differ. If intervals straddle \(c\), report the affected link decisions as indeterminate rather than forcing a binary conclusion. A point-estimate comparison can also be reported, but it answers a less cautious question.

Worked Example: Stable Evidence Above the Clinical Threshold

Suppose a hypothetical analysis prespecifies a trajectory contrast at month 12 and a clinical threshold of \(HR^*=1.5\). Two plausible links produce estimates \(\hat{\delta}_A=0.55\), \(SE_A=0.07\), and \(\hat{\delta}_B=0.62\), \(SE_B=0.08\). Assume both models converged adequately, the standard errors are appropriate, and the estimates refer to the same contrast.

The threshold is \(c=\log(1.5)=0.4055\). For link A, the 95% Wald interval is \(0.55\pm1.96(0.07)=0.55\pm0.1372\), or \((0.4128,0.6872)\). Its lower endpoint exceeds 0.4055. The estimated hazard ratio is \(\exp(0.55)=1.733\), and exponentiating the interval gives approximately \((1.511,1.988)\).

For link B, the interval is \(0.62\pm1.96(0.08)=0.62\pm0.1568\), or \((0.4632,0.7768)\). This also lies entirely above the threshold. Its estimated hazard ratio is \(\exp(0.62)=1.859\), with interval approximately \((1.589,2.174)\).

Under the stated interval rule, both links support a hazard ratio above 1.5 for this contrast at month 12. The clinical conclusion is stable above threshold across these two links. This does not establish that the association is causal, or that the conclusion would persist under every possible link or at every time.

Why the Scale and Contrast Must Be Checked

Candidate links often use different functions of the biomarker or its trajectory. A coefficient in a current-value link may describe a one-unit increase in the current biomarker; a slope-link coefficient may describe a unit change in rate per unit time. Those coefficients are not directly comparable simply because they appear in the same position in two model equations. The contrast \(\delta_k\), not the raw association coefficient, is the relevant quantity for the threshold decision.

For a linear current-value association contribution \(A_k(z,t)=\alpha_k m_z(t)\), where \(m_z(t)\) is the biomarker value for trajectory \(z\), the contrast is \(\delta_k=\alpha_k\{m_{z_H}(t^*)-m_{z_R}(t^*)\}\). For a nonlinear link it is the difference of the two transformed values, multiplied or otherwise combined with the model parameters as specified by that link. In either case, the contrast must be computed from the fitted model rather than assumed to equal one reported coefficient.

A threshold link may imply that a small change within one biomarker range has a different association contribution from a change that crosses the threshold. A time-varying association can also make the contrast depend on \(t^*\). Therefore, the clinical time point and trajectory pair should be fixed before comparing results. If the intended decision concerns a time interval rather than a single time, define a suitable time-summary estimand in advance and use it for every link.

Worked Example: Point Decisions Change, but Intervals Are Indeterminate

In a second hypothetical comparison, use the same \(HR^*=1.5\) threshold and the same prespecified contrast. Link A gives \(\hat{\delta}_A=0.30\), \(SE_A=0.06\); link B gives \(\hat{\delta}_B=0.50\), \(SE_B=0.05\). Assume adequate fitting and standard-error estimation as in the previous example.

The point estimates fall on opposite sides of \(c=0.4055\): \(0.30<0.4055\), while \(0.50>0.4055\). Their hazard-ratio estimates are \(\exp(0.30)=1.350\) and \(\exp(0.50)=1.649\). Thus, the point-estimate decision changes with the link.

For link A, the interval is \(0.30\pm1.96(0.06)=0.30\pm0.1176\), giving \((0.1824,0.4176)\). For link B, it is \(0.50\pm1.96(0.05)=0.50\pm0.0980\), giving \((0.4020,0.5980)\). Each interval includes the threshold 0.4055. The interval-based classification is therefore indeterminate under both links, not “above” for B and “below” for A.

The appropriate report distinguishes the two findings: the point-estimate rule yields a changing decision, while the interval rule yields uncertainty about threshold status for both links. Neither result justifies claiming that the true hazard ratio is below threshold under A and above it under B.

Checking Stability Below the Threshold

A stable conclusion need not be a stable positive finding. If every plausible link places the uncertainty interval below the clinical threshold, the evidence is stable against the specified level of clinical importance. This does not necessarily mean the hazard ratio equals 1: it may indicate an association that is positive but smaller than the prespecified threshold.

Worked Example: Stable Evidence Below the Clinical Threshold

Consider two more hypothetical estimates for the same contrast and \(HR^*=1.5\): link A has \(\hat{\delta}_A=0.20\), \(SE_A=0.04\); link B has \(\hat{\delta}_B=0.25\), \(SE_B=0.05\). Suppose both models satisfy the fitting and standard-error conditions for the Wald approximation.

For A, the interval is \(0.20\pm1.96(0.04)=0.20\pm0.0784\), or \((0.1216,0.2784)\). Its upper endpoint is below 0.4055. The estimated hazard ratio is \(\exp(0.20)=1.221\), with interval approximately \((1.129,1.321)\).

For B, the interval is \(0.25\pm1.96(0.05)=0.25\pm0.0980\), or \((0.1520,0.3480)\), also entirely below the threshold. The estimated hazard ratio is \(\exp(0.25)=1.284\), with interval approximately \((1.164,1.416)\).

The interval-based conclusion is stable below the 1.5 threshold for these two links. The intervals do not establish no association: their log-scale estimates are positive. They indicate that, under the model and approximation, the specified contrast does not reach the prespecified hazard-ratio threshold.

Diagnostics, Alternatives, and Limitations

Before interpreting a stability classification, verify that the candidate models estimate the same clinical contrast, on the same biomarker scale, at the same time or over the same prespecified time summary. Check that the threshold was chosen for clinical reasons rather than selected to make results agree. Review convergence, standard errors, and interval endpoints; a numerically narrow interval from a poorly fitting or weakly identified model can give false reassurance.

A useful reporting table lists, for each link, the contrast definition, \(\hat{\delta}_k\), its standard error, the log-scale interval, the exponentiated hazard ratio and interval, and the threshold classification. It makes it possible to see whether a conclusion is stable because all estimates are far from the threshold or merely because rounded values obscure a borderline result. Avoid treating overlap between two confidence intervals as a formal test that the link-specific estimates are equal. The purpose here is to assess decisions relative to a clinical threshold, not to test equality between models.

Several alternatives answer different questions. A likelihood comparison assesses relative fit under specified models; it does not by itself determine whether a clinical threshold decision is robust. Model averaging combines information across candidate links according to a stated procedure, whereas this analysis displays the decisions link by link. A single selected link gives a decision conditional on that choice and can conceal sensitivity. None of these approaches replaces the need to define a common contrast.

The classification is limited to the candidate links, fitted data, covariate specification, and uncertainty method considered. It does not account automatically for every source of model uncertainty, and a 95% interval is not a 95% probability that the fixed parameter lies inside that particular interval. Strong stability across several plausible links is useful evidence of robustness, not a guarantee of correctness or a causal conclusion.

Common Pitfall

Common mistake: “The association coefficient is positive under both links, so the clinical decision is stable.” A positive coefficient can correspond to hazard ratios on opposite sides of a clinically important threshold, and coefficients may refer to different units or trajectory features. Correction: calculate each link’s hazard-ratio contrast for the same prespecified clinical comparison, transform the common threshold to the log scale, and apply the declared decision rule to estimates and uncertainty intervals.
Key takeaway: Clinical decision stability is a comparison of threshold classifications for one common, prespecified estimand. Report whether point decisions and uncertainty-aware decisions agree across links, and call a result indeterminate when its interval crosses the threshold.

Check Your Understanding

Answer each question, then compare your reasoning with the solutions below.

  1. A clinical threshold is \(HR^*=1.4\). A link gives \(\hat{\delta}=0.34\) with \(SE=0.03\). What are the point-estimate and 95% Wald interval classifications?
  2. For a threshold \(HR^*=1.5\), one link has interval \((0.38,0.52)\) on the log scale and another has \((0.42,0.61)\). Are the interval-based conclusions stable above threshold?
  3. Why is it not enough to compare the association coefficients from a current-value link and a slope link?
  4. What log-scale threshold corresponds to \(HR^*=1.8\), approximately?
  5. Does stability below an \(HR^*=1.5\) threshold prove that the biomarker has no association with the hazard?

Solutions. (1) The threshold is \(\log(1.4)=0.3365\). The point estimate 0.34 is just above it. The interval is \(0.34\pm1.96(0.03)=0.34\pm0.0588\), or \((0.2812,0.3988)\), which crosses the threshold; the interval classification is indeterminate. (2) The first interval crosses \(0.4055=\log(1.5)\), while the second lies entirely above it. The classifications are indeterminate and above, so they are not stable. (3) The coefficients can represent different biomarker units or trajectory features. Compute the same prespecified clinical contrast under each link before comparing threshold decisions. (4) \(\log(1.8)\approx0.5878\). (5) No. It means the uncertainty interval is below the specified clinical threshold under the stated rule; a smaller nonzero association may still be present.

Clinical Biostats