Tutorials › Multi-Arm Multi-Stage (MAMS) Designs › Prognostic Association With the Final Endpoint

Time-to-Event MAMS With Intermediate Outcomes · Tutorial 303 of 499

Prognostic Association With the Final Endpoint

Learn to quantify how an intermediate outcome is associated with subsequent event risk while keeping that prognostic association distinct from evidence about treatment effects.

Advanced 12 min read

What You'll Learn

  • Define a landmark population and subsequent-event risk for a specified time horizon.
  • Quantify prognostic association using risk differences, risk ratios, odds ratios, and regression coefficients.
  • Explain why marker associations should be examined within treatment arms or adjusted for treatment.
  • Interpret model-based marker associations without giving them a causal meaning.
  • Identify follow-up, censoring, model-fit, and selection issues that can distort an association.
  • Distinguish prediction of individual event risk from evidence that treatment effects are captured.

Why Prognostic Association Needs a Clear Target

In a multi-arm, multi-stage trial, an intermediate outcome may be available before the final time-to-event endpoint is mature. It is useful to know whether that intermediate outcome is associated with the later event: for example, whether patients with a poor early response tend to experience the event sooner or more often over a specified follow-up period. That is a prognostic question about patients’ subsequent outcomes.

It is not, by itself, a question about whether treatment effects on the intermediate outcome reflect treatment effects on the final endpoint. A marker can identify patients at higher risk while failing to capture differences between treatments. The association described here is therefore a patient-level relationship, defined for a specific population, treatment context, and time horizon.

Definition: Let \(A\) denote randomized treatment arm, \(M\) an intermediate outcome measured at landmark time \(\tau\), and \(T\) the time from randomization to the final event. For patients with \(T>\tau\), define the subsequent-event indicator for horizon \(u>0\) as \(Z=I(\tau<T\leq \tau+u)\). The landmark risk at marker value \(m\) in arm \(a\) is \(P(Z=1\mid T>\tau,M=m,A=a)\). A prognostic association describes how this risk varies with \(m\), within a stated arm or after adjustment for arm and other specified covariates.

This definition makes the target population explicit: patients who are event-free at \(\tau\) and have an observed intermediate outcome. The association need not describe patients who experienced the event before the landmark. It also depends on the chosen horizon \(u\); a marker may be associated with near-term risk but less informative about risk over a longer period.

For a binary marker, useful descriptive measures include the risk difference, risk ratio, and odds ratio. For instance, the risk difference compares the event probabilities in the two marker groups, while the risk ratio divides one probability by the other. These are association measures, not effects of intervening to change the marker.

Assumptions and Interpretation

Before calculating an association, specify the landmark, marker measurement, event definition, and follow-up horizon. The marker must be measured by the landmark, and the subsequent event window must begin after it. Use a consistent event definition and ascertainment process across marker groups and treatment arms.

A simple comparison of observed risks is most directly interpretable when subsequent event status is known for all eligible patients through the horizon. If some patients are censored before \(\tau+u\), treating them as event-free is generally incorrect. A valid analysis then needs a method that accounts for censoring and assumptions about the censoring process; the risk calculations below assume complete ascertainment through the specified horizon.

Describing an association does not require the marker to be randomized, nor does it require causal exchangeability between marker groups. It does require care about what population is being described. In particular, conditioning on being event-free at \(\tau\) defines a landmark-survivor population; it may differ across arms if treatment affects events before \(\tau\). If the marker is affected by treatment, its distribution may also differ across arms. Neither issue is resolved by merely pooling participants.

For an adjusted model, the functional form and included covariates must be stated. A model that assumes one common marker association across arms should be checked for departures from that assumption. Adequate observations across marker values and covariate patterns are also needed; sparse or empty groups can make estimated associations unstable or impossible to identify.

Risk Contrasts and a Simple Derivation

For a binary marker, let \(p_1\) be the subsequent-event risk for \(M=1\) and \(p_0\) the risk for \(M=0\), in a specified arm and landmark population. The risk difference is \(p_1-p_0\), the risk ratio is \(p_1/p_0\) when \(p_0>0\), and the odds ratio compares the odds \(p/(1-p)\) between groups.

The odds ratio has a direct connection to logistic regression. Suppose that, within a treatment arm and at fixed values of other covariates, the model is \(\operatorname{logit}\{P(Z=1\mid M,A,X,T>\tau)\}=\beta_0+\beta_M M+\beta_A A+\beta_X X\), with no marker-by-arm interaction. The logit is the logarithm of the odds. Increasing \(M\) from 0 to 1 changes the model’s log odds by \(\beta_M\), so exponentiating gives the conditional odds ratio:

$$ \frac{\operatorname{odds}(Z=1\mid M=1,A,X,T>\tau)} {\operatorname{odds}(Z=1\mid M=0,A,X,T>\tau)} = \frac{\exp(\beta_0+\beta_M+\beta_A A+\beta_X X)} {\exp(\beta_0+\beta_A A+\beta_X X)} =\exp(\beta_M). $$

This result follows from the stated model, including its assumption that the marker coefficient does not vary with arm or \(X\). The odds ratio is not a risk ratio, and the same odds ratio can correspond to different risk differences at different baseline risks. If marker associations plausibly vary by arm, an interaction or arm-specific estimates are needed rather than interpreting one common coefficient.

Worked Example: Comparing Risks for a Binary Intermediate Outcome

In a hypothetical trial, consider patients in one treatment arm who were event-free at the landmark and had complete event follow-up for the next year. Among 100 patients with a positive intermediate marker, 40 had the final event. Among 100 with a negative marker, 15 had the event. Calculate and interpret three association measures.

The risks are \(p_1=40/100=0.400\) and \(p_0=15/100=0.150\). The risk difference is \(0.400-0.150=0.250\), or 25.0 percentage points. In this hypothetical arm and landmark population, the positive-marker group had a 25.0-percentage-point higher one-year event risk.

The risk ratio is \(0.400/0.150=2.67\). Thus, the observed one-year risk was 2.67 times as high for the positive-marker group as for the negative-marker group.

The odds ratio is \((40/60)/(15/85)=(40\times85)/(60\times15)=3400/900=3.78\). The odds of the event were 3.78 times as high in the positive-marker group. This is an odds comparison, not a statement that its risk was 3.78 times as high. None of these contrasts shows that changing the marker would change a patient’s risk.

Why Treatment Arm Must Be Considered

A pooled marker–event association can reflect differences in treatment-arm composition rather than the association within an arm. This matters in multi-arm trials because arms can have different event risks, and the intermediate outcome may have different distributions across arms. A useful first analysis is therefore to examine risks separately by arm. If a single summary is needed, it should use an explicit adjustment or standardization strategy and state its target population.

For example, a standardized risk can average the arm-specific risks using the same arm weights for each marker group. With two arms and equal weights, the standardized risk for marker value \(m\) is the average of the two risks for that marker value. This removes differences in arm weights from the descriptive comparison, but it does not turn the marker association into a causal effect.

Worked Example: A Pooled Association Reverses the Within-Arm Pattern

Consider hypothetical counts among landmark-eligible patients with complete follow-up. In the control arm, 90 of 900 patients with \(M=0\) had the event, while 20 of 100 with \(M=1\) had it. In the experimental arm, 1 of 100 with \(M=0\) had the event, while 18 of 900 with \(M=1\) had it. Calculate the risks within arms and after pooling.

In the control arm, the risks are \(90/900=0.100\) for \(M=0\) and \(20/100=0.200\) for \(M=1\). In the experimental arm, they are \(1/100=0.010\) and \(18/900=0.020\), respectively. In each arm, risk is higher for \(M=1\): the within-arm risk differences are \(0.100\) and \(0.010\).

After pooling, the \(M=0\) group has \(91\) events among \(1{,}000\) patients, giving risk \(91/1{,}000=0.091\). The \(M=1\) group has \(38\) events among \(1{,}000\), giving risk \(38/1{,}000=0.038\). The pooled risk difference is \(0.038-0.091=-0.053\): the pooled data suggest lower risk for \(M=1\), opposite to the pattern in each arm.

The reversal occurs because the \(M=0\) group contains 900 control-arm patients but only 100 experimental-arm patients, whereas the \(M=1\) group has the reverse arm composition. Since event risk differs substantially between arms, the pooled comparison mixes marker and arm differences. With equal arm weights, the standardized risks are \((0.100+0.010)/2=0.055\) for \(M=0\) and \((0.200+0.020)/2=0.110\) for \(M=1\), giving a difference of \(0.055\). The standardized comparison preserves the within-arm direction for this example; it remains an association among landmark-eligible patients, not a causal marker effect.

Regression as an Adjusted Description

When the marker and baseline covariates are continuous or numerous, a regression model can summarize the association while adjusting for measured covariates. For a binary event indicator at the stated horizon, logistic regression models the log odds of that event. For a binary marker, its coefficient gives a conditional odds ratio under the specified model. For a continuous marker, the coefficient describes the change in log odds per unit increase, so the unit must be reported.

Adjustment changes the question from an unadjusted comparison to a conditional association at fixed values of included covariates. It does not guarantee that all relevant differences are controlled, nor does it justify a causal interpretation. The model should include treatment arm, and an interaction should be considered when there is reason to expect the marker association to differ by arm. The analysis should also assess whether the chosen functional form is adequate and whether predicted risks agree reasonably with observed risks.

Worked Example: Interpreting an Adjusted Marker Coefficient

Suppose a hypothetical logistic regression fitted to 600 landmark-eligible trial participants gives \(\operatorname{logit}(p)=-2.0+0.80M-0.60A+0.40X\), where \(M\) is a binary marker, \(A=1\) denotes the experimental arm, and \(X=1\) denotes a baseline risk factor. Assume, for this illustration, that the model has no interactions and that follow-up is complete for the one-year event indicator. Calculate fitted risks for \(X=0\) in each arm and interpret the marker coefficient.

For the control arm with \(M=0\), the linear predictor is \(-2.0\), giving \(p=1/(1+\exp(2.0))=0.119\). With \(M=1\), it is \(-2.0+0.80=-1.20\), giving \(p=1/(1+\exp(1.20))=0.231\).

For the experimental arm with \(M=0\), the predictor is \(-2.0-0.60=-2.60\), giving \(p=1/(1+\exp(2.60))=0.0691\). With \(M=1\), it is \(-2.60+0.80=-1.80\), giving \(p=1/(1+\exp(1.80))=0.142\).

The model’s conditional odds ratio for \(M=1\) versus \(M=0\), at the same arm and baseline-risk-factor value, is \(\exp(0.80)=2.23\). The fitted risks show why that odds ratio should not be reported as a risk ratio: the control-arm risk ratio is about \(0.231/0.119=1.94\), and the experimental-arm risk ratio is about \(0.142/0.0691=2.06\). The coefficient describes prognostic association conditional on the model covariates; it does not show that treatment effects are captured by the marker.

Diagnostics, Alternatives, and Limits

Useful diagnostics are substantive as well as statistical. Check that marker measurement precedes the subsequent event window, follow-up is comparable, and the event counts and denominators are correct. Display arm-specific risks before a pooled estimate. Look for sparse marker-by-arm groups, implausible fitted probabilities, poor calibration, and evidence that the marker relationship is nonlinear or differs by arm. If censoring is substantial, an analysis that assumes everyone without a recorded event remained event-free is not appropriate.

The main alternatives answer related but different descriptive questions. Crude risks are transparent but can be distorted by arm composition or covariate imbalance. Arm-specific risks expose variation across arms but may be imprecise in small groups. Regression can adjust for measured covariates and accommodate continuous markers, but depends on model specification. Standardization gives a comparison for a stated common distribution of arms or covariates; changing that distribution can change the summary.

A strong prognostic association can be useful for identifying patients with higher subsequent event risk, but it does not establish that treatment effects on the intermediate outcome predict treatment effects on the final endpoint. That is a separate surrogacy question. In particular, an association estimated among patients who remain event-free at the landmark is not, without further argument, a measure of how well the marker supports treatment selection across all randomized patients.

Common pitfall: “The intermediate outcome strongly predicts the final event, so selecting the treatment arm with the best intermediate outcome will select the arm with the best final outcome.” This does not follow. Prognostic association compares later risk across patients with different marker values; treatment-effect capture compares treatment effects across arms. Report the former as such, and do not infer the latter from it alone.

Check Your Understanding

Answer each question using the landmark population and time horizon stated in the question. Brief solutions follow.

  1. Among landmark-eligible patients, 24 of 80 with a positive marker and 12 of 80 with a negative marker have the event by one year. Calculate the risk difference and risk ratio.
  2. Why can a pooled marker–event association differ in direction from the association within each treatment arm?
  3. In a logistic model with marker coefficient \(0.50\), what is the conditional odds ratio for a one-unit increase in the marker? Does this mean the event risk increases by 50%?
  4. What population does a landmark risk describe, and why should patients with an event before the landmark not simply be treated as event-free?
  5. Does a strong association between an intermediate outcome and the final event demonstrate that treatment effects on the intermediate outcome capture treatment effects on the final endpoint? Explain.

Solutions. (1) The risks are \(24/80=0.300\) and \(12/80=0.150\). The risk difference is \(0.300-0.150=0.150\), or 15 percentage points; the risk ratio is \(0.300/0.150=2.00\). (2) The marker groups may contain different proportions of treatment arms with different event risks. Pooling can therefore mix arm composition with the within-arm marker association. (3) The odds ratio is \(\exp(0.50)=1.65\). It is an increase in odds, not a 50% increase in risk; the risk change depends on baseline risk. (4) It describes patients who are event-free at the landmark and have the marker measured, followed over the specified subsequent horizon. Those who had an event earlier are not at risk for that subsequent event in this landmark population. (5) No. Prognostic association is a patient-level relationship; treatment-effect surrogacy concerns whether treatment effects on the intermediate outcome capture treatment effects on the final endpoint.

Clinical Biostats