Why the Outcome and Its Summary Both Matter
A clinical outcome is not yet a complete statement of the treatment effect a trial aims to estimate. “Response,” “symptom change,” and “time to an event” name different kinds of outcomes, but even after choosing one, the trial must specify which feature of its distribution will be compared between treatment conditions. For a binary response, for example, a difference in response probabilities and a ratio of those probabilities are distinct summaries. They answer related but nonidentical questions.
This distinction matters in an adaptive trial because a change to the outcome definition or to its summary can change the scientific target, even if the treatment arms and target population stay fixed. The earlier material on the five attributes of an adaptive-trial estimand established that the outcome variable and summary measure are separate parts of the estimand. Here we make that distinction precise and apply it to three common clinical outcome types.
Write \(Y^a\) for the outcome that would be observed for a participant under treatment condition \(a\), and let \(P^*\) denote the fixed target population. A treatment effect may be defined as a contrast between summaries of the distributions of \(Y^a\) in that population. The symbol \(Y^a\) represents the outcome variable; the function applied to its distribution determines the summary measure. A change in either one can change the estimand.
To define an outcome adequately, name the clinical construct, measurement scale, and assessment time or period. “Blood pressure” alone is incomplete if it is unclear whether the outcome is systolic or diastolic pressure, the units, and when it is measured. Similarly, “event-free survival” needs a specified event and a time horizon for summaries that depend on time. The summary then states how the treatment conditions are compared on the defined outcome.
Binary Outcomes: Risks and Contrasts
For a binary outcome measured at a specified time, let \(Y^a=1\) indicate that a participant meets the defined response criterion under treatment \(a\), and \(Y^a=0\) otherwise. The response risk in the target population is \(P(Y^a=1)\). That risk is a summary for one treatment condition; a treatment effect compares the risks between conditions.
Common contrasts include the risk difference, risk ratio, and odds ratio. Each uses the same binary outcome variable but summarizes its distribution differently. Their numerical values and interpretations are not interchangeable. The risk difference is expressed in percentage points when risks are reported as proportions; the risk ratio and odds ratio are dimensionless.
Worked Example: Three Summaries of a Binary Response
In a hypothetical randomized trial, response is defined as a reduction of at least 30% in a symptom score by week 12. All 120 participants assigned to each treatment condition have a week-12 response assessment. Suppose 54 participants respond under the new treatment and 42 respond under control. The outcome variable is the binary week-12 response, with the same criterion applied in both groups.
The estimated risks are \(54/120=0.450\) under the new treatment and \(42/120=0.350\) under control. The estimated risk difference is
Thus, the estimated response probability is 10.0 percentage points higher under the new treatment than under control in this hypothetical trial. The estimated risk ratio is
The estimated response probability is therefore 1.286 times as large under the new treatment. For comparison, the estimated odds ratio is
This says the estimated odds of response are 1.519 times as large under the new treatment. It does not say that the response probability is 1.519 times as large. These are three summaries of the same binary outcome, not three different outcomes. The example gives point estimates only; without additional information, it does not establish the precision or statistical significance of any contrast.
The response criterion and assessment time are part of the outcome definition: changing the threshold or moving the assessment from week 12 to week 24 defines a different outcome variable. Choosing a risk ratio instead of a risk difference, while holding the response definition fixed, changes the summary measure. Either change alters the estimand and can alter the clinical interpretation.
Continuous Outcomes: Change and Its Summary
For a continuous clinical measurement, the outcome variable might be the value at a fixed visit or the change from baseline to that visit. These are not automatically the same variable. If \(Y_0\) is the baseline measurement and \(Y_\tau\) is the measurement at the specified follow-up time \(\tau\), a change outcome can be defined as \(C=Y_\tau-Y_0\). Its summary might be the population mean change in each treatment condition, with a treatment effect defined as the difference between those means.
The sign of a change depends on the subtraction order and the clinical scale. If larger scores mean worse symptoms and change is follow-up minus baseline, a negative mean change indicates improvement. State both the units and the direction of benefit rather than relying on a sign alone.
Worked Example: Difference in Mean Symptom Change
In a hypothetical randomized study, a symptom score ranges from 0 to 40, with higher scores indicating worse symptoms. The outcome variable is change from baseline to week 8, calculated as week-8 score minus baseline score. Suppose 100 participants per group have complete measurements. The new-treatment group has a mean baseline score of 22.0 points and a mean week-8 score of 14.0 points; the control group has corresponding means of 21.5 and 17.0 points.
The mean change in the new-treatment group is \(14.0-22.0=-8.0\) points. The mean change in the control group is \(17.0-21.5=-4.5\) points. The estimated difference in mean change, new treatment minus control, is
On this scale, both groups improved on average, and the estimated improvement was 3.5 points greater under the new treatment. This is a difference in mean changes, not a statement that every participant improved by 3.5 points. The group summaries alone do not provide the standard error or an interval for the estimated effect.
An endpoint value at week 8 is a different outcome variable from change through week 8. In a randomized target population, the expected baseline value is the same under either assigned treatment condition, so the population contrast in mean change equals the population contrast in mean week-8 values when the same baseline definition applies:
The middle equality uses the same target-population baseline mean in both conditions. This does not make endpoint and change outcomes identical participant by participant, nor does it imply their estimates have the same precision. It shows why their population mean contrasts can coincide under that condition, while the outcome definition still needs to be explicit.
Time-to-Event Outcomes: Time Horizon and Summary
A time-to-event outcome records the elapsed time from a defined origin to a specified event. Its distribution can be summarized in several ways. For example, \(S_a(t)=P(T^a>t)\) is the probability of remaining event-free beyond time \(t\) under treatment \(a\). A contrast in \(S_a(\tau)\) compares event-free probabilities at a fixed horizon \(\tau\). Another summary is the restricted mean survival time (RMST) through \(\tau\), which expresses the expected event-free time accumulated up to that horizon.
Worked Example: Comparing Restricted Mean Event-Free Time
Consider a hypothetical trial with four participants in each treatment group and complete event-time observation through 6 months. There is no censoring before 6 months in this small illustration. Under the new treatment, events occur at months 2 and 5; the other two participants remain event-free through month 6. Under control, events occur at months 1, 3, and 4; one participant remains event-free through month 6.
For the new treatment, the estimated event-free proportion is 1 from month 0 to 2, \(3/4=0.75\) from month 2 to 5, and \(2/4=0.50\) from month 5 to 6. The area under this step curve is
For control, the event-free proportion is 1 from month 0 to 1, 0.75 from month 1 to 3, 0.50 from month 3 to 4, and 0.25 from month 4 to 6. Therefore,
The estimated RMST difference is \(4.75-3.50=1.25\) months in favor of the new treatment: in this hypothetical sample, the estimated mean event-free time accumulated during the first 6 months is 1.25 months greater under the new treatment. The estimated event-free proportions at month 6 are \(0.50\) and \(0.25\), a difference of 0.25. That fixed-time contrast and the RMST contrast summarize the same event-time distributions differently; neither should be reported as though it were the other.
The area interpretation follows from a simple identity. For any nonnegative event time \(T\), the quantity \(\min(T,\tau)\) is the length of the interval from 0 to \(\tau\) during which a participant remains event-free. Equivalently, it is the integral of the indicator that \(T>t\) across that interval. Taking expectations gives
The second equality follows by integrating the expected indicator, which equals \(P(T>t)\). Thus the RMST is not an arbitrary curve summary: it has a direct interpretation as expected event-free time up to the chosen horizon.
Choosing and Preserving the Estimand
Different summaries can be useful for different clinical questions. The choice should be made in a way that matches the question and is stated before interpreting results. The following comparisons illustrate what is being summarized, not which measure is universally best.
| Outcome variable | Summary measure | Interpretation | Units |
|---|---|---|---|
| Binary response by week 12 | Risk difference | Difference in response probabilities | Proportion or percentage points |
| Binary response by week 12 | Risk ratio | Ratio of response probabilities | None |
| Change in symptom score through week 8 | Difference in mean change | Difference in average score change | Score points |
| Time to a defined event through month 6 | Difference in RMST | Difference in mean event-free time accumulated by month 6 | Months |
| Time to a defined event | Difference in event-free probability at month 6 | Difference in probability of remaining event-free past month 6 | Proportion or percentage points |
For an adaptive trial, the key check is whether any change in measurement or analysis preserves the originally defined outcome variable and summary measure. Changing the week-12 response threshold, replacing a week-8 change score with a week-8 endpoint, or changing the time horizon from 6 to 12 months may change the estimand. Changing from a risk difference to a risk ratio also changes it, even if the binary response itself stays fixed. An adaptation that leaves these definitions intact may still change how data are collected or analyzed, but it does not, by that fact alone, change the outcome-and-summary portion of the estimand.
This check is especially important when results from different trial stages are to be interpreted together. If the same clinical label is used for outcomes defined with different thresholds, times, or summary functions, the label can hide a real change in the target. Conversely, explicitly specifying the outcome and summary makes it possible to distinguish an operational change from a change in the intended clinical question.
Diagnostics, Alternatives, and Limitations
A practical diagnostic is to write a one-sentence interpretation of the treatment effect, including the population, outcome, time, contrast direction, and units. If that sentence cannot be written precisely, the estimand may be underspecified. Check that the outcome criterion and assessment schedule are the same across treatment conditions, and that the reported summary matches the one named in the estimand. For time-to-event outcomes, verify that the event and time origin are defined and that a fixed-time or RMST summary includes its horizon.
- Risk difference versus risk ratio: the risk difference describes an absolute change in response probability; the risk ratio describes a relative comparison. A ratio should not be read as a percentage-point increase.
- Change versus endpoint: a mean change and a follow-up mean are different summaries of different outcome variables, even when their population contrasts coincide under specified conditions.
- Fixed-time survival versus RMST: one compares event-free probabilities at a single time; the other compares accumulated event-free time over an interval. The latter requires stating the interval endpoint.
- Outcome labels without definitions: terms such as “response” or “survival” are insufficient unless the event, threshold, timing, and scale are specified.
No summary measure is best for every clinical question. A difference in risks can be easier to interpret in absolute terms, while a ratio may be useful for a relative comparison. A fixed-time event-free probability can answer a focused horizon-specific question; RMST can summarize event-free time over a period. The limitations follow from the choice: each measure emphasizes a different feature of the distribution, and its interpretation should not be stretched beyond that feature. Estimating these quantities precisely also requires appropriate data and analysis; the small, complete-data time-to-event calculation above illustrates the definition rather than a general approach to incomplete follow-up.
Check Your Understanding
Answer each question by naming the outcome variable and the summary measure where relevant. Solutions follow the questions.
- A trial defines response as a 20% symptom-score reduction by week 10. Is a risk difference or a risk ratio the outcome variable, and what does it summarize?
- A score ranges from 0 to 50, with higher scores worse. Mean change from baseline to week 6 is \(-5\) in one group and \(-2\) in control. Calculate the difference in mean change, treatment minus control, and interpret its sign.
- In a time-to-event trial, what additional information is needed to define an RMST contrast?
- Explain how a change from response at week 10 to response at week 20 can affect the estimand, even if the response threshold is unchanged.
Solutions. (1) The outcome variable is binary response by week 10. Risk difference and risk ratio are alternative summary measures: the former compares response probabilities by subtraction, and the latter by division. (2) The difference is \((-5)-(-2)=-3\) score points. Since higher scores are worse, the estimated mean reduction is 3 points greater in the treatment group. (3) Specify the event-time outcome and the horizon \(\tau\) through which event-free time is accumulated, as well as the treatment conditions and target population for the contrast. (4) The assessment time is part of the outcome definition. The two outcomes represent response status at different times, so their distributions and the treatment effect being summarized may differ.