Why Define the Estimand Before Comparing Doses?
A dose-finding study can produce many numbers: a mean response at each dose, a difference from a reference dose, a response rate, or a prediction for a patient with specified characteristics. Those numbers answer different questions. Before analyzing data or ranking dose options, specify which population quantity is the target. Otherwise, a calculation may be precise yet answer a question that was never intended.
An estimand is the precise quantity a study seeks to learn. In dose finding, it identifies who the conclusion concerns, which treatment regimens are compared, what outcome is measured, and when that outcome is assessed. A separate decision rule may then use the estimand, along with other information and preferences, to rank doses. The estimand describes the treatment effect or outcome of interest; it does not by itself say which tradeoffs are acceptable.
The Components of a Dose-Finding Estimand
Target population. Name the people to whom the result is intended to apply, using clinically meaningful eligibility and baseline characteristics. “Patients in the study” is not always sufficient: a study sample may differ from the intended population, and a trial that enrolls only people with a particular disease severity cannot automatically answer a question about everyone with that disease. The target population also determines how patient characteristics are represented in a population average.
Treatment conditions and contrast. A dose is part of a regimen, not just a number. Specify the dose, route, schedule, duration, and any relevant background treatment. State the comparator and the contrast, such as a difference in mean outcome or a ratio of means. The scale matters: a difference is expressed in outcome units, whereas a ratio is unitless. For a dose-specific mean, the reference dose may be placebo, standard of care, or another active dose.
Outcome and time horizon. Define what is measured and when. “Efficacy” is too broad to be an outcome definition. A specific outcome might be change from baseline in a symptom score at week 8, or the number of exacerbations accumulated over 12 weeks. For a repeated measure, specify which visit or summary over time is intended. A measurement at week 8 and an average over weeks 4 through 8 are different outcomes, even if both use the same scale.
Intercurrent events. Treatment discontinuation, rescue medication, switching therapy, or death after treatment begins can affect how an outcome is interpreted. State how such events are handled. For example, a treatment-policy strategy can define the outcome as measured regardless of discontinuation, while a hypothetical strategy asks what the outcome would have been under a specified scenario in which the event did not occur. These target different quantities; neither is automatically preferable in every setting. The event and strategy need to be clear enough that the outcome is well-defined.
For clarity, let \(Y^d(\tau)\) denote the outcome that a member of the target population would have at horizon \(\tau\) under regimen \(d\), with the stated strategy for intercurrent events. The dose-specific population mean is \(\mu_d(\tau)=E[Y^d(\tau)]\). One possible contrast against reference regimen \(d_0\) is \(\Delta(d,d_0;\tau)=E[Y^d(\tau)]-E[Y^{d_0}(\tau)]\). These definitions are not a commitment to a particular analysis model: they define the target quantity first.
A Short Justification: Population Composition Is Part of the Target
Suppose \(X\) denotes a baseline characteristic, such as renal-function group. The population mean under dose \(d\) averages the conditional mean outcome at each value of \(X\) over the distribution of \(X\) in the target population. For a difference in means, the same averaging applies to the conditional differences:
The second equality follows from linearity of expectation and averaging over the target distribution \(F_{\text{target}}\). Thus, even if conditional dose contrasts are the same in two studies, their unstandardized population averages can differ when the studies represent different populations. This is why “the population” is not background wording: it is part of the mathematical definition.
Worked Example: A Mean Change Contrast at Week 8
Hypothetical specification. The target population is adults with moderate disease who meet stated eligibility criteria and receive stable background therapy. Compare oral regimen A, 100 mg once daily for 8 weeks, with regimen B, 50 mg once daily for 8 weeks. The outcome is change from baseline in a symptom score at week 8; higher values mean greater improvement. Discontinuations are followed by outcome measurement where possible, and the outcome is defined under a treatment-policy strategy.
Suppose, solely for this illustration, the target-population mean changes under the two regimens are stipulated to be 18.0 and 14.5 score points. The estimand is the mean difference:
The interpretation is that the population mean improvement under regimen A exceeds that under regimen B by 3.50 score points at week 8, under the specified event strategy. This arithmetic defines the contrast; it is not an estimate from real study data and supplies no uncertainty interval. If the outcome instead were the week-8 score adjusted for baseline, or the average score across several visits, the estimand would need to say so explicitly.
Worked Examples: Population and Event Strategy
Worked Example: Standardizing to the Intended Population
Hypothetical specification. Consider a 12-week mean symptom-score difference between a new dose and a reference dose. Let \(X\) distinguish patients with and without a baseline risk factor. Suppose the conditional mean differences (new dose minus reference) are 10.0 points for patients with the risk factor and 4.00 points for those without it. In the target population, 30% have the risk factor and 70% do not.
The target-population contrast is the weighted average of those conditional contrasts:
Now suppose a study population has 50% with the risk factor. Its corresponding average, if these same conditional contrasts apply, is \( (0.50)(10.0)+(0.50)(4.00)=7.00 \) score points. That is not the target-population estimand of 5.80 points; it averages over a different composition. The example assumes the subgroup contrasts are applicable to both populations. In practice, that assumption and adequate representation of the relevant subgroups would need scrutiny.
Worked Example: Discontinuation Changes the Question
Hypothetical specification. Compare dose D with a reference over 12 weeks using the mean number of exacerbations per patient. Under a treatment-policy strategy, count exacerbations throughout the 12 weeks even if a patient discontinues assigned treatment. Suppose the stipulated population means are 1.40 events under D and 1.80 under reference.
The treatment-policy contrast is \(1.40-1.80=-0.400\) events per patient over 12 weeks. On this scale, a negative value means fewer events on average under D.
Alternatively, a study might define a hypothetical estimand for the scenario in which treatment discontinuation did not occur. Suppose the corresponding hypothetical means are stipulated as 1.10 and 1.60 events. Then the contrast is \(1.10-1.60=-0.500\) events per patient over 12 weeks. The two contrasts differ because their event strategies define different outcomes of interest, not because one is a more accurate calculation of the other. Estimating a hypothetical quantity from observed data requires additional assumptions and methods; the definition alone does not make it observable.
Estimands, Estimates, Models, and Utilities
These terms refer to different parts of a decision process. The estimand is the target population quantity, defined before looking at the analysis result. An estimate is a value calculated from observed data to approximate that target, and ordinarily has sampling uncertainty. A model is a representation used to describe data or predict outcomes; its predictions need not automatically equal the estimand unless the model, data, and target population align. A utility expresses how decision makers value outcomes or options for a decision.
A utility may combine outcomes or account for burdens and preferences, but it does not retroactively define what a study measured. Two decision makers can agree on the estimand and estimated dose effects while preferring different doses because they assign different value to benefit, risk, burden, or uncertainty. Conversely, a stated utility cannot repair an ambiguous population, outcome, or time horizon. The dose-ranking step uses a utility or other decision criterion; specifying the estimand is a prior task.
Worked Example: The Effect Contrast Does Not Determine the Ranking
Hypothetical quantities. For two doses, suppose the estimand is the 8-week mean improvement in a symptom score in the target population. The stipulated means are 12.0 points for dose L and 15.0 points for dose H. The dose-H versus dose-L estimand is \(15.0-12.0=3.00\) points, so dose H has the higher mean improvement on this outcome.
Suppose a decision team separately supplies expected utility scores of 6.0 utility units for L and 5.0 utility units for H, taking into account considerations beyond this symptom score. Under those supplied scores, L ranks higher because \(6.0>5.0\), even though H has the larger mean improvement. The utility values are hypothetical inputs, not derived from the symptom-score estimand. This example shows why an effect contrast alone does not specify a decision and why utility should not be mistaken for the estimand.
Assumptions, Diagnostics, and Limits
An estimand is defined independently of whether the available data identify it. To estimate a causal contrast from a randomized comparison, the assigned regimens must correspond to the specified treatment conditions, outcomes must be measured and interpreted consistently, and missing outcomes or intercurrent events must be handled in a way compatible with the chosen strategy. In a nonrandomized comparison, causal interpretation also requires adequate control of confounding. For standardization across baseline groups, the data must support the relevant groups and the conditional contrasts must be applicable to the target population.
For potential-outcome interpretations, consistency means that a person's observed outcome under the regimen actually received corresponds to the potential outcome defined for that same regimen. This requires treatment conditions to be specified well enough that materially different versions are not silently combined. No interference means one person's regimen does not alter another person's outcome. In nonrandomized settings, exchangeability requires no uncontrolled confounding of treatment and potential outcomes, conditional on the variables used, and positivity requires a nonzero probability of receiving each compared regimen within relevant covariate patterns. These are identification conditions for causal estimation, not additional words that make an ill-defined estimand precise.
Useful checks begin with the specification: can a clinician identify who is in the target population, what exactly each regimen entails, which outcome is recorded, and the assessment time? Then check whether data collection matches that definition. Look for missing outcome measurements, differential follow-up, treatment versions that were pooled despite different schedules, and insufficient representation of target-population subgroups. A large sample cannot fix a mismatch between the study's measured outcome and the outcome named in the estimand.
A common pitfall is to report “the best dose” without saying best for whom, on which outcome, and over what period. Another is to treat an analysis model's predicted mean as the estimand itself. The correction is to write the target quantity in words and, where useful, as a population expectation and contrast before discussing how it will be estimated. Specify the utility or decision rule separately.
No single estimand answers every clinical question. A mean can conceal variation across patients; one time horizon does not describe the entire trajectory; and a treatment-policy strategy may answer a different practical question than a hypothetical strategy. These are reasons to define the target carefully, not to assume that one summary is universally sufficient. The estimand gives a disciplined basis for interpreting estimates and for subsequent dose decisions.
Check Your Understanding
Answer each question by identifying the target quantity, not merely an analysis method.
- A study compares two regimens using mean change from baseline in a score at week 6. Name four details needed to make the estimand more precise.
- In a target population, 20% of patients have a risk factor. The dose contrast is 8 points in that group and 3 points otherwise. What is the population-average contrast?
- Why might a treatment-policy contrast and a hypothetical no-discontinuation contrast differ?
- A higher dose improves a mean outcome more, but has a lower supplied expected utility score. Which dose ranks higher under that utility, and why does this not contradict the estimand?
Solutions. (1) Specify the target population, exact treatment regimens and comparator, the score and whether the outcome is change from baseline, the week-6 assessment, the contrast scale, and the handling of intercurrent events. (2) The weighted contrast is \( (0.20)(8)+(0.80)(3)=1.6+2.4=4.00 \) score points. (3) The strategies define different outcomes: one includes outcomes after discontinuation, while the other concerns a hypothetical scenario in which discontinuation did not occur. (4) The dose with the higher supplied expected utility ranks higher under that utility; the estimand describes the mean outcome contrast, whereas utility reflects the decision maker's valuation of options.