Tutorials › Bayesian Clinical Trials › Defining the Target Population for a Bayesian Estimand

Bayesian Estimands and Regulatory Interpretation · Tutorial 263 of 696

Defining the Target Population for a Bayesian Estimand

Learn to specify who a Bayesian treatment-effect estimand applies to and how population composition affects its interpretation and estimation.

Advanced 14 min read

What You'll Learn

  • Distinguish the target population from the people enrolled in a trial.
  • Translate eligibility criteria and disease-stage definitions into an explicit target population.
  • See how baseline characteristics and subgroup effect differences affect population weighting.
  • Standardize subgroup effects to a specified target population using Bayesian posterior draws.
  • Check overlap, transportability, and other assumptions needed to apply trial results to a target population.

Why the Target Population Is Part of the Question

A treatment effect is not fully described by a number alone. It also matters for whom that effect is intended to apply. A trial may enroll adults with a particular diagnosis and disease stage, while a decision-maker is interested in a broader or narrower group. Even when the outcome and treatment contrast are held fixed, changing the population can change the effect being summarized—especially when treatment effects differ across baseline characteristics.

The target population is therefore not just a description of who happened to enter the trial. It is part of the scientific question. Eligibility criteria, disease stage, and baseline characteristics specify whose outcomes the estimand concerns. The five attributes of a clinical trial estimand include this population attribute; here the focus is on making that attribute precise and understanding its consequences for Bayesian estimation.

Definition: The target population is the clearly specified group of people to whom the treatment-effect estimand is intended to apply. It may be defined by diagnosis, disease stage, age range, prior treatment, baseline characteristics, setting, or a combination of these. The trial sample is the people actually enrolled and observed; it need not have the same composition as the target population.

Writing the Population Precisely

A useful specification says both who is included and the context in which the definition applies. “Patients with the disease” is usually too broad: it may leave unclear which disease definition, stage, age range, or care setting is intended. A practical description identifies the defining criteria and clarifies whether they apply at screening or another pre-treatment time.

For example, a target population might be adults aged 18–75 with a confirmed diagnosis and moderate disease at baseline, receiving care in outpatient clinics. Each element narrows the group whose treatment effect is being discussed. If eligibility criteria are used to define this target, state them in clinically meaningful terms rather than relying only on a protocol label such as “eligible patients.”

Let \(X\) denote measured baseline characteristics, and let \(F_T\) denote their distribution in the target population. Write \(Y(1)\) and \(Y(0)\) for the outcome that an individual would have under the two treatment conditions being compared. For this tutorial, suppose the outcome is well-defined under both conditions and the estimand is the target-population average difference. The notation \(Y(1)\) and \(Y(0)\) represents potential outcomes; it does not imply that both are observed for an individual.

$$ \theta_T = E_T\{Y(1)-Y(0)\} = \int \left[E\{Y(1)\mid X=x\}-E\{Y(0)\mid X=x\}\right]\,dF_T(x). $$

This expression makes the role of the population explicit: the conditional treatment effects are averaged using the distribution \(F_T\) of baseline characteristics in the target population. If effects vary by \(X\), a different target distribution can yield a different \(\theta_T\). If effects are constant across all relevant values of \(X\), changing the distribution alone does not change this average, though other assumptions may still matter.

In a Bayesian analysis, uncertainty about model parameters and outcomes is represented by a posterior distribution given the data and model. When the target distribution is specified, each posterior draw of the relevant conditional effects can be averaged over that distribution, producing posterior draws of \(\theta_T\). A posterior mean summarizes the target-population effect under the model; a credible interval summarizes posterior uncertainty about that estimand. Neither summary changes what population the estimand refers to.

Worked Example: Turning Eligibility Criteria Into a Population

Suppose a hypothetical outpatient trial is intended to inform treatment decisions for adults aged 18–75 with confirmed disease and moderate baseline severity. A screening roster contains 120 adults with the diagnosis. Of these, 90 are aged 18–75, and 72 meet both the age and moderate-severity criteria. For this example, assume all 72 also have confirmed disease and meet the outpatient-setting definition.

The target population is not simply “the 120 adults on the roster.” It is adults in the specified setting who have confirmed disease, are aged 18–75, and have moderate severity at baseline. Among this roster, \(72\) meet the stated criteria, so the observed fraction meeting them is

$$ \frac{72}{120}=0.6. $$

Thus, the proportion of this roster meeting the two criteria is \(0.6\), and \(120-72=48\) people do not meet both. The figure \(0.6\) describes this roster only; it is not automatically the prevalence of eligibility in a wider population. That broader claim would require the roster to represent the wider population under a suitable sampling process.

A precise estimand statement would name the specified adults with moderate disease in the outpatient setting as its target population. If the intended population instead included mild or severe disease, the original criteria would not define it. The population specification must match the clinical question, not merely the available sample.

Baseline Composition Determines the Weighting

Eligibility criteria define the boundaries of a population, while baseline characteristics describe its composition within those boundaries. Characteristics such as disease stage, age, prior treatment, or baseline risk may be effect modifiers. When treatment effects differ across these groups, a population-average effect depends on how common each group is in the target population.

The following calculation is a direct standardization: compute a conditional effect for each subgroup, then average those effects using the target population’s subgroup proportions. It does not assume that the trial’s subgroup proportions are the target proportions.

Worked Example: Reweighting by Disease Stage

Consider a hypothetical trial in which the outcome is a symptom score in points, with lower values better. Posterior summaries of the treatment-minus-control effect are \(-2\) points for patients with lower-stage disease and \(-6\) points for patients with higher-stage disease. Suppose the trial is 80% lower-stage and 20% higher-stage, but the intended target population is 50% in each stage.

Using the target proportions, the target-population average based on these subgroup summaries is

$$ \theta_T = 0.50(-2)+0.50(-6) = -1-3 = -4 \text{ points}. $$

For comparison, averaging with the trial’s proportions would give

$$ 0.80(-2)+0.20(-6) = -1.6-1.2 = -2.8 \text{ points}. $$

The two results differ because the higher-stage subgroup has a more negative estimated effect and receives greater weight in the target population than in the trial. Under the stated outcome convention, the target summary corresponds to a 4-point lower symptom score under treatment on average. These calculations use subgroup effect summaries as fixed values to illustrate weighting; a full Bayesian analysis would apply the same weights to each posterior draw and report the resulting posterior distribution.

Bayesian Standardization and Its Assumptions

Let \(\delta(x)=E\{Y(1)\mid X=x\}-E\{Y(0)\mid X=x\}\) denote the conditional effect at baseline profile \(x\). If a model produces posterior draws \(\delta^{(m)}(x)\), for draw \(m\), then a target-population draw can be calculated as

$$ \theta_T^{(m)} = \int \delta^{(m)}(x)\,dF_T(x). $$

For a target population divided into \(K\) baseline strata, with target proportions \(w_k\), this becomes \(\theta_T^{(m)}=\sum_{k=1}^{K} w_k\delta_k^{(m)}\), where \(w_k\geq 0\) and \(\sum_{k=1}^{K}w_k=1\). If the target distribution is uncertain, that uncertainty can also be represented in the analysis; treating the weights as known is an assumption, not a mathematical necessity.

The calculation is useful only if its inputs and assumptions are credible. A randomized trial supports comparisons between assigned groups within the trial population under the trial’s design and analysis assumptions. Applying conditional effects to a different target population requires additional justification. In particular:

  • Population definition: The eligibility and baseline criteria must identify the intended target group clearly and be measured consistently.
  • Overlap: Target-population profiles used for standardization should be represented in the trial data. If a target stratum has no relevant trial participants, its effect cannot be learned directly from that trial without additional modeling or external information.
  • Conditional transportability: After accounting for the baseline characteristics included in the model, the conditional treatment effects must be applicable to the target population. Unmeasured differences that modify treatment effect can invalidate this assumption.
  • Measurement and model adequacy: Baseline characteristics, outcomes, and subgroup definitions must be measured meaningfully, and the model must capture relevant effect modification well enough for the target calculation.

A short justification explains why standardization requires target weights. In a two-stratum population, let \(\delta_1\) and \(\delta_2\) be the stratum-specific effects and let \(w\) be the target proportion in stratum 1. By the law of total expectation, the average effect is the sum of the stratum-specific averages weighted by their probabilities in the target population:

$$ E_T\{Y(1)-Y(0)\} = w\delta_1+(1-w)\delta_2. $$

If the trial proportion in stratum 1 is \(q\), using the trial mix instead gives \(q\delta_1+(1-q)\delta_2\). Subtracting the target average yields

$$ \left[q\delta_1+(1-q)\delta_2\right] - \left[w\delta_1+(1-w)\delta_2\right] = (q-w)(\delta_1-\delta_2). $$

Thus, the two weighted averages agree if the stratum proportions agree (\(q=w\)), or if the effects are equal (\(\delta_1=\delta_2\)). Otherwise, using the trial composition generally targets a different average.

Worked Example: Applying Trial Effects to a Different Age Mix

Suppose a hypothetical trial estimates treatment effects of \(-3\) points among adults under age 65 and \(-1\) point among adults aged 65 or older. The trial is 25% age 65 or older, while the target population is 40% age 65 or older. The remaining proportions are therefore 75% and 60%, respectively.

The target effect calculated from these subgroup summaries is

$$ \theta_T = 0.60(-3)+0.40(-1) = -1.8-0.4 = -2.2 \text{ points}. $$

The trial-composition average would instead be

$$ 0.75(-3)+0.25(-1) = -2.25-0.25 = -2.5 \text{ points}. $$

The difference is \((-2.5)-(-2.2)=-0.3\) points. The trial average is more negative because the trial contains a larger share of the subgroup with the more negative effect. The target calculation is justified only if the relevant age groups are adequately represented and their conditional effects can be transported to the target setting.

Diagnostics, Alternatives, and Limitations

Several checks can reveal when a target-population analysis is becoming unreliable. Compare baseline distributions in the trial and target population, inspect whether each target subgroup appears in the trial, and examine how sensitive the standardized result is to plausible changes in target weights and subgroup effects. Sparse or empty target-relevant trial strata, extreme weights, and large changes under small modeling choices are warnings that the result depends heavily on extrapolation.

When the trial and target populations are already aligned, the unweighted trial-population summary may answer the intended question. When they differ, direct standardization—as in the examples—makes the target composition explicit. Regression modeling can estimate conditional effects and then average them over the target distribution; weighting approaches can instead reweight trial participants toward that distribution. These approaches rely on assumptions about measured covariates and overlap, and their results can differ when the model is misspecified or the target distribution is poorly known. No statistical method repairs a target population that has not been defined or supplies reliable evidence for profiles absent from the trial.

A common mistake is to treat the randomized sample as the target population automatically: “The trial was randomized, so its average effect applies to everyone with the diagnosis.” Randomization supports a treatment comparison in the trial setting; it does not make the enrolled group representative of every population. The correction is to specify the intended population, compare its relevant baseline composition with the trial, and justify any standardization or extrapolation.

Key takeaway: State the target population in clinically meaningful, operational terms. If treatment effects may vary across its baseline characteristics, average conditional effects using the target population’s distribution—not automatically the trial’s distribution—and make the transport assumptions explicit.

Check Your Understanding

Answer each question, then compare your reasoning with the solutions.

  1. A trial enrolls adults with mild-to-moderate disease, but the proposed target population includes severe disease. What must be checked before applying the trial’s estimate to that population?
  2. Two disease-stage groups have effects of \(-2\) and \(-5\) points. The target population is 30% in the first group and 70% in the second. Calculate the target-weighted effect.
  3. When will weighting subgroup effects by the trial’s proportions give the same result as weighting by the target proportions?
  4. Why does a target stratum with no trial participants create a problem for standardization?

Solutions. (1) Check whether severe disease is represented in the trial and whether conditional treatment effects can reasonably be transported to that stage. If severe disease is absent, its effect requires extrapolation or additional evidence. (2) The target effect is \(0.30(-2)+0.70(-5)=-0.6-3.5=-4.1\) points. (3) The weighted results agree if trial and target proportions are the same, or if the subgroup effects are equal; with multiple groups, equality can also occur by cancellation, but should not be presumed. (4) The trial provides no direct information about the conditional effect in that stratum, so the result depends on untestable extrapolation or external assumptions.

Clinical Biostats