Tutorials › Adaptive Clinical Trial Design › Deriving Posterior Target-Attainment Rules

Adaptive Designs With Pharmacometric Models · Tutorial 512 of 799

Deriving Posterior Target-Attainment Rules

Learn to define a target event, calculate its posterior probability under an adaptation, and apply a pre-specified probability or utility threshold.

Advanced 11 min read

What You'll Learn

  • Distinguish posterior probabilities about a model parameter from predictive probabilities about future patient exposure.
  • Derive target-attainment probabilities for interval and one-sided targets under normal models.
  • Combine residual variability with posterior uncertainty when calculating predictive exposure probabilities.
  • Apply a posterior threshold consistently, including a pre-specified default when no action qualifies.
  • Derive a probability threshold from the benefits and costs of an adaptation.
  • Diagnose sensitivity to model assumptions, prior choices, and the selected target threshold.

From an Interim Model to an Adaptation Rule

An interim pharmacometric model can describe uncertainty about exposure or response, but an adaptation requires a decision statement: what quantity must attain what target, and how much posterior support is required before acting? A rule based only on a fitted mean can conceal uncertainty. A posterior target-attainment rule makes that uncertainty explicit by calculating the probability of a prespecified target event given the interim data.

The target event must be defined before applying the rule. It may concern a model parameter, such as whether a population mean response exceeds a minimum, or a future observation, such as whether a patient's exposure lies within a therapeutic interval. These are different probabilities. The first concerns uncertainty about a population quantity; the second also includes the variability of future observations around that quantity.

Definition: Let \(D\) denote interim data and \(a\) a candidate adaptation. Let \(A_a\) be the prespecified event that the scientific target is attained under \(a\). The posterior target-attainment probability is \(q_a=P(A_a\mid D,a)\). Given a prespecified threshold \(\gamma\), the adaptation qualifies under a threshold rule when \(q_a\geq\gamma\). The event, probability model, threshold, and action to take when no adaptation qualifies must be specified clearly.

For a parameter target, the probability is calculated from the posterior distribution of that parameter. For a future-patient target, it is a posterior predictive probability: uncertainty about model parameters is combined with the conditional variability of a future observation. The distinction matters because a posterior mean exposure inside a target interval does not imply that most future patients will fall inside that interval.

Deriving a Predictive Exposure Probability

Suppose log exposure \(X\), under a fixed adaptation, follows \(X\mid\theta\sim N(\theta,\sigma^2)\), where \(\theta\) is the population mean log exposure and \(\sigma^2\) is residual variance among future patients. Suppose the interim data give \(\theta\mid D\sim N(m,v)\). These assumptions describe a normal population on the log scale, a known residual variance, and a normal posterior for the mean. Conditional on \(\theta\), the future exposure is independent of the interim data.

The probability of attaining an exposure interval \([L,U]\) is obtained by integrating over uncertainty in \(\theta\). Because \(X=\theta+\varepsilon\), with \(\varepsilon\sim N(0,\sigma^2)\) independent of \(\theta\mid D\), the posterior predictive distribution adds the two variances:

$$ X\mid D \sim N(m,\sigma^2+v), \qquad P(L\leq e^X\leq U\mid D) = \Phi\!\left(\frac{\log U-m}{\sqrt{\sigma^2+v}}\right) - \Phi\!\left(\frac{\log L-m}{\sqrt{\sigma^2+v}}\right). $$

Here \(\Phi\) is the standard normal cumulative distribution function. The equation follows because \(L\leq e^X\leq U\) is equivalent to \(\log L\leq X\leq\log U\), and the probability of a normal variable lying between two limits is the difference of its cumulative probabilities at those limits. The term \(v\) represents uncertainty about the mean exposure; \(\sigma^2\) represents future-patient variability. Omitting either term changes the target event being evaluated.

Worked Example: Attaining a Prespecified Exposure Interval

Hypothetical data and model. An interim analysis supports a posterior mean log exposure of \(m=\log(100)\) and posterior variance \(v=0.0016\). Assume future log exposures have residual variance \(\sigma^2=0.0064\), independent of the posterior uncertainty in the mean. The prespecified exposure target is 80 to 120 concentration units, and the probability threshold is \(\gamma=0.90\). These summaries and assumptions are hypothetical.

The posterior predictive standard deviation on the log scale is \(\sqrt{0.0064+0.0016}=\sqrt{0.008}=0.08944\). The standardized upper and lower limits are:

$$ z_U=\frac{\log(120)-\log(100)}{0.08944} =\frac{\log(1.2)}{0.08944} =\frac{0.1823}{0.08944}=2.038, \qquad z_L=\frac{\log(80)-\log(100)}{0.08944} =\frac{\log(0.8)}{0.08944} =\frac{-0.2231}{0.08944}=-2.495. $$

Thus the posterior predictive target probability is \(q=\Phi(2.038)-\Phi(-2.495)\approx0.9792-0.0063=0.9729\). Since \(0.9729\geq0.90\), the exposure target qualifies under this rule. The interpretation is that, conditional on the stated model and interim information, the probability that a future patient's exposure is between 80 and 120 units is about 97.3%. It is not a probability that the fixed population mean itself lies in that interval.

The calculation assumes the lognormal exposure model is suitable, the residual variance is appropriate for the future population, and the posterior summary adequately represents uncertainty in the mean. If the residual variance were ignored, the resulting probability would describe uncertainty about the mean rather than the chance of target exposure in a future patient.

Parameter Targets for Response

A response target may instead be defined on a population parameter. For example, the event may be that the population mean response \(\theta\) exceeds a clinically relevant minimum \(\theta_0\). A simple derivation is available when normally distributed responses have known variance and the prior for \(\theta\) is normal. If \(Y_i\mid\theta\sim N(\theta,\sigma^2)\) independently and \(\theta\sim N(m_0,\tau_0^2)\), then after observing \(n\) responses with sample mean \(\bar{x}\), the posterior variance and mean are:

$$ v_n=\left(\frac{1}{\tau_0^2}+\frac{n}{\sigma^2}\right)^{-1}, \qquad m_n=v_n\left(\frac{m_0}{\tau_0^2}+\frac{n\bar{x}}{\sigma^2}\right). $$

These expressions result by multiplying the normal prior density by the normal likelihood and collecting the terms in \(\theta^2\) and \(\theta\) in the exponent. The resulting posterior is normal with precision \(1/v_n=1/\tau_0^2+n/\sigma^2\). For the one-sided target \(A=\{\theta\geq\theta_0\}\), the attainment probability is \(1-\Phi((\theta_0-m_n)/\sqrt{v_n})\). This is a probability about the population mean, not a predictive probability for an individual patient's response.

Worked Example: Posterior Probability of a Mean-Response Target

Hypothetical data and model. Suppose 16 interim responses have sample mean \(\bar{x}=0.72\) response units. Assume independent normal responses with known standard deviation \(\sigma=0.16\) units and a normal prior for the population mean with \(m_0=0.60\) units and \(\tau_0=0.10\) units. The target is a population mean of at least \(\theta_0=0.65\) units, and the threshold is 0.90. The normal sampling model, known variance, prior, and independence assumption are part of this hypothetical example.

The posterior variance and mean are:

$$ v_n=\left(\frac{1}{0.10^2}+\frac{16}{0.16^2}\right)^{-1} =(100+625)^{-1}=0.001379, \qquad m_n=\frac{100(0.60)+625(0.72)}{725} =\frac{510}{725}=0.7034. $$

The posterior standard deviation is \(\sqrt{0.001379}=0.03714\) response units. Therefore, \(z=(0.7034-0.65)/0.03714=1.438\), and \(P(\theta\geq0.65\mid D)=\Phi(1.438)\approx0.925\). Because \(0.925\geq0.90\), this population-mean target qualifies under the specified rule. The result does not say there is a 92.5% probability that an individual patient will respond above 0.65 units; that would require a predictive calculation including individual response variability.

What a Threshold Does—and Does Not—Mean

A threshold rule is a decision policy, not a guarantee of success. The threshold \(\gamma\) expresses how much posterior support the policy requires for a defined event before an adaptation qualifies. Its value should be chosen in advance with the clinical consequences of acting and not acting in view. It should not be described as a frequentist type I error rate: a rule requiring a posterior probability of 0.90 does not, by itself, ensure a 10% false-positive rate across repeated trials.

One way to justify a threshold is through expected utility. Suppose taking an adaptation yields incremental utility \(B>0\) if the target is attained and incurs incremental utility \(-C\), with \(C>0\), if it is not attained. Relative to not taking that adaptation, the expected utility is \(qB-(1-q)C\). Acting is preferred when that quantity is positive, which gives the probability threshold below.

$$ qB-(1-q)C>0 \quad\Longleftrightarrow\quad q(B+C)>C \quad\Longleftrightarrow\quad q>\frac{C}{B+C}. $$

Worked Example: Deriving a Threshold From Consequences

Hypothetical decision. Consider an adaptation with incremental utility of 8 units if a prespecified clinical target is attained and a loss of 2 units if it is not. Assume these utilities adequately summarize the consequences relevant to this decision. The expected incremental utility is positive when:

$$ 8q-2(1-q)>0 \quad\Longleftrightarrow\quad 10q>2 \quad\Longleftrightarrow\quad q>0.20. $$

The implied break-even threshold is 0.20. If the hypothetical posterior target probability is \(q=0.72\), expected incremental utility is \(8(0.72)-2(0.28)=5.76-0.56=5.20\) utility units, so acting has positive expected incremental utility under these assumptions. This low threshold follows from the stipulated relative consequences; it is not a general recommendation. If utility values omit important safety consequences or the target event is misspecified, the calculated threshold may not support a sound clinical decision.

Applying the Rule and Checking Its Weak Points

A reproducible decision rule links the event, posterior calculation, threshold, and operational consequence. Before the interim analysis, specify the target and its units, the population or future observation to which it refers, the model used to calculate its probability, the threshold, and what happens if no action qualifies. If the rule includes several candidate actions, define in advance how to proceed when several meet the threshold, rather than treating the threshold alone as a complete ranking rule.

1
Define the event.
State precisely which parameter or future observation must meet the target, including any interval limits and units.
2
Specify the probability model.
State the sampling and posterior assumptions, and include future-observation variability when the event concerns a future patient.
3
Calculate and compare.
Calculate \(q_a=P(A_a\mid D,a)\) and compare it with the prespecified \(\gamma\), using the stated inclusive or strict inequality.
4
Execute the prewritten consequence.
Apply the adaptation or default specified by the protocol. Record the model inputs and probability used in the decision.

Useful diagnostics include checking that the target event matches the clinical question, verifying transformations and units, and confirming that numerical integration or simulation estimates the intended posterior probability with adequate precision. Posterior predictive checks can reveal whether the assumed exposure or response distribution reproduces important features of observed data. Sensitivity analyses should examine plausible alternative priors, residual variability, model parameters, and thresholds. If a small reasonable change moves the probability across \(\gamma\), the decision is fragile even if the calculation is correct.

A posterior mean compared with a target is a simpler alternative, but it ignores uncertainty: two analyses with the same mean and different posterior spreads can produce different target probabilities. A credible interval can summarize parameter uncertainty, but a rule such as “the interval lies above the target” is not identical to a specified posterior probability threshold unless its relationship to that threshold is established under the model. For future-patient exposure, neither a parameter mean nor a parameter interval substitutes for the predictive distribution. A fixed, non-adaptive rule avoids interim posterior calculations but cannot respond to interim evidence in the same way.

The calculation is only as reliable as its target definition and model. Unmodeled heterogeneity, misspecified tails, inappropriate borrowing of information, or an interim sample unrepresentative of the future population can distort attainment probabilities. Further, evaluating many candidate actions and acting on the most favorable result is not automatically accounted for by the probability threshold. The entire adaptive policy should be assessed under plausible trial scenarios, including model departures, to understand its operating characteristics. That assessment is separate from the meaning of any single posterior probability.

Common Pitfall

Common mistake: “The posterior mean exposure is inside the therapeutic interval, so the probability that a future patient will attain the target is high.” The conclusion does not follow: the posterior mean alone omits both uncertainty about the mean and patient-to-patient variability. Correction: define whether the event concerns a parameter or a future observation, then calculate the corresponding posterior or posterior predictive probability with all relevant sources of uncertainty.

Check Your Understanding

Answer each question, then compare with the solutions below.

  1. A rule qualifies an action when \(q\geq0.85\). If the calculated target probability is 0.84, does the action qualify?
  2. In the log-exposure model, why is the posterior predictive variance \(\sigma^2+v\), rather than \(v\) alone?
  3. A response-parameter target has posterior \(N(0.70,0.04^2)\). What is the posterior probability that the parameter is at least 0.66?
  4. An adaptation gives incremental utility \(B=6\) if the target is attained and loss \(C=4\) otherwise. What is the break-even probability threshold?
  5. Why does a posterior probability threshold of 0.90 not automatically imply a 10% frequentist false-positive rate?

Solutions. (1) No. The rule requires \(q\geq0.85\), and \(0.84<0.85\). (2) Future log exposure varies both because the population mean is uncertain, with variance \(v\), and because future observations vary around that mean, with variance \(\sigma^2\); independence makes the variances add. (3) \(z=(0.70-0.66)/0.04=1\), so the probability is \(\Phi(1)\approx0.8413\). (4) The threshold is \(C/(B+C)=4/(6+4)=0.40\). (5) The posterior threshold is conditional on the model and observed data; a repeated-sampling false-positive rate depends on the full trial design, data-generating process, and decision policy.

Clinical Biostats