Tutorials › Optimal Design and Model-Informed Dosing › Posterior Probability of Meeting an Exposure Target

Bayesian Forecasting and Dose Adaptation · Tutorial 336 of 497

Posterior Probability of Meeting an Exposure Target

Use posterior predictive distributions—not just a point estimate of exposure—to quantify the probability that an individual’s future exposure falls within a specified target range.

Advanced 12 min read

What You'll Learn

  • Distinguish the probability of a future exposure meeting a target from whether a posterior mean exposure is in range.
  • Derive a posterior predictive target probability by integrating over individual parameter uncertainty.
  • Calculate a target probability under a conditional normal predictive model.
  • Estimate target attainment from posterior predictive simulations and quantify Monte Carlo error.
  • Handle closed target intervals correctly when predictive distributions have point masses.
  • Identify assumptions and diagnostics that affect interpretation of the probability.

Why a Target Probability Uses a Predictive Distribution

An exposure target is often stated as a range: exposure should be high enough to support efficacy and low enough to avoid unacceptable toxicity. For an individual, however, the relevant question is not only what exposure is expected under a proposed regimen. It is also how uncertain that expectation is, and how much future variability remains. A posterior predictive probability combines these sources of uncertainty to answer: given the individual’s observed data, how likely is a future exposure to lie inside the specified range?

Let \(D\) denote the individual’s observed data, \(\theta\) the unknown individual-specific parameters, and \(Y^*\) a future exposure of interest under a specified regimen and prediction occasion. Let \(L\) and \(U\) be the lower efficacy limit and upper safety limit, with \(L\leq U\). The probability is conditional on the observed data and on the model, regimen, and prediction conditions used to define \(Y^*\). It is not a probability that the limits themselves are correct, nor does it by itself prescribe a dose change.

Definition: The posterior predictive probability of meeting the exposure target is \(P(L\leq Y^*\leq U\mid D)\). It is the posterior probability that a future exposure \(Y^*\) falls in the specified closed interval, after accounting for uncertainty in the individual’s parameters and for future variability represented by the model.

This differs from checking whether a point summary, such as the posterior mean exposure, lies in the range. A posterior mean inside the range does not imply a high probability of being inside it: substantial uncertainty or residual variability could put much of the predictive distribution outside. Conversely, a point summary outside the range does not determine the probability of meeting the target.

Definition by Posterior Predictive Integration

Suppose a model specifies the distribution of future exposure given the individual parameters and observed data, \(p(y^*\mid\theta,D)\), and the individual posterior distribution \(p(\theta\mid D)\). The posterior predictive distribution averages the future-exposure distribution over that posterior. This is the key step: plausible parameter values contribute in proportion to their posterior probability, and future variability conditional on those values is retained.

$$ p(y^*\mid D)=\int p(y^*\mid\theta,D)\,p(\theta\mid D)\,d\theta $$

For a closed interval, the corresponding target probability is

$$ P(L\leq Y^*\leq U\mid D) = \int P(L\leq Y^*\leq U\mid\theta,D)\,p(\theta\mid D)\,d\theta. $$

If the predictive distribution has cumulative distribution function \(F_{Y^*\mid D}\), the exact closed-interval expression is

$$ P(L\leq Y^*\leq U\mid D) = F_{Y^*\mid D}(U)-F_{Y^*\mid D}(L^-), $$

where \(F_{Y^*\mid D}(L^-)=P(Y^*<L\mid D)\) is the left limit of the CDF at \(L\). For a continuous predictive distribution there is no probability mass at \(L\), so \(F(L^-)=F(L)\) and the familiar difference \(F(U)-F(L)\) is valid. For a discrete or mixed distribution, the left limit matters: using \(F(L)\) would omit any mass exactly at the lower boundary.

Why Parameter and Future Variability Both Matter

A short derivation clarifies the role of the two uncertainty sources. Suppose, specifically, that conditional on \(D\), \(\theta\sim N(m,V)\), and that \(Y^*=\theta+\varepsilon\), where \(\varepsilon\mid D\sim N(0,R)\) and \(\varepsilon\) is independent of \(\theta\) conditional on \(D\). These are conditional assumptions: marginal independence of \(\varepsilon\) and \(\theta\) alone is not sufficient, because observing \(D\) can induce dependence or provide information about \(\varepsilon\).

Under these assumptions, the conditional moment-generating function of \(Y^*\) is the product of the two normal moment-generating functions. For any real \(t\),

$$ E(e^{tY^*}\mid D) = E(e^{t\theta}\mid D)E(e^{t\varepsilon}\mid D) = \exp\left(tm+\frac{t^2V}{2}\right) \exp\left(\frac{t^2R}{2}\right) = \exp\left(tm+\frac{t^2(V+R)}{2}\right). $$

This is the moment-generating function of a normal variable with mean \(m\) and variance \(V+R\). Therefore, in this specific model, \(Y^*\mid D\sim N(m,V+R)\). The variance \(V\) represents posterior uncertainty about the individual parameter, while \(R\) represents future variability conditional on that parameter. This normal result is not automatic in nonlinear PK models or when the conditional predictive error depends on \(\theta\); in those settings, use the model’s full posterior predictive distribution.

Worked Example: A Normal Predictive Distribution and a Closed Target Range

Suppose a hypothetical individual’s latent mean trough exposure, \(\theta\), has posterior distribution \(N(8.2,1.1^2)\) mg/L. The future trough is \(Y^*=\theta+\varepsilon\), where the future error has distribution \(N(0,0.9^2)\) mg/L and, conditional on the observed data \(D\), is independent of \(\theta\). Assume this error is also independent of \(D\) under the specified forecasting model. The target is the closed range from \(6\) to \(10\) mg/L. Calculate the posterior predictive target probability.

By the conditional normal result, the predictive mean is \(m=8.2\) mg/L and the predictive variance is

$$ V+R=1.1^2+0.9^2=1.21+0.81=2.02\ \text{(mg/L)}^2. $$

Thus the predictive standard deviation is \(\sqrt{2.02}=1.421\) mg/L, and \(Y^*\mid D\sim N(8.2,2.02)\) when the variance is written as the second parameter. Standardizing the target limits gives

$$ z_L=\frac{6-8.2}{1.421}=-1.548, \qquad z_U=\frac{10-8.2}{1.421}=1.266. $$

Because this predictive distribution is continuous, its probability at either exact endpoint is zero. Using the standard normal CDF \(\Phi\),

$$ P(6\leq Y^*\leq 10\mid D) = \Phi\left(\frac{10-8.2}{\sqrt{2.02}}\right) - \Phi\left(\frac{6-8.2}{\sqrt{2.02}}\right) \approx 0.8365. $$

Under the stated model, the posterior predictive probability that this individual’s future trough is in the target range is about \(0.836\), or \(83.6\%\). This is conditional on the observed data and model assumptions; it is not a claim that there is an 83.6% probability the model or target limits are correct.

Computing the Probability From Posterior Predictive Draws

For complex models, the integral defining the target probability may not have a closed form. A direct simulation approach is to draw parameter values from \(p(\theta\mid D)\), then draw a future exposure from the model conditional on each parameter draw and the prediction conditions. Each simulated future exposure is classified as inside or outside the target. The fraction inside estimates the posterior predictive probability.

If \(M\) independent predictive draws are generated, write them as \(Y^{*(1)},\ldots,Y^{*(M)}\). The Monte Carlo estimate is

$$ \widehat{P} = \frac{1}{M}\sum_{m=1}^{M} I\{L\leq Y^{*(m)}\leq U\}, $$

where \(I\{\cdot\}\) equals 1 when the condition holds and 0 otherwise. When the draws are independent, the estimated Monte Carlo standard error is \(\sqrt{\widehat{P}(1-\widehat{P})/M}\). This quantifies simulation error in estimating the probability, not uncertainty about whether the model is adequate. If draws are dependent, as can occur with posterior simulation algorithms, the independent-draw standard error is not generally appropriate; dependence must be accounted for when assessing Monte Carlo precision.

Worked Example: Estimating a Joint Exposure Target by Simulation

In a hypothetical forecast, the target requires both \(30\leq \mathrm{AUC}^*\leq 50\) mg·h/L and \(\mathrm{Cmax}^*\leq 12\) mg/L. A simulation generates \(M=1{,}000\) independent posterior predictive pairs, each incorporating a parameter draw from the individual posterior and a future exposure draw conditional on that parameter. Of the 1,000 pairs, 823 meet both requirements.

The estimated probability of meeting the joint target is

$$ \widehat{P}=\frac{823}{1{,}000}=0.823. $$

The estimated Monte Carlo standard error is

$$ \mathrm{MCSE} = \sqrt{\frac{0.823(1-0.823)}{1{,}000}} = \sqrt{0.000145671} \approx 0.0121. $$

So the simulation estimates an \(82.3\%\) probability of satisfying both constraints, with a Monte Carlo standard error of about 1.21 percentage points under the independent-draw assumption. The event is joint: counting draws that meet the AUC limit but exceed the Cmax limit as successes would answer a different question. Increasing the number of effectively independent draws can reduce Monte Carlo error, but it cannot correct a misspecified model or an inappropriate target range.

Atoms at Target Boundaries

A future exposure distribution need not be continuous. For example, rounding, a discrete endpoint, or a model with a probability of zero exposure can create point masses. In that case, boundary inclusion is part of the target definition, and the closed interval formula must include mass at both \(L\) and \(U\).

Worked Example: Including Probability Mass at the Lower Limit

Consider a hypothetical predictive distribution for exposure with probability \(0.20\) below \(5\) mg/L, probability \(0.12\) exactly at \(5\) mg/L, probability \(0.50\) strictly between \(5\) and \(10\) mg/L, probability \(0.08\) exactly at \(10\) mg/L, and probability \(0.10\) above \(10\) mg/L. These probabilities sum to \(1.00\). Find the probability of being in the closed target \([5,10]\) mg/L.

The target includes the mass at both boundaries, so direct addition gives

$$ P(5\leq Y^*\leq 10\mid D) = 0.12+0.50+0.08 = 0.70. $$

Equivalently, \(F(10)=0.20+0.12+0.50+0.08=0.90\), while \(F(5^-)=0.20\). Hence \(F(10)-F(5^-)=0.90-0.20=0.70\). Subtracting \(F(5)\), which is \(0.32\), instead would give \(0.58\) and wrongly exclude the probability mass exactly at the lower limit.

Assumptions, Diagnostics, and Alternative Summaries

A target probability is only as meaningful as the predictive distribution used to calculate it. Before interpreting the result, check that the forecast matches the intended clinical quantity and time: for example, an AUC over the relevant interval is not interchangeable with a trough at one time point. Verify that the regimen, dosing history, adherence assumptions, and any prediction conditions used to construct the forecast are appropriate for the individual. The probability is conditional on these choices.

Also check how the calculation represents uncertainty. A plug-in calculation that fixes \(\theta\) at a point estimate and includes only residual variability omits posterior uncertainty in \(\theta\). Conversely, using a posterior distribution for a mean exposure while omitting meaningful future variability can make the predictive distribution too narrow. In either case the resulting target probability may be poorly calibrated to the intended future outcome. For nonlinear relationships, transforming a posterior mean parameter is generally not equivalent to averaging the transformed exposure over the posterior; prediction should use the model’s exposure function for each draw.

Useful practical checks include confirming that predictive draws have plausible units and ranges, that the target event is coded with the correct strict or inclusive boundaries, and that repeated simulation runs give sufficiently stable estimates. For simulation estimates, report \(M\), the estimated probability, and an appropriate measure of Monte Carlo precision. A narrow Monte Carlo error does not establish that the structural model, parameter assumptions, or target limits are clinically suitable.

ApproachWhat it summarizesMain limitation for target attainment
Posterior mean exposureAverage exposure over the posterior for a parameter or predictionDoes not directly give the probability of a future exposure being within bounds
Plug-in predictionExposure predicted at a selected parameter estimateUsually omits uncertainty in the individual parameters
Posterior predictive probabilityProbability that a future exposure meets the stated target, integrating parameter uncertainty and modeled future variabilityDepends on the predictive model, prediction conditions, and target definition

A common mistake is to see that the posterior mean lies between \(L\) and \(U\) and conclude that the individual is likely to meet the target. The mean alone does not determine the probability: distributions with the same mean can have different variances, shapes, and probabilities outside the interval. The correction is to calculate or simulate the posterior predictive probability for the actual target event. A second mistake is to use \(F(U)-F(L)\) for a closed interval without checking continuity. The correction is to use \(F(U)-F(L^-)\), which includes any predictive mass exactly at the lower limit.

Key takeaway: Target attainment is a probability about a future exposure, conditional on the individual’s observed data. Calculate it from the posterior predictive distribution, retain both parameter and future variability, and make the interval-boundary convention explicit when the distribution can have point masses.

Check Your Understanding

Work through each question, then compare with the brief solutions below.

  1. A posterior predictive distribution is continuous and has \(F(8)=0.91\) and \(F(4)=0.14\). What is the probability of a future exposure in the closed range \([4,8]\)?
  2. In the conditional normal model, \(m=7\), \(V=4\), and \(R=5\), with exposure measured in mg/L. What are the predictive mean and standard deviation?
  3. A simulation produces 360 target successes from 500 independent predictive draws. Calculate the estimated target probability and its Monte Carlo standard error.
  4. A predictive distribution has \(P(Y^*<3)=0.25\), \(P(Y^*=3)=0.15\), \(P(3<Y^*\leq 7)=0.45\), and \(P(Y^*>7)=0.15\). What is \(P(3\leq Y^*\leq 7)\)?

Solutions. (1) Continuity means there is no mass at 4, so \(P(4\leq Y^*\leq 8\mid D)=F(8)-F(4)=0.91-0.14=0.77\). (2) Under the stated conditional independence and normality assumptions, the predictive mean is \(7\) mg/L and variance is \(V+R=4+5=9\) \((\mathrm{mg/L})^2\), giving standard deviation \(3\) mg/L. (3) The estimate is \(360/500=0.720\), and \(\mathrm{MCSE}=\sqrt{0.720(0.280)/500}=\sqrt{0.0004032}\approx0.0201\), or about 2.01 percentage points. (4) The closed interval includes the mass at 3, so the probability is \(0.15+0.45=0.60\). Equivalently, \(F(7)-F(3^-)=0.85-0.25=0.60\).

Clinical Biostats