Tutorials › Physiologically-Based Pharmacokinetics (PBPK) › Conditional Prediction Intervals Across Patient Subgroups

Uncertainty Propagation and Predictive Intervals · Tutorial 762 of 799

Conditional Prediction Intervals Across Patient Subgroups

Learn how to estimate and interpret PBPK prediction intervals for specified patient strata while preserving the covariate distributions and dependencies relevant to each subgroup.

Advanced 10 min read

What You'll Learn

  • Define a subgroup-specific predictive distribution for a PBPK endpoint.
  • Estimate conditional interval endpoints from simulations within a target stratum.
  • Preserve dependencies when conditioning on renal function or other covariates.
  • Distinguish subgroup intervals from a marginal interval for a mixture population.
  • Diagnose sparse strata, unstable quantiles, and inappropriate subgroup extrapolation.
  • Report the target subgroup, prediction context, interval level, and units.

Why Condition on Patient Subgroups?

A PBPK prediction for a patient with impaired renal function need not have the same distribution as a prediction for a patient with normal renal function. The subgroup may differ in physiology, covariates, or the way uncertain inputs affect the model output. A single interval for a population combining both groups can conceal these differences. Conditional prediction intervals make the target explicit: they describe predictions for patients who meet a stated subgroup definition, under a stated dose and prediction context.

The calculation uses the same basic simulation outputs as other prediction intervals, but changes which predictive distribution is summarized. The key is to condition the distribution on subgroup membership, rather than to treat all simulated patients as one undifferentiated sample. For example, the target might be the concentration at a specified time for a new patient in a defined renal-function group. The interval is then about that patient-level prediction distribution, not an interval for a group mean.

Definition: Let \(Y\) be a PBPK-predicted quantity, such as concentration at a specified time, and let \(G=g\) denote membership in a defined patient subgroup. A central \(100(1-\alpha)\%\) conditional prediction interval for subgroup \(g\) is an interval with endpoints given by the conditional predictive quantiles \(q_{\alpha/2\mid g}\) and \(q_{1-\alpha/2\mid g}\) of \(Y\mid G=g\). Its intended interpretation is that it covers the stated proportion of predictions for patients in subgroup \(g\), under the model and prediction context used to generate that distribution.

The distribution being summarized must match the prediction question. It may include patient-to-patient variability and parameter uncertainty, if both are part of the predictive target. If simulations use nested sampling, the subgroup condition applies to the patient-level covariates and outputs, while the parameter draws represent the uncertainty included in the target prediction. The model, dose, endpoint, time point, and any other fixed conditions should be held consistent across subgroup comparisons.

Constructing a Conditional Interval

For a categorical subgroup, such as a prespecified renal-function category, generate or select predictive draws whose patient covariates satisfy that category. Then calculate the desired quantiles of the corresponding outputs. For a continuous covariate, the condition must be defined precisely: for example, an interval of renal-function values, or a prediction at a specified value. These are different targets. A category interval averages over the covariate values represented within that category; a prediction at a particular value conditions on that value or uses a model that predicts at it.

In Monte Carlo work, suppose \(M_g\) predictive outputs belong to subgroup \(g\), and write them in increasing order as \(Y_{(1),g},\ldots,Y_{(M_g),g}\). One simple empirical quantile convention is the inverse empirical CDF: \(\hat q_{p\mid g}\) is the smallest observed value for which the empirical proportion at or below that value is at least \(p\). With this convention, the estimated central interval is formed from the empirical quantiles at probabilities \(\alpha/2\) and \(1-\alpha/2\). Other software may interpolate between ordered values, so the quantile convention should be reported.

$$ \widehat{\mathrm{PI}}_{1-\alpha\mid g} = \left[\hat q_{\alpha/2\mid g},\ \hat q_{1-\alpha/2\mid g}\right], \qquad \hat q_{p\mid g} = \inf\{y:\widehat F_g(y)\ge p\}. $$

Here \(\widehat F_g\) is the empirical CDF of outputs for the target subgroup. The quantiles are not calculated from the subgroup mean and standard deviation unless a particular predictive distribution is justified and those summaries correctly determine its quantiles. PBPK outputs can be skewed or otherwise non-normal; simulation quantiles avoid imposing a normal shape, though they still depend on adequate simulation and a suitable model.

Worked Example: A 90% Interval for a Renal-Function Stratum

In a hypothetical PBPK simulation, 20 outputs for concentration at a specified time are retained for a prespecified renal-function stratum. The outputs, sorted in mg/L, are \(1.8, 2.0, 2.1, 2.2, 2.3, 2.4, 2.5, 2.6, 2.7, 2.8, 2.9, 3.0, 3.1, 3.2, 3.3, 3.4, 3.6, 3.8, 4.0, 4.5\). Use the inverse empirical CDF convention to estimate a central 90% conditional prediction interval.

For a central 90% interval, the endpoint probabilities are \(0.05\) and \(0.95\). With \(M_g=20\), the first empirical quantile is the smallest value whose cumulative fraction is at least \(0.05\). The first value has fraction \(1/20=0.05\), so \(\hat q_{0.05\mid g}=1.8\) mg/L. For the upper endpoint, the cumulative fraction first reaches at least \(0.95\) at the 19th value, because \(19/20=0.95\). Thus \(\hat q_{0.95\mid g}=4.0\) mg/L.

The estimated interval is \([1.8,\ 4.0]\) mg/L. It summarizes predictions for the stated stratum, not for all patients in the simulation. With only 20 outputs, the endpoint estimates are coarse and may be sensitive to additional simulation draws; the calculation does not by itself establish that Monte Carlo error is negligible.

Conditioning Must Preserve the Relevant Covariates

A valid conditional distribution reflects how covariates are distributed within the target subgroup and how those covariates depend on one another. For instance, if age and renal function are associated in the target population, sampling age independently of renal-function stratum can create an unrealistic subgroup. Similarly, conditioning on a renal-function category should not be replaced by setting every patient’s renal function to the category midpoint unless that is specifically the prediction target and the model assumptions justify it.

There are two common ways to obtain subgroup predictions. One is to generate patient covariates from a joint distribution and retain simulated patients whose covariates meet the subgroup definition. The other is to sample directly from the covariate distribution conditional on subgroup membership. Either can be appropriate. In both cases, preserve relevant dependencies and ensure that the retained or generated patients represent the intended target population. If a subgroup is rare, simple filtering can leave too few outputs for stable tail quantiles; direct conditional sampling may use simulation effort more efficiently.

For continuous covariates, conditioning can be more demanding than assigning a category. A prediction at exactly one continuous value may have probability zero under a continuous covariate distribution, so it is usually defined through the model evaluated at that value or through a conditional model. A prediction for a range instead averages over the covariate values within that range. The choice changes the predictive distribution and should be stated, not left implicit.

Worked Example: Propagating Age Variation Within a Renal Stratum

Consider a hypothetical model for concentration \(C\), in mg/L, at a fixed time. Within a low renal-function stratum, age \(A\) is modeled as \(A\mid G=g\sim N(75,8^2)\) years. The model is \(\log(C/(1\text{ mg/L}))=1.2+0.02(A-60)+\varepsilon\), where \(\varepsilon\sim N(0,0.1^2)\) is independent of age. Assume these distributions and the model are appropriate for the target stratum. Find a central 90% conditional interval.

The conditional mean of the log concentration is \(1.2+0.02(75-60)=1.50\). Age contributes variance \((0.02)^2(8^2)=0.0256\), and the residual contributes variance \(0.1^2=0.0100\). Independence makes the total variance \(0.0356\), so the standard deviation is \(\sqrt{0.0356}=0.1887\). The log concentration is normally distributed under the assumptions in this example.

Using \(1.645\) as the standard-normal 95th percentile, the 90% interval on the log scale is \(1.50\pm1.645(0.1887)\), or \(1.50\pm0.3104=[1.1896,1.8104]\). Exponentiating both endpoints gives \([\exp(1.1896),\exp(1.8104)]=[3.286,6.113]\) mg/L. This is a conditional interval because the age distribution used in its variance calculation is the distribution within the specified renal stratum.

If instead age were fixed at 75 years, only the residual variance would remain, and the resulting interval would be narrower. That would answer a different question: prediction at a fixed age, rather than prediction for a new patient whose age varies within the stratum.

Why a Marginal Interval Is Not a Subgroup Interval

If a population contains several subgroups, its marginal predictive distribution is a mixture of the conditional distributions. If \(w_g=P(G=g)\) is the subgroup proportion in the target population, then the marginal CDF is the weighted sum of subgroup CDFs. Its quantiles generally cannot be obtained by averaging subgroup quantiles, and a marginal interval does not automatically provide the desired interval for any one subgroup.

$$ F_Y(y)=\sum_g w_g F_{Y\mid G=g}(y), \qquad q_p \ne \sum_g w_g q_{p\mid g} \quad\text{in general}. $$

The reason is that a quantile is defined by where a CDF reaches a probability threshold. Adding CDFs with subgroup weights changes the shape and position of that combined CDF. There is no general algebraic rule that makes its threshold equal to a weighted average of the subgroup thresholds.

Worked Example: Comparing Subgroup and Pooled Quantiles

Suppose two hypothetical subgroups each have 20 simulated concentration outputs in mg/L. Subgroup A has sorted outputs \(8, 9, 9, 10, 10, 10, 10, 11, 11, 11, 11, 12, 12, 12, 13, 13, 14, 14, 15, 20\). Subgroup B has sorted outputs \(18, 19, 19, 20, 20, 20, 20, 21, 21, 21, 21, 22, 22, 22, 23, 24, 30, 35, 40, 50\). Use the inverse empirical CDF convention for central 90% intervals.

For each subgroup, the 5th percentile is the first of its 20 values, and the 95th percentile is its 19th value. Therefore subgroup A has estimated interval \([8,15]\) mg/L, and subgroup B has estimated interval \([18,40]\) mg/L.

If the two groups are pooled, there are 40 outputs. The 5th percentile is the second pooled value, 9 mg/L. The 95th percentile is the 38th pooled value: the 18th value from subgroup B, which is 35 mg/L. The marginal interval is therefore \([9,35]\) mg/L. It is not either subgroup’s interval. It describes the combined sample under its particular subgroup weights, not the predictive distribution conditional on A or B.

Diagnostics, Comparisons, and Limitations

Conditional intervals are useful when decisions concern specific patient groups, but they can be less stable than marginal intervals because fewer simulations contribute to each subgroup’s tails. Check the number of outputs in each stratum, inspect the simulated covariate values and their dependencies, and assess whether additional draws materially change the endpoint quantiles. Earlier material on Monte Carlo error in prediction quantiles provides relevant methods for assessing endpoint stability. A large total simulation count does not guarantee precise conditional tails if only a small fraction of draws belongs to the subgroup.

Also check that subgroup membership is applied to the intended patient covariates and that model predictions are evaluated under consistent dose, time, and other conditions. Implausible covariate combinations, abrupt changes at category boundaries, or large endpoint shifts from small changes in the stratum definition can signal sparse support or model sensitivity. If a subgroup is absent or poorly represented in the input data, simulation does not create empirical support for it; predictions may depend heavily on model extrapolation.

A marginal interval is appropriate when the target is a new patient drawn from a specified overall population, including its subgroup proportions. A conditional interval is appropriate when the target is a new patient known to belong to a specified subgroup. A model-based conditional prediction evaluated at a fixed covariate value is another option when the question is about that particular profile. These approaches answer different questions and should not be presented as interchangeable.

Finally, subgroup intervals describe model-based predictive distributions, not guarantees for individual patients. Their interpretation depends on the model, input distributions, subgroup definition, and uncertainty sources included in the simulation. Wide intervals may reflect real within-group variability as well as uncertainty represented in the model; narrow intervals can be misleading if important sources of variation were omitted. Report the subgroup definition, endpoint and time, dose or scenario, interval level, quantile method, and units so the target is clear.

Key takeaway: A conditional prediction interval is calculated from the predictive distribution for the specified subgroup. Define the subgroup and prediction context first, preserve the relevant conditional covariate distribution, and estimate the subgroup’s quantiles rather than substituting a pooled interval.

Check Your Understanding

Answer each question, then compare your reasoning with the solutions.

  1. A model produces 100 concentration predictions for a renal-function stratum. Which outputs should determine the stratum’s conditional interval?
  2. Why is a marginal interval for a population containing two renal-function groups not generally a substitute for either group’s conditional interval?
  3. In the age example, what changes if age is fixed at 75 years rather than sampled from its distribution within the stratum?
  4. A subgroup has only 12 simulated outputs, despite 50,000 total simulations. What is the main concern when estimating a 95% conditional interval?
  5. For a continuous covariate, explain the difference between predicting at one fixed value and predicting for a range of values.

Solutions. (1) Use the 100 predictions whose patient covariates meet the specified stratum definition, provided those outputs represent the intended conditional predictive distribution. (2) The marginal CDF combines subgroup CDFs using population weights; its quantiles generally differ from the conditional quantiles. (3) Fixing age removes age variation from the predictive distribution, so the interval is for a fixed-age profile and is generally narrower under the example’s assumptions. (4) The subgroup’s tail quantiles may be highly unstable because few outputs determine the endpoints; the total simulation count does not resolve that scarcity. (5) Prediction at one value conditions on that specific profile, whereas prediction over a range includes the distribution of covariate values within the range.