Tutorials › Physiologically-Based Pharmacokinetics (PBPK) › Mixture Distributions for Multiple Plausible Scenarios

Uncertainty Propagation and Predictive Intervals · Tutorial 766 of 799

Mixture Distributions for Multiple Plausible Scenarios

Build and interpret a weighted predictive distribution when several discrete PBPK scenarios remain plausible.

Advanced 11 min read

What You'll Learn

  • Define a predictive mixture from scenario-specific PBPK output distributions and explicit scenario weights.
  • Calculate mixture expectations and separate within-scenario from between-scenario variance.
  • Construct mixture quantiles from the combined distribution rather than averaging scenario quantiles.
  • Estimate threshold-event probabilities using scenario weights and conditional probabilities.
  • Diagnose when scenario weights or scenario definitions do not support a meaningful mixture.
  • Compare a mixture with separate scenario-specific predictions and an unweighted range.

Why Combine Predictions Across Scenarios?

A PBPK prediction can depend on a discrete physiological assumption: for example, whether a clearance pathway is present, which maturation category applies, or which of two defensible organ-flow representations is used. If the alternatives remain plausible and the prediction must represent uncertainty across them, the output should account for both uncertainty within each scenario and uncertainty about which scenario applies. A mixture distribution does this by assigning an explicit weight to each alternative and combining its scenario-specific predictive distribution.

The weights are part of the analysis, not a cosmetic choice. They may represent specified plausibility weights or probabilities supported by evidence and the intended predictive question. Equal weights are not automatically justified merely because two scenarios have been considered. If no defensible probabilities can be assigned, report the scenario-specific predictions or a clearly labelled range instead of presenting an arbitrary mixture as a probability distribution.

Definition: Let \(S\) denote a discrete scenario taking one of \(K\) mutually exclusive and collectively exhaustive values, \(1,\ldots,K\). Let \(w_k=P(S=k)\), where \(w_k\geq 0\) and \(\sum_{k=1}^{K}w_k=1\). For a prediction \(Y\), the scenario mixture is the distribution whose conditional distribution given \(S=k\) is the PBPK predictive distribution for scenario \(k\), combined using the weights \(w_k\). The weights describe uncertainty over scenarios; they are not the within-scenario probabilities of prediction outcomes.

Defining the Mixture Precisely

Write \(F_k(y)=P(Y\leq y\mid S=k)\) for the predictive cumulative distribution function (CDF) under scenario \(k\). The mixture CDF is the weighted sum of these conditional CDFs:

$$ F(y)=P(Y\leq y)=\sum_{k=1}^{K} w_k F_k(y). $$

When the conditional distributions have densities \(f_k(y)\), the mixture density is \(f(y)=\sum_{k=1}^{K} w_k f_k(y)\). PBPK predictions are often obtained by propagating uncertain inputs through the model, so \(F_k\) may instead be represented by Monte Carlo draws or a weighted empirical distribution. The same mixture definition applies: combine conditional probabilities or empirical masses using the scenario weights.

A mixture represents a two-stage predictive statement: first a scenario is selected according to its weights, then a prediction is drawn from that scenario's conditional distribution. This is a statement about the predictive distribution, not a claim that a particular simulated individual literally changes physiological scenario during prediction. The scenarios must be defined consistently, and each \(F_k\) must condition on the scenario-specific assumptions while propagating the other uncertainties intended for the analysis.

Means and the Two Sources of Variance

Let \(\mu_k=E(Y\mid S=k)\) and \(\sigma_k^2=\operatorname{Var}(Y\mid S=k)\). The mixture mean is the weighted mean of the conditional means. Its variance has two components: average within-scenario variance and variance among scenario means.

$$ E(Y)=\sum_{k=1}^{K} w_k\mu_k,\qquad \operatorname{Var}(Y)= \underbrace{\sum_{k=1}^{K}w_k\sigma_k^2}_{\text{within-scenario variance}} + \underbrace{\sum_{k=1}^{K}w_k(\mu_k-E(Y))^2}_{\text{between-scenario variance}}. $$

The first term describes predictive spread that remains when the scenario is fixed. The second describes additional spread because the conditional means differ across scenarios. A mixture can therefore be more variable than any one scenario, although the exact comparison depends on the conditional variances and means. These variance summaries do not fully describe the distribution: separated scenario predictions can produce a shape that is not well summarized by a single mean and standard deviation.

Why the Variance Decomposition Holds

For a complete justification, write \(\mu=E(Y)\). Conditional on \(S=k\), add and subtract \(\mu_k\) to express the deviation from the overall mean as \(Y-\mu=(Y-\mu_k)+(\mu_k-\mu)\). Squaring and taking the conditional expectation gives:

$$ \begin{aligned} E\left[(Y-\mu)^2\mid S=k\right] &=E\left[(Y-\mu_k)^2\mid S=k\right] +2(\mu_k-\mu)E\left[Y-\mu_k\mid S=k\right] +(\mu_k-\mu)^2\\ &=\sigma_k^2+(\mu_k-\mu)^2, \end{aligned} $$

The cross-product term is zero because \(E(Y-\mu_k\mid S=k)=0\). Averaging over scenarios, with probabilities \(w_k\), yields \(\operatorname{Var}(Y)=\sum_k w_k[\sigma_k^2+(\mu_k-\mu)^2]\), which is the stated decomposition. This identity requires finite conditional means and variances; the CDF mixture itself does not require finite variance.

Worked Example: Combining Scenario Means and Variances

Hypothetical data. Suppose a PBPK analysis predicts AUC in two plausible physiological scenarios. Under scenario 1, AUC has mean \(8.0\) mg·h/L and variance \(4.0\) (mg·h/L)\(^2\). Under scenario 2, it has mean \(12.0\) mg·h/L and variance \(9.0\) (mg·h/L)\(^2\). The analysis assigns weights \(w_1=0.70\) and \(w_2=0.30\). These values and weights are illustrative.

The overall mean is:

$$ \mu=0.70(8.0)+0.30(12.0)=5.6+3.6=9.2\ \text{mg·h/L}. $$

The within-scenario contribution to variance is:

$$ 0.70(4.0)+0.30(9.0)=2.8+2.7=5.5\ (\text{mg·h/L})^2. $$

The between-scenario contribution is:

$$ 0.70(8.0-9.2)^2+0.30(12.0-9.2)^2 =0.70(1.44)+0.30(7.84)=1.008+2.352=3.36\ (\text{mg·h/L})^2. $$

Thus the mixture variance is \(5.5+3.36=8.86\) (mg·h/L)\(^2\), and its standard deviation is \(\sqrt{8.86}=2.977\) mg·h/L. The between-scenario component is not negligible here: ignoring it would understate the variance of the combined predictive distribution.

Quantiles Must Come From the Combined CDF

For a probability \(q\) between 0 and 1, define the mixture quantile by \(Q(q)=\inf\{y:F(y)\geq q\}\). To obtain it, first combine the scenario CDFs at each candidate \(y\), then find where the combined CDF reaches \(q\). In general, \(Q(q)\) is not the weighted average of the scenario-specific quantiles. Quantiles are nonlinear functionals of a distribution, so averaging them does not usually preserve the probability statement that defines a quantile.

Worked Example: A Mixture Central Prediction Interval

Hypothetical data. Consider empirical scenario distributions for a concentration prediction, in mg/L. In scenario 1, five equally weighted simulation draws are \(2,4,6,8,10\). In scenario 2, five equally weighted draws are \(8,10,12,14,16\). Assign weights \(0.60\) and \(0.40\), respectively. Use the empirical quantile definition \(Q(q)=\inf\{y:F(y)\geq q\}\).

Each draw in scenario 1 has conditional mass \(1/5\), so its mixture mass is \(0.60/5=0.12\). Each draw in scenario 2 has mixture mass \(0.40/5=0.08\). At values shared by the two scenarios, add their masses. The resulting cumulative probabilities are:

Concentration (mg/L)Mixture massMixture CDF
20.120.12
40.120.24
60.120.36
80.200.56
100.200.76
120.080.84
140.080.92
160.081.00

The 5th percentile is 2 mg/L, since the CDF first reaches or exceeds 0.05 there. The 95th percentile is 16 mg/L, since the CDF remains below 0.95 at 14 mg/L and reaches 1.00 at 16 mg/L. Under this empirical quantile convention, the central 90% mixture prediction interval is therefore \([2,16]\) mg/L. By contrast, the scenario-specific 5th percentiles are 2 and 8 mg/L and the 95th percentiles are 10 and 16 mg/L. Their weighted averages, 4.4 and 12.4 mg/L, are not the mixture's 5th and 95th percentiles.

Estimating Mixture Probabilities From Simulations

When scenario \(k\) has \(N_k\) simulated outcomes \(Y_{ki}\), an empirical estimate of the probability of exceeding a threshold \(c\) is:

$$ \widehat{P}(Y>c)=\sum_{k=1}^{K}w_k \left(\frac{1}{N_k}\sum_{i=1}^{N_k} I(Y_{ki}>c)\right), $$

where \(I(Y_{ki}>c)\) equals 1 if draw \(i\) in scenario \(k\) exceeds \(c\), and 0 otherwise. This estimator first estimates each conditional exceedance probability, then weights those estimates according to scenario plausibility. The scenario weights must not be replaced by the fraction of simulations allocated to each scenario unless that allocation was deliberately chosen to equal the target weights.

Worked Example: A Weighted Threshold Probability

Hypothetical data. Suppose two scenarios have weights \(0.25\) and \(0.75\). For a concentration threshold of \(2.0\) mg/L, 80 of 1,000 draws in scenario 1 exceed the threshold, while 200 of 1,000 draws in scenario 2 do. The estimated conditional probabilities are \(80/1000=0.080\) and \(200/1000=0.200\).

The weighted mixture estimate is:

$$ \widehat{P}(Y>2.0\ \text{mg/L}) =0.25(0.080)+0.75(0.200) =0.020+0.150=0.170. $$

The estimated probability of exceeding 2.0 mg/L under the specified mixture is 17.0%. It is not the unweighted average of the conditional estimates, which would be 14.0%, and it is not the overall fraction of exceedances after simply pooling the 2,000 draws, which would be 14.0% here because equal simulation counts do not match the 25%/75% scenario weights.

Diagnostics, Alternatives, and Limitations

Before interpreting a mixture, check that scenario weights are nonnegative, sum to one, and correspond to the predictive question. Confirm that the scenario definitions are mutually exclusive and collectively cover the alternatives represented by the weights. Within each scenario, inspect simulation convergence and verify that all outcomes use consistent units, endpoints, dosing conditions, and target populations. A numerically precise mixture cannot repair an implausible scenario set or unsupported weights.

A frequent implementation error is to pool all simulation draws and treat each draw as equally probable. That is appropriate only when the simulation allocation across scenarios matches the intended weights, or when a valid correction is applied. For example, allocating 1,000 draws to each scenario does not imply equal scenario probabilities. Another error is to average scenario quantiles and label the result a mixture interval; the worked example shows why the resulting endpoints need not have the stated coverage.

The main alternatives answer different questions. Reporting scenario-specific distributions keeps each conditional prediction visible and avoids assigning unsupported scenario probabilities. A range spanning scenario-specific intervals can show the envelope of outcomes, but it is not generally a prediction interval with a specified coverage probability. Reporting only a weighted mean summarizes one feature of the mixture while discarding its spread and distributional shape. A weighted mixture is useful when the weights are defensible and a single predictive distribution is needed; its interpretation remains conditional on the included scenarios and their weights.

Key takeaway: Combine conditional distributions, not just their summaries. Define the scenarios and weights, form the weighted CDF (or weighted empirical distribution), and calculate means, variances, quantiles, and event probabilities from that combined distribution.

Check Your Understanding

Answer each question, then compare with the solutions below.

  1. Two scenarios have weights 0.40 and 0.60 and conditional means 5 and 9 mg/L. What is the mixture mean?
  2. Why is an unweighted average of two scenario-specific 90th percentiles generally not the mixture's 90th percentile?
  3. Two scenarios have weights 0.20 and 0.80, with conditional probabilities of exceeding a threshold equal to 0.05 and 0.25. Find the mixture exceedance probability.
  4. What should be reported if scenario alternatives are plausible but no defensible probability weights are available?

Solutions. (1) The mixture mean is \(0.40(5)+0.60(9)=2+5.4=7.4\) mg/L. (2) The mixture percentile is defined by the weighted mixture CDF reaching 0.90; averaging conditional percentiles does not generally produce a value with that CDF probability. (3) The mixture exceedance probability is \(0.20(0.05)+0.80(0.25)=0.01+0.20=0.21\), or 21%. (4) Report the scenario-specific predictive results, or a clearly labelled range or envelope, rather than assigning arbitrary weights and presenting them as probabilities.