Tutorials › Optimal Design and Model-Informed Dosing › Posterior Risk Intervals in Bayesian Logistic Regression Models

Model-Based Dose Escalation · Tutorial 190 of 497

Posterior Risk Intervals in Bayesian Logistic Regression Models

Use the posterior distribution of a logistic dose-toxicity model to calculate risk intervals at candidate doses and interpret their widths in relation to the target toxicity rate.

Advanced 9 min read

What You'll Learn

  • Transform posterior draws or linear-predictor quantiles into toxicity-risk intervals at a fixed dose.
  • Calculate an approximate risk interval from a joint normal posterior for logistic-model parameters.
  • Interpret interval width in probability units and percentage points near a target toxicity rate.
  • Distinguish a dose-specific credible interval from a simultaneous band and from a posterior overdose probability.
  • Identify model, posterior, and numerical diagnostics that can undermine reported intervals.

Why Risk Intervals Matter in Dose Finding

A dose-toxicity model does not give a single known toxicity probability at each candidate dose. It gives a posterior distribution for that probability, reflecting uncertainty in the model parameters after the observed dose-limiting toxicity (DLT) data and prior information are combined. A posterior risk interval summarizes part of that distribution at a particular dose. It can show whether the estimated risk is fairly well determined or remains uncertain, including when the estimated risk is near the target toxicity rate.

The interval is not itself a dose recommendation. In particular, a risk interval that contains the target does not establish that the dose has an acceptable overdose probability, nor does a narrow interval establish that the model is appropriate. The interval answers a more focused question: under the specified model, prior, and observed data, what range of toxicity probabilities is supported by a chosen portion of the posterior distribution at this dose?

Model and Definition

For a binary DLT outcome \(Y_i\) observed within a defined assessment window, let \(Y_i=1\) indicate a DLT and \(Y_i=0\) otherwise. At dose \(d_i\), the logistic model specifies

$$ Y_i\mid d_i,\alpha,\beta \sim \operatorname{Bernoulli}\{p(d_i)\}, \qquad \operatorname{logit}\{p(d)\}=\alpha+\beta x(d), \qquad x(d)=\log(d/d_{\mathrm{ref}}). $$

Here \(d_{\mathrm{ref}}\) is a positive reference dose, \(\alpha\) is the log-odds of DLT at that reference dose, and \(\beta\) is the slope per unit of log dose. The inverse-logit function is \(\operatorname{logit}^{-1}(z)=1/\{1+\exp(-z)\}\). If the model imposes \(\beta>0\), its risk curve increases with dose. A prior distribution on \((\alpha,\beta)\), together with the likelihood, yields a posterior distribution for these parameters and therefore for \(p(d)\).

Definition: At a fixed candidate dose \(d\), a central \(100(1-\gamma)\%\) posterior risk interval is the interval between the \(\gamma/2\) and \(1-\gamma/2\) posterior quantiles of \(p(d)\). For a 95% interval, these are the 2.5th and 97.5th percentiles. Its posterior credible interpretation is conditional on the specified model, prior, and observed data.

The dose must be held fixed when interpreting this interval. The interval is a marginal, dose-specific summary: it accounts for posterior uncertainty in the model parameters at that dose. A collection of such intervals across doses is not automatically a simultaneous 95% band for the entire risk curve. Nor is a Bayesian credible interval a frequentist confidence interval: its stated posterior probability applies to the parameter or risk under the posterior distribution, conditional on the model and data.

Transforming Posterior Uncertainty to Risk

The direct calculation uses posterior draws. For draw \(m\), transform its parameter values \((\alpha^{(m)},\beta^{(m)})\) to a risk at dose \(d\):

$$ p^{(m)}(d)=\frac{1}{1+\exp\{-\alpha^{(m)}-\beta^{(m)}x(d)\}}. $$

The empirical quantiles of these transformed draws estimate the posterior risk quantiles. This approach preserves the joint posterior dependence between \(\alpha\) and \(\beta\), which matters because the linear predictor at a dose is a combination of both parameters. With a large, well-mixed posterior sample, the quantiles can be estimated directly without assuming that the risk itself is normally distributed.

A useful justification follows from monotonicity. The inverse-logit function is strictly increasing, so for a scalar posterior linear predictor \(\eta(d)=\alpha+\beta x(d)\), its quantiles transform in order:

$$ Q_{p(d)}(q)=\operatorname{logit}^{-1}\{Q_{\eta(d)}(q)\}, \qquad 0<q<1. $$

Thus, if the posterior quantiles of \(\eta(d)\) are available, applying the inverse-logit to the lower and upper quantiles gives the corresponding risk interval endpoints. This does not mean that the interval width can be found by transforming the width on the log-odds scale: the inverse-logit is nonlinear, so endpoint transformation is required.

Worked Example: Transforming Linear-Predictor Quantiles

Suppose posterior output for a hypothetical candidate dose gives the 2.5th and 97.5th percentiles of \(\eta(d)\) as \(-2.0\) and \(-0.3\). Calculate the equal-tailed 95% risk interval and its width.

Apply the inverse-logit to each endpoint:

$$ p_L=\frac{1}{1+\exp(2.0)}\approx 0.1192,\qquad p_U=\frac{1}{1+\exp(0.3)}\approx 0.4256. $$

The interval is approximately \(0.1192\) to \(0.4256\), or 11.92% to 42.56%. Using the unrounded endpoint calculations, its width is

$$ p_U-p_L\approx 0.4255575-0.1192029=0.3063546\approx 0.306. $$

Thus the width is about 30.6 percentage points. If the target toxicity rate is 30%, it lies within this interval, but that fact alone does not show that the dose is safe or that its posterior risk is concentrated near 30%. The interval extends over substantial risk values on both sides of the target.

Intervals From a Joint Normal Approximation

When posterior draws are unavailable, a local approximation can be made from a bivariate normal posterior for the parameter vector. Suppose \((\alpha,\beta)\) has posterior mean \((\mu_\alpha,\mu_\beta)\), variances \(V_\alpha,V_\beta\), and covariance \(C_{\alpha\beta}\). At a fixed dose, the linear predictor is a linear combination of the parameters. Its posterior mean and variance are therefore

$$ \mu_\eta(d)=\mu_\alpha+x(d)\mu_\beta,\qquad V_\eta(d)=V_\alpha+x(d)^2V_\beta+2x(d)C_{\alpha\beta}. $$

If the joint normal approximation is adequate, \(\eta(d)\) is approximately normal. An approximate equal-tailed 95% interval for its value is \(\mu_\eta(d)\pm1.96\sqrt{V_\eta(d)}\); inverse-logit transformation gives an approximate risk interval. This calculation must use the covariance term, not just the separate parameter variances. It also assumes that the normal approximation is reasonable in the relevant posterior region.

Worked Example: Approximate Interval at a Candidate Dose

Consider a hypothetical posterior approximation with \(\mu_\alpha=-1.00\), \(\mu_\beta=0.800\), \(V_\alpha=0.1225\), \(V_\beta=0.0625\), and \(C_{\alpha\beta}=-0.0300\). Calculate the approximate 95% risk interval at \(d=200\) when \(d_{\mathrm{ref}}=100\).

First, the dose covariate is \(x(d)=\log(200/100)=\log(2)\approx0.6931\). The linear-predictor mean is

$$ \mu_\eta=-1.00+(0.6931)(0.800)=-0.4455. $$

Its variance, including the covariance term, is

$$ V_\eta=0.1225+(0.6931)^2(0.0625)+2(0.6931)(-0.0300) \approx 0.1109. $$

The standard deviation is \(\sqrt{0.1109}\approx0.3330\). The approximate logit-scale interval is

$$ -0.4455\pm1.96(0.3330)=[-1.0982,\ 0.2072]. $$

Transforming the endpoints gives

$$ \operatorname{logit}^{-1}(-1.0982)\approx0.2500,\qquad \operatorname{logit}^{-1}(0.2072)\approx0.5516. $$

The approximate 95% posterior risk interval is therefore 25.00% to 55.16%, with a width of about 30.16 percentage points. This interval is approximate because it relies on the bivariate normal posterior approximation. In an analysis with posterior draws, quantiles of the transformed draws are generally preferable, especially if the posterior is skewed or constrained.

Reading Interval Width Near the Target

The width is the upper risk endpoint minus the lower risk endpoint, measured in probability units or percentage points. It describes posterior spread on the risk scale, not the distance between a point estimate and the target. Width is affected both by uncertainty in the linear predictor and by the nonlinear inverse-logit transformation. In particular, equal uncertainty on the logit scale can produce different risk-scale widths at different locations: the inverse-logit changes most rapidly near zero and flattens toward risks of zero and one.

Worked Example: Comparing Widths Across Candidate Doses

Suppose posterior linear-predictor quantiles at three hypothetical candidate doses are as follows. Calculate the transformed risk intervals and compare their widths. The middle dose has a posterior median risk near a 30% target.

Candidate dose2.5th–97.5th percentiles of \(\eta(d)\)
Low\([-3.2,-1.2]\)
Near target\([-2.0,-0.3]\)
High\([-1.2,0.8]\)

At the low dose, the endpoint risks are \(\operatorname{logit}^{-1}(-3.2)\approx0.0392\) and \(\operatorname{logit}^{-1}(-1.2)\approx0.2315\). The interval is about 3.92% to 23.15%, with width \(0.2315-0.0392\approx0.1923\), or 19.23 percentage points.

Near the target, the endpoint risks are \(\operatorname{logit}^{-1}(-2.0)\approx0.1192\) and \(\operatorname{logit}^{-1}(-0.3)\approx0.4256\). The interval is about 11.92% to 42.56%, with width approximately \(0.3064\), or 30.64 percentage points. The posterior median risk is near the target, but the interval is broad enough to include materially lower and higher risks.

At the high dose, the endpoint risks are \(\operatorname{logit}^{-1}(-1.2)\approx0.2315\) and \(\operatorname{logit}^{-1}(0.8)\approx0.6900\). The interval is about 23.15% to 69.00%, with width \(0.6900-0.2315\approx0.4585\), or 45.85 percentage points. These comparisons show why an interval width must be read with its endpoints and dose context. It is not a measure of closeness to target, and intervals from different doses need not have the same width.

Diagnostics, Alternatives, and Limitations

Before interpreting the interval, check that the posterior computation and the model support it. For simulation-based output, inspect chain mixing, effective sample sizes, convergence diagnostics, and stability of the reported quantiles. A small effective sample size in the tails can make 2.5th and 97.5th percentiles unstable even when the posterior median appears stable. Recompute intervals from longer or better-mixed runs if relevant tail quantiles vary materially across chains or runs.

Check the model inputs as well: the dose units and reference dose must be consistent; the DLT assessment window must match the outcome being modeled; and the likelihood and prior must correspond to the intended analysis. For a monotone dose-toxicity model, inspect whether the posterior slope behaves as intended and whether the risk curve is plausible over the candidate-dose range. A credible interval computed precisely from an implausible or poorly calibrated model does not become reliable merely because its endpoints are numerically stable.

The posterior median or mean risk is an alternative point summary, but neither replaces an interval when uncertainty is important. The posterior mean risk at a dose is the average of the transformed posterior draws, not generally the inverse-logit of the posterior mean linear predictor. A posterior probability such as \(P\{p(d)>\phi\mid\text{data}\}\), where \(\phi\) is a specified risk threshold, answers a different question from a central interval: it is the posterior probability that risk exceeds that threshold. A dose-specific interval also differs from a simultaneous curve band, which must account for uncertainty across doses jointly.

A common mistake is to say, “The interval contains the 30% target, so the dose has a 95% probability of being acceptable.” The correction is that a central 95% interval describes the posterior distribution of risk at that dose; it does not assign 95% probability to the target being met, and inclusion of the target does not quantify the probability of exceeding a safety threshold. That probability requires evaluating the relevant posterior event directly. Likewise, a narrow interval does not guarantee good prediction if the logistic form, monotonicity assumption, prior, or data structure is inappropriate.

Key takeaway: Calculate a dose-specific risk interval by transforming posterior uncertainty through the inverse-logit, preferably using joint posterior draws. Report its endpoints and width in context, and distinguish uncertainty about risk from a dose-selection rule or a posterior probability of exceeding a threshold.

Check Your Understanding

Answer each question, then compare your reasoning with the solutions below.

  1. A posterior 95% interval for the linear predictor at a dose is \([-1.0,0.5]\). What is the corresponding approximate risk interval?
  2. Why must the covariance between \(\alpha\) and \(\beta\) be included when calculating the variance of \(\eta(d)\)?
  3. A 95% dose-specific risk interval contains the target rate. Does that establish a 95% posterior probability that the dose is acceptable?
  4. Two doses have the same width of posterior uncertainty on the logit scale. Must their risk intervals have the same width?

Solutions. (1) Transform both endpoints: \(\operatorname{logit}^{-1}(-1.0)=1/(1+\exp(1))\approx0.2689\), and \(\operatorname{logit}^{-1}(0.5)=1/(1+\exp(-0.5))\approx0.6225\). The risk interval is approximately 26.89% to 62.25%. (2) Since \(\eta(d)=\alpha+x(d)\beta\), its variance is \(V_\alpha+x(d)^2V_\beta+2x(d)C_{\alpha\beta}\); omitting the covariance generally gives the wrong variance. (3) No. The interval summarizes the posterior distribution of risk; it neither gives a 95% probability of acceptability nor directly calculates the probability of exceeding a specified threshold. (4) No. The inverse-logit is nonlinear, so the same logit-scale spread can map to different probability-scale widths depending on where the interval lies.

Clinical Biostats