From posterior evidence to a dose decision
A posterior distribution describes uncertainty about each dose’s effects after observing the data. A dose-selection rule turns that uncertainty into an action: for example, retain doses that have a sufficiently high posterior probability of meeting an efficacy target and a sufficiently high probability of staying below a toxicity limit. Alternatively, choose the dose with the greatest posterior expected utility, where utility gives explicit value to benefit and harm.
These rules answer different questions. A probability threshold asks whether a dose is sufficiently likely to satisfy a specified condition. An expected-utility rule asks which available action has the greatest average value under a stated utility scale. Neither rule is automatic: the target, thresholds and relative value of benefits and harms are decision inputs that should be specified and justified.
For a simple binary-outcome model, each participant at dose \(j\) has an efficacy outcome and a toxicity outcome, each coded 1 if the event occurs and 0 otherwise. The marginal data at a dose can be modelled as binomial counts conditional on \(\theta_{E,j}\) and \(\theta_{T,j}\). A common conjugate specification gives each rate a beta prior; with a \(\mathrm{Beta}(a,b)\) prior and \(y\) events among \(n\) observations, the posterior is \(\mathrm{Beta}(a+y,b+n-y)\). This calculation presumes the binomial sampling model is appropriate and the prior is specified before using the data for the decision.
A rule may require two marginal conditions, such as \(P(\theta_{E,j}\geq\theta_E^*\mid D)\geq\gamma_E\) and \(P(\theta_{T,j}\leq\theta_T^*\mid D)\geq\gamma_T\). Satisfying both is a pair of marginal statements; it does not, by itself, specify the posterior probability that both conditions hold simultaneously. That joint probability requires a joint posterior model. The examples below use marginal criteria or additive utility and do not infer a joint event from marginal probabilities.
Calculating a posterior probability criterion
The posterior probability is evaluated against a prespecified threshold, not against a frequentist significance level. For integer beta parameters, a useful identity gives an exact calculation: if \(X\sim\mathrm{Beta}(a,b)\), then \(P(X>q)=P\{Z\leq a-1\}\), where \(Z\sim\mathrm{Binomial}(a+b-1,q)\). This identity follows from the relationship between the beta cumulative distribution function and binomial tail probabilities.
Worked Example: Probability That Efficacy Exceeds a Target
Suppose 18 hypothetical participants receive one dose, and 8 experience the efficacy event. Use a uniform \(\mathrm{Beta}(1,1)\) prior for the dose’s efficacy rate \(\theta_E\). Find the posterior probability that \(\theta_E>0.5\), and assess whether it reaches a decision threshold of 0.80.
The binomial model treats each participant’s efficacy outcome as a Bernoulli observation with the same dose-specific rate. With the stated prior, the posterior is \(\mathrm{Beta}(1+8,1+18-8)=\mathrm{Beta}(9,11)\). The beta-binomial identity gives
The posterior probability is about 0.3238, below the specified threshold of 0.80. Under this rule, the dose does not meet the efficacy-probability criterion. This is not a claim that the probability the null hypothesis is true is 0.6762; it is a posterior probability about the dose’s efficacy rate under the stated model and prior.
Screening doses with efficacy and toxicity criteria
A practical probability-based rule can first exclude doses that are insufficiently likely to be effective or sufficiently likely to be too toxic. The decision thresholds should reflect the intended use of the dose and the consequences of errors. For example, a rule might retain dose \(j\) only when both \(P(\theta_{E,j}\geq\theta_E^*\mid D)\geq\gamma_E\) and \(P(\theta_{T,j}\leq\theta_T^*\mid D)\geq\gamma_T\). A further rule is needed if more than one dose remains; one might choose the lowest qualifying dose or use expected utility to rank the qualifying doses.
Worked Example: Applying Separate Efficacy and Toxicity Thresholds
Consider two hypothetical doses. At the lower dose, 7 of 8 participants have the efficacy event and 1 of 8 has the toxicity event. At the higher dose, the corresponding counts are 8 of 10 and 4 of 8. Use independent \(\mathrm{Beta}(1,1)\) marginal priors for each dose and each outcome, and assume binomial sampling for each marginal count. The rule requires at least 0.90 posterior probability that efficacy exceeds 0.50 and at least 0.90 posterior probability that toxicity is no more than 0.50.
At the lower dose, the efficacy posterior is \(\mathrm{Beta}(8,2)\). Using the beta-binomial identity, \(P(\theta_{E,\mathrm{low}}>0.5\mid D)=P\{\mathrm{Binomial}(9,0.5)\leq7\}\), so \[ 1-\frac{{9\choose8}+{9\choose9}}{2^9} =1-\frac{10}{512} =\frac{502}{512} \approx 0.9805. \] The toxicity posterior is \(\mathrm{Beta}(2,8)\), giving \(P(\theta_{T,\mathrm{low}}\leq0.5\mid D)=P\{\mathrm{Binomial}(9,0.5)\geq2\}=502/512\approx0.9805\). The lower dose meets both marginal thresholds.
At the higher dose, the efficacy posterior is \(\mathrm{Beta}(9,3)\). Therefore, \[ P(\theta_{E,\mathrm{high}}>0.5\mid D) =P\{\mathrm{Binomial}(11,0.5)\leq8\} =1-\frac{55+11+1}{2048} =\frac{1981}{2048} \approx0.9673. \] Its toxicity posterior is \(\mathrm{Beta}(5,5)\). Symmetry about 0.5 gives \(P(\theta_{T,\mathrm{high}}\leq0.5\mid D)=0.5000\). The higher dose meets the efficacy threshold but fails the toxicity threshold. Under the stated rule, retain the lower dose and exclude the higher one. These conclusions depend on the chosen targets, thresholds and model; they are not universal properties of the two doses.
Choosing by posterior expected utility
A probability screen treats the chosen cutoffs as decisive. Expected utility offers another way to express trade-offs. Suppose a participant’s utility at dose \(j\) is \(u_j\), specified in utility points, and it is additive in efficacy and toxicity:
where \(B>0\) is the utility value assigned to efficacy and \(H>0\) is the disutility assigned to toxicity. If dose burden or treatment cost matters, it can be included as another prespecified utility term. For a finite set of available doses and a common utility scale, select a dose \(j^*\) maximizing \(EU_j\). This rule balances the outcomes through the specified values \(B\) and \(H\), rather than through separate pass/fail probability cutoffs.
The justification is direct. If the action is to choose one dose and the consequence of action \(j\) is utility \(u_j\), its posterior expected utility is \(E(u_j\mid D)\). The posterior expected utility of any randomized choice among doses is a weighted average of their \(EU_j\) values, and cannot exceed the largest of them. Choosing a dose with maximum \(EU_j\) therefore maximizes posterior expected utility among the available actions. This derivation relies on comparing utilities on the same scale and on the stated model for the posterior expectations.
Worked Example: Ranking Three Doses by Expected Utility
For three hypothetical doses, suppose the efficacy and toxicity counts are respectively 7/10 and 1/10 at the low dose, 8/10 and 3/10 at the middle dose, and 9/10 and 6/10 at the high dose. Use \(\mathrm{Beta}(1,1)\) priors for both marginal rates at each dose and binomial sampling models for the counts. Assign 100 utility points to an efficacy event and a disutility of 120 points to a toxicity event, so \(u_j=100I(E_j=1)-120I(T_j=1)\). Additivity means the expectation can be calculated from the marginal posterior means; no independence between efficacy and toxicity is required for this linear expectation.
The posterior means are the beta shape parameter for events divided by the sum of the two shape parameters. At the low dose, the posteriors are \(\mathrm{Beta}(8,4)\) for efficacy and \(\mathrm{Beta}(2,10)\) for toxicity. Thus, \(E(\theta_{E,\mathrm{low}}\mid D)=8/12=0.6667\) and \(E(\theta_{T,\mathrm{low}}\mid D)=2/12=0.1667\), giving \(EU_{\mathrm{low}}=100(0.6667)-120(0.1667)\approx46.67\) utility points.
At the middle dose, the posteriors are \(\mathrm{Beta}(9,3)\) and \(\mathrm{Beta}(4,8)\), with means 0.7500 and 0.3333. Therefore, \(EU_{\mathrm{middle}}=100(0.7500)-120(0.3333)=35.00\) utility points.
At the high dose, the posteriors are \(\mathrm{Beta}(10,2)\) and \(\mathrm{Beta}(7,5)\), with means 0.8333 and 0.5833. Therefore, \(EU_{\mathrm{high}}=100(0.8333)-120(0.5833)\approx13.33\) utility points. The low dose has the greatest posterior expected utility and is selected under this rule. The conclusion is conditional on the specified utility values: a different relative valuation of efficacy and toxicity could change the ranking.
Assumptions, checks and alternatives
Before applying either rule, check that the dose-specific outcome model and prior are appropriate for the available data. In a beta-binomial analysis, confirm that the counts refer to the intended population and follow-up period, that event definitions are consistent across doses, and that the binomial sampling assumption is reasonable. Inspect how much the prior influences the posterior, particularly when dose-specific sample sizes are small. Also check whether the decision thresholds and utility values were set independently of the observed outcomes; choosing them after seeing the results can make the decision difficult to interpret.
A posterior probability rule is transparent when there are clinically meaningful targets and a clear acceptable level of uncertainty. An expected-utility rule can compare several outcomes on one scale and can distinguish doses that all pass a screen. The alternatives are not interchangeable: a dose can pass efficacy and safety thresholds but have lower expected utility than another qualifying dose, or have the highest expected utility while failing a non-negotiable safety constraint. In that situation, a coherent protocol can apply a safety screen first and maximize expected utility among the remaining doses.
- Common mistake: treating two marginal probabilities as a joint guarantee. Passing both separate 0.90 criteria does not establish that the probability of meeting both conditions is 0.90 or greater. The correction is to state the criteria as separate marginal requirements or calculate the joint probability under a suitable joint posterior.
- Common mistake: calling the highest observed efficacy rate the optimal dose. The observed rate ignores posterior uncertainty and toxicity. The correction is to apply the prespecified posterior decision rule to all relevant outcomes and candidate doses.
- Common mistake: treating utility points as objective facts. A numerical utility scale encodes value judgments. The correction is to justify its components and examine whether plausible alternatives would change the choice.
These rules do not, by themselves, establish a dose’s causal effect, guarantee patient benefit, or quantify frequentist error rates. Their conclusions are conditional on the model, prior and decision inputs. They also do not resolve issues such as uncertain control response, complex dependence or computational error; those require additional modelling and assessment.
Check Your Understanding
Use the definitions and decision rules above. Solutions follow the questions.
- For a dose with posterior efficacy distribution \(\mathrm{Beta}(6,4)\), write the posterior probability criterion for efficacy exceeding 0.50 when the required probability is 0.90.
- Why does satisfying separate efficacy and toxicity probability thresholds not automatically give the posterior probability that both conditions hold?
- For posterior efficacy and toxicity means of 0.70 and 0.20, calculate expected utility when efficacy is worth 100 points and toxicity has disutility 150 points.
- Two doses have expected utilities of 42 and 42 utility points. What does the expected-utility rule imply, and what additional decision input could break the tie?
Solutions. (1) The criterion is \(P(\theta_E>0.50\mid D)\geq0.90\); whether it is satisfied requires evaluating that beta posterior probability. (2) Separate marginal probabilities do not determine the probability of the intersection without information about the joint posterior dependence. (3) \(EU=100(0.70)-150(0.20)=70-30=40\) utility points. (4) Both doses maximize posterior expected utility, so the rule leaves a tie. A prespecified secondary criterion, such as choosing the lower dose when utility is equal, can resolve it.