Tutorials › Model-Informed Drug Development (MIDD) › Risk Tolerance Thresholds for Clinical Trade-Offs

Quantitative Benefit-Risk Assessment · Tutorial 353 of 596

Risk Tolerance Thresholds for Clinical Trade-Offs

Learn to calculate a utility-based harm threshold, distinguish a break-even boundary from the largest feasible harm rate, and interpret the result in context.

Advanced 12 min read

What You'll Learn

  • Derive the harm threshold from an additive expected-utility model.
  • Distinguish the treatment harm rate from the increase in harm relative to control.
  • Interpret the threshold as a conditional trade-off, not as a probability of treatment benefit.
  • Handle thresholds above 100% without incorrectly describing them as indifference points.
  • Check the model’s assumptions and compare utility thresholds with risk-difference and risk-ratio criteria.

Why a Risk Tolerance Threshold Is Useful

A treatment may improve the chance of an efficacy outcome while also increasing the chance of a harmful outcome. A risk tolerance threshold makes that trade-off explicit: given a specified efficacy gain and a specified value assigned to each outcome, how large could the treatment harm rate be before its expected utility no longer exceeds control’s? This is a model-based comparison, not a universal clinical rule. Its answer depends on the outcomes, time horizon, utility values, and control risks used.

The introductory material on nonlinear utility for benefit and harm motivates representing outcomes by their value rather than treating every event as equally important. Here, consider a particular additive utility model and derive the maximum acceptable treatment harm rate from it. The resulting threshold is conditional on the model inputs; it does not by itself account for uncertainty in those inputs or establish a treatment recommendation.

Model and Assumptions

Definition: Let \(E\) indicate whether a patient experiences the specified efficacy outcome and \(H\) indicate whether the patient experiences the specified harm during a common follow-up period. Consider the additive utility \(U=bE-hH\), where \(b>0\) is the utility gain for efficacy and \(h>0\) is the utility loss for harm. For comparator \(C\) and treatment \(T\), let \(p_{E,C}\), \(p_{E,T}\), \(p_{H,C}\), and \(p_{H,T}\) be the respective event probabilities. Define the efficacy gain as \(\Delta p_E=p_{E,T}-p_{E,C}\). Under this model, the treatment has nonnegative incremental expected utility when \(b\Delta p_E-h(p_{H,T}-p_{H,C})\geq 0\).

This formulation uses an additive utility: the utility contribution of efficacy is \(bE\), and the contribution of harm is \(-hH\). It assumes that these contributions add, that the utility values apply to both treatment groups, and that the specified efficacy and harm outcomes are defined over the same relevant population and time horizon. The utility scale can be rescaled without changing the threshold, provided both \(b\) and \(h\) are rescaled by the same positive factor. Their ratio, not their separate numerical scale, determines the trade-off.

The model also treats utility as depending on these outcome indicators alone. If other outcomes differ between arms or the value of one outcome depends on whether the other occurs, this two-term calculation may not represent the full comparison. Correlation between \(E\) and \(H\) does not alter the expectation of this particular additive utility: linearity of expectation gives \(E[U]=bP(E=1)-hP(H=1)\). However, dependence can matter for a different, non-additive utility model.

Deriving the Threshold

Assume first that the treatment efficacy gain \(\Delta p_E\) is specified and positive. The treatment is at least as good as control according to this model when its incremental expected utility is nonnegative. Solving that condition for the treatment harm probability gives the harm-rate threshold.

$$ \begin{aligned} \Delta EU &=E[U_T]-E[U_C]\\ &=b(p_{E,T}-p_{E,C})-h(p_{H,T}-p_{H,C})\\ &=b\Delta p_E-h(p_{H,T}-p_{H,C})\geq 0,\\ p_{H,T} &\leq p_{H,C}+\frac{b}{h}\Delta p_E. \end{aligned} $$

The right-hand side, \(p_{H,C}+(b/h)\Delta p_E\), is the uncapped break-even value. When it is at most 1, it is a feasible harm rate at which the model gives equal expected utility to treatment and control. Rates below it give positive incremental expected utility; rates above it give negative incremental expected utility, when those rates are feasible. The threshold includes the comparator’s harm rate because the decision depends on the increase in harm, not on the treatment harm rate in isolation.

A harm probability cannot exceed 1. If the uncapped break-even value is greater than 1, no feasible treatment harm rate reaches break-even. Even at \(p_{H,T}=1\), incremental expected utility remains positive under the stated model. In this case the maximum feasible treatment harm rate is 1, but 1 is not an indifference point. If the uncapped value equals 1, by contrast, a treatment harm rate of 1 is a feasible break-even point. These cases must not be conflated.

For a negative efficacy gain, the same inequality still applies algebraically, but it does not describe a positive efficacy benefit being traded against harm. The examples below use a positive specified gain. If efficacy and harm risks are uncertain rather than fixed, this calculation is a threshold conditional on chosen values; uncertainty requires separate analysis.

Worked Example: Calculating a Feasible Break-Even Harm Rate

Suppose a hypothetical treatment raises the probability of an efficacy outcome from 0.40 to 0.45, a gain of 0.05, or 5 percentage points. The harm probability under control is 0.03. In the chosen utility scale, efficacy has value \(b=1.00\) utility unit and harm has loss \(h=0.25\) utility unit. Assume these values and event probabilities refer to the same follow-up period, and that the additive model is appropriate for this illustration.

The efficacy gain is \(\Delta p_E=0.45-0.40=0.05\). The uncapped break-even value is

$$ p_{H,C}+\frac{b}{h}\Delta p_E =0.03+\frac{1.00}{0.25}(0.05) =0.03+0.20 =0.23. $$

Thus, a treatment harm probability of 0.23, or 23%, is the break-even rate in this model. It represents a 20-percentage-point increase relative to the 3% control risk. For example, if the treatment harm rate were 0.18, the harm increase would be \(0.18-0.03=0.15\), and

$$ \Delta EU=(1.00)(0.05)-(0.25)(0.15) =0.0500-0.0375 =0.0125\text{ utility units}. $$

The model therefore gives treatment a positive incremental expected utility at an 18% harm rate. At 23%, the calculation is \(0.0500-(0.25)(0.20)=0\), as required for a break-even rate. This is a consequence of the assumed utility values, not a claim that a 23% harm rate would be clinically acceptable in every setting.

Worked Example: When the Uncapped Value Exceeds 100%

Consider another hypothetical comparison with \(p_{E,C}=0.50\), \(p_{E,T}=0.62\), \(p_{H,C}=0.08\), \(b=8.00\) utility units, and \(h=1.00\) utility unit. The efficacy gain is \(0.62-0.50=0.12\). Assume the same additive model and a common outcome period.

The uncapped break-even value is

$$ 0.08+\frac{8.00}{1.00}(0.12)=0.08+0.96=1.04. $$

Because 1.04 exceeds the largest possible probability, it is not a feasible indifference point. At the largest feasible treatment harm rate, \(p_{H,T}=1\), the harm increase is \(1.00-0.08=0.92\). The incremental expected utility is

$$ \Delta EU=(8.00)(0.12)-(1.00)(0.92)=0.96-0.92=0.0400\text{ utility units}. $$

This value is positive. Therefore, no feasible treatment harm rate reaches break-even in this specified model, and all feasible treatment harm rates—including 100%—give treatment greater expected utility than control. The maximum feasible treatment harm rate is 100%, but it is not a tie boundary. Describing it as an indifference threshold would be incorrect.

Worked Example: Checking a Proposed Treatment Rate

Suppose, in a hypothetical setting, \(p_{E,C}=0.30\), \(p_{E,T}=0.34\), and \(p_{H,C}=0.10\). Let \(b=2.00\) utility units and \(h=0.50\) utility unit. A proposed treatment harm rate is 0.22. Assume the model’s additive utility values and shared follow-up period are suitable for this comparison.

The efficacy gain is \(0.34-0.30=0.04\). The uncapped break-even value is

$$ 0.10+\frac{2.00}{0.50}(0.04) =0.10+0.16 =0.26. $$

The proposed rate, 0.22, is below the 0.26 break-even value. Direct calculation verifies the interpretation: the harm increase is \(0.22-0.10=0.12\), so

$$ \Delta EU=(2.00)(0.04)-(0.50)(0.12) =0.0800-0.0600 =0.0200\text{ utility units}. $$

The treatment has positive incremental expected utility under these inputs. The 0.26 threshold is a treatment harm rate, whereas 0.16 is the corresponding maximum increase over control. Reporting which quantity is meant prevents a common ambiguity.

Why the Derivation Works

The threshold follows directly from comparing expected utilities under the same utility function. For each arm, the expected utility is the efficacy value multiplied by its event probability, minus the harm loss multiplied by its event probability. Subtracting control from treatment cancels any terms shared by both arms and leaves only the differences in efficacy and harm risks:

$$ \begin{aligned} E[U_T]-E[U_C] &=(bp_{E,T}-hp_{H,T})-(bp_{E,C}-hp_{H,C})\\ &=b(p_{E,T}-p_{E,C})-h(p_{H,T}-p_{H,C}). \end{aligned} $$

Setting this difference equal to zero identifies the break-even condition. Rearranging the inequality for nonnegative incremental utility gives \(p_{H,T}\leq p_{H,C}+(b/h)\Delta p_E\). This also shows the direction of the trade-off: for fixed positive weights, a larger efficacy gain increases the harm rate compatible with break-even; a larger harm loss relative to efficacy value reduces the tolerated increase.

1
Specify the comparison.
Name the efficacy and harm outcomes, the treatment and comparator, and the shared follow-up period. Use absolute event probabilities on the same population basis.
2
Set the utility values.
State \(b\) and \(h\) in a consistent utility scale and justify why the additive model is suitable for the decision being considered.
3
Calculate the uncapped value.
Compute \(p_{H,C}+(b/h)\Delta p_E\). Compare this value with 1 before describing it as a feasible break-even rate.
4
Interpret and verify.
If the value is at most 1, interpret it as the break-even treatment harm rate. If it is greater than 1, state that no feasible harm rate reaches break-even and verify the sign of incremental utility at \(p_{H,T}=1\).

Diagnostics, Alternatives, and Limitations

Before using a threshold, check that efficacy and harm are defined consistently across arms and over the same period. A difference between a 12-month treatment efficacy rate and a lifetime control harm rate does not represent the stated model comparison. Check that each probability is an absolute risk, that the efficacy gain is treatment minus control, and that the threshold is not confused with the allowed increase in harm. A direct substitution into \(\Delta EU=b\Delta p_E-h(p_{H,T}-p_{H,C})\) is a useful arithmetic and sign check.

The utility values deserve particular scrutiny. They express how much the decision-maker values the efficacy outcome relative to the harm, not how frequently either event occurs. If the utility ratio \(b/h\) is poorly supported, the resulting threshold may look precise while being highly preference-dependent. A threshold calculated from estimated event rates and elicited utilities should therefore be presented with its assumptions and input values; a single plug-in value does not express uncertainty in those inputs.

A risk-difference criterion is the closest arithmetic alternative: it states a tolerated increase in harm risk directly. In this additive model that increase at break-even is \((b/h)\Delta p_E\), so the utility model explains how the permitted difference follows from the efficacy gain and relative outcome values. A risk-ratio criterion instead compares \(p_{H,T}/p_{H,C}\). It can be useful when proportional changes are the chosen decision scale, but it is not equivalent to this utility-derived threshold: the same risk ratio implies different absolute harm increases at different control risks. Neither a fixed risk difference nor a fixed risk ratio automatically represents the specified utility trade-off.

The result is limited to the utility structure and inputs used. It is not a causal estimate of treatment effects, a guarantee about an individual patient, or a statement that harms below the threshold are harmless. If utility is nonlinear in event probability, if an event’s value depends on another outcome, or if relevant outcomes differ beyond the two represented here, the two-term equation may be inadequate. The analysis also does not make uncertain inputs certain: the threshold answers a conditional question for the specified values, while uncertainty and preference variation require explicit consideration.

Common Pitfalls

  • Calling a value above 1 an indifference point. A value such as 1.04 cannot be a probability and is not a feasible tie. If the uncapped value exceeds 1, check utility at the feasible maximum \(p_{H,T}=1\); if incremental utility is still positive, all feasible rates remain above break-even in utility.
  • Reporting only the treatment rate or only the risk increase. The threshold equation gives a treatment harm rate. Subtracting \(p_{H,C}\) gives the corresponding increase over control. State which one is being reported.
  • Treating a model threshold as a clinical standard. The threshold changes with the efficacy gain and the relative utility values. It is a conditional result, not a universally acceptable rate.
  • Reversing the efficacy difference. Use \(p_{E,T}-p_{E,C}\). A reversed subtraction changes the sign of the benefit term and can reverse the conclusion.
  • Ignoring the outcome period or population. Probabilities from different follow-up windows or populations cannot be combined as if they described the same comparison without additional justification.
Key takeaway: For an additive utility with positive efficacy value \(b\), harm loss \(h\), and specified positive efficacy gain \(\Delta p_E\), the uncapped break-even treatment harm rate is \(p_{H,C}+(b/h)\Delta p_E\). If this value is at most 1, it is a feasible indifference boundary. If it exceeds 1, no feasible treatment harm rate reaches break-even; 1 is only the largest feasible rate, and incremental expected utility remains positive there.

Check Your Understanding

Answer each question, then compare your reasoning with the solutions below.

  1. A hypothetical treatment increases efficacy risk by 0.03. If \(b=2\), \(h=0.50\), and \(p_{H,C}=0.04\), calculate the uncapped break-even treatment harm rate. Is it feasible?
  2. For the values in Question 1, what increase in harm risk over control corresponds to break-even?
  3. A calculation gives an uncapped value of 1.12. Is 1.00 an indifference point? What can be concluded under the stated model?
  4. Why can two comparisons with the same treatment-to-control harm risk ratio have different utility-based conclusions?

Solutions. (1) \(0.04+(2/0.50)(0.03)=0.04+0.12=0.16\). This is a feasible break-even treatment harm rate because it is below 1. (2) The increase is \(0.16-0.04=0.12\), or 12 percentage points. (3) No. Since 1.12 exceeds the feasible probability range, 1.00 is not a break-even point. Under the stated model, even at \(p_{H,T}=1\), incremental expected utility is positive; no feasible treatment harm rate reaches break-even. (4) A risk ratio does not determine the absolute increase in risk without the comparator risk. The additive utility threshold depends on the absolute increase in harm, the efficacy gain, and the utility ratio \(b/h\), so equal risk ratios alone do not establish equal utility differences.