When the Efficacy-Favoring Dose Is Not the Safety-Favoring Dose
A higher dose may improve an efficacy endpoint more than a lower dose while also producing more adverse events. The efficacy ranking alone does not establish which dose should be used. Nor does observing more adverse events at the higher dose, by itself, show that its benefit is not worth the risk. A defensible dose recommendation makes the clinical tradeoff explicit: what efficacy is sufficient, how much additional efficacy would justify a higher dose, and what level of safety risk is acceptable?
The key is to distinguish three claims. A dose can meet a minimum efficacy requirement; its safety risk can be below a defined limit; and the extra efficacy of a higher dose can be too small to justify its extra risk. These claims require different comparisons. They should be tied to the relevant clinical outcomes, treatment duration, patient population, and decision context rather than inferred from which estimate is numerically largest.
State the Decision Criteria Before Comparing Doses
Let \(E(d)\) denote the efficacy effect at dose \(d\), with larger values representing better efficacy. Let \(R(d)\) denote the risk of a specified safety event over a defined period, with larger values representing greater risk. Contrasts must use consistent definitions and reference groups. For instance, the excess event risk at dose \(d\) relative to placebo is \(R(d)-R(0)\), while the efficacy gain at a higher dose \(d_H\) relative to a lower dose \(d_L\) is \(E(d_H)-E(d_L)\).
A transparent decision can specify three criteria. First, require the selected dose to meet a minimum efficacy threshold relative to placebo or another relevant comparator. Second, require its safety risk to remain below a maximum acceptable limit. Third, if choosing the lower dose, define how much efficacy it may give up relative to the higher dose. That last criterion prevents “the doses are not significantly different” from being mistaken for evidence that their efficacy is sufficiently similar.
Here \(\operatorname{LCB}\) and \(\operatorname{UCB}\) are lower and upper confidence bounds from an analysis appropriate to the endpoint and design. These inequalities describe one conservative decision rule, not a universal regulatory formula. The thresholds and confidence level must be justified for the clinical context. If safety is instead framed as an absolute risk limit, compare an upper bound for \(R(d)\) with that limit. The relevant formulation should be chosen in advance and kept consistent.
A common convention is to use one-sided 95% bounds. Under an approximately normal sampling distribution with a valid standard error, an estimate \(\hat\theta\) has lower and upper bounds \(\hat\theta-1.645SE\) and \(\hat\theta+1.645SE\), respectively. This calculation relies on the analysis providing an appropriate estimate and standard error. Model-based contrasts should use their model-based standard errors, including covariance between dose estimates; one should not assume that separate estimates are independent unless that assumption is justified.
Why the Confidence-Bound Rule Matches the Decision
Suppose the clinical question is whether a lower dose meets a minimum efficacy threshold \(M_E\). The relevant contrast is \(\theta=E(d_L)-E(0)\). If a one-sided lower confidence bound for \(\theta\) exceeds \(M_E\), the data support an effect greater than the minimum under the stated confidence procedure. Likewise, if the question is whether the higher dose adds more than a tolerable efficacy loss \(\delta_E\), define \(\Delta=E(d_H)-E(d_L)\). A one-sided upper bound below \(\delta_E\) supports the conclusion that the added efficacy is smaller than the prespecified margin.
The same logic applies to safety. For excess risk \(\rho=R(d)-R(0)\), an upper bound below \(M_S\) supports the conclusion that excess risk is below the chosen limit. A point estimate below the limit is not enough when its uncertainty extends above it. Conversely, an upper bound above the limit does not prove that the risk exceeds the limit; it means the data do not establish that it is below the limit using this rule.
These are confidence-procedure statements, not probabilities that a fixed parameter lies inside a particular interval. Their interpretation depends on a suitable estimand, a sound statistical model or estimation method, and adequate handling of missing data, multiplicity, and trial conduct. In a randomized comparison, the dose groups should be compared using the prespecified population and follow-up period. If estimates are adjusted or model-based, their interpretation should remain aligned with the clinical contrast the threshold was designed to assess.
Worked Example: Selecting the Lower Dose When Its Efficacy Is Sufficient
Consider a hypothetical randomized trial of placebo, 50 mg, and 100 mg. The efficacy endpoint is improvement from baseline, in points, with larger improvements better. The prespecified minimum clinically relevant improvement over placebo is 4 points. The safety endpoint is the proportion of patients experiencing a specified adverse event during 12 weeks; the maximum acceptable excess risk over placebo is 5 percentage points. The maximum tolerable efficacy loss for choosing 50 mg instead of 100 mg is 2 points.
The fitted efficacy analysis estimates improvement over placebo at 50 mg as 5.4 points, with \(SE=0.50\). Its one-sided 95% lower bound is:
Because 4.578 exceeds the 4-point minimum, 50 mg meets the specified efficacy criterion. The model-based contrast \(E(100)-E(50)\) is estimated as 1.1 points with \(SE=0.45\). Its one-sided upper bound is:
The upper bound is below the 2-point tolerable-loss margin. Under this rule, the data support the conclusion that the efficacy added by 100 mg is smaller than the amount required to justify selecting it on efficacy grounds alone.
For safety, the estimated excess event risk over placebo is 1.5 percentage points at 50 mg, with \(SE=0.80\) percentage points, and 6.5 percentage points at 100 mg, with \(SE=1.00\) percentage point. At 50 mg, the upper bound is \(1.5+1.645(0.80)=2.816\) percentage points, below the 5-point limit. At 100 mg, the estimated excess risk itself is 6.5 points, above that limit; its upper bound is \(6.5+1.645(1.00)=8.145\) points. Thus, on these hypothetical results, 50 mg meets the efficacy and safety criteria, while 100 mg does not meet the safety criterion. The evidence supports selecting 50 mg under the stated thresholds, not the broader claim that 100 mg is proven harmful.
The standard errors in this example are hypothetical outputs from appropriate endpoint analyses, and the bounds use a normal approximation. In an actual analysis, the uncertainty method must be suitable for the efficacy scale and the safety-event data; the arithmetic does not make an unsuitable model valid.
When the Higher Dose Can Still Be Defensible
A safety-favoring lower dose does not automatically win. If the higher dose produces an incremental efficacy gain that is clinically important and its risk remains below a justified safety limit, selecting the higher dose can be defensible. This argument should show both that the higher dose clears the efficacy requirement and that the safety cost is acceptable. A larger efficacy estimate without a clinical threshold does not establish that the extra benefit is worth the extra risk.
Worked Example: Choosing the Higher Dose for a Meaningful Gain
In a second hypothetical trial, improvement is again measured in points. The minimum improvement over placebo is 4 points. The efficacy analysis estimates that the 80 mg dose improves the endpoint by 7.1 points over placebo, with \(SE=0.50\). Its one-sided lower bound is:
This is above the 4-point minimum. Before examining the dose contrast, clinicians have specified that at least 1.5 additional efficacy points are needed to justify choosing 80 mg instead of 40 mg. The model-based estimate of \(E(80)-E(40)\) is 2.5 points, with \(SE=0.60\). Its lower bound is:
The lower bound just exceeds the 1.5-point threshold, supporting a clinically meaningful incremental gain under the specified rule. Suppose the estimated excess risk of the safety event at 80 mg versus placebo is 4.0 percentage points, with \(SE=0.80\) percentage points, and the maximum acceptable excess is 6 points. The upper bound is:
Since 5.316 is below 6, the higher dose meets the safety criterion in this example. The argument for 80 mg is therefore not simply that its efficacy estimate is larger: its estimated incremental benefit clears a prespecified clinical threshold, and its safety upper bound remains below the prespecified limit. The decision is conditional on the thresholds being clinically appropriate and the analyses being valid.
When the Evidence Does Not Resolve the Tradeoff
Sometimes the lower dose clearly meets its efficacy requirement, while the higher dose has a promising efficacy estimate but uncertain safety. The correct conclusion may be that the available evidence supports the lower dose, while leaving open whether the higher dose would be acceptable with more precise evidence. Failure to establish safety below a limit is not proof that the limit is exceeded. Equally, a reassuring point estimate is not enough to establish that it is below the limit.
Worked Example: A Safety Estimate Below the Limit but Too Uncertain
In a third hypothetical trial, a lower dose improves efficacy by 5.2 points over placebo, with \(SE=0.45\), and the minimum efficacy threshold is 4 points. Its lower bound is \(5.2-1.645(0.45)=4.460\) points, so it meets the efficacy requirement. The higher dose has an estimated excess safety-event risk of 4.5 percentage points over placebo, with \(SE=1.20\) percentage points. The maximum acceptable excess is 5 points. Its upper bound is:
The 4.5-point estimate is below the limit, but the 6.474-point upper bound is above it. The data therefore do not establish that the higher-dose excess risk is below the limit. They also do not establish that the risk is above the limit: the estimate and its uncertainty do not justify that stronger conclusion. If the lower dose meets its efficacy and safety criteria, selecting it may be supported while the higher dose remains insufficiently characterized. More precise safety evidence could change the assessment.
Diagnostics, Alternatives, and Common Pitfalls
Before using a dose-justification rule, check that the efficacy and safety contrasts correspond to the same relevant population and treatment period. Confirm the endpoint direction, units, reference group, and event definition. Inspect confidence intervals as well as point estimates, and verify that the standard errors correspond to the actual dose contrasts. A threshold based on a short exposure period cannot automatically be applied to a materially longer treatment duration. If the analysis changes substantially under reasonable endpoint definitions or missing-data assumptions, the recommendation should disclose that sensitivity rather than present a single contrast as definitive.
There are several alternatives to a threshold-based argument, but each answers a different question. An efficacy-only choice selects the dose with the largest efficacy estimate and may ignore an important safety cost. A safety-first rule can exclude a dose that exceeds a hard clinical constraint, but it does not by itself identify the best dose among those that satisfy the constraint. A single composite score can combine benefits and harms, but its result depends on how outcomes are scaled and weighted. A threshold-based argument instead makes the boundaries visible and explains which dose meets them. It does not replace clinical judgment; it makes the judgment inspectable.
- Pitfall: “The higher dose was not significantly better, so the lower dose is equally effective.” A nonsignificant difference does not show that the efficacy loss is smaller than a clinical margin. Specify \(\delta_E\) and assess the appropriate confidence bound for the dose contrast.
- Pitfall: “The safety estimate is below the limit, so the dose is safe.” The estimate may be imprecise. Compare an appropriate upper bound with the limit, and describe a failed criterion as uncertainty when the evidence does not establish that risk exceeds the limit.
- Pitfall: “The higher dose has the best efficacy estimate, so it is the best dose.” A numerical ranking does not quantify whether the incremental benefit is clinically worthwhile or whether the safety cost is acceptable.
- Pitfall: choosing thresholds after seeing which dose passes. This weakens the interpretability of the decision. Thresholds should be justified in clinical terms and specified before using the trial results to select among doses.
Threshold-based dose justification has limits. A threshold may not capture all patient preferences, the evidence may be too imprecise to satisfy either criterion, and safety risks can differ in severity even when their frequencies are similar. A recommendation should therefore state the population and conditions to which it applies, identify unresolved uncertainties, and avoid implying that passing a specified criterion proves the absence of other risks.
Check Your Understanding
Answer each question using the stated decision rule. Solutions follow the questions.
- A lower dose has an efficacy lower bound of 3.8 points; the minimum efficacy threshold is 4 points. Does it meet the efficacy criterion?
- The estimated efficacy gain of a higher dose over a lower dose is 0.8 points with \(SE=0.40\). The maximum tolerable loss when choosing the lower dose is 1.5 points. Using a one-sided 95% upper bound, is the lower dose’s efficacy loss below the margin?
- A dose has an estimated excess safety risk of 2 percentage points with \(SE=1.5\) percentage points. The maximum acceptable excess is 4 points. Does the upper-bound rule establish that the dose is below the limit?
- Why is “the safety difference was not statistically significant” insufficient, by itself, to establish that the higher dose meets a safety limit?
Solutions. (1) No. The lower bound, 3.8 points, does not exceed the 4-point minimum, so the criterion is not established. (2) The upper bound is \(0.8+1.645(0.40)=1.458\) points. Because 1.458 is below 1.5, the rule supports a loss below the margin. (3) The upper bound is \(2+1.645(1.5)=4.468\) percentage points, which exceeds 4. The evidence does not establish that excess risk is below the limit; this does not prove that it is above the limit. (4) A nonsignificant difference may reflect imprecision. To establish acceptable safety, compare an appropriate upper confidence bound for the relevant risk contrast with the prespecified safety limit.