Tutorials › Response-Adaptive Randomization › The Welfare-Information Trade-Off Frontier

Optimal Allocation Targets · Tutorial 133 of 501

The Welfare-Information Trade-Off Frontier

Learn to calculate the attainable welfare and contrast variance under two-arm allocations and identify which targets are Pareto-efficient.

Intermediate 10 min read

What You'll Learn

  • Define expected patient utility and contrast variance as functions of a two-arm allocation share.
  • Derive the variance-minimizing share and use it to locate the welfare-information trade-off.
  • Identify Pareto-efficient targets when treatment utility is higher, lower, or equal to control utility.
  • Account for feasible allocation bounds such as a minimum control share.
  • Diagnose how assumptions and plug-in uncertainty can affect interpretation of a frontier.

Why an Allocation Frontier Is Useful

A two-arm trial allocation target cannot generally be judged by a single criterion. Sending more patients to the arm with greater expected patient utility can raise the expected utility of participants, while moving away from the allocation that minimizes the variance of the treatment contrast can reduce precision. The welfare-information frontier describes the attainable combinations of these two objectives. It helps distinguish targets that represent a genuine trade-off from targets that are inferior on both objectives.

The frontier is a decision aid, not a rule that supplies a uniquely correct allocation. Its conclusions depend on the utilities, variances, trial size, and feasible allocation range used to construct it. All numerical values below are hypothetical.

Model, Assumptions, and Definitions

Consider a fixed-size, two-arm trial with \(n\) participants. Let \(r\) be the target share assigned to treatment arm 1, so the target share assigned to control arm 0 is \(1-r\). Assume \(r\) lies in a feasible interval \([a,b]\), where \(0<a\leq b<1\). The interval can encode requirements such as a minimum number of participants per arm. A continuous target share is used for the calculations; in an actual trial, allocation counts must be integers.

Let \(u_1\) and \(u_0\) be the expected patient utilities under assignment to arms 1 and 0, respectively, measured on the same utility scale. These expectations can incorporate treatment-related harms and costs when those have been included in the defined patient utility. Assume each participant’s expected utility depends on their assigned arm, and that the allocation does not change the expected utility for other participants. Under these assumptions, the expected utility per randomized participant is \(W(r)\). The expected total utility for the \(n\) participants is \(nW(r)\), so it gives the same ranking of targets.

Definition: For a treatment share \(r\), the expected patient utility per randomized participant is \(W(r)=(1-r)u_0+ru_1\). The welfare-information pair for that target is \((W(r),V(r))\), where \(V(r)\) is the variance of the estimated treatment-minus-control mean contrast.

For the contrast variance, suppose the outcome being compared has arm-specific variances \(\sigma_1^2>0\) and \(\sigma_0^2>0\), the trial uses fixed arm counts corresponding to the target shares, and outcomes are independent across participants. The estimator is the difference in sample means, \(\bar{x}_1-\bar{x}_0\). Under this model, its variance is

$$ V(r)=\frac{\sigma_1^2}{nr}+\frac{\sigma_0^2}{n(1-r)}. $$

Thus \(W(r)\) is measured in utility units per participant, while \(V(r)\) is measured in squared outcome units. They should not be added or compared as if they shared a scale. The frontier instead displays the attainable pairs and makes the trade-off explicit.

Definition: A feasible target \(r_1\) dominates another feasible target \(r_2\) if \(W(r_1)\geq W(r_2)\) and \(V(r_1)\leq V(r_2)\), with at least one strict inequality. A target is Pareto-efficient if no feasible target dominates it.

Locating the Variance Minimum

The variance-minimizing share provides a reference point for the frontier. Differentiating the variance function with respect to \(r\) gives

$$ \frac{dV(r)}{dr} =\frac{1}{n}\left(-\frac{\sigma_1^2}{r^2} +\frac{\sigma_0^2}{(1-r)^2}\right). $$

Setting this derivative to zero requires \(\sigma_1/r=\sigma_0/(1-r)\), since all quantities are positive. Solving yields the unconstrained Neyman share. The second derivative is positive throughout \(0<r<1\), so this stationary point is the unique variance minimum. With a feasible interval, the minimizing share is the unconstrained value if it lies in the interval; otherwise it is the nearest endpoint.

$$ r_N=\frac{\sigma_1}{\sigma_0+\sigma_1}, \qquad r_V=\min\{b,\max\{a,r_N\}\}. $$

Here \(r_N\) is the variance-minimizing share without allocation bounds, and \(r_V\) is the variance-minimizing share among feasible targets. This derivation concerns the variance curve; it does not establish that the variance-minimizing target also maximizes patient utility.

The Shape of the Welfare-Information Frontier

Write \(\Delta u=u_1-u_0\). Expected utility is linear in the allocation share:

$$ W(r)=u_0+r\Delta u, \qquad \frac{dW(r)}{dr}=\Delta u. $$

The direction of this slope determines which side of the variance minimum can be efficient. If \(\Delta u>0\), raising \(r\) raises welfare. For any feasible \(r<r_V\), increasing the share toward \(r_V\) raises welfare and lowers variance, so that target is dominated. Every feasible target at or above \(r_V\) is efficient: moving to a larger share raises welfare but also raises variance, while moving to a smaller share lowers variance but also lowers welfare. If \(\Delta u<0\), the same reasoning reverses: targets above \(r_V\) are dominated, and the efficient targets lie at or below \(r_V\). If \(\Delta u=0\), welfare is constant, so the unique variance-minimizing feasible target dominates all other targets.

Key result: If \(u_1>u_0\), the Pareto-efficient targets are \(r\in[r_V,b]\). If \(u_1<u_0\), they are \(r\in[a,r_V]\). If \(u_1=u_0\), only \(r_V\) is efficient. These conclusions assume positive arm variances and the stated fixed-size variance model.

This result also explains how to read a plotted frontier. When \(u_1>u_0\), the efficient branch runs from the feasible variance minimum toward higher treatment shares: welfare rises along it, but so does contrast variance. Targets on the other branch are not trade-offs; they are worse in both dimensions than a target closer to the variance minimum. When \(u_1<u_0\), the efficient branch instead extends toward lower treatment shares.

Worked Example: Tracing an Unconstrained Frontier

Worked Example: Tracing an Unconstrained Frontier

Suppose a hypothetical trial has \(n=100\), \(u_0=4\) utility units per participant, \(u_1=7\) utility units per participant, \(\sigma_0=2\) outcome units, and \(\sigma_1=3\) outcome units. Take the feasible range to be \(0<r<1\).

The welfare function is \(W(r)=4+3r\), so greater treatment allocation raises expected patient utility. The variance-minimizing share is \(r_N=3/(2+3)=0.600\). The feasible efficient branch is therefore \(0.600\leq r<1\).

At \(r=0.600\), the expected utility is \(W(0.600)=4+3(0.600)=5.80\) utility units per participant. The contrast variance is

$$ V(0.600)=\frac{3^2}{100(0.600)} +\frac{2^2}{100(0.400)} =0.150+0.100=0.250 $$

squared outcome units. At \(r=0.800\), expected utility is \(W(0.800)=4+3(0.800)=6.40\) utility units per participant, while

$$ V(0.800)=\frac{9}{80}+\frac{4}{20} =0.1125+0.200=0.3125 $$

squared outcome units. The higher treatment share gains \(0.60\) utility units per participant relative to \(r=0.600\), at the cost of increasing contrast variance by \(0.0625\) squared outcome units.

By contrast, at \(r=0.400\), \(W(0.400)=5.20\) utility units per participant and \(V(0.400)=9/40+4/60=0.2917\) squared outcome units. The target \(r=0.600\) has both higher welfare and lower variance, so \(r=0.400\) is dominated. This identifies the efficient branch without assigning an arbitrary numerical exchange rate between welfare and variance.

Worked Example: Applying a Minimum Control Requirement

Worked Example: Applying a Minimum Control Requirement

Use the same hypothetical utilities and standard deviations, but now require at least 30% of participants to receive control. Let \(a=0.200\) and \(b=0.700\); equivalently, treatment allocation cannot exceed 70%. The unconstrained variance minimum \(r_N=0.600\) is feasible, so \(r_V=0.600\). Because \(u_1>u_0\), the efficient range is \(0.600\leq r\leq0.700\).

At the maximum permitted treatment share, \(r=0.700\), welfare is \(W(0.700)=4+3(0.700)=6.10\) utility units per participant, and

$$ V(0.700)=\frac{9}{70}+\frac{4}{30} =0.1286+0.1333=0.2619 $$

squared outcome units. Relative to \(r=0.600\), this target increases expected utility by \(6.10-5.80=0.30\) utility units per participant and increases contrast variance by \(0.2619-0.2500=0.0119\) squared outcome units. It is an efficient feasible target, but not automatically the preferred one: that choice depends on how the study values the welfare gain relative to the loss of precision.

The lower-bound requirement on control is satisfied at \(r=0.700\), since the control share is \(1-0.700=0.300\). Checking the bound matters: a mathematically efficient target outside the feasible interval is not an available design choice.

Worked Example: When Treatment Has Lower Expected Utility

Worked Example: When Treatment Has Lower Expected Utility

Consider a different hypothetical trial with \(n=120\), \(u_0=6\), \(u_1=5\) utility units per participant, \(\sigma_0=2\), \(\sigma_1=3\) outcome units, and feasible shares \(0.100\leq r\leq0.900\). Now \(\Delta u=5-6=-1\), and \(r_N=3/(2+3)=0.600\) remains feasible. The efficient branch is \(0.100\leq r\leq0.600\).

At \(r=0.300\), \(W(0.300)=6-0.300=5.70\) utility units per participant, and

$$ V(0.300)=\frac{9}{120(0.300)} +\frac{4}{120(0.700)} =0.2500+0.04762=0.2976 $$

squared outcome units. At \(r=0.600\), \(W(0.600)=5.40\) utility units per participant and

$$ V(0.600)=\frac{9}{72}+\frac{4}{48} =0.1250+0.08333=0.2083 $$

squared outcome units. Moving from \(r=0.300\) to \(r=0.600\) improves precision but reduces expected utility; neither target dominates the other. At \(r=0.800\), welfare is \(5.20\) utility units per participant and variance is \(9/96+4/24=0.2604\) squared outcome units. The \(r=0.600\) target has both higher welfare and lower variance, so \(r=0.800\) is dominated.

Assumptions, Diagnostics, and Alternatives

The frontier is only as useful as the quantities used to construct it. Check that the utility values refer to the same population and utility scale, that the sign of \(u_1-u_0\) has been interpreted correctly, and that the variance formula matches the contrast and design being considered. In particular, the displayed formula is for a difference in independent arm means with fixed arm sizes. Dependence between outcomes, a different estimand, or a different design may require a different variance expression.

In practice, the arm variances may be estimated rather than known, and the utility values may also be uncertain. A frontier calculated from point estimates is then an estimated frontier, not a guarantee that the same ordering will hold under the true values. Useful checks include recalculating the efficient region across plausible inputs and checking whether the selected share respects the actual integer allocation and arm-size constraints. If small changes in an input move the variance minimum or reverse the utility ordering, report that sensitivity rather than presenting the frontier as exact.

A single-objective alternative is to choose the target that maximizes expected utility alone, or the one that minimizes contrast variance alone. These choices answer different questions: welfare-only maximization moves toward the arm with larger expected utility, while variance-only minimization selects \(r_V\). The frontier makes visible what each single-objective choice leaves aside. A decision-maker can then select a feasible point on the efficient branch using explicit study priorities or constraints. Without those priorities, the frontier does not determine a unique target.

Common Mistake

Common mistake: “Treatment has higher expected utility, so every increase in treatment allocation is better.” This reasoning considers welfare but ignores precision. When \(u_1>u_0\), increasing \(r\) below \(r_V\) improves welfare and reduces variance, but increasing \(r\) above \(r_V\) raises variance as well as welfare. The correction is to identify the variance minimum and distinguish dominated targets from the efficient branch; then make any further choice using explicit design priorities.

Check Your Understanding

Answer each question, then compare your reasoning with the solutions below.

  1. If \(u_1>u_0\) and the unconstrained variance minimum is feasible, which shares can be Pareto-efficient?
  2. For \(n=80\), \(\sigma_1=2\), and \(\sigma_0=2\), calculate the unconstrained variance-minimizing treatment share.
  3. Suppose \(u_1=u_0\) and positive arm variances give a unique feasible variance minimum. Which target is Pareto-efficient, and why?
  4. For the values in the first worked example, explain why \(r=0.400\) is dominated by \(r=0.600\).
  5. Name one assumption behind the displayed contrast-variance formula that should be checked before using it.

Solutions. (1) Shares from \(r_N\) through the largest feasible share \(b\) are efficient: above the variance minimum, greater welfare requires greater variance. (2) \(r_N=2/(2+2)=0.500\). (3) Only the variance-minimizing feasible target is efficient, because all targets have the same welfare and every other target has larger variance. (4) At \(r=0.400\), welfare is \(5.20\) and variance is \(0.2917\); at \(r=0.600\), welfare is \(5.80\) and variance is \(0.2500\). The latter is better on both criteria. (5) For example, the formula assumes independent outcomes across participants and a difference in arm-specific sample means with fixed arm sizes.

Clinical Biostats