Tutorials › Response-Adaptive Randomization › Ethical Allocation as Expected Patient Utility

Optimal Allocation Targets · Tutorial 123 of 501

Ethical Allocation as Expected Patient Utility

Learn to calculate and compare allocation targets by weighting each arm’s possible outcomes by their probabilities and patient utility values.

Intermediate 10 min read

What You'll Learn

  • Define arm-specific expected utility from outcome probabilities and utility values.
  • Derive expected total utility for a fixed-size trial and allocation shares.
  • Compare feasible allocation targets using hypothetical outcome distributions.
  • Check probability and utility inputs before interpreting an objective.
  • Distinguish a welfare target from a Neyman target for statistical precision.

From Patient Outcomes to an Allocation Objective

An allocation target answers a design question: among the allocations under consideration, which one has the greatest expected value for the participants assigned in the trial? For an ethical allocation objective, that value is patient utility. The objective must specify both how likely each outcome is under each arm and how valuable each outcome is judged to be. Neither probabilities nor utility scores alone determine expected patient utility.

This is a design criterion, not a claim that an allocation will improve every participant’s outcome. Its result depends on the outcome probabilities used, the utility scale chosen, the population to which those probabilities apply, and which allocations are feasible. Utility scores encode value judgments as well as measurement choices; they should be stated clearly rather than treated as objective properties of outcomes.

Definition: Suppose a trial has \(J\) arms and a set of mutually exclusive, collectively exhaustive outcome states \(k=1,\ldots,K\). For arm \(j\), let \(p_{jk}=P(Y(j)=k)\) be the probability of state \(k\) under assignment to that arm, and let \(u_{jk}\) be the utility assigned to that arm–outcome combination. The arm-specific expected utility is $$ \mu_{U,j}=\sum_{k=1}^{K}p_{jk}u_{jk}. $$ For an allocation with \(n_j\) participants assigned to arm \(j\), where \(\sum_{j=1}^{J}n_j=N\), expected total patient utility is $$ W(\mathbf n)=\sum_{j=1}^{J}n_j\mu_{U,j} =\sum_{j=1}^{J}n_j\sum_{k=1}^{K}p_{jk}u_{jk}. $$ An ethical allocation target maximizes \(W(\mathbf n)\) over a specified feasible set of allocations.

The corresponding allocation shares are \(q_j=n_j/N\), with \(\sum_jq_j=1\). For a fixed total sample size \(N\), expected utility per assigned participant is $$ \frac{W(\mathbf n)}{N}=\sum_{j=1}^{J}q_j\mu_{U,j}. $$ Thus, the share assigned to an arm weights that arm’s expected utility in the trial-wide average. The total and per-participant objectives have the same maximizing allocations when \(N\) is fixed, because one is the other multiplied by \(N\).

Assumptions Behind the Objective

The calculation is straightforward, but its interpretation requires care. The outcome states must cover the outcomes included in the objective, and the probabilities for each arm must be nonnegative and sum to one. Each \(u_{jk}\) must represent the intended value of outcome \(k\) under arm \(j\), on a scale where the stated additions and probability-weighted averages are meaningful.

The probabilities should describe the population and outcome period relevant to the design. In a randomized trial, they can be interpreted as the probabilities of outcomes under assignment to each arm for eligible participants. Using them to compare allocations assumes the expected outcome under an arm does not change merely because a different number of participants are assigned to that arm. This is appropriate, for example, when one participant’s assignment does not affect another participant’s outcome. If there are important spillovers, or if treatment delivery changes with allocation, the arm-specific probabilities may need to depend on the allocation itself.

Utilities should also refer to a consistent perspective and time horizon. If one arm’s scores describe short-term outcomes while another’s represent long-term outcomes, their weighted averages do not answer a coherent allocation question. The model can allow \(u_{jk}\) to vary by arm, but any such variation needs a stated interpretation. It is not safe to assume that a higher probability of one named outcome automatically means higher expected utility.

Why the Formula Gives Expected Total Utility

For a participant assigned to arm \(j\), define the utility \(U\) to be \(u_{jk}\) if their outcome is state \(k\). The expected value of this participant’s utility is the sum of each possible utility multiplied by its probability: $$ E(U\mid j)=\sum_{k=1}^{K}P(Y(j)=k)u_{jk} =\sum_{k=1}^{K}p_{jk}u_{jk} =\mu_{U,j}. $$ If there are \(n_j\) participants assigned to arm \(j\), the expected sum of their utilities is \(n_j\mu_{U,j}\), by linearity of expectation. Summing this quantity over arms gives \(W(\mathbf n)\). This argument does not require the participants’ outcomes to be independent: linearity of expectation applies to the sum even when outcomes are dependent. Independence and other modeling assumptions may matter for assessing uncertainty, but they are not needed for this expected-value identity.

The derivation also shows what the objective leaves out: it adds expected utilities across participants. It does not, by itself, reward an allocation for estimating treatment effects precisely or for balancing arm sizes. Those are different design considerations.

Worked Example: Comparing Three Feasible Allocations

Consider a hypothetical two-arm trial with \(N=50\) participants and three outcome states: high improvement, moderate improvement, and no improvement. Suppose the utilities are 8, 4, and 0 points, respectively, in both arms. The assumed probabilities are:

ArmHigh improvementModerate improvementNo improvement
A0.700.200.10
B0.550.300.15

Each row sums to 1. For arm A, the expected utility per assigned participant is $$ \mu_{U,A}=(0.70)(8)+(0.20)(4)+(0.10)(0)=5.60+0.80+0=6.40\text{ points}. $$ For arm B, it is $$ \mu_{U,B}=(0.55)(8)+(0.30)(4)+(0.15)(0)=4.40+1.20+0=5.60\text{ points}. $$

Suppose the design team is comparing the following three feasible allocations: \((n_A,n_B)=(25,25)\), \((35,15)\), and \((15,35)\). Their expected total utilities are:

  • \((25,25)\): \(25(6.40)+25(5.60)=160+140=300\) utility points.
  • \((35,15)\): \(35(6.40)+15(5.60)=224+84=308\) utility points.
  • \((15,35)\): \(15(6.40)+35(5.60)=96+196=292\) utility points.

Among these specified candidates, \((35,15)\) has the greatest expected total utility. This conclusion is conditional on the stated probabilities, utilities, sample size, and candidate set. It does not establish that this allocation would be best under a different set of assumptions.

Utilities Can Change the Ranking of Outcomes

An allocation objective is not determined by a success probability alone. An outcome’s contribution is its probability multiplied by its utility, and the contributions from all outcome states are added. The utility scale makes explicit how the design treats the relative value of those states.

Worked Example: A Higher Probability of the Best Outcome Is Not the Whole Objective

In a hypothetical study, two arms have “high improvement” and “other improvement” as the outcome states. Suppose high improvement is valued at 9 utility points and other improvement at 3 points in either arm. Arm X has probabilities 0.50 and 0.50; arm Y has probabilities 0.65 and 0.35. Both probability pairs sum to 1.

The arm-specific expected utilities are $$ \mu_{U,X}=(0.50)(9)+(0.50)(3)=4.50+1.50=6.00\text{ points}, $$ and $$ \mu_{U,Y}=(0.65)(9)+(0.35)(3)=5.85+1.05=6.90\text{ points}. $$ Here, the greater probability of high improvement in arm Y also leads to greater expected utility under the specified utilities. With 40 participants assigned to an arm, the expected total utility would be \(40(6.00)=240\) points under X and \(40(6.90)=276\) points under Y.

The conclusion follows from the full calculation, not from the probability 0.65 alone. If the outcome states or utility scores changed, the expected utilities would need to be recalculated. The numbers are hypothetical and illustrate the objective rather than report a study result.

Choosing and Checking a Target

The feasible set is part of the definition of the target. It states which allocations the design team is willing or able to consider. For a finite set of candidate allocations, calculate \(W(\mathbf n)\) for each and select one with the largest value. For a continuous set of shares, the same principle is written as $$ \mathbf q^*=\underset{\mathbf q\in\mathcal Q}{\operatorname{arg\,max}}\ \sum_{j=1}^{J}q_j\mu_{U,j}, $$ where \(\mathcal Q\) is the specified feasible set of shares. In a real design, the set may reflect practical or scientific requirements. Those requirements should be stated rather than hidden inside the utility scores.

A useful diagnostic is to check the inputs before optimizing:

  • For every arm, verify \(p_{jk}\geq 0\) and \(\sum_kp_{jk}=1\). A row that does not sum to one may indicate an omitted outcome state or a calculation error.
  • Check that each utility score has the intended direction and that all arm scores refer to a comparable scale, perspective, and time horizon.
  • Recalculate expected utility arm by arm. A very large contribution can be mathematically correct, but it is worth checking whether it comes from an unintended probability, score, or unit.
  • State whether probabilities are assumptions or estimates. If they are estimated, the computed target inherits uncertainty from those estimates.

The principal alternative in the earlier material on Neyman allocation is an allocation chosen to improve the precision of a specified treatment-effect estimate, under its stated assumptions. That is a statistical information objective, whereas expected patient utility is a welfare objective. An allocation that is best for one objective need not be best for the other. A design may need to make the objective explicit before choosing a target; merely labeling an allocation “optimal” is incomplete.

This expected-utility formulation has limitations. It compresses several outcomes into a single weighted average, so different utility judgments can change the ranking of allocations. It also treats the input probabilities as adequate for the design question; uncertain or population-specific probabilities can make a numerical target fragile. Finally, maximizing this objective alone does not guarantee precise estimates, representativeness across arms, or the same benefit for every participant. Those properties require additional criteria, not an unspoken reinterpretation of \(W(\mathbf n)\).

Common Mistakes

  • Using outcome probabilities without utilities. Probabilities describe what may happen; utilities specify how the outcomes enter the welfare objective. The objective requires both.
  • Using utility scores without probabilities. A highly valued outcome contributes little to expected utility if its probability is small. Calculate the probability-weighted sum for each arm.
  • Calling the result a precision optimum. Expected utility does not measure the variance of an estimator. Compare it with a Neyman target only after naming the different objective each addresses.
  • Ignoring the feasible set. An allocation can be optimal among stated candidates without being optimal among all possible allocations. Report what was compared.
  • Interpreting an expected total as a guaranteed outcome. \(W(\mathbf n)\) is an expectation under the assumed model, not a promise that the realized participants’ utilities will equal that number.
Key takeaway: For each arm, multiply every possible outcome’s probability by its utility and sum to obtain arm-specific expected utility. Multiply by the number assigned to that arm, add across arms, and maximize the result over a clearly specified feasible set.

Check Your Understanding

Answer each question, then compare your reasoning with the solutions below.

  1. Arm A has outcome probabilities 0.60 and 0.40 with utilities 5 and 1. What is its expected utility per assigned participant?
  2. Two arms have expected utilities of 4 and 3 points. With 20 participants in the first arm and 10 in the second, what is expected total utility?
  3. Why must outcome probabilities for an arm sum to one in this formulation?
  4. In one sentence, distinguish an expected-utility allocation target from a Neyman allocation target.

Solutions. (1) \((0.60)(5)+(0.40)(1)=3.00+0.40=3.40\) utility points per participant. (2) \(20(4)+10(3)=80+30=110\) utility points. (3) The outcome states are assumed to be mutually exclusive and collectively exhaustive, so exactly one of them occurs and their probabilities must sum to one. (4) An expected-utility target maximizes the probability-weighted utility of assigned participants, while a Neyman target is chosen to improve the precision of a specified treatment-effect estimate under its assumptions.

Clinical Biostats