Why Attrition Is Especially Important for Vaccine Titers
A vaccine trial may measure antibody titers soon after vaccination and again months later, when waning can be assessed. If participants leave before the later visit, their later titers are unknown. This is consequential: early measurements do not reveal exactly how each participant’s antibody level subsequently changed. A comparison restricted to participants who returned may therefore describe a selected subset rather than the randomized groups.
The analysis below targets the mean log10 antibody titer at a specified later visit for all randomized participants in each arm. It compares responses across observed follow-up patterns, then adjusts predictions for missing titers using delta parameters. The delta adjustment makes an explicit sensitivity assumption about how the missing values differ from predictions under a missing-at-random (MAR) model. It does not make those values observed or identify their distribution from the trial alone.
Titers are commonly analyzed on the log scale because antibody concentrations are positive and often right-skewed. A difference in mean log10 titer can be converted to a ratio of geometric means by exponentiating base 10. This ratio compares the arms’ geometric mean titers; it is not, by itself, proof of protection from infection or clinical disease.
Define the Estimand and Follow-Up Patterns
For example, patterns may distinguish participants with a measured later titer from participants who discontinued before that visit. More detailed patterns can distinguish intermittent missed visits from dropout, or dropout at different times, if the data support those distinctions. Pattern membership is observed, but the later titer for a dropout pattern is not. Thus the pattern-specific mean for missing outcomes requires a model and, for departures from MAR, sensitivity assumptions.
Write \(q_{ag}\) for the proportion of randomized participants in arm \(a\) belonging to pattern \(g\), and \(\mu_{ag}\) for that pattern’s mean later titer. The arm-specific target mean is
For a pattern with observed later titers, its mean can be estimated from those measurements, possibly after adjustment or standardization for baseline and earlier antibody measurements. For a pattern with missing later titers, a model predicts the mean given the available history. Under MAR, the prediction assumes that, conditional on included observed information, missing later titers have the same distribution as comparable observed outcomes. Delta adjustment replaces that assumption with a stated departure:
A negative \(\delta_{ag}\) says that the missing participants’ mean log10 titer is lower than the MAR prediction, after conditioning on the information in the model. A shift of \(-0.30\) log10 units corresponds to multiplying the predicted titer by \(10^{-0.30}\), approximately 0.501. It does not mean subtracting 0.30 from the raw titer or from every observed participant’s measurement.
Assumptions Before Calculation
The calculations require clearly stated assumptions. Randomization supports an intention-to-treat comparison of the assigned arms, subject to the chosen estimand and appropriate handling of outcomes. It does not make missing later titers ignorable. The pattern proportions \(q_{ag}\) are estimated from the randomized participants in each arm, and the prediction model should use relevant observed information, such as baseline titer, early post-vaccination titer, age, and timing of dropout. Its form should be adequate for the data and should not extrapolate silently beyond the observed covariate range.
The MAR calculation relies on the conditional missingness assumption described above. A delta-adjusted calculation additionally assumes that the selected shifts are meaningful descriptions of departures from those predictions. The trial data generally cannot determine the correct delta for outcomes that are never observed. Clinical input may help define plausible shifts, for example by considering assay variability, known antibody kinetics, and the time between the last measurement and the missed visit. Such input motivates sensitivity values; it does not turn them into empirically identified parameters.
If some patterns have very few participants, their observed means and predictions may be unstable. If a pattern has no comparable observed later outcomes, its MAR prediction may rely heavily on extrapolation. In either case, the weighted mean can look precise while resting on weak information. Pattern definitions, model diagnostics, and uncertainty from estimating means and proportions should therefore be reported alongside the point estimates.
Worked Example: Reading Pattern-Specific Responses
Suppose a hypothetical vaccine trial has 100 participants in each arm. In Vaccine A, 80 participants have a measured 12-month titer with mean 2.50 log10 units, and 20 leave before that visit. In Vaccine B, 90 have a measured titer with mean 2.30 log10 units, and 10 leave early. The observed means describe the measured-pattern participants only.
A fitted prediction model, using baseline and early titers and other prespecified covariates, predicts a mean 12-month titer of 2.10 for the missing Vaccine A pattern and 2.20 for the missing Vaccine B pattern under MAR. These values are hypothetical model predictions, not observed later titers.
The MAR pattern-mixture mean for Vaccine A is
For Vaccine B it is
The estimated arm contrast is \(2.42-2.29=0.13\) log10 units, corresponding to a geometric mean ratio of \(10^{0.13}\approx1.349\). This is an all-randomized-participant estimate only under the prediction and missingness assumptions; the observed-pattern means alone do not establish the later-response means for those who left.
Delta Adjustment and Its Consequences
A useful way to see the effect of delta is to substitute the adjusted pattern means into the weighted total. If only one pattern is missing, with proportion \(q\), then adding \(\delta\) to that pattern’s MAR mean changes the arm mean by \(q\delta\). The weighting matters: a large shift in a small missing group may have less impact on the arm mean than a modest shift in a large missing group.
This follows directly by replacing the missing-pattern mean \(\mu_{a,\mathrm{mis}}^{(\mathrm{MAR})}\) with \(\mu_{a,\mathrm{mis}}^{(\mathrm{MAR})}+\delta_a\) in the weighted sum. The observed-pattern terms cancel, leaving \(q_{a,\mathrm{mis}}\delta_a\). With multiple missing patterns, the total change is the sum of each missing pattern’s proportion times its own delta.
Worked Example: Applying a Clinically Justified Delta
Consider another hypothetical trial summary. Suppose the MAR pattern-mixture mean is 2.38 log10 units for Vaccine A and 2.1775 for Vaccine B. In each arm, 20% of participants are missing the later titer. Clinicians judge that a shift of \(-0.30\) log10 units for the missing Vaccine A pattern is a useful sensitivity scenario, while the Vaccine B prediction is left unchanged, so \(\delta_A=-0.30\) and \(\delta_B=0\). This scenario represents approximately half the MAR-predicted titer for missing Vaccine A participants, conditional on the model’s observed history.
The change in Vaccine A’s overall mean is its missing proportion times its delta:
Vaccine B remains at 2.1775 log10 units. The adjusted contrast is
Under this hypothetical sensitivity scenario, the estimated geometric mean titer in Vaccine A is about 1.388 times that in Vaccine B. The result is conditional on the selected delta values; it is not evidence that missing participants actually had those titers. Rounding the ratio to three decimal places gives 1.388.
Worked Example: Comparing Two Plausible Sensitivity Scenarios
Use the same hypothetical MAR means, 2.38 for Vaccine A and 2.1775 for Vaccine B, and the same 20% missing fraction in both arms. Suppose a second clinical scenario assigns \(\delta_A=-0.50\) and \(\delta_B=-0.10\). These shifts correspond to multiplying the respective MAR-predicted titers for missing participants by about 0.316 and 0.794.
The adjusted means are
Thus the contrast is \(2.28-2.1575=0.1225\) log10 units, and the geometric mean ratio is \(10^{0.1225}\approx1.326\). Relative to the MAR contrast of \(2.38-2.1775=0.2025\), the result is smaller, because the assumed reduction among missing Vaccine A participants is greater than the reduction in Vaccine B. The example illustrates why a shared or symmetric delta is not automatically neutral: what matters for the arm contrast is the difference between the weighted arm-specific shifts.
Diagnostics, Alternatives, and Limitations
Check whether the pattern and prediction model are credible before interpreting a sensitivity result. Compare baseline and early titers across follow-up patterns within each arm; large differences can signal that a simple unadjusted pattern mean is inadequate. Examine distributions and residuals for the observed later titers, confirm that predictions are within a defensible range, and inspect whether missing participants have covariate histories similar to participants contributing observed later outcomes. Report the number of participants in every arm-pattern cell. Sparse cells and extreme predictions are warnings, not reasons to conceal the pattern.
A complete-case analysis is simpler but uses only participants with observed later titers. It estimates a survivor-pattern comparison and can be biased for the all-randomized estimand if response and retention are related. A MAR-based analysis uses observed histories to predict missing outcomes but depends on its conditional missingness assumption. Delta-adjusted pattern-mixture analysis keeps that model as a reference and makes departures explicit. Selection models are a different alternative: they model outcome distributions and the probability of observation jointly or conditionally. They can encode nonignorability differently, but do not eliminate the need for untestable assumptions about missing outcomes.
No single delta is certified by the observed data when later titers are missing. A defensible report explains the clinical rationale for the range examined, states whether shifts apply equally or differently by arm and dropout timing, and presents the resulting arm-specific means and contrasts. The analysis is limited by the quality of the prediction model, the plausibility of the delta values, assay properties, and the amount and timing of attrition. It estimates antibody response, not vaccine efficacy, unless a separate design and analysis justify that clinical claim.
Check Your Understanding
Answer each question, then compare with the solutions below.
- If 25% of an arm is missing the later titer and its delta is \(-0.20\) log10 units, by how much does the overall arm mean shift from its MAR estimate?
- Why does a negative delta of \(-0.30\) correspond to about half the MAR-predicted raw titer?
- In a hypothetical trial, the MAR means are 2.40 for Arm A and 2.20 for Arm B. Each arm is 10% missing. Set \(\delta_A=-0.40\) and \(\delta_B=-0.10\). Calculate both adjusted means and the geometric mean ratio.
- What does a complete-case comparison estimate, and why may it differ from an all-randomized comparison?
- Name two diagnostics that could reveal problems with a pattern-mixture prediction model.
Solutions. (1) The shift is \(q\delta=(0.25)(-0.20)=-0.05\) log10 units, so the adjusted overall mean is 0.05 units below its MAR estimate. (2) A log10 shift multiplies the raw-scale prediction by \(10^\delta\); \(10^{-0.30}\approx0.501\), approximately one half. (3) Arm A is \(2.40+(0.10)(-0.40)=2.36\); Arm B is \(2.20+(0.10)(-0.10)=2.19\). The contrast is \(2.36-2.19=0.17\), giving ratio \(10^{0.17}\approx1.479\). (4) A complete-case comparison concerns participants with measured later titers. It may differ if retention is associated with later response, even after randomization. (5) Examples include comparing baseline and early titers across patterns, checking prediction ranges and residuals, and assessing whether participants with missing outcomes have covariate histories represented among observed outcomes.