Tutorials › Pattern-Mixture and Selection Models › Pediatric Vaccine Trial With Age-Dependent Follow-Up

Case Studies · Tutorial 481 of 499

Pediatric Vaccine Trial With Age-Dependent Follow-Up

Learn to describe age-dependent follow-up patterns and calculate how alternative assumptions about missing antibody responses change an age-standardized vaccine-control contrast.

Advanced 11 min read

What You'll Learn

  • Distinguish complete follow-up, an intermediate missed visit, and a missing endpoint.
  • Summarize how endpoint missingness differs by age group and treatment arm.
  • Calculate age-specific and standardized antibody-response estimates under a missing-at-random restriction.
  • Apply a pattern-specific delta adjustment and quantify its effect on the treatment contrast.
  • Diagnose sparse patterns, incompatible visit timing, and unsupported identifying restrictions.
  • Compare pattern-mixture estimates with complete-case and reference-based alternatives.

Why age-related follow-up patterns matter

In a pediatric vaccine trial, missed visits can reflect more than a general tendency to drop out. Appointment burden, illness, and family logistics may differ with a child’s age; age may also be associated with the antibody response itself. If follow-up differs across ages, the people whose endpoint responses are observed may not represent all randomized children in the same way in each age group. A single overall missingness rate can conceal that structure.

This case study uses a hypothetical randomized trial with a six-month antibody endpoint. The aim is to estimate and compare mean responses for vaccine and control while making the follow-up patterns visible. The numerical estimates below illustrate identifying restrictions; they are not results from an actual trial. They also do not establish that a particular restriction is true.

Definition: Let \(A\) denote randomized assignment, with \(A=V\) for vaccine and \(A=C\) for control. Let \(G\) denote age group, \(Y\) the six-month antibody response measured in log2 titer units, and \(R\) the follow-up pattern. We use three patterns: \(E\), all scheduled visits attended; \(I\), an intermediate visit missed but the six-month endpoint observed; and \(L\), the six-month endpoint missing. A pattern-mixture analysis describes the outcome distribution within these patterns and uses an identifying restriction to supply information about outcomes that are unobserved.

For this illustration, age groups are 2–5 months and 6–11 months at enrollment. The endpoint is measured at a common, prespecified time after the final scheduled dose. This alignment matters: if the age groups have different dose schedules, a response measured at different times since vaccination would not be directly comparable without a clinically justified time-based estimand. The analysis also assumes the endpoint has the same meaning and measurement scale across ages and arms.

First describe the follow-up patterns

The following hypothetical counts are the same in both randomized arms. Each age-by-arm group has 40 children. Younger children more often have the endpoint missing, while some children in both age groups miss an intermediate visit and later attend the endpoint visit.

Age groupArmAll visits attended (E)Intermediate missed, endpoint observed (I)Endpoint missing (L)Total
2–5 monthsVaccine20101040
2–5 monthsControl20101040
6–11 monthsVaccine2510540
6–11 monthsControl2510540

Worked Example: Quantifying the Age Difference in Endpoint Missingness

In each arm, calculate the proportion with a missing six-month endpoint in each age group, then compare the proportions.

Younger group: \(10/40=0.25\), or 25%. Older group: \(5/40=0.125\), or 12.5%. The difference is \(0.25-0.125=0.125\), or 12.5 percentage points. Thus the endpoint is missing more often among younger children in these hypothetical data.

The calculation describes the observed follow-up patterns; by itself it does not explain why visits were missed or establish that age caused missingness. Nor does it tell us the unobserved antibody responses. The \(I\) pattern is important to retain: those children missed a visit, but their endpoint is observed, so their endpoint values should not be classified as missing.

For an endpoint analysis, the \(E\) and \(I\) groups both contribute observed \(Y\) values. Their different histories may still help predict outcomes for children in \(L\). In practice, the prediction model could condition on age, randomized arm, baseline variables, and observed antibody measurements or visit history. The restriction is about the unobserved endpoint after conditioning on the variables included in that model.

Identifying an endpoint mean by pattern

Write \(\mu_{a,g,r}=E(Y\mid A=a,G=g,R=r)\) for the mean endpoint response in a treatment-arm, age-group, and follow-up-pattern cell. For patterns \(E\) and \(I\), this mean can be estimated from observed endpoint values, subject to ordinary sampling and model considerations. For pattern \(L\), the endpoint values are not observed, so the corresponding mean is not determined by the observed data alone.

One possible identifying restriction is missing at random conditional on the variables used in the model: within a given arm, age group, and observed history, the expected endpoint among children with a missing endpoint equals the model-predicted expected endpoint among comparable children whose endpoint is observed. This restriction does not mean the missingness is unrelated to everything; it allows dependence on included observed information. It does rule out residual dependence between endpoint values and endpoint missingness after conditioning on that information.

Identification under a conditional MAR restriction: If the prediction model includes the observed history used to make endpoint predictions, the expected endpoint for pattern \(L\) is set equal to the model-based expected endpoint for children with comparable observed history in the same arm and age group. This is an assumption, not a quantity revealed by the missing outcomes.

A pattern-specific delta restriction instead allows the mean for a missing-endpoint pattern to depart from its MAR prediction. Here \(\delta_{a,g,L}\) is an additive shift in log2 titer units: the assumed mean for pattern \(L\) is the MAR-predicted mean plus \(\delta_{a,g,L}\). A negative value represents a lower assumed mean response among children with missing endpoints than among otherwise comparable children under MAR. The observed data do not estimate this shift; it is a sensitivity parameter chosen for clinical interpretation.

Calculate the MAR estimates

Suppose the hypothetical observed endpoint means and the model-based predictions for pattern \(L\) are as follows. The \(L\)-column values are predictions under the conditional MAR restriction. All values are in log2 titer units.

ArmAge group\(n_E\)Mean in E\(n_I\)Mean in I\(n_L\)MAR-predicted mean in L
Vaccine2–5 months208.0107.6107.4
Vaccine6–11 months258.8108.458.2
Control2–5 months205.5105.3105.2
Control6–11 months256.0105.855.7

For each arm and age group, combine the observed endpoint values and the predicted missing-endpoint values, weighting each pattern mean by its number of children. The resulting age-specific mean is

$$ \widehat{\mu}_{a,g} = \frac{n_E\bar{Y}_E+n_I\bar{Y}_I+n_L\widehat{\mu}_{L,\mathrm{MAR}}} {n_E+n_I+n_L}. $$

To define an age-standardized contrast, give the two age groups equal weight. This targets a hypothetical population with half its children in each age group; it is a transparent choice for this illustration, not a claim that every trial should use equal weights.

Worked Example: Age-Standardized Vaccine-Control Contrast Under MAR

For younger children in the vaccine arm, the estimated mean is

$$ \frac{20(8.0)+10(7.6)+10(7.4)}{40} = \frac{160+76+74}{40} = 7.75 \text{ log}_2 \text{ titer units}. $$

For older children in the vaccine arm, it is \(\{25(8.8)+10(8.4)+5(8.2)\}/40=(220+84+41)/40=8.625\). The equal-weight vaccine mean is \((7.75+8.625)/2=8.1875\) log2 titer units.

For younger children in the control arm, the estimate is \(\{20(5.5)+10(5.3)+10(5.2)\}/40=(110+53+52)/40=5.375\). For older children it is \(\{25(6.0)+10(5.8)+5(5.7)\}/40=(150+58+28.5)/40=5.9125\). The equal-weight control mean is \((5.375+5.9125)/2=5.64375\) log2 titer units.

The age-standardized vaccine-minus-control contrast is \(8.1875-5.64375=2.54375\), or about 2.544 log2 titer units. Under the stated conditional MAR restriction and the chosen age weights, the estimated vaccine-arm mean is higher by about 2.544 log2 units. This is a model-dependent estimate, not a conclusion that missing responses actually follow MAR.

Change the restriction and examine the result

Suppose clinicians consider it plausible that vaccine recipients whose endpoint is missing had lower responses than comparable vaccine recipients with observed endpoints, even after accounting for the observed history. As one sensitivity scenario, set \(\delta_{V,g,L}=-0.8\) in both age groups and set the control-arm shifts to zero. This scenario changes only the unobserved endpoint means; observed endpoint means remain as recorded.

Worked Example: A Pattern-Specific Delta Sensitivity Scenario

The vaccine-arm MAR-predicted means for pattern \(L\) are 7.4 for younger children and 8.2 for older children. Under the chosen \(-0.8\) shift, the assumed means become \(7.4-0.8=6.6\) and \(8.2-0.8=7.4\) log2 titer units, respectively.

For younger vaccine recipients, the adjusted mean is \(\{20(8.0)+10(7.6)+10(6.6)\}/40=(160+76+66)/40=7.55\). For older vaccine recipients, it is \(\{25(8.8)+10(8.4)+5(7.4)\}/40=(220+84+37)/40=8.525\). The equal-weight vaccine mean is \((7.55+8.525)/2=8.0375\).

The control means are unchanged because their delta shifts are zero, so the standardized contrast is \(8.0375-5.64375=2.39375\), or about 2.394 log2 titer units. Relative to the MAR contrast, this is lower by \(2.54375-2.39375=0.15\) log2 units.

The size of that change can also be checked directly. For younger vaccine recipients, 10 of 40 outcomes receive a \(-0.8\) shift, reducing the age-specific mean by \(10(-0.8)/40=-0.2\). For older vaccine recipients, the corresponding reduction is \(5(-0.8)/40=-0.1\). With equal age weights, the overall reduction is \(\{(-0.2)+(-0.1)\}/2=-0.15\) log2 units. This verifies the difference between the two standardized contrasts.

Assumptions, diagnostics, and alternative approaches

The calculations rely on several distinct conditions. Randomization supports comparison by assigned arm, but does not identify missing outcomes. The conditional MAR estimate additionally relies on a suitable prediction model, adequate observed information for predicting pattern \(L\), and overlap: children with missing endpoints must have observed counterparts with sufficiently similar age and recorded history to inform predictions. The delta scenario replaces the MAR equality for the specified pattern with an explicit alternative mean shift. Both approaches require consistent endpoint measurement and a clearly defined target population and age weights.

Diagnostics should examine whether the visit-pattern definitions match the protocol, whether endpoint availability differs by age and arm, and whether the prediction model is extrapolating beyond observed histories. Check cell counts and the range of predicted values, compare predictions with observed endpoint values in similar history groups, and investigate whether missed visits cluster around illness, treatment discontinuation, or other recorded events. A very small pattern cell can make its mean unstable; a model that predicts far outside the observed response range can signal poor fit or insufficient overlap. These checks can expose problems but cannot verify a restriction about outcomes that were never observed.

ApproachWhat it assumes or usesMain caution in this case
Conditional MAR pattern-mixture estimateMissing endpoints have the same conditional mean as predicted from observed history.Unrecorded reasons for missed visits may be related to antibody response after conditioning.
Pattern-specific delta sensitivityMissing endpoints differ from their MAR predictions by specified shifts.The shifts are assumptions; report their values and clinical interpretation.
Complete-case comparisonUses only children with observed endpoints.Can describe observed responders, but may not represent all randomized children when follow-up patterns differ.
Reference-based restrictionUses a specified reference-arm outcome distribution for some missing outcomes.Requires a defensible clinical rationale; a control response is not automatically the right counterfactual for missing vaccine responses.

A frequent mistake is to treat every missed visit as a missing endpoint and discard the distinction between patterns \(I\) and \(L\). The correction is to classify endpoint availability separately from earlier visit attendance: a child in \(I\) contributes an observed six-month response, while a child in \(L\) requires an identifying restriction for that endpoint.

Another mistake is to read the MAR estimate as if it were determined by randomization or confirmed by a good model fit. Randomization addresses assignment, while MAR addresses the relationship between missingness and unobserved outcomes after conditioning. A well-fitting model can still rely on an incorrect restriction. The delta comparison makes this dependence visible, but no single delta value is selected by the observed data alone.

Finally, the point estimates above do not quantify sampling uncertainty. In a full analysis, uncertainty must reflect estimation of observed pattern means and missing-outcome predictions, and the chosen sensitivity scenario should be reported alongside its assumptions. The numerical contrast is in log2 titer units; it should not be described as a probability or as proof that vaccination caused an individual child’s response.

Check Your Understanding

Answer each question, then compare your reasoning with the solutions below.

  1. In the younger age group, 10 of 40 children have a missing endpoint. What is the endpoint missingness proportion, and how does it compare with the older group’s 5 of 40?
  2. A child misses an intermediate visit but provides the six-month blood sample. Which follow-up pattern applies, and is the endpoint missing?
  3. If a missing-endpoint mean is 6.9 under MAR and the specified delta is \(-0.5\), what mean is assumed under the sensitivity restriction, and what does the shift mean?
  4. Under the worked sensitivity scenario, how much does the equal-weight vaccine mean decrease relative to MAR, and why?

Solutions. (1) \(10/40=0.25\), or 25%; the older group has \(5/40=0.125\), or 12.5%, so the younger-group proportion is 12.5 percentage points higher. (2) Pattern \(I\); the endpoint is observed, so the child contributes an observed endpoint value. (3) \(6.9-0.5=6.4\) log2 titer units; the restriction assumes a mean 0.5 units below the MAR-predicted mean for that missing-endpoint pattern. (4) It decreases by 0.15 log2 units: the shifts reduce the younger and older vaccine means by \(10(0.8)/40=0.2\) and \(5(0.8)/40=0.1\), respectively, and their equal-weight average reduction is \((0.2+0.1)/2=0.15\).

Clinical Biostats