Tutorials › Pattern-Mixture and Selection Models › Checking the J2R Transition at Dropout

Reference-Based Imputation for Clinical Trials · Tutorial 302 of 499

Checking the J2R Transition at Dropout

Use numerical and graphical checks to distinguish the transition J2R implies at dropout from a transition that is merely an artifact of indexing, averaging, or simulation.

Advanced 10 min read

What You'll Learn

  • Define the J2R transition for participants who drop out after a given visit.
  • Calculate participant-level and dropout-pattern mean transitions from conditional reference-model predictions.
  • Separate the expected transition from variation in realized imputations.
  • Use trajectory plots and numerical summaries to find implementation or interpretation problems.
  • Recognize why J2R does not generally require a continuous trajectory or an immediate jump to the reference-arm marginal mean.

Why Check the Transition at Dropout?

Jump to reference (J2R) changes the model used to generate outcomes after a participant discontinues the treatment strategy. Before dropout, the participant’s observed outcomes are retained. After dropout, the conditional distribution for future outcomes is based on the reference arm, with the participant’s observed history carried into that conditional prediction. A useful check is therefore to inspect what this switch implies for the change from the last observed outcome to the first imputed outcome.

That change is not required to be zero, and it is not generally equal to the difference between the treatment-arm and reference-arm marginal means at that visit. It depends on the participant’s conditioning history and the reference model’s conditional mean. A check should compare the observed transition with the transition implied by that model—not impose continuity or a marginal-mean target that J2R does not specify.

Definition: Let \(Y_{ig}\) be participant \(i\)'s outcome at the last observed visit \(g\), and let \(Y_{i,g+1}^{J2R}\) be the first post-dropout outcome generated under J2R. The participant-level transition is \(\Delta_i^{J2R}=Y_{i,g+1}^{J2R}-Y_{ig}\). Its model-based expected transition, conditional on the history available at dropout, is \(E_0(Y_{i,g+1}\mid H_{ig})-Y_{ig}\), where \(E_0\) denotes expectation under the reference-arm conditional model and \(H_{ig}\) is the history used for prediction.

What the Reference-Model Transition Means

For clarity, consider a continuous outcome measured at scheduled visits. Suppose a participant assigned to treatment has observed outcomes through visit \(g\), then drops out. Write \(H_{ig}\) for the history used by the sequential imputation model. It may contain the observed outcome at visit \(g\), earlier outcomes, and any other conditioning variables specified by that model. Under J2R, the first missing outcome is generated from the reference-arm conditional distribution given this history. In notation,

$$ Y_{i,g+1}^{J2R}\mid H_{ig}\ \sim\ F_0(\,\cdot\mid H_{ig}), \qquad m_{i,g+1}^{J2R}=E_0(Y_{i,g+1}\mid H_{ig}). $$

Here \(F_0\) is the reference conditional distribution and \(m_{i,g+1}^{J2R}\) is its conditional mean. The expected transition for this participant is \(m_{i,g+1}^{J2R}-Y_{ig}\). If the imputation model is normal, for example, it also specifies a conditional variance; the realized imputed value can differ from its conditional mean because it includes a random residual and, in multiple imputation, may also reflect parameter uncertainty.

The key assumption is about the post-dropout distribution: conditional on the history included in the model, the participant’s unobserved outcomes follow the reference-arm conditional distribution. The transition check does not verify that this untestable assumption is true. It checks whether the implementation and resulting predictions are consistent with the stated assumption. The imputation model, including its conditioning history and sequential use across visits, must be correctly specified for this interpretation to apply.

From Individual Predictions to a Pattern-Level Check

Participants who drop out after the same visit form a dropout pattern. For a pattern \(g\) containing \(n_g\) participants, the model-based mean transition at the first missing visit is the average of their conditional expected transitions:

$$ \overline{\Delta}_{g,\mathrm{expected}}^{J2R} = \frac{1}{n_g}\sum_{i=1}^{n_g} \left\{E_0(Y_{i,g+1}\mid H_{ig})-Y_{ig}\right\}. $$

For one completed imputation, the corresponding realized average is \(\overline{\Delta}_{g,\mathrm{draw}}^{J2R} =n_g^{-1}\sum_i(Y_{i,g+1}^{J2R}-Y_{ig})\). These two quantities need not match exactly. The realized average includes random outcome variation, and may additionally include parameter-draw variation. Across many imputations, their averages should be reasonably aligned, allowing for Monte Carlo error. A small pattern can show substantial variation even when the model is implemented correctly.

A useful short derivation makes the distinction concrete. If the reference conditional mean has the linear form \(m_{i,g+1}^{J2R}=\alpha+\beta^\mathsf{T}H_{ig}\), then

$$ \overline{\Delta}_{g,\mathrm{expected}}^{J2R} = \frac{1}{n_g}\sum_i(\alpha+\beta^\mathsf{T}H_{ig}-Y_{ig}) = \alpha+\beta^\mathsf{T}\overline{H}_g-\overline{Y}_g. $$

Thus, the pattern-level expected change depends on the pattern’s histories and last observed outcomes. It is not obtained by subtracting two marginal means unless the model and data make that calculation equivalent. This is why a plot of arm-level means alone cannot fully diagnose the transition.

Worked Example: Calculating an Individual Transition

Suppose a hypothetical participant has an outcome of 12 points at visit 2, the last observed visit. The fitted reference conditional model predicts a mean of 10.5 points at visit 3 given this participant’s history. Assume the model uses the observed history as specified and that visit 3 is the first missing visit.

The expected J2R transition is

$$ m_{i3}^{J2R}-Y_{i2}=10.5-12=-1.5\text{ points}. $$

So J2R implies an expected decrease of 1.5 points from visit 2 to visit 3 for this participant. If a particular imputation draws 9.8 points at visit 3, its realized transition is \(9.8-12=-2.2\) points. That is 0.7 points below the conditional mean, a possible random deviation rather than, by itself, evidence of an error. The interpretation assumes the stated reference conditional model and correct alignment of the visit-2 history with the visit-3 prediction.

Worked Example: Summarizing a Dropout Pattern

Consider three hypothetical participants who all drop out after visit 2. Their last observed outcomes are 12, 9, and 15 points. The reference conditional model gives first-missing-visit means of 10.5, 9.5, and 12 points for their respective histories.

The individual expected transitions are \(10.5-12=-1.5\), \(9.5-9=0.5\), and \(12-15=-3\) points. Their pattern-level expected mean transition is

$$ \overline{\Delta}_{2,\mathrm{expected}}^{J2R} = \frac{-1.5+0.5-3}{3} = \frac{-4}{3} \approx -1.333\text{ points}. $$

The expected average first-missing outcome is \((10.5+9.5+12)/3=10.667\) points, while the average last observed outcome is \((12+9+15)/3=12\) points. Their difference is \(10.667-12=-1.333\) points, agreeing with the average of individual transitions. This arithmetic check is useful: the pattern transition must equal the difference between those two pattern means when the same participants are included in both.

Suppose one completed imputation instead produces first-missing values 9.8, 10.2, and 11.0 points. Its realized mean transition is \(\{(9.8-12)+(10.2-9)+(11-15)\}/3=-1.667\) points. The difference from \(-1.333\) points is not automatically a failure; one imputation includes outcome-level randomness. The model-based predictions and multiple-imputation averages are the more direct checks of the expected transition.

Numerical and Graphical Checks

A practical review combines calculations with plots. Start by separating participants by their last observed visit. Within each dropout pattern, calculate the mean last observed outcome, mean conditional prediction for the first missing visit, and their difference. Also calculate individual expected transitions and inspect their spread. This prevents an overall average from concealing patterns with different dropout times or histories.

For plots, mark each participant’s dropout visit and distinguish observed outcomes from imputed outcomes. A spaghetti plot can reveal whether a few extreme participant-level transitions dominate the group average. A pattern-specific mean trajectory can show the average at the final observed visit and the first missing visit, with separate symbols or line styles for observed and imputed values. Displaying the model-based conditional means separately from one set of stochastic imputed values helps distinguish a mean-model feature from random draw variation.

A transition at the boundary may look abrupt and still be consistent with J2R. Conversely, a smooth plotted line does not demonstrate that the J2R model was applied correctly: plotting choices can connect points across dropout, and averages can look smooth while participant-level predictions are misaligned. Checks should therefore include the numerical values and the data-processing rules, not just visual appearance.

1
Confirm the boundary.
For each participant, verify that \(g\) is the last observed visit and that \(g+1\) is the first imputed visit. Check that pre-dropout observed outcomes were not replaced by J2R imputations.
2
Check the conditional target.
Verify that the first post-dropout conditional mean and distribution come from the reference model, conditional on the history specified by the imputation procedure.
3
Summarize at both levels.
Calculate participant-level expected transitions and pattern-specific averages. Reconcile the average transition with the difference between the pattern’s first-missing predicted mean and last-observed mean.
4
Compare expectations with draws.
Inspect realized imputed transitions and averages across imputations. Allow for random variation, especially in small patterns, but investigate persistent discrepancies from the conditional predictions.
5
Plot with dropout marked.
Display individual and pattern-level trajectories, identify the observed-to-imputed boundary, and check that the plot uses the same participants and visit definitions as the numerical summaries.

Common Pitfalls, Alternatives, and Limits

The main alternatives answer different questions. A treatment-arm missing-at-random model continues to use the treatment-arm conditional distribution after dropout, whereas J2R uses the reference-arm conditional distribution after dropout. Copy-reference approaches make a different assumption about what treatment history is carried forward. These approaches can therefore imply different transition patterns. The transition check is not a method for choosing among them: it shows the implications of the chosen model and can reveal whether those implications match its intended specification.

  • Wrong reasoning: J2R means the first missing mean must equal the reference-arm marginal mean. The correction is to use the reference conditional mean given the history specified by the model. Conditional and marginal means need not coincide.
  • Wrong reasoning: the trajectory must be continuous at dropout. The correction is that J2R changes the post-dropout conditional model. A nonzero expected transition can follow from that change and the participant’s last observed outcome.
  • Wrong reasoning: one realized imputation must equal the conditional mean. The correction is that a draw includes random outcome variation, and possibly parameter uncertainty. Compare expected predictions with suitable averages across draws, not an individual draw with an exact mean requirement.
  • Wrong reasoning: an overall mean transition is enough. The correction is to stratify by dropout visit and inspect participant-level transitions. Opposing or heterogeneous changes can cancel in an overall average.

These checks are diagnostics, not tests that establish the missing-data assumption. The post-dropout outcomes are unobserved, so their distribution cannot be confirmed from the observed data alone. A plausible transition plot can coexist with a misspecified reference model, and an unusual-looking transition may reflect genuine model implications rather than a coding error. The check is most informative when paired with careful review of visit indexing, conditioning variables, reference-arm fit, and the handling of parameter and outcome draws.

Key takeaway: The J2R transition is the change from a participant’s last observed outcome to the reference-model conditional prediction at the first missing visit. Check it by dropout pattern and participant, and distinguish the expected transition from stochastic imputed values. Do not impose continuity or equate a conditional prediction with a reference-arm marginal mean.

Check Your Understanding

Answer each question, then compare with the solutions below.

  1. A participant’s last observed outcome is 20 units, and the reference conditional mean for the first missing visit given the participant’s history is 17 units. What is the expected J2R transition, and how should it be described?
  2. Two participants in one dropout pattern have last observed values 8 and 14, with conditional first-missing means 9 and 11. Calculate the pattern-level expected mean transition.
  3. Why does a realized imputed transition differing from its conditional expected transition not, on its own, show that J2R was implemented incorrectly?
  4. A plot shows the first missing pattern-level mean equal to the reference arm’s marginal mean, but the reference conditional predictions given participant histories average to a different value. Which quantity is the direct J2R check, and why?

Solutions. 1. The expected transition is \(17-20=-3\) units, an expected decrease of 3 units from the last observed visit to the first missing visit. 2. The transitions are \(9-8=1\) and \(11-14=-3\) units, so the pattern mean is \((1-3)/2=-1\) unit. 3. A realized imputed value includes random outcome variation, and potentially parameter-draw variation; the relevant check is whether the conditional predictions and averages across imputations are consistent with the specified model. 4. The average of the reference conditional predictions given the pattern’s histories is the direct check, because J2R uses the reference conditional distribution given those histories. The marginal reference mean averages over a different distribution of histories and need not match.

Clinical Biostats