Tutorials › Biostatistics › FDA Guidance on Missing Data in Clinical Trials

Clinical Trial Methodology

FDA Guidance on Missing Data in Clinical Trials

A practical guide to FDA expectations for preventing, documenting, analyzing, and stress-testing missing data in clinical trials, including estimands, intercurrent events, missing-data assumptions, multiple imputation, pattern-mixture models, tipping-point analyses, sensitivity analyses, and clinical-trial reporting.

Intermediate 24 min read

What You'll Learn

  • Why FDA treats prevention and treatment of missing data as a trial-design issue
  • How ICH E9(R1) estimands change the missing-data discussion
  • How MCAR, MAR, and MNAR assumptions differ
  • When mixed models, multiple imputation, and likelihood methods are appropriate
  • How to construct sensitivity analyses and tipping-point analyses
  • How to document missingness in the protocol, SAP, CSR, and regulatory submission

Introduction

Missing data are unavoidable in many clinical trials. Participants may discontinue treatment, miss visits, withdraw consent, die, start rescue medication, move to another therapy, or become unable to complete an assessment.

The statistical problem is not simply that a cell in a database is blank. The more important question is what the missing outcome might have been, why it is missing, and whether the missingness could change the clinical conclusion.

FDA's current statistical perspective places missing data within a broader framework that includes trial design, data collection, estimands, prespecification, assumptions, and sensitivity analysis. FDA's Office of Biostatistics explicitly identifies prevention and treatment of missing data, along with evaluation of statistical assumptions, as part of its review of clinical-trial evidence.

Important terminology: There is not one standalone FDA document that governs every missing-data problem in every clinical trial. The practical FDA framework is assembled from FDA statistical guidance and reviews, the National Research Council's 2010 report commissioned by FDA, and ICH E9/E9(R1). This tutorial therefore uses “FDA guidance” in the practical regulatory sense and should be read alongside the guidance specific to the endpoint, indication, product type, and trial design.

The Core FDA Principle

The central principle is simple: prevent missing data whenever possible, understand why data are missing, prespecify how missingness will be handled, and demonstrate that the primary conclusion is robust to clinically plausible departures from the primary assumptions.

FDA materials repeatedly emphasize that missing data can create uncertainty and bias, that sponsors should make efforts to reduce loss to follow-up, and that the reasons for missingness should be documented. FDA also emphasizes that the statistical analysis plan should address the assumptions underlying the chosen method.

1
Prevent: design the study and operational processes to reduce missed visits and withdrawals.
2
Collect: continue outcome collection when clinically and ethically appropriate, including after treatment discontinuation when it is relevant to the estimand.
3
Document: record the amount, timing, and reasons for missingness.
4
Analyze: use a prespecified estimator consistent with the estimand and data-generating assumptions.
5
Stress-test: perform sensitivity analyses under alternative plausible assumptions.
6
Interpret: explain whether the treatment conclusion changes under those assumptions.

Why Missing Data Can Bias a Trial

Suppose a randomized trial has 200 patients, 100 per treatment arm. The primary endpoint is a continuous measure at Week 24.

If 5 patients in each arm are missing, the missingness may have limited impact if the reasons and outcome trajectories are reasonably balanced. But suppose 20 experimental-arm patients discontinue because they perceive the treatment as ineffective, while only 5 control patients discontinue for the same reason.

Simply analyzing observed Week 24 values can make the experimental arm look better than it would have looked had outcomes been observed for everyone. Conversely, if patients with poor outcomes remain more likely to return for assessment in the experimental arm, complete-case analysis could move the estimate in the opposite direction.

$$ \text{Observed-data estimate} \neq \text{necessarily the treatment effect in the intended trial population} $$

The direction of bias is not determined by the percentage of missing data alone. The relationship between missingness, treatment, observed outcomes, unobserved outcomes, and post-randomization events matters.

Missingness Is More Than a Percentage

A statement such as “10% of Week 24 observations are missing” is incomplete. A useful missing-data assessment asks at least four questions:

  • How much data are missing?
  • When do observations become missing?
  • Why are they missing?
  • Are missingness patterns different between treatment groups or important subgroups?

FDA-oriented reporting should therefore distinguish between the numerical amount of missing data and the clinical reasons that generated it.

Figure 1. Illustrative Missingness by Visit and Treatment Arm
The percentage missing at each scheduled assessment can reveal patterns that are hidden by a single overall missing-data percentage.
Experimental
Control

Illustrative data only. The example shows how differential attrition can become more pronounced late in follow-up.

What Counts as Missing Data?

Missingness can arise in several distinct ways.

SituationExampleStatistical concern
Missed visitPatient does not attend Week 24Endpoint is unobserved at the planned time
Early treatment discontinuationAdverse event at Week 12Later outcomes may differ systematically from completers
Withdrawal from studyPatient stops all study contactSubsequent outcomes may be entirely unavailable
DeathPatient dies before endpointMay be an intercurrent event rather than ordinary missingness
Rescue medicationPatient starts prohibited rescue therapyRequires an estimand-specific strategy
Unusable measurementLaboratory specimen is invalidObserved visit but missing endpoint value
Administrative missingnessStudy ends before planned assessmentMay be unrelated to patient outcome

Missing Data Versus Intercurrent Events

ICH E9(R1) introduced an essential distinction: failure to collect data should not be confused with an intercurrent event that changes the meaning or availability of the outcome.

For example, treatment discontinuation can lead to two very different situations:

  1. The patient stops treatment but continues outcome assessments.
  2. The patient stops treatment and consequently provides no later outcome assessments.

The first is primarily an intercurrent-event question. The second contains both an intercurrent event and a missing-data problem.

Practical rule: First ask what happened to the patient and what treatment-policy question the trial is trying to answer. Only then decide how the unobserved endpoint should be handled statistically.

Estimands: The Missing-Data Question Starts With the Scientific Question

An estimand defines what treatment effect the trial is trying to estimate. ICH E9(R1) describes five attributes: treatment, population, variable, intercurrent-event strategy, and population-level summary.

This matters because missing-data methods cannot be selected intelligently without first knowing the target treatment effect.

For example, consider treatment discontinuation because of an adverse event. Two legitimate scientific questions might be:

  • Treatment-policy question: What is the effect of assignment to treatment regardless of whether patients discontinue treatment?
  • While-on-treatment question: What is the effect while patients remain on the assigned treatment?

These are different estimands. The data needed and the missing-data assumptions can therefore differ.

A Simple Estimand Example

Suppose the endpoint is change from baseline in systolic blood pressure at Week 24.

$$ Y_i = \text{Week 24 SBP change for patient } i $$

A treatment-policy estimand might target:

$$ \Delta = E(Y\mid A=1)-E(Y\mid A=0) $$

where outcomes after treatment discontinuation remain relevant to the question.

A hypothetical estimand could instead ask what the Week 24 difference would have been if all patients had remained on their assigned treatment.

The numerical answer to these questions can differ even when they use the same observed trial data.

MCAR, MAR, and MNAR

Missing-data mechanisms are often described using three shorthand concepts: MCAR, MAR, and MNAR.

MechanismPlain-language interpretationTypical implication
MCARMissingness is unrelated to observed or unobserved outcome information, conditional on the trial structure.Complete-case analysis can be unbiased for some targets, although it may be inefficient.
MARAfter conditioning on observed information, missingness does not depend on the unobserved value itself.Likelihood or multiple-imputation methods can often be justified if the model and observed-data history are adequate.
MNAREven after conditioning on observed information, missingness depends on the unobserved outcome.Additional assumptions are required; sensitivity analysis becomes especially important.

These are assumptions about a data-generating process, not labels that can usually be proven from the observed dataset.

$$ P(R=1\mid Y_{\mathrm{obs}},Y_{\mathrm{mis}}) $$

where \(R\) is the missingness indicator, \(Y_{\mathrm{obs}}\) represents observed outcomes, and \(Y_{\mathrm{mis}}\) represents unobserved outcomes.

MCAR: Missing Completely at Random

Under MCAR, missingness is unrelated to the outcome information after accounting for the trial design.

For example, imagine that a laboratory shipment is accidentally lost for a randomly selected group of patients, with no relationship to treatment, disease severity, or outcome.

That scenario is more compatible with MCAR than a pattern in which patients with worsening disease are more likely to miss visits.

MCAR is mathematically convenient but often implausible for clinical trial dropout.

MAR: Missing at Random

Under MAR, missingness can depend on information that has already been observed.

For example, patients with poor Week 8 outcomes may be more likely to discontinue before Week 24, but if the relationship between discontinuation and the missing Week 24 outcome is adequately explained by observed information such as Week 8 outcome, prior visits, baseline disease severity, and treatment, an MAR analysis may be plausible.

Conceptually:

$$ P(R=1\mid Y_{\mathrm{obs}},Y_{\mathrm{mis}}) = P(R=1\mid Y_{\mathrm{obs}}) $$

The assumption is not “the data are random.” It is a conditional assumption about the relationship between missingness and the unobserved outcome.

MNAR: Missing Not at Random

MNAR is often used to describe settings in which the probability of missingness depends on the unobserved outcome even after conditioning on observed data.

For example, suppose two patients have identical observed histories, but the patient with the worse unobserved Week 24 outcome is more likely to withdraw. That dependence is not captured by a simple MAR assumption.

Important: MNAR is not directly testable from the observed data because the unobserved outcome is, by definition, unavailable. The purpose of sensitivity analysis is to examine how conclusions change under plausible departures from the primary assumption.

Visualizing the Logic of Missingness Assumptions

Figure 2. Conceptual Relationship Between Observed Outcomes and Missingness
The diagram is conceptual rather than a statistical model. It illustrates why observed history can support an MAR analysis while an MNAR sensitivity analysis adds assumptions about unobserved outcomes.

The mechanisms cannot generally be distinguished with certainty from the observed trial dataset alone.

Why Complete-Case Analysis Is Usually Not Enough

Complete-case analysis removes participants with missing endpoint data. That can be attractive because it is simple and transparent.

However, the patients who remain may differ systematically from those who are excluded.

In a randomized trial, randomization protects the treatment comparison at baseline. It does not guarantee that the subset of completers remains comparable after post-randomization dropout.

$$ \text{Randomization} \not\Rightarrow \text{random dropout} $$

Therefore, excluding incomplete patients can change the population being analyzed and can introduce bias.

Why Last Observation Carried Forward Is Problematic

Last observation carried forward (LOCF) replaces a missing later measurement with the patient's last observed value.

For example:

$$ Y_0=100,\quad Y_8=82,\quad Y_{24}=\text{missing} $$

LOCF would set:

$$ Y_{24}^{\mathrm{LOCF}}=82 $$

The problem is that this imposes a strong and usually scientifically unjustified assumption: the patient's unobserved outcome would have remained at the last observed value.

FDA review materials have specifically noted that LOCF is not a generally preferred modern strategy for primary analyses, and that the assumptions behind the chosen method should be explained.

Better principle: Do not ask, “What simple value can I substitute for the missing observation?” Ask, “What assumptions about the patient's unobserved trajectory are consistent with the estimand and clinical context?”

Likelihood-Based Repeated-Measures Models

For continuous longitudinal endpoints, mixed models for repeated measures (MMRM) are frequently used because they can incorporate observed outcomes from participants with incomplete follow-up without requiring a single imputed value for every missing visit.

A simplified model can be written as:

$$ Y_{ij} = \mu + \beta_{\mathrm{trt}}A_i + \beta_{\mathrm{visit}}V_j + \beta_{\mathrm{trt\times visit}}(A_iV_j) + \gamma^\top X_i + \varepsilon_{ij} $$

where \(Y_{ij}\) is the observed outcome for patient \(i\) at visit \(j\), \(A_i\) is treatment, \(V_j\) is visit, \(X_i\) represents covariates, and the residual covariance structure accounts for within-patient correlation.

Under a standard MAR interpretation, likelihood-based estimation uses the observed history to contribute information about the treatment effect.

Key caveat: An MMRM is not automatically “a missing-data solution.” Its validity depends on the estimand, model specification, observed-data history, covariance assumptions, and the plausibility of the missingness assumptions. Sensitivity analyses are still needed when departures from those assumptions could materially affect the conclusion.

Multiple Imputation

Multiple imputation replaces each missing value with multiple plausible values rather than a single deterministic substitute.

For \(M\) imputed datasets, the analysis produces estimates:

$$ \hat\theta_1,\hat\theta_2,\ldots,\hat\theta_M $$

These are combined using Rubin's rules. The pooled point estimate is:

$$ \bar\theta = \frac{1}{M} \sum_{m=1}^{M}\hat\theta_m $$

and total variance combines within-imputation and between-imputation uncertainty.

$$ T = \bar U + \left(1+\frac{1}{M}\right)B $$

where \(\bar U\) is the average within-imputation variance and \(B\) is the between-imputation variance.

What Should Go Into an Imputation Model?

An imputation model should generally contain information that predicts the outcome and/or missingness, subject to the estimand and analysis strategy. Potential variables include:

  • Treatment assignment
  • Baseline prognostic factors
  • Observed post-baseline outcomes
  • Prior treatment response
  • Important disease characteristics
  • Reasons for treatment discontinuation
  • Other variables associated with missingness

The model should be developed before looking at the final treatment result when possible, and it should be documented in the SAP.

Pattern-Mixture Models

Pattern-mixture models stratify or model the outcome distribution according to missingness patterns.

For example, patients might be grouped as:

  • Complete through Week 24
  • Missing after Week 16
  • Missing after Week 12
  • Missing after Week 8

The observed data inform each pattern, while assumptions are needed to relate unobserved outcomes to observed outcomes.

Pattern-mixture approaches are especially useful for sensitivity analysis because they make departures from MAR explicit.

Delta Adjustment

A common sensitivity-analysis approach is to modify imputed values by a clinically justified shift:

$$ Y_{\mathrm{mis}}^{(\delta)} = Y_{\mathrm{mis}}^{(\mathrm{MAR})} + \delta $$

For an endpoint where larger values are worse, a positive \(\delta\) might represent a worse-than-MAR assumption for missing patients.

For an endpoint where larger values are better, the direction would need to be interpreted accordingly.

The value of \(\delta\) should not be arbitrary. It should be motivated by clinical knowledge, observed outcome differences, historical evidence, or other credible information.

Tipping-Point Analysis

A tipping-point analysis asks: How unfavorable would the missing outcomes need to be before the clinical conclusion changes?

For example, suppose the primary analysis gives:

$$ \hat\Delta=-4.2,\qquad p=0.012 $$

The sensitivity analysis might impose increasingly unfavorable assumptions for missing experimental-arm outcomes.

AssumptionAdjusted effectConclusion
MAR−4.2Favors treatment
Small adverse shift−3.8Favors treatment
Moderate adverse shift−3.0Favors treatment
Large adverse shift−1.8Favors treatment, less strongly
Very large adverse shift−0.5Conclusion changes

The exact numerical threshold depends on the endpoint, estimator, covariance structure, and inferential criterion.

Figure 3. Illustrative Tipping-Point Sensitivity Analysis
The treatment effect becomes progressively less favorable as increasingly unfavorable assumptions are imposed on missing outcomes.
Estimated treatment effect
Null effect

Illustrative values only. A real tipping-point analysis should use a prespecified and clinically justified sensitivity parameterization.

Reference-Based Imputation

Reference-based methods use the observed behavior of a reference group to construct assumptions about outcomes after certain intercurrent events. Examples include jump-to-reference and copy-reference strategies.

These methods can be useful when the scientific question implies that after an event such as treatment discontinuation, the future trajectory may resemble a control or reference trajectory.

The choice must be justified in the context of the estimand and clinical setting rather than treated as a generic “conservative” option.

Control-Based Imputation Is Not Automatically Conservative

It is tempting to label any method that moves missing experimental-arm outcomes toward control as conservative.

But conservatism depends on the endpoint, treatment effect definition, direction of benefit, and estimand.

A sensitivity assumption should therefore be described in terms of the scientific behavior it represents, not merely as “conservative” or “nonconservative.”

Missing Binary Endpoints

For a binary endpoint, missingness often appears as an incomplete response status.

Suppose the objective response rate is:

$$ ORR = \frac{\text{number of responders}} {\text{number of patients in the analysis population}} $$

If patients with missing response assessments are excluded from the denominator, the apparent response rate can increase substantially.

A simple worst-case sensitivity analysis might classify missing experimental patients as nonresponders and missing control patients as responders.

That is only one sensitivity analysis, however. More realistic methods may model response probabilities using observed covariates and response history.

Missing Time-to-Event Endpoints

Time-to-event endpoints require special care because censoring is not the same thing as ordinary missingness.

For progression-free survival, for example, a patient who has no documented progression before the last adequate assessment may be censored according to the prespecified event and censoring rules.

A patient who withdraws consent may have a different censoring implication than a patient who remains in follow-up but simply has no event by study end.

Do not mechanically apply continuous-endpoint missing-data methods to time-to-event endpoints. The estimand, event definition, censoring rules, intercurrent events, and follow-up process all need to be considered together.

Missing Safety Data

Missing safety data create a different set of concerns from missing efficacy data.

A participant who stops treatment early may have fewer opportunities to experience and report later adverse events. The resulting exposure-time differences can affect interpretation of safety summaries.

Safety analyses therefore require careful consideration of:

  • Exposure duration
  • Early treatment discontinuation
  • Follow-up duration
  • Serious adverse events after treatment discontinuation
  • Deaths and their ascertainment
  • Laboratory and vital-sign assessment schedules

The missing-data framework should not be reduced to an imputation exercise. For many safety endpoints, the more important goal is complete ascertainment and transparent accounting of follow-up.

Preventing Missing Data Begins in the Protocol

The strongest missing-data strategy is often operational rather than statistical.

Protocol planning can include:

  • Flexible visit windows
  • Remote assessments where scientifically appropriate
  • Transportation assistance
  • Reminder systems
  • Retention plans
  • Clear instructions for missed visits
  • Collection of outcome data after treatment discontinuation when relevant
  • Training sites to document reasons for missingness
  • Procedures for contacting participants who miss visits

The goal is not simply to increase the number of completed visits. The goal is to preserve the ability of the trial to answer its intended scientific question.

Collect the Reason for Missingness

“Lost to follow-up” is often too vague to be analytically useful.

A more informative classification might distinguish:

ReasonPotential implication
Adverse eventMissingness may be related to tolerability and future outcome
Lack of efficacyMissingness may be related to poor treatment response
Patient burdenMay be associated with treatment or trial logistics
Administrative errorPotentially unrelated to patient outcome
Moved awayMay be unrelated, depending on context
Withdrawal of consentReason should be documented where ethically and operationally appropriate
DeathRequires separate clinical ascertainment

These categories help investigators understand whether the observed missingness pattern is clinically informative.

Missing Data Should Be Summarized by Treatment Arm

A useful clinical-trial missing-data table should show counts and percentages by treatment arm, and often by visit.

VisitExperimental MissingExperimental NControl MissingControl N
Baseline01000100
Week 431002100
Week 851004100
Week 1281005100
Week 24171009100

The table suggests increasing attrition and a potentially important difference between treatment groups. The numbers alone do not prove bias, but they should trigger review of reasons and patterns.

Patterns by Subgroup

Missingness can also differ by:

  • Age group
  • Disease severity
  • Geographic region
  • Site
  • Baseline prognostic factors
  • Prior treatment history
  • Biomarker subgroup

This matters because a missing-data method can perform differently if the missingness process differs substantially across clinically important subgroups.

Observed Versus Missing Outcome Distributions

One useful exploratory strategy is to compare the observed outcome history of patients who later become missing with that of patients who remain observed.

For example, compare Week 8 outcomes between:

  • Patients with a Week 24 measurement
  • Patients without a Week 24 measurement

If the missing group already has markedly worse Week 8 outcomes, an assumption that their future outcomes are identical to those of completers may be questionable.

Missing Data and the Treatment Effect

Suppose the treatment effect is defined as:

$$ \Delta = \mu_T-\mu_C $$

If missing values are systematically different from observed values, the estimate based only on observed outcomes can be written conceptually as:

$$ \hat\Delta_{\mathrm{obs}} = \bar Y_{T,\mathrm{obs}} - \bar Y_{C,\mathrm{obs}} $$

while the estimand may require:

$$ \Delta = E(Y_T)-E(Y_C) $$

The missing-data problem is therefore the gap between what is observed and what is required to estimate the target population-level quantity.

Primary Analysis and Sensitivity Analysis Are Different Jobs

The primary analysis should estimate the prespecified estimand using a method supported by clinically plausible assumptions.

Sensitivity analyses ask whether the conclusion survives plausible alternative assumptions.

AnalysisMain purpose
Primary analysisEstimate the prespecified estimand
Supportive analysisCheck consistency using a different reasonable estimator
Sensitivity analysisAssess robustness to plausible missing-data assumptions
Tipping-point analysisDetermine how much departure from the primary assumption would overturn the conclusion

Do Not Choose Sensitivity Analyses After Seeing the Result

If a sponsor chooses only sensitivity analyses that preserve statistical significance, the exercise is not a meaningful robustness assessment.

The SAP should therefore describe:

  • Which assumptions will be examined
  • Which sensitivity estimators will be used
  • How missing outcomes will be shifted or modeled
  • Which covariates will be included
  • How intercurrent events will be treated
  • How conclusions will be summarized

A Practical Sensitivity-Analysis Grid

A
Primary MAR analysis: prespecified model or likelihood-based analysis.
B
Alternative MAR analysis: change model specification or covariance assumptions.
C
MNAR delta adjustment: impose clinically plausible worsening or improvement after missingness.
D
Pattern-mixture analysis: vary assumptions by missingness pattern.
E
Reference-based analysis: model post-discontinuation behavior using a clinically justified reference trajectory.
F
Tipping point: identify the assumption at which the regulatory conclusion changes.

What Is a Good Sensitivity Analysis?

A good sensitivity analysis should be:

  • Clinically plausible: it represents a scenario that could reasonably occur.
  • Transparent: the assumptions can be explained to a reviewer.
  • Relevant: it addresses a weakness in the primary assumption.
  • Prespecified: it is not selected solely because of the observed result.
  • Interpretable: the reader can understand what departure from the primary assumption it represents.

Example: A Continuous Endpoint

Suppose a randomized trial has:

  • 200 patients
  • 100 per arm
  • Week 24 continuous endpoint
  • 15% missing in the experimental arm
  • 8% missing in control

The primary analysis estimates:

$$ \hat\Delta=-5.0 $$

Suppose the 95% confidence interval is:

$$ (-8.7,-1.3) $$

A sensitivity analysis might progressively worsen the assumed outcomes for missing experimental-arm patients until the confidence interval includes zero.

If this requires an implausibly large departure from the observed data, confidence in robustness is strengthened.

Example: Binary Response Endpoint

Suppose:

ExperimentalControl
Randomized150150
Observed responders6040
Missing response assessment155

An observed-case analysis could be:

$$ ORR_T=\frac{60}{135}=44.4\% $$
$$ ORR_C=\frac{40}{145}=27.6\% $$

But if missing patients differ systematically, these percentages may not represent the intended estimand.

A sensitivity analysis can examine assumptions ranging from all missing experimental patients being responders to all being nonresponders, along with more clinically realistic model-based assumptions.

Handling Treatment Discontinuation

Treatment discontinuation is one of the most important sources of missing efficacy data.

A strong analysis plan distinguishes:

  • Why the patient discontinued
  • Whether outcome assessments continued
  • Whether rescue medication was initiated
  • Whether the estimand is treatment-policy, hypothetical, while-on-treatment, or another strategy

For example, if the estimand is treatment policy, continued outcome collection after treatment discontinuation may be particularly important. If the estimand is while-on-treatment, the analysis may intentionally focus on outcomes before a defined intercurrent event.

Withdrawal of Consent

Withdrawal of consent creates an ethical and operational boundary. Once a participant withdraws consent for further research participation, the sponsor cannot simply assume that additional outcome data will be available.

The protocol and informed-consent process should therefore anticipate the possibility of early withdrawal and define what information may still be collected where legally and ethically permitted.

Death Is Not Just Another Missing Value

If a patient dies before a planned endpoint, treating the endpoint as a generic missing continuous value can be scientifically inappropriate.

Death may be an intercurrent event that changes the meaning of the endpoint. The correct strategy depends on the estimand and disease context.

For example, in some settings death may be incorporated as a failure, while in others the scientific question may require a composite endpoint or a competing-risk framework.

Key lesson: The statistical treatment of a death should follow the clinical question, not a generic “missing-value” rule.

Rescue Medication

Rescue medication can create a similar issue.

Suppose a patient receives rescue therapy because the assigned treatment is not controlling the disease.

The post-rescue outcome is not merely “missing” if the rescue therapy changes what the outcome means.

The analysis should first define the estimand strategy for rescue treatment and then address any missing observations created by the event.

Estimand Strategy and Missing Data Should Agree

Estimand strategyConceptual questionMissing-data implication
Treatment policyWhat happens after the intercurrent event under continued observation?Continue collecting outcome data when possible; analyze according to the treatment-policy estimand.
HypotheticalWhat would have happened had the intercurrent event not occurred?Requires assumptions about the counterfactual outcome.
While on treatmentWhat is the effect while patients remain on assigned treatment?Post-event outcomes may be outside the primary target, depending on the precise definition.
CompositeWhat is the effect when the intercurrent event is incorporated into the endpoint?Event status may be part of the endpoint rather than missingness.
Principal stratumWhat is the effect in a subgroup defined by potential response to the intercurrent event?Usually requires strong assumptions and specialized methods.

FDA-Oriented Data Review

A regulatory reviewer is likely to ask questions such as:

  • How much data are missing?
  • Is missingness balanced across treatment groups?
  • When does missingness occur?
  • Why are patients missing?
  • Are missingness reasons related to treatment efficacy or safety?
  • What outcome information was collected after treatment discontinuation?
  • What assumptions support the primary analysis?
  • What happens if those assumptions are violated?
  • Does the treatment conclusion remain consistent?

Missing Data in the Statistical Analysis Plan

A strong SAP section should define, at minimum:

  • The estimand for the key endpoint
  • Intercurrent-event strategies
  • The primary estimator
  • The analysis population
  • Baseline and covariate definitions
  • The primary missing-data assumption
  • How missing observations contribute to the primary analysis
  • How missingness reasons will be summarized
  • Prespecified sensitivity analyses
  • Any imputation model and its variables
  • Any MNAR or reference-based assumptions
  • Rules for post-rescue or post-discontinuation data

Recommended SAP Structure

1. Estimand
   1.1 Treatment
   1.2 Population
   1.3 Variable
   1.4 Intercurrent-event strategies
   1.5 Population-level summary

2. Primary analysis
   2.1 Analysis population
   2.2 Statistical model
   2.3 Covariates
   2.4 Variance/covariance assumptions
   2.5 Missing-data assumption

3. Missing-data prevention
   3.1 Retention procedures
   3.2 Continued outcome collection
   3.3 Documentation of reasons

4. Sensitivity analyses
   4.1 Alternative model
   4.2 Pattern-mixture analysis
   4.3 Delta adjustment
   4.4 Reference-based analysis
   4.5 Tipping-point analysis

5. Reporting
   5.1 Missing-data summaries
   5.2 Disposition
   5.3 Reasons for missingness
   5.4 Primary and sensitivity results

Data Standards and Analysis Dataset Considerations

In a CDISC-oriented development program, the missing-data strategy should remain traceable from collected observations through analysis datasets and tables, listings, and figures.

Useful analysis variables may include:

VariablePurpose
USUBJIDUnique subject identifier
TRT01PPlanned treatment assignment
AVISIT / AVISITNAnalysis visit
ADT / ADYAnalysis date and relative day
AVALAnalysis value
ABLFL / BASEBaseline identification or baseline value
DTYPEDerived-data or imputation indicator, when applicable
PARAM / PARAMCDEndpoint identification

The exact variables and derivations depend on the study and analysis datasets. The key requirement is traceability: the reviewer should be able to understand how the final analysis was constructed from the observed clinical-trial data.

R Example: Missingness by Visit

A simple exploratory summary can calculate the percentage of patients without an observed endpoint at each visit.

library(dplyr)
library(ggplot2)

missing_by_visit <- adsl %>%
  group_by(TRT01P, AVISITN, AVISIT) %>%
  summarise(
    N = n(),
    Missing = sum(is.na(AVAL)),
    PctMissing = 100 * Missing / N,
    .groups = "drop"
  )

ggplot(
  missing_by_visit,
  aes(
    x = AVISITN,
    y = PctMissing,
    group = TRT01P,
    color = TRT01P
  )
) +
  geom_line(linewidth = 0.9) +
  geom_point(size = 2) +
  labs(
    x = "Analysis Visit",
    y = "Missing Endpoint (%)",
    color = "Treatment"
  ) +
  theme_classic()

R Example: Multiple Imputation

For a continuous endpoint, a simple multiple-imputation workflow can be implemented with packages such as mice. The actual imputation model must be aligned with the study estimand and SAP.

library(mice)

imp <- mice(
  analysis_data,
  m = 50,
  method = "pmm",
  seed = 20260911
)

fit <- with(
  imp,
  lm(
    CHANGE24 ~ TRT01P + BASELINE + AGE
  )
)

pooled <- pool(fit)

summary(pooled, conf.int = TRUE)

This example illustrates software mechanics only. It should not be copied into a regulated analysis without specifying the estimand, imputation model, auxiliary variables, treatment of intercurrent events, diagnostics, and sensitivity analyses.

R Example: A Simple Delta-Adjustment Sensitivity Analysis

A delta adjustment can be conceptualized by shifting imputed outcomes after a primary MAR imputation.

# Conceptual example only

imputed_data$Y24_MNAR <-
  imputed_data$Y24_MAR + delta

fit_mnar <- lm(
  Y24_MNAR ~ TRT01P + BASELINE,
  data = imputed_data
)

summary(fit_mnar)

In a real analysis, the shift may differ by treatment, missingness pattern, visit, or event history, and the imputation and analysis should be combined using an appropriate multiple-imputation framework.

R Example: Tipping-Point Grid

deltas <- seq(
  -5, 5,
  by = 0.5
)

results <- lapply(
  deltas,
  function(delta) {

    # Re-impute under the specified delta
    # Fit the prespecified analysis model
    # Return the treatment estimate and CI

    data.frame(
      delta = delta,
      estimate = NA_real_,
      lower = NA_real_,
      upper = NA_real_
    )
  }
)

results <- do.call(
  rbind,
  results
)

The missing portion of the example is intentional: the correct code depends on the endpoint, imputation model, estimand, and primary analysis model.

Common Statistical Mistakes

  1. Using complete cases without assessing why patients are missing.
  2. Using LOCF as a default simply because it is easy to implement.
  3. Calling an analysis “MAR” without describing the variables and model supporting the assumption.
  4. Calling an MNAR analysis “conservative” without explaining the clinical meaning of the assumption.
  5. Ignoring treatment discontinuation when defining the estimand.
  6. Confusing an intercurrent event with missing data.
  7. Performing sensitivity analyses that are not clinically plausible.
  8. Changing the missing-data method after seeing the primary result without justification.
  9. Failing to report differential missingness between treatment groups.
  10. Failing to collect reasons for missed visits and discontinuations.

Common Regulatory-Review Mistakes

  1. Reporting only the percentage missing. The reasons and timing matter.
  2. Claiming randomization solves missing-data bias. It does not guarantee random dropout.
  3. Presenting one sensitivity analysis as proof of robustness. Robustness is stronger when clinically plausible alternatives have been considered.
  4. Ignoring post-treatment data that are relevant to the estimand.
  5. Using inconsistent estimands across primary and sensitivity analyses.
  6. Failing to explain the clinical interpretation of the missing-data assumption.

Quality-Control Checklist

1
Confirm the target estimand.
2
List all important intercurrent events.
3
Confirm how outcome data are collected after treatment discontinuation.
4
Summarize missingness by treatment and visit.
5
Review reasons for missingness.
6
Compare observed histories of patients with and without later observations.
7
Confirm the primary analysis assumption.
8
Validate the imputation or likelihood model.
9
Run prespecified sensitivity analyses.
10
Determine whether the clinical conclusion is robust.

How to Present Missing Data in a Clinical Study Report

A clear CSR presentation should include both disposition and statistical summaries.

CSR ComponentWhat to Show
Patient dispositionRandomized, treated, completed, discontinued, and reasons
Missing endpoint summaryCounts and percentages by treatment and relevant visit
Reasons for missingnessClinical and operational reasons
Primary analysisEstimator, assumptions, estimate, CI, and p-value where applicable
Sensitivity analysesAlternative plausible assumptions and resulting estimates
InterpretationWhether the treatment conclusion is robust

Example CSR Language

Example: Missing endpoint data were summarized by treatment group and scheduled assessment. The primary analysis was based on the prespecified estimand and model using all available data under the stated missing-data assumptions. Reasons for treatment discontinuation and missing assessments were reviewed by treatment group. Sensitivity analyses evaluated the robustness of the primary result under alternative clinically plausible assumptions regarding outcomes after missingness. The direction and magnitude of the treatment effect were consistent across the prespecified analyses.

When the Primary and Sensitivity Analyses Disagree

Disagreement is not necessarily a failure of the trial.

It is information about the uncertainty created by missing data.

Suppose the primary MAR analysis favors treatment, but a clinically plausible MNAR sensitivity analysis removes the effect.

The appropriate conclusion is not that one analysis is automatically correct. Instead, the report should explain:

  • What assumptions differ
  • Why the primary assumption was selected
  • Why the sensitivity assumption is plausible
  • How much missing data are involved
  • Whether missingness is differential by treatment
  • How the overall evidence should be interpreted

How Much Missing Data Is Too Much?

There is no universal percentage at which missing data suddenly become unacceptable.

A 5% missing-data rate can be problematic if all missing patients are concentrated in one clinically important subgroup for a reason related to treatment efficacy.

Conversely, a larger percentage may be less damaging if the missingness is well understood, balanced, and appropriately addressed under a credible estimand and analysis strategy.

$$ \text{Impact of missingness} \neq f(\text{missing percentage alone}) $$

Missing Data and Sample-Size Planning

Missingness should be considered when planning sample size, but simply inflating the sample size does not solve bias.

If the expected completer fraction is \(c\), a simple planning adjustment may be:

$$ N_{\mathrm{recruit}} = \frac{N_{\mathrm{required}}}{c} $$

For example, if 90% of randomized participants are expected to provide the information required for the primary analysis:

$$ N_{\mathrm{recruit}} = \frac{N_{\mathrm{required}}}{0.90} $$

This protects precision against attrition but does not guarantee unbiased inference.

Operational Monitoring of Missing Data

Missing-data prevention should continue during the trial rather than being left to the statistician at database lock.

Useful monitoring metrics include:

  • Missed visits per site
  • Visit completion rates by treatment
  • Time to recovery after missed visits
  • Early discontinuation rates
  • Reasons for discontinuation
  • Assessment completion by region
  • Assessment completion by important subgroup

Monitoring should be designed so that operational interventions do not compromise trial integrity or introduce differential treatment of participants.

Missing Data and Blinding

The collection and review of missing-data information should be handled in a way that respects the trial's blinding and operational controls.

For example, site-level retention monitoring can often be performed without revealing treatment assignment.

If unblinded access is required for a particular monitoring purpose, the process should be prespecified and governed appropriately.

What FDA Reviewers May Consider When Evaluating Robustness

A robust package generally connects:

A
Design: Was missingness anticipated and minimized?
B
Conduct: Were reasons for missingness documented and follow-up maintained?
C
Estimand: Is the treatment effect clearly defined?
D
Primary analysis: Is the estimator appropriate under its assumptions?
E
Sensitivity: Does the conclusion survive plausible alternative assumptions?
F
Interpretation: Is uncertainty clearly communicated?

Practical Decision Tree

A useful way to approach a new missing-data problem is:

1
What is the clinical question and estimand?
2
What intercurrent events can occur?
3
Can outcome data still be collected after those events?
4
What are the observed missingness patterns and reasons?
5
What assumption supports the primary analysis?
6
What clinically plausible violations of that assumption should be tested?
7
Would those violations change the regulatory conclusion?

Three Questions to Ask Before Choosing an Imputation Method

  1. What estimand am I estimating?
  2. What assumption about the unobserved outcomes am I making?
  3. How will I demonstrate robustness if that assumption is wrong?

If those questions cannot be answered clearly, choosing an imputation method is premature.

What Not to Say

Avoid vague statements such as:

  • “Missing values were imputed conservatively.”
  • “LOCF was used to avoid bias.”
  • “The missing data were assumed to be random.”
  • “The results were robust because the sensitivity analysis was significant.”

Instead, describe the assumption mathematically or clinically.

Better Reporting Language

For example:

Preferred style: The primary analysis assumes that, conditional on the observed outcome history and prespecified baseline covariates, the distribution of the unobserved endpoint is adequately represented by the observed-data model. Sensitivity analyses imposed increasingly unfavorable assumptions on outcomes after missingness to evaluate the robustness of the treatment effect.

Relationship to ICH E9(R1)

The modern regulatory framework is best understood as an integrated estimand-and-sensitivity-analysis framework.

ICH E9(R1) emphasizes that the estimand defines the treatment effect of interest, while the estimator is the method used to estimate it. Missing data and intercurrent events are therefore not isolated programming problems; they are part of the specification of the scientific question.

FDA materials have emphasized the same general direction: relevant data should be collected where possible, missingness should be minimized, assumptions should be documented, and sensitivity analyses should examine the robustness of conclusions.

FDA, NRC, and ICH: How the Pieces Fit Together

SourcePrimary contribution
FDA statistical practiceRegulatory expectations for trial design, prevention, analysis, assumptions, and robustness
NRC 2010 reportFramework for prevention and treatment of missing data in clinical trials
ICH E9Core statistical principles for clinical trials
ICH E9(R1)Formal estimand framework and stronger connection between estimands and sensitivity analysis
Endpoint-specific FDA guidanceClinical context and additional expectations for particular indications and endpoints

Current Regulatory Perspective

FDA's Office of Biostatistics describes prevention and treatment of missing data as part of the statistical evaluation of clinical trials and also highlights evaluation of assumptions of statistical methods and robustness of trial findings.

Recent FDA materials continue to emphasize prespecification of estimands, analysis approaches, missing-data assumptions, and sensitivity analyses. This means that missing-data planning should be treated as part of trial design rather than a database-lock cleanup exercise.

A Practical Missing-Data Analysis Plan

1
Define the estimand and intercurrent-event strategies.
2
Identify likely sources of missingness during protocol development.
3
Build retention and continued-assessment procedures.
4
Collect and classify reasons for missingness.
5
Summarize missingness by treatment, visit, and important subgroups.
6
Specify the primary estimator and its assumptions.
7
Specify clinically plausible sensitivity analyses.
8
Validate all analysis datasets and derivations.
9
Compare primary and sensitivity conclusions.
10
Document limitations and residual uncertainty.

Final Checklist for a Regulatory Submission

QuestionCheck
Is the estimand clearly defined?Yes / No
Are important intercurrent events identified?Yes / No
Were efforts made to minimize missing data?Yes / No
Were reasons for missingness collected?Yes / No
Is missingness summarized by treatment and time?Yes / No
Is the primary missing-data assumption explicit?Yes / No
Is the primary estimator appropriate for the estimand?Yes / No
Are sensitivity analyses prespecified?Yes / No
Do sensitivity analyses reflect clinically plausible departures?Yes / No
Does the overall conclusion remain interpretable under those assumptions?Yes / No

The Most Important Concept

The most important lesson is that missing data are not primarily an imputation problem.

They are a trial-design, clinical, estimand, and statistical-inference problem.

A sophisticated imputation method cannot rescue a trial in which the reasons for missingness were never documented, important post-discontinuation data were not collected, or the scientific estimand was never defined.

Conversely, a trial with carefully designed retention procedures, continued outcome collection, transparent missingness documentation, a coherent primary estimator, and clinically credible sensitivity analyses can provide much stronger evidence even when some data remain missing.

Bottom line: FDA's practical expectation is not “find the best imputation method.” The stronger principle is to minimize missing data, understand why they occur, align the analysis with the estimand, make assumptions explicit, prespecify sensitivity analyses, and show whether the clinical conclusion is robust to plausible departures from those assumptions.

References and Regulatory Resources

U.S. Food and Drug Administration. Office of Biostatistics. Statistical review principles include prevention and treatment of missing data and evaluation of statistical assumptions.

National Research Council. (2010). The Prevention and Treatment of Missing Data in Clinical Trials. National Academies Press. This report was commissioned by FDA and remains a foundational reference for the prevention and treatment of missing data.

ICH. E9(R1) Addendum on Estimands and Sensitivity Analysis in Clinical Trials. The addendum provides the modern framework linking estimands, intercurrent events, estimators, and sensitivity analyses.

ICH. E9 Statistical Principles for Clinical Trials.

FDA. Endpoint- and indication-specific guidances should also be consulted because recommendations for missing data can differ according to the clinical setting, endpoint, and trial design.

Useful official resources: