Tutorials › Multiple Imputation by Chained Equations (MICE) › Checking Survival Predictors in Covariate Imputation

Survival and Time-Varying Data · Tutorial 391 of 497

Checking Survival Predictors in Covariate Imputation

Assess whether survival information is represented plausibly in imputed covariates by checking associations, distributions, and stability across completed datasets.

Advanced 12 min read

What You'll Learn

  • Explain the diagnostic role of event status and cumulative hazard in covariate imputation.
  • Compare covariate–survival associations among observed records and completed datasets.
  • Calculate and interpret differences in event proportions and cumulative-hazard summaries.
  • Identify signs of unstable chains, distorted associations, and inadequate overlap.
  • Distinguish useful diagnostics from evidence that missingness assumptions are true.

Why Check Survival Predictors After Imputation?

When a covariate is incomplete in a survival analysis, its imputation model should retain information about the observed survival outcome. Event status and cumulative-hazard summaries can carry different information: event status distinguishes observed events from censoring, while cumulative hazard summarizes the event experience associated with follow-up. Including them as predictors is not enough by itself. The imputed values should also show sensible relationships with those predictors.

This tutorial focuses on checking those relationships after chained-equation imputation. The checks are diagnostic, not a test that proves the imputation model is correct. In particular, close agreement between observed and completed-data associations cannot establish that the missingness mechanism is ignorable.

Definition: For person \(i\), let \(Y_i=\min(T_i,C_i)\) denote observed follow-up time, where \(T_i\) is event time and \(C_i\) is censoring time. Let \(\delta_i=1\) indicate an observed event and \(\delta_i=0\) indicate censoring. Let \(H_i(t_k)\) denote a cumulative-hazard summary evaluated at a chosen time \(t_k\). A survival-predictor check examines whether an imputed covariate \(X_i\) has plausible associations with \(\delta_i\), \(H_i(t_k)\), and, where appropriate, other observed covariates.

The checks assume that event status, follow-up time, and the hazard summaries were constructed consistently from the observed survival records, and that the selected cumulative-hazard evaluation times are appropriate for the analysis. Estimating a population cumulative hazard also relies on suitable censoring assumptions for the estimator used. The imputation model must be specified for the covariate type, include the survival predictors needed by the analysis, and represent important nonlinearities or interactions when they are plausible. Conventional MICE inference also relies on an adequate missingness assumption, commonly that missingness is conditionally independent of the missing values given the variables in the imputation model. Diagnostics cannot verify that assumption.

What Relationships Should Be Examined?

Start with the scientific and statistical structure of the analysis. If a covariate is expected to be associated with event occurrence, follow-up experience, or both, examine whether that relationship appears in the completed data. Useful summaries include event proportions by covariate group, differences in mean cumulative hazard by group, and regression relationships between a continuous covariate and survival predictors. Use the same definitions and scales across observed and completed records.

Comparisons need care. The observed covariate values form a selected subset whenever missingness is present, so their associations need not equal the associations in the full population. Compare observed records with imputed records as a diagnostic of possible incompatibility, not as two random samples that must match exactly. Also examine each completed dataset, rather than relying only on a single average: averaging can hide an imputation that produces an implausibly weak or strong relationship.

Worked Example: Comparing Event Proportions

Suppose a hypothetical cohort has 100 people and an incomplete binary covariate \(X\). In one completed dataset, 40 people have \(X=1\), of whom 24 experienced an event; 60 have \(X=0\), of whom 18 experienced an event. Among the 50 people whose \(X\) was observed, the corresponding counts are 20 people with \(X=1\) and 12 events, and 30 people with \(X=0\) and 9 events. Compare the event proportions.

For the completed dataset, the event proportions are

$$ \hat p_{\delta=1\mid X=1}=\frac{24}{40}=0.600,\qquad \hat p_{\delta=1\mid X=0}=\frac{18}{60}=0.300. $$

The difference is \(0.600-0.300=0.300\), or 30 percentage points. Among records with observed \(X\), the proportions are \(12/20=0.600\) and \(9/30=0.300\), also a 30-percentage-point difference. In this hypothetical example, the event-status association is similar in the observed subset and the completed dataset. That is reassuring as a basic check, but the equality does not prove that the imputation model is correct: the subset is small, the comparison is unadjusted, and other aspects of the covariate distribution may still be problematic.

For a continuous covariate, compare its distribution across event-status groups and examine its relationship with cumulative hazard. A difference in group means can be a transparent first check, but it is not a substitute for checking distributions or conditional associations. If the relationship is nonlinear, a single slope or mean difference may conceal important departures. When the substantive analysis includes interactions or nonlinear terms, the diagnostic should look for their preservation as well.

Worked Example: Comparing Cumulative-Hazard Summaries

In a second hypothetical cohort, \(X\) is a binary covariate and \(H_i(t_k)\) is a cumulative-hazard summary at a prespecified evaluation time. Among records with observed \(X\), the mean \(H_i(t_k)\) is 0.40 for \(X=1\) (\(n=20\)) and 0.25 for \(X=0\) (\(n=30\)). Among records whose \(X\) was imputed, the respective means are 0.46 (\(n=12\)) and 0.22 (\(n=18\)). Calculate and compare the differences.

The observed-record difference is \(0.40-0.25=0.15\). The imputed-record difference is \(0.46-0.22=0.24\). The imputed-record contrast is therefore larger by \(0.24-0.15=0.09\) cumulative-hazard units. To see the corresponding completed-data group means, combine the observed and imputed records within each \(X\) group:

$$ \bar H_{X=1}=\frac{20(0.40)+12(0.46)}{32} =\frac{13.52}{32}=0.4225, \qquad \bar H_{X=0}=\frac{30(0.25)+18(0.22)}{48} =\frac{11.46}{48}=0.2388. $$

The completed-data difference is \(0.4225-0.23875=0.18375\), which rounds to \(0.1838\). The stronger contrast in the imputed records deserves investigation, but it is not automatically evidence of failure: only 12 and 18 imputed records contribute to those means, and missingness may select records with different outcome patterns. Inspect the distributions, uncertainty, and patterns across all completed datasets before deciding whether the association is implausible.

A Conditional-Mean Justification

The reason to check both event status and cumulative hazard can be made explicit using a simple model. Suppose, for illustration, that a continuous covariate has conditional mean

$$ E(X_i\mid \delta_i,H_i(t_k),Z_i) =\beta_0+\beta_\delta\delta_i+\beta_H H_i(t_k)+\beta_Z^\mathsf{T}Z_i, $$

where \(Z_i\) denotes other predictors. This linear form is only an illustration; the appropriate imputation model depends on the covariate type and data structure. At fixed \(H_i(t_k)\) and \(Z_i\), the model implies a difference of \(\beta_\delta\) in the conditional mean of \(X_i\) between event and censored records. At fixed event status and \(Z_i\), changing cumulative hazard from \(h_1\) to \(h_2\) changes the conditional mean by \(\beta_H(h_2-h_1)\).

If the imputation model omits a survival predictor whose conditional association with \(X_i\) is nonzero, it cannot represent that part of the conditional mean. In the simple case with no \(Z_i\), omitting the outcome predictors makes the imputed draws independent of them under the imputation model. Consequently, among records whose \(X_i\) is imputed, the model may fail to reproduce the association present in the data. This is why post-imputation checks should consider both the association in imputed records and the overall completed-data association.

Worked Example: Checking Associations Across Imputations

Suppose five hypothetical completed datasets each contain 100 people. In the records with observed \(X\), the event proportions were 0.60 for \(X=1\) and 0.30 for \(X=0\), a difference of 0.30. Across the five completed datasets, the event-proportion differences are 0.30, 0.27, 0.33, 0.29, and 0.29. Calculate their average and range.

The average difference is

$$ \frac{0.30+0.27+0.33+0.29+0.29}{5} =\frac{1.48}{5}=0.296. $$

The range is \(0.33-0.27=0.06\), and the observed-record difference of 0.30 lies within it. Here, the average association is close to the observed-record association and the variation across imputations is modest. This is a useful consistency check, not a formal acceptance criterion. A broad range, systematic drift over iterations, or repeated large departures from the observed relationship would prompt review of the model, convergence, and imputation procedure.

Diagnostics, Alternatives, and Failure Modes

Use several views of the imputed data rather than a single number. For each completed dataset, inspect covariate distributions separately for observed and imputed records; compare event proportions or cumulative-hazard summaries across covariate groups; and check whether these patterns vary substantially across imputations. For iterative algorithms, inspect trace summaries such as the mean or proportion of imputed values over iterations. A stable trace does not establish model adequacy, but a persistent trend or chains settling at markedly different levels is a warning that the draws may not have stabilized.

Also look for signs that the imputation model is being asked to extrapolate. If one covariate group has very few events, or if particular combinations of event status and cumulative hazard are absent among records with observed covariates, estimates for those combinations may be weakly supported. Extreme imputed values, implausible category frequencies, or sharply different associations among imputations are further reasons to investigate. Recheck predictor coding, the treatment of nonlinear relationships, the choice and construction of hazard summaries, and whether the model has enough information for the patterns of missingness.

The main alternatives are not interchangeable. Omitting survival information is simpler but can lose outcome-related structure. Including event status alone preserves a status association but may not represent variation in follow-up experience. Including a cumulative-hazard summary alone may fail to distinguish events from censoring adequately. Including both, when justified by the analysis and correctly specified, is a common strategy; it still requires diagnostics. A substantive joint-modeling approach is another broad alternative, but it involves a different modeling framework and is not validated merely by passing the checks described here.

These diagnostics have important limits. The observed subset may differ systematically from the records with missing covariates, so exact agreement is not generally expected. Marginal agreement can also hide a distorted conditional association, and agreement in one completed dataset can hide instability in others. Most importantly, no plot, summary, or association check can establish that the missingness mechanism is ignorable or that unmeasured predictors are irrelevant.

Common pitfall: “The event proportions are almost identical before and after imputation, so the imputation model must be correct.” This reasoning is too strong. Similar proportions are one useful diagnostic, but they do not assess every conditional relationship, convergence, distributional feature, or missingness assumption. Examine multiple summaries and completed datasets, then interpret them in light of the substantive model.

Check Your Understanding

Answer each question using the definitions and diagnostic logic above.

  1. In a completed dataset, 15 of 25 people with \(X=1\) experienced an event, compared with 12 of 40 people with \(X=0\). What are the event proportions and their difference?
  2. Observed-\(X\) records have mean cumulative hazard 0.31 in one group and 0.20 in another. Imputed-\(X\) records have means 0.38 and 0.19. What are the two group differences, and what is one cautious interpretation?
  3. Why might an imputation model that includes event status but omits cumulative hazard still fail to preserve a useful survival association?
  4. Does close agreement between observed-record and completed-data associations prove that the missingness mechanism is ignorable? Explain.

Solutions. (1) The proportions are \(15/25=0.600\) and \(12/40=0.300\); their difference is \(0.600-0.300=0.300\), or 30 percentage points. (2) The observed-record difference is \(0.31-0.20=0.11\); the imputed-record difference is \(0.38-0.19=0.19\). The imputed-record association is stronger by \(0.08\) cumulative-hazard units, which merits investigation but may reflect sampling variation or selection into missingness. (3) Event status distinguishes event from censoring, but cumulative hazard can summarize differences in follow-up experience not represented by status alone. (4) No. Agreement is a limited diagnostic and cannot establish the missingness assumption or rule out distortions in other relationships.

Clinical Biostats