Tutorials › Multiple Imputation by Chained Equations (MICE) › Why The Finite-Number Correction Matters

Rubin's Rules and Pooling · Tutorial 58 of 497

Why The Finite-Number Correction Matters

Learn to calculate the finite-number contribution to Rubin’s total variance and judge its practical size without confusing it with the between-imputation variance itself.

Intermediate 9 min read

What You'll Learn

  • Identify the added \(B/M\) contribution in Rubin’s total variance.
  • Explain why a finite number of imputations adds uncertainty to the pooled estimate.
  • Calculate how the correction changes pooled variance and standard error.
  • Compare the correction’s size across different numbers of imputations and values of \(B\).
  • Use a relative-variance calculation to assess practical importance.
  • Recognize when poor imputation draws can make the correction misleading.

Why a Finite Number of Imputations Adds Uncertainty

Rubin’s pooled estimate averages estimates from \(M\) completed datasets. That average is itself based on a finite collection of imputations: if a different set of imputations had been drawn, the pooled estimate would generally differ. Rubin’s total variance includes an explicit contribution for this finite-number uncertainty. It is the factor \(1+1/M\) multiplying the between-imputation variance.

The factor matters most when the between-imputation variation is substantial and \(M\) is small. It does not change the pooled point estimate, and it does not replace the between-imputation variance. Instead, it adds \(B/M\) to the variance already made up of within-imputation and between-imputation components.

Definition: For \(M\) imputations, let \(Q_m\) be the estimate from completed dataset \(m\), and let \(U_m\) be its estimated variance. The pooled estimate is \(\bar{Q}=\sum_{m=1}^M Q_m/M\). The pooled within-imputation variance is \(\bar{U}=\sum_{m=1}^M U_m/M\), and the between-imputation variance is \(B=\sum_{m=1}^M(Q_m-\bar{Q})^2/(M-1)\). Rubin’s total variance is \(T=\bar{U}+(1+1/M)B\), or equivalently \(T=\bar{U}+B+B/M\).

Here, \(T\), \(\bar{U}\), and \(B\) are variances, measured in squared units of the estimate. Their square roots are standard errors, in the units of the estimate. The term \(B\) represents variation among the estimates across imputations. The additional term \(B/M\) is the finite-number contribution. Since \(B\) is estimated from the \(M\) estimates, the term is larger relative to \(B\) when fewer imputations are used.

Justifying the Finite-Number Contribution

The distinction is between uncertainty in the missing-data problem and uncertainty from using only a finite number of imputations to represent it. Even if the imputation procedure is appropriate, a finite set of completed datasets only approximates the distribution of possible completed-data estimates. The pooled estimate \(\bar{Q}\) is therefore subject to simulation variation across possible sets of imputations.

Under the usual Rubin pooling conditions—proper imputations, variance estimates \(U_m\) appropriate for their completed-data analyses, and draws that adequately represent the imputation distribution—the between-imputation variance estimates the variation associated with missing data. The variance of a mean formed from \(M\) effectively independent draws is approximately the variance of one draw divided by \(M\). Thus, the finite collection contributes approximately \(B/M\). Combining the within-imputation variance, the missing-data component, and the finite-number component gives:

$$ T \approx \bar{U}+B+\frac{B}{M} =\bar{U}+\left(1+\frac{1}{M}\right)B. $$

This is a justification of the standard pooling formula, not a guarantee that the formula will repair an inadequate imputation model. In MICE, imputations must be representative of the intended imputation distribution. If the chained-equation process has not mixed adequately, or the resulting imputations are strongly dependent, the simple \(B/M\) calculation may not describe the actual simulation error well. The rule presumes suitable imputations; it does not diagnose whether that presumption holds.

Worked Example: Calculating the Added Variance

Suppose a hypothetical analysis estimates a treatment contrast in days of symptom-free time. Five imputations give estimates \(48, 52, 50, 54,\) and \(46\) days. Suppose their pooled within-imputation variance is \(\bar{U}=9\) days\(^2\). Calculate the between-imputation variance, total variance with the finite-number correction, and the total variance if the correction were omitted.

The pooled estimate is \(\bar{Q}=(48+52+50+54+46)/5=50\) days. The squared deviations from 50 are \(4,4,0,16,\) and \(16\) days\(^2\). Therefore:

$$ B=\frac{4+4+0+16+16}{5-1} =\frac{40}{4}=10\ \text{days}^2. $$

With \(M=5\), the finite-number contribution is \(B/M=10/5=2\) days\(^2\). Hence:

$$ T=9+\left(1+\frac{1}{5}\right)10 =9+12=21\ \text{days}^2. $$

If the factor were incorrectly omitted, the result would be \(\bar{U}+B=9+10=19\) days\(^2\). The corresponding standard errors are \(\sqrt{21}\approx4.583\) days with the correction and \(\sqrt{19}\approx4.359\) days without it. In this example, omitting the correction understates the pooled variance by 2 days\(^2\).

How the Size Changes with \(M\) and \(B\)

For a fixed \(B\), the added variance \(B/M\) decreases in inverse proportion to \(M\). Doubling the number of imputations halves this particular contribution, while leaving the observed \(B\) fixed. For a fixed \(M\), the contribution rises in direct proportion to \(B\): more variation among the imputed-data estimates means a larger finite-number addition. Its practical size also depends on \(\bar{U}\), because an addition of a given size is less consequential when the other variance components are large.

Worked Example: Comparing Three Numbers of Imputations

Consider a hypothetical estimate of a 30-day readmission risk difference, in percentage points. Suppose \(\bar{U}=80\) percentage-points\(^2\) and \(B=12\) percentage-points\(^2\). Compare \(M=5\), \(M=20\), and \(M=100\), treating \(\bar{U}\) and \(B\) as fixed to isolate the correction’s effect.

For \(M=5\), \(B/M=12/5=2.4\) percentage-points\(^2\), so \(T=80+12+2.4=94.4\) percentage-points\(^2\). For \(M=20\), \(B/M=12/20=0.6\), so \(T=80+12+0.6=92.6\) percentage-points\(^2\). For \(M=100\), \(B/M=12/100=0.12\), so \(T=80+12+0.12=92.12\) percentage-points\(^2\).

Without the correction, the variance in each comparison would be \(80+12=92\) percentage-points\(^2\). Relative to that uncorrected variance, the additions are \(2.4/92\approx2.61\%\), \(0.6/92\approx0.652\%\), and \(0.12/92\approx0.130\%\), respectively. With this relatively modest \(B\), the correction is largest at five imputations and quite small at 100. This comparison holds \(B\) fixed for clarity; in an actual analysis, its estimated value can vary with the set of imputations.

A useful measure of practical impact is the relative increase in variance over the variance that would result from omitting only the finite-number term. That reference variance is \(\bar{U}+B\), so the relative increase is \(B/[M(\bar{U}+B)]\). To express the impact on the standard error instead, take the square root of the variance ratio:

$$ \frac{\sqrt{T}-\sqrt{\bar{U}+B}}{\sqrt{\bar{U}+B}} = \sqrt{1+\frac{B}{M(\bar{U}+B)}}-1. $$

This expression makes clear why \(B/M\) alone does not determine whether the correction is important: its size must be judged against \(\bar{U}+B\). There is no universal cutoff for “important.” A tolerance can be chosen for a particular analysis, and the resulting variance or standard-error change can then be reported transparently.

Worked Example: Checking a One-Percent Standard-Error Tolerance

Suppose a hypothetical estimate of average hospital stay has \(\bar{U}=9\) days\(^2\), \(B=36\) days\(^2\), and \(M=20\). Assess whether the finite-number correction changes the standard error by more than 1% relative to the calculation that omits it.

The uncorrected variance is \(\bar{U}+B=9+36=45\) days\(^2\). The correction is \(B/M=36/20=1.8\) days\(^2\), giving \(T=46.8\) days\(^2\). The standard errors are \(\sqrt{45}\approx6.708\) days and \(\sqrt{46.8}\approx6.841\) days. The relative increase is:

$$ \frac{6.841-6.708}{6.708}\approx0.0198=1.98\%. $$

The change exceeds the stated 1% tolerance. To find the number of imputations needed to keep the increase at or below 1%, write \(x=B/[M(\bar{U}+B)]\). The condition is \(\sqrt{1+x}-1\leq0.01\), which implies \(\sqrt{1+x}\leq1.01\), \(1+x\leq1.0201\), and \(x\leq0.0201\). Thus:

$$ M\geq\frac{B}{0.0201(\bar{U}+B)} =\frac{36}{0.0201(45)} \approx39.80. $$

Since \(M\) must be an integer, \(M\geq40\) meets this illustrative tolerance, if the variance components are held fixed. This is a planning calculation, not a universal recommendation: the tolerance depends on the use of the analysis, and the actual \(B\) may not stay fixed as \(M\) changes.

Diagnostics, Alternatives, and Limitations

The correction is straightforward to calculate, but it is useful to check the quantities that determine it and the assumptions behind their interpretation. Confirm that \(M\) is the number of completed datasets used in pooling, that \(B\) was calculated from the variation of the \(Q_m\) values, and that \(\bar{U}\) averages the corresponding within-imputation variance estimates. Check that all estimates refer to the same estimand and use the same scale and units. A very small \(B\) from very few imputations should not automatically be interpreted as evidence that missing-data uncertainty is negligible.

Compare the standard calculation with the calculation omitting \(B/M\) as a sensitivity check on the correction’s numerical impact, not as a competing preferred formula. If that difference is consequential, increasing \(M\) reduces the finite-number contribution under the rule. But increasing \(M\) does not correct a misspecified imputation model, poor chain mixing, or invalid within-imputation standard errors. Conversely, if the correction is small relative to \(\bar{U}+B\), it may have little numerical impact, though Rubin’s total variance formula still includes it.

ApproachWhat it doesKey limitation
Rubin’s total varianceUses \(\bar{U}+B+B/M\).Requires imputations and variance estimates suitable for pooling.
Omit the finite-number termUses \(\bar{U}+B\), ignoring the contribution \(B/M\).Understates the standard pooled variance by \(B/M\).
Use more imputationsReduces \(B/M\) when \(B\) is held fixed.Does not repair problems in the imputation model or its convergence.

A common mistake is to say, “There are many imputations, so the between-imputation variance can be reduced by dividing it by \(M\).” That confuses the added finite-number contribution with \(B\) itself. The correct calculation retains the entire \(B\) and adds \(B/M\): \(T=\bar{U}+B+B/M\). Another mistake is to treat \(1+1/M\) as a multiplier on the entire variance. It multiplies only \(B\), not \(\bar{U}\).

The \(1+1/M\) factor is part of Rubin’s standard pooling rule; it is not a general small-sample correction for the original study sample size. Nor does it account for every possible simulation issue. If imputation draws are strongly dependent, the actual Monte Carlo variation of their mean can differ from the simple independent-draw approximation \(B/M\). The correction should therefore be interpreted alongside checks that the imputations adequately represent the intended distribution.

Key takeaway: The finite-number correction adds \(B/M\) to \(\bar{U}+B\). Its absolute size decreases as \(M\) increases, and its practical importance depends on \(B/M\) relative to the other variance components. Keep \(B\) intact, multiply only \(B\) by \(1+1/M\), and do not treat more imputations as a remedy for a poor imputation procedure.

Check Your Understanding

Answer each question, then compare your work with the solutions below.

  1. If \(\bar{U}=16\), \(B=8\), and \(M=4\), calculate \(B/M\) and \(T\).
  2. For fixed \(\bar{U}\) and \(B\), what happens to the finite-number contribution when \(M\) is tripled?
  3. Suppose \(B=0\). What is the finite-number contribution, and what should you be cautious about if this estimate came from only two imputations?
  4. Explain why increasing \(M\) does not compensate for a poorly specified imputation model.

Solutions. (1) \(B/M=8/4=2\), so \(T=16+8+2=26\), in the corresponding squared units. (2) Since the contribution is \(B/M\), tripling \(M\) divides it by 3 when \(B\) is fixed. (3) The calculated contribution is \(0/2=0\), but a between-imputation variance estimated from only two imputations is based on very little information; a zero estimate does not establish that missing-data uncertainty is truly absent. (4) Increasing \(M\) reduces the finite-number contribution, but a poorly specified model can still generate inappropriate imputations and invalid pooled inference, regardless of how many such imputations are used.

Clinical Biostats