Tutorials › Multiple Imputation by Chained Equations (MICE) › Singleton Clusters In Multilevel Imputation

Nested and Multilevel Data · Tutorial 350 of 497

Singleton Clusters In Multilevel Imputation

Distinguish the between-cluster information a singleton can provide from the within-cluster information it cannot, and see how that distinction affects random-intercept imputation.

Advanced 11 min read

What You'll Learn

  • Separate within-cluster contrasts from between-cluster information for a one-member cluster
  • Decompose a level-1 predictor when a cluster has only one observed member
  • Calculate the conditional distribution of a random intercept for a singleton
  • Identify why singleton observations alone cannot separate random-intercept and residual variances
  • Diagnose when singleton clusters may be dominating or destabilizing an imputation model
  • Compare retaining singleton clusters with approaches that discard them or use cluster indicators

Why Singleton Clusters Need a Separate Interpretation

A cluster with one observed member is not an empty cluster: its record may inform population means, associations between cluster means and outcomes, and the marginal variability of the response. But it cannot provide a comparison between two members of that cluster. This distinction matters in multilevel imputation because a model may use the same record for some parts of the conditional distribution while having no within-cluster contrast to learn from.

The key question is therefore not simply whether to retain a singleton. It is which model quantities the singleton can inform, and whether the data contain enough replicated clusters to distinguish those quantities. The discussion below uses the random-intercept normal model; it does not assume random slopes.

Definition: A singleton cluster is a cluster with exactly one observed member for the variable or analysis under consideration. In a two-level random-intercept model, a singleton contributes one level-1 record and one cluster-level grouping label. It supplies no observed within-cluster pair or contrast. Its information about between-cluster quantities depends on the model, the observed covariates, and what is missing.

What Within-Between Decomposition Shows

For a level-1 predictor \(x_{ij}\), write its value as the cluster mean plus its deviation from that mean:

$$ x_{ij}=\bar{x}_{j}+(x_{ij}-\bar{x}_{j}). $$

For a singleton, the only observed value is also the observed cluster mean, so \(x_{ij}-\bar{x}_{j}=0\). Thus that record supplies no nonzero within-cluster predictor deviation. It can still contribute to an association involving \(\bar{x}_{j}\), provided the between-cluster model and estimand make that association relevant. The same logic applies to the outcome: a single observed outcome can contribute to the cluster mean, but there is no within-cluster outcome contrast for that cluster.

This statement concerns observed data and the decomposition being used. If some cluster members are missing, the mean calculated from observed members may not equal the cluster’s underlying mean. Imputation and the model for the mean must account for that uncertainty rather than treating an observed-subset mean as known without qualification.

Worked Example: A Singleton in a Within-Between Decomposition

Consider three hypothetical clusters. Cluster A has predictor values \(x=(2,4)\) and outcome values \(y=(6,10)\); cluster B has one observed member with \(x=5\) and \(y=12\); cluster C has \(x=(6,8)\) and \(y=(14,18)\). Calculate the cluster means and identify the singleton’s contribution.

The cluster means are \((\bar{x}_A,\bar{y}_A)=(3,8)\), \((\bar{x}_B,\bar{y}_B)=(5,12)\), and \((\bar{x}_C,\bar{y}_C)=(7,16)\). In cluster B, \(x-\bar{x}_B=5-5=0\), and \(y-\bar{y}_B=12-12=0\). There is no within-cluster deviation in this record.

For illustration, an unweighted regression of the three cluster outcome means on the three cluster predictor means has slope

$$ \frac{\sum_j(\bar{x}_j-\bar{x})(\bar{y}_j-\bar{y})} {\sum_j(\bar{x}_j-\bar{x})^2} = \frac{(-2)(-4)+(0)(0)+(2)(4)} {(-2)^2+0^2+2^2} = \frac{16}{8}=2. $$

Here \(\bar{x}=5\) and \(\bar{y}=12\). The singleton contributes the middle cluster mean to this between-cluster calculation. It contributes no within-cluster contrast. This simple calculation illustrates the distinction; it is not a claim that an unweighted regression is the correct estimator for every multilevel estimand.

What a Singleton Says About a Random Intercept

Suppose the outcome follows a random-intercept model with known covariate contribution \(\mu_{ij}\):

$$ y_{ij}=\mu_{ij}+u_j+e_{ij},\qquad u_j\sim N(0,\tau^2),\qquad e_{ij}\sim N(0,\sigma^2), $$

where the cluster effects \(u_j\) are independent across clusters, the residuals \(e_{ij}\) are independent across members and clusters, and the two sets of effects are mutually independent. The covariate contribution \(\mu_{ij}\) may include fixed effects. For the calculations that follow, assume the variance components and fixed effects are known. In practice they are estimated, and their uncertainty also matters for proper imputation.

For a singleton with observed outcome \(y_j\), let \(r_j=y_j-\mu_j\). The observation is \(r_j=u_j+e_j\). It gives information about \(u_j\), but that information is noisy: the one residual combines the cluster effect and individual residual. Under the normal model, the conditional distribution is

$$ u_j\mid r_j\sim N\left( \frac{\tau^2}{\tau^2+\sigma^2}r_j,\, \frac{\tau^2\sigma^2}{\tau^2+\sigma^2} \right). $$

This is a shrunken estimate of the cluster effect, not a direct observation of it. The conditional variance remains positive when both variance components are positive. A singleton therefore can update the distribution of its cluster effect, while leaving substantial uncertainty about how much of its residual is cluster-level and how much is individual-level.

Worked Example: Conditional Random-Intercept Information

Suppose a hypothetical singleton has observed outcome \(y_j=15\) and fixed-effect prediction \(\mu_j=10\), so \(r_j=15-10=5\). Assume \(\tau^2=4\) outcome-units squared and \(\sigma^2=9\) outcome-units squared. Under the model above, the conditional mean of \(u_j\) is

$$ E(u_j\mid r_j)=\frac{4}{4+9}(5)=\frac{20}{13}=1.538 $$

outcome units. Its conditional variance and standard deviation are

$$ \operatorname{Var}(u_j\mid r_j)=\frac{(4)(9)}{13}=\frac{36}{13}=2.769, \qquad SD(u_j\mid r_j)=\sqrt{2.769}=1.664 $$

outcome units. The observed residual of 5 does not imply that the cluster effect equals 5. Under these assumptions, the conditional mean is 1.538, with appreciable remaining uncertainty. A proper imputation procedure draws a cluster effect from its conditional distribution, rather than substituting its conditional mean as if it were known.

Singletons and Variance Components

The covariance structure makes a second limitation precise. Under the random-intercept model, a singleton’s marginal outcome variance is \(\tau^2+\sigma^2\). A cluster with two members has covariance matrix

$$ \begin{pmatrix} \tau^2+\sigma^2 & \tau^2\\ \tau^2 & \tau^2+\sigma^2 \end{pmatrix}. $$

The off-diagonal covariance between two different members is \(\tau^2\), because they share the same random intercept but have independent residuals. A singleton has no such pairwise covariance. Consequently, if every cluster is a singleton and there are no other sources of information that distinguish the components, the outcome data identify only the sum \(\tau^2+\sigma^2\), not the two variances separately. Replicated clusters can provide the within-cluster covariance needed for that separation under the stated assumptions.

Worked Example: What the Covariance Structure Can Identify

Take hypothetical values \(\tau^2=4\) and \(\sigma^2=9\), both in outcome-units squared. A singleton has marginal variance

$$ \operatorname{Var}(y_j)=4+9=13. $$

A two-member cluster has covariance matrix

$$ \begin{pmatrix}13&4\\4&13\end{pmatrix}. $$

The diagonal value 13 is the total variance for either member. The off-diagonal value 4 is the shared random-intercept variance. With only singleton clusters, the data can inform the marginal variance 13, but cannot use an within-cluster covariance of 4 because there are no pairs. For example, \((\tau^2,\sigma^2)=(4,9)\) and \((6,7)\) both give singleton variance 13. The singleton-only marginal variance cannot distinguish these choices. This is an identifiability point about the model, not a claim that every fitted data set containing some singletons has unidentified variance components.

Implications for Imputation and Model Choice

In multilevel chained equations, the conditional imputation model should preserve the distinctions relevant to the analysis. A singleton’s observed predictors and outcome can contribute to fixed-effect and between-cluster relationships. If its outcome is missing, however, that missing value cannot itself update the cluster random intercept. Under the model above, with no other observed variable informing that effect, the random intercept remains drawn from its prior distribution \(N(0,\tau^2)\) before the missing outcome is generated. Any observed auxiliary variable can change this conclusion only if the imputation model specifies how it relates to the cluster effect.

A cluster-indicator model gives a different view. A singleton has its own indicator, but there is only one observation associated with that indicator; it cannot create a within-cluster comparison. Treating each singleton’s effect as an unrestricted fixed parameter is not equivalent to drawing a random effect from a population distribution. Conversely, excluding all singleton clusters removes valid observations that may inform population means and between-cluster associations. Neither choice is automatically appropriate: the decision should follow the target estimand and the assumptions of the imputation and analysis models.

The assumptions behind the random-intercept calculations include a correctly specified conditional mean, normally distributed independent random intercepts and residuals, and positive variance components. The imputation model must also be appropriate for the missingness and analysis goals. These assumptions are not verified merely because a software routine converges. In particular, the normal random-intercept calculation above does not establish that a singleton’s effect is known accurately, or that a model with very few replicated clusters can estimate the variance components reliably.

1
Tabulate cluster sizes.
Count singleton, replicated, and highly unequal clusters for each variable being imputed; missingness can make the relevant observed cluster size differ across variables.
2
Check which information is present.
Ask whether the singleton has observed values that inform fixed effects or cluster-level relationships, and whether any within-cluster contrasts exist elsewhere to inform the relevant within-cluster coefficient.
3
Inspect estimation and imputation behavior.
Look for unstable or boundary variance estimates, convergence problems, implausible imputed values, and sensitivity to retaining or excluding singleton clusters. These are warning signs, not proofs of a particular failure.
4
Check alignment with the estimand.
Confirm that the imputation model retains the between- and within-cluster information needed by the intended analysis, and that any exclusion or simplification is justified for that target.

Common Mistakes and Limits

  • Wrong reasoning: “A singleton contributes nothing to a multilevel model.” Correction: It supplies no within-cluster contrast, but may inform the fixed mean, a between-cluster association, or the marginal outcome distribution.
  • Wrong reasoning: “The singleton’s observed residual is its random intercept.” Correction: The residual is the sum of the random intercept and individual error. The conditional random-intercept distribution reflects uncertainty in that separation.
  • Wrong reasoning: “One singleton can identify both variance components because its outcome is observed.” Correction: Its marginal variance is \(\tau^2+\sigma^2\); separating the components requires information beyond that singleton variance, such as replicated clusters under the model.
  • Wrong reasoning: “Dropping singletons is always safer.” Correction: Dropping them can discard useful between-cluster information and may change the target population. Assess the estimand, missingness, and model behavior instead.

Singletons have a real but limited role. They can add information about the distribution of observed records across clusters, yet cannot replace replication for learning within-cluster relationships or shared covariance. Their contribution to an imputation depends on what is observed, how the model represents cluster effects, and whether enough non-singleton clusters support the quantities being estimated.

Check Your Understanding

Answer each question, then compare with the solutions.

  1. A level-1 predictor for a singleton is \(x=7\). What are its observed cluster mean and within-cluster deviation?
  2. Under the random-intercept model, a singleton has residual \(r=3\), \(\tau^2=2\), and \(\sigma^2=6\). Find the conditional mean of its random intercept.
  3. Why can a singleton contribute to a between-cluster association but not provide a within-cluster contrast?
  4. If all clusters contain one member, what combination of \(\tau^2\) and \(\sigma^2\) determines the marginal outcome variance under the model?
  5. Name one diagnostic warning sign when fitting an imputation model with many singleton clusters.

Solutions. (1) The observed cluster mean is 7, so the deviation is \(7-7=0\). (2) The conditional mean is \(\frac{\tau^2}{\tau^2+\sigma^2}r=\frac{2}{8}(3)=0.75\) outcome units. (3) Its observed value can contribute to a cluster-level mean or relationship, but there is no second member in that cluster to form a within-cluster comparison. (4) The marginal variance is \(\tau^2+\sigma^2\); singleton observations alone do not separate the two components. (5) Examples include an unstable or boundary variance estimate, convergence problems, or substantial sensitivity to retaining versus excluding singletons. A warning sign motivates investigation; it does not by itself prove that the model is invalid.

Clinical Biostats