Tutorials › Generalized Linear Mixed Models (GLMM) › Explaining Cluster Variation in a Multicenter Case

Software and Case Studies · Tutorial 693 of 698

Explaining Cluster Variation in a Multicenter Case

Learn to translate a fitted random-intercept variance into a careful description of between-center heterogeneity without treating it as a fixed center effect.

Intermediate 10 min read

What You'll Learn

  • Interpret the random-intercept variance and standard deviation in conditional log-odds units.
  • Calculate and explain the median odds ratio from a fitted variance.
  • Transform variance interval endpoints into an interval for the median odds ratio.
  • Distinguish a model-based summary of center variation from a fixed effect or a causal claim.
  • Identify assumptions and warning signs that affect interpretation of estimated cluster variation.

What a Random-Intercept Summary Says

In a multicenter logistic GLMM, the random intercept describes how centers vary in their conditional baseline log odds after accounting for the covariates in the model. Explaining this variation is not the same as claiming that a particular center characteristic has an effect. The model summarizes a distribution of center-specific deviations; it does not, by itself, identify why centers differ.

Suppose \(Y_{ij}\) is a binary outcome for patient \(i\) in center \(j\), and \(x_{ij}\) is a vector of patient-level covariates. A random-intercept model can be written as

$$ Y_{ij}\mid b_j,x_{ij}\sim\operatorname{Bernoulli}(p_{ij}),\qquad \operatorname{logit}(p_{ij})=\beta_0+x_{ij}^{\mathsf T}\beta+b_j,\qquad b_j\sim N(0,\tau^2). $$

Here \(b_j\) is the center-specific random intercept, measured in log-odds units, and \(\tau^2\) is its variance across centers. Conditional on the random intercepts and included covariates, outcomes are assumed independent, and the center effects are assumed independent draws from a normal distribution with mean zero and common variance. The model also assumes that the included fixed effects have the same coefficients across centers; this random-intercept model does not allow those effects to vary by center.

Definition: The random-intercept variance \(\tau^2\) summarizes the spread of the modeled center-specific log-odds deviations \(b_j\). Its square root, \(\tau\), is the between-center standard deviation in conditional log-odds units. Neither quantity is a percentage of outcome variation or a fixed coefficient for a named center.

The conditional probability scale is nonlinear: the same shift \(b_j\) in log odds changes probabilities by different amounts at different covariate values. Therefore, the variance is most directly interpreted on the log-odds scale. It is not a percentage-point difference in outcome probability, and it does not say that every pair of centers differs by the same amount.

From Variance to a More Interpretable Contrast

A common supplementary summary is the median odds ratio (MOR). Imagine selecting two centers at random from the modeled center distribution and comparing their conditional odds for otherwise identical patients. Label the center with the higher odds as the numerator. The MOR is the median of this larger-to-smaller odds ratio across such random pairs. It is at least 1; a value closer to 1 indicates less modeled center variation.

For two independent random intercepts \(b_1,b_2\sim N(0,\tau^2)\), their difference is normal with mean zero and variance \(2\tau^2\). The absolute difference has median \(0.67449\sqrt{2\tau^2}\), because \(0.67449\) is the median of the absolute value of a standard normal variable. Conditional odds ratios are exponentiated log-odds differences. Hence:

$$ \operatorname{MOR} =\exp\left\{0.67449\sqrt{2\tau^2}\right\}. $$

This is a model-based contrast between two randomly selected centers, not an estimated odds ratio for a named center or a measured center-level predictor. It is also conditional on the covariates in the model: the comparison holds those covariates fixed.

Worked Example: Describing a Fitted Variance

A hypothetical logistic GLMM for readmission includes patient age and comorbidity as fixed covariates and a random intercept for each of 24 centers. The software reports a center-intercept variance estimate of \(\hat{\tau}^2=0.25\). Describe the estimated scale of variation and calculate the MOR.

Between-center standard deviation. The estimate is \(\hat{\tau}=\sqrt{0.25}=0.500\) conditional log-odds units. Thus, the fitted random-intercept distribution has a standard deviation of 0.500 log-odds units around its assumed mean of zero.

Median odds ratio. Substitute the variance estimate into the formula:

$$ \widehat{\operatorname{MOR}} =\exp\left\{0.67449\sqrt{2(0.25)}\right\} =\exp\left\{0.67449\sqrt{0.50}\right\} =\exp(0.47694) \approx 1.611. $$

Under this fitted model, the median larger-to-smaller conditional odds ratio for a randomly selected pair of centers is about 1.611, comparing patients with the same modeled covariates. This is a distribution-level summary, not a statement that every pair differs by 61.1%, nor a claim about the readmission odds of any particular center.

Reporting Uncertainty and the Model-Based Meaning

A variance estimate is uncertain, and its uncertainty matters especially when there are few centers or little information about between-center differences. If software supplies an interval for \(\tau^2\), the MOR is a monotone increasing function of that variance. Applying the MOR transformation to both variance endpoints therefore gives corresponding endpoints on the MOR scale. The result remains an interval for a model-derived quantity, not a probability statement about the parameter.

Worked Example: Transforming a Variance Interval

Suppose a hypothetical fitted model reports \(\hat{\tau}^2=0.36\), with a 95% confidence interval for the variance of \([0.12,0.79]\). Calculate the point estimate and transformed interval for the MOR.

For the point estimate:

$$ \widehat{\operatorname{MOR}} =\exp\left\{0.67449\sqrt{2(0.36)}\right\} =\exp\left\{0.67449\sqrt{0.72}\right\} \approx \exp(0.57232) \approx 1.772. $$

Transform the lower variance endpoint:

$$ \exp\left\{0.67449\sqrt{2(0.12)}\right\} =\exp(0.33043) \approx 1.392. $$

Transform the upper endpoint:

$$ \exp\left\{0.67449\sqrt{2(0.79)}\right\} =\exp(0.84782) \approx 2.335. $$

The transformed interval is approximately \([1.392,2.335]\). A suitable description is: “The estimated MOR was 1.772, with a transformed 95% confidence interval of approximately 1.392 to 2.335.” The interval describes uncertainty in the model-based MOR under the fitted model and the interval method used for the variance. It does not mean there is a 95% probability that the fixed, unknown MOR lies in this particular interval.

When explaining the variance itself, report its scale and connect it to the model. For example, \(\hat{\tau}^2=0.25\) means an estimated between-center variance of 0.25 conditional log-odds-squared units; \(\hat{\tau}=0.500\) gives the more directly readable standard deviation in log-odds units. The MOR can provide an odds-ratio-scale description, but does not replace the variance estimate or its uncertainty.

Worked Example: Choosing Careful Reporting Language

A hypothetical analysis of 1,080 patients across 18 centers estimates the random-intercept variance as \(\hat{\tau}^2=0.09\). A report needs one sentence for a clinical team. Calculate the standard deviation and MOR, then identify what can reasonably be said.

The standard deviation is \(\hat{\tau}=\sqrt{0.09}=0.300\) conditional log-odds units. The MOR is:

$$ \widehat{\operatorname{MOR}} =\exp\left\{0.67449\sqrt{2(0.09)}\right\} =\exp\left\{0.67449\sqrt{0.18}\right\} \approx\exp(0.28616) \approx1.331. $$

A careful sentence would be: “After adjustment for the modeled patient covariates, the fitted model estimated between-center variation in conditional log odds with a standard deviation of 0.300; the corresponding MOR was 1.331.” The sentence describes the fitted distribution. It does not say that center membership caused an individual’s outcome, that center differences are explained, or that all centers have odds ratios 1.331 apart.

The sample size of 1,080 does not by itself guarantee a precise estimate of the center variance. Information about this variance depends importantly on the number of centers and the outcome patterns across centers. The report should therefore include an uncertainty interval when available and avoid presenting a point estimate as definitive evidence of substantial or negligible heterogeneity.

Assumptions, Diagnostics, and Alternatives

A random-intercept summary is only as useful as the model supporting it. The interpretation above relies on the logistic mean structure, the specified covariates, the normal random-intercept distribution, and conditional independence of outcomes given those effects and covariates. It also assumes that the centers are meaningfully treated as draws from a common distribution. If centers were selected in a way that makes this assumption implausible, or if important predictors differ systematically across centers and are omitted, the estimated random-intercept variation can absorb that misspecification.

Useful checks focus on whether the model gives a credible account of the data, rather than on treating a single variance estimate as a diagnostic test. Examine observed outcome patterns and fitted predictions across centers, including whether a few centers have unusually large residual discrepancies. Compare the observed distribution of outcomes with model-based predictions at both the patient and center levels. Consider whether the estimated variance is sensitive to influential centers or reasonable changes to covariate specification. If the estimate is near zero, remember that variance is constrained to be nonnegative; a boundary estimate is not proof that centers are identical.

The random-intercept model is not the only way to represent center structure. Treating center as a fixed categorical effect estimates separate conditional contrasts for the included centers, whereas the random-intercept model summarizes a distribution and can support partial pooling. A population-averaged model targets a different, marginal interpretation. These approaches answer different questions; a random-intercept variance should not be relabeled as a fixed center effect or as a marginal effect.

The random-intercept summary also has limits. The MOR is dependent on the assumed distribution and model specification, and does not attribute heterogeneity to staffing, policy, or any other center feature unless those features are explicitly included and appropriately modeled. Nor does a variance estimate show whether a particular center is above or below the model’s average. Center-specific random-effect predictions are shrunken estimates and have their own uncertainty; they are not the same object as the variance summary.

Common Mistake

Common mistake: “The variance is 0.25, so centers differ by 25% in readmission risk,” or “the random intercept proves that center quality causes the difference.” Both statements misuse the result. The variance is on the squared conditional log-odds scale; its square root is a standard deviation in log-odds units. The fitted distribution describes residual between-center heterogeneity after adjustment, but does not identify its cause. Use the MOR if an odds-ratio-scale contrast is useful, and describe it as a model-based comparison for randomly selected centers at the same covariates.
Key takeaway: Explain the random-intercept variance as between-center spread in conditional log odds. Pair it, where useful, with the MOR and an uncertainty interval, while distinguishing both from fixed effects, percentage-point differences, and causal explanations.

Check Your Understanding

Answer each question, then compare with the brief solutions below.

  1. A fitted random-intercept variance is \(0.16\). What is the estimated between-center standard deviation, and what are its units?
  2. For \(\hat{\tau}^2=0.25\), what is the MOR to three decimal places, and what pairwise comparison does it summarize?
  3. A variance interval is \([0.12,0.79]\). What is the corresponding transformed MOR interval to three decimal places?
  4. Why is it incorrect to say that a random-intercept variance of \(0.25\) means a 25% difference in outcome risk?

Solutions. (1) \(\sqrt{0.16}=0.400\), in conditional log-odds units. (2) \(\exp\{0.67449\sqrt{2(0.25)}\}=\exp(0.47694)\approx1.611\). It is the median larger-to-smaller conditional odds ratio for a random pair of centers at the same covariates. (3) Transforming the endpoints gives approximately \([1.392,2.335]\). (4) The variance is measured in squared log-odds units, not as a percentage of risk. It summarizes modeled between-center spread and does not directly give a probability difference or a causal effect.

Clinical Biostats