Tutorials › Joint Modeling of Longitudinal and Time-to-Event Data › Reporting Fixed and Random Effects Clearly

Mixed Models Review · Tutorial 93 of 697

Reporting Fixed and Random Effects Clearly

Build a concise, accurate results summary that makes both the population-average trends and the model’s sources of variability interpretable.

Intermediate 11 min read

What You'll Learn

  • State a biomarker mixed model and identify the fixed effects and covariance parameters to report.
  • Translate time and treatment coefficients into contrasts with units and uncertainty intervals.
  • Report random-effect variances, covariance, and correlation on clearly identified scales.
  • Describe residual variance and within-subject correlation without conflating them with random effects.
  • Distinguish population-level estimates from subject-specific predictions and avoid common reporting errors.

Why Clear Reporting Matters

A mixed-model results section should let a reader answer two different questions: how does the expected biomarker level vary with measured predictors, and how much variation is associated with subjects and within-subject measurement error? A list of coefficients without scales, units, or covariance details rarely answers either question. For example, a time coefficient depends on whether time was measured in days or years, while a random-intercept variance has squared biomarker units and is not itself a typical deviation.

This tutorial uses a hypothetical biomarker study to develop a concise reporting approach. It focuses on what to report and how to interpret it, rather than on fitting the model. The earlier material on random-effects covariance parameterizations, within-subject residual correlation, heteroscedastic residuals, and residual diagnostics supplies the modeling background needed here.

A Model and Its Reporting Targets

Suppose \(Y_{ij}\) is a biomarker measurement for subject \(i\) at visit \(j\), measured in milligrams per liter (mg/L). Let \(t_{ij}\) denote time in years since baseline, and let \(G_i=1\) for the treatment group and \(G_i=0\) for the comparison group. Consider the following linear mixed model:

$$ Y_{ij}=\beta_0+\beta_1t_{ij}+\beta_2G_i+\beta_3t_{ij}G_i+b_{0i}+b_{1i}t_{ij}+\epsilon_{ij}. $$

The fixed effects \(\beta_0,\ldots,\beta_3\) describe the group-level mean trajectory. With this coding, \(\beta_0\) is the comparison-group mean at baseline, \(\beta_1\) is its mean change per year, \(\beta_2\) is the baseline treatment-versus-comparison difference, and \(\beta_3\) is the difference between the groups’ mean yearly changes. The treatment-group mean change per year is \(\beta_1+\beta_3\), and its mean at time \(t\) differs from the comparison-group mean by \(\beta_2+t\beta_3\).

The subject-specific random intercept and slope are \(b_{0i}\) and \(b_{1i}\). Assume their vector has mean zero and covariance matrix \(D\), and that the random effects are independent across subjects. In this example, residuals have an AR(1) correlation across equally spaced visits: their variance is \(\sigma^2\), and the correlation between residuals \(k\) visits apart is \(\rho^{|k|}\). Assume residuals are independent across subjects and independent of the random effects. These assumptions describe the particular model to be reported; other covariance structures require different descriptions.

$$ D= \begin{pmatrix} \tau_{00} & \tau_{01}\\ \tau_{01} & \tau_{11} \end{pmatrix}, \qquad \operatorname{Var}(\epsilon_{ij})=\sigma^2, \qquad \operatorname{Corr}(\epsilon_{ij},\epsilon_{ik})=\rho^{|j-k|}. $$

A useful report therefore identifies the fixed-effect estimates and uncertainty intervals, the random-effect variance-covariance parameters, and the residual variance and correlation structure. State the time origin, time units, biomarker units, group coding, and interval method. Random-effect variances have squared units: \(\tau_{00}\) has units (mg/L)\(^2\), \(\tau_{11}\) has units (mg/L per year)\(^2\), and \(\tau_{01}\) has units (mg/L)\(^2\) per year. The correlation \(\rho\) is dimensionless.

Worked Example: Interpreting Fixed-Effect Estimates

Suppose a hypothetical model gives \(\hat\beta_0=50.0\), \(\hat\beta_1=-2.0\), \(\hat\beta_2=4.0\), and \(\hat\beta_3=-1.5\). The biomarker is measured in mg/L and time in years. Interpret the fitted group means and calculate the treatment-group difference at two years.

At baseline, the fitted comparison-group mean is \(\hat\beta_0=50.0\) mg/L. Its fitted mean change is \(\hat\beta_1=-2.0\) mg/L per year. The treatment group’s fitted baseline difference is \(\hat\beta_2=4.0\) mg/L, and its fitted mean change per year is \(\hat\beta_1+\hat\beta_3=-2.0-1.5=-3.5\) mg/L per year.

At two years, the fitted treatment-minus-comparison difference is

$$ \hat\beta_2+2\hat\beta_3=4.0+2(-1.5)=1.0\text{ mg/L}. $$

Thus the fitted treatment-group mean is 1.0 mg/L higher than the comparison-group mean at two years. This is an estimated difference in mean biomarker level, not evidence by itself that treatment caused a change; causal interpretation depends on study design and assumptions beyond the model.

Uncertainty for Effects and Contrasts

A coefficient estimate should ordinarily be accompanied by an uncertainty interval and, when relevant to the question, a test result. For a large-sample Wald interval, an estimate \(\hat\beta\) with standard error \(SE(\hat\beta)\) has an approximate 95% interval \(\hat\beta\pm1.96SE(\hat\beta)\). If inference uses a \(t\) reference distribution, report the chosen degrees of freedom and critical value instead. State the method rather than implying that every software package uses the same interval calculation.

A derived contrast is often more useful than a coefficient alone. For a linear contrast \(c^\mathsf{T}\beta\), its estimated variance is \(c^\mathsf{T}\widehat{\operatorname{Var}}(\hat\beta)c\). In particular, the uncertainty for a treatment difference at a specified time must account for the covariance between \(\hat\beta_2\) and \(\hat\beta_3\), not just their separate standard errors.

Derivation: At time \(t\), the fixed mean difference is \(\beta_2+t\beta_3\). Its estimate is the linear combination \(c^\mathsf{T}\hat\beta\), where \(c=(0,0,1,t)^\mathsf{T}\). For any vector of estimates with covariance matrix \(\widehat V\), the variance of a linear combination is \(c^\mathsf{T}\widehat Vc\). Expanding the relevant entries gives \(\widehat{\operatorname{Var}}(\hat\beta_2+t\hat\beta_3)=SE(\hat\beta_2)^2+t^2SE(\hat\beta_3)^2+2t\widehat{\operatorname{Cov}}(\hat\beta_2,\hat\beta_3)\). The covariance term is essential unless it is zero.

Worked Example: A Confidence Interval for a Two-Year Difference

Continue the hypothetical example. Suppose \(SE(\hat\beta_2)=1.50\), \(SE(\hat\beta_3)=0.70\), and \(\widehat{\operatorname{Cov}}(\hat\beta_2,\hat\beta_3)=-0.35\). Use a normal-based 95% Wald interval for the treatment-minus-comparison difference at two years.

The estimate is \(4.0+2(-1.5)=1.0\) mg/L. Its estimated variance is

$$ 1.50^2+2^2(0.70^2)+2(2)(-0.35) =2.25+1.96-1.40=2.81. $$

Therefore, \(SE=\sqrt{2.81}=1.676\) mg/L. The interval is

$$ 1.0\pm1.96(1.676) =1.0\pm3.285 =(-2.285,\ 4.285)\text{ mg/L}. $$

Using the stated normal-based method, the estimated two-year difference is 1.0 mg/L, with a 95% confidence interval from about -2.29 to 4.29 mg/L. The interval includes zero, so these data do not establish a nonzero difference at the corresponding two-sided 5% level. The interval does not assign a 95% probability to the fixed parameter; it describes the coverage of the procedure over repeated samples under its assumptions.

Reporting Random Effects and Residual Structure

Report random effects as a covariance structure, not as an unqualified statement that “subjects varied.” For an intercept-and-slope model, give the intercept variance, slope variance, and their covariance or correlation. The correlation is calculated as \(\tau_{01}/\sqrt{\tau_{00}\tau_{11}}\). Variances describe dispersion on squared scales; their square roots, the corresponding standard deviations, are often easier to interpret as typical scales of between-subject variation. Do not confuse a standard deviation with a standard error of an estimate.

Residual reporting is separate. Give the residual variance or residual standard deviation and specify any modeled serial correlation, such as an AR(1) correlation with estimated \(\rho\). Random intercepts and slopes represent between-subject variation in trajectories; correlated residuals represent remaining within-subject dependence after accounting for the model. Reporting one does not substitute for reporting the other.

Worked Example: Translating Covariance Estimates to Their Scales

Suppose a hypothetical fit estimates \(\hat\tau_{00}=16.0\), \(\hat\tau_{11}=0.36\), \(\hat\tau_{01}=-1.20\), and \(\hat\sigma^2=9.0\), with AR(1) residual correlation estimate \(\hat\rho=0.35\). Translate these values into interpretable scales.

The random-intercept standard deviation is \(\sqrt{16.0}=4.0\) mg/L. The random-slope standard deviation is \(\sqrt{0.36}=0.60\) mg/L per year. The correlation between subject-specific intercepts and slopes is

$$ \frac{-1.20}{\sqrt{16.0(0.36)}}=\frac{-1.20}{2.40}=-0.50. $$

The negative correlation indicates that, in this fitted random-effects distribution, subjects with higher intercept deviations tend to have more negative slope deviations. The residual standard deviation is \(\sqrt{9.0}=3.0\) mg/L. An AR(1) estimate of 0.35 means that, under the model, residual correlation is 0.35 between adjacent equally spaced visits and \(0.35^2=0.1225\) between visits two steps apart.

A concise report would preserve the estimated variances and covariance, or report standard deviations and correlation with clear labels, and separately state the residual variance and AR(1) estimate. It would not call \(\hat\tau_{00}=16.0\) a “16 mg/L variation”: its unit is (mg/L)\(^2\), and the corresponding standard deviation is 4.0 mg/L.

Intervals for Variance Parameters and a Complete Summary

Uncertainty intervals for variance components need special care. Variances cannot be negative, and their sampling distributions may be skewed, especially near zero. A symmetric estimate-plus-or-minus-standard-error interval can therefore extend below zero or poorly represent uncertainty. Prefer a method appropriate to the fitted model, such as a profile-likelihood interval or a suitable bootstrap interval, and name the method. If a reported interval is for a variance, retain squared units; if it is transformed to a standard deviation, take square roots of both nonnegative endpoints and label the interval as an interval for the standard deviation. Boundary estimates and singular fits also deserve explicit disclosure rather than a falsely precise summary.

The following hypothetical results combine fixed effects, covariance estimates, and residual structure. The fixed-effect intervals use the normal-based Wald calculation; the variance-component intervals are assumed to come from profile likelihood. These methods are stated separately because they are not interchangeable.

Worked Example: Writing a Compact Results Paragraph

Suppose the fitted estimates and intervals are: \(\hat\beta_0=50.0\) mg/L (95% CI 47.6 to 52.4), \(\hat\beta_1=-2.00\) mg/L per year (95% CI -2.88 to -1.12), \(\hat\beta_2=4.00\) mg/L (95% CI 1.06 to 6.94), and \(\hat\beta_3=-1.50\) mg/L per year (95% CI -2.87 to -0.13). Suppose the covariance estimates are \(\hat\tau_{00}=16.0\) (profile-likelihood 95% CI 9.0 to 25.0), \(\hat\tau_{11}=0.36\) (CI 0.16 to 0.64), and \(\hat\tau_{01}=-1.20\), with \(\hat\sigma^2=9.0\) and \(\hat\rho=0.35\).

A clear summary is: “In the fitted model, the comparison-group mean biomarker level at baseline was 50.0 mg/L (95% Wald CI 47.6 to 52.4), with an estimated mean change of -2.00 mg/L per year (95% CI -2.88 to -1.12). The treatment group’s baseline mean was estimated to be 4.00 mg/L higher (95% CI 1.06 to 6.94), and its mean yearly change was estimated to be 1.50 mg/L per year more negative (group-by-time estimate -1.50; 95% CI -2.87 to -0.13). The estimated random-intercept and random-slope variances were 16.0 (95% profile-likelihood CI 9.0 to 25.0) (mg/L)\(^2\) and 0.36 (95% CI 0.16 to 0.64) (mg/L per year)\(^2\), respectively; their estimated covariance was -1.20 (mg/L)\(^2\) per year. The residual variance was 9.0 (mg/L)\(^2\), with an AR(1) residual correlation estimate of 0.35 between adjacent visits.”

This paragraph identifies the reference group and baseline, reports units, distinguishes fixed effects from covariance parameters, and specifies the interval method where supplied. It also avoids presenting the interaction coefficient as the treatment difference at every follow-up time: that difference changes with time. For a target time, report the corresponding contrast and its interval, as in the two-year calculation above.

Diagnostics, Alternatives, and Common Pitfalls

A polished summary should reflect a model whose assumptions and fit have been examined. Check residual plots and the diagnostics appropriate to the fitted residual structure; look for systematic patterns, unequal spread, influential subjects, or remaining serial dependence. Check whether random-effect estimates are near a boundary, whether the fit is singular, and whether the data support estimating a random slope. A reported AR(1) structure should match the visit indexing and spacing used by the model. If the observed visits are irregularly spaced, an ordinary discrete-visit AR(1) structure may not represent correlation as a function of elapsed time; describe and justify the actual structure used.

There is no single reporting format for every scientific question. A coefficient table is efficient for presenting the model’s parameter estimates, standard errors, intervals, and units. A contrast-focused summary is more direct when the question concerns a group difference at a particular time or a change over a specified interval. A table of standard deviations and correlations can make random-effect scales more intuitive, while a variance-covariance table preserves the parameters used by the model. Whichever format is chosen, do not omit the residual structure or mix parameter scales without labels.

  • Do not report only a p-value. Include an estimate, its units, and an uncertainty interval so the magnitude and precision are visible.
  • Do not interpret an interaction as a universal group difference. A time-by-group coefficient is a difference in slopes; the group difference at time \(t\) is \(\beta_2+t\beta_3\).
  • Do not confuse fitted population effects with subject-specific predictions. Fixed effects describe the modeled group-level mean; conditional predictions incorporating estimated subject effects answer a different question.
  • Do not omit the reference point for time. The intercept and group main effect depend on the time origin; identify baseline or the chosen centering value.
  • Do not claim the chosen covariance structure is established merely because it was fitted. State the structure, check its adequacy, and acknowledge weak identification or singularity when present.

These reporting choices improve interpretability but do not remove limitations. Estimates depend on the model specification, observed follow-up, and assumptions about the mean and covariance structure. A confidence interval describes uncertainty under the stated procedure and model; it does not account automatically for model misspecification, selection bias, or unmeasured confounding. When the results are used in a broader joint analysis, report the longitudinal submodel clearly without implying that its summary alone describes event-time outcomes.

Check Your Understanding

Answer each question, then compare with the brief solutions.

  1. If time is measured in months instead of years, what happens to the units of a time slope and random-slope variance?
  2. With \(\hat\beta_2=3\) mg/L and \(\hat\beta_3=-0.8\) mg/L per year, what is the fitted treatment-minus-comparison difference at 2.5 years?
  3. Why must the covariance between two coefficient estimates be included when calculating a contrast interval?
  4. What is the distinction between a random-intercept variance and a residual variance?
  5. A variance-component estimate is near zero and its symmetric Wald interval extends below zero. What should the report do?

Solutions. (1) The slope is measured in mg/L per month, and its variance in (mg/L per month)\(^2\); the numerical slope and variance change under the time rescaling. (2) \(3+2.5(-0.8)=1.0\) mg/L. (3) The variance of a sum includes twice the covariance term; omitting it generally gives the wrong standard error. (4) The random-intercept variance describes between-subject variation in underlying levels, whereas residual variance describes within-subject measurement variation remaining after the modeled effects. (5) Do not present a negative variance as plausible; use an appropriate nonnegative-scale interval method, state the method, and discuss boundary or weak-identification concerns.

Clinical Biostats