Tutorials › Competing Risks and Multi-State Models › Shared Frailty Induces Within-Cluster Dependence

Frailty and Clustered Events · Tutorial 617 of 699

Shared Frailty Induces Within-Cluster Dependence

Learn to derive marginal joint survival and dependence under shared frailty, and to distinguish dependence between event-free indicators from correlation between event times.

Advanced 11 min read

What You'll Learn

  • State the assumptions that make shared frailty induce marginal dependence.
  • Derive joint survival by integrating conditional survival over the frailty distribution.
  • Calculate covariance and correlation of event-free indicators at specified horizons.
  • Compare dependence under different gamma-frailty variances.
  • Relate shared frailty to covariance between event times in an exponential model.
  • Recognize limits of these dependence summaries and common interpretation errors.

Why Shared Frailty Creates Dependence

Two people in the same cluster may have related event times even when their event processes are independent after conditioning on a shared latent risk. For example, a cluster-level factor that raises both members’ event hazards can make early events in one member informative about the likely risk of the other. The dependence arises when that common factor is unobserved and integrated out; it is not the same as conditional dependence given the factor.

The derivation below concerns one event time for each of two cluster members. It uses a shared frailty and assumes conditional independence of their event times given that frailty. This gives a precise way to describe how a latent common risk induces dependence in the marginal event-time distribution.

Definition: Let \(U\) be a nonnegative shared frailty with \(E(U)=1\) and \(\operatorname{Var}(U)=\theta\). For member \(i\), assume the hazard conditional on \(U\) is \(U\lambda_i(t)\), where \(\lambda_i(t)\) is the member’s hazard in the absence of frailty. Write \(A_i(t)=\int_0^t \lambda_i(s)\,ds\). Conditional on \(U\), the two members’ event times \(T_1,T_2\) are independent, with \(P(T_i>t\mid U)=\exp\{-U A_i(t)\}\). The marginal distribution integrates over \(U\).

The mean-one convention separates the overall hazard scale from the frailty variation: \(\theta=0\) corresponds to a nonrandom frailty equal to one, while larger \(\theta\) means greater variation in shared risk. A common covariate model has \(\lambda_i(t)=\lambda_0(t)\exp(x_i^\mathsf{T}\beta)\), so \(A_i(t)=\Lambda_0(t)\exp(x_i^\mathsf{T}\beta)\). The dependence derivation itself requires only the two cumulative hazards and the shared-frailty assumptions above.

From Conditional Independence to Marginal Dependence

Let \(L_U(s)=E\{\exp(-sU)\}\) be the Laplace transform of the frailty distribution. Conditional independence gives a product of conditional survival probabilities. Integrating that product over the shared \(U\) yields the joint marginal survival:

$$ \begin{aligned} P(T_1>t_1,T_2>t_2) &=E\left[P(T_1>t_1,T_2>t_2\mid U)\right]\\ &=E\left[\exp\{-U[A_1(t_1)+A_2(t_2)]\}\right]\\ &=L_U\{A_1(t_1)+A_2(t_2)\}. \end{aligned} $$

By contrast, each marginal survival is \(P(T_i>t_i)=L_U\{A_i(t_i)\}\). If the two event times were marginally independent, the joint survival would equal the product of those marginal survivals. In general, \(L_U(A_1+A_2)\ne L_U(A_1)L_U(A_2)\). The same random \(U\) appears in both conditional probabilities, so averaging their product is not the same as multiplying their separate averages.

Key result: Under shared frailty and conditional independence, the joint marginal survival is \(L_U(A_1+A_2)\), whereas the product of marginal survivals is \(L_U(A_1)L_U(A_2)\). Their difference is the covariance of the two event-free indicators at the specified times.

To see the sign of that covariance more generally, define \(f(U)=\exp(-A_1U)\) and \(g(U)=\exp(-A_2U)\), for fixed nonnegative cumulative hazards \(A_1,A_2\). Both functions decrease as \(U\) increases. Let \(U'\) be an independent copy of \(U\). Expanding the product and using independence of \(U\) and \(U'\) gives

$$ \operatorname{Cov}\{f(U),g(U)\} =\frac{1}{2}E\left[(f(U)-f(U'))(g(U)-g(U'))\right]\geq 0. $$

The inequality holds because the two differences always have the same sign: if \(U>U'\), both are nonpositive, and if \(U<U'\), both are nonnegative. Thus the event-free indicators have nonnegative covariance. It is strictly positive when the frailty is nondegenerate and both cumulative hazards are positive. If \(\theta=0\), \(U=1\) with probability one and this source of marginal dependence disappears.

Gamma Frailty and Horizon-Specific Dependence

For a gamma frailty with mean one and variance \(\theta>0\), use the shape-rate parameterization \(U\sim\operatorname{Gamma}(1/\theta,1/\theta)\). Its Laplace transform is \(L_U(s)=(1+\theta s)^{-1/\theta}\). Consequently, for horizons \(t_1,t_2\), the joint survival and the covariance of event-free indicators \(I_i=I(T_i>t_i)\) are

$$ \begin{aligned} P(T_1>t_1,T_2>t_2) &=\{1+\theta[A_1(t_1)+A_2(t_2)]\}^{-1/\theta},\\ \operatorname{Cov}(I_1,I_2) &=\{1+\theta(A_1+A_2)\}^{-1/\theta} -\{1+\theta A_1\}^{-1/\theta}\{1+\theta A_2\}^{-1/\theta}. \end{aligned} $$

Here \(A_i\) denotes \(A_i(t_i)\) in the second line. A horizon-specific correlation is this covariance divided by the product of the standard deviations of the two indicators:

$$ \operatorname{Corr}(I_1,I_2) = \frac{\operatorname{Cov}(I_1,I_2)} {\sqrt{S_1(1-S_1)S_2(1-S_2)}}, \qquad S_i=\{1+\theta A_i\}^{-1/\theta}. $$

This correlation describes whether two members are event-free at their respective specified horizons. It is not automatically the correlation between their event times. Both the covariance and the correlation depend on the horizons and cumulative hazards; the correlation can also behave differently from the covariance because its denominator changes.

Worked Example: Covariance at a Fixed Horizon

Suppose two hypothetical cluster members have the same cumulative hazard \(A=0.7\) by a chosen follow-up horizon. Assume shared gamma frailty with \(\theta=0.25\), and conditional independence given \(U\). The marginal event-free probability for either member is

\(S=(1+0.25\times0.7)^{-4}=1.175^{-4}\approx0.52462445.\)

The joint probability that both are event-free is \(S_{12}=(1+0.25\times(0.7+0.7))^{-4}=1.35^{-4}\approx0.30106823.\)

Therefore, using the unrounded values in the subtraction, \(\operatorname{Cov}(I_1,I_2)=0.30106823-(0.52462445)^2\approx0.0258374.\) Each indicator has variance \(S(1-S)\approx0.2493936\), so the correlation is \(0.0258374/0.2493936\approx0.1036.\) At this horizon, event-free status has positive but modest correlation across the two members. This is a model-implied association, not evidence that one member’s event causes or directly changes the other’s event.

Worked Example: Greater Frailty Variance, Greater Horizon Covariance

Keep the same hypothetical cumulative hazards, \(A_1=A_2=0.7\), but compare gamma frailty variances \(\theta=0.25\) and \(\theta=0.5\). For \(\theta=0.5\), the shape is 2 and the marginal event-free probability is \(S=1.35^{-2}\approx0.54869684.\)

The joint event-free probability is \(S_{12}=1.7^{-2}=1/2.89\approx0.34602076.\) Thus the covariance, calculated without subtracting rounded survival probabilities, is \(\operatorname{Cov}(I_1,I_2)=0.34602076-(0.54869684)^2\approx0.0449526,\) or approximately \(0.0450\) to four decimal places.

For comparison, the covariance at \(\theta=0.25\) was approximately \(0.0258374\). In this setting, increasing the variance of the shared gamma frailty increases the horizon-specific covariance. The calculation should not be generalized into a claim that every dependence measure must increase at every pair of horizons; the relevant quantity and time points matter.

Dependence Between Event Times

Joint survival fully describes the bivariate event-time distribution in this continuous-time setting, but it can be useful to calculate a familiar event-time correlation as well. Consider the special case of a constant baseline hazard \(\lambda\), shared gamma frailty \(U\), and conditionally independent event times. Given \(U\), each \(T_i\) has an exponential distribution with rate \(\lambda U\). Therefore \(E(T_i\mid U)=1/(\lambda U)\), and conditional independence gives \(E(T_1T_2\mid U)=1/(\lambda^2U^2)\).

For the gamma parameterization above, inverse moments exist only when their order is below the shape \(1/\theta\). In particular, \(E(U^{-1})\) is finite for \(\theta<1\), and \(E(U^{-2})\) is finite for \(\theta<1/2\). Under the latter condition, \(E(U^{-1})=1/(1-\theta)\) and \(E(U^{-2})=1/\{(1-\theta)(1-2\theta)\}\). The event-time covariance is therefore

$$ \begin{aligned} \operatorname{Cov}(T_1,T_2) &=E(T_1T_2)-E(T_1)E(T_2)\\ &=\frac{1}{\lambda^2} \left\{\frac{1}{(1-\theta)(1-2\theta)} -\frac{1}{(1-\theta)^2}\right\}\\ &=\frac{\theta}{\lambda^2(1-\theta)^2(1-2\theta)}, \qquad 0\leq\theta<\frac12. \end{aligned} $$

Worked Example: Event-Time Correlation Under Exponential Hazards

Suppose, hypothetically, that two members have conditionally exponential event times with \(\lambda=0.2\) per month and shared gamma frailty variance \(\theta=0.25\). The frailty shape is 4, so both required inverse moments are finite. They are \(E(U^{-1})=4/3\) and \(E(U^{-2})=8/3\).

Each marginal mean event time is \(E(T_i)=E\{1/(\lambda U)\}=(4/3)/0.2\approx6.667\) months. The cross-moment is \(E(T_1T_2)=(8/3)/(0.2)^2\approx66.67\) months squared. Hence \(\operatorname{Cov}(T_1,T_2)=66.67-(6.667)^2\approx22.22\) months squared.

For either member, \(E(T_i^2)=2E(U^{-2})/\lambda^2=(16/3)/0.04\approx133.3\) months squared, so \(\operatorname{Var}(T_i)=133.3-(6.667)^2\approx88.89\) months squared. The equal marginal variances imply \(\operatorname{Corr}(T_1,T_2)=22.22/88.89=0.250.\) This is correlation between event times, not the event-free indicator correlation in the fixed-horizon example.

Assumptions, Comparisons, and Failure Modes

The calculations rely on several substantive assumptions. The frailty is shared by the two members, multiplies their hazards, and has the stated distribution and mean. Event times are independent conditional on that frailty and any specified covariates. The event-time example adds a constant conditional baseline hazard; its covariance and correlation formulas also require the indicated finite inverse moments. If these assumptions do not describe the data-generating process, the formulas need not describe the observed dependence.

Shared frailty is one explanation for within-cluster association. A model with no shared latent factor but with conditional dependence specified directly is a different approach; it need not produce the same joint survival structure. Similarly, conditional independence under shared frailty is not marginal independence. Cluster-robust uncertainty calculations address a different question: they can adjust uncertainty for clustering but do not, by themselves, specify this joint event-time distribution.

Dependence summaries also have limitations. A positive covariance of event-free indicators at a selected horizon does not fully characterize the shape or strength of all dependence between event times. Conversely, a single event-time correlation can hide horizon-specific patterns and may not exist when the marginal event-time variance is infinite. In gamma models, the inverse-moment conditions above are essential, not technical decoration.

  • Common mistake: multiplying marginal survivals. The reasoning “the members are conditionally independent, so their marginal survivals multiply” omits the shared random \(U\). The correction is to multiply conditional survivals first, then average: \(E\{\exp[-U(A_1+A_2)]\}=L_U(A_1+A_2)\).
  • Common mistake: treating a horizon correlation as an event-time correlation. The correlation of \(I(T_i>t_i)\) concerns binary status at chosen horizons. The correlation of \(T_1,T_2\) concerns the event times themselves and requires finite second moments.
  • Diagnostic warning: interpreting the fitted frailty as proof of a mechanism. Shared frailty can represent unmeasured common risk, but an observed association alone does not establish its cause. Different unmeasured factors or direct dependencies can also produce clustered outcomes.
  • Numerical warning: rounding too early. Compute the joint survival, marginal survivals, covariance, and variances at full precision, then round the final result. Subtracting separately rounded probabilities can change the reported last digit of a small covariance.
Key takeaway: A shared frailty can make conditionally independent cluster members marginally dependent. For gamma frailty, the joint survival follows directly from the Laplace transform evaluated at the sum of the two cumulative hazards. State which dependence measure and time scale you are reporting.

Check Your Understanding

Try the questions first, then compare with the solutions below.

  1. Under shared frailty, why is conditional independence not enough to conclude marginal independence?
  2. For gamma frailty with \(\theta=0.5\) and equal cumulative hazards \(A_1=A_2=0.7\), what is the joint event-free probability?
  3. What is the covariance of event-free indicators when \(\theta=0\), under the model assumptions?
  4. Why can the gamma-frailty event-time covariance formula not be used at \(\theta=0.6\)?
  5. Distinguish the correlation of two event-free indicators at specified horizons from the correlation of the event times.

Solutions. (1) Conditional probabilities are multiplied at a fixed \(U\), but averaging their product over the common \(U\) generally differs from multiplying the two averages. (2) \(P(T_1>t_1,T_2>t_2)=\{1+0.5(0.7+0.7)\}^{-2}=1.7^{-2}\approx0.3460.\) (3) It is zero: \(\theta=0\) makes \(U=1\) with probability one, leaving no shared random factor. (4) The formula uses \(E(U^{-2})\), which is finite for the gamma frailty only when \(\theta<1/2\); at \(0.6\), the event-time second moments are not finite. (5) The first concerns binary event-free status at chosen times and depends on those horizons; the second concerns the numerical event times and requires finite event-time variances.

Clinical Biostats