Tutorials › Pharmacokinetic-Pharmacodynamic (PK/PD) Modeling › Copula Models For Flexible Endpoint Dependence

Joint Models of Multiple Endpoints · Tutorial 386 of 598

Copula Models For Flexible Endpoint Dependence

You will build Gaussian and Clayton copula models from endpoint marginals, calculate joint densities and binary probabilities, and compare what their dependence parameters imply.

Advanced 11 min read

What You'll Learn

  • State the conditions under which a copula combines two specified marginal distributions.
  • Derive the joint density for a pair of continuous endpoints.
  • Calculate Gaussian and Clayton copula densities from marginal cumulative probabilities.
  • Obtain binary joint probabilities by taking differences of the copula distribution function.
  • Explain why binary outcomes do not uniquely identify a copula away from their observed probability grid.
  • Compare Gaussian and Clayton tail-dependence interpretations and recognize model limitations.

Why Model Dependence Separately From the Margins?

Two pharmacodynamic endpoints can have different marginal distributions and still be associated within a subject. For example, one endpoint might be approximately continuous while another is skewed, bounded, or binary. A copula separates these two modeling tasks: first specify each endpoint's marginal distribution, then use a dependence model to connect them. This lets the marginal model describe each endpoint's scale and shape while the copula describes how their outcomes co-occur.

The separation is useful, but it does not make the dependence parameter self-interpreting. A Gaussian copula parameter describes latent normal association, whereas a Clayton parameter emphasizes lower-tail association. For binary endpoints, the copula's dependence interpretation is more limited still: the observed data constrain the joint distribution at only a few points.

Definition: A copula \(C(u,v)\) is a bivariate cumulative distribution function on \([0,1]^2\) whose two marginal distributions are uniform on \([0,1]\). If \(X_1\) and \(X_2\) have continuous marginal cumulative distribution functions \(F_1\) and \(F_2\), then their joint cumulative distribution function can be written \(F_{12}(x_1,x_2)=C(F_1(x_1),F_2(x_2))\). The copula describes the dependence structure separately from the marginal distributions.

For continuous margins, this representation follows from the probability integral transform: \(U=F_1(X_1)\) and \(V=F_2(X_2)\) are each uniform on \([0,1]\). The copula is their joint distribution. The continuity condition matters: with discrete margins, the transformed values are not continuously distributed uniforms, and a unique copula is generally not determined by the observed joint distribution.

Gaussian and Clayton Copulas

The Gaussian copula is obtained by applying the standard normal cumulative distribution function to a bivariate standard normal pair with correlation \(\rho\). Here \(-1<\rho<1\), \(\Phi\) is the standard normal cumulative distribution function, and \(\Phi^{-1}\) is its inverse.

$$ C_{\mathrm{G}}(u,v;\rho) = \Phi_{2,\rho}\!\left(\Phi^{-1}(u),\Phi^{-1}(v)\right) $$

A value \(\rho=0\) gives independence. Positive and negative values represent positive and negative association, respectively, on the latent normal scale. The Clayton copula instead uses a parameter \(\theta>0\) and is commonly used when stronger lower-tail than upper-tail dependence is scientifically plausible.

$$ C_{\mathrm{Cl}}(u,v;\theta) = \left(u^{-\theta}+v^{-\theta}-1\right)^{-1/\theta} $$

The independence model is the limiting case \(\theta\to0\). Unlike the Gaussian family, the standard Clayton family represents positive dependence only. For a bivariate Gaussian copula with \(|\rho|<1\), asymptotic lower- and upper-tail dependence are both zero. For Clayton, the lower-tail dependence coefficient is \(2^{-1/\theta}\), while upper-tail dependence is zero. These distinctions concern joint behavior in the extremes, not just overall association.

Deriving the Joint Density for Continuous Endpoints

Suppose each endpoint has a continuous density \(f_j\) and cumulative distribution function \(F_j\), for \(j=1,2\). If the copula has density \(c(u,v)\), differentiating the joint cumulative distribution function once with respect to each endpoint gives the paired density.

1
Start with the joint cumulative distribution function.
\(F_{12}(x_1,x_2)=C(F_1(x_1),F_2(x_2))\).
2
Differentiate with respect to \(x_1\).
The chain rule gives \(c_1(F_1(x_1),F_2(x_2))f_1(x_1)\), where \(c_1\) is the derivative of \(C\) with respect to its first argument.
3
Differentiate with respect to \(x_2\).
Applying the chain rule again gives the copula density multiplied by both marginal densities.
$$ f_{12}(x_1,x_2) = c(F_1(x_1),F_2(x_2))f_1(x_1)f_2(x_2) $$

This factorization is a density identity, not an assumption that the endpoints are independent. Under independence, \(C(u,v)=uv\), so \(c(u,v)=1\) and the formula reduces to \(f_{12}=f_1f_2\). With dependence, the copula density adjusts the product of marginal densities. The joint density has units equal to the product of the two endpoint units' reciprocal; the copula density is dimensionless.

For the Gaussian copula, write \(z_1=\Phi^{-1}(u)\) and \(z_2=\Phi^{-1}(v)\). Its density is the bivariate normal density divided by the product of its standard normal marginal densities:

$$ c_{\mathrm{G}}(u,v;\rho) = \frac{1}{\sqrt{1-\rho^2}} \exp\left( \frac{2\rho z_1z_2-\rho^2(z_1^2+z_2^2)} {2(1-\rho^2)} \right) $$

For Clayton, differentiating its copula distribution function gives the density

$$ c_{\mathrm{Cl}}(u,v;\theta) = (1+\theta)(uv)^{-1-\theta} \left(u^{-\theta}+v^{-\theta}-1\right)^{-2-1/\theta} $$

Worked Example: A Gaussian Copula Joint Density

Consider hypothetical continuous endpoints \(X_1\) and \(X_2\) with normal marginal distributions. Select their marginal standard deviations as \(\sigma_1=\phi(1)/0.1210\) and \(\sigma_2=\phi(1)/0.2420\), where \(\phi\) is the standard normal density, and set their means to \(\mu_1=12+\sigma_1\) and \(\mu_2=4-\sigma_2\). Thus, at \(x_1=12\) and \(x_2=4\), the marginal standardized values are \(z_1=-1\) and \(z_2=1\). The marginal densities there are \(f_1(12)=0.1210\) and \(f_2(4)=0.2420\), in the units appropriate to each endpoint. Assume a Gaussian copula with \(\rho=0.5\).

The transformed cumulative probabilities are \(u=\Phi(-1)\) and \(v=\Phi(1)\). Substituting the standardized values and \(\rho=0.5\) into the Gaussian copula density gives

$$ c_{\mathrm{G}}(u,v;0.5) = \frac{1}{\sqrt{1-0.5^2}} \exp\left( \frac{2(0.5)(-1)(1)-(0.5)^2(1+1)} {2(1-0.5^2)} \right) = \frac{e^{-1}}{\sqrt{0.75}} \approx 0.4248 $$

The paired density is therefore

$$ f_{12}(12,4) = 0.1210(0.2420)(0.4248) \approx 0.01244 $$

This is a density, not the probability of observing exactly the pair \((12,4)\); for continuous outcomes that probability is zero. The value \(0.01244\) is expressed per product of endpoint units. The copula factor below one indicates that this particular combination of marginal ranks is less dense under the specified positive dependence model than it would be under independence.

Worked Example: A Clayton Copula Density at the Center

Suppose the transformed endpoint values are \(u=v=0.5\), and use a hypothetical Clayton dependence parameter \(\theta=2\). First, the copula cumulative probability at this point is

$$ C_{\mathrm{Cl}}(0.5,0.5;2) = (0.5^{-2}+0.5^{-2}-1)^{-1/2} = 7^{-1/2} \approx 0.3780 $$

The copula density at the same point is

$$ c_{\mathrm{Cl}}(0.5,0.5;2) = 3(0.25)^{-3}7^{-2.5} = \frac{192}{7^{2.5}} \approx 1.481 $$

If the marginal densities at the corresponding endpoint values were, hypothetically, \(0.20\) and \(0.30\), the joint density would be \(1.481(0.20)(0.30)\approx0.08886\) per product of endpoint units. A copula density greater than one is not a probability greater than one: it is a dimensionless density multiplier at a point.

Binary Endpoints: Probabilities From Rectangle Differences

For binary outcomes, use probabilities rather than a continuous joint density. Let \(Y_j=1\) denote an event, with \(P(Y_1=1)=p_1\) and \(P(Y_2=1)=p_2\). Their marginal cumulative probabilities at zero are \(F_1(0)=1-p_1\) and \(F_2(0)=1-p_2\). The probability of both outcomes being zero is the copula evaluated at those marginal cumulative probabilities. The other cell probabilities follow by subtraction.

$$ \begin{aligned} P(Y_1=0,Y_2=0)&=C(1-p_1,1-p_2),\\ P(Y_1=0,Y_2=1)&=(1-p_1)-C(1-p_1,1-p_2),\\ P(Y_1=1,Y_2=0)&=(1-p_2)-C(1-p_1,1-p_2),\\ P(Y_1=1,Y_2=1)&=p_1+p_2-1+C(1-p_1,1-p_2). \end{aligned} $$

Worked Example: Binary Endpoints With a Clayton Copula

Consider hypothetical binary endpoints with \(p_1=0.30\) and \(p_2=0.40\), linked by a Clayton copula with \(\theta=2\). The probability that both endpoints equal zero is

$$ P(Y_1=0,Y_2=0) = C_{\mathrm{Cl}}(0.70,0.60;2) = (0.70^{-2}+0.60^{-2}-1)^{-1/2} \approx 0.5117 $$

The remaining cells are \(P(0,1)=0.70-0.5117=0.1883\), \(P(1,0)=0.60-0.5117=0.0883\), and \(P(1,1)=0.30+0.40-1+0.5117=0.2117\). They are nonnegative and sum to \(1.0000\); their row and column totals recover the specified marginal probabilities. Under independence, the both-event probability would be \(0.30(0.40)=0.1200\), rather than \(0.2117\). Here the selected copula implies positive binary association, but the numerical value of its continuous-margin parameter should not be read as a binary correlation.

For binary margins, the joint distribution identifies the copula only at the grid points formed by the marginal cumulative probabilities. Many distinct copulas can agree at those points and differ elsewhere. Consequently, a chosen copula family supplies an assumption about dependence beyond what binary observations alone determine. This is why continuous-endpoint interpretations such as tail dependence do not transfer directly to a binary pair.

Choosing, Checking, and Interpreting a Dependence Model

FeatureGaussian copulaClayton copula
Dependence parameter\(\rho\), between \(-1\) and \(1\)\(\theta>0\), with independence as \(\theta\to0\)
Association supportedPositive or negativePositive only
Tail behaviorNo asymptotic tail dependence for \(|\rho|<1\)Lower-tail dependence; no upper-tail dependence
Potential useFlexible overall association when symmetric tail independence is plausiblePositive association with particular interest in joint lower-tail outcomes

Neither family is automatically appropriate because its marginal models fit well. Check whether simulated or predicted paired outcomes reproduce the observed association across the range of the endpoints, including clinically important joint extremes. For continuous outcomes, marginal probability-integral-transform values can help assess whether the dependence structure is plausible; for discrete outcomes, account for the fact that such transformed values are not continuous uniforms. Also check that the implied binary cell probabilities are nonnegative and reproduce the stipulated margins.

A copula is an alternative to representing dependence through shared random effects or a residual covariance structure. Those approaches encode association through latent subject effects or residual distributions; a copula specifies the joint distribution by combining marginals with a dependence function. These are different modeling assumptions, not interchangeable descriptions of a causal mechanism. A fitted copula association does not establish that one endpoint causes the other.

Common pitfall: It is incorrect to interpret a Gaussian copula's \(\rho\), or a Clayton \(\theta\), as the observed correlation between the endpoints. These are parameters of a dependence family on the transformed scale. The observed-scale association also depends on the marginal distributions; with binary outcomes, it depends on the event probabilities as well. Interpret predicted joint probabilities or other explicitly defined association summaries in context.

Copulas provide flexibility, not immunity to misspecification. A single dependence parameter may be inadequate when association changes with covariates, time, or endpoint level. Clayton cannot express negative association, and the Gaussian copula may underrepresent extreme co-occurrence when tail dependence is present. With discrete outcomes, the limited information about the copula away from the marginal probability grid makes family choice particularly consequential. These limitations should shape how confidently model-based joint predictions are interpreted.

Check Your Understanding

Answer each question, then compare your reasoning with the solutions.

  1. For continuous margins, what two ingredients multiply to form the copula-based joint density?
  2. Under a Gaussian copula with \(\rho=0\), what is the joint density in terms of the marginal densities?
  3. For binary margins, why is \(C(1-p_1,1-p_2)\) the probability of two zero outcomes?
  4. Which dependence family in this tutorial permits negative association, and which emphasizes lower-tail dependence?

Solutions. (1) The joint density is \(c(F_1(x_1),F_2(x_2))f_1(x_1)f_2(x_2)\): the copula density multiplier times both marginal densities. (2) At \(\rho=0\), the Gaussian copula is independence and \(c=1\), so \(f_{12}(x_1,x_2)=f_1(x_1)f_2(x_2)\). (3) For each binary endpoint, the cumulative probability at zero is \(P(Y_j\leq0)=P(Y_j=0)=1-p_j\); evaluating the joint cumulative distribution function at those thresholds gives the probability that both are zero. (4) The Gaussian copula permits positive or negative association. Clayton represents positive association and has lower-tail dependence.

Clinical Biostats