Why Model Dependence Separately From the Margins?
Two pharmacodynamic endpoints can have different marginal distributions and still be associated within a subject. For example, one endpoint might be approximately continuous while another is skewed, bounded, or binary. A copula separates these two modeling tasks: first specify each endpoint's marginal distribution, then use a dependence model to connect them. This lets the marginal model describe each endpoint's scale and shape while the copula describes how their outcomes co-occur.
The separation is useful, but it does not make the dependence parameter self-interpreting. A Gaussian copula parameter describes latent normal association, whereas a Clayton parameter emphasizes lower-tail association. For binary endpoints, the copula's dependence interpretation is more limited still: the observed data constrain the joint distribution at only a few points.
For continuous margins, this representation follows from the probability integral transform: \(U=F_1(X_1)\) and \(V=F_2(X_2)\) are each uniform on \([0,1]\). The copula is their joint distribution. The continuity condition matters: with discrete margins, the transformed values are not continuously distributed uniforms, and a unique copula is generally not determined by the observed joint distribution.
Gaussian and Clayton Copulas
The Gaussian copula is obtained by applying the standard normal cumulative distribution function to a bivariate standard normal pair with correlation \(\rho\). Here \(-1<\rho<1\), \(\Phi\) is the standard normal cumulative distribution function, and \(\Phi^{-1}\) is its inverse.
A value \(\rho=0\) gives independence. Positive and negative values represent positive and negative association, respectively, on the latent normal scale. The Clayton copula instead uses a parameter \(\theta>0\) and is commonly used when stronger lower-tail than upper-tail dependence is scientifically plausible.
The independence model is the limiting case \(\theta\to0\). Unlike the Gaussian family, the standard Clayton family represents positive dependence only. For a bivariate Gaussian copula with \(|\rho|<1\), asymptotic lower- and upper-tail dependence are both zero. For Clayton, the lower-tail dependence coefficient is \(2^{-1/\theta}\), while upper-tail dependence is zero. These distinctions concern joint behavior in the extremes, not just overall association.
Deriving the Joint Density for Continuous Endpoints
Suppose each endpoint has a continuous density \(f_j\) and cumulative distribution function \(F_j\), for \(j=1,2\). If the copula has density \(c(u,v)\), differentiating the joint cumulative distribution function once with respect to each endpoint gives the paired density.
\(F_{12}(x_1,x_2)=C(F_1(x_1),F_2(x_2))\).
The chain rule gives \(c_1(F_1(x_1),F_2(x_2))f_1(x_1)\), where \(c_1\) is the derivative of \(C\) with respect to its first argument.
Applying the chain rule again gives the copula density multiplied by both marginal densities.
This factorization is a density identity, not an assumption that the endpoints are independent. Under independence, \(C(u,v)=uv\), so \(c(u,v)=1\) and the formula reduces to \(f_{12}=f_1f_2\). With dependence, the copula density adjusts the product of marginal densities. The joint density has units equal to the product of the two endpoint units' reciprocal; the copula density is dimensionless.
For the Gaussian copula, write \(z_1=\Phi^{-1}(u)\) and \(z_2=\Phi^{-1}(v)\). Its density is the bivariate normal density divided by the product of its standard normal marginal densities:
For Clayton, differentiating its copula distribution function gives the density
Worked Example: A Gaussian Copula Joint Density
Consider hypothetical continuous endpoints \(X_1\) and \(X_2\) with normal marginal distributions. Select their marginal standard deviations as \(\sigma_1=\phi(1)/0.1210\) and \(\sigma_2=\phi(1)/0.2420\), where \(\phi\) is the standard normal density, and set their means to \(\mu_1=12+\sigma_1\) and \(\mu_2=4-\sigma_2\). Thus, at \(x_1=12\) and \(x_2=4\), the marginal standardized values are \(z_1=-1\) and \(z_2=1\). The marginal densities there are \(f_1(12)=0.1210\) and \(f_2(4)=0.2420\), in the units appropriate to each endpoint. Assume a Gaussian copula with \(\rho=0.5\).
The transformed cumulative probabilities are \(u=\Phi(-1)\) and \(v=\Phi(1)\). Substituting the standardized values and \(\rho=0.5\) into the Gaussian copula density gives
The paired density is therefore
This is a density, not the probability of observing exactly the pair \((12,4)\); for continuous outcomes that probability is zero. The value \(0.01244\) is expressed per product of endpoint units. The copula factor below one indicates that this particular combination of marginal ranks is less dense under the specified positive dependence model than it would be under independence.
Worked Example: A Clayton Copula Density at the Center
Suppose the transformed endpoint values are \(u=v=0.5\), and use a hypothetical Clayton dependence parameter \(\theta=2\). First, the copula cumulative probability at this point is
The copula density at the same point is
If the marginal densities at the corresponding endpoint values were, hypothetically, \(0.20\) and \(0.30\), the joint density would be \(1.481(0.20)(0.30)\approx0.08886\) per product of endpoint units. A copula density greater than one is not a probability greater than one: it is a dimensionless density multiplier at a point.
Binary Endpoints: Probabilities From Rectangle Differences
For binary outcomes, use probabilities rather than a continuous joint density. Let \(Y_j=1\) denote an event, with \(P(Y_1=1)=p_1\) and \(P(Y_2=1)=p_2\). Their marginal cumulative probabilities at zero are \(F_1(0)=1-p_1\) and \(F_2(0)=1-p_2\). The probability of both outcomes being zero is the copula evaluated at those marginal cumulative probabilities. The other cell probabilities follow by subtraction.
Worked Example: Binary Endpoints With a Clayton Copula
Consider hypothetical binary endpoints with \(p_1=0.30\) and \(p_2=0.40\), linked by a Clayton copula with \(\theta=2\). The probability that both endpoints equal zero is
The remaining cells are \(P(0,1)=0.70-0.5117=0.1883\), \(P(1,0)=0.60-0.5117=0.0883\), and \(P(1,1)=0.30+0.40-1+0.5117=0.2117\). They are nonnegative and sum to \(1.0000\); their row and column totals recover the specified marginal probabilities. Under independence, the both-event probability would be \(0.30(0.40)=0.1200\), rather than \(0.2117\). Here the selected copula implies positive binary association, but the numerical value of its continuous-margin parameter should not be read as a binary correlation.
For binary margins, the joint distribution identifies the copula only at the grid points formed by the marginal cumulative probabilities. Many distinct copulas can agree at those points and differ elsewhere. Consequently, a chosen copula family supplies an assumption about dependence beyond what binary observations alone determine. This is why continuous-endpoint interpretations such as tail dependence do not transfer directly to a binary pair.
Choosing, Checking, and Interpreting a Dependence Model
| Feature | Gaussian copula | Clayton copula |
|---|---|---|
| Dependence parameter | \(\rho\), between \(-1\) and \(1\) | \(\theta>0\), with independence as \(\theta\to0\) |
| Association supported | Positive or negative | Positive only |
| Tail behavior | No asymptotic tail dependence for \(|\rho|<1\) | Lower-tail dependence; no upper-tail dependence |
| Potential use | Flexible overall association when symmetric tail independence is plausible | Positive association with particular interest in joint lower-tail outcomes |
Neither family is automatically appropriate because its marginal models fit well. Check whether simulated or predicted paired outcomes reproduce the observed association across the range of the endpoints, including clinically important joint extremes. For continuous outcomes, marginal probability-integral-transform values can help assess whether the dependence structure is plausible; for discrete outcomes, account for the fact that such transformed values are not continuous uniforms. Also check that the implied binary cell probabilities are nonnegative and reproduce the stipulated margins.
A copula is an alternative to representing dependence through shared random effects or a residual covariance structure. Those approaches encode association through latent subject effects or residual distributions; a copula specifies the joint distribution by combining marginals with a dependence function. These are different modeling assumptions, not interchangeable descriptions of a causal mechanism. A fitted copula association does not establish that one endpoint causes the other.
Copulas provide flexibility, not immunity to misspecification. A single dependence parameter may be inadequate when association changes with covariates, time, or endpoint level. Clayton cannot express negative association, and the Gaussian copula may underrepresent extreme co-occurrence when tail dependence is present. With discrete outcomes, the limited information about the copula away from the marginal probability grid makes family choice particularly consequential. These limitations should shape how confidently model-based joint predictions are interpreted.
Check Your Understanding
Answer each question, then compare your reasoning with the solutions.
- For continuous margins, what two ingredients multiply to form the copula-based joint density?
- Under a Gaussian copula with \(\rho=0\), what is the joint density in terms of the marginal densities?
- For binary margins, why is \(C(1-p_1,1-p_2)\) the probability of two zero outcomes?
- Which dependence family in this tutorial permits negative association, and which emphasizes lower-tail dependence?
Solutions. (1) The joint density is \(c(F_1(x_1),F_2(x_2))f_1(x_1)f_2(x_2)\): the copula density multiplier times both marginal densities. (2) At \(\rho=0\), the Gaussian copula is independence and \(c=1\), so \(f_{12}(x_1,x_2)=f_1(x_1)f_2(x_2)\). (3) For each binary endpoint, the cumulative probability at zero is \(P(Y_j\leq0)=P(Y_j=0)=1-p_j\); evaluating the joint cumulative distribution function at those thresholds gives the probability that both are zero. (4) The Gaussian copula permits positive or negative association. Clayton represents positive association and has lower-tail dependence.