Why Contrast Direction Matters
In a multi-arm trial, two estimated treatment contrasts can use some of the same group means. Their estimates are then generally dependent, even when the groups themselves are sampled independently. The direction in which a shared group enters each contrast matters: if both contrasts subtract the group, its sampling variation moves both estimates in the same direction; if one adds it and the other subtracts it, that variation moves the estimates in opposite directions.
The central task here is to read that dependence from the contrast coefficients. A shared group does not guarantee positive covariance: its contribution can be positive or negative, and contributions from several shared groups can offset one another. This is why checking only whether contrasts share an arm is not enough.
Assumptions and the Shared-Group Contribution
Use the following sampling model. Group \(g\) contains \(n_g\) observations \(Y_{gi}\), each with variance \(\sigma_g^2\). Observations are independent within each group, and the groups are independent of one another. The within-group observations have a common variance, though that variance may differ across groups. These assumptions imply \(\operatorname{Var}(\bar Y_g)=v_g=\sigma_g^2/n_g\), and the group means are uncorrelated across distinct groups. Normal outcomes are not required for these covariance calculations.
For two contrasts \(L_1=\sum_g c_g\bar Y_g\) and \(L_2=\sum_g d_g\bar Y_g\), expand their covariance by bilinearity. Terms involving different group means vanish because those means are uncorrelated. For a group included in both contrasts, the remaining term is the product of its two coefficients times its group-mean variance:
This expression is useful here as a group-by-group sign check. If only one group is shared, the covariance is \(c_gd_gv_g\) for that group. Since \(v_g>0\), the sign is determined by whether its two coefficients have the same or opposite signs. If several groups are shared, add their contributions: same-sign coefficient pairs contribute positively, opposite-sign pairs negatively, and exact cancellation can give zero covariance.
The condition \(\sum_g c_g=0\) makes a contrast insensitive to adding the same constant to every group mean. It does not determine the sign of covariance between two contrasts. That sign depends on their shared coefficients and the associated variances \(v_g\).
Worked Example: Two Treatment-Control Contrasts
Suppose a hypothetical trial has control group \(C\) and treatment groups \(A\) and \(B\). The observations are independent within and across groups. The group-mean variances are \(v_C=4\), \(v_A=2\), and \(v_B=3\) score-points squared. Consider \(L_1=\bar Y_A-\bar Y_C\) and \(L_2=\bar Y_B-\bar Y_C\). Both contrasts subtract the same control mean.
The coefficient of \(\bar Y_C\) is \(-1\) in each contrast, so the shared-control contribution is \((-1)(-1)v_C\). The other groups appear in only one contrast each and contribute nothing to their covariance:
For context, \(\operatorname{Var}(L_1)=v_A+v_C=2+4=6\) and \(\operatorname{Var}(L_2)=v_B+v_C=3+4=7\). Their correlation is therefore \(\operatorname{Corr}(L_1,L_2)=4/\sqrt{6\cdot7}=0.6172\). The positive covariance has the expected direction: a random upward fluctuation in the control mean lowers both treatment-minus-control estimates.
The variances used here follow from the stated independent-observation model. For instance, \(v_C=4\) would result from \(n_C=10\) independent observations with common variance \(\sigma_C^2=40\) score-points squared, since \(\sigma_C^2/n_C=40/10=4\).
Opposite Signs and Negative Covariance
Reversing the direction of one comparison reverses the sign of its coefficient on the shared group. The same sampling fluctuation can then push the two estimates in opposite directions. The sign describes dependence between the estimates, not whether the underlying treatment effects are positive or negative.
Worked Example: Contrasts That Use the Shared Arm in Opposite Directions
Keep the hypothetical group-mean variances \(v_A=2\), \(v_C=4\), and \(v_B=3\), under the independent sampling assumptions above. Now compare \(L_1=\bar Y_A-\bar Y_C\) with \(L_2=\bar Y_C-\bar Y_B\). Group \(C\) has coefficient \(-1\) in \(L_1\) and \(+1\) in \(L_2\).
Only \(C\) is shared, and the coefficient product is negative:
The individual contrast variances are \(\operatorname{Var}(L_1)=v_A+v_C=2+4=6\) and \(\operatorname{Var}(L_2)=v_C+v_B=4+3=7\). Thus \(\operatorname{Corr}(L_1,L_2)=-4/\sqrt{42}=-0.6172\). An upward fluctuation in the mean of \(C\) lowers \(L_1\) but raises \(L_2\), explaining the negative sign.
When Contributions Cancel
With more than one shared group, coefficient signs give the sign of each contribution, not necessarily the sign of the total covariance. Contributions are weighted by the relevant group-mean variances, so equal and opposite coefficient products need not cancel if the group variances differ.
Worked Example: Two Shared Arms With Zero Covariance
Consider three independent groups \(A\), \(B\), and \(C\), with group-mean variances \(v_A=2\), \(v_B=1\), and \(v_C=2\) score-points squared. Let \(L_1=\bar Y_A-\bar Y_C\) and \(L_2=\bar Y_A+\bar Y_C-2\bar Y_B\). Both are contrasts because their coefficients sum to zero.
The contrasts share \(A\) and \(C\). At \(A\), the coefficient product is \((+1)(+1)=+1\), contributing \(+2\). At \(C\), it is \((-1)(+1)=-1\), contributing \(-2\). Group \(B\) is not in \(L_1\), so it contributes zero:
As a check, \(\operatorname{Var}(L_1)=v_A+v_C=4\), while \(\operatorname{Var}(L_2)=v_A+v_C+(-2)^2v_B=2+2+4=8\). The correlation is \(0/\sqrt{4\cdot8}=0\). If the two shared groups instead had unequal variances, the same coefficient signs would produce a nonzero covariance: with \(v_A=3\) and \(v_C=2\), for example, it would be \(3-2=1\) score-points squared.
Zero covariance does not in general establish independence. It means that the two estimates have no linear covariance under this model. If the group means, and hence the contrasts, are jointly normal, zero covariance does imply independence; without joint normality, that stronger conclusion is not warranted.
How to Read the Signs Reliably
A reliable calculation keeps the coefficient signs attached to the contrast as written. For each shared group, multiply the coefficient in the first contrast by the coefficient in the second, then weight that product by the group-mean variance. Add the resulting contributions. A group appearing in just one contrast has coefficient zero in the other and contributes nothing.
For example, \(\bar Y_A-\bar Y_C\) and \(\bar Y_C-\bar Y_B\) have opposite coefficients on \(C\).
Do not infer the covariance sign merely from the fact that the two contrasts share an arm.
For each shared group, multiply its two coefficients and its group-mean variance. The total, not any one contribution, determines the covariance sign.
Covariance has squared-outcome units. Correlation divides by the two contrast standard deviations and has no units; it has the same sign as covariance when both variances are positive.
A useful comparison is between sign inspection and a direct calculation from the group means. Direct expansion can verify the result, but the coefficient approach makes the source of each term visible and scales more cleanly when many arms are involved. Neither method can repair a wrong sampling model: if group means are correlated across groups, the cross-group covariance terms that were set to zero must be included.
Diagnostics, Limits, and a Common Pitfall
Before interpreting a computed sign, check that the model supports the calculation. Within each group, independent observations with common variance give \(\operatorname{Var}(\bar Y_g)=\sigma_g^2/n_g\); independence across groups gives zero covariance between distinct group means. If observations within a group are dependent, this variance formula need not hold. If groups are related, the omitted cross-group covariance terms can change the result.
Also check whether you are discussing covariance or correlation. Covariance magnitude depends on the measurement scale and the variances of shared group means. Correlation is standardized, but it still reflects the same coefficient-driven direction. Reversing the sign of an entire contrast reverses its covariance and correlation with another contrast; it does not change the underlying data.
- Common mistake: “These contrasts share the control group, so their covariance must be positive.”
- Correction: Inspect the control coefficients. Two negative coefficients give a positive control contribution; opposite signs give a negative contribution. With multiple shared groups, sum all weighted contributions before deciding the total sign.
- Another pitfall: Treating zero covariance as proof of independence without a joint-normality condition.
These calculations concern sampling dependence between contrast estimates. They do not imply that the observed patient outcomes are correlated across independently assigned groups, nor do they establish a causal relation between treatment effects. They describe how shared estimated group means contribute uncertainty to the contrasts.
Check Your Understanding
Answer each question using the contrast coefficients and the stated group-mean variances. Solutions follow the questions.
- Two contrasts are \(\bar Y_A-\bar Y_C\) and \(\bar Y_B-\bar Y_C\), with \(v_C=5\). What is the shared-control contribution to their covariance, and what is its sign?
- For \(\bar Y_A-\bar Y_C\) and \(\bar Y_C-\bar Y_B\), let \(v_C=3\). Calculate their covariance if \(C\) is their only shared group.
- Let \(L_1=\bar Y_A-\bar Y_C\) and \(L_2=\bar Y_A+\bar Y_C-2\bar Y_B\), with \(v_A=4\), \(v_C=1\), and independent group means. Calculate their covariance.
- What additional distributional condition allows zero covariance between two contrasts to imply their independence?
Solutions. (1) The coefficient product on \(C\) is \((-1)(-1)=1\), so the contribution is \(1(5)=+5\), in squared-outcome units. (2) The product is \((-1)(+1)=-1\), giving covariance \(-1(3)=-3\), in squared-outcome units. (3) Group \(A\) contributes \((+1)(+1)(4)=4\), and \(C\) contributes \((-1)(+1)(1)=-1\). Their sum is \(4-1=3\), in squared-outcome units. (4) Joint normality of the contrasts makes zero covariance sufficient for independence; without it, zero covariance alone is not enough.