Why K-Arm Allocation Fluctuations Are Joint
In a trial with \(K\) treatment arms, the allocation proportions are not \(K\) unrelated estimates. At every sample size, they sum to one: allocating a larger fraction to one arm necessarily leaves a smaller total fraction for the others. Consequently, even when a Gaussian limit describes the fluctuations around an interior allocation target, its covariance matrix must reflect this exact constraint.
The goal here is to express that joint structure precisely. The key result is that the limiting covariance is singular in the full \(K\)-dimensional space: fluctuations lie in the \((K-1)\)-dimensional subspace whose coordinates sum to zero. This does not prevent useful inference. It means that one should work with \(K-1\) free coordinates or with contrasts between arms, rather than treating all \(K\) proportions as independent.
Allocation Vectors and the Simplex Constraint
Let \(N_{n,i}\) be the number assigned to arm \(i\) among the first \(n\) trial participants, for \(i=1,\ldots,K\). Define the allocation-proportion vector by \(\hat{\boldsymbol v}_n=(N_{n,1}/n,\ldots,N_{n,K}/n)'\), and let \(\boldsymbol v=(v_1,\ldots,v_K)'\) be its target. Each vector of proportions belongs to the probability simplex.
For the Gaussian limit considered here, assume the target is fixed and interior and that the design satisfies conditions yielding a centered, root-\(n\) Gaussian limit:
The assumptions include that the allocation proportions converge to \(\boldsymbol v\) and that the relevant fluctuations have a Gaussian limit under the design's regularity conditions. In an adaptive design, this limit and its covariance must account for the allocation mechanism and its feedback; convergence to the target alone does not establish a Gaussian limit. The earlier material on Gaussian fluctuations and estimator-allocation feedback provides the relevant asymptotic setting. This tutorial focuses on the additional joint structure imposed by \(K\)-arm proportions.
Why the Limiting Covariance Must Be Singular
At every \(n\), \(\boldsymbol 1'\hat{\boldsymbol v}_n=1\), and \(\boldsymbol 1'\boldsymbol v=1\). Subtracting these equalities gives an exact identity, not an approximation:
Therefore any distributional limit \(Z\) must also satisfy \(\boldsymbol 1'Z=0\) with probability one. In particular, \(\Sigma=\operatorname{Cov}(Z)\) obeys \(\Sigma\boldsymbol 1=\boldsymbol 0\). The covariance is positive semidefinite and has rank at most \(K-1\); it cannot be positive definite as a \(K\times K\) matrix. For a nondegenerate Gaussian limit in every tangent direction, its rank is exactly \(K-1\).
This conclusion follows directly from the exact constraint. If \(Z\) is centered and \(\boldsymbol 1'Z=0\) almost surely, then \(\Sigma\boldsymbol 1=E[Z(Z'\boldsymbol 1)]=\boldsymbol 0\). Because covariance matrices are symmetric, the column sums and row sums are both zero. The result does not require independent allocations or a particular adaptive rule.
A Free-Coordinate Representation
One way to work with the constrained limit is to retain the first \(K-1\) components. The last component is determined by their sum. Define the \((K-1)\times(K-1)\) matrix \(\Gamma\) as the covariance matrix of \((Z_1,\ldots,Z_{K-1})'\), and set \(B=\begin{pmatrix}I_{K-1}\\-\boldsymbol 1_{K-1}'\end{pmatrix}\). Since \(Z_K=-\sum_{i=1}^{K-1}Z_i\), \(Z=B(Z_1,\ldots,Z_{K-1})'\), and therefore:
This is a parameterization of every covariance matrix supported on \(\mathcal T\): any positive semidefinite \(\Gamma\) yields a positive semidefinite \(\Sigma\) with zero row and column sums, and a tangent-supported \(\Sigma\) is recovered by taking its upper-left \((K-1)\times(K-1)\) block as \(\Gamma\). If the limit is nondegenerate on the tangent subspace, \(\Gamma\) is positive definite. Other choices of \(K-1\) coordinates are possible; the last arm is not statistically special.
Worked Example: Reconstructing a Three-Arm Covariance
Suppose, hypothetically, that the first two components of a three-arm Gaussian allocation limit have covariance \(\Gamma=\begin{pmatrix}0.04&0.01\\0.01&0.09\end{pmatrix}\). The numbers are variances and covariances on the root-\(n\) scale, not variances of the raw proportions at a specified sample size.
For three arms, \(B=\begin{pmatrix}1&0\\0&1\\-1&-1\end{pmatrix}\). Using \(\Sigma=B\Gamma B'\), the covariance with the third component is obtained by negating the row sums of \(\Gamma\): \(\operatorname{Cov}(Z_1,Z_3)=-(0.04+0.01)=-0.05\) and \(\operatorname{Cov}(Z_2,Z_3)=-(0.01+0.09)=-0.10\). The third variance is \(0.04+0.09+2(0.01)=0.15\). Hence
Each row sums to zero, as required. For the contrast between arms 1 and 2, use \(c=(1,-1,0)'\): its limiting variance is \(c'\Sigma c=0.04+0.09-2(0.01)=0.11\). For arm 1 versus arm 3, \(c=(1,0,-1)'\), giving \(c'\Sigma c=0.04+0.15-2(-0.05)=0.29\). Both are variances of root-\(n\)-scaled contrasts.
Contrasts and the Meaning of Covariance
A contrast is a linear combination \(c'Z\) with \(\boldsymbol 1'c=0\). Its variance is \(c'\Sigma c\), and it measures uncertainty in a comparison of allocation fluctuations that does not depend on an arbitrary overall level. Differences between two arms use \(c=e_i-e_j\), where \(e_i\) is the \(i\)th coordinate vector. The corresponding variance is:
The negative covariance often present between arms matters: ignoring it can substantially misstate the uncertainty of a difference. More generally, even if a vector \(c\) does not sum to zero, the constraint implies that \(c'Z\) equals the contrast formed by \(c-(\boldsymbol 1'c/K)\boldsymbol 1\), because \(\boldsymbol 1'Z=0\). Only the component of a coefficient vector along \(\mathcal T\) affects the random limit.
Worked Example: Multinomial Allocation Noise
Consider a hypothetical nonadaptive design that independently assigns each participant to one of three arms with probabilities \(\boldsymbol v=(0.2,0.3,0.5)'\). Each assignment is a one-hot vector \(X_t\), with a 1 for the assigned arm and 0 elsewhere. Its mean is \(\boldsymbol v\), and its covariance is \(\operatorname{diag}(\boldsymbol v)-\boldsymbol v\boldsymbol v'\). The usual multivariate central limit theorem for the sample average gives the following root-\(n\) covariance:
For example, the first variance is \(0.2(1-0.2)=0.16\), while the covariance between arms 1 and 3 is \(-0.2(0.5)=-0.10\). The rows sum to zero. To compare arms 1 and 3, take \(c=(1,0,-1)'\), so \(c'\Sigma c=0.16+0.25-2(-0.10)=0.61\). At \(n=100\), the approximate variance of the observed proportion difference is \(0.61/100=0.0061\); its standard error is \(\sqrt{0.0061}=0.0781\), in proportion units.
This covariance is specifically the multinomial allocation-noise covariance. It is not automatically the covariance for an adaptive trial, where allocation probabilities can depend on accumulated responses or estimates.
What Changes Under Adaptive Allocation
For an adaptive design, let \(\boldsymbol\pi_t\) denote the conditional allocation-probability vector immediately before participant \(t\) is assigned. Conditional on the observed history, the one-hot allocation vector \(X_t\) has mean \(\boldsymbol\pi_t\). Its allocation innovation, \(X_t-\boldsymbol\pi_t\), has conditional covariance \(\operatorname{diag}(\boldsymbol\pi_t)-\boldsymbol\pi_t\boldsymbol\pi_t'\). If \(\boldsymbol\pi_t\) approaches \(\boldsymbol v\) suitably, this describes the limiting covariance of the allocation innovations under the corresponding martingale conditions.
But the final allocation fluctuation also reflects how the probabilities \(\boldsymbol\pi_t\) themselves move in response to past observations. That feedback can add variation, reduce it in some directions, and create covariance terms. Thus the multinomial formula is a useful benchmark, not a universal answer for an adaptive design. The full asymptotic covariance must come from the applicable adaptive-limit result, including its feedback and estimation contributions. Whatever that full covariance is, the exact sum-to-one constraint still requires \(\Sigma\boldsymbol 1=\boldsymbol 0\).
Worked Example: Building a Four-Arm Covariance from Free Coordinates
Suppose a hypothetical four-arm adaptive limit has covariance for its first three components \(\Gamma=\operatorname{diag}(0.02,0.03,0.04)\). This example specifies a possible free-coordinate covariance; it does not assert that a particular adaptive design produces it. The final fluctuation is \(Z_4=-(Z_1+Z_2+Z_3)\), so its variance is \(0.02+0.03+0.04=0.09\), and its covariances with the first three components are respectively \(-0.02,-0.03,-0.04\). Therefore:
For the arm 1 versus arm 4 contrast, the limiting variance is \(0.02+0.09-2(-0.02)=0.15\). If \(n=400\), the corresponding approximate variance for the observed proportion difference is \(0.15/400=0.000375\), giving standard error \(\sqrt{0.000375}=0.0194\) in proportion units. The factor \(1/n\) converts the root-\(n\) limit covariance to the approximate covariance of the unscaled proportions.
Diagnostics, Alternatives, and Limitations
A covariance calculation should be checked against the geometry of the allocation vector before it is used. The following checks catch common implementation and interpretation errors:
- Check the constraint: verify that each row and column of the reported full covariance sums to zero, up to rounding. Equivalently, check that \(\Sigma\boldsymbol 1\) is numerically close to zero.
- Check positive semidefiniteness: all eigenvalues should be nonnegative in exact arithmetic. Tiny negative eigenvalues can result from rounding; a substantial negative eigenvalue indicates an invalid covariance calculation.
- Check the rank: a nondegenerate limit on the tangent subspace has \(K-1\) positive eigenvalues and one zero eigenvalue in the full \(K\)-dimensional representation.
- Check the scale: \(\Sigma\) describes the limit of \(\sqrt n(\hat{\boldsymbol v}_n-\boldsymbol v)\). The approximate covariance of \(\hat{\boldsymbol v}_n\) is \(\Sigma/n\), not \(\Sigma\).
There are several valid representations, each useful for a different purpose. The full singular covariance displays all arm-to-arm covariances; a \(K-1\) coordinate covariance \(\Gamma\) avoids a redundant coordinate; and contrast variances directly answer questions about differences among arms. The multinomial covariance is appropriate for independent categorical assignments with fixed probabilities. It is not a substitute for an adaptive covariance that includes response-driven changes in allocation.
The interior Gaussian result also has limits. At a boundary target, some proportions approach zero and root-\(n\) Gaussian behavior can fail or require different scaling; the tangent-space covariance result alone does not establish a suitable limit there. Likewise, a covariance matrix does not establish asymptotic normality: the limit may be non-Gaussian or degenerate in additional directions. Finally, the covariance depends on the design and its response feedback, not only on the target proportions.
Check Your Understanding
Answer each question using the simplex constraint and the covariance relationships developed above. Solutions follow the questions.
- Why must the limiting covariance of a centered Gaussian allocation-proportion vector satisfy \(\Sigma\boldsymbol 1=\boldsymbol 0\)?
- For a three-arm limit, the first two components have covariance \(\Gamma=\begin{pmatrix}0.05&-0.01\\-0.01&0.08\end{pmatrix}\). Find the covariances of each of those components with the third component, and the variance of the third component.
- In the three-arm multinomial example with \(\boldsymbol v=(0.2,0.3,0.5)'\), what is the limiting variance of the arm 2 versus arm 3 contrast?
- If a reported four-arm covariance has row sums close to zero but one eigenvalue is substantially negative, is it a valid covariance matrix? Explain.
- Does \(\operatorname{diag}(\boldsymbol v)-\boldsymbol v\boldsymbol v'\) necessarily give the full asymptotic covariance in an adaptive trial? Why or why not?
Solutions. (1) The centered allocation vector sums to zero exactly at every sample size, so its Gaussian limit lies in the sum-zero subspace. Thus \(\Sigma\boldsymbol 1=E[Z(Z'\boldsymbol 1)]=\boldsymbol 0\). (2) The covariances with the third component are the negatives of the first two row sums of \(\Gamma\): \(-(0.05-0.01)=-0.04\) and \(-(-0.01+0.08)=-0.07\). The third variance is the sum of all entries of \(\Gamma\), \(0.05-0.01-0.01+0.08=0.11\). (3) For \(c=(0,1,-1)'\), \(c'\Sigma c=0.21+0.25-2(-0.15)=0.76\). (4) No. A covariance must be positive semidefinite; a substantial negative eigenvalue violates this condition even if the row-sum constraint holds. (5) No. That formula describes the one-step allocation innovation covariance in the fixed-probability multinomial case. Adaptive feedback can also contribute to the full allocation fluctuation covariance.