Why Eigenvalues Set Urn Fluctuation Rates
In an adaptive allocation scheme represented by an urn, the current composition affects the next draw, and the draw affects the composition that follows. Consequently, composition fluctuations are not simply sums of independent increments. Their rates depend on how strongly the replacement mechanism amplifies or damps departures from its long-run composition. Eigenvalues provide a way to describe that behavior mode by mode.
The central comparison is between a nonleading eigenvalue’s real part and one half, after the replacement matrix has been normalized by the number of balls added per draw. This comparison identifies the natural scale of a composition mode; by itself, it does not establish the mode’s limiting distribution. The result is most direct for balanced urns with a simple leading eigenvalue and well-behaved replacement noise.
Model and Eigenvalue Conventions
Consider an urn with \(d\) colors. Write \(Z_n\) for the column vector of color counts after \(n\) draws, and \(T_n=\sum_{i=1}^{d}Z_{n,i}\) for the total number of balls. At each draw, a ball is selected with probability equal to its color’s proportion in the urn. It is returned, and a replacement vector is added. The replacement vector may depend on the color drawn; its conditional mean, given that color, is the corresponding column of a \(d\)-by-\(d\) matrix \(R\). In this convention, column \(j\) describes the mean replacement when color \(j\) is drawn.
Assume that the total number added is the same positive constant \(c\) at every draw. Thus \(T_n=T_0+nc\). The replacement vectors are assumed to be nonnegative and bounded, and the urn starts with positive counts. For the standard rate classification, also assume that the mean replacement matrix is irreducible and that its eigenvalue \(c\) is simple. These conditions ensure a unique positive leading composition direction. Less restrictive or unbalanced models require separate analysis.
A right eigenvector describes a direction in the color-count coordinates. For deviations from the leading composition, the relevant directions have total zero. A left eigenvector is useful for extracting the scalar coordinate of a deviation along a mode. In particular, if \(\ell^{T}A=\lambda\ell^{T}\), then applying \(\ell^{T}\) to the centered count vector isolates the mode associated with \(\lambda\).
Because the principal eigenvalue is \(1\), nonleading modes are compared with the threshold \(1/2\) on the normalized scale. Equivalently, for an eigenvalue \(\rho\) of the unnormalized matrix \(R\), compare \(\operatorname{Re}(\rho)\) with \(c/2\). For complex eigenvalues the real part, not the magnitude, determines the basic power rate.
From the Recursion to the Rate Threshold
The rate comparison follows from a simple linear recursion. Let \(Y_n=Z_n-T_n v\) denote the count deviation from the leading composition at the current total. Write \(\mathcal{F}_n\) for the information available after draw \(n\), and let \(\xi_{n+1}\) be the difference between the replacement vector at draw \(n+1\) and its conditional mean given \(\mathcal{F}_n\). Then \(E(\xi_{n+1}\mid\mathcal{F}_n)=0\). Since the probability of drawing each color is its current proportion, the conditional mean replacement is \(RZ_n/T_n\). Using \(Rv=cv\), the centered recursion is
To see this, substitute \(Z_n=Y_n+T_n v\) into the conditional mean increment. The mean replacement is \(RZ_n/T_n=cAY_n/T_n+cv\). The term \(cv\) is exactly the increase in \(T_n v\), leaving \(Y_n+cAY_n/T_n\); since \(T_n=c(n+a)\), the displayed recursion follows after adding the mean-zero noise.
Project the recursion onto a left eigenvector \(\ell\) with eigenvalue \(\lambda\), and set \(U_n=\ell^{T}Y_n\). Then
The product of the scalar multipliers from one step to \(n\) grows at order \(n^{\lambda}\). For a complex \(\lambda\), its magnitude grows at order \(n^{\operatorname{Re}(\lambda)}\). After dividing by that product, the contribution of the noise at step \(k\) is weighted at order \(k^{-\lambda}\). If the projected noise has nonzero, bounded variance, the accumulated variance is therefore governed by a sum of the form \(\sum_{k\le n} k^{-2\operatorname{Re}(\lambda)}\). That sum converges when the real part exceeds one half, grows logarithmically at one half, and grows at order \(n^{1-2\operatorname{Re}(\lambda)}\) below one half. This yields the rate classification below.
- If \(\operatorname{Re}(\lambda)<1/2\), the noise accumulation gives the usual order \(\sqrt{n}\).
- If \(\operatorname{Re}(\lambda)=1/2\), the boundary scale is \(\sqrt{n\log n}\).
- If \(\operatorname{Re}(\lambda)>1/2\), the mode can retain early randomness and has order \(n^{\operatorname{Re}(\lambda)}\).
Worked Examples: Reading the Three Regimes
Worked Example: A Subcritical Mode
Suppose a two-color urn adds exactly 10 balls per draw, with mean replacement matrix
Each column sums to 10, so the urn is balanced with \(c=10\). The vector \((1,1)^T\) is an eigenvector with eigenvalue 10, and the contrast vector \((1,-1)^T\) has eigenvalue 2. The normalized nonleading eigenvalue is therefore \(\lambda=2/10=0.2\), which is less than \(1/2\). The leading composition is \(v=(1/2,1/2)^T\), since the principal eigenvector has equal coordinates. The contrast in the color counts is on the \(\sqrt n\) scale under the stated noise conditions; the difference between the two color proportions is on the \(n^{-1/2}\) scale. The eigenvalue places the mode below the threshold; it does not by itself specify the limiting variance or distribution.
Worked Example: An Above-Threshold Mode
Now consider a balanced urn with
Again, each column sums to 10. The principal eigenvalue is 10, with leading composition \((1/2,1/2)^T\). The contrast vector \((1,-1)^T\) has eigenvalue \(8-2=6\), so its normalized eigenvalue is \(\lambda=6/10=0.6\). Since \(0.6>1/2\), this is an above-threshold mode. Its count deviation can have order \(n^{0.6}\), and its proportion deviation can have order \(n^{-0.4}\). In particular, \(n^{0.6}\) grows faster than \(\sqrt n=n^{0.5}\), so the mode is not at the usual square-root count scale. The specific limiting behavior requires additional results and conditions.
Worked Example: A Critical Mode
Consider a third urn with
Both columns sum to 10. The trace is 15 and the determinant is \(8(7)-3(2)=50\), so the eigenvalues solve \(x^2-15x+50=0\). Factoring gives \((x-10)(x-5)=0\). The normalized nonleading eigenvalue is \(5/10=1/2\): this mode is exactly at the threshold. The principal eigenvector satisfies \(-2v_1+3v_2=0\), so its coordinates are proportional to \(3\) and \(2\), giving \(v=(0.6,0.4)^T\). Under the standard noise conditions, the critical count mode has scale \(\sqrt{n\log n}\), and its proportion mode has scale \(\sqrt{\log n/n}\). The logarithmic factor distinguishes this boundary case from the strictly subcritical scale.
Conditions, Diagnostics, and Limits
The classification is useful only if the model and its spectral quantities are correctly specified. Check that total additions really are fixed at \(c\), that the matrix columns follow the stated convention, and that the matrix used in the threshold comparison is \(A=R/c\), not \(R\) itself. Verify that the eigenvalue \(1\) is the simple leading eigenvalue and that the remaining modes describe deviations rather than a second leading direction. In a numerical calculation, recompute the eigenvalues after normalizing the matrix and check that rounding has not moved a value across \(1/2\).
The noise also matters. The rate argument uses bounded or suitably controlled increments and nonzero variation in the projected noise direction. If the replacement mechanism produces no random variation in a mode, its noise-driven scale may not apply; the deterministic recursion or initial deviation can then be more important. Close to the threshold, finite samples can make the regimes difficult to distinguish: a value just below one half may show slow convergence, while a value just above it may resemble square-root behavior for a long time.
For a nonreal eigenvalue, the basic magnitude rate is controlled by its real part. The mode may also rotate as it grows or decays. If an eigenvalue has a nontrivial Jordan block, additional logarithmic factors can arise, so the simple power-rate summary is not a complete description. Likewise, if the urn is unbalanced, its total is not \(T_0+nc\), and the centered recursion and normalization must be reconsidered.
This eigenvalue view complements, rather than replaces, other descriptions. The earlier material on Pólya urn proportions and Dirichlet limits concerns a classical scheme with persistent randomness in its proportions; the simple-leading-eigenvalue rate calculation here does not apply unchanged when multiple directions share the leading eigenvalue. Linearization near an allocation target provides a related local-drift perspective, while the eigenvalue calculation organizes that drift into modes. Neither an eigenvalue classification nor a rate alone gives a complete distributional limit, a covariance formula, or a finite-sample guarantee.
Common Mistakes
- Comparing a raw eigenvalue with one half. The threshold applies to \(R/c\). For example, an eigenvalue \(6\) with \(c=10\) corresponds to \(0.6\), not 6, on the normalized scale.
- Using the eigenvalue’s magnitude for a complex mode. The basic power rate depends on \(\operatorname{Re}(\lambda)\), not \(|\lambda|\).
- Treating a rate as a distributional conclusion. A square-root scale does not, by itself, prove a Gaussian limit. That conclusion needs additional conditions and a limit theorem.
- Calling a mode above threshold when it is below, or vice versa. Check the normalized value explicitly against \(1/2\), including equality as the critical case.
- Ignoring degeneracy or model structure. Balance, a simple leading eigenvalue, and noise in the projected direction are substantive conditions, not automatic consequences of computing eigenvalues.
Check Your Understanding
Use the normalized eigenvalue and state the rate in context. Solutions follow the questions.
- A balanced urn adds \(c=8\) balls per draw. A nonleading eigenvalue of \(R\) is 3. Which regime applies, and what is the count scale?
- A normalized nonleading eigenvalue is \(0.5\). What are the count and proportion scales?
- For a complex normalized eigenvalue \(0.3+0.4i\), which quantity determines the basic power-rate regime, and which regime follows?
- Why is it not enough to report that a mode has order \(\sqrt n\) in order to claim a Gaussian limit?
Solutions. (1) The normalized eigenvalue is \(3/8=0.375<1/2\), so the count mode is on the \(\sqrt n\) scale. (2) The mode is critical: counts have scale \(\sqrt{n\log n}\), and proportions have scale \(\sqrt{\log n/n}\). (3) The real part is \(0.3\), which is below \(1/2\); the basic count scale is \(\sqrt n\). (4) A rate describes the magnitude of fluctuations, not their limiting distribution. A Gaussian conclusion requires further assumptions and a suitable limit theorem, including control of the noise and its conditional variance.