Tutorials › Multivariate Statistics (Graduate) › Pitman Efficiency of Multivariate Rank Tests

Ranks and Nonparametric Methods · Tutorial 772 of 975

Pitman Efficiency of Multivariate Rank Tests

Learn to derive the local power of multivariate rank-score tests and compare their Pitman efficiencies under specified radial models.

Advanced 12 min read

What You'll Learn

  • Define local location alternatives and the radial location score in a spherical model
  • Derive the local mean shift and null covariance of a multivariate rank-score statistic
  • Relate its limiting power to a noncentral chi-square distribution
  • Calculate Pitman asymptotic relative efficiency from score-function inner products
  • Compare sign and radial-score tests under Gaussian, Student t, and logistic models
  • Recognize why score norms must be computed under the correct radial distribution

Why Compare Rank Tests Locally?

Two multivariate rank tests can both control their null rejection probability while responding differently to small departures from the null. Pitman efficiency makes that comparison precise: it compares the tests’ power against alternatives that approach the null at rate \(n^{-1/2}\). For location tests, the comparison reveals how a test’s radial score aligns with the location information carried by the assumed radial distribution.

We develop the comparison for a spherical location model in \(p\) dimensions. This setting isolates the role of radial scores. The conclusions apply when the center and scale conventions of the test are fixed; they do not by themselves establish efficiency under every scatter structure or every alternative.

Model, Scores, and Local Alternatives

Definition: Let \(X\in\mathbb{R}^p\) have density \(x\mapsto g(\|x-\theta\|)\), where \(g\) is a radial density generator and \(\theta\in\mathbb{R}^p\) is the location. Under the null, \(\theta=0\). Write \(R=\|X\|\), \(U=X/\|X\|\) when \(X\ne0\), and let \(F_R\) denote the null distribution function of \(R\). The radial location score is \(\psi(r)=-g'(r)/g(r)\), wherever \(g(r)>0\) and differentiable. The location score vector at the null is \(\psi(R)U\).

Assume throughout that the null distribution is absolutely continuous, \(P(R=0)=0\), and the location family is differentiable in quadratic mean at zero. Assume also that \(0<E[\psi(R)^2]<\infty\), so the location Fisher information is finite and nonzero. A local alternative has the form \(\theta_n=h/\sqrt n\), where \(h\in\mathbb{R}^p\) is fixed.

For a score function \(\phi:[0,1]\to\mathbb{R}\), define the radial rank-score statistic \(S_n=n^{-1/2}\sum_{i=1}^n\phi(R_{i:n}/(n+1))U_i\), where \(R_{i:n}\) is the rank of \(R_i=\|X_i\|\) among the observed radii. We use bounded, sufficiently regular scores for which replacing \(R_{i:n}/(n+1)\) by \(F_R(R_i)\) changes \(S_n\) by \(o_p(1)\) under the null and under the stated local alternatives. This rank-substitution condition holds for standard smooth score choices under the usual continuity and moment conditions. The rank version is distribution-free in its radial ordering under the spherical null; its local power still depends on the radial model.

The probability integral transform \(V=F_R(R)\) is uniform on \((0,1)\) under the null. Define \(c_\phi=E[\phi(V)^2]=\int_0^1\phi(v)^2\,dv\) and \(a_\phi=E[\phi(F_R(R))\psi(R)]\). These two quantities will determine the test’s null scale and its local response.

Local Limit and Power

Theorem: Under the regularity conditions above, suppose \(c_\phi>0\) and the rank statistic and location central sequence have a joint normal limit. Under the null, \(S_n\) converges in distribution to \(N_p(0,(c_\phi/p)I_p)\). Under \(\theta_n=h/\sqrt n\), its limiting distribution is \(N_p((a_\phi/p)h,(c_\phi/p)I_p)\). Consequently, \(Q_n=(p/c_\phi)S_n^\mathsf{T}S_n\) converges under the null to \(\chi^2_p\), and under the local alternative to a noncentral \(\chi^2_p\) distribution with noncentrality parameter \(\lambda_\phi(h)=a_\phi^2\|h\|^2/(p c_\phi)\).

Here \(I_p\) is the \(p\)-dimensional identity matrix. The joint-limit condition is standard for smooth rank scores with finite score variance; it lets us use the local likelihood expansion to obtain the alternative limit rather than trying to calculate the distribution of the statistic directly under each alternative.

Derivation. Under spherical symmetry, \(U\) is uniform on the unit sphere and independent of \(R\). Rotational symmetry gives \(E[UU^\mathsf{T}]=I_p/p\). With \(V=F_R(R)\), the limiting covariance of a single score vector is therefore \(E[\phi(V)^2UU^\mathsf{T}]=(c_\phi/p)I_p\). The rank-substitution condition transfers this covariance to the rank statistic. The central sequence for location is \(n^{-1/2}\sum_i\psi(R_i)U_i\). Its cross-covariance with the score statistic is \(E[\phi(F_R(R))\psi(R)UU^\mathsf{T}]=(a_\phi/p)I_p\). By differentiability in quadratic mean, the location model is locally asymptotically normal with this central sequence. The local-alternative change-of-measure result for jointly asymptotically normal statistics then shifts the limiting mean by the cross-covariance matrix times \(h\), giving \((a_\phi/p)h\), while leaving the limiting covariance unchanged. Finally, standardizing this normal vector gives the stated central and noncentral chi-square limits. \(\square\)

The theorem makes the efficiency comparison explicit. The radial score expressed on the uniform rank scale is \(q_f(v)=\psi(F_R^{-1}(v))\), with \(F_R^{-1}\) the radial quantile function. Since \(a_\phi=\int_0^1\phi(v)q_f(v)\,dv\), the local response is an inner product of score functions. For the efficient location score, \(a_{q_f}=c_{q_f}=E[\psi(R)^2]\).

Definition: The Pitman asymptotic relative efficiency of the test using \(\phi\), relative to the test using the efficient radial location score \(q_f\), is the ratio of their local noncentrality parameters for the same \(h\): \(\operatorname{ARE}(\phi,q_f)=\dfrac{a_\phi^2}{c_\phi E[\psi(R)^2]}=\dfrac{\left(\int_0^1\phi(v)q_f(v)\,dv\right)^2}{\left(\int_0^1\phi(v)^2\,dv\right)\left(\int_0^1q_f(v)^2\,dv\right)}.\)

This is a squared cosine in the space of square-integrable functions on \((0,1)\). Cauchy–Schwarz implies that the efficiency is at most one, with equality when \(\phi\) is proportional to \(q_f\) almost everywhere. If the inner product is zero, the test has zero first-order sensitivity to these local location shifts. For two non-efficient scores \(\phi_1\) and \(\phi_2\), compare \(a_{\phi_1}^2/c_{\phi_1}\) with \(a_{\phi_2}^2/c_{\phi_2}\); the common factor \(\|h\|^2/p\) cancels.

Worked Comparisons

Worked Example: Sign Scores Under a Bivariate Gaussian Model

Suppose \(p=2\) and \(X\sim N_2(\theta,I_2)\). The radial density generator is proportional to \(\exp(-r^2/2)\), so \(\psi(r)=r\). The efficient rank score is \(q_f(v)=F_R^{-1}(v)\), where \(R\) has a chi distribution with two degrees of freedom.

For the sign score \(\phi(v)=1\), \(c_\phi=\int_0^1 1\,dv=1\), and \(a_\phi=E[R]\). The two-dimensional Gaussian radius has \(E[R]=\sqrt{\pi/2}\) and \(E[R^2]=2\). Thus \(E[\psi(R)^2]=2\), and \(\operatorname{ARE}(\text{sign},q_f)=(E[R])^2/E[R^2]=(\pi/2)/2=\pi/4\), approximately \(0.785\).

The sign test therefore has about 78.5% of the efficient test’s local noncentrality under this model. The comparison is about local power, not a statement that the sign test is inferior for every distribution or every alternative.

Worked Example: A Radial Linear Score Under a Bivariate Student t Model

Let \(p=2\), \(\theta\) be the location, and \(X\) follow a Student \(t\) distribution with four degrees of freedom and identity scale. Its radial generator is proportional to \((1+r^2/4)^{-3}\), so \(\psi(r)=6r/(4+r^2)\). Compare the radial linear score \(\phi(F_R(r))=r\) with the efficient score \(\psi\).

Set \(Z=R^2/4\). The radial density is proportional to \(r(1+r^2/4)^{-3}\); changing variables gives the density \(2(1+z)^{-3}\) for \(z>0\), since \(2\int_0^\infty(1+z)^{-3}\,dz=1\). Hence \(E[Z]=2\int_0^\infty z(1+z)^{-3}\,dz=1\), so \(c_\phi=E[R^2]=4E[Z]=4\).

The cross-moment is \(a_\phi=E[R\psi(R)]=6E[R^2/(4+R^2)]=6E[Z/(1+Z)]\). Using the density of \(Z\), \(E[Z/(1+Z)]=2\int_0^\infty z(1+z)^{-4}\,dz=1/3\), and therefore \(a_\phi=2\).

For the efficient score norm, \(E[\psi(R)^2]=36E[R^2/(4+R^2)^2]=9E[Z/(1+Z)^2]\). Also \(E[Z/(1+Z)^2]=2\int_0^\infty z(1+z)^{-5}\,dz=1/6\), giving \(E[\psi(R)^2]=3/2\). Thus \(\operatorname{ARE}(\phi,q_f)=a_\phi^2/(c_\phi E[\psi(R)^2])=4/(4\cdot3/2)=2/3\).

The radial linear score has two-thirds the efficient local noncentrality for this model. The calculations use the Student \(t\) radial distribution; substituting a Gaussian radial moment here would give the wrong comparison.

Worked Example: Sign-Score Efficiency Under a Bivariate Logistic Model

For a one-dimensional logistic location model with density \(g(x)=1/[4\cosh^2(x/2)]\), the radial variable is \(R=|X|\). Its radial distribution function is \(F_R(r)=\tanh(r/2)\), and its radial score is \(\psi(r)=\tanh(r/2)\). Therefore \(q_f(v)=v\). This example illustrates the score calculation in one dimension before applying the same inner-product comparison to multivariate settings.

For the sign score \(\phi(v)=1\), \(c_\phi=1\) and \(a_\phi=\int_0^1v\,dv=1/2\). The efficient score norm is \(\int_0^1v^2\,dv=1/3\). The relative efficiency is \((1/2)^2/(1\cdot1/3)=3/4\). The efficient score \(q_f(v)=v\) itself has efficiency one.

A related weighted-norm calculation shows why the measure used in an expectation must be stated. If a radial variable \(Y\) has density \(2(1-y)\) on \((0,1)\) and \(q(y)=3\sqrt{y(1-y)}\), then \(E[q(Y)^2]=18\int_0^1 y(1-y)\,2(1-y)\,dy =18\left(\frac12-\frac23+\frac14\right)=\frac32\). The parenthesized integral is \(1/12\), so the coefficient remains 18 in this last step. This is a weighted radial expectation, not the uniform rank-score norm \(\int_0^1q(v)^2\,dv\).

Interpreting the Comparison

The formula separates two ingredients. The denominator \(c_\phi\) measures the null variability contributed by the chosen score. The numerator \(a_\phi^2\) measures how strongly that score aligns with the radial location score of the model. A score can have a large norm without having a large local response: components orthogonal to \(q_f\) add variability but no first-order location signal.

This is why there is no universally most efficient rank score across all radial distributions. A score tuned to one radial location score may align less well with another. The analysis here compares local location power under a specified spherical model; it does not settle robustness to contamination, performance against large shifts, or power for non-location alternatives.

Common Pitfall

  • Using the wrong measure for a score norm. A rank score norm is \(c_\phi=\int_0^1\phi(v)^2\,dv\), because the null rank percentile is uniform. A moment such as \(E[q(Y)^2]\) for a nonuniform radial variable \(Y\) must instead be integrated against the density of \(Y\). Replacing one measure by the other changes the efficiency calculation.
  • Comparing only score slopes. A larger cross-moment alone does not imply greater efficiency. The score’s null variance \(c_\phi\) must also be included.
  • Reading Pitman efficiency as a universal ranking. The ratio is tied to local \(n^{-1/2}\) location alternatives and the radial model used to define \(q_f\). Different models or alternatives can reverse the comparison.
Key takeaway: Under regular local location alternatives, multivariate rank-score power is governed by the squared alignment between the chosen score and the radial location score, divided by the chosen score’s null variance. Compute both using the correct radial or uniform-rank measure.

Check Your Understanding

Use the local power and efficiency formulas to answer these questions.

  1. Why is the null covariance of a spherical score vector proportional to \(I_p\)? What determines its scalar multiplier?
  2. For a fixed alternative direction \(h\), which two score-dependent quantities determine the noncentrality parameter?
  3. What condition on \(\phi\) gives efficiency one relative to the radial location score?
  4. In the bivariate Student \(t\) example, verify that \(E[Z/(1+Z)^2]=1/6\) using the stated density of \(Z\).
  5. Why is a score norm under a nonuniform radial variable not generally equal to the rank-score norm?
Clinical Biostats