Tutorials › Stochastic Processes › Concentration for Random Permutations by Exposure

Martingale Applications · Tutorial 792 of 994

Concentration for Random Permutations by Exposure

Build an exposure martingale for a uniform random permutation and use swap sensitivity to obtain explicit concentration bounds.

Advanced 12 min read

What You'll Learn

  • Define the exposure filtration and conditional-expectation martingale for a permutation statistic
  • Prove an increment bound by coupling completions that differ by a transposition
  • Apply Azuma-Hoeffding with the correct increment bounds and degenerate-case convention
  • Work out the fixed-point martingale along a specified sequence of revelations
  • Bound deviations of assignment sums and inversion counts using swap sensitivity
  • Recognize why sampling without replacement must be handled conditionally

Exposing a Random Permutation One Value at a Time

A statistic of a random permutation often depends on all \(n\) assignments, so its distribution can be difficult to calculate directly. Instead, reveal the permutation sequentially and track the conditional expectation of the statistic after each revelation. These conditional expectations form a martingale. If changing two assigned values cannot change the statistic very much, then the martingale increments are bounded, and Azuma-Hoeffding gives a deviation bound.

Fix an integer \(n\ge1\). Take \(\Omega\) to be the set of all permutations of \(\{1,\ldots,n\}\), let \(\mathcal{F}\) be its power set, and give each permutation probability \(1/n!\). Write \(\Pi(i)\) for the value assigned to position \(i\), so \(\Pi\) is uniform on these \(n!\) possibilities. Let \(F= f(\Pi)\) be a real-valued statistic. For \(0\le k\le n\), let \(\mathcal{F}_k=\sigma(\Pi(1),\ldots,\Pi(k))\), with \(\mathcal{F}_0=\{\varnothing,\Omega\}\), and define \(M_k=\mathbb{E}[F\mid\mathcal{F}_k]\). Thus \((M_k)_{k=0}^n\) is a real-valued process with time indices \(0,\ldots,n\), on this probability space, with state space \(\mathbb{R}\) and filtration \((\mathcal{F}_k)\).

Definition (transposition sensitivity): Say that \(f\) has sensitivity at most \(L\) if, for every permutation \(\pi\) and every pair of distinct positions \(r,s\), exchanging the values \(\pi(r)\) and \(\pi(s)\) changes \(f(\pi)\) by at most \(L\) in absolute value. The exchange is a transposition of the assigned values; all other assignments remain unchanged.

The key point is that the unexposed assignments are not independent draws. Given the first \(k\) values, the remaining values are assigned uniformly over the remaining positions. The proof below uses this conditional uniformity directly.

The Exposure Increment Bound

Theorem (permutation exposure bound): Let \(\Pi\) be uniform on the permutations of \(\{1,\ldots,n\}\), and suppose \(f\) has transposition sensitivity at most \(L\). For the filtration and martingale \(M_k=\mathbb{E}[f(\Pi)\mid\mathcal{F}_k]\), every increment satisfies \(|M_k-M_{k-1}|\le L\) almost surely, for \(1\le k\le n\).

Proof. Fix \(k\) and a possible history \(\Pi(1),\ldots,\Pi(k-1)\). Let \(R\) be the set of values not yet revealed. For each \(a\in R\), let \(g(a)\) be the conditional expectation of \(f(\Pi)\) given this history and \(\Pi(k)=a\). We first show that \(|g(a)-g(b)|\le L\) for any \(a,b\in R\). If \(a=b\), this difference is zero. If \(a\ne b\), pair every completion with \(\Pi(k)=a\) to a completion with \(\Pi(k)=b\) as follows: locate the position \(r\) holding \(b\) in the first completion, then exchange the values at positions \(k\) and \(r\). This gives a bijection between the completions in the two conditional sets, because the same exchange reverses the map. Corresponding completions differ by one transposition, so their \(f\)-values differ by at most \(L\). Averaging over the paired completions gives \(|g(a)-g(b)|\le L\).

Given the fixed history, each value in \(R\) is equally likely to be \(\Pi(k)\). Consequently \(M_{k-1}\) is the average of the numbers \(g(a)\), \(a\in R\), while \(M_k=g(\Pi(k))\). All these numbers lie in an interval of length at most \(L\), by the pairwise bound just proved. A number in that interval differs from their average by at most \(L\). Hence \(|M_k-M_{k-1}|\le L\). The history and \(k\) were arbitrary, so the bound holds almost surely for every increment. \(\square\)

This argument also explains why an exposure martingale is useful: its increment bound comes from comparing conditional expectations across possible next revelations, rather than trying to compute the full distribution of \(F\).

Concentration consequence: Under the theorem's assumptions, for \(t>0\), if \(nL^2>0\), then $$ \mathbb{P}\bigl(|f(\Pi)-\mathbb{E}f(\Pi)|\ge t\bigr) \le 2\exp\left(-\frac{t^2}{2nL^2}\right). $$ More generally, if the increments have bounds \(c_k\ge0\), the denominator is \(2\sum_{k=1}^n c_k^2\), provided this sum is positive. If \(\sum_{k=1}^n c_k^2=0\), every increment is zero almost surely, so \(M_n=M_0\) almost surely and the probability is zero for every \(t>0\).

Indeed, \(M_0=\mathbb{E}f(\Pi)\) and \(M_n=f(\Pi)\). The stated bound follows by applying the Azuma-Hoeffding inequality for martingale differences with deterministic bounds \(c_k\), a standard result established in the earlier material on Azuma-Hoeffding inequalities. When all bounds equal \(L\), \(\sum_{k=1}^n c_k^2=nL^2\). If this sum is zero, nonnegativity implies every \(c_k=0\); the increment bounds then give \(M_k=M_{k-1}\) almost surely at every step. This handles constant statistics and avoids an undefined denominator.

Worked Example: Exposing the Fixed Points of a Permutation

For \(n=4\), let \(F\) count the fixed points, that is, positions \(i\) for which \(\Pi(i)=i\). Initially each position has probability \(1/4\) of being fixed, so \(M_0=\mathbb{E}F=4(1/4)=1\). Consider the revelations \(\Pi(1)=2,\ \Pi(2)=1,\ \Pi(3)=3,\ \Pi(4)=4\).

After \(\Pi(1)=2\), position 1 is not fixed, and value 2 is no longer available. Position 2 therefore cannot be fixed. Positions 3 and 4 each have conditional probability \(1/3\) of receiving their own value among the three remaining values \(\{1,3,4\}\). Thus \(M_1=0+0+1/3+1/3=2/3\).

After also revealing \(\Pi(2)=1\), neither of the first two positions is fixed. The remaining values 3 and 4 are assigned uniformly to positions 3 and 4. Each position has conditional probability \(1/2\) of being fixed, so \(M_2=1/2+1/2=1\). Upon revealing \(\Pi(3)=3\), position 3 is fixed and the last value must be 4, so \(M_3=2\) and \(M_4=2\). The martingale values along this path are \(1,2/3,1,2,2\), with increments \(-1/3,1/3,1,0\). Their sum is \(2-1=1\), the difference between the observed statistic and its expectation.

Check: The resulting permutation is \((2,1,3,4)\). Its fixed points are exactly 3 and 4, so \(F=2=M_4\). The four increments sum to \(-1/3+1/3+1+0=1\), as required.

For any \(n\ge1\), exchanging two assigned values can change fixed-point status only at the two affected positions. Each of their indicators changes by at most 1, so the fixed-point count has sensitivity at most 2. The theorem therefore gives, for \(t>0\), $$ \mathbb{P}\bigl(|F-1|\ge t\bigr)\le 2\exp\left(-\frac{t^2}{8n}\right). $$ Here \(\mathbb{E}F=1\), since each of the \(n\) positions has probability \(1/n\) of receiving its own value. For example, with \(n=10\) and \(t=8\), the bound is \(2\exp(-64/80)=2e^{-4/5}\). This is a valid upper bound even if a particular choice of threshold makes it uninformative; a probability bound can always also be replaced by its minimum with 1.

Worked Example: A Weighted Assignment Sum

Let \(n=3\), let the position weights be \(a=(0,1,2)\), and let the values be \(b=(1,3,4)\). Consider \(F=\sum_{i=1}^3 a_i b_{\Pi(i)}\), where \(\Pi\) is uniform on the six permutations. Since each value is equally likely at each position, \(\mathbb{E}F=(a_1+a_2+a_3)(b_1+b_2+b_3)/3=(0+1+2)(1+3+4)/3=8\).

For a direct check, the six statistic values, in the order \((123),(132),(213),(231),(312),(321)\), are \(11,10,9,6,7,5\). Their sum is \(11+10+9+6+7+5=48\), and their average is \(48/6=8\).

Now expose the path \(\Pi(1)=2,\Pi(2)=3,\Pi(3)=1\). After \(\Pi(1)=2\), the first term is \(a_1b_2=0\). The remaining values \(b_1=1\) and \(b_3=4\) are assigned uniformly to positions 2 and 3. The conditional expected remaining sum is \((a_2+a_3)(b_1+b_3)/2=(1+2)(1+4)/2=15/2\), so \(M_1=15/2\). After also revealing \(\Pi(2)=3\), the second term is \(a_2b_3=1\cdot4=4\), and the last term is \(a_3b_1=2\cdot1=2\). Hence \(M_2=M_3=6\). The path increments are \(15/2-8=-1/2\), \(6-15/2=-3/2\), and \(6-6=0\); they sum to \(6-8=-2\).

Swapping the values assigned to positions \(r\) and \(s\) changes \(F\) by \((a_r-a_s)(b_{\pi(s)}-b_{\pi(r)})\). Here \(|a_r-a_s|\le2\) and \(|b_{\pi(s)}-b_{\pi(r)}|\le3\), so sensitivity is at most \(6\). Azuma-Hoeffding gives \(\mathbb{P}(|F-8|\ge t)\le2\exp(-t^2/216)\) for \(t>0\), since \(2nL^2=2\cdot3\cdot36=216\).

Check: On the specified path, \(F=0\cdot3+1\cdot4+2\cdot1=6\). The increments sum to \(-1/2-3/2+0=-2=F-\mathbb{E}F\), and the six-value enumeration independently gives expectation 8.

Worked Example: Inversions in a Three-Value Permutation

An inversion is a pair \(i<j\) for which \(\Pi(i)>\Pi(j)\). For \(n=3\), let \(F\) be the number of inversions. Each of the three position pairs is inverted with probability \(1/2\), because swapping the two values in that pair gives a bijection between permutations where it is and is not inverted. Thus \(\mathbb{E}F=3(1/2)=3/2\).

For a direct enumeration, the inversion counts for \((123),(132),(213),(231),(312),(321)\) are \(0,1,1,2,2,3\), respectively. Their sum is \(0+1+1+2+2+3=9\), and \(9/6=3/2\).

A transposition of two positions can affect only comparisons involving at least one of those positions. With three positions, there are at most three such pairs: the pair formed by the swapped positions and the two pairs involving the third position. Each comparison indicator changes by at most 1, so the inversion statistic has sensitivity at most 3. Therefore, for \(t>0\), $$ \mathbb{P}\bigl(|F-3/2|\ge t\bigr)\le2\exp\left(-\frac{t^2}{54}\right), $$ because \(2nL^2=2\cdot3\cdot9=54\).

Check: The possible inversion counts range from 0 to 3, and the enumeration gives mean \(3/2\). The claimed sensitivity bound covers all three pair indicators that could change in a transposition; no unaffected pair contributes to the difference.

Common Mistake: Treating the Remaining Values as Independent

After one value has been revealed, the remaining values are sampled without replacement. For example, in the fixed-point calculation with \(n=4\) and \(\Pi(1)=2\), position 2 cannot be fixed, since value 2 has already been used. The correct conditional expectation is \(0+0+1/3+1/3=2/3\). Counting position 2 as having probability \(1/3\) of being fixed would give the incorrect value \(1\). After \(\Pi(2)=1\) is also revealed, positions 3 and 4 each have probability \(1/2\), not 1, of receiving their own value: the two remaining values have not yet been assigned to those positions. Their combined expected contribution is 1.

A second error is to use the sensitivity bound as though it were a bound on the total deviation. The theorem bounds each martingale increment; the tail estimate depends on the sum of the squared increment bounds. With \(n\) increments bounded by \(L\), that sum is \(nL^2\), not \(L^2\). If all increment bounds are zero, do not substitute into a formula with a zero denominator: the martingale is constant and every positive-threshold deviation event has probability zero.

The method applies whenever a statistic is defined on a uniform permutation and a transposition sensitivity bound can be established. The conditional-expectation martingale handles the dependence created by sampling without replacement, while the sensitivity calculation supplies the quantitative control needed for concentration.

Check Your Understanding

For each question, identify the conditioning information and check any numerical bound by substituting its parameters.

  1. For the fixed-point statistic on four positions, after revealing \(\Pi(1)=3\), compute the conditional expected number of fixed points.
  2. Why does coupling completions with next values \(a\) and \(b\) establish a bound on the difference of conditional expectations?
  3. For a statistic with \(n=5\) exposure increments, each bounded in absolute value by 2, write the Azuma-Hoeffding bound for a deviation of at least \(t>0\).
  4. If all increment bounds \(c_k\) are zero, what is the probability of a deviation of at least \(t>0\), and why?
  5. For the inversion count on three positions, verify the mean from the six possible permutations and state the transposition sensitivity bound used above.