Tutorials › Statistical Theory I - Probability and Distribution Theory › Uniform Spacings and the Simplex Constraint

Ranks, Spacings, and Empirical Laws · Tutorial 477 of 994

Uniform Spacings and the Simplex Constraint

Learn how ordered uniform observations partition the unit interval into \(n+1\) nonnegative gaps whose lengths sum to one.

Advanced 9 min read

What You'll Learn

  • Define all \(n+1\) spacings, including the two endpoint gaps.
  • Prove that every spacing is nonnegative and the spacings sum to one.
  • Distinguish the closed simplex constraint from the almost-surely strict inequalities of a continuous sample.
  • Recover ordered observations from their spacings by cumulative sums.
  • Interpret zero gaps as ties or endpoint observations.
  • Work out spacing vectors and reconstructions for small samples.

From Ordered Observations to Gaps

A sample of points in the unit interval can be described either by the locations of its ordered observations or by the lengths of the intervals between them. The second description is useful because it turns the whole collection of observations into a vector of gaps. That vector is constrained: each gap is nonnegative, and together the gaps exactly fill the unit interval.

Let \(X_1,\ldots,X_n\) be independent random variables, each uniformly distributed on \((0,1)\), where \(n\geq 1\). Write their order statistics as \(X_{(1)}\leq X_{(2)}\leq\cdots\leq X_{(n)}\). To include the intervals at both ends of the unit interval, set \(X_{(0)}=0\) and \(X_{(n+1)}=1\).

Definition: The \(n+1\) uniform spacings are \(D_i=X_{(i+1)}-X_{(i)}\), for \(i=0,1,\ldots,n\). In particular, \(D_0=X_{(1)}\) is the gap from 0 to the smallest observation, and \(D_n=1-X_{(n)}\) is the gap from the largest observation to 1. Each \(D_i\) is a random variable.

There are \(n+1\) gaps, not \(n-1\): the intervals before the first observation and after the last observation count as spacings too. The word “uniform” identifies the sampling distribution; it does not mean that the realized gaps are equal in length.

The Simplex Constraint

The defining differences immediately impose a geometric restriction on the spacing vector. It is convenient to name the set of all vectors satisfying this restriction.

Definition: The closed \(n\)-simplex in \(\mathbb{R}^{n+1}\) is \(\Delta_n=\{(d_0,\ldots,d_n): d_i\geq 0\text{ for every }i,\ \sum_{i=0}^{n}d_i=1\}\). Its relative interior is the set of vectors in \(\Delta_n\) for which every coordinate is strictly positive.

Although a spacing vector has \(n+1\) coordinates, its unit-sum condition means that only \(n\) coordinates can be chosen freely: the remaining coordinate must make the total equal to one. Thus the simplex is \(n\)-dimensional, lying inside \(\mathbb{R}^{n+1}\).

Theorem: For every ordered sample \(0\leq X_{(1)}\leq\cdots\leq X_{(n)}\leq 1\), its spacing vector belongs to \(\Delta_n\). In particular, all spacings are nonnegative and \(\sum_{i=0}^{n}D_i=1\).

Proof. By the ordering and the endpoint definitions, \(X_{(i+1)}\geq X_{(i)}\) for \(i=0,\ldots,n\). Subtracting gives \(D_i=X_{(i+1)}-X_{(i)}\geq 0\) for every \(i\). For the total, substitute the differences and cancel consecutive terms:

$$ \sum_{i=0}^{n}D_i =\sum_{i=0}^{n}\bigl(X_{(i+1)}-X_{(i)}\bigr) =X_{(n+1)}-X_{(0)} =1-0 =1. $$

The cancellation is telescoping: each interior order statistic appears once with a plus sign and once with a minus sign. Therefore the vector satisfies both defining conditions of \(\Delta_n\). \(\square\)

Worked Examples

Worked Example: Three Observations and Four Gaps

Suppose the ordered observations are \(0.12,\ 0.41,\ 0.78\). Here \(n=3\), so there are four spacings. Include both endpoints, giving \(X_{(0)}=0\) and \(X_{(4)}=1\).

Calculate each successive difference:

$$ \begin{aligned} D_0&=0.12-0=0.12,\\ D_1&=0.41-0.12=0.29,\\ D_2&=0.78-0.41=0.37,\\ D_3&=1-0.78=0.22. \end{aligned} $$

Each value is nonnegative. Their sum is \(0.12+0.29+0.37+0.22=1.00\), as required. The four gaps partition the full interval from 0 to 1.

Worked Example: One Observation

For a single observation \(X_1=0.64\), the order statistic is \(X_{(1)}=0.64\). There are two gaps, one on each side of the observation:

$$ D_0=0.64-0=0.64,\qquad D_1=1-0.64=0.36. $$

Both are nonnegative, and \(D_0+D_1=0.64+0.36=1\). This smallest case makes clear why the endpoint gaps are part of the definition: even with only one observation, the unit interval has two resulting pieces.

Recovering the Ordered Sample

The gaps do not lose information about the ordered observations. Starting at zero, add the gaps from left to right to recover each observation. Conversely, taking successive differences of the ordered observations recovers the gaps.

Theorem: The mapping from ordered samples \((x_{(1)},\ldots,x_{(n)})\) satisfying \(0\leq x_{(1)}\leq\cdots\leq x_{(n)}\leq1\) to their gap vectors is a bijection onto \(\Delta_n\). Its inverse is \(x_{(k)}=\sum_{j=0}^{k-1}d_j\), for \(k=1,\ldots,n\).

Proof. First take any ordered sample and define its gaps by differences. For \(k=1,\ldots,n\), summing the first \(k\) gaps gives

$$ \sum_{j=0}^{k-1}D_j =\sum_{j=0}^{k-1}\bigl(X_{(j+1)}-X_{(j)}\bigr) =X_{(k)}-X_{(0)} =X_{(k)}. $$

So the cumulative-sum formula recovers every order statistic. To verify the reverse direction, begin with any \((d_0,\ldots,d_n)\in\Delta_n\), and define \(x_{(0)}=0\) and \(x_{(k)}=\sum_{j=0}^{k-1}d_j\) for \(k=1,\ldots,n\). Since each \(d_j\geq0\), these values are nondecreasing. Also, each partial sum is at most the full sum 1, so \(x_{(n)}\leq1\). The successive differences of these values are \(d_0,\ldots,d_{n-1}\), and the final difference is

$$ 1-x_{(n)} =1-\sum_{j=0}^{n-1}d_j =d_n, $$

where the last equality uses \(\sum_{j=0}^{n}d_j=1\). Thus every vector in \(\Delta_n\) comes from an ordered sample, and the cumulative sums uniquely determine that sample. This proves the bijection. \(\square\)

Worked Example: Reconstructing Observations From Gaps

Consider the proposed spacing vector \((0.08,\ 0.12,\ 0.33,\ 0.38,\ 0.09)\), which has five coordinates and so corresponds to \(n=4\) ordered observations. First check the constraint: \(0.08+0.12+0.33+0.38+0.09=1.00\), and every coordinate is nonnegative.

Recover the ordered observations using cumulative sums:

$$ \begin{aligned} x_{(1)}&=0.08,\\ x_{(2)}&=0.08+0.12=0.20,\\ x_{(3)}&=0.08+0.12+0.33=0.53,\\ x_{(4)}&=0.08+0.12+0.33+0.38=0.91. \end{aligned} $$

The final gap checks against the right endpoint: \(1-0.91=0.09\). Taking the five successive differences of \(0,\ 0.08,\ 0.20,\ 0.53,\ 0.91,\ 1\) returns exactly the proposed vector.

Strict Gaps With Probability One

The simplex condition allows zero coordinates. For example, a zero interior spacing means two consecutive ordered observations are equal; a zero endpoint spacing means an observation is at 0 or 1. These possibilities are included in the closed simplex as boundary cases. For an independent continuous uniform sample, however, they occur with probability zero.

Theorem: If \(X_1,\ldots,X_n\) are independent and uniformly distributed on \((0,1)\), then \(D_i>0\) for every \(i=0,\ldots,n\), with probability one.

Proof. A uniform random variable assigns probability zero to each individual point, so \(P(X_j=0)=P(X_j=1)=0\) for every \(j\). For any distinct \(j\) and \(k\), independence and the continuous uniform distribution give

$$ P(X_j=X_k) =\int_{0}^{1}P(X_k=x)\,dx =\int_{0}^{1}0\,dx =0. $$

The probability that any observation is an endpoint or that any pair of observations is equal is at most the sum of finitely many zero probabilities, hence is zero. Outside this event, all observations lie strictly between 0 and 1 and are distinct. Their order statistics then satisfy \(0<X_{(1)}<\cdots<X_{(n)}<1\), so every successive difference, including both endpoint gaps, is strictly positive. \(\square\)

This result distinguishes two useful statements: the spacing vector always satisfies the closed-simplex constraints, while a continuous uniform sample lands in the simplex’s relative interior with probability one. The first is a deterministic consequence of ordering; the second uses the sampling assumptions.

Common Mistake and Why the Constraint Matters

A frequent error is to count only the spaces between observations and omit the two endpoint gaps. For \(n\) ordered observations there are \(n-1\) interior intervals, but the partition of \([0,1]\) also includes the interval from 0 to the first point and the interval from the last point to 1. The total is therefore \((n-1)+2=n+1\) spacings.

Another mistake is to treat all \(n+1\) gaps as freely selectable. They must add to exactly one, so choosing \(n\) of them determines the last. A proposed vector with nonnegative entries but total \(0.9\), for instance, cannot be the complete set of gaps on \([0,1]\); it leaves \(0.1\) of the interval unaccounted for.

The simplex description is a geometric characterization, not by itself a probability distribution for the gap vector. It tells which vectors are possible under the ordering construction. Describing how probability is distributed across that simplex requires additional results. For now, the key structural fact is that ordered sample locations and their \(n+1\) gaps are equivalent descriptions, linked by differences and cumulative sums.

Check Your Understanding

Use the endpoint definitions and the simplex constraint to answer these questions.

  1. How many spacings are formed by \(n=5\) ordered observations, and which two are the endpoint gaps?
  2. For ordered observations \(0.25\) and \(0.70\), calculate all three spacings and verify their sum.
  3. Recover the ordered observations corresponding to the gap vector \((0.2,\ 0.3,\ 0.5)\).
  4. What does a zero interior spacing mean for the ordered observations? What does a zero first spacing mean?
  5. Why is strict positivity of all gaps an almost-sure statement for an independent continuous uniform sample, rather than part of the definition of the closed simplex?