Tutorials › Statistical Theory I - Probability and Distribution Theory › Rectangle Increments and Nonnegative Probability

Joint Distribution Representations · Tutorial 200 of 994

Rectangle Increments and Nonnegative Probability

Learn why bivariate CDF increments give rectangle probabilities, how to calculate them, and how a negative increment rules out a candidate joint CDF.

Intermediate 9 min read

What You'll Learn

  • State the four-corner increment for a half-open rectangle.
  • Prove the rectangle-probability identity directly from event indicators.
  • Explain why every such increment must be nonnegative.
  • Calculate rectangle probabilities for independent uniform random variables.
  • Use a negative increment to disqualify a proposed bivariate CDF.
  • Distinguish this necessary check from a complete verification of a CDF.

Why Four CDF Values Describe a Rectangle

A bivariate CDF records probabilities of lower-left regions: the value at \((x,y)\) is the probability that both coordinates are at most their respective thresholds. To obtain the probability of a bounded rectangle, we need to remove the parts below its lower edges. This is why the calculation uses four corner values, with alternating signs.

Definition: For a random vector \((X,Y)\), its bivariate cumulative distribution function is \(F(x,y)=P(X\leq x,\;Y\leq y)\), for real \(x,y\). For \(a<b\) and \(c<d\), the alternating increment of \(F\) over the rectangle \((a,b]\times(c,d]\) is \(\Delta F=F(b,d)-F(a,d)-F(b,c)+F(a,c)\).

The endpoint convention matters. The increment corresponds to a rectangle open at its lower edges and closed at its upper edges. This convention works whether or not \(X\) or \(Y\) has positive probability at a boundary. No continuity assumption is needed for the identity.

The Rectangle-Increment Identity

The identity follows by writing the rectangle event in terms of four lower-left events. The indicator argument gives both the exact probability formula and its sign.

Theorem: If \(F\) is the bivariate CDF of \((X,Y)\), and \(a<b\), \(c<d\), then \(F(b,d)-F(a,d)-F(b,c)+F(a,c)=P(a<X\leq b,\;c<Y\leq d)\geq 0\).

Proof. For any outcome, let \(I_{u,v}\) be the indicator of the event \(\{X\leq u,\;Y\leq v\}\). The alternating combination of indicators is \(I_{b,d}-I_{a,d}-I_{b,c}+I_{a,c}\). We check its value by considering whether each coordinate lies in the indicated ranges.

If \(a<X\leq b\) and \(c<Y\leq d\), the first indicator is 1 and the other three are 0, so the combination is 1. If \(X\leq a\) and \(c<Y\leq d\), the first two indicators are 1 and cancel. If \(a<X\leq b\) and \(Y\leq c\), the first and third are 1 and cancel. If either \(X>b\) or \(Y>d\), all indicators are 0. Outcomes below the lower thresholds also cancel or contribute zero. Thus, for every outcome, the combination equals the indicator of \(\{a<X\leq b,\;c<Y\leq d\}\). Taking expectations gives the claimed identity, since the expectation of an event indicator is its probability. Probabilities are nonnegative, proving the inequality. \(\square\)

The theorem is sometimes called the nonnegative-increment condition for a bivariate CDF. It says more than that the function should increase when either coordinate increases: it also constrains how its changes in the two coordinates fit together. A function can pass simple one-coordinate monotonicity checks and still have a negative rectangle increment.

Worked Calculations

Worked Example: A Rectangle for Independent Uniform Variables

Let \(X\) and \(Y\) be independent, each uniformly distributed on \([0,1]\). Their univariate CDF is \(G(t)=0\) for \(t<0\), \(G(t)=t\) for \(0\leq t\leq1\), and \(G(t)=1\) for \(t>1\). Independence gives \(F(x,y)=G(x)G(y)\). Find \(P(0.2<X\leq0.7,\;0.4<Y\leq0.9)\).

The four CDF values are \(F(0.7,0.9)=0.7(0.9)=0.63\), \(F(0.2,0.9)=0.2(0.9)=0.18\), \(F(0.7,0.4)=0.7(0.4)=0.28\), and \(F(0.2,0.4)=0.2(0.4)=0.08\). Therefore,

$$ P(0.2<X\leq0.7,\;0.4<Y\leq0.9) =0.63-0.18-0.28+0.08=0.25. $$

As a check, the two interval probabilities are \(0.7-0.2=0.5\) and \(0.9-0.4=0.5\). Independence gives \(0.5(0.5)=0.25\), in agreement with the increment.

Worked Example: A Rectangle Crossing the Support Boundary

Keep the independent uniform model, but now find \(P(-1<X\leq0.3,\;0.6<Y\leq2)\). The rectangle extends outside the support \([0,1]^2\), so the CDF values use the clipped portions of the thresholds.

Here \(F(0.3,2)=G(0.3)G(2)=0.3\), \(F(-1,2)=0\), \(F(0.3,0.6)=0.3(0.6)=0.18\), and \(F(-1,0.6)=0\). Hence the increment is

$$ 0.3-0-0.18+0=0.12. $$

This agrees with the direct calculation: the allowed values of \(X\) have probability \(0.3\), those of \(Y\) have probability \(1-0.6=0.4\), and independence gives \(0.3(0.4)=0.12\). Portions of the rectangle beyond the support add no probability.

Worked Example: Disqualifying a Candidate by One Rectangle

Consider the function proposed as a bivariate CDF \(F_*(x,y)=G(x)G(y)+8h(x)h(y)\), where \(G(t)=\min(\max(t,0),1)\) and \(h(t)=G(t)(1-G(t))\). Test its increment on \((0,0.5]\times(0.5,1]\).

For a product \(A(x)B(y)\), its four-corner increment factors as \([A(b)-A(a)][B(d)-B(c)]\), by expanding the product. Thus the increment of \(F_*\) is

$$ [G(0.5)-G(0)][G(1)-G(0.5)] +8[h(0.5)-h(0)][h(1)-h(0.5)]. $$

The needed values are \(G(0)=0\), \(G(0.5)=0.5\), \(G(1)=1\), \(h(0)=0\), \(h(0.5)=0.25\), and \(h(1)=0\). Substitution gives

$$ (0.5)(0.5)+8(0.25)(-0.25) =0.25-0.5=-0.25. $$

A probability cannot be negative, so \(F_*\) cannot be a bivariate CDF. A single violating rectangle is enough to rule it out; there is no need to find a probability model that might generate it.

Additivity Across Adjacent Rectangles

The increment also behaves as a rectangle probability should when a rectangle is split into adjacent pieces. This provides a useful calculation check: the probability of the whole rectangle must equal the sum of the probabilities of its pieces.

Result: If \(a<e<b\), \(c<d\), then the increment on \((a,b]\times(c,d]\) is the sum of the increments on \((a,e]\times(c,d]\) and \((e,b]\times(c,d]\).

Proof. Write \(\Delta F((u,v]\times(c,d])=F(v,d)-F(u,d)-F(v,c)+F(u,c)\). Adding the increments for the two smaller rectangles gives

$$ \begin{aligned} &F(e,d)-F(a,d)-F(e,c)+F(a,c)\\ &\quad+F(b,d)-F(e,d)-F(b,c)+F(e,c)\\ &=F(b,d)-F(a,d)-F(b,c)+F(a,c). \end{aligned} $$

The terms involving \(e\) cancel, leaving exactly the increment for the whole rectangle. Equivalently, the two smaller half-open rectangles are disjoint and their union is the larger rectangle, so the same conclusion follows from additivity of probability. \(\square\)

Repeated splitting gives the same conclusion for any finite grid partition: the increment over the whole rectangle is the sum of all cell increments. Since each cell increment must be nonnegative, such sums cannot be smaller than zero.

Using Nonnegative Increments to Check a Candidate

When a formula is proposed as a bivariate CDF, choose thresholds \(a<b\) and \(c<d\), evaluate its four corner values, and compute the alternating increment. A negative result disproves the proposal. The failed example above illustrates why this check is essential: its product term contributes a positive increment, but the added term contributes a larger negative one on the selected rectangle.

Passing this test is necessary, but by itself it does not prove that a function is a CDF. A full verification must also check the other defining requirements of a bivariate CDF, including its appropriate continuity and boundary behavior. The increment test is a particularly direct way to detect an impossible candidate because it has a concrete interpretation: every checked value must equal a probability.

Common Pitfall

A frequent error is to use only three corners, or to give the lower-left corner a positive sign. The lower-left term is essential: it corrects for subtracting the region below both lower thresholds twice. Another error is to treat \((a,b]\) as interchangeable with \([a,b]\). When boundary values can carry probability, changing the endpoints changes the event; the stated four-corner formula specifically gives \((a,b]\times(c,d]\).

A related mistake is to check only that \(F\) increases as \(x\) or \(y\) increases. Those one-coordinate checks cannot detect every failure. Always test the alternating increment itself: for every \(a<b\) and \(c<d\), it must be nonnegative.

Key takeaway: For a bivariate CDF, the four-corner increment \(F(b,d)-F(a,d)-F(b,c)+F(a,c)\) is exactly \(P(a<X\leq b,\;c<Y\leq d)\). Consequently, every rectangle increment must be nonnegative; one negative increment rules out the proposed function.

Check Your Understanding

Use the rectangle-increment identity to answer these questions.

  1. Write the four-corner increment for the rectangle \((a,b]\times(c,d]\), and state the event whose probability it equals.
  2. Why does the rectangle-increment identity require no continuity assumption on the joint distribution?
  3. For independent uniform random variables on \([0,1]\), calculate the increment on \((0.1,0.4]\times(0.2,0.7]\).
  4. If a candidate function has increment \(-0.03\) on one rectangle, what can you conclude? Does a nonnegative increment on that rectangle establish that it is a CDF?
  5. Explain why splitting \((a,b]\times(c,d]\) at \(e\), where \(a<e<b\), must preserve the total increment.