Tutorials › Exam P - Probability › Boundary Cases at Perfect Positive and Negative Correlation

Exam P · Bivariate Normal Basics · Tutorial 873 of 915

Boundary Cases at Perfect Positive and Negative Correlation

Use the exact linear relationship at perfect correlation to turn joint probability questions into one-variable normal calculations.

Advanced 10 min read

What You'll Learn

  • State the exact relationship between two nondegenerate jointly normal variables when correlation is plus or minus one
  • Derive the boundary relationship from the variance of a standardized residual
  • Translate joint inequalities into intervals on the line occupied by the random pair
  • Compute reduced probabilities with the standard normal distribution function
  • Recognize why a nonsingular bivariate normal density does not apply at perfect correlation
  • Avoid errors from reversing inequalities or rounding normal probabilities too early

Why Perfect Correlation Is a Boundary Case

For two jointly normal variables with correlation strictly between \(-1\) and \(1\), the pair has variation in two directions: knowing one variable does not determine the other exactly. At correlation \(1\) or \(-1\), that changes. Once one variable is known, the other is fixed by an exact linear equation. The pair lies on a line rather than spreading across the plane.

This boundary case is useful in joint probability questions because it replaces a two-variable problem with a one-variable one. The essential work is to identify the line, translate every condition in the event onto that line, and find the resulting interval for one normal variable. The method is aligned with the SOA Exam P (Probability) syllabus.

Definition: Let \(X\) and \(Y\) be jointly normal, with \(X\sim N(\mu_X,\sigma_X^2)\), \(Y\sim N(\mu_Y,\sigma_Y^2)\), and \(\sigma_X,\sigma_Y>0\). Their correlation is \(\rho=\operatorname{Cov}(X,Y)/(\sigma_X\sigma_Y)\). If \(\rho=1\), then \(Y=\mu_Y+(\sigma_Y/\sigma_X)(X-\mu_X)\) with probability 1. If \(\rho=-1\), then \(Y=\mu_Y-(\sigma_Y/\sigma_X)(X-\mu_X)\) with probability 1. Equivalently, both cases are given by \(Y=\mu_Y+\rho(\sigma_Y/\sigma_X)(X-\mu_X)\) with probability 1.

The assumptions matter. Both standard deviations must be positive for the correlation and the ratio in the relationship to be defined. If either variable is constant, its correlation with the other variable is not defined. At perfect correlation, the joint distribution is singular: it has no ordinary density spread over the plane, so a bivariate normal density formula that requires an inverse covariance matrix cannot be used.

Why the Pair Must Lie on a Line

Standardize the two variables by setting \(U=(X-\mu_X)/\sigma_X\) and \(V=(Y-\mu_Y)/\sigma_Y\). Each has mean 0 and variance 1, and their correlation is \(\rho\). The variance of \(V-\rho U\) is

$$ \operatorname{Var}(V-\rho U) =\operatorname{Var}(V)+\rho^2\operatorname{Var}(U)-2\rho\operatorname{Cov}(U,V) =1+\rho^2-2\rho^2 =1-\rho^2. $$

When \(\rho=1\) or \(\rho=-1\), this variance is zero. A random variable with variance zero equals its mean with probability 1; here \(E[V-\rho U]=0\), so \(V-\rho U=0\) with probability 1. Therefore \(V=\rho U\) with probability 1. Substituting the definitions of \(U\) and \(V\) gives the stated line equation. This derivation also explains why the sign of the correlation determines the direction of the line: a positive sign means the standardized variables move together, while a negative sign means they move in opposite directions.

Method: For a joint event involving \(X\) and \(Y\), first substitute \(Y=\mu_Y+\rho(\sigma_Y/\sigma_X)(X-\mu_X)\) into every inequality. Simplify each inequality, combine the resulting restrictions on \(X\), and calculate the probability of the resulting interval under \(X\sim N(\mu_X,\sigma_X^2)\). If the restrictions cannot hold together, the event is empty and its probability is zero.

Write \(\Phi(z)=P(Z\le z)\) for the standard normal distribution function, where \(Z\sim N(0,1)\). If the event reduces to \(a<X\le b\), with \(a<b\), then

$$ P(a<X\le b) =\Phi\left(\frac{b-\mu_X}{\sigma_X}\right) -\Phi\left(\frac{a-\mu_X}{\sigma_X}\right). $$

The same calculation applies to other combinations of strict or non-strict endpoints. Since \(X\) has a continuous normal distribution, any particular endpoint has probability zero, so changing an endpoint from strict to non-strict does not change the answer. Do not, however, discard an endpoint condition before checking whether the inequalities leave an interval, a single point, or no possible values.

Worked Example: A Joint Event at Perfect Positive Correlation

Suppose \(X\sim N(10,4)\) and \(Y\sim N(20,9)\) are jointly normal with correlation \(\rho=1\). Find \(P(X>11,\ Y\le 26)\). Give the probability to four decimal places. The variances are 4 and 9, so the standard deviations are \(\sigma_X=2\) and \(\sigma_Y=3\).

Method. Use the exact line for positive perfect correlation, then intersect the restrictions on \(X\). A common mistake is to treat \(Y\le26\) as an independent condition and multiply two marginal probabilities; the variables are not independent here.

Step 1: Find the line. With \(\rho=1\), substitute the stated means and standard deviations into the line equation:

$$ Y=20+\frac{3}{2}(X-10)=1.5X+5. $$

Step 2: Translate the second condition. Since the coefficient of \(X\) is positive, \(Y\le26\) is equivalent to

$$ 1.5X+5\le26 \quad\Longleftrightarrow\quad 1.5X\le21 \quad\Longleftrightarrow\quad X\le14. $$

Combining this with \(X>11\), the event is \(11<X\le14\). Since \(X\) has mean 10 and standard deviation 2, the standardized bounds are \((11-10)/2=0.5\) and \((14-10)/2=2\). Therefore

$$ P(X>11,\ Y\le26) =\Phi(2)-\Phi(0.5) \approx0.9772499-0.6914625 =0.2857874. $$

The probability to four decimal places is 0.2858. As a check, the interval is nonempty and lies above the mean of \(X\), so a probability between 0 and 0.5 is reasonable. The result is a one-dimensional interval probability, not a product of marginal probabilities.

Worked Example: Opposite Restrictions at Perfect Negative Correlation

Suppose \(X\sim N(50,100)\) and \(Y\sim N(8,16)\) are jointly normal with correlation \(\rho=-1\). Find \(P(X\ge35,\ Y>10)\), to four decimal places. The standard deviations are \(\sigma_X=10\) and \(\sigma_Y=4\).

Method. Substitute the negative-slope line into the \(Y\)-condition, taking care to reverse the inequality when dividing by a negative coefficient. This sign reversal is the main trap in this problem.

Step 1: Find the line.

$$ Y=8-\frac{4}{10}(X-50)=28-0.4X. $$

Step 2: Translate \(Y>10\). Subtract 28 to obtain \(-0.4X>-18\). Dividing by \(-0.4\) reverses the inequality:

$$ Y>10 \quad\Longleftrightarrow\quad 28-0.4X>10 \quad\Longleftrightarrow\quad X<45. $$

The other condition is \(X\ge35\), so the joint event becomes \(35\le X<45\). Standardize using \(X\sim N(50,100)\):

$$ \frac{35-50}{10}=-1.5, \qquad \frac{45-50}{10}=-0.5. $$

Thus

$$ P(X\ge35,\ Y>10) =\Phi(-0.5)-\Phi(-1.5) \approx0.3085375-0.0668072 =0.2417303. $$

The probability to four decimal places is 0.2417. The interval is consistent with the negative relationship: values of \(X\) below 45 correspond to values of \(Y\) above 10. Reversing the inequality incorrectly would produce the wrong interval.

Worked Example: A Linear Threshold and a One-Sided Bound

Let \(X\sim N(100,100)\) and \(Y\sim N(30,25)\) be jointly normal with \(\rho=1\). Find \(P(2X-Y<175,\ X\ge95)\), to four decimal places. Here \(\sigma_X=10\) and \(\sigma_Y=5\).

Method. Replace \(Y\) in the linear threshold using the exact line, then intersect its solution with the separate lower bound on \(X\). Do not round a standardized cutoff before evaluating \(\Phi\).

Step 1: Find the line.

$$ Y=30+\frac{5}{10}(X-100)=0.5X-20. $$

Step 2: Simplify the linear condition.

$$ 2X-Y<175 \quad\Longleftrightarrow\quad 2X-(0.5X-20)<175 \quad\Longleftrightarrow\quad 1.5X+20<175 \quad\Longleftrightarrow\quad X<\frac{310}{3}. $$

Combining with \(X\ge95\) gives \(95\le X<310/3\). Standardizing the lower and upper bounds gives \((95-100)/10=-0.5\) and \((310/3-100)/10=1/3\). Therefore

$$ P(2X-Y<175,\ X\ge95) =\Phi(1/3)-\Phi(-0.5) \approx0.6305587-0.3085375 =0.3220212. $$

The probability to four decimal places is 0.3220. As a check, the upper cutoff \(310/3\approx103.3333\) exceeds 95, so the interval is nonempty. The standard normal probability must be evaluated using the unrounded cutoff \(1/3\), not a prematurely rounded approximation.

Interpreting the Geometry and Avoiding Traps

The line equation is not merely a convenient approximation. Under the stated assumptions it holds with probability 1. Thus, for example, at \(\rho=-1\), an event such as \(X>c\) and \(Y>d\) may describe an empty part of the line even though each separate condition has positive probability. The joint probability is determined by their intersection on the line, not by the product or overlap of two areas in the plane.

A common incorrect approach is to use a nonsingular bivariate normal formula at \(\rho=\pm1\). Such formulas often include a factor involving \(\sqrt{1-\rho^2}\) in a denominator; at the boundary this quantity is zero. The resulting expression is not a valid density calculation. The correction is to use the exact linear relationship and compute a univariate normal probability.

Another trap is to standardize each variable separately and then treat the resulting conditions as independent. Standardization changes location and scale, but it does not remove dependence. At perfect correlation, the standardized variables satisfy \(V=U\) for \(\rho=1\) and \(V=-U\) for \(\rho=-1\), exactly. They are maximally dependent, not independent.

A reliable calculation keeps enough precision in normal probabilities until the final subtraction. For instance, use \(\Phi(1/3)-\Phi(-0.5)\approx0.3220212\), which rounds to 0.3220 at four decimal places. Subtracting already-rounded values can occasionally change the final rounded result. State the requested precision, retain unrounded or sufficiently precise values during the calculation, and round only once at the end.

1
Check the boundary assumptions.
Confirm joint normality, positive marginal standard deviations, and correlation exactly \(1\) or \(-1\).
2
Write the line.
Use \(Y=\mu_Y+\rho(\sigma_Y/\sigma_X)(X-\mu_X)\), preserving the sign of \(\rho\).
3
Reduce the event.
Substitute into every condition, reverse inequalities when dividing by a negative number, and intersect all restrictions.
4
Evaluate and check.
Standardize the resulting interval for \(X\), evaluate with \(\Phi\), then verify the interval and round only at the final step.

The boundary relationship is especially helpful when several linear expressions in \(X\) and \(Y\) appear in one event: after substitution, every condition is a restriction on the same variable. It is also a useful diagnostic. If the translated inequalities demand both \(X<r\) and \(X\ge s\) with \(s\ge r\), the event is impossible except possibly at a single endpoint; a continuous normal variable assigns that endpoint probability zero.

Key takeaway: At perfect positive or negative correlation, a nondegenerate jointly normal pair is exactly one-dimensional. Substitute the line relationship, solve the inequalities carefully, and use a single marginal normal distribution to compute the joint probability.

Check Your Understanding

For each problem, identify the line relationship before reducing the event. Probabilities are reported to four decimal places.

  1. Let \(X\sim N(4,4)\) and \(Y\sim N(9,1)\) be jointly normal with \(\rho=-1\). Find \(P(X<3,\ Y>9.5)\). (Answer: 0.3085)
  2. Let \(X\sim N(0,1)\) and \(Y\sim N(6,4)\) be jointly normal with \(\rho=1\). Find \(P(Y>8,\ X<2)\). (Answer: 0.1359)
  3. Let \(X\sim N(20,25)\) and \(Y\sim N(4,9)\) be jointly normal with \(\rho=-1\). Find \(P(2X+Y\le51,\ Y<13)\). (Answer: 0.8400)
  4. Let \(X\sim N(0,1)\) and \(Y\sim N(0,1)\) be jointly normal with \(\rho=-1\). Find \(P(X+Y>0)\). (Answer: 0.0000)
  5. Let \(X\sim N(100,64)\) and \(Y\sim N(40,9)\) be jointly normal with \(\rho=1\). Find \(P(X\ge108,\ Y\le43)\). (Answer: 0.0000)
Clinical Biostats