Tutorials › Statistical Theory I - Probability and Distribution Theory › Recovering Interval Probabilities from Mixed Representations

Discrete, Continuous, and Mixed Laws · Tutorial 70 of 994

Recovering Interval Probabilities from Mixed Representations

Use CDF differences, atom sums, density integrals, and mixture weights to calculate interval probabilities without losing endpoint mass.

Beginner 10 min read

What You'll Learn

  • Recover interval probabilities from CDF values and left limits.
  • Determine exactly which endpoint atoms belong to an interval.
  • Combine atom masses with integrated density when the law has no singular remainder.
  • Calculate interval probabilities under finite mixtures, including zero-weight components.
  • Recognize when a density formula alone misses singular probability.

Why Endpoints Matter

For a continuous law, changing whether an interval includes one endpoint does not change its probability. For a law with atoms, it can. An interval probability may combine a jump at an endpoint, atoms inside the interval, and probability accumulated continuously across it. Keeping these contributions distinct makes calculations reliable.

The cumulative distribution function (CDF) is often the quickest route: subtract its values using the correct endpoint convention. When a law is given instead by its atoms and density, add the relevant atom masses and integrate the density over the interval. For a mixture, first calculate each component's interval probability, then weight and add those probabilities.

Interval Probabilities From a CDF

Definition: The CDF of a real-valued random variable \(X\) is \(F(x)=P(X\le x)\). Its left limit is \(F(x-)=\lim_{t\uparrow x}F(t)=P(X<x)\). The probability that \(X\) equals \(x\), called the atom at \(x\), is \(P(X=x)=F(x)-F(x-)\).

The left limit distinguishes strictly less than \(x\) from less than or equal to \(x\). For \(a\le b\), the four usual interval conventions therefore give:

$$ \begin{aligned} P(a<X\le b)&=F(b)-F(a),\\ P(a\le X\le b)&=F(b)-F(a-),\\ P(a<X<b)&=F(b-)-F(a),\\ P(a\le X<b)&=F(b-)-F(a-). \end{aligned} $$

These identities follow by subtracting probabilities of nested events. For example, \(\{X\le b\}\) is the disjoint union of \(\{X\le a\}\) and \(\{a<X\le b\}\), so subtracting \(P(X\le a)=F(a)\) from \(F(b)\) gives the first identity. To include \(a\), subtract \(P(X<a)=F(a-)\) instead. Replacing \(\{X\le b\}\) by \(\{X<b\}\), whose probability is \(F(b-)\), gives the two formulas with an open right endpoint. Thus each endpoint's inclusion is handled by choosing the appropriate CDF value or left limit.

Theorem: For any real numbers \(a\le b\), the interval formulas above hold, with the open-interval formula used only when \(a<b\); when \(a=b\), \(P(a<X<b)=0\). No assumption is made that \(X\) is discrete, continuous, or free of a singular component.

The argument uses only event inclusion and the definition of the CDF. In particular, it does not assume that \(F\) is continuous. If \(a=b\), the formula for the closed interval gives \(P(X=a)=F(a)-F(a-)\); each of the other three intervals is empty and has probability zero. The formula \(F(b-)-F(a)\) for \(P(a<X<b)\) applies only when \(a<b\).

Worked Example: Reading Endpoint Atoms From a CDF

Suppose \(X\) has probability \(0.20\) at \(-1\), probability \(0.25\) at \(1\), and a density equal to \(0.55\) on \(0\le x\le 1\), with density zero elsewhere. The density integrates to \(0.55(1-0)=0.55\), so the atom and density probabilities sum to \(0.20+0.25+0.55=1\). Its CDF is

$$ F(x)= \begin{cases} 0, & x<-1,\\ 0.20, & -1\le x<0,\\ 0.20+0.55x, & 0\le x<1,\\ 1, & x\ge 1. \end{cases} $$

First calculate \(P(-1<X\le1)\). Here \(F(1)=1\), while \(F(-1)=0.20\), so

$$ P(-1<X\le1)=F(1)-F(-1)=1-0.20=0.80. $$

The interval excludes the atom at \(-1\), but includes the atom at \(1\). Its probability is also the \(0.55\) density probability between \(0\) and \(1\), plus the \(0.25\) atom at \(1\): \(0.55+0.25=0.80\).

Now change the interval to \([-1,1)\). Since \(F(1-)=0.20+0.55(1)=0.75\) and \(F((-1)-)=0\),

$$ P(-1\le X<1)=F(1-)-F((-1)-)=0.75-0=0.75. $$

This interval includes the atom at \(-1\) and excludes the atom at \(1\). Its probability is \(0.20+0.55=0.75\), confirming the CDF calculation.

Intervals From Atoms and a Density

A law may be given directly by its atom locations and masses, together with a density for its absolutely continuous part. Let \(A\) be the set of atom locations, and write \(p_x=P(X=x)\) for \(x\in A\). Suppose the rest of the law has density \(f\) with respect to length, with no additional singular component. For a measurable set \(B\), the interval formula extends to

$$ P(X\in B)=\sum_{x\in A\cap B}p_x+\int_B f(t)\,dt. $$

For an interval, include an atom in the sum exactly when its location belongs to that interval, and integrate the density over the interval. A countable sum is required if there are countably many atoms. Including or excluding an endpoint does not affect the density integral, but it can change the atom sum. The assumption of no additional singular component matters: if there is singular probability not represented by atoms or by \(f\), it must be added separately. A density formula alone does not account for it.

Result: If the law consists only of atoms with masses \(p_x\) and an absolutely continuous part with density \(f\), then \(P(a<X\le b)=\sum_{x\in A:\,a<x\le b}p_x+\int_a^b f(t)\,dt\). For other endpoint conventions, change the inequalities in the atom sum to match the interval. The integral is unchanged by endpoint inclusion.

To justify the result, the event that \(X\) lies in the interval splits into disjoint events: \(X=x\) for each atom location \(x\) in that interval, and \(X\) falls in the interval through the absolutely continuous part of the law. Countable additivity gives the sum of the atom probabilities. By the definition of a density, the absolutely continuous part assigns probability \(\int_a^b f(t)\,dt\) to the interval. Adding these disjoint contributions yields the formula.

Worked Example: Adding Atoms and Integrated Density

Suppose \(X\) has mass \(0.20\) at \(0\), mass \(0.10\) at \(2\), and density \(f(x)=0.35\) on \(0<x<2\), with density zero elsewhere. The continuous component has probability \(\int_0^2 0.35\,dx=0.70\); with the two atoms, the total probability is \(0.20+0.10+0.70=1\).

Find \(P(0\le X<1.5)\). The atom at \(0\) is included and contributes \(0.20\); the atom at \(2\) is outside the interval. The density contribution is

$$ \int_0^{1.5}0.35\,dx=0.35(1.5-0)=0.525. $$

Therefore \(P(0\le X<1.5)=0.20+0.525=0.725\). The endpoint at \(1.5\) carries no atom, so choosing an open or closed right endpoint makes no difference here.

For comparison, \(P(0<X\le2)\) excludes the atom at \(0\), includes the atom at \(2\), and includes the entire density component. Hence

$$ P(0<X\le2)=\int_0^2 0.35\,dx+0.10=0.70+0.10=0.80. $$

Intervals Under a Mixture

In a finite mixture, a component is selected with a specified probability, and the observation is drawn from that component's distribution. Let the component distributions be \(P_1,\ldots,P_k\), and let their weights satisfy \(w_j\ge0\) and \(\sum_{j=1}^k w_j=1\). For any measurable set \(B\), the mixture assigns probability

$$ P(X\in B)=\sum_{j=1}^k w_jP_j(X\in B). $$

This applies to intervals as well: find the interval probability under each component, multiply by its weight, and add. The identity can be justified using a component label \(J\). For each \(j\), the joint probability of selecting component \(j\) and then observing \(X\in B\) is \(w_jP_j(X\in B)\), including when \(w_j=0\): in that case the joint probability is zero. The events \(\{X\in B,J=j\}\) are disjoint and their union is \(\{X\in B\}\), so additivity gives the displayed identity. This argument does not condition on any event of probability zero.

Worked Example: Combining Component Interval Probabilities

Select one of three components with weights \(w_1=0.40\), \(w_2=0.60\), and \(w_3=0\). Component 1 is a point mass at \(0\), component 2 is uniform on \([0,2]\), and component 3 is standard normal. Calculate \(P(0<X\le1)\).

Under component 1, \(X=0\) with probability one, so \(P_1(0<X\le1)=0\). Under component 2, the interval has length \(1\) within a uniform distribution on an interval of length \(2\), so \(P_2(0<X\le1)=1/2\). Write \(q_3=P_3(0<X\le1)\); its value is irrelevant because its mixture weight is zero. Therefore,

$$ P(0<X\le1)=0.40(0)+0.60\left(\frac12\right)+0(q_3)=0.30. $$

If the interval were changed to \(0\le X\le1\), component 1 would assign probability \(1\), not \(0\), because its atom at \(0\) would now be included. The mixture probability would be \(0.40(1)+0.60(1/2)+0(q_3)=0.70\). This comparison shows both how mixture weights operate and why endpoint conventions still matter within each component.

Common Mistakes and Why the Calculations Matter

  • Using \(F(a)\) when the interval includes \(a\). \(F(a)=P(X\le a)\) already includes the atom at \(a\). To include that endpoint in an interval calculation, subtract \(F(a-)=P(X<a)\) instead.
  • Adding an endpoint atom twice. If using CDF differences, the jump is already included or excluded by the chosen values. Do not add it again unless working from an atom-and-density formula.
  • Integrating density as if it represented every part of the law. The density integral misses both atoms and any singular component. Add atoms explicitly, and account for singular probability separately when present.
  • Conditioning on a zero-weight mixture component. A component with weight zero contributes zero to the mixture. Use its weighted probability term \(0\cdot P_j(X\in B)=0\), not a conditional probability given that the zero-probability component was selected.

These calculations matter whenever a probability statement has strict or inclusive thresholds, such as a probability of being below a cutoff or at most a specified value. The CDF handles arbitrary laws, while an atom-and-density representation can make the separate contributions transparent. Mixture calculations then preserve those endpoint choices component by component.

Check Your Understanding

For each question, identify the endpoint convention before calculating.

  1. If \(F(3)=0.72\) and \(F(3-)=0.60\), what is \(P(X=3)\)?
  2. Write a CDF expression for \(P(a\le X<b)\).
  3. A law has an atom of mass \(0.15\) at \(1\) and density \(0.20\) on \((1,4)\), with no other probability. Find \(P(1<X\le2)\).
  4. A mixture has weights \(0.25\) and \(0.75\). The component probabilities of an event are \(0.8\) and \(0.2\), respectively. What is the mixture probability?
  5. Why does a density integral alone fail to give interval probabilities when the law has a singular component?