Tutorials › Statistical Theory I - Probability and Distribution Theory › Convolution Checks for Support and Normalization

Joint Laws of Independent Variables · Tutorial 297 of 994

Convolution Checks for Support and Normalization

Learn a systematic way to verify convolution support, limits, normalization, and possible atoms at the boundaries.

Intermediate 10 min read

What You'll Learn

  • Determine the possible range of a sum from the supports of its independent components
  • Choose integration and summation limits that include exactly the admissible component values
  • Verify that a convolution is nonnegative and has total probability one
  • Distinguish support endpoints from points that carry positive probability
  • Check boundary atoms in discrete and mixed convolutions

Why Check a Convolution?

A convolution calculation can look algebraically plausible and still describe no probability distribution. A missing interval of integration can leave out probability; an incorrect range can include impossible values; and a density that integrates to one still does not describe the whole law if the sum also has an unaccounted-for atom. Checking support, nonnegativity, total probability, and boundary masses is therefore part of deriving a distribution, not an optional final step.

The checks apply to discrete, continuous, and mixed random variables. The common starting point is that \(X\) and \(Y\) are independent. If they are dependent, the marginal distributions alone do not determine the law of \(X+Y\), as established in the earlier material on why dependence invalidates convolution.

Definition: The support of a real-valued random variable is the set of points \(x\) such that every open interval containing \(x\) has positive probability. For independent real-valued \(X\) and \(Y\), the law of \(X+Y\) is their convolution: for each Borel set \(A\), $$ P(X+Y\in A)=\int\!\!\int \mathbf{1}_{A}(x+y)\,dF_X(x)\,dF_Y(y). $$ Here \(F_X,F_Y\) are the marginal distribution functions, and \(\mathbf{1}_A\) is one on \(A\) and zero elsewhere. This measure formula applies whether the variables are discrete, continuous, or mixed.

Support Determines the Limits

If \(X\) and \(Y\) have densities \(f_X\) and \(f_Y\), the density of their sum is $$ f_{X+Y}(z)=\int_{-\infty}^{\infty} f_X(x)f_Y(z-x)\,dx. $$ The integrand can be nonzero only when \(x\) is in the support of \(X\) and \(z-x\) is in the support of \(Y\). These two conditions determine the actual integration limits. If the supports are intervals \([a,b]\) and \([c,d]\), respectively, they require $$ \max(a,z-d)\leq x\leq \min(b,z-c). $$ An empty interval means the density is zero at that \(z\). The sum can only lie between \(a+c\) and \(b+d\), though it need not have positive density at every point in that range if the component supports have gaps.

For discrete variables, the corresponding rule is to sum only over values that are possible for both components: $$ P(X+Y=z)=\sum_x P(X=x)P(Y=z-x). $$ For mixed variables, it is safest to begin with the measure formula. A density convolution alone may fail to record atoms; the examples below show how to check for them.

Theorem: If \(X\) and \(Y\) are independent real-valued random variables with supports \(S_X\) and \(S_Y\), then the support of \(X+Y\) is the closure of $$ S_X+S_Y=\{x+y:x\in S_X,\ y\in S_Y\}. $$ If both supports are compact, their sum is compact, so the closure is unnecessary.

Proof. Let \(S\) be the closure of \(S_X+S_Y\). If \(z\notin S\), some open interval \(I\) containing \(z\) is disjoint from \(S_X+S_Y\). With probability one, \(X\in S_X\) and \(Y\in S_Y\), so \(X+Y\notin I\) with probability one. Thus \(z\) is not in the support of the sum.

Now let \(z\in S\), and let \(I\) be any open interval containing \(z\). Since \(z\) is in the closure, there are \(x\in S_X\) and \(y\in S_Y\) with \(x+y\in I\). Because addition is continuous and \(I\) is open, there are open intervals \(U\) around \(x\) and \(V\) around \(y\) such that \(u+v\in I\) for every \(u\in U\) and \(v\in V\). The definition of support gives \(P(X\in U)>0\) and \(P(Y\in V)>0\). Independence then gives $$ P(X+Y\in I)\geq P(X\in U,Y\in V) =P(X\in U)P(Y\in V)>0. $$ Every interval around \(z\) therefore has positive probability, so \(z\) is in the support of the sum. This proves the claim. \(\square\)

Normalization and Boundary Masses

A valid density must be nonnegative and integrate to one. A valid probability mass function must be nonnegative and sum to one. Convolution preserves both properties under independence, but checking them in a calculation can expose a wrong formula or omitted part of the support.

Theorem: If \(X\) and \(Y\) are independent and have densities \(f_X\) and \(f_Y\), then the convolution formula defines a nonnegative density with total integral one.

Proof. Since densities are nonnegative, \(f_X(x)f_Y(z-x)\geq0\), and its integral in \(x\) is nonnegative. Tonelli’s theorem applies to the nonnegative integrand, so the integral over \(z\) can be evaluated by changing the order of integration. For every fixed \(x\), use \(u=z-x\): $$ \int_{-\infty}^{\infty} f_{X+Y}(z)\,dz =\int_{-\infty}^{\infty} f_X(x) \left(\int_{-\infty}^{\infty} f_Y(z-x)\,dz\right)dx =\int_{-\infty}^{\infty} f_X(x)\,dx=1. $$ Thus the convolution is nonnegative and integrates to one. \(\square\)

This proof depends on integrating over the entire real line, with the component densities set to zero outside their supports. In a piecewise calculation, the displayed intervals must cover all possible values of the sum. If a piece is omitted, the resulting expression need not integrate to one.

A support endpoint is not necessarily an atom. For example, a continuous variable may have support \([a,b]\) while \(P(X=a)=P(X=b)=0\). More generally, if \(X\geq a\) and \(Y\geq b\) almost surely, then the sum can equal \(a+b\) only when \(X=a\) and \(Y=b\). Independence gives $$ P(X+Y=a+b)=P(X=a)P(Y=b). $$ So a boundary atom occurs precisely when both component variables have atoms at their respective lower endpoints. The corresponding statement holds for upper endpoints when the variables are bounded above. For distributions whose support endpoint is only an infimum or supremum, the endpoint may not be attainable at all.

Worked Example: Checking the Support of a Uniform Sum

Let \(X\) and \(Y\) be independent, each uniformly distributed on \([0,1]\). Find the density of \(Z=X+Y\), verify its support and normalization, and check its boundary probabilities.

The sum must lie in \([0,2]\). For a fixed \(z\), the convolution integrand is one when both \(0\leq x\leq1\) and \(0\leq z-x\leq1\). Equivalently, \(x\) must lie between \(\max(0,z-1)\) and \(\min(1,z)\). The length of this interval gives the density:

$$ f_Z(z)= \begin{cases} 0, & z<0,\\ z, & 0\leq z\leq1,\\ 2-z, & 1<z\leq2,\\ 0, & z>2. \end{cases} $$

For \(0\leq z\leq1\), the valid interval is \([0,z]\), of length \(z\). For \(1<z\leq2\), it is \([z-1,1]\), of length \(2-z\). Outside \([0,2]\) the interval is empty. The density is nonnegative throughout, and its integral is

$$ \int_0^1 z\,dz+\int_1^2(2-z)\,dz =\frac12+\frac12=1. $$

At the endpoints the density is zero, and \(P(Z=0)=P(X=0,Y=0)=0\); likewise, \(P(Z=2)=P(X=1,Y=1)=0\). The endpoints belong to the support because every interval immediately inside \([0,2]\) has positive probability, but neither endpoint is an atom.

Worked Example: Discrete Endpoint Atoms

Let \(X\) and \(Y\) be independent Bernoulli variables with \(P(X=1)=0.4\) and \(P(Y=1)=0.3\). Check the support, the convolution probabilities, and the atoms at the endpoints.

Each variable takes values zero and one, so \(Z=X+Y\) can only take values \(0,1,2\). The convolution gives

$$ \begin{aligned} P(Z=0)&=P(X=0)P(Y=0)=0.6(0.7)=0.42,\\ P(Z=1)&=P(X=0)P(Y=1)+P(X=1)P(Y=0)\\ &=0.6(0.3)+0.4(0.7)=0.18+0.28=0.46,\\ P(Z=2)&=P(X=1)P(Y=1)=0.4(0.3)=0.12. \end{aligned} $$

All three probabilities are nonnegative and their sum is \(0.42+0.46+0.12=1\). Both endpoints of the support are atoms: the sum is zero when both variables are zero, and it is two when both are one. In contrast to the continuous example, these boundary values carry positive probability.

Worked Example: A Mixed Sum With a Gap in Its Support

Let \(X\) be independent of \(Y\), where \(P(X=0)=0.7\), \(P(X=2)=0.3\), and \(Y\) is uniform on \([0,1]\). Find the law of \(Z=X+Y\), check normalization, and determine whether the support endpoints are atoms.

Condition on the two possible values of \(X\). If \(X=0\), the sum is uniform on \([0,1]\), with weight \(0.7\). If \(X=2\), it is uniform on \([2,3]\), with weight \(0.3\). Thus the density is

$$ f_Z(z)= \begin{cases} 0.7, & 0<z<1,\\ 0.3, & 2<z<3,\\ 0, & \text{otherwise}, \end{cases} $$

where density values at individual endpoints can be assigned arbitrarily without changing the distribution. Its total integral is $$ \int_0^1 0.7\,dz+\int_2^3 0.3\,dz=0.7+0.3=1. $$ The support is \([0,1]\cup[2,3]\), not the entire interval \([0,3]\): no sum can fall in the gap \((1,2)\). The four interval endpoints are in the support, but none is an atom. For example, \(P(Z=0)=P(X=0,Y=0)=0.7(0)=0\), and the same reasoning applies at \(1,2,\) and \(3\), since \(Y\) has no point masses.

A Practical Diagnostic

When reviewing a convolution, use the following checks in order. They separate errors about where probability can occur from errors about how much probability the formula assigns.

1
Find the possible sums.
Combine the component supports, remembering that the resulting support is the closure of their pairwise sums. Look for gaps as well as extreme endpoints.
2
Translate support into limits.
For a density convolution, impose both component-support conditions on the integration variable. For a discrete convolution, include exactly those summands for which both component probabilities are defined and nonzero.
3
Check nonnegativity and total probability.
Every density or mass must be nonnegative. Integrate or sum over the entire proposed support, including every piece.
4
Inspect endpoints separately.
Ask whether each endpoint is attainable, and whether the components have atoms that can combine to place positive probability there. A density value at one point does not determine the probability of that point.

For instance, keeping only the first branch \(f_Z(z)=z\) in the uniform-sum example would omit the interval \(1<z\leq2\). The retained formula would integrate to \(\int_0^1 z\,dz=1/2\), not one, immediately exposing the missing probability. Conversely, simply stretching that branch across \([0,2]\) would give a nonzero density where the convolution geometry requires a different overlap length. Support and normalization checks complement each other: neither replaces the derivation.

Common Mistake

  • Assuming support endpoints must be atoms. A student sees support \([0,2]\) and assigns positive probability to \(Z=0\) or \(Z=2\). The correction is to distinguish neighborhoods from points: support means every neighborhood has positive probability, while an atom requires \(P(Z=z)>0\). For independent sums, check the component endpoint masses directly.
  • Checking only that a formula integrates to one. A nonnegative function with total integral one can still put probability on impossible values and omit other parts. Verify the support and the limits before accepting normalization.
  • Ignoring gaps in component supports. Adding only the smallest and largest possible values gives an outer range, not always the full support. The mixed example has sums in \([0,1]\cup[2,3]\), with no probability in between.
Key takeaway: A reliable convolution must match the possible sums, use limits that reflect both component distributions, assign nonnegative probabilities with total mass one, and account separately for any atoms—including at support boundaries.

Check Your Understanding

For each question, distinguish the range where a sum can occur from the points that carry positive probability.

  1. If \(X\) and \(Y\) are independent with supports \([1,3]\) and \([0,2]\), what is the support of their sum?
  2. For two independent continuous variables, why does a zero density at a support endpoint not by itself imply that the endpoint is outside the support?
  3. Two independent Bernoulli variables have success probabilities \(p\) and \(q\). Write the probabilities of their sum being zero, one, and two, and verify that they add to one.
  4. A nonnegative proposed density for a sum integrates to \(0.8\). Give one likely diagnostic conclusion, and explain why this check alone does not identify the precise error.
  5. In the mixed example with \(X\in\{0,2\}\) and \(Y\) uniform on \([0,1]\), explain why the sum has no probability in \((1,2)\) and no atom at zero.