Tutorials › Probability Theory (Graduate) › Slutsky Problems with Dependent Perturbations

Weak Convergence on Euclidean Spaces · Tutorial 181 of 946

Slutsky Problems with Dependent Perturbations

Work through dependent Slutsky problems by identifying vanishing errors, using tightness, and separating valid product conclusions from claims that require joint convergence.

Intermediate 10 min read

What You'll Learn

  • State the joint weak-convergence conclusion when one component converges in probability to a constant.
  • Apply Slutsky’s theorem to sums and products without assuming independence.
  • Prove that a vanishing perturbation multiplied by a weakly convergent sequence vanishes in probability.
  • Distinguish a negligible dependent error from two variables with only marginal convergence.
  • Recognize why tightness matters in product arguments.

Why Dependence Is Not the Main Obstacle

A common Slutsky problem gives a sequence \(X_n\) with a weak limit and a second sequence \(R_n\) that becomes negligible in probability. The two variables may be strongly dependent: the error \(R_n\) might be constructed directly from \(X_n\). That dependence does not prevent the usual conclusions for sums and products.

The key distinction is not whether two variables are independent. It is whether one component is known to approach a constant in probability, or whether the pair has a specified joint limit. Marginal weak convergence of two nonconstant sequences, by itself, does not specify how they interact.

Central principle: If \(X_n\) converges weakly to a finite random variable and \(R_n\) converges in probability to zero, then the perturbation is negligible in sums and in products with \(X_n\). No independence assumption is needed.

Convergence Notation

For random vectors in Euclidean space, \(X_n\Rightarrow X\) means that \(E[f(X_n)]\to E[f(X)]\) for every bounded continuous real-valued function \(f\). Convergence in probability \(R_n\to_p 0\) means that for every \(\varepsilon>0\), \(P(\lVert R_n\rVert>\varepsilon)\to0\). A sequence converging weakly to a finite-dimensional random vector is tight: for every \(\eta>0\), some bounded set contains \(X_n\) with probability at least \(1-\eta\), uniformly in \(n\).

The tightness fact is important in product arguments. Weak convergence prevents most of the probability mass of \(X_n\) from escaping to arbitrarily large values. A small error can therefore be controlled on the event that \(X_n\) is bounded, while the remaining event has small probability.

Joint Convergence with a Vanishing Component

Theorem: Let \(X_n\) take values in \(\mathbb{R}^d\), let \(R_n\) take values in \(\mathbb{R}^k\), and suppose \(X_n\Rightarrow X\) and \(R_n\to_p0\). Then \[ (X_n,R_n)\Rightarrow(X,0). \] The conclusion holds regardless of the dependence between \(X_n\) and \(R_n\).

Proof. Let \(f\) be any bounded continuous function on \(\mathbb{R}^{d+k}\), and write \(C=\sup |f|\). We show that

$$ E[f(X_n,R_n)]-E[f(X_n,0)]\longrightarrow 0. $$

Fix \(\eta>0\). By tightness, choose \(M\geq1\) such that \(P(\lVert X_n\rVert>M)<\eta\) for every \(n\). On the compact set \(\{(x,r):\lVert x\rVert\leq M,\ \lVert r\rVert\leq1\}\), \(f\) is uniformly continuous. Thus, for any \(\delta>0\), there is a \(\rho\in(0,1]\) such that \(\lVert r\rVert\leq\rho\) and \(\lVert x\rVert\leq M\) imply \(|f(x,r)-f(x,0)|<\delta\). Splitting according to these two bounds gives

$$ \left|E[f(X_n,R_n)]-E[f(X_n,0)]\right| \leq \delta+2C\bigl(P(\lVert X_n\rVert>M)+P(\lVert R_n\rVert>\rho)\bigr). $$

Taking the limit superior in \(n\) bounds this difference by \(\delta+2C\eta\), since \(R_n\to_p0\). As \(\delta\) and \(\eta\) can be made arbitrarily small, the difference tends to zero. Also, \(x\mapsto f(x,0)\) is bounded and continuous, so weak convergence gives \(E[f(X_n,0)]\to E[f(X,0)]\). Combining the two limits proves the asserted joint convergence. □

This theorem is the useful form of Slutsky’s result for dependent perturbations. Once the joint convergence is established, the continuous mapping theorem applies to continuous functions of the pair. For example, addition and multiplication are continuous maps on Euclidean spaces.

Adding a Vanishing Error

The additive conclusion follows immediately from the joint result and the continuous map \((x,r)\mapsto x+r\), when the dimensions agree.

Corollary: If \(X_n\Rightarrow X\) in \(\mathbb{R}^d\) and \(R_n\to_p0\) in \(\mathbb{R}^d\), then \(X_n+R_n\Rightarrow X\).

The important point in an exercise is to identify the error itself. If the expression is \(X_n+Y_n\), and \(Y_n\to_p0\), then \(Y_n\) is the perturbation. There is no need to establish independence, nor to calculate a joint distribution.

Worked Example: A Dependent Additive Error

Let \(Z\) be a standard normal random variable, set \(X_n=Z\), and let \(R_n=Z/n\). The variables are dependent—in fact, \(R_n\) is a deterministic function of \(X_n\). For every \(\varepsilon>0\),

$$ P(|R_n|>\varepsilon)=P(|Z|>n\varepsilon)\longrightarrow0, $$

because \(Z\) is finite almost surely. Also \(X_n\Rightarrow Z\), since \(X_n\) has the same distribution as \(Z\) for every \(n\). Therefore the theorem gives \(X_n+R_n\Rightarrow Z\). Directly, \(X_n+R_n=(1+1/n)Z\), which also converges almost surely to \(Z\). The dependence has no adverse effect.

Products: Two Useful Routes

For products, there are two closely related ways to apply the same principle. One can treat a factor converging in probability to a constant as the nearly constant component of the joint limit. Or one can show directly that a weakly convergent factor times a vanishing error converges in probability to zero.

Theorem: Suppose \(X_n\Rightarrow X\) in \(\mathbb{R}\) and \(Y_n\to_p c\), where \(c\in\mathbb{R}\) is constant. Then \[ X_nY_n\Rightarrow cX. \] No independence between \(X_n\) and \(Y_n\) is required.

Proof. Apply the joint-convergence theorem to \(X_n\) and \(Y_n-c\), which converges in probability to zero. It gives \((X_n,Y_n)\Rightarrow(X,c)\). The map \((x,y)\mapsto xy\) is continuous, so the continuous mapping theorem yields \(X_nY_n\Rightarrow Xc\). □

A related estimate makes explicit why multiplication by a vanishing error is safe.

Lemma: If \(X_n\Rightarrow X\) in \(\mathbb{R}\) and \(R_n\to_p0\), then \(X_nR_n\to_p0\).

Proof. Fix \(\varepsilon>0\) and \(\eta>0\). Tightness gives \(M\geq1\) such that \(P(|X_n|>M)<\eta\) for every \(n\). Then

$$ P(|X_nR_n|>\varepsilon) \leq P(|X_n|>M)+P(|R_n|>\varepsilon/M). $$

The first term is less than \(\eta\), and the second tends to zero. Hence the limit superior of the left-hand side is at most \(\eta\). Since \(\eta\) is arbitrary, the probability tends to zero. □

Worked Example: A Dependent Multiplicative Perturbation

Again let \(Z\) be standard normal, and define \(X_n=Z\) and \(Y_n=2+Z/n\). The factor \(Y_n\) is dependent on \(X_n\), but \(Y_n\to_p2\), since \(Z/n\to_p0\). The product theorem therefore gives \(X_nY_n\Rightarrow2Z\).

The error can also be seen by expanding:

$$ X_nY_n=2Z+\frac{Z^2}{n}, \qquad \left|X_nY_n-2Z\right|=\frac{Z^2}{n}\longrightarrow0 \quad\text{almost surely}. $$

Thus the extra product term vanishes, despite being built from the same \(Z\) as the leading term. No independence calculation is relevant.

When Marginal Convergence Is Not Enough

The preceding conclusions rely on a component converging in probability to a constant. It is a different situation if both \(X_n\) and \(Y_n\) merely converge weakly to nonconstant limits. Their marginal limits do not determine the joint limit, so they need not determine the limit of their product.

Worked Example: Identical Marginals, Different Products

Let \(Z\) take the values \(1\) and \(-1\), each with probability \(1/2\). In one construction, set \(X_n=Z\) and \(Y_n=Z\) for every \(n\). Both marginal distributions are symmetric on \(\{-1,1\}\), but \(X_nY_n=1\) surely.

In a second construction, set \(X_n=Z\) and \(Y_n=-Z\). The marginal distribution of each variable is unchanged: \(-Z\) is also symmetric on \(\{-1,1\}\). Yet now \(X_nY_n=-1\) surely. Thus, the same marginal weak limits are compatible with different product limits. A product conclusion requires joint information, such as a joint weak limit, or the special condition that one factor converges in probability to a constant.

This comparison also clarifies the role of independence. Independence is not needed when the Slutsky conditions already give the joint limit. Conversely, marginal convergence alone does not become sufficient merely by naming the marginals; the dependence structure can still change the product.

A Tightness Pitfall

The product lemma uses tightness, which follows from \(X_n\Rightarrow X\). Without a suitable bound on \(X_n\), multiplying by an error that tends to zero need not produce a small product.

Worked Example: A Vanishing Factor Is Not Enough

Take deterministic variables \(X_n=n\) and \(R_n=1/\sqrt n\). Then \(R_n\to0\), but

$$ X_nR_n=n\cdot\frac{1}{\sqrt n}=\sqrt n\longrightarrow\infty. $$

Here \(X_n\) does not converge weakly to a finite real-valued random variable and is not tight. The vanishing of \(R_n\) alone does not control the product. In a valid Slutsky product argument, check that the other factor is weakly convergent (hence tight), or establish an appropriate bound by some other means.

A Practical Problem-Solving Routine

For a sum or product involving dependent sequences, organize the argument around the available convergence information rather than attempting to factor probabilities or expectations.

1
Identify the proposed error.
Rewrite the expression to expose an additive term or a factor converging in probability to a constant.
2
Check the convergence modes.
Look for weak convergence of the main term and convergence in probability of the perturbation.
3
Do not impose independence unnecessarily.
The joint Slutsky result allows arbitrary dependence when one component converges in probability to a constant.
4
Apply a continuous map.
Use addition or multiplication only after the required joint convergence has been established.
5
For two nonconstant weak limits, ask for joint information.
Marginal convergence alone does not generally determine sums or products.

Why This Distinction Matters

In applications, a perturbation often shares data, noise, or latent variables with the principal term. Treating dependence as an automatic obstruction can lead to unnecessary calculations or assumptions. Slutsky’s theorem says precisely when that concern can be set aside: weak convergence supplies tightness, and convergence in probability to a constant supplies the negligible component.

The converse caution is just as important. If neither variable approaches a constant, their marginal limits do not describe their joint behavior. A rigorous solution should state which joint-convergence result justifies the map being applied, rather than assuming that separately established marginal limits can simply be combined.

Check Your Understanding

For each question, identify which convergence condition supports the proposed conclusion.

  1. If \(X_n\Rightarrow X\) and \(R_n\to_p0\), what joint weak limit follows, even when the sequences are dependent?
  2. Why does \(X_n\Rightarrow X\) together with \(Y_n\to_p c\) imply \(X_nY_n\Rightarrow cX\)?
  3. Where does tightness enter the proof that \(X_nR_n\to_p0\)?
  4. Can marginal weak convergence of both \(X_n\) and \(Y_n\) alone determine the limit of \(X_nY_n\)? Give the reason.
  5. What fails in the deterministic example \(X_n=n\), \(R_n=1/\sqrt n\), and which hypothesis of the product lemma is absent?
Clinical Biostats