Why Matching Changes the Analysis
Suppose a clinician records a measurement on each participant before and after a treatment. The two measurements from one participant are linked: they share characteristics of that person, and the question may concern how much the measurement changed. A comparison that ignores this link discards useful information.
The key move is to calculate one difference for each complete pair. The resulting list of differences is a single quantitative sample. A one-sample t procedure applied to that list tests or estimates the mean change. The paired t procedure is therefore not a separate kind of t calculation: it is a one-sample t procedure on appropriately defined differences.
The choice of direction is part of the definition. If \(D_i=Y_i-X_i\), then a positive difference means the second measurement exceeds the first. Reversing the order changes the signs of all differences and of the test statistic, but it does not change \(s_d\). State the order clearly so the result has an interpretable direction.
Model and the One-Sample Connection
Before using the t procedure, consider its model. The observations used by the procedure are the differences \(D_1,\ldots,D_n\), not the two columns considered as separate samples. For an exact t reference distribution, assume that the differences are independent observations from a normal population with mean \(\mu_D\) and standard deviation \(\sigma_D\). In notation, \(D_i\sim N(\mu_D,\sigma_D^2)\). In applications, the one-sample t procedure can also be reasonably robust to departures from normality when the sample of differences is sufficiently large and does not contain severe outliers; the conditions for paired inference are considered separately.
Under this model, the sample mean \(\bar{d}\) estimates \(\mu_D\), and \(s_d/\sqrt{n}\) estimates the standard deviation of \(\bar{d}\). If the null hypothesis specifies \(\mu_D=\delta_0\), the one-sample t result gives the statistic and reference distribution below.
The degrees of freedom are \(n-1\) because the standard deviation \(s_d\) is calculated from the \(n\) differences after estimating their mean with \(\bar{d}\). The number \(n\) is the number of complete pairs, not the total number of measurements in both columns. Although there are \(2n\) recorded values, there are only \(n\) difference values in the one-sample analysis.
Why the Differences Carry the Relevant Variability
The standard error must reflect how much the paired changes vary from one pair to another. It is not generally enough to know how spread out the first and second columns are separately. To see the role of matching algebraically, write \(s_X^2\) and \(s_Y^2\) for the sample variances of the two columns and \(s_{XY}\) for their sample covariance, calculated across the matched pairs. Expanding the squared deviations of \(D_i=Y_i-X_i\) gives
This identity follows by squaring each difference: the squared \(Y\) deviations contribute \(\sum(Y_i-\bar{Y})^2\), the squared \(X\) deviations contribute \(\sum(X_i-\bar{X})^2\), and the cross-product contributes \(-2\sum(X_i-\bar{X})(Y_i-\bar{Y})\). Dividing by \(n-1\) yields the two sample variances and twice the sample covariance, as shown.
When paired measurements tend to move together, \(s_{XY}\) is positive. Subtracting \(2s_{XY}\) can make \(s_d^2\) substantially smaller than the sum of the two separate variances. That shared variation is exactly what pairing removes from the within-pair changes. The paired standard error is \(s_d/\sqrt{n}\), not a standard error that treats the two columns as unrelated samples.
Worked Example: Blood Pressure Before and After
In a hypothetical pilot exercise, six participants have blood pressure measured before and after a program. Define each difference as after minus before, in mmHg. The recorded measurements and resulting differences are:
| Participant | Before (mmHg) | After (mmHg) | Difference \(d_i\) (mmHg) |
|---|---|---|---|
| 1 | 128 | 125 | -3 |
| 2 | 134 | 129 | -5 |
| 3 | 126 | 124 | -2 |
| 4 | 140 | 134 | -6 |
| 5 | 132 | 128 | -4 |
| 6 | 136 | 132 | -4 |
The differences sum to \(-24\) mmHg, so \(\bar{d}=-24/6=-4\) mmHg. Their deviations from \(-4\) are \(1,-1,2,-2,0,0\) mmHg. Thus the sum of squared deviations is \(1+1+4+4+0+0=10\) \(\text{mmHg}^2\), and
For illustration, compare the mean difference with a null value of \(\delta_0=0\) mmHg. The standard error and statistic are
The negative sign indicates that the observed mean after-minus-before difference is below zero: in this hypothetical sample, the average blood pressure after the program is 4 mmHg lower. The calculation uses the standard deviation of the six within-person differences, not the standard deviations of the before and after columns separately.
The Same Formula Works for Any Null Difference
A paired t statistic does not require the null mean difference to be zero. The null value \(\delta_0\) is the mean difference specified by the question. For example, a study might ask whether the average reduction exceeds a prespecified benchmark. The subtraction in the numerator then measures how far the observed mean difference is from that benchmark, in standard-error units. The definition of \(D_i\) must still match the intended direction of change.
Worked Example: Comparing Improvement With a Benchmark
In a hypothetical study of five learners, a practice method is evaluated using completion time. Define improvement as the old completion time minus the new completion time, measured in minutes. The five differences are \(1,3,0,4,2\) minutes. Consider the null value \(\delta_0=2\) minutes; the calculation below shows how the statistic is formed, without making a decision about a test.
The mean difference is \(\bar{d}=(1+3+0+4+2)/5=2\) minutes. Deviations from the mean are \(-1,1,-2,2,0\) minutes, whose squared values sum to \(1+1+4+4+0=10\) \(\text{minutes}^2\). Therefore,
Substituting the benchmark gives
The statistic is zero because the sample mean improvement equals the specified 2-minute benchmark. The denominator still comes from the variation among the five paired improvements; it does not come from the variation among all ten time measurements treated as separate observations.
Matching Can Reduce the Standard Error
The following example makes the effect of matching visible. The paired t method first calculates each within-pair change and then measures the variation of those changes. The columns may each have considerable spread while the changes are comparatively consistent.
Worked Example: Using the Pairing Information
Suppose five hypothetical devices are measured before and after a calibration adjustment. Define \(d_i=\text{after}-\text{before}\), in units. The before measurements are \(10,12,14,16,18\), and the corresponding after measurements are \(12,13,16,17,21\). The paired differences are \(2,1,2,1,3\) units.
Their mean is \(\bar{d}=(2+1+2+1+3)/5=1.8\) units. The deviations are \(0.2,-0.8,0.2,-0.8,1.2\), and their squared values sum to \(0.04+0.64+0.04+0.64+1.44=2.80\) units squared. Thus
For a null mean difference of zero units, the statistic is
The separate columns have sample variances \(s_X^2=10\) and \(s_Y^2=12.7\) units squared. Their sample covariance across matched devices is \(s_{XY}=11\) units squared, so the identity gives \(s_d^2=10+12.7-2(11)=0.70\) units squared. If one ignored the pairing and used the unrelated-samples standard-error expression, the result would be \(\sqrt{(10+12.7)/5}=\sqrt{4.54}=2.131\) units, rather than the paired standard error of \(0.3742\) units. That unrelated-samples calculation does not represent the variability of the observed within-device changes.
How to Think About the Procedure
The logic can be summarized as a sequence. The inferential units are the pairs, and the analysis variable is the change within each pair. Once those differences have been formed, the familiar one-sample t structure applies.
Define \(D_i\), for example as after minus before, so the sign has a clear meaning.
Use only complete matched pairs to obtain the \(n\) values \(d_1,\ldots,d_n\).
Calculate \(\bar{d}\) and \(s_d\); these describe the center and spread of the paired changes.
Compare \(\bar{d}\) with \(\delta_0\) using \(s_d/\sqrt{n}\), with \(n-1\) degrees of freedom.
Common Mistake and Why the Distinction Matters
A common mistake is to treat the before and after columns as two independent samples merely because they appear in two columns. That reasoning overlooks that each after value is linked to a particular before value. The correction is to calculate the within-pair differences first and apply a one-sample t method to those differences. This uses the actual variation in change and preserves the information supplied by matching.
The paired method is appropriate only when the pairing represents the study design: the two measurements belong together in a meaningful way. It is not a device for making unrelated observations into pairs after the fact. Also, a small standard error does not itself establish that a change is important in practice; it describes the precision of the estimated mean difference. The central result here is structural: the paired t statistic is a one-sample t statistic whose data are the pairwise differences.
Check Your Understanding
Use the definitions and examples above to answer these questions.
- If differences are defined as after minus before, what does a negative sample mean difference indicate in context?
- A paired study has 12 complete pairs. How many difference values enter the one-sample t calculation, and what are the degrees of freedom?
- Why is \(s_d/\sqrt{n}\) used rather than a standard error that treats the two measurement columns as independent?
- For a null mean difference of \(\delta_0=3\), write the paired t statistic using \(\bar{d}\), \(s_d\), and \(n\).
- Explain why two measurements on each of ten participants do not make the paired analysis a sample of 20 independent observations.