Tutorials › VEE Mathematical Statistics › Calculating Standardized Sample-Mean Probabilities

VEE Mathematical Statistics · Chi-Square and Student t Distributions · Tutorial 401 of 880

Calculating Standardized Sample-Mean Probabilities

Learn to convert sample-mean conditions into Student’s t events and calculate the corresponding probabilities with the correct degrees of freedom and tail areas.

Intermediate 10 min read

What You'll Learn

  • State the normal-sampling assumptions required for an exact Student’s t calculation
  • Convert bounds on a sample mean into bounds on its studentized statistic
  • Use sample size to determine the Student’s t degrees of freedom
  • Calculate one-sided, central, and non-symmetric probabilities
  • Avoid confusing a one-tail probability with a two-tail probability
  • Recognize when an exact t probability is not justified

From a Sample-Mean Event to a t Probability

When the population variance is unknown, a sample mean is often standardized using the sample standard deviation. This replaces the known population standard deviation in the usual normal standardization with an estimate calculated from the same sample. Under a normal-sampling model, the resulting statistic has a Student’s t distribution, and probabilities about the sample mean can be found by translating the event into t units.

The key is to standardize the entire event, including its bounds. A bound such as \(\mu+2S/\sqrt{n}\) is random because \(S\) is random; the probability is not obtained by treating \(S\) as a fixed observed number. The t distribution accounts for the sampling variation in both the sample mean and the sample standard deviation.

Definition: Let \(X_1,\ldots,X_n\) be an independent random sample from a normal population \(N(\mu,\sigma^2)\), where both \(\mu\) and \(\sigma^2\) are unknown. Define the sample mean and sample standard deviation by $$ \bar{X}=\frac{1}{n}\sum_{i=1}^n X_i,\qquad S=\sqrt{\frac{1}{n-1}\sum_{i=1}^n(X_i-\bar{X})^2}. $$ Then $$ T=\frac{\bar{X}-\mu}{S/\sqrt{n}}\sim t_{n-1}. $$ The number of degrees of freedom is \(n-1\).

Here \(\mu\) is the population mean, \(S/\sqrt{n}\) is the estimated standard error of the sample mean, and \(t_{n-1}\) denotes a Student’s t random variable with \(n-1\) degrees of freedom. The exact t result assumes independent observations from a normal population. If the population is not normal, this exact distributional statement generally does not hold; a large-sample approximation may be appropriate in some settings, but it is a different justification.

Standardizing Bounds and Reading Tail Areas

Since \(S>0\) with probability 1 for a continuous normal sample with \(n\geq 2\), dividing an inequality by \(S/\sqrt n\) does not reverse its direction. For any constants \(a<b\),

$$ \begin{aligned} a < \frac{\bar{X}-\mu}{S/\sqrt n} < b &\quad\Longleftrightarrow\quad \mu+a\frac{S}{\sqrt n}<\bar{X}<\mu+b\frac{S}{\sqrt n},\\ P\left(\mu+a\frac{S}{\sqrt n}<\bar{X}<\mu+b\frac{S}{\sqrt n}\right) &=P(a<T<b)\\ &=F_{t_{n-1}}(b)-F_{t_{n-1}}(a). \end{aligned} $$

In this expression \(F_{t_{n-1}}(x)=P(T\leq x)\) is the cumulative distribution function for a t variable with \(n-1\) degrees of freedom. The final equality follows by subtracting the probability to the left of \(a\) from the probability to the left of \(b\). A continuous t distribution assigns probability zero to either endpoint, so whether the endpoints are included does not change the result.

For a one-sided event, use the corresponding single tail. For example, \(P(T>c)=1-F_{t_{n-1}}(c)\). The t distribution is symmetric about zero, so \(P(T<-c)=P(T>c)\). But a one-sided tail and a two-sided tail are not interchangeable: if \(c\) is the 95th percentile, then \(P(T>c)=0.05\), while \(P(|T|>c)=0.10\).

1
Check the model.
Confirm that the observations are independent and identically distributed from a normal population, and that the sample standard deviation \(S\) is used.
2
Find the degrees of freedom.
For a sample of size \(n\), use \(n-1\) degrees of freedom for the t distribution.
3
Rewrite each bound in t units.
Subtract \(\mu\) and divide by \(S/\sqrt n\) on each side. Preserve the inequality direction because \(S/\sqrt n>0\).
4
Evaluate the resulting probability.
Use a t cumulative probability, symmetry, or a stated t quantile. Check whether the event is one-sided or two-sided.

Worked Probabilities

Worked Example: A Central Sample-Mean Range

A hypothetical study models the recorded cost of a service as independent observations from \(N(\mu,\sigma^2)\), with both parameters unknown. A sample of \(n=10\) observations is collected. Find the probability that the sample mean is within \(1.833\) estimated standard errors of the population mean: \(\mu-1.833S/\sqrt{10}<\bar{X}<\mu+1.833S/\sqrt{10}\). Use the \(t_9\) 95th percentile \(1.833\).

Method. Standardize both bounds. The sample size gives \(n-1=10-1=9\) degrees of freedom, so \(T=(\bar{X}-\mu)/(S/\sqrt{10})\sim t_9\).

For the lower bound, \[ \frac{\mu-1.833S/\sqrt{10}-\mu}{S/\sqrt{10}}=-1.833. \] For the upper bound, \[ \frac{\mu+1.833S/\sqrt{10}-\mu}{S/\sqrt{10}}=1.833. \] Thus the required probability is \(P(-1.833<T<1.833)\).

The given 95th percentile means \(P(T<1.833)=0.95\). By symmetry, \(P(T<-1.833)=0.05\). Therefore, \[ P(-1.833<T<1.833)=0.95-0.05=0.90. \] The probability is 0.9000 to four decimal places.

Check. The central interval leaves 0.05 in each tail, or 0.10 in total, so its probability is 0.90. The common mistake avoided here is to call the 95th-percentile cutoff a 95% central cutoff; it is a one-sided percentile, and the symmetric central probability is 90%.

Worked Example: A Lower-Tail Sample-Mean Event

In a hypothetical normal model for independent measurements, \(X_i\sim N(\mu,\sigma^2)\), with unknown \(\mu\) and \(\sigma^2\). A sample of \(n=5\) is taken. Find \(P(\bar{X}<\mu-2.132S/\sqrt{5})\). Use the 5th percentile of \(t_4\), approximately \(-2.132\).

Method. Convert the event to a standardized t event. There are \(5-1=4\) degrees of freedom, so \(T=(\bar{X}-\mu)/(S/\sqrt{5})\sim t_4\). Subtracting \(\mu\) and dividing by the positive quantity \(S/\sqrt{5}\) gives \[ \frac{\bar{X}-\mu}{S/\sqrt{5}}<-2.132, \] which is the event \(T<-2.132\).

By the stated t quantile, \[ P(T<-2.132)\approx 0.0500. \] Therefore, the required probability is 0.0500 to four decimal places.

Check. The cutoff is the 5th percentile of \(t_4\), so its left-tail probability is 0.05. The common mistake avoided is assigning 0.025 to this event by confusing the cutoff with the 97.5th percentile. For \(t_4\), the 97.5th percentile is approximately \(2.776\), not \(2.132\).

Worked Example: A Non-Symmetric Interval

A hypothetical set of independent normal observations has unknown population parameters \(X_i\sim N(\mu,\sigma^2)\). For a sample of \(n=9\), calculate \[ P\left(\mu-\frac{S}{3}<\bar{X}<\mu+\frac{2S}{3}\right). \] For \(t_8\), use the calculator values \(F_{t_8}(2)\approx0.9596\) and \(F_{t_8}(1)\approx0.8267\).

Method. The degrees of freedom are \(9-1=8\), and the standard error is \(S/\sqrt{9}=S/3\). Standardizing the lower bound gives \[ \frac{\mu-S/3-\mu}{S/3}=-1, \] and standardizing the upper bound gives \[ \frac{\mu+2S/3-\mu}{S/3}=2. \] Thus the event is \(-1<T<2\), where \(T\sim t_8\).

The probability is \[ P(-1<T<2)=F_{t_8}(2)-F_{t_8}(-1). \] By symmetry, \(F_{t_8}(-1)=1-F_{t_8}(1)\approx1-0.8267=0.1733\). Therefore, \[ P(-1<T<2)\approx0.9596-0.1733=0.7863. \] The probability is approximately 0.7863 to four decimal places.

Check. The interval is not centered at zero, so it is not valid to double one tail or apply a central-probability shortcut. Subtracting the two cumulative probabilities correctly handles its unequal bounds.

Why the t Conversion Works

The t conversion is useful because it places an event about \(\bar{X}\) on a common standardized scale, even though \(\sigma\) is unknown. In a normal sample, the standardized sample mean using the true standard deviation has a standard normal distribution, and the sample variance supplies an independent estimate of the variance. The resulting ratio has the form \[ \frac{Z}{\sqrt{U/\nu}}, \] where \(Z\sim N(0,1)\), \(U\) has a chi-square distribution with \(\nu=n-1\) degrees of freedom, and \(Z\) and \(U\) are independent. This ratio has a \(t_\nu\) distribution. In the sample-mean problem, \(\nu=n-1\), so replacing \(\sigma\) with \(S\) leads to the stated statistic \(T\).

For calculation, the important consequence is the exact event equivalence: a sample-mean bound expressed as \(\mu+cS/\sqrt n\) becomes the fixed t bound \(c\). Once both endpoints are expressed this way, the requested probability is a t tail area or a difference of t cumulative probabilities. No numerical value for the unknown \(\mu\) or \(\sigma\) is needed when the event is already written relative to \(\mu\) and scaled by \(S/\sqrt n\).

Common Traps and Checks

Several errors recur in standardized sample-mean calculations:

  • Using \(n\) degrees of freedom. The sample variance uses \(n-1\) degrees of freedom, so the t distribution is \(t_{n-1}\), not \(t_n\).
  • Using \(\sigma/\sqrt n\) in place of \(S/\sqrt n\). The stated statistic concerns an unknown population variance estimated from the sample. A probability involving the known-\(\sigma\) standardization is a different calculation.
  • Forgetting to standardize every endpoint. A raw bound must be transformed by subtracting \(\mu\) and dividing by \(S/\sqrt n\). Keeping an unscaled \(S\) or omitting \(\sqrt n\) changes the t cutoff.
  • Confusing a tail with a central area. A positive 95th-percentile cutoff has 0.05 to its right; the symmetric interval between the negative and positive cutoffs has probability 0.90.
  • Applying an exact t result without normal sampling. The exact result requires independent observations from a normal population. A large sample alone does not make the exact t statement true, although an approximation may be justified separately.

A final check is to sketch the t axis mentally: mark the standardized endpoints, identify whether the event is left-tail, right-tail, or between two points, then compute the area. For a symmetric interval around zero, the two omitted tails must be equal. For an asymmetric interval, use the cumulative distribution at each endpoint rather than assuming equal tails.

Key takeaway: Under independent normal sampling with unknown variance, \(T=(\bar{X}-\mu)/(S/\sqrt n)\sim t_{n-1}\). Transform the event into t units first, then use the correct one-tail or interval probability for that degrees-of-freedom value.

Check Your Understanding

For each problem, use the stated t quantile or cumulative probability and identify the degrees of freedom before evaluating the event.

  1. A hypothetical sample consists of \(n=7\) independent observations from \(N(\mu,\sigma^2)\), with unknown parameters. Find \(P(\bar{X}>\mu+1.943S/\sqrt{7})\), using the 95th percentile of \(t_6\) as 1.943. (Answer: 0.0500)
  2. For \(n=5\) independent normal observations, find \(P(\mu-2.132S/\sqrt{5}<\bar{X}<\mu+2.132S/\sqrt{5})\), using the 95th percentile of \(t_4\) as 2.132. (Answer: 0.9000)
  3. A sample of \(n=11\) comes from an independent normal population with unknown parameters. Find \(P(\bar{X}<\mu+1.812S/\sqrt{11})\), using the 95th percentile of \(t_{10}\) as 1.812. (Answer: 0.9500)
  4. For \(n=9\) independent normal observations, calculate \(P(\mu-S/3<\bar{X}<\mu+2S/3)\). For \(t_8\), use \(F_{t_8}(1)=0.8267\) and \(F_{t_8}(2)=0.9596\). (Answer: 0.7863)
  5. A hypothetical normal-sample analysis has \(n=16\). Find \(P(\bar{X}>\mu-1.753S/4)\), using the 5th percentile of \(t_{15}\) as approximately \(-1.753\). (Answer: 0.9500)
Clinical Biostats