Tutorials › Group Sequential Methods and Sample Size Re-Estimation › A Worked Two-Look Normal-Mean Example

The Canonical Joint Distribution · Tutorial 50 of 699

A Worked Two-Look Normal-Mean Example

Learn to calculate and interpret the joint distribution and conditional transition of two cumulative z statistics in a known-variance normal-mean example.

Advanced 11 min read

What You'll Learn

  • State the assumptions for two cumulative looks in a known-variance normal-mean model.
  • Calculate the mean and variance of each look’s z statistic under the null and a fixed alternative.
  • Find the covariance and correlation between the nested z statistics.
  • Derive the conditional distribution at the later look given the earlier statistic.
  • Distinguish the null transition from the transition under a fixed alternative.
  • Check a calculation using independent batches and identify common interpretation errors.

Two Cumulative Looks in a Normal-Mean Model

A group sequential design observes accumulating data at planned looks. At two looks, the later statistic reuses all the observations from the earlier look, so the two cumulative z statistics are correlated. That dependence matters when calculating their joint behavior and when describing what values at the second look are plausible after seeing the first.

This worked example uses independent normal observations and a known variance. The goal is to calculate the joint means, covariance and correlation of the two z statistics, then find the conditional distribution of the later statistic given the earlier one. These calculations describe the joint model; by themselves, they do not specify a stopping rule or adjust a test for repeated looks.

Model and assumptions: Let \(X_1,X_2,\ldots\) be independent observations with \(X_i\sim N(\mu,\sigma^2)\), where the variance \(\sigma^2\) is known and constant across observations. The first look uses \(n_1\) observations, and the second uses the first \(n_2\) observations, with \(0<n_1<n_2\). For testing \(H_0:\mu=\mu_0\), define the cumulative statistic at look \(k\) by \(Z_k=\sqrt{n_k}(\bar X_k-\mu_0)/\sigma\), for \(k=1,2\). The population mean \(\mu\) is fixed across both looks.

The observations added between looks are \(X_{n_1+1},\ldots,X_{n_2}\). Their independence from the first \(n_1\) observations is essential to the independent-increment representation. Define \(\Delta=\mu-\mu_0\) and \(I_k=n_k/\sigma^2\). Here \(I_k\) is the information for the normal mean at look \(k\), and the statistic’s mean under the fixed value \(\mu\) is \(\Delta\sqrt{I_k}\). The variance of each \(Z_k\) is 1.

The information fraction at the first look, relative to the second, is \(I_1/I_2=n_1/n_2\). Because the observations have the same known variance at both looks, this ratio also gives the squared correlation of the cumulative statistics.

Joint Mean, Covariance, and Correlation

Each \(Z_k\) is a linear combination of normal observations. Therefore \((Z_1,Z_2)\) has a bivariate normal distribution. Its mean vector follows from the mean of each sample mean:

$$ E_\mu(Z_k)=\frac{\sqrt{n_k}(\mu-\mu_0)}{\sigma} =\Delta\sqrt{I_k}, \qquad \operatorname{Var}_\mu(Z_k)=1. $$

The covariance comes from the shared observations. In particular, \(\bar X_2\) includes the first \(n_1\) observations that also determine \(\bar X_1\). Independence gives \(\operatorname{Cov}(\bar X_1,\bar X_2)=\sigma^2/n_2\), so scaling the two sample means into z statistics yields the following joint distribution:

$$ \begin{pmatrix}Z_1\\ Z_2\end{pmatrix} \sim N\left( \begin{pmatrix}\Delta\sqrt{I_1}\\ \Delta\sqrt{I_2}\end{pmatrix}, \begin{pmatrix} 1 & \sqrt{I_1/I_2}\\ \sqrt{I_1/I_2} & 1 \end{pmatrix} \right). $$

The second argument of \(N\) here is the covariance matrix. Since both marginal variances are 1, the covariance equals the correlation. Write \(\rho=\sqrt{I_1/I_2}=\sqrt{n_1/n_2}\). The correlation is positive and less than 1: the statistics share data, but the later look also contains new observations.

Result: Under the null, \(\Delta=0\), the two statistics have mean zero, unit variances and correlation \(\rho=\sqrt{n_1/n_2}\). Under a fixed alternative \(\mu\ne\mu_0\), their means are \(\Delta\sqrt{I_1}\) and \(\Delta\sqrt{I_2}\); their covariance and correlation remain \(\rho\). Thus, the fixed alternative changes the joint mean, not the covariance matrix.

Worked Example: Joint Distribution Under a Fixed Alternative

Suppose, hypothetically, that \(\sigma=10\) measurement units, \(\mu_0=50\) units, and the true mean is \(\mu=52\) units. The first and second looks occur after \(n_1=100\) and \(n_2=225\) observations. Calculate the joint mean, covariance and correlation.

The standardized effect is \(\Delta/\sigma=(52-50)/10=0.2\). The information levels are \(I_1=100/10^2=1\) and \(I_2=225/10^2=2.25\). Therefore the means are \(E_\mu(Z_1)=0.2\sqrt{100}=2\) and \(E_\mu(Z_2)=0.2\sqrt{225}=3\).

Each statistic has variance 1. The covariance and correlation are \(\rho=\sqrt{100/225}=2/3=0.6667\). Hence the covariance matrix has diagonal entries 1 and off-diagonal entries \(2/3\), and the joint mean vector is \((2,3)^\mathsf{T}\). Under this fixed alternative, the later statistic has the larger expected z value because it uses more observations.

Deriving the Conditional Transition

A conditional transition describes the distribution of \(Z_2\) after conditioning on \(Z_1=z_1\). For jointly normal variables, the conditional mean is the later marginal mean plus the correlation times the earlier statistic’s deviation from its mean. The conditional variance is the later variance multiplied by \(1-\rho^2\). These formulas can also be justified directly from the bivariate normal model.

1
Remove the linear prediction from \(Z_2\).
Let \(W=Z_2-m_2-\rho(Z_1-m_1)\), where \(m_k=E_\mu(Z_k)\). Then \(E_\mu(W)=0\) and \(\operatorname{Cov}(W,Z_1)=\rho-\rho=0\).
2
Use joint normality.
Because \(W\) and \(Z_1\) are jointly normal and uncorrelated, they are independent. Also, \(\operatorname{Var}(W)=1-\rho^2\).
3
Condition on the observed first look.
Given \(Z_1=z_1\), the independent residual \(W\) still has mean 0 and variance \(1-\rho^2\). Substitute back to obtain the conditional mean and variance of \(Z_2\).

Substituting \(m_1=\Delta\sqrt{n_1}/\sigma\), \(m_2=\Delta\sqrt{n_2}/\sigma\), and \(\rho=\sqrt{n_1/n_2}\) gives an equivalent form of the transition:

$$ Z_2\mid Z_1=z_1 \sim N\left( m_2+\rho(z_1-m_1),\,1-\rho^2 \right) = N\left( \rho z_1+\frac{\Delta(n_2-n_1)}{\sigma\sqrt{n_2}},\, \frac{n_2-n_1}{n_2} \right). $$

The second form shows the contribution of the new observations explicitly. Under \(H_0\), \(\Delta=0\), so the conditional mean is \(\rho z_1\). Under a fixed alternative, the extra term reflects the mean shift in the added observations. In both cases the conditional variance is positive when \(n_2>n_1\), and it does not depend on the observed value \(z_1\).

Worked Example: Conditional Distribution Under the Null

Suppose, hypothetically, \(\sigma=8\) units, \(\mu_0=100\) units, \(n_1=64\), and \(n_2=100\). The observed first-look sample mean is \(\bar X_1=101.2\) units. Find the null conditional distribution of \(Z_2\) given the resulting \(Z_1\).

First calculate the observed first-look statistic: \(z_1=\sqrt{64}(101.2-100)/8=8(1.2)/8=1.2\). The correlation is \(\rho=\sqrt{64/100}=0.8\). Under the null, the conditional mean is \(0.8(1.2)=0.96\), and the conditional variance is \(1-0.8^2=0.36\). Thus \(Z_2\mid Z_1=1.2,H_0\sim N(0.96,0.36)\), with conditional standard deviation \(\sqrt{0.36}=0.6\).

This gives the distribution of the later statistic under the null, conditional on this first-look value. It does not say that the later statistic must equal 0.96; 0.96 is its conditional mean, and the remaining variation has standard deviation 0.6.

Worked Example: Checking the Transition From the Added Batch

Use the hypothetical setting of the previous example, and suppose the mean of the 36 observations added after the first look is \(\bar X_{\mathrm{new}}=100.4\) units. Check the resulting cumulative statistic and its relation to the transition.

The cumulative mean at look 2 is \(\bar X_2=(64(101.2)+36(100.4))/100=(6476.8+3614.4)/100=100.912\) units. Therefore \(z_2=\sqrt{100}(100.912-100)/8=10(0.912)/8=1.14\).

The standardized statistic from the added batch, relative to \(\mu_0\), is \(Z_{\mathrm{new}}=\sqrt{36}(100.4-100)/8=6(0.4)/8=0.3\). The cumulative statistics satisfy \(Z_2=\sqrt{64/100}\,Z_1+\sqrt{36/100}\,Z_{\mathrm{new}}=0.8(1.2)+0.6(0.3)=0.96+0.18=1.14\). This confirms the cumulative calculation. Under the null, the new-batch statistic is independent of \(Z_1\), has mean zero and variance 1; the observed value 0.3 is one realization, not its expected value.

Worked Example: Conditional Transition Under a Fixed Alternative

Suppose, hypothetically, \(\sigma=4\) units, \(\mu_0=20\) units, and the fixed mean is \(\mu=20.4\) units. Let \(n_1=50\), \(n_2=200\), and condition on \(Z_1=1\). Calculate the conditional distribution of \(Z_2\).

Here \(\Delta=0.4\) units and \(\rho=\sqrt{50/200}=0.5\). The marginal means are \(m_1=(0.4/4)\sqrt{50}=0.7071\) and \(m_2=(0.4/4)\sqrt{200}=1.4142\). The conditional mean is \(m_2+\rho(1-m_1)=1.4142+0.5(1-0.7071)=1.5607\). The conditional variance is \(1-\rho^2=0.75\). Thus \(Z_2\mid Z_1=1\sim N(1.5607,0.75)\), with conditional standard deviation \(\sqrt{0.75}=0.8660\).

Equivalently, the conditional mean is \(\rho z_1+\Delta(n_2-n_1)/(\sigma\sqrt{n_2})=0.5+0.4(150)/(4\sqrt{200})=1.5607\). The positive increment term is why the conditional mean is not simply \(\rho z_1\) under this alternative.

Interpretation, Checks, and Limitations

The joint distribution can be constructed either from the covariance of the nested sample means or from the first-look statistic and an independent added-batch statistic. The direct covariance calculation is compact. The batch representation is often a useful arithmetic check and makes clear why the cumulative z statistics themselves are not independent. Both approaches give the same transition under the stated model.

Several checks help identify mistakes. The look sizes must satisfy \(0<n_1<n_2\), so \(0<\rho<1\). Both marginal variances must equal 1, while the conditional variance \(1-n_1/n_2\) must be positive. The covariance matrix must be valid: its determinant is \(1-\rho^2=1-n_1/n_2>0\). If the computed correlation exceeds 1, the covariance or sample-size ratio has been mishandled.

A common mistake is to treat the independent observations added between looks as if the cumulative statistics \(Z_1\) and \(Z_2\) were independent. They are not: their correlation is \(\sqrt{n_1/n_2}\), since the second statistic includes the first look’s observations. Another mistake is to use the null conditional mean \(\rho z_1\) under a nonzero fixed alternative. Under that alternative, the correct mean includes the increment term \(\Delta(n_2-n_1)/(\sigma\sqrt{n_2})\).

These calculations rely on independent normal observations, a common known variance, fixed look sizes, and a fixed mean across the looks. If the variance is estimated, observations are dependent, or the mean changes during data collection, this exact finite-sample distribution need not apply. The result also describes the joint statistics without prescribing how to use them for a sequential decision; the design’s stopping boundaries and error-rate procedure must be specified separately.

Key takeaway: For two nested cumulative z statistics in this model, the means are \(\Delta\sqrt{I_1}\) and \(\Delta\sqrt{I_2}\), and their correlation is \(\sqrt{I_1/I_2}\). Given \(Z_1=z_1\), the later statistic is normal with mean \(m_2+\rho(z_1-m_1)\) and variance \(1-\rho^2\).

Check Your Understanding

Work through each question, then check the solutions below.

  1. With \(n_1=81\) and \(n_2=144\), what are the correlation and conditional variance of \(Z_2\) given \(Z_1\)?
  2. Under the null, if those look sizes are used and \(Z_1=0.5\), what is the conditional mean of \(Z_2\)?
  3. For \(\sigma=5\) units, \(\mu_0=30\) units, \(\mu=31\) units, \(n_1=25\), and \(n_2=100\), give the joint mean vector and correlation.
  4. Why does the correlation stay the same under the fixed alternative as under the null?

Solutions. (1) \(\rho=\sqrt{81/144}=0.75\), so the conditional variance is \(1-0.75^2=0.4375\). (2) Under the null the conditional mean is \(\rho z_1=0.75(0.5)=0.375\). (3) \(\Delta/\sigma=(31-30)/5=0.2\), so the means are \(0.2\sqrt{25}=1\) and \(0.2\sqrt{100}=2\); the joint mean vector is \((1,2)^\mathsf{T}\), and the correlation is \(\sqrt{25/100}=0.5\). (4) The alternative changes the mean of each statistic, but the covariance is determined by the shared observations and the known variance. Standardizing by the unit marginal variances therefore leaves the same correlation.

Clinical Biostats