Tutorials › Joint Modeling of Longitudinal and Time-to-Event Data › Greenwood Standard Errors and Survival Intervals

Survival Models Review · Tutorial 101 of 697

Greenwood Standard Errors and Survival Intervals

Use Greenwood’s formula to quantify Kaplan–Meier uncertainty, calculate pointwise confidence intervals, and assess their assumptions and limitations.

Intermediate 10 min read

What You'll Learn

  • Identify the risk-set and event-count quantities used in Greenwood’s formula.
  • Calculate a Kaplan–Meier standard error from event-time data.
  • Construct and interpret a pointwise Wald confidence interval.
  • Derive and use a log-minus-log transformed survival interval.
  • Diagnose boundary problems and imprecision caused by sparse risk sets.

Why quantify uncertainty in a Kaplan–Meier estimate?

A Kaplan–Meier curve gives an estimated survival probability over time, but an estimate alone does not show how precisely it has been determined. Uncertainty is especially important late in follow-up, when fewer individuals may remain at risk. Greenwood’s formula provides a standard estimate of the variance of the Kaplan–Meier estimator, which can then be used to construct pointwise confidence intervals.

These intervals describe uncertainty in survival at a particular time. They are not, by themselves, a simultaneous confidence band for the entire curve, and they do not compare two survival groups. The focus here is the uncertainty calculation for one Kaplan–Meier estimate at a time.

Definition: Let \(t_1,\ldots,t_k\) be the distinct observed event times up to time \(t\). At event time \(t_j\), let \(n_j\) be the number at risk just before \(t_j\), and let \(d_j\) be the number of events at \(t_j\). The Kaplan–Meier estimate is \(\hat S(t)=\prod_{t_j\le t}(1-d_j/n_j)\). Greenwood’s estimated variance is \(\widehat{\operatorname{Var}}\{\hat S(t)\}=\hat S(t)^2\sum_{t_j\le t}d_j/\{n_j(n_j-d_j)\}\), when the terms are defined. Its square root is the Greenwood standard error.

The event count \(d_j\) includes all events tied at \(t_j\); the risk set \(n_j\) is counted immediately before that time. Censored individuals contribute to the risk set up to their censoring time, but do not count as events. The introductory material on the Kaplan–Meier estimator establishes this product-limit construction.

Greenwood’s formula and its justification

Greenwood’s expression is a variance estimate, not an additional factor in the Kaplan–Meier product. To see its structure, write the survival factor at an event time as \(\hat q_j=1-d_j/n_j\). Under a binomial approximation for the event count within a risk set, the estimated variance of this factor is approximately \(d_j(n_j-d_j)/n_j^3\). Dividing by \(\hat q_j^2=\{(n_j-d_j)/n_j\}^2\) gives the relative variance

$$ \frac{\widehat{\operatorname{Var}}(\hat q_j)}{\hat q_j^2} \approx \frac{d_j}{n_j(n_j-d_j)}. $$

For a product of estimated factors, the first-order variance approximation adds their relative variances. Multiplying that sum by the squared product \(\hat S(t)^2\) gives Greenwood’s formula. This justification relies on the usual large-sample approximation for the product-limit estimator; it does not make a small-sample interval exact.

The standard setting is independent individuals with right-censored event times and censoring that is independent of the event time, or independent conditional on relevant groups or covariates. The risk sets must correctly reflect who is under observation and at risk; with delayed entry, they must include only individuals who have entered by the event time. The formula can accommodate tied event times by using the total \(d_j\) at each distinct time. It does not correct bias from informative censoring or an incorrectly constructed risk set.

Worked Example: Calculating a Greenwood Standard Error

Suppose a hypothetical cohort has the following risk-set information by the time of interest. The event times are \(t=1,2,4\); the counts are \((n_j,d_j)=(10,2),(7,1),(4,1)\), respectively. Censoring between event times accounts for the changes in the risk sets. Calculate the Kaplan–Meier estimate, Greenwood standard error, and a 95% Wald interval at \(t=4\).

The survival estimate is

$$ \hat S(4) =(1-2/10)(1-1/7)(1-1/4) =0.8(6/7)(0.75) =0.5143. $$

The Greenwood sum is

$$ G(4) =\frac{2}{10(8)}+\frac{1}{7(6)}+\frac{1}{4(3)} =0.02500+0.02381+0.08333 =0.1321. $$

Therefore \(SE\{\hat S(4)\}=\hat S(4)\sqrt{G(4)}=0.5143\sqrt{0.1321}\approx0.1870\). The ordinary Wald interval is \(\hat S(4)\pm1.96SE\), giving \(0.5143\pm1.96(0.1870)\), or approximately \((0.1479,0.8807)\), calculated using unrounded values. In context, this is a pointwise 95% confidence interval for survival probability at time 4 in the hypothetical cohort. Its width signals considerable uncertainty.

Pointwise confidence intervals

A pointwise interval concerns \(S(t)\) at one fixed time \(t\). The simplest construction uses a normal approximation for \(\hat S(t)\):

$$ \hat S(t)\ \pm\ z_{1-\alpha/2}\,SE\{\hat S(t)\}, \qquad SE\{\hat S(t)\}=\hat S(t)\sqrt{G(t)}. $$

For a 95% interval, \(z_{1-\alpha/2}\) is approximately 1.96. The Wald interval is easy to calculate, but it is formed on the probability scale. It can extend below 0 or above 1, even though survival probabilities must lie between 0 and 1. It can also behave poorly near either boundary or when the normal approximation is weak.

A common alternative is to form an interval on the log-minus-log scale. For \(0<\hat S(t)<1\), define \(g(S)=\log\{-\log(S)\}\). Its derivative is \(g'(S)=1/\{S\log(S)\}\). Applying the delta method to the Greenwood variance gives

$$ SE\{g(\hat S(t))\} \approx |g'(\hat S(t))|SE\{\hat S(t)\} = \frac{\sqrt{G(t)}}{|\log\{\hat S(t)\}|}. $$

Construct a normal interval for \(g(S(t))\), then transform the endpoints back. Since \(S=\exp\{-\exp(g)\}\) decreases as \(g\) increases, the endpoint order reverses:

$$ \left[ \exp\{-\exp(g(\hat S)+zSE_g)\}, \ \exp\{-\exp(g(\hat S)-zSE_g)\} \right], \qquad SE_g=\frac{\sqrt{G(t)}}{|\log\{\hat S(t)\}|}. $$

This transformation keeps the resulting limits between 0 and 1 and often gives a more plausible interval when the estimated survival probability is near a boundary. It does not make the interval exact; it still relies on an approximate normal distribution on the transformed scale.

Worked Example: A Log-Minus-Log Survival Interval

For a second hypothetical cohort, suppose three event times have \((n_j,d_j)=(12,2),(8,1),(5,1)\). Construct a 95% log-minus-log interval at the third event time.

The estimated survival is

$$ \hat S=(10/12)(7/8)(4/5)=7/12=0.5833. $$

The Greenwood sum and its square root are

$$ G=\frac{2}{12(10)}+\frac{1}{8(7)}+\frac{1}{5(4)} =0.08452, \qquad \sqrt G=0.2907. $$

Here \(g(\hat S)=\log\{-\log(0.5833)\}\approx-0.6180\), and \(SE_g=0.2907/|\log(0.5833)|\approx0.5394\). The interval on the transformed scale is \(-0.6180\pm1.96(0.5394)=(-1.675,0.4392)\). Reversing endpoint order when transforming back gives

$$ \left(\exp\{-\exp(0.4392)\},\ \exp\{-\exp(-1.675)\}\right) \approx(0.2120,\ 0.8294). $$

Thus the pointwise 95% log-minus-log interval for survival at this event time is approximately 0.2120 to 0.8294. It is wide, reflecting the uncertainty in the estimate; the interval does not mean there is a 95% probability that the fixed survival probability lies inside these particular limits.

Reading the uncertainty and spotting problems

Greenwood’s sum is cumulative over event times. A large value increases the estimated standard error relative to \(\hat S(t)\), but an individual contribution \(d_j/\{n_j(n_j-d_j)\}\) depends on both \(n_j\) and \(d_j\). Holding \(d_j\) fixed, the contribution increases as \(n_j\) decreases over its valid range. But a smaller risk set does not guarantee a larger contribution if the event count changes too. For example, \(n=10,d=5\) contributes \(5/\{10(5)\}=0.1000\), whereas \(n=5,d=1\) contributes \(1/\{5(4)\}=0.05000\).

Useful checks include verifying the risk sets and event counts, confirming that censoring is not being counted as an event, and comparing the width of the interval with the number at risk at the time of interest. A sharp change in the curve with a small risk set can leave late survival estimates imprecise. Also check whether the chosen interval method is producing limits in the allowable range. When \(\hat S(t)=1\), the log-minus-log transformation is undefined; when \(\hat S(t)=0\), it is also undefined, and Greenwood’s expression may encounter a zero denominator if \(d_j=n_j\). These boundary cases require special care rather than mechanical use of the displayed formulas.

Worked Example: A Smaller Risk Set Does Not Ensure a Larger Contribution

In a hypothetical cohort, one event time has \(n_1=10\) and \(d_1=5\), followed by another with \(n_2=5\) and \(d_2=1\). Assume no other event times before the second one. Compare their Greenwood contributions and calculate the resulting survival estimate and standard error.

The first contribution is \(5/\{10(10-5)\}=0.1000\); the second is \(1/\{5(5-1)\}=0.05000\). Although the second risk set is smaller, its contribution is also smaller because its event count differs. The survival estimate is \((1-5/10)(1-1/5)=0.5(0.8)=0.4000\), and \(G=0.1000+0.05000=0.1500\). Thus \(SE(\hat S)=0.4000\sqrt{0.1500}=0.1549\). A 95% Wald interval is \(0.4000\pm1.96(0.1549)\approx(0.0964,0.7036)\).

Choosing an interval and understanding its limits

The Wald interval and the log-minus-log interval use the same Greenwood standard error but handle the probability scale differently. The Wald interval is transparent and may be adequate when the estimate is well away from 0 and 1 and the approximation is reasonable. The transformed interval respects the range of survival probabilities and is often preferred near the boundaries. Neither repairs sparse data, informative censoring, or a misspecified risk set. Resampling methods can be another option for assessing uncertainty, but they also require a suitable resampling scheme and enough information in the observed data.

Both types of interval here are pointwise: their nominal coverage applies separately at a fixed time under the approximation and assumptions, not to the whole survival curve simultaneously. A collection of pointwise 95% intervals is not automatically a 95% band for every time on the curve. Report the time point, interval method, and units of time, and interpret the interval in terms of the survival probability for the population represented by the data.

Key takeaway: Greenwood’s formula estimates the variance of a Kaplan–Meier survival probability through its cumulative event-time contributions. The Wald interval is simple but may leave the probability range; a log-minus-log interval transforms limits back to the range from 0 to 1. Both require careful attention to censoring, risk sets, and the amount of information at the time being studied.

Check Your Understanding

Answer each question, then compare with the solutions below.

  1. At an event time, \(n_j=20\) and \(d_j=2\). What is that event time’s Greenwood contribution?
  2. If \(\hat S(t)=0.60\) and \(G(t)=0.04\), calculate the Greenwood standard error.
  3. Why can a Wald interval for survival be unsuitable even when its standard error has been calculated correctly?
  4. Does a smaller risk set always produce a larger Greenwood contribution? Explain.

Solutions. (1) The contribution is \(2/\{20(20-2)\}=2/360=0.005556\). (2) \(SE=0.60\sqrt{0.04}=0.60(0.20)=0.1200\), in survival-probability units. (3) The Wald limits are formed on an unbounded scale and can fall below 0 or exceed 1; the normal approximation may also be weak near the boundaries. (4) No. The contribution depends on both \(n_j\) and \(d_j\); for example, \(n=10,d=5\) gives 0.1000, while \(n=5,d=1\) gives 0.05000.

Clinical Biostats