Why uncertainty needs careful reporting
A competing-risk analysis can produce a precise-looking percentage or hazard ratio even when only a few events occurred for the cause of interest. The number of decimal places does not tell readers how stable the estimate is, and a p-value alone does not show the range of effect sizes compatible with the data. Clear reporting therefore puts the estimate, its uncertainty, the event counts, and the analysis context together.
This is particularly important when the cause of interest is uncommon. A wide interval can include both a small effect and a clinically important one; the data may not distinguish between them. That is different from showing that the effect is negligible. The goal is not to make a sparse result sound definitive, but to describe what was estimated and how limited its precision is.
For competing-risk reports, name the estimand and its time horizon before interpreting uncertainty. For example, a cumulative incidence \(F_k(t)\) is the probability of experiencing cause \(k\) by time \(t\), in the presence of the other competing causes. A cause-specific hazard ratio and a subdistribution hazard ratio are different quantities, so the interval must be described on the scale actually estimated. The earlier material on choosing and naming the reported competing-risk estimand provides the relevant distinction.
What to report when a cause is sparse
Give the number of events for each cause, preferably alongside the number at risk or the cohort denominator and the follow-up horizon. A cause-specific event count is not the total number of observed events: events from other causes remain important because they affect the risk of experiencing the cause of interest. Also report the estimator or model, the uncertainty method, the confidence level, and the units or scale.
There is no universal event-count threshold at which every competing-risk estimate becomes unreliable. Stability depends on the number and distribution of events, the number of model parameters, censoring, covariate patterns, and the estimation method. A small number of events relative to model complexity can lead to unstable coefficients, large standard errors, sensitivity to a few observations, or convergence problems. Report the count and relevant diagnostics rather than declaring an estimate stable or unstable from a single cutoff.
Worked Example: Reporting a Wide Cumulative-Incidence Interval
Suppose a hypothetical study estimates the 2-year cumulative incidence of cause A as 3.20%. A model-based Wald interval is calculated on the logit scale. The estimated logit is \(-3.409\), and its standard error is \(0.650\). Assume the analysis has correctly classified causes, used an appropriate competing-risk estimator, and has a censoring and model specification that support the estimator and its variance calculation. The logit-scale approximation is also being used as an approximate sampling distribution, not as an exact small-sample result.
The 95% interval on the logit scale is the estimate plus or minus \(1.96\) standard errors:
Transform the endpoints back to the probability scale with the inverse logit, \(g^{-1}(z)=\exp(z)/(1+\exp(z))\). The lower endpoint is \(\exp(-4.683)/(1+\exp(-4.683)) \approx 0.0092\), or 0.92%. The upper endpoint is \(\exp(-2.135)/(1+\exp(-2.135)) \approx 0.1057\), or 10.57%. Thus the estimated 2-year cumulative incidence is 3.20% (95% CI 0.92% to 10.57%).
The interval is wide relative to the point estimate: values from below 1% to above 10% are compatible with this procedure. A suitable interpretation is that the estimated risk is low, but imprecisely estimated; the analysis does not pin down whether the true risk is near the point estimate or closer to either endpoint. Do not report only “3.2%” or round the interval so coarsely that its width is hidden.
A transformed Wald interval is only one possible interval procedure. Its adequacy depends on the estimator, sample size, and variance approximation. With sparse causes, check the method used by the software and consider whether an interval based on a more suitable likelihood or resampling procedure is warranted. Transformation keeps endpoints within 0 and 1, but does not by itself make the approximation accurate.
How to interpret model estimates without a significance-only conclusion
For a model coefficient, report the estimate and interval on its natural interpretation scale. For example, a cause-specific hazard ratio compares cause-specific hazards among individuals still free of any event at each time, under the model and covariate conditions. Its interval describes uncertainty about that ratio, not a risk ratio or a difference in cumulative incidence. A p-value can summarize incompatibility with a specified null under the model, but it does not measure the size, clinical importance, or precision of an effect.
Worked Example: A Hazard Ratio With Few Events
In a hypothetical cohort, 11 cause A events occur: 4 in one exposure group and 7 in the other. A fitted cause-specific Cox model, adjusted for prespecified covariates, reports a hazard ratio of 0.62 with standard error \(0.400\) for its log estimate. Assume independent individuals, correctly recorded event causes, an appropriate proportional-hazards specification for the cause-specific hazard, and a censoring mechanism that is non-informative conditional on the model covariates. These assumptions are needed for the model-based estimate and standard error to be interpreted as intended.
The Wald statistic for testing a log hazard ratio of zero is
The two-sided normal-approximation p-value is approximately 0.232. The 95% interval for the log hazard ratio is
Exponentiating gives a hazard-ratio interval of approximately \((0.283,\,1.358)\). Report, for example, “The adjusted cause-specific hazard ratio was 0.62 (95% CI 0.28 to 1.36; Wald \(p=0.232\)); 11 cause A events were observed.” The interval includes 1, but also includes values representing a substantial reduction and a possible increase in the cause-specific hazard. The result is inconclusive about the direction and magnitude; it does not establish the absence of an association.
With only 11 cause A events, the estimate may be sensitive to individual observations and to the number of fitted parameters. The event count does not prove that the model is invalid, but it is essential context for assessing its precision. Examine convergence, the stability of estimates under reasonable specifications, and whether sparse covariate patterns or influential observations are driving the result. If diagnostics reveal problems, report them and avoid presenting the coefficient as a firm finding.
Absolute-risk predictions and limited precision
Adjusted absolute-risk predictions are often easier to interpret clinically than relative model coefficients, but they are not automatically precise. State the prediction horizon, the population or covariate profile to which the prediction applies, and the method used to obtain its interval. When comparing predictions, express an absolute difference in percentage points, not percent, unless a relative contrast is explicitly intended. Ensure both predictions use the same horizon and target population.
Worked Example: Reporting an Uncertain Risk Difference
A hypothetical fitted competing-risk model produces adjusted 3-year cause A risks of 6.2% for group 1 and 10.1% for group 0, standardized to the same covariate distribution. A bootstrap procedure gives a 95% interval for the risk difference from \(-11.8\) to \(4.0\) percentage points. Assume the model is appropriately specified for these predictions, the resampling reflects the study’s sampling design, and the bootstrap interval is adequate for this analysis. With clustered data, for example, resampling would need to preserve the relevant clustering.
Define the contrast as group 1 minus group 0. The point estimate is
A clear report is: “The adjusted 3-year risk of cause A was 6.2% in group 1 and 10.1% in group 0, a difference of \(-3.9\) percentage points (95% bootstrap CI \(-11.8\) to \(4.0\)).” The interval includes zero and spans differences in either direction. It also includes potentially important differences, so the data do not establish that the groups have equivalent risks. The interval is more informative than describing the contrast only as “not statistically significant.”
Choosing and presenting uncertainty measures
Different interval procedures make different approximations. A Wald interval uses an estimate and its standard error and is convenient, but can perform poorly with sparse data, skewed estimates, or estimates near a parameter boundary. Likelihood-based intervals can better reflect asymmetry when the likelihood is informative, while bootstrap intervals can capture some features of the estimator’s sampling distribution if the resampling scheme and sample size are appropriate. Neither approach guarantees reliable inference when the data contain very little information. State the procedure used; do not imply that a particular method cures sparsity.
A practical report should make it possible to judge both the magnitude and the support for the estimate. Include:
- the estimand, cause, comparison, and time horizon;
- the point estimate and confidence interval, with units and the interval method;
- cause-specific event counts and relevant denominators;
- key model or estimation conditions that materially affect interpretation; and
- an interpretation of the range of plausible values, including whether it allows clinically important effects in more than one direction.
Keep reported precision proportional to the information in the analysis. For a risk near 3%, reporting 3.2% may be reasonable, while reporting 3.2047% suggests a degree of precision the interval does not support. Avoid rounding interval endpoints so aggressively that they become equal to the point estimate or conceal a meaningful range.
Common pitfalls and limitations
- Equating a nonsignificant result with no effect. A p-value above a chosen threshold does not show that the null is true. Describe the estimate and interval, and say when the evidence is inconclusive.
- Reporting only the point estimate. A percentage or hazard ratio without an interval conceals how uncertain it is. Pair the estimate with its interval and the cause-specific event count.
- Using the event count as a universal quality rule. A low count raises concern, especially for a complex model, but does not alone prove invalidity. Consider model complexity, data configuration, and diagnostics.
- Calling a wide interval evidence of equivalence. Equivalence requires a suitable design and prespecified margin, with an analysis that addresses that margin. A wide interval that crosses zero or one is usually inconclusive, not proof of similarity.
- Confusing scales or estimands. A cause-specific hazard ratio is not a cumulative-incidence difference. Name the quantity being estimated before interpreting its interval.
Uncertainty intervals typically quantify sampling uncertainty conditional on the chosen estimator or model. They may not capture uncertainty from misclassified causes, omitted predictors, incorrect model structure, or choices made during analysis. Sensitivity checks can help reveal instability, but they do not remove these limitations. Where sparse causes make results fragile, say so directly and avoid turning exploratory estimates into definitive claims.
Check Your Understanding
Answer each question, then compare your reasoning with the solutions below.
- A cumulative-incidence estimate is 4% with a 95% interval from 0.5% to 15%. What does the width tell you, and what does it not establish?
- A cause-specific Cox model reports a hazard ratio of 1.20 with a 95% interval from 0.70 to 2.05 and \(p=0.49\). Is it correct to conclude that the exposure has no association?
- Why should a report give cause-specific event counts as well as the total cohort size?
- Adjusted risks at a fixed horizon are 8.5% and 12.0%. What is the difference when defined as the first risk minus the second, in percentage points?
Solutions. (1) The interval indicates substantial imprecision: values from a very low risk to a considerably higher risk are compatible with the procedure. It neither assigns a probability to the fixed parameter nor establishes that the true risk is near 4%. (2) No. The interval includes 1 and allows both a lower and a higher cause-specific hazard; the result is inconclusive about the direction and magnitude, not proof of no association. (3) The cohort size alone does not show how much information supports the estimate for the cause of interest. Counts by cause reveal how sparse that outcome is and help readers assess model complexity and stability. (4) \(8.5\%-12.0\%=-3.5\) percentage points.