Tutorials › Statistical Genetics › Transporting Absolute Risk Across Populations

Individual Risk and Clinical Utility · Tutorial 771 of 989

Transporting Absolute Risk Across Populations

Assess which parts of an absolute-risk model may transfer across populations, how to recalibrate for target incidence, and what target-population validation can reveal.

Advanced 12 min read

What You'll Learn

  • Distinguish target baseline incidence from genetic relative effects
  • State the assumptions behind transporting a risk model
  • Recalibrate an intercept using the target predictor distribution and incidence
  • Solve for a target baseline risk from a target-population incidence
  • Check target calibration and identify failures an intercept adjustment cannot fix

Why Transport Requires More Than Changing the Baseline

An absolute-risk estimate is tied to the population and time horizon in which it is interpreted. A genetic score can rank people similarly in two populations while their absolute risks differ because the underlying incidence differs. Conversely, matching an overall incidence does not guarantee that the score has the same predictive relationship with the outcome in both populations. Transport therefore asks two distinct questions: does the genetic relative effect carry over, and what baseline risk applies in the target population?

The distinction matters in clinical use. If only baseline incidence changes and the genetic relative effect is stable, it may be reasonable to update the model's baseline while retaining its genetic coefficient. If the relative effect changes, a baseline adjustment alone can make the average predicted risk look appropriate while leaving risk estimates systematically wrong across score levels.

Definition: Let \(Y\) indicate an outcome within a specified time horizon, and let \(X\) denote the predictors used by a risk model, including a genetic score \(S\) and any clinical predictors \(C\). A model is transported from a source population to a target population when its predictions are used to estimate \(P_T(Y=1\mid X)\), the target-population risk conditional on those predictors. Transporting an absolute-risk model requires both a target-appropriate baseline risk and a sufficiently valid conditional relationship between \(X\) and \(Y\).

A useful working model for a binary outcome at a fixed horizon is

$$ \operatorname{logit}\{P_S(Y=1\mid S,C)\} = \alpha_S+\beta_S S+\gamma_S^{\mathsf T}C, \qquad \operatorname{logit}(p)=\log\left(\frac{p}{1-p}\right). $$

Here \(S\) is on the same scale in source and target populations, and \(C\) is a vector of clinical predictors. The intercept \(\alpha_S\) sets the model's baseline on the log-odds scale; \(\beta_S\) and \(\gamma_S\) describe conditional associations on that scale. A basic transport strategy assumes the conditional slopes transfer, while allowing the intercept to change:

$$ P_T(Y=1\mid S,C) = \operatorname{expit}\left(\alpha_T+\beta_S S+\gamma_S^{\mathsf T}C\right), \qquad \operatorname{expit}(u)=\frac{1}{1+\exp(-u)}. $$

This is an assumption, not a consequence of observing different population incidences. It can fail if, for example, genetic score effects differ because the score captures different underlying variants, the outcome definition or follow-up differs, or predictor effects vary with environmental or clinical context. A score's distribution may also differ between populations; even with stable conditional effects, that difference changes the average risk.

Updating Risk When Relative Effects Are Assumed Stable

For fixed clinical predictors and a specified reference score, a relative effect can be expressed as an odds ratio. If the target-population risk at score \(S=0\) is \(q_T\), and the odds ratio per one-unit increase in \(S\) is \(R\), then the risk at score \(S=s\) is

$$ p_T(s) = \frac{q_T R^s}{1-q_T+q_T R^s}. $$

The odds ratio multiplies odds, not risk. Thus, substituting a target baseline risk into this formula is appropriate only when the odds ratio is a valid conditional relative effect for the target population and the other predictors are held at the same values.

Worked Example: Updating Risks With a Target Baseline

Suppose a hypothetical source model estimates a 6.00% risk by a fixed horizon for people with score \(S=0\), at a specified value of the clinical predictors. Its odds ratio per one-unit increase in score is 1.80. In a target population, assume the corresponding \(S=0\) risk is 10.0%, and assume the conditional score odds ratio remains 1.80. Find target risks at scores 1 and 2.

At \(S=1\), the baseline odds are \(0.10/(1-0.10)=0.1111\). Multiplying by 1.80 gives odds \(0.2000\), so

$$ p_T(1)=\frac{0.2000}{1+0.2000}=0.1667. $$

The estimated target risk at score 1 is 16.7%. At \(S=2\), the odds ratio relative to \(S=0\) is \(1.80^2=3.24\). The odds are \(0.1111(3.24)=0.3600\), giving

$$ p_T(2)=\frac{0.3600}{1+0.3600}=0.2647. $$

The estimated target risk at score 2 is 26.5%. These are conditional risks under the stated assumptions; they are not obtained by multiplying 10.0% by 1.80 or 3.24. Nor do the calculations establish that the score odds ratio actually transfers. That requires evidence about the target conditional relationship.

In practice, a baseline risk for a single reference profile may not be available. Instead, a representative target sample may provide an overall event incidence, and the target distribution of predictors can be used to recalibrate the model intercept. Let \(\pi_T\) be the target incidence over the same horizon among people at risk at its start. Retaining the source slopes, choose \(\alpha_T\) to satisfy

$$ E_T\left[ \operatorname{expit}\left(\alpha_T+\beta_S S+\gamma_S^{\mathsf T}C\right) \right] = \pi_T. $$

The expectation is over the target population's distribution of \(S\) and \(C\). Consequently, a changed predictor distribution is part of the recalibration: the same conditional model can imply different overall incidence when applied to different mixtures of predictor values. In data, the expectation is often approximated by averaging predictions across a representative target sample, or by a suitably weighted sample if the sampling design requires weights.

Why an Intercept Can Be Solved—and What It Does

For fixed slopes and target predictor values, define \(f(a)=E_T[\operatorname{expit}(a+\beta_S S+\gamma_S^{\mathsf T}C)]\). When predictors are finite, \(f\) is continuous and strictly increasing: each expit term increases with \(a\), with derivative \(\operatorname{expit}(u)\{1-\operatorname{expit}(u)\}>0\). As \(a\) tends to negative infinity, \(f(a)\) tends to 0; as \(a\) tends to positive infinity, it tends to 1. Therefore, for any target incidence \(0<\pi_T<1\), there is a unique intercept that makes the average predicted risk equal \(\pi_T\). It can be found numerically.

This argument establishes only a match in the target average. It does not establish that people with a particular score or clinical profile have accurate predictions. Intercept recalibration shifts predictions on the log-odds scale; it cannot repair an incorrect genetic slope, an incorrect clinical slope, or a relationship whose form differs in the target population.

Worked Example: Solving for a Target Baseline Risk

Consider a hypothetical target population with two score groups. A fraction \(w=0.4426667\) is in a higher-score group whose odds are assumed to be \(R=7.315789\) times those of a reference group; the remaining fraction \(1-w=0.5573333\) is in the reference group. Suppose the target incidence over the stated horizon is 0.2400. Let \(q\) be the unknown risk in the reference group. Under the assumed common relative odds, the higher-score risk is \(Rq/\{1+(R-1)q\}\). The target incidence equation is therefore

$$ (1-w)q+w\frac{Rq}{1+(R-1)q}=0.2400. $$

Substitute the values and multiply both sides by \(1+(R-1)q\). The resulting quadratic, with coefficients rounded as displayed, is

$$ 3.52q^2+2.28q-0.240=0. $$

The quadratic formula gives

$$ q = \frac{-2.28+\sqrt{2.28^2+4(3.52)(0.240)}}{2(3.52)} \approx 0.0921526. $$

The other root is negative, so it cannot represent a risk. The target reference-group risk is approximately 9.22%. The corresponding higher-score risk is

$$ \frac{(7.315789)(0.0921526)} {1+(7.315789-1)(0.0921526)} \approx 0.4262. $$

Weighting the two risks by their target group proportions gives approximately \(0.5573333(0.0921526)+0.4426667(0.4262)=0.2400\), as required. This example shows why target incidence and target score distribution must be considered together: the overall incidence does not equal the reference-group risk.

Target-Population Calibration Is a Necessary Check

After recalibration, predictions should be assessed in target-population data that are appropriate for the intended population and horizon. The observed outcome must be ascertained comparably, and the validation sample should represent the target population or be analyzed with appropriate weights. Useful checks include comparing average predicted risk with observed incidence, examining observed outcomes across ranges of predicted risk, and checking whether errors vary with score or clinical predictors. An overall match alone is insufficient.

Worked Example: An Overall Match Can Hide Miscalibration

An independent hypothetical validation sample contains 1,000 target-population participants with complete outcome follow-up. For a common horizon, 500 are in a lower predicted-risk group with mean predicted risk 5.00%, and 500 are in a higher group with mean predicted risk 19.0%. The observed event counts are 20 in the lower group and 130 in the higher group.

The model's total expected events are \(500(0.0500)+500(0.190)=25+95=120\), or an average predicted risk of \(120/1{,}000=0.120\). The observed incidence is \((20+130)/1{,}000=0.150\). Thus, the average prediction is 12.0%, while the observed incidence is 15.0%, a difference of 3.00 percentage points; the observed-to-expected event ratio is \(150/120=1.25\). The model underpredicts overall in this sample.

The group-specific comparison is also informative. In the lower-risk group, observed incidence is \(20/500=4.00\%\), compared with 5.00% predicted. In the higher-risk group, it is \(130/500=26.0\%\), compared with 19.0% predicted. The errors differ across the groups. An intercept adjustment to raise the average prediction may improve the overall match, but these results do not show that an intercept shift alone will correct the group-specific errors. The target data call for further assessment of the conditional model, not just a new baseline.

Assumptions and Common Pitfalls

A transport analysis should make its assumptions explicit. In particular, check that the predicted outcome has the same definition and time horizon, and that the target incidence refers to the same eligible population and starting point. Confirm that the score is constructed and scaled comparably; standardizing the score differently in the target population changes the meaning of a one-unit coefficient. The target sample must also provide a credible estimate of incidence and predictor distribution. A case-control sample, for example, does not generally reveal population incidence from its sampled case fraction alone.

Most importantly, assess whether retaining the source conditional effects is defensible. Genetic effects estimated through a score can vary across settings, including when the score's relationship to underlying genetic variants differs or when relevant interactions differ. A changed score distribution by itself can change marginal risks without changing conditional effects; it should not be mistaken for proof that the genetic slope has changed. Conversely, a correct target average does not prove the genetic slope is stable.

  • Wrong reasoning: “The target population has higher incidence, so multiply every source risk by the ratio of incidences.” Correction: Risks are bounded by 1, and relative odds or risks do not generally translate through simple multiplication. Use a model-appropriate recalibration, such as a target intercept fitted to target incidence and predictor distribution.
  • Wrong reasoning: “The recalibrated predictions average to the target incidence, so the model transports.” Correction: The average can match while predictions are wrong within score or clinical subgroups. Check target calibration across predicted risks and relevant predictors.
  • Wrong reasoning: “A changed target incidence proves that the genetic effect changed.” Correction: Incidence can change because of baseline risk or predictor distributions even when conditional genetic effects are stable. Evaluate baseline and relative effects as separate questions.
Key takeaway: Transporting absolute genetic risk is not a choice between “keep the source model” and “replace it.” State the assumption about conditional genetic effects, adapt the baseline using target incidence and predictor distribution when justified, and validate calibration in the target population. Baseline recalibration can correct an overall level; it cannot by itself establish or repair transport of relative effects.

Check Your Understanding

Use the model assumptions and target-population distinctions in this tutorial to answer the following.

  1. Why can the same conditional genetic score effect yield different average absolute risks in two populations?
  2. A score has a stable conditional odds ratio, but the target population has a different score distribution. Which part of the target-risk calculation must account for that difference?
  3. What assumptions are needed before using a target baseline risk with a source odds ratio to calculate target risks at other score values?
  4. Why does matching the mean predicted risk to the target incidence not demonstrate calibration across score levels?
  5. Why is multiplying all source risks by the ratio of target to source incidence generally not a valid recalibration method?
Clinical Biostats