Tutorials › Model-Informed Drug Development (MIDD) › Subgroup Exposure-Response Comparisons

Exposure-Response for Efficacy and Safety · Tutorial 200 of 596

Subgroup Exposure-Response Comparisons

Estimate subgroup differences in exposure-response relationships on a defined scale, quantify their uncertainty, and interpret them without relying on separate subgroup significance tests.

Advanced 12 min read

What You'll Learn

  • Specify a subgroup-by-exposure model and identify the contrast that compares subgroup relationships.
  • Calculate an interaction estimate and confidence interval from a fitted model.
  • Interpret interaction terms on linear and log-odds scales.
  • Explain why significance in one subgroup but not another is not evidence of a subgroup difference.
  • Recognize when limited exposure overlap, model assumptions, or subgroup selection weaken conclusions.
  • Distinguish pooled interaction models from separate subgroup fits and report the scale of comparison.

What a Subgroup Comparison Must Establish

A treatment may have a different exposure-response relationship in different patient groups. For example, the change in an efficacy score associated with a given increase in exposure might differ by renal function category. The relevant question is not simply whether an exposure-response association is detectable in each subgroup. It is whether the estimated relationships differ from one another, by how much, and with what uncertainty.

The comparison should be defined before interpreting results: specify the subgroup, the exposure contrast, the outcome scale, and the model scale on which differences will be assessed. An interaction term in a pooled model gives a direct estimate of subgroup difference on the specified model scale. Its interpretation depends on that scale: a difference in linear slopes is not the same quantity as a ratio of odds ratios or a difference in predicted probabilities.

Definition: A subgroup exposure-response contrast is a stated difference between exposure-response effects in two or more defined patient groups. In a model with exposure \(x\) and binary subgroup indicator \(G\), the exposure-by-subgroup interaction estimates how the model-scale exposure effect changes between \(G=0\) and \(G=1\). The contrast, its units, and the model scale should be reported explicitly.

Subgroups should be prespecified when possible, with a clinically interpretable definition and a clear reference group. This helps distinguish a planned comparison from a pattern noticed after inspecting many possible partitions. Prespecification does not, by itself, remove uncertainty, confounding, or the need to consider multiplicity when many subgroup claims are made.

A Pooled Interaction Model

For a continuous outcome measured once per participant, a simple linear model is

$$ Y_i=\beta_0+\beta_E x_i+\beta_G G_i+\beta_{EG}x_iG_i+\varepsilon_i. $$

Here \(Y_i\) is the outcome for participant \(i\), \(x_i\) is exposure on a specified scale, and \(G_i=0\) or \(1\) identifies subgroup membership. The error \(\varepsilon_i\) has mean zero conditional on the modeled predictors. For the usual model-based standard errors and tests, assume independent participants, a correctly specified conditional mean, and constant error variance; normal errors support exact small-sample inference, while large-sample inference is often approximately normal. If these assumptions are not suitable, the uncertainty calculation must be adapted rather than treating the usual standard error as automatically valid.

When \(G_i=0\), the exposure slope is \(\beta_E\). When \(G_i=1\), it is \(\beta_E+\beta_{EG}\). Therefore the slope difference, subgroup 1 minus subgroup 0, is \(\beta_{EG}\). The interaction estimate directly addresses the comparison; the subgroup-specific slopes describe its components.

$$ \text{slope}_{G=0}=\beta_E,\qquad \text{slope}_{G=1}=\beta_E+\beta_{EG},\qquad \text{slope}_{G=1}-\text{slope}_{G=0}=\beta_{EG}. $$

If \(x\) is measured in units of 10 mg/L, a slope is a change in outcome units per 10 mg/L. Centering exposure at a meaningful value can make the intercept and subgroup main effect easier to interpret; it does not change the linear slope difference. The subgroup main effect \(\beta_G\) is the difference between groups at \(x=0\), not a general measure of subgroup difference at every exposure.

Estimating Uncertainty in the Contrast

The interaction estimate is a linear contrast of model coefficients. If \(\hat{\boldsymbol{\beta}}\) is the vector of fitted coefficients, \(c\) is a vector selecting the desired contrast, and \(\widehat{\mathrm{Cov}}(\hat{\boldsymbol{\beta}})\) is their estimated covariance matrix, then the estimated contrast is \(c^\mathsf{T}\hat{\boldsymbol{\beta}}\) and its standard error is the square root of \(c^\mathsf{T}\widehat{\mathrm{Cov}}(\hat{\boldsymbol{\beta}})c\). A large-sample 95% confidence interval is the estimate plus or minus 1.96 standard errors. For smaller samples, use an appropriate \(t\) critical value and degrees of freedom when justified.

This calculation matters because coefficients in the same model are generally correlated. For the subgroup 1 slope, \(\hat{\beta}_E+\hat{\beta}_{EG}\), its variance includes the covariance between the two estimates:

$$ \widehat{\mathrm{Var}}(\hat{\beta}_E+\hat{\beta}_{EG}) = \widehat{\mathrm{Var}}(\hat{\beta}_E) +\widehat{\mathrm{Var}}(\hat{\beta}_{EG}) +2\widehat{\mathrm{Cov}}(\hat{\beta}_E,\hat{\beta}_{EG}). $$
Justification: For any coefficient vector with covariance matrix \(\widehat{\mathrm{Cov}}(\hat{\boldsymbol{\beta}})\), the variance of a linear combination \(c^\mathsf{T}\hat{\boldsymbol{\beta}}\) is \(c^\mathsf{T}\widehat{\mathrm{Cov}}(\hat{\boldsymbol{\beta}})c\). This follows by expanding the variance of the weighted sum and retaining the covariance terms. Thus, uncertainty for a slope or slope difference must use the joint coefficient covariance, not just one coefficient's standard error.

Worked Example: Comparing Continuous-Outcome Slopes

In hypothetical data, investigators fit the linear model above for change in a symptom score, with exposure measured per 10 mg/L and \(G=1\) denoting a prespecified subgroup. The fitted exposure coefficient is \(\hat{\beta}_E=-2.0\) score points per 10 mg/L, with standard error 0.35. The interaction estimate is \(\hat{\beta}_{EG}=-1.10\), with standard error 0.45. The estimated covariance between these coefficients is 0.020 score-points-squared per squared exposure unit.

The estimated slope in subgroup 0 is \(-2.0\) score points per 10 mg/L. In subgroup 1 it is \(-2.0+(-1.10)=-3.10\) score points per 10 mg/L. Thus, the estimated subgroup 1 minus subgroup 0 slope difference is \(-1.10\) score points per 10 mg/L: the modeled decrease is greater in subgroup 1.

The 95% large-sample interval for the difference is

$$ -1.10\pm 1.96(0.45) =-1.10\pm 0.882 =(-1.982,\,-0.218) $$

The interval excludes zero, indicating that this model-based estimate is inconsistent with a zero slope difference at the two-sided 5% level under the stated approximation. It does not establish that exposure causes the outcome change, nor does it establish the mechanism for the difference.

For completeness, the estimated variance of the subgroup 1 slope is \(0.35^2+0.45^2+2(0.020)=0.365\), giving a standard error of \(\sqrt{0.365}=0.604\). Its approximate 95% interval is \(-3.10\pm1.96(0.604)=(-4.284,-1.916)\) score points per 10 mg/L. This interval uses the covariance; adding the two standard errors or ignoring their covariance would not give the correct calculation.

Interactions in Binary-Outcome Models

For a binary outcome, a logistic model can express the exposure relationship on the log-odds scale:

$$ \log\left(\frac{P(Y_i=1\mid x_i,G_i)}{1-P(Y_i=1\mid x_i,G_i)}\right) =\beta_0+\beta_E x_i+\beta_G G_i+\beta_{EG}x_iG_i. $$

This model assumes a correctly specified conditional log-odds relationship and, for standard likelihood-based inference, independent participant outcomes. Here \(\beta_E\) is the exposure effect on log odds in subgroup 0. In subgroup 1, it is \(\beta_E+\beta_{EG}\). Consequently, \(\exp(\beta_{EG})\) is the ratio of the exposure odds ratios for the same exposure increment in subgroups 1 and 0. It is not a difference in event probabilities. To compare probabilities, calculate predicted probabilities at specified exposure values and use an uncertainty calculation for that probability contrast.

Worked Example: Interpreting a Logistic Interaction

Suppose hypothetical binary-outcome data are analyzed with exposure \(x\) in units of 10 mg/L and the logistic model above. Estimates are \(\hat{\beta}_0=-1.50\), \(\hat{\beta}_G=0.40\), \(\hat{\beta}_E=0.60\), and \(\hat{\beta}_{EG}=-0.25\). The interaction standard error is 0.20.

For each 10 mg/L increase, the estimated odds ratio is \(\exp(0.60)=1.822\) in subgroup 0. In subgroup 1 it is \(\exp(0.60-0.25)=\exp(0.35)=1.419\). The ratio of these odds ratios is \(\exp(-0.25)=0.779\): the estimated exposure odds ratio in subgroup 1 is about 0.779 times the corresponding odds ratio in subgroup 0.

The interaction interval on the log-odds scale is \(-0.25\pm1.96(0.20)=(-0.642,0.142)\). Exponentiating the endpoints gives an approximate 95% interval of \((\exp(-0.642),\exp(0.142))=(0.526,1.153)\) for the ratio of odds ratios. Because this interval includes 1, the data do not provide clear evidence of a difference in exposure odds ratios at the 5% level.

Predicted risks illustrate why scale must be stated. At \(x=0\), the fitted risks are \(\mathrm{logit}^{-1}(-1.50)=0.182\) in subgroup 0 and \(\mathrm{logit}^{-1}(-1.50+0.40)=0.250\) in subgroup 1. At \(x=1\), they are \(\mathrm{logit}^{-1}(-0.90)=0.289\) and \(\mathrm{logit}^{-1}(-0.75)=0.321\), respectively. The fitted risk increases are therefore 0.107 and 0.071, a subgroup difference in increases of about \(-0.036\), or \(-3.6\) percentage points. These are point estimates; an interval for this probability-scale contrast requires the joint uncertainty of the fitted coefficients.

Why Separate Significance Tests Do Not Compare Subgroups

A common error is to conclude that exposure-response relationships differ because the estimate is statistically significant in one subgroup but not in another. A test in each subgroup asks whether that subgroup's effect differs from zero. It does not test whether the two subgroup effects differ from each other. The difference depends on both estimates and the uncertainty of their contrast.

Worked Example: One Significant Slope Is Not an Interaction Test

Consider hypothetical, independently estimated linear slopes for a continuous outcome, each in score points per 10 mg/L. Subgroup A has an estimated slope of \(-1.8\) with standard error 0.8; subgroup B has an estimated slope of \(-0.8\) with standard error 0.6. Using normal approximations, the subgroup A statistic is \(-1.8/0.8=-2.25\), with a two-sided \(p\)-value of about 0.024. For subgroup B it is \(-0.8/0.6=-1.33\), with a two-sided \(p\)-value of about 0.182.

The estimated difference, B minus A, is \(-0.8-(-1.8)=1.0\) score point per 10 mg/L. Since the subgroup estimates are independent in this example, the standard error of their difference is

$$ SE_{\mathrm{difference}}=\sqrt{0.8^2+0.6^2} =\sqrt{1.00}=1.00. $$

The difference statistic is \(1.0/1.0=1.00\), with a two-sided \(p\)-value of about 0.317. Its approximate 95% interval is \(1.0\pm1.96(1.0)=(-0.96,2.96)\) score points per 10 mg/L. Thus, one subgroup slope is statistically distinguishable from zero and the other is not, but these data do not establish a difference between slopes. The correct comparison is the interval or test for the difference itself.

Assumptions, Diagnostics, and Alternative Comparisons

An interaction estimate is only as meaningful as the model and data supporting it. Consider the following before interpreting a subgroup contrast:

  • Comparable exposure scale and range. State the exposure unit and compare effects over a range represented in both groups. If exposure values barely overlap, a model may compare slopes largely through extrapolation rather than information from both subgroups.
  • Appropriate outcome model. Check that the selected outcome distribution, link, and exposure-response form are reasonable for the question. A linear interaction compares linear slopes; it cannot capture a true difference in curvature if curvature is absent from the model.
  • Subgroup and covariate specification. Define subgroup membership clearly. If adjustment covariates are needed, state what is adjusted for and ensure the subgroup contrast remains interpretable. A single exposure interaction does not automatically account for other subgroup-varying relationships.
  • Dependence and uncertainty. Repeated outcomes, clustering, or other dependence require an uncertainty method that accounts for that structure. Sparse observations or events in a subgroup can produce imprecise estimates or unstable fitting.
  • Exposure-response interpretation. Differences in observed exposure relationships do not by themselves establish causal effect modification. As emphasized in the earlier material on causal assumptions in individual-level exposure-response, confounding and the way exposure arises must be considered before making causal claims.

A pooled model with an interaction is often the clearest primary approach because it estimates the contrast directly and can share specified model components across groups. Separate subgroup fits can be useful when models genuinely need different structures, but the difference and its uncertainty must still be calculated; separate \(p\)-values are not a substitute. A third option is to report subgroup-specific predicted outcomes at clinically meaningful exposure values. This can aid interpretation, especially for nonlinear links, but the chosen exposure values and probability-scale contrast should be explicit, and uncertainty must be propagated from the fitted model.

The scale of comparison is a substantive choice, not just a technical detail. A linear model interaction compares outcome-unit slopes. A logistic interaction compares log-odds slopes, equivalently the ratio of odds ratios for a fixed exposure increment. Two groups can differ on one scale and appear similar on another. When the clinical question concerns absolute risks or outcome changes, report relevant predictions or contrasts on that scale as well as the model interaction, with uncertainty.

Common Pitfalls and Reporting

  • “Significant here, not significant there” means different. It does not. Estimate the between-group contrast and its uncertainty directly.
  • An interaction \(p\)-value says how large the difference is. It does not. Report the estimated difference, its units or scale, and an uncertainty interval.
  • A non-significant interaction proves the relationships are the same. It does not. The interval may include both negligible and clinically important differences. A claim of similarity requires a defined range of differences considered acceptably small and an analysis designed to assess that claim.
  • An interaction has one scale-independent meaning. It does not. State whether it is a slope difference, log-odds interaction, ratio of odds ratios, or another defined contrast.
  • A precise-looking estimate is necessarily reliable. It may be sensitive to weak exposure overlap, sparse subgroup data, model misspecification, or subgroup selection. Prespecification and a reasonable uncertainty calculation do not eliminate these limitations.

A concise report should name the prespecified groups and reference group, identify the exposure increment and outcome scale, give the subgroup-specific estimates, and report the direct interaction contrast with its interval. For example: “The estimated difference in linear slopes (group 1 minus group 0) was \(-1.10\) score points per 10 mg/L (95% interval \(-1.982\) to \(-0.218\)).” Add whether the result is an association or a causal estimate, as warranted by the analysis assumptions.

Check Your Understanding

Answer each question, then compare your reasoning with the solutions below.

  1. In a linear model with exposure coefficient \(0.7\) and exposure-by-subgroup coefficient \(-0.3\), what are the exposure slopes in groups 0 and 1, and what is the slope difference (group 1 minus group 0)?
  2. A logistic interaction estimate is \(0.2\). What quantity does its exponential represent?
  3. Why does a significant exposure slope in one subgroup and a non-significant slope in another fail to establish that the subgroup slopes differ?
  4. What is one reason a subgroup interaction can be unreliable when exposure ranges differ greatly across groups?

Solutions: (1) The group 0 slope is \(0.7\); the group 1 slope is \(0.7-0.3=0.4\); the difference is \(-0.3\) outcome units per exposure unit. (2) Its exponential, \(\exp(0.2)=1.221\), is the ratio of the groups' exposure odds ratios for the specified exposure increment, under the stated logistic model. (3) The separate tests compare each slope with zero, not with each other. The difference needs its own estimate and uncertainty. (4) With little shared exposure range, the comparison may depend on extrapolation, so the estimated interaction may be driven by model form rather than well-supported comparisons across groups.