Tutorials › Population Pharmacokinetics › Sensitivity Analyses for Race, Genotype, and Co-medication Findings

Sex, Race, Genetics and Co-medications · Tutorial 274 of 599

Sensitivity Analyses for Race, Genotype, and Co-medication Findings

Learn to design and interpret sensitivity analyses that reveal how covariate estimates depend on subgroup coding and record-handling choices.

Intermediate 10 min read

What You'll Learn

  • Distinguish a sensitivity analysis from choosing the most favorable model.
  • Compare race-category definitions while keeping their contrasts clear.
  • Assess genotype estimates under allele, carrier, and diplotype coding.
  • Evaluate how medication exposure windows affect estimated covariate effects.
  • Examine uncertain-record handling without hiding its assumptions.
  • Summarize robustness using effect magnitude, direction, uncertainty, and model diagnostics.

Why Sensitivity Analysis Matters

A subgroup covariate estimate depends not only on the observed pharmacokinetic data but also on how the subgroup is defined. A genotype effect can look different when genotype is coded as allele dosage rather than carrier status; a co-medication effect can change when the exposure window changes; and a race-associated contrast can depend on which categories are compared. Records with uncertain or missing classifications add another layer of choice.

A sensitivity analysis asks whether a scientific conclusion is materially changed by reasonable, explicitly stated alternatives to these choices. It is not a search for whichever definition produces the smallest p-value or the largest effect. Alternatives should be clinically or scientifically defensible, documented before interpreting their results where feasible, and compared in relation to the question each actually estimates.

Definition: A sensitivity analysis evaluates how an estimate or conclusion changes when a defensible modeling choice, covariate definition, exposure window, or record-handling assumption is varied. A useful analysis states the baseline specification, the alternatives, the reason for each alternative, and the extent to which the resulting estimates agree.

The earlier material on genotype representations, medication histories, missing and misclassified records, and parameter uncertainty provides the concepts needed to define these alternatives. Here the emphasis is on comparing results systematically. Keep the population pharmacokinetic model, data exclusions, and other covariates fixed whenever possible, so that a change in the reported estimate can be attributed to the choice under examination.

Define What Is Being Compared

Suppose a model describes individual clearance \(CL_i\) using a log-linear covariate term:

$$ \log(CL_i)=\log(CL_{\mathrm{pop}})+\beta Z_i+\eta_i $$

Here \(CL_{\mathrm{pop}}\) is the typical clearance for the reference covariate value, \(Z_i\) is the covariate coding for individual \(i\), \(\beta\) is its coefficient, and \(\eta_i\) represents individual variability on the log scale. For a binary covariate coded 0 and 1, the clearance ratio for category 1 versus category 0 is \(\exp(\beta)\). Its percentage difference from the reference is \(100[\exp(\beta)-1]\%\). This transformation makes it easier to compare effects expressed on the log scale.

A sensitivity comparison is most interpretable when it tracks a common target contrast. However, changing a definition may change the target itself: a contrast between one race category and all remaining categories is not necessarily the same contrast as a comparison between that category and a particular reference group. In that case, report the contrast in words as well as the estimate; do not present the two estimates as if they answered an identical question.

For each alternative, record the estimate, its uncertainty, the number of individuals and observations contributing to the relevant groups, and any notable model-fitting or predictive diagnostic issues. An estimate changing slightly while its uncertainty overlaps substantially can still be practically important, or practically unimportant; the judgment depends on the magnitude and the pharmacological context, not on a significance label alone.

Varying Subgroup Definitions and Genotype Coding

Race-associated estimates require particular care in defining groups and interpreting contrasts. Race is a social classification and should not be treated as a direct measurement of genetic ancestry or as a biological mechanism. If categories are combined or a reference category is changed, state the rule and its rationale. Examine whether the conclusion is driven by a small category or by sparse representation, and avoid implying that a group label itself explains a pharmacological difference.

Genotype alternatives also encode different assumptions. Allele dosage commonly represents the number of copies of an allele, often 0, 1, or 2; a linear dosage coefficient assumes the same log-scale change for each additional copy. Carrier coding compares people with at least one copy against those with none, assuming the carrier group shares one effect. Diplotype coding can estimate separate contrasts for genotype combinations, but those contrasts may be imprecise when a diplotype is rare. The earlier tutorial on genotype representations distinguishes these codings; a sensitivity analysis compares their implications rather than treating them as interchangeable.

Worked Example: Comparing Two Genotype Encodings

Hypothetical data: In 100 participants, genotype counts are 60 with zero copies of a variant allele, 30 with one copy, and 10 with two copies. A population pharmacokinetic model estimates the association with clearance using each of two prespecified encodings. Assume the same structural model and the same participants are used in both fits.

With allele dosage, let \(Z\) be 0, 1, or 2. Suppose the fitted coefficient is \(\beta=-0.105\) per allele. The implied clearance ratio for one additional allele is:

$$ \exp(-0.105)=0.900 $$

Thus, under the linear dosage assumption, each additional copy is associated with an estimated 10.0% lower clearance, since \(100(0.900-1)=-10.0\%\). The model imposes the same multiplicative change from zero to one copy as from one to two copies.

With carrier coding, let \(Z=1\) for either one or two copies and \(Z=0\) for zero copies. Suppose the fitted coefficient is \(-0.223\). The carrier-to-noncarrier clearance ratio is:

$$ \exp(-0.223)=0.800 $$

The estimated carrier contrast is therefore 20.0% lower clearance. This is not a contradiction: the carrier model estimates one contrast combining 40 carriers, whereas the dosage model estimates a per-copy trend. These hypothetical results suggest an association under both encodings, but they do not establish that the effect is linear per allele. The diplotype-specific estimates and their uncertainty would help show whether the two carrier genotypes behave similarly.

The counts also expose a limitation: only 10 participants have two copies. A separate estimate for that diplotype may be unstable. A changed estimate should therefore be interpreted alongside group sizes and uncertainty, not as evidence that the coding with the more extreme result is preferable.

Varying Co-medication Windows and Uncertain Records

Medication exposure is defined in relation to time, not simply by whether a medication appears somewhere in a history. For a time-varying analysis, compare scientifically plausible windows relative to each pharmacokinetic observation or dosing event. A shorter window may capture current use; a longer window may be justified if the drug's pharmacological effect persists after the last recorded dose. The alternatives should reflect plausible exposure timing, not be chosen after inspecting which window yields the strongest estimate.

When comparing windows, check whether the exposure classification changes for many observations, whether certain subgroups are disproportionately reclassified, and whether enough exposed and unexposed information remains to estimate the effect. Keep concurrent covariates and the model specification stable. If overlapping medications or shared pathways make the effect difficult to identify, changing the window alone does not resolve that problem.

Worked Example: Checking a Medication Exposure Window

Hypothetical analysis: A model estimates the association between use of an enzyme inhibitor and clearance. Exposure is defined using records in the 1-day, 3-day, or 7-day period before each relevant observation. The model and analysis population are otherwise held fixed. Suppose the fitted coefficients are \(-0.174\), \(-0.128\), and \(-0.020\), respectively.

For the 1-day window, the estimated ratio is \(\exp(-0.174)=0.840\), or \(100(0.840-1)=-16.0\%\). For the 3-day window, it is \(\exp(-0.128)=0.880\), or \(-12.0\%\). For the 7-day window, it is \(\exp(-0.020)=0.980\), or \(-2.00\%\). The point estimates therefore attenuate as the window lengthens.

That pattern could occur if the longer window classifies people as exposed even when the relevant pharmacological effect is no longer present. It could also reflect a change in who is classified as exposed, such as adding remote users with different clinical characteristics. These estimates alone do not distinguish those explanations. The analyst should inspect the changed classifications, their timing, uncertainty intervals, group sizes, and relevant diagnostics before deciding what the pattern means. The 1-day window is not automatically correct merely because its estimate is largest.

Uncertain records can be examined using more than one defensible handling rule. For example, compare a primary classification rule with a rule that excludes ambiguous records, a rule that assigns them according to a prespecified clinical criterion, or an appropriate missing-data method. Each approach relies on assumptions: exclusion may change the analyzed population; deterministic assignment may misclassify records; and imputation depends on the imputation model and its assumptions about missingness. State which records are uncertain and how each alternative treats them.

Worked Example: Assessing Ambiguous Medication Records

Hypothetical analysis: In a dataset with 80 participants, 12 have records that do not clearly establish whether an inhibitor was active at the relevant time. Under the primary record-review rule, the estimated clearance ratio for inhibitor exposure is 0.86, with a 95% confidence interval from 0.72 to 1.03. Excluding the 12 ambiguous records gives an estimated ratio of 0.91, with an interval from 0.74 to 1.12. A prespecified alternative rule classifies records with documented recent use as exposed and gives a ratio of 0.83, with an interval from 0.69 to 1.00.

The corresponding point-estimate differences from the reference are \(100(0.86-1)=-14.0\%\), \(100(0.91-1)=-9.00\%\), and \(100(0.83-1)=-17.0\%\). The estimated direction is consistently toward lower clearance, while the magnitude varies from 9% to 17%. All three intervals include 1.00, so these results do not provide clear evidence against a ratio of 1 at the 5% level under each individual analysis. That does not demonstrate that the effect is absent, nor does it establish that the three handling rules are equivalent. The exclusion analysis also uses fewer records and may represent a selected subset.

A useful report would explain the record rules, show the estimates and intervals together, and discuss whether the observed range would change a pharmacological or modeling decision. It would not label one result “robust” just because its interval happens to have an endpoint near 1.

A Compact Comparison Strategy

The following sequence keeps sensitivity analyses interpretable without turning them into an unstructured collection of model fits.

1
Specify the baseline.
State the covariate definition, reference group, genotype coding or exposure window, record rules, model, and target contrast.
2
Choose defensible alternatives.
Give a scientific or data-quality reason for each change. Avoid alternatives selected solely because they produce a preferred result.
3
Fit and check each analysis.
Review estimation stability, subgroup support, uncertainty, and relevant model diagnostics. Do not compare an estimate from a failed or poorly supported fit as if it were reliable.
4
Summarize the pattern.
Compare effect direction and magnitude, intervals, information available, and changes in the estimand. Describe material dependence on choices rather than declaring a winner.

For a coefficient \(\beta\) on the log-clearance scale, the effect ratio is \(\exp(\beta)\). If two otherwise comparable analyses produce coefficients \(\beta_1\) and \(\beta_2\), their ratio-scale estimates differ by the multiplicative factor \(\exp(\beta_2-\beta_1)\). This follows directly from:

$$ \frac{\exp(\beta_2)}{\exp(\beta_1)} =\exp(\beta_2-\beta_1) $$

For example, coefficients \(-0.10\) and \(-0.15\) correspond to ratios of approximately 0.905 and 0.861; their ratio is \(\exp(-0.05)\), approximately 0.951. The second estimate is about 4.9% lower than the first on the ratio scale. This calculation describes the difference in point estimates; it does not, by itself, quantify uncertainty in that difference.

Diagnostics, Alternatives, and Limitations

Sensitivity results need the same basic scrutiny as the primary model. Look for nonconvergence, large changes in standard errors, boundary estimates, or unstable estimates when a rare category is isolated. Check whether covariate patterns change systematically across time or patients, whether exposure groups have adequate observations, and whether predictive diagnostics worsen. A dramatic shift accompanied by a sparse subgroup or a fitting problem may reflect weak information rather than a meaningful biological difference.

The main alternative to a set of sensitivity analyses is to report one prespecified primary definition and its uncertainty. That is often clearer for a primary estimate, but it cannot show how dependent the conclusion is on plausible data or coding choices. Sensitivity analyses add that information; they do not automatically identify which definition is true. Nor do they replace careful study design, record validation, or an explicit account of confounding. In particular, a stable race-associated estimate does not show that race is a causal biological factor, and a stable co-medication association does not by itself remove confounding by indication.

A common mistake is to call an effect robust whenever it remains statistically significant under every alternative. This confuses a thresholded decision with stability of the estimated effect. An estimate can change substantially while remaining on the same side of a significance threshold, or change little while an interval crosses that threshold because precision changed. Compare estimates, uncertainty, and the scientific meaning of the contrast directly. Also avoid presenting a collection of post hoc definitions as independent confirmation: if alternatives were selected after seeing results, that selection should be disclosed.

Key takeaway: A credible sensitivity analysis makes each alternative transparent and interpretable. Robustness is a reasoned assessment of how much the estimate and its scientific interpretation depend on defensible choices—not a claim that every model is identical or that one favorable p-value settles the question.

Check Your Understanding

Answer each question, then compare your reasoning with the solutions below.

  1. A genotype coefficient is \(-0.20\) per additional allele in a log-clearance model. What clearance ratio and percentage difference does it imply per allele?
  2. Why is a carrier-coded genotype estimate not automatically the same estimand as an allele-dosage estimate?
  3. A 1-day and a 7-day inhibitor window produce different estimates. Name two checks that could help explain the difference.
  4. Why can excluding ambiguous medication records change the target population as well as reduce the sample size?
  5. One sensitivity analysis has a p-value below 0.05 and another above 0.05. What should be compared before calling the finding robust or unstable?

Solutions. (1) The ratio is \(\exp(-0.20)=0.819\), approximately, so the estimated clearance difference is \(100(0.819-1)=-18.1\%\) per additional allele. (2) Dosage estimates a per-copy trend, usually assuming a common log-scale increment for each copy; carrier coding estimates one contrast between anyone with at least one copy and those with none. (3) Inspect which observations change exposure status and whether exposure-group sizes, timing patterns, uncertainty, or model diagnostics change. (4) Ambiguous records may be concentrated among particular participants or clinical circumstances, so removing them can leave a systematically different group, not merely fewer records. (5) Compare effect magnitude and direction, uncertainty intervals, subgroup support, diagnostics, and whether the analyses estimate the same contrast. A p-value threshold alone does not measure estimate stability.

Clinical Biostats