Tutorials › Statistical Genetics › Pharmacogenomic Outcomes And Estimands

Pharmacogenomic Association and Translation · Tutorial 969 of 989

Pharmacogenomic Outcomes And Estimands

A useful pharmacogenomic estimand makes clear whose outcome is being compared, under which treatment strategies, in which genetic subgroup, and over what period.

Advanced 12 min read

What You'll Learn

  • Distinguish an observed outcome from the estimand it is intended to measure
  • Specify the target population, treatment strategies, genetic subgroup, outcome, and time horizon
  • Define efficacy and toxicity outcomes with a measurement rule and summary scale
  • Make dose-requirement outcomes meaningful for every person in the target population
  • Define discontinuation by its reason, time origin, and treatment of competing events
  • Calculate and interpret simple subgroup-specific risk and mean contrasts

Why Pharmacogenomic Outcomes Need Explicit Estimands

A genetic association with a drug outcome is not interpretable from the outcome label alone. “Response,” “side effect,” “dose,” and “stopping treatment” can each refer to several different measurements. A response could mean symptom improvement at a fixed visit or improvement at any time; a side effect could mean a particular event or any event; dose could mean the initial dose, the stable dose, or the dose required to reach a target. Changing the definition can change the scientific question and the answer.

An estimand is the precise target quantity an analysis aims to describe or estimate. For pharmacogenomic questions, it should identify the target population, the treatment strategies being contrasted, the genetic subgroup, the outcome definition, the time horizon, and the summary measure. These choices are part of the scientific question, not details to fill in after looking at the data.

Definition: A pharmacogenomic estimand is a specified summary of an outcome under one or more treatment strategies for a defined target population or genetic subgroup over a defined time horizon. At minimum, state (1) the population, (2) the treatment contrast, (3) the genetic subgroup, (4) the outcome and its measurement rule, (5) the time origin and horizon, and (6) the summary scale.

For a potential-outcomes description, let \(Y^a\) denote the outcome that would be observed under treatment strategy \(a\). Let \(G=g\) denote membership in a clearly defined genetic subgroup, and let \(S=1\) denote membership in the target population. A mean contrast, for example, can be written \(E(Y^{a_1}-Y^{a_0}\mid S=1,G=g)\). This notation describes a target quantity; it does not by itself establish that the quantity can be identified from a particular data set.

The treatment strategies must be specific enough to distinguish what is being compared. “Drug A versus usual care” is incomplete if usual care varies substantially. One might instead compare Drug A at a specified starting dose with Drug B under a specified titration plan. Similarly, a genetic subgroup must be operationally defined—for example, carriers of at least one prespecified allele at a named locus, using a stated genotype-calling rule. “Genetically susceptible patients” is not a reproducible subgroup definition.

Constructing an Estimand Before Choosing a Model

A practical way to define an estimand is to write its components in words before writing an equation or selecting a statistical model. In particular, name the people to whom the result is intended to apply, not merely the people who happened to be included in the analysis. State the treatment strategies from a common time origin, specify how genotype defines the subgroup, define what is measured, and state when it is measured or over what period it is accumulated.

1
Name the target population.
Specify eligibility, setting, and the time at which eligibility is assessed. For example, adults with a diagnosed condition who are eligible to start either of two named drugs.
2
State the treatment contrast.
Describe the strategies being compared, including relevant dose, titration, and follow-up rules. Do not leave the comparator as an undefined “control.”
3
Define the genetic subgroup.
Give the variant or genotype rule and the group it creates. Keep the rule fixed for the target question.
4
Define outcome and horizon.
Specify the event, scale, measurement procedure, time origin, and endpoint or follow-up duration. State how treatment changes, missing measurements, or relevant events are handled.
5
Choose the summary measure.
Examples include a risk by a fixed time, a risk difference, a mean outcome, or a difference in mean outcomes. State the units and direction of the contrast.

The subgroup-specific contrast in this tutorial compares treatment strategies within one defined genetic subgroup. It is not, by itself, a comparison of treatment effects between genetic subgroups. Those are distinct questions, and a result from one subgroup alone does not establish that genotype modifies the treatment effect.

Defining Efficacy and Toxicity Outcomes

An efficacy endpoint should state what counts as benefit and how it is assessed. For a binary endpoint, “clinical response” needs a rule, such as meeting a prespecified symptom-reduction threshold at week 12. For a continuous endpoint, specify the instrument, scoring direction, and visit. A fixed-time endpoint and an “ever responded during follow-up” endpoint answer different questions. If a measurement requires survival or continued participation to be observed, the estimand must also say how outcomes after death, withdrawal, or treatment discontinuation are represented.

Toxicity endpoints need the same care. “Any adverse event” can combine events that differ in severity and clinical meaning. An estimand might instead concern the risk of a named adverse reaction by day 30, or the mean change in a laboratory measure at week 8. For a risk, define whether a participant counts as having the outcome if the event occurs at any time through the horizon, and specify whether the event must be judged treatment-related. The definition should be applied consistently across treatment strategies.

Worked Example: Efficacy Risk Difference at Week 12

Consider a hypothetical randomized trial among adults eligible for either Drug A or the standard treatment. The target subgroup is patients with at least one copy of a prespecified allele. The efficacy outcome is remission at week 12, defined before enrollment by a stated symptom-score threshold. In this subgroup, 32 of 50 patients assigned Drug A and 24 of 50 assigned standard treatment meet the remission definition.

The subgroup-specific estimand is the week-12 remission risk under assignment to Drug A minus the risk under assignment to standard treatment, among eligible patients in this genetic subgroup. The observed risks are \(32/50=0.640\) and \(24/50=0.480\). Thus the estimated risk difference is

$$ \widehat{RD}=0.640-0.480=0.160. $$

In this hypothetical sample, assignment to Drug A is associated with a 0.160, or 16-percentage-point, higher remission risk by week 12 than assignment to standard treatment in the defined subgroup. This is a sample estimate, not a claim that every patient benefits, and it does not alone show that treatment effects differ across genotypes. For a causal interpretation as a treatment-strategy contrast, the trial’s randomization, outcome ascertainment, and adherence to the defined strategies must support that interpretation.

A toxicity estimand can also use a fixed-horizon risk, but the event and time window should reflect the clinical question. The same arithmetic may be used for a risk difference, while its direction is interpreted according to whether the event is harmful. The risk difference must be described with the event, subgroup, comparator, and horizon, rather than merely reported as a number.

Worked Example: Thirty-Day Toxicity Risk

In a separate hypothetical randomized study of the same defined allele subgroup, the outcome is a prespecified serious adverse reaction occurring within 30 days after treatment assignment. The event is recorded for 4 of 40 patients assigned Drug A and 10 of 40 assigned the comparator. The target quantity is the 30-day event risk under Drug A minus that under the comparator.

The observed risks are \(4/40=0.100\) and \(10/40=0.250\). Therefore,

$$ \widehat{RD}=0.100-0.250=-0.150. $$

The estimate is a 15-percentage-point lower risk of the specified serious reaction by day 30 under Drug A than under the comparator in this subgroup. It is not a 15% relative reduction: the relative risk would be \(0.100/0.250=0.400\). The event definition, ascertainment period, and treatment strategies are essential to either interpretation.

Making Dose-Requirement Outcomes Well Defined

“Dose requirement” is especially easy to leave ambiguous. It may refer to a dose needed to reach a prespecified therapeutic target under a titration algorithm, but that target, the titration steps, and the assessment schedule must be defined. A stable dose at a visit is not automatically the dose that would be required under another treatment strategy or another titration procedure. Nor is a dose measured only among people who responded an outcome for the full eligible population: response is affected by treatment, so selecting only responders changes who is being described.

A defensible dose outcome specifies a rule that assigns a value for every person in the target population. For example, define the outcome as the protocol-assigned daily dose at week 8 under a fixed titration algorithm; assign the maximum protocol dose if the target has not been reached, and assign the last dose before stopping treatment if discontinuation occurs before week 8. This endpoint measures dose under that specified algorithm, including its rules for nonattainment and stopping. It should not be presented as a universal biological dose requirement.

Worked Example: Mean Dose Under a Titration Rule

Suppose a hypothetical study defines dose requirement as the week-8 daily dose under one fixed algorithm. The target is a prespecified clinical threshold; a patient who does not reach it is assigned the protocol maximum, and a patient who stops early is assigned the last protocol dose before stopping. In a genetic subgroup, the five observed values under Drug A are 50, 75, 75, 100, and 100 mg/day. The five values under the comparator are 75, 100, 100, 125, and 125 mg/day. These values are hypothetical and use the same rule in both groups.

The mean under Drug A is \((50+75+75+100+100)/5=400/5=80\) mg/day. The comparator mean is \((75+100+100+125+125)/5=525/5=105\) mg/day. The estimated mean difference, Drug A minus comparator, is

$$ \widehat{\Delta}=80-105=-25\ \text{mg/day}. $$

Under the specified titration rule, the subgroup’s mean assigned dose at week 8 is 25 mg/day lower with Drug A in this sample. The result is tied to the algorithm and the rule for stopping or failing to reach target. It does not establish that the drug intrinsically requires a lower dose in every carrier, or that the same contrast would hold under a different titration protocol.

Discontinuation as an Outcome

Discontinuation is a treatment outcome when the question concerns whether or when patients stop a drug. Define whether the endpoint is stopping for any reason or stopping for a specified reason, such as toxicity or lack of efficacy. Specify the time origin and horizon—for example, all-cause discontinuation by 12 weeks after assignment. State how temporary interruptions, switching, and restarting are classified. If the study records only time to stopping, the estimand should also specify the summary measure used to describe that time.

If death or another event prevents the discontinuation of interest from occurring, the estimand must state how that event is handled. For example, an all-cause discontinuation endpoint can count a composite that includes death, while a question about discontinuation before death needs a different definition. Such decisions affect the meaning of the reported risk; treating people with incomplete follow-up as if they had not discontinued is not a definition of the outcome.

Worked Example: All-Cause Discontinuation by Twelve Weeks

In a hypothetical randomized trial, the target population is adults starting one of two named treatments, and the target subgroup is defined by a prespecified genotype rule. The outcome is stopping the assigned treatment for any reason within 12 weeks after assignment. Among 50 subgroup members assigned Drug A, 5 stop by week 12; among 50 assigned the comparator, 12 stop.

The observed risks are \(5/50=0.100\) and \(12/50=0.240\). The risk difference for Drug A minus comparator is

$$ \widehat{RD}=0.100-0.240=-0.140. $$

The sample shows a 14-percentage-point lower risk of all-cause discontinuation by week 12 under Drug A in the specified subgroup. Because the endpoint is all-cause, the estimate does not identify whether any difference arose from efficacy, toxicity, convenience, or other reasons. Reason-specific discontinuation would require a separately defined outcome.

Why the Summary Scale and Assumptions Matter

A risk difference, risk ratio, mean difference, and time-to-event summary are not interchangeable descriptions. They answer different questions and can lead to different impressions, particularly when outcome risks differ across populations. The estimand must name the scale before results are interpreted. For example, a 16-percentage-point remission difference is an absolute contrast; it is not a 16% relative increase.

A brief justification shows how a binary estimand leads to a risk-difference calculation. For a fixed horizon \(\tau\), define \(Y_\tau^a=1\) when the specified event has occurred by \(\tau\) under strategy \(a\), and \(Y_\tau^a=0\) otherwise. Then the risk under that strategy in subgroup \(g\) is \(P(Y_\tau^a=1\mid S=1,G=g)\). Subtracting the two strategy-specific risks gives

$$ RD_g(\tau) = P(Y_\tau^{a_1}=1\mid S=1,G=g) - P(Y_\tau^{a_0}=1\mid S=1,G=g). $$

In a randomized trial, the observed event proportion in each assigned arm and subgroup estimates the corresponding strategy-specific risk when assignment is randomized within the relevant population and outcomes are ascertained according to the endpoint definition. Interpreting this as the intended causal contrast also depends on the trial’s treatment strategies and follow-up matching the estimand. In observational data, randomization cannot be presumed; whether a causal contrast is identified requires additional assumptions and methods. Defining the estimand is necessary in either setting, but does not itself solve confounding or missing outcome data.

Key takeaway: A pharmacogenomic result is interpretable only in relation to a defined population, treatment contrast, genetic subgroup, outcome, time horizon, and summary scale. A precise estimand makes clear what the result does—and does not—say.

Common Pitfalls

  • Using an outcome label without a measurement rule. “Efficacy” is not a complete endpoint. Define the response threshold or measurement, visit, and time horizon.
  • Leaving the treatment strategy vague. “Drug versus control” can conceal different doses, titration procedures, or follow-up. Name the strategies being compared.
  • Analyzing dose only among responders without saying so. This describes a selected post-treatment group, not dose outcomes for all eligible patients. Define a dose outcome and rules for nonresponse and stopping if the target population is broader.
  • Calling a subgroup-specific effect a genotype interaction. A contrast within one genetic subgroup does not show that the contrast differs in another subgroup.
  • Interpreting a discontinuation risk as a toxicity risk. All-cause stopping can reflect many reasons. Use a reason-specific endpoint when that is the question.
  • Reporting a number without its units or horizon. “The risk difference was −0.14” is incomplete unless the event, treatment order, subgroup, and time period are stated.

Check Your Understanding

For each question, state the estimand component that must be made explicit or identify the appropriate interpretation.

  1. A study reports “response” in carriers of a variant. Name two details needed to make the efficacy outcome reproducible.
  2. Why is a mean dose calculated only among participants who reached a response target not automatically an estimand for all eligible patients?
  3. A treatment has a 30-day adverse-event risk of 0.08 versus 0.12 in a defined subgroup. State the risk difference in percentage points, with the treatment order specified.
  4. What additional endpoint definition is needed to interpret “discontinuation by week 12” when the study includes deaths before week 12?
  5. Does finding a treatment contrast within one genotype subgroup establish that treatment effects differ by genotype? Explain briefly.
Clinical Biostats