Tutorials › Adaptive Clinical Trial Design › Misclassification Correction For Biomarker-Defined Effects

Population Enrichment and Subgroup Selection · Tutorial 416 of 799

Misclassification Correction For Biomarker-Defined Effects

Derive and apply corrections for biomarker prevalence and subgroup treatment effects when a binary assay misclassifies biomarker status.

Advanced 12 min read

What You'll Learn

  • Define sensitivity, specificity, prevalence, and the assay-positive rate for a binary biomarker.
  • Correct observed assay-positive prevalence when sensitivity and specificity are known.
  • Derive how assay misclassification mixes treatment effects across true biomarker groups.
  • Recover true subgroup effects from observed assay-stratum contrasts under nondifferential misclassification.
  • Recognize weak assay discrimination, differential error, and uncertainty in assay parameters as limits on correction.

Why Misclassification Changes a Subgroup Effect

Enrichment decisions and subgroup claims depend on knowing which participants truly have the biomarker of interest. An assay that sometimes labels a biomarker-positive participant as negative, or a negative participant as positive, mixes the true subgroups. Consequently, treatment effects calculated within the assay-reported groups generally do not equal the effects in the true biomarker groups. The direction and size of the distortion depend on prevalence as well as assay accuracy.

This tutorial considers a binary baseline biomarker and a treatment comparison on an additive scale: a difference in mean outcome, or a risk difference for a binary outcome. The correction is not generally a direct correction of odds ratios or hazard ratios; those measures do not combine as simple weighted averages.

Definition: Let \(B=1\) denote true biomarker-positive status and \(B=0\) true biomarker-negative status. Let \(W=1\) and \(W=0\) denote assay-reported positive and negative status. Sensitivity is \(Se=P(W=1\mid B=1)\); specificity is \(Sp=P(W=0\mid B=0)\). The true prevalence is \(p=P(B=1)\), and the observed assay-positive proportion is \(q=P(W=1)\). The Youden index \(J=Se+Sp-1\) measures discrimination beyond an uninformative binary assay.

Write \(A=1\) for assignment to the experimental treatment and \(A=0\) for control. For an outcome \(Y\), define the true subgroup treatment effect as \(\tau_b=E[Y(1)-Y(0)\mid B=b]\), where \(Y(a)\) is the potential outcome under assignment \(a\). For a continuous outcome, \(\tau_b\) is in outcome units; for a binary outcome, it is a risk difference.

Assumptions for the Basic Correction

The formulas below require more than a sensitivity and specificity number. First, the biomarker is measured at baseline, before treatment assignment can affect either the biomarker or its measurement. Second, treatment is randomized, so treatment assignment is independent of true biomarker status and potential outcomes. Third, the assay properties apply to the trial population and are the same across treatment assignments.

The central misclassification assumption is nondifferential measurement conditional on true biomarker status: given \(B\), the assay result \(W\) is independent of treatment assignment and of the potential outcomes. In particular, the assay error must not depend on prognosis or treatment response within a true biomarker group. Under this assumption, people classified into a given assay stratum are mixtures of the true groups with the same mixture proportions in both randomized arms. If assay error depends on outcome or treatment, the simple mixture correction need not hold.

The basic correction also assumes \(Se\) and \(Sp\) are known or have been estimated from suitable validation data, and that \(J>0\). When \(J=0\), the assay result contains no information about true status, so prevalence and subgroup effects cannot be recovered from it using these equations. A value of \(J\) near zero makes the correction highly unstable.

Correcting Biomarker Prevalence

The observed assay-positive proportion combines true positives correctly detected and true negatives incorrectly called positive. The law of total probability gives

$$ q=P(W=1)=Se\,p+(1-Sp)(1-p). $$

Collecting the terms in \(p\) yields \(q=1-Sp+Jp\). Thus, when \(J\ne 0\), the prevalence implied by the observed assay-positive proportion is

$$ p=\frac{q+Sp-1}{Se+Sp-1}=\frac{q+Sp-1}{J}. $$

The corrected value must be between 0 and 1. Equivalently, under the assumed assay properties, \(q\) must lie between the false-positive rate \(1-Sp\) and sensitivity \(Se\) when \(J>0\). A value outside that range is a warning of sampling variation, mismatched assay properties, or a violated model; it is not a reason to silently truncate the result and proceed as if the assumptions held.

Worked Example: Correcting the Positive Prevalence

Suppose a hypothetical trial has 440 assay-positive participants among 1,000 screened, so \(q=0.440\). An external validation set relevant to the trial population suggests \(Se=0.900\) and \(Sp=0.850\). Assume these values apply to the trial and the assay classification is nondifferential.

The discrimination index is \(J=0.900+0.850-1=0.750\). Therefore,

$$ \hat p=\frac{q+Sp-1}{J} =\frac{0.440+0.850-1}{0.750} =\frac{0.290}{0.750} =0.3867. $$

The corrected estimated prevalence is 38.67%, rather than the observed assay-positive proportion of 44.0%. This estimate is coherent with the assumed assay: \(0.900(0.3867)+0.150(1-0.3867)=0.4400\), up to rounding. The difference arises because some assay-positive participants are false positives, while some true positives are missed.

Correcting Treatment Effects

To correct an additive treatment effect, first determine the true-status composition of each assay stratum. By Bayes' rule, the proportion truly positive among assay-positive participants is \(a=P(B=1\mid W=1)=Se\,p/q\). The proportion truly positive among assay-negative participants is \(r=P(B=1\mid W=0)=(1-Se)p/(1-q)\). The remaining proportions in those strata are truly negative.

Let \(\delta_+\) be the randomized treatment contrast among participants with \(W=1\), and let \(\delta_-\) be the corresponding contrast among participants with \(W=0\). Under the assumptions above, the two observed contrasts are mixtures of the true subgroup effects:

$$ \begin{aligned} \delta_+ &= a\tau_1+(1-a)\tau_0,\\ \delta_- &= r\tau_1+(1-r)\tau_0. \end{aligned} $$

Subtracting the second equation from the first eliminates the common component of the effects and gives \(\delta_+-\delta_-=(a-r)(\tau_1-\tau_0)\). Therefore, if \(a\ne r\), the contrast between true subgroup effects is

$$ \tau_1-\tau_0=\frac{\delta_+-\delta_-}{a-r}. $$

Substitution into either mixture equation recovers the individual effects. For example, \(\tau_0=\delta_- - r(\tau_1-\tau_0)\), and \(\tau_1=\tau_0+(\tau_1-\tau_0)\). These equations correct both the estimated effect difference and the subgroup-specific effect levels; simply dividing the assay-positive effect by sensitivity would not do so.

Why the Effect Correction Works

The preceding subtraction is the key justification. In matrix form, the mixture equations are

$$ \begin{pmatrix} \delta_+\\ \delta_- \end{pmatrix} = \begin{pmatrix} a & 1-a\\ r & 1-r \end{pmatrix} \begin{pmatrix} \tau_1\\ \tau_0 \end{pmatrix}. $$

The determinant of the mixing matrix is \(a(1-r)-r(1-a)=a-r\). If \(a-r\ne0\), the matrix is invertible, and the two true effects are identifiable from the two observed contrasts, provided the mixture weights are known. If \(a=r\), assay-positive and assay-negative strata have the same true-status composition. They then provide no distinct information with which to separate \(\tau_1\) from \(\tau_0\).

The connection between this determinant and assay accuracy can be made explicit. Using the Bayes expressions for \(a\) and \(r\), and \(q=Se\,p+(1-Sp)(1-p)\), gives

$$ a-r=\frac{p(1-p)(Se+Sp-1)}{q(1-q)} =\frac{p(1-p)J}{q(1-q)}. $$

Thus, if both true groups are present and \(J>0\), the assay strata have distinct compositions. But when prevalence is near 0 or 1, or \(J\) is small, \(a-r\) can be small. Dividing by a small value amplifies sampling error and any error in the assumed assay properties.

Worked Example: Recovering True Subgroup Effects

Use the hypothetical trial and assay from the prevalence example: \(p=0.3867\), \(q=0.440\), \(Se=0.900\), and \(Sp=0.850\). Suppose the estimated treatment contrast is 5.00 outcome units in the assay-positive stratum and 2.00 units in the assay-negative stratum. Assume randomization, nondifferential assay error, and an additive treatment-effect scale.

The assay-positive true-positive fraction is \(a=Se\,p/q\):

$$ a=\frac{0.900(0.3867)}{0.440} =\frac{0.3480}{0.440} =0.7909. $$

The assay-negative true-positive fraction is \(r=(1-Se)p/(1-q)\):

$$ r=\frac{0.100(0.3867)}{0.560} =\frac{0.03867}{0.560} =0.06905. $$

The observed difference between assay-stratum effects is \(5.00-2.00=3.00\) units, while \(a-r=0.7909-0.06905=0.7219\). Hence,

$$ \tau_1-\tau_0 =\frac{3.00}{0.7219} =4.156\text{ units}. $$

Recover the negative-group effect from the assay-negative mixture:

$$ \tau_0=2.00-(0.06905)(4.156)=1.713\text{ units}. $$

Then \(\tau_1=\tau_0+4.156=5.869\) units. Checking the assay-positive mixture gives \((0.7909)(5.869)+(0.2091)(1.713)=5.00\) units, up to rounding. Under the model, the corrected estimated treatment effects are about 5.87 units for true biomarker-positive participants and 1.71 units for true biomarker-negative participants. These are estimates, not proof that the treatment effects differ.

Worked Example: A Less Discriminating Assay

Consider another hypothetical setting with true prevalence \(p=0.250\), \(Se=0.800\), and \(Sp=0.800\). The assay-positive rate implied by these values is

$$ q=(0.800)(0.250)+(0.200)(0.750)=0.350. $$

The two composition weights are \(a=(0.800)(0.250)/0.350=0.5714\) and \(r=(0.200)(0.250)/0.650=0.07692\), so \(a-r=0.4945\). Suppose the observed contrasts are \(\delta_+=4.00\) and \(\delta_-=1.50\) outcome units. Then

$$ \tau_1-\tau_0=\frac{4.00-1.50}{0.5714-0.07692} =\frac{2.50}{0.4945} =5.056\text{ units}. $$

The true negative-group effect is \(\tau_0=1.50-(0.07692)(5.056)=1.111\) units, and the true positive-group effect is \(\tau_1=1.111+5.056=6.167\) units. The mixture equations reproduce the observed contrasts: \(0.5714(6.167)+0.4286(1.111)\approx4.00\), and \(0.07692(6.167)+0.92308(1.111)\approx1.50\). The correction is larger than in the preceding example because these assay strata are less separated in their true-status composition.

Estimation, Diagnostics, and Alternatives

In practice, replace \(q\) with the observed assay-positive proportion and use estimates of sensitivity and specificity from validation data. Calculate \(\hat p\), then the estimated composition weights, and finally solve the mixture equations using the randomized treatment contrasts within assay strata. Keep the analysis on a prespecified additive estimand, with its units stated. The earlier material on population-specific estimands is relevant to choosing which population and treatment contrast the corrected effects are intended to describe.

A plug-in correction does not make uncertainty disappear. The uncertainty in the observed treatment contrasts, prevalence, sensitivity, and specificity all contribute to uncertainty in the corrected effects. A standard error that treats estimated assay properties as fixed can be too small. Suitable approaches include joint likelihood methods that incorporate validation data, or a bootstrap that resamples trial and validation participants according to the sampling design and recalculates the complete correction in each replicate. Report the source and precision of assay-performance estimates, not only their point values.

Diagnostics should include checking that the corrected prevalence lies in \([0,1]\), inspecting whether the assay validation population and laboratory procedures match the trial, and examining whether sensitivity or specificity plausibly varies by treatment arm, outcome-related factors, or participant characteristics. Large corrected effects, wide intervals, or estimates that change sharply under small changes in \(Se\) or \(Sp\) indicate instability. A negative corrected prevalence or an implausible effect is a model warning, not evidence that the formula should be adjusted informally.

The direct analysis by observed assay status is simpler and avoids relying on externally supplied assay accuracy, but estimates effects in assay-defined groups rather than true biomarker groups. Restricting analysis to assay-positive participants does not remove false positives or recover missed positives. A validation substudy can support correction or a likelihood model that propagates assay uncertainty; if the assay properties are unknown, the observed positive rate alone cannot identify prevalence and both subgroup effects. These approaches answer different questions and rely on different information.

The main limitation is the nondifferential-error assumption. If false negatives have different outcomes within the true-positive group, for example, then the assay-positive and assay-negative mixtures need not combine the same \(\tau_1\) and \(\tau_0\) in both treatment arms. The simple linear equations then fail. Further, the correction is specific to additive effects: a risk difference can be mixed by subgroup proportions, but an odds ratio or hazard ratio generally cannot be corrected by applying these same formulas. Finally, correcting a point estimate does not address multiplicity or selection from searching across many subgroups.

Common pitfall: “Sensitivity is 90%, so divide the observed assay-positive treatment effect by 0.90 to get the true-positive effect.” This is incorrect: the observed positive group also contains false positives, the assay-negative group contains missed positives, and both observed effects are mixtures. Correct the prevalence and mixture weights, then solve both equations. If the assay barely distinguishes the true groups, report that the correction is unstable rather than presenting a precise-looking subgroup estimate.

Check Your Understanding

Answer each question using the assumptions stated in the question. Solutions follow each prompt.

  1. A population has assay-positive proportion \(q=0.300\), sensitivity \(Se=0.800\), and specificity \(Sp=0.900\). What prevalence does the correction imply? Solution: \(J=0.800+0.900-1=0.700\), so \(p=(0.300+0.900-1)/0.700=0.200/0.700=0.2857\), or 28.57%.
  2. What does \(J=0\) imply for the prevalence correction and the separation of true subgroup effects? Solution: The assay-positive probability becomes \(q=1-Sp\), independent of prevalence, so the prevalence formula divides by zero. The assay strata do not distinguish true status; in the effect mixture, the weights are equal and the two true effects cannot be separated from the observed strata contrasts.
  3. With \(p=0.400\), \(Se=0.900\), and \(Sp=0.800\), calculate \(q\), \(a\), and \(r\). Solution: \(q=(0.900)(0.400)+(0.200)(0.600)=0.480\). Then \(a=0.360/0.480=0.750\), and \(r=(0.100)(0.400)/(1-0.480)=0.040/0.520=0.07692\).
  4. For the weights in Question 3, suppose \(\delta_+=6.00\) and \(\delta_-=2.00\) outcome units. Calculate the corrected subgroup effects. Solution: \(a-r=0.750-0.07692=0.6731\), so \(\tau_1-\tau_0=(6.00-2.00)/0.6731=5.943\) units. Then \(\tau_0=2.00-(0.07692)(5.943)=1.543\) units and \(\tau_1=1.543+5.943=7.486\) units, up to rounding.
  5. Why can the correction be unreliable even when its point estimate is finite? Solution: If \(a-r\) is small, the estimate divides the observed effect difference by a small number, amplifying sampling error and uncertainty in sensitivity, specificity, and prevalence. The point estimate alone does not show that instability; uncertainty analysis and sensitivity checks are needed.
Clinical Biostats