Tutorials › Statistical Genetics › Reliable Phenotype Measurement and Misclassification

Genome-Wide Association Study Design · Tutorial 339 of 989

Reliable Phenotype Measurement and Misclassification

Learn how phenotype error changes association estimates and precision, and quantify the consequences of repeated measurements and diagnostic misclassification.

Intermediate 12 min read

What You'll Learn

  • Distinguish classical quantitative measurement error from phenotype scaling and diagnostic misclassification
  • Calculate how independent measurement noise changes phenotype variance and reliability
  • Derive how averaging repeated measurements reduces random error, including correlated errors
  • Quantify the attenuation caused by nondifferential binary phenotype misclassification
  • Relate measurement quality to genetic-association precision and power
  • Recognize when phenotype error can bias an association rather than merely reduce precision

Why Phenotype Measurement Matters

A genetic association analysis can be carefully designed and still have little power if the phenotype is recorded imprecisely. A noisy laboratory measure varies for reasons unrelated to the participant’s underlying trait; a diagnostic definition can incorrectly label some unaffected participants as cases and some affected participants as controls. These errors affect the variation in the analyzed phenotype and the amount of genetic signal available to detect.

The consequences depend on the error mechanism. In a linear regression of a quantitative phenotype on genotype, independent error in the outcome generally leaves the unstandardized genetic slope unbiased but increases its standard error. Misclassification of a binary phenotype can attenuate the genetic association itself. Error that depends on genotype or other analysis variables can cause bias and is not safely summarized as a simple loss of power.

Definition: Let \(Y\) denote the phenotype of scientific interest and \(W\) the phenotype actually analyzed. Measurement error is a discrepancy between \(W\) and \(Y\). In the classical additive model, \(W=Y+U\), where the error \(U\) has mean zero and is independent of \(Y\), genotype, and other variables in the association model. Reliability in this model is the proportion of observed variance attributable to the true phenotype: \(\operatorname{Var}(Y)/\operatorname{Var}(W)\).

Quantitative Phenotypes: Variance and Precision

Consider the association model \(Y=\alpha+\beta G+\varepsilon\), where \(G\) is genotype dosage, \(\beta\) is the change in the mean phenotype per additional allele, and \(\varepsilon\) is the residual. Suppose the measured phenotype is \(W=Y+U\), with \(U\) independent of \(G\) and \(\varepsilon\), mean zero, and variance \(\tau^2\). Then

$$ W=\alpha+\beta G+(\varepsilon+U),\qquad \operatorname{Var}(W\mid G)=\sigma_\varepsilon^2+\tau^2. $$

Because the error has conditional mean zero, \(E(W\mid G)=E(Y\mid G)\): the unstandardized slope remains \(\beta\). But the residual variance increases. In a large-sample linear regression, the standard error of the slope is approximately \(\sigma_\varepsilon/\sqrt{n\operatorname{Var}(G)}\). Replacing \(Y\) with \(W\) therefore reduces the association’s noncentrality parameter, which measures the signal relative to its sampling variability.

$$ \frac{\text{noncentrality for }W}{\text{noncentrality for }Y} \approx \sqrt{\frac{\sigma_\varepsilon^2}{\sigma_\varepsilon^2+\tau^2}}. $$

This ratio assumes the same participants, genotype distribution, model, and covariate adjustment, with independent additive error in the outcome. It describes a reduction in precision, not a change in the unstandardized genetic effect. For a fixed significance threshold, lower noncentrality means lower power. The formula is an approximation for the usual large-sample regression setting; exact power also depends on the test and its rejection threshold.

Worked Example: Independent Error in a Quantitative Trait

Suppose the residual variance of a hypothetical true phenotype is \(4\) units squared, the independent measurement-error variance is \(1\) unit squared, the genetic slope is \(0.20\) phenotype units per allele, \(\operatorname{Var}(G)=0.5\), and \(n=2{,}000\). Assume the linear model and independence conditions above hold.

The measured phenotype has residual variance \(4+1=5\) units squared. The true-phenotype noncentrality is approximately

$$ 0.20\sqrt{\frac{2{,}000(0.5)}{4}} =0.20\sqrt{250} \approx 3.162. $$

For the measured phenotype it is

$$ 0.20\sqrt{\frac{2{,}000(0.5)}{5}} =0.20\sqrt{200} \approx 2.828. $$

Their ratio is \(2.828/3.162\approx 0.8944=\sqrt{4/5}\). Thus the association has about 89.44% of the noncentrality it would have with the true phenotype, under these assumptions. The slope remains \(0.20\) phenotype units per allele; the larger residual variance, not slope attenuation, accounts for the loss of precision.

For the classical model, reliability is \(\operatorname{Var}(Y)/\operatorname{Var}(W)\), since independence gives \(\operatorname{Var}(W)=\operatorname{Var}(Y)+\tau^2\). When the genetic contribution to total variance is small, the variance ratio in the noncentrality formula is often close to the corresponding reliability. It is important, however, to distinguish the two: association precision depends on residual variance conditional on the modeled predictors, whereas reliability is defined using total phenotype variance.

Repeated Measurements

Repeating a measurement can reduce random error, but the benefit depends on whether errors across repeats are independent. Let \(W_{ij}=Y_i+U_{ij}\) be repeat \(j\) for participant \(i\). Assume each error has variance \(\tau^2\), and every pair of errors from the same participant has correlation \(\rho\). The mean of \(m\) measurements has error variance

$$ \operatorname{Var}\left(\frac{1}{m}\sum_{j=1}^{m}U_{ij}\right) = \frac{\tau^2}{m}\{1+(m-1)\rho\} = \tau^2\left\{\rho+\frac{1-\rho}{m}\right\}. $$

The expression follows by adding the \(m\) individual variances and the \(m(m-1)\) ordered covariance terms, each equal to \(\rho\tau^2\), then dividing by \(m^2\). If \(\rho=0\), error variance falls to \(\tau^2/m\). If \(\rho>0\), the shared component remains even as the number of repeats grows; repeating the same systematically biased procedure does not remove that shared error.

Worked Example: Averaging Correlated Repeats

In a hypothetical study, each single measurement has random-error variance \(9\) units squared, and the error correlation between repeats on the same person is \(0.40\). The true phenotype has variance \(16\) units squared. Compare one measurement with the mean of three measurements. Assume errors are independent of the true phenotype and genotype, and there is no systematic bias.

With one measurement, the error variance is \(9\), so the measured variance is \(16+9=25\) units squared and reliability is \(16/25=0.6400\).

For three repeats, the averaged error variance is

$$ 9\left\{0.40+\frac{1-0.40}{3}\right\} =9(0.40+0.20) =5.4\text{ units squared}. $$

The variance of the averaged measured phenotype is \(16+5.4=21.4\) units squared, giving reliability \(16/21.4\approx0.7477\). Averaging has improved reliability, but it has not eliminated error: the correlation of \(0.40\) leaves a shared-error component.

Binary Phenotypes: Diagnostic Misclassification

For a binary phenotype, write \(D=1\) for a true case and \(D=0\) for a true control. Let \(D^*\) be the recorded classification. Sensitivity is \(Se=P(D^*=1\mid D=1)\), and specificity is \(Sp=P(D^*=0\mid D=0)\). Suppose classification is nondifferential with respect to genotype: conditional on the true disease status, the chance of recording a case does not depend on genotype. Also assume \(Se\) and \(Sp\) are constant across the genotype values being compared.

The probability of a recorded case is

$$ P(D^*=1\mid G) =(1-Sp)+(Se+Sp-1)P(D=1\mid G). $$

The quantity \(J=Se+Sp-1\), called Youden’s \(J\), is the multiplier on the true risk difference across genotype values under these assumptions. Thus, in a linear probability model, the slope for \(D^*\) is \(J\) times the slope for \(D\). If \(J=1\), classification is perfect; if \(J=0\), recorded status carries no information about true status under this model.

Misclassification also changes the case proportion and the binary phenotype variance. If the true case prevalence is \(p\), the observed case proportion is \(q=Se\,p+(1-Sp)(1-p)\), so the observed variance is \(q(1-q)\), rather than \(p(1-p)\). The slope multiplier alone does not determine power: the variance changes too. Logistic-regression odds ratios do not, in general, equal the true odds ratio multiplied by \(J\). The linear-probability result and the power approximation below should not be treated as an exact logistic or case-control correction.

Worked Example: Nondifferential Misclassification

Suppose a hypothetical population has true case prevalence \(p=0.10\), diagnostic sensitivity \(Se=0.90\), and specificity \(Sp=0.95\). Assume these values apply equally across genotype groups and that classification errors are independent of genotype conditional on true status.

The recorded case proportion is

$$ q=(0.90)(0.10)+(1-0.95)(1-0.10) =0.090+0.045 =0.135. $$

The true binary variance is \(0.10(0.90)=0.0900\). The recorded binary variance is \(0.135(0.865)=0.116775\). Also, \(J=0.90+0.95-1=0.85\), so the linear risk-difference slope is reduced to 85% of its true value.

For a small genetic effect in an unselected population, a rough linear-model comparison of noncentrality uses the slope multiplier and the ratio of binary variances:

$$ 0.85\sqrt{\frac{0.0900}{0.116775}} \approx 0.85(0.8779) \approx 0.7462. $$

Under this stated approximation, the recorded phenotype has about 74.62% of the true phenotype’s noncentrality. This is not an exact power ratio for a logistic analysis or an ascertained case-control sample; those settings require their own sampling and model assumptions.

Calibration, Differential Error, and Interpretation

Not every measurement problem follows the classical additive model. For example, an instrument may report \(W=cY+U\), where \(c\) is a calibration factor. If \(U\) is independent with mean zero, the genetic slope becomes \(c\beta\); the measured scale itself changes the unstandardized effect. This differs from adding independent noise to an accurately calibrated outcome. A deterministic change of units alone does not reduce a correctly standardized association, but adding noise after scaling can reduce precision.

Worked Example: Scaling Plus Additive Noise

Suppose a hypothetical true phenotype follows \(Y=\alpha+0.10G+\varepsilon\), with residual variance \(\operatorname{Var}(\varepsilon)=0.250\) phenotype-units squared. An instrument reports \(W=0.75Y+U\), where \(U\) is independent of genotype and \(\varepsilon\), has mean zero, and has variance \(0.12875\) instrument-units squared. This is a calibration change plus additive error, not the classical \(W=Y+U\) model.

The observed genetic slope is \(0.75(0.10)=0.075\) instrument-units per allele. Its residual variance is

$$ 0.75^2(0.250)+0.12875 =0.140625+0.12875 =0.269375. $$

With genotype variance and sample size held fixed, squared noncentrality is proportional to slope squared divided by residual variance. The ratio of squared noncentrality for the instrument reading to that for the true phenotype is therefore

$$ \frac{0.075^2/0.269375}{0.10^2/0.250} = \frac{0.005625/0.269375}{0.0100/0.250} \approx 0.5220. $$

The ratio of noncentrality parameters is \(\sqrt{0.5220}\approx0.7225\). Thus, under the model and approximation stated, the instrument reading retains about 72.25% of the true phenotype’s noncentrality. The calculation uses the conditional residual variances; it does not imply that every form of calibration error has this effect.

If error depends on genotype, the recorded conditional mean need not preserve the true association. For example, if a biomarker assay has different bias by genotype, the measured genetic slope can be shifted, not merely made less precise. Likewise, diagnostic sensitivity or specificity that varies with genotype can invalidate the simple \(J\)-multiplier result. These mechanisms require validation data, an explicit measurement model, or sensitivity analyses; assuming nondifferential error without justification can lead to misleading conclusions.

Practical Checks and Common Mistakes

Before interpreting a genetic association based on an imperfect phenotype, specify what the target phenotype is, how the recorded value relates to it, and which assumptions are plausible. The following checks help separate a loss of precision from a change in the estimand or bias.

  • Do not say all measurement error attenuates the slope. Independent additive error in a quantitative outcome leaves its unstandardized linear-regression slope unchanged under the stated model, while increasing residual variance and standard error.
  • Do not assume repeat measurements eliminate error. Averaging reduces the independent component; correlated or systematic error can remain.
  • Do not apply a binary misclassification multiplier indiscriminately. The \(Se+Sp-1\) result concerns risk differences under nondifferential classification with constant sensitivity and specificity. It is not a universal correction to a logistic odds ratio.
  • Do not equate reliability with genetic heritability or association power. Reliability describes measurement variance under a specified model; power additionally depends on effect size, genotype variation, sample size, analysis, and significance threshold.
  • Do not interpret a null result as evidence that the true phenotype has no genetic association. A weakly reliable or misclassified phenotype can make an association harder to detect.
Key takeaway: Quantify the error mechanism before predicting its effect. Independent additive noise in a quantitative outcome primarily increases residual variance; repeated measures can reduce random error; and nondifferential binary misclassification can attenuate a risk-difference association while changing phenotype variance. Differential error may bias the association and needs separate evaluation.

Check Your Understanding

Use the assumptions stated in each question, and distinguish effect estimates from their precision.

  1. Under \(W=Y+U\), with independent mean-zero \(U\), what happens to the unstandardized slope in a linear regression of phenotype on genotype, and what happens to residual variance?
  2. A single measure has error variance \(12\), and repeat errors are independent. What is the error variance of the mean of four repeats?
  3. For a binary phenotype with sensitivity \(0.92\) and specificity \(0.96\), calculate \(J\). What kind of association measure does this multiplier directly describe under the stated nondifferential model?
  4. Why can positively correlated errors limit the benefit of averaging repeated measurements?
  5. Give one reason why genotype-dependent phenotype measurement error cannot be summarized as a simple loss of power.
Clinical Biostats