Tutorials › High-Dimensional Genomic Data Analysis › Sample-Level Quality Control for Methylation Arrays

Epigenomic and Regulatory Data · Tutorial 772 of 795

Sample-Level Quality Control for Methylation Arrays

Learn to assess methylation-array samples using complementary technical diagnostics and make a defensible, documented decision about exclusion.

Intermediate 12 min read

What You'll Learn

  • Interpret detection p-values as evidence that probe signal is distinguishable from background.
  • Summarize failed-probe rates within each array and compare them across samples.
  • Read control-probe signals and methylated and unmethylated intensity distributions as technical diagnostics.
  • Use sample clustering to flag unusual profiles while accounting for biological differences.
  • Combine independent evidence, metadata, and study design when deciding whether exclusion is justified.
  • Recognize why fixed thresholds and isolated outlier results can lead to poor decisions.

Why sample-level quality control matters

A methylation array measures many CpG sites for each sample. A sample with widespread weak signal, failed conversion, or other technical problems can produce unreliable measurements across many sites. This is different from a problematic individual probe: the question here is whether an array, considered as a whole, provides data that are fit for the planned analysis. Sample-level quality control (QC) uses several diagnostics together; no single plot or cutoff reliably answers that question in every study.

The diagnostics considered here are detection p-values, control-probe signals, distributions of methylated and unmethylated signal, and sample clustering. They are useful before downstream analyses because they can reveal broad technical failure and possible sample mix-ups. QC is an evidence-based decision, not a procedure for deleting every unusual-looking sample. A sample can be unusual for biological reasons, and a technical concern can be real even when the sample does not look like an extreme outlier.

Detection p-values and sample-level summaries

Definition: A detection p-value for a probe in a sample measures how incompatible that probe's observed signal is with a background-signal model. Small values indicate that the signal is distinguishable from background under that model; larger values indicate weaker evidence of detection. It is not the probability that the probe is truly methylated, nor a test of differential methylation.

A common approach estimates background from negative-control probes and compares the observed probe signal with that background. Exact calculations depend on the array platform and processing software. The interpretation is consistent: a detection p-value near zero indicates a signal that is unlikely under the background model, while a larger value warrants concern about that probe's measurement. A failed detection does not establish that the CpG is biologically absent or unmethylated.

For a sample with \(m\) probes, choose a detection-p-value cutoff \(c\) as part of a documented QC plan, then summarize the fraction of probes that fail:

$$ \text{failed-probe fraction} = \frac{1}{m}\sum_{j=1}^{m} I(p_j \ge c), $$

where \(p_j\) is the detection p-value for probe \(j\), and \(I(\cdot)\) equals 1 when its condition is true and 0 otherwise. This fraction is a descriptive sample-level summary. Probes with missing or invalid measurements should be handled explicitly rather than silently counted as passing. Also examine whether failures are concentrated in particular probe types or regions if that information is relevant to the platform and analysis.

A cutoff such as \(c=0.01\) is an example, not a universal rule. The suitable cutoff and sample-level action threshold depend on the platform, software, assay documentation, and study plan. Detection p-values across probes need not be independent, so the failed-probe fraction should not automatically be treated as a binomial test with independent trials.

Worked Example: Comparing Detection Failure Rates

Suppose two hypothetical arrays each have valid measurements at 10,000 probes. The QC plan defines a failed detection as \(p_j \ge 0.01\), and flags an array for review if more than 1.0% of probes fail. Array A has 18 failed probes; Array B has 145.

For Array A, the failed-probe fraction is \(18/10{,}000=0.0018\), or \(0.18\%\). This is below the plan's review threshold. For Array B, it is \(145/10{,}000=0.0145\), or \(1.45\%\), above the threshold. Array B should be investigated further, not automatically discarded: its control-probe signals, overall intensities, and metadata may help distinguish a technical failure from a less consequential set of probe-level failures.

Control probes and intensity distributions

Array control probes assess technical steps using signals whose expected behavior is known or specified by the platform. Depending on the array, control categories can provide information about processes such as staining, extension, hybridization, target removal, bisulfite conversion, and assay specificity. They are technical checks, not measurements of methylation at biological CpG sites. Examine the relevant categories separately: a broadly weak control pattern suggests a different concern from one isolated control outside its expected range.

Compare control signals with platform documentation and, when appropriate, other arrays processed under comparable conditions. The direction and acceptable range depend on the control type and platform; one generic intensity threshold cannot be applied to all controls. Record which controls failed, how far they departed from the expected range, and whether multiple controls point to the same technical problem. Control failures can flag a sample for review even when the overall signal looks plausible.

Also inspect methylated and unmethylated signal distributions separately. A sample with low signal in both channels may have inadequate overall intensity. A markedly abnormal pattern in one channel, a compressed distribution, or an unusual shape relative to comparable samples can also signal trouble. These observations are prompts for investigation, not diagnoses by themselves: legitimate biological differences can shift methylation-related summaries, and array design affects the intensity pattern. At this stage, the aim is to assess whether a sample's measurements are credible, not to adjust background or dye bias.

Worked Example: Interpreting Control and Signal Evidence

Consider a hypothetical array with 12 control checks in the platform's documented expected ranges. The QC plan calls for review if at least two controls are outside range, and its signal-distribution rule calls for review when either channel's median intensity is below 60 arbitrary units. The sample has 10 controls in range, with two conversion-related controls below range. Its methylated and unmethylated median intensities are 72 and 69 arbitrary units, respectively.

The control criterion triggers review because \(12-10=2\) controls are outside range, meeting the plan's threshold. The signal criterion does not trigger review because \(72\ge60\) and \(69\ge60\). The evidence is therefore mixed: overall channel medians are adequate by the stated rule, but two controls flag a possible conversion problem. The next step is to inspect the control values and technical records, and compare the pattern with other arrays. The control finding is meaningful even though it does not prove that every measurement on the array is unusable.

Using sample clustering as a diagnostic

A sample-level clustering plot can show whether an array is isolated from the others. Clustering may use QC summaries, control-probe signals, or measurements at a shared set of probes that passed relevant probe-level checks. If variables have very different scales, scale them appropriately before calculating distances; otherwise a variable with large numerical values can dominate. State what measurements were used and how missing values and scaling were handled.

An isolated sample is a flag, not a verdict. Clustering based on methylation profiles can separate samples because of real biology, such as tissue or cell composition, as well as technical problems. Conversely, a technical failure shared by several arrays may not appear as a single isolated branch. Evaluate clustering alongside sample annotations, control results, and intensity diagnostics rather than interpreting a dendrogram as an exclusion rule.

Worked Example: A Cluster Outlier Is Not Automatically a Failed Sample

For illustration, take four shared CpG measurements from three hypothetical samples: A has \((0.20, 0.30, 0.70, 0.80)\), B has \((0.21, 0.31, 0.69, 0.79)\), and C has \((0.55, 0.60, 0.40, 0.45)\). Use Euclidean distance, the square root of the sum of squared coordinate differences.

The distance between A and B is \(d(A,B)=\sqrt{0.01^2+0.01^2+(-0.01)^2+(-0.01)^2}=\sqrt{0.0004}=0.020\). The distance between A and C is \(d(A,C)=\sqrt{0.35^2+0.30^2+(-0.30)^2+(-0.35)^2}=\sqrt{0.425}=0.652\). C is much farther from A than B is. That establishes a profile difference in this small illustration; it does not establish that C failed technically. If C represents a distinct tissue group, the separation might be expected. Investigate C's identity, controls, detection failures, and signal distributions before considering exclusion.

Combining evidence and making an exclusion decision

A defensible QC decision specifies the evidence and its relevance to the analysis. A sample with a high failed-probe fraction, multiple abnormal controls consistent with the same technical problem, and weak or distorted channel distributions has converging reasons for concern. A sample flagged by only one mild diagnostic, with the other checks satisfactory, generally calls for review rather than immediate removal. In either case, check sample labels, processing records, and other available metadata; a possible labeling error has implications beyond a low signal summary.

1
Apply the stated QC rules.
Calculate detection-failure summaries and compare control and intensity results with platform-appropriate, pre-specified criteria.
2
Look for coherent evidence.
Check whether independent diagnostics point to the same sample and a plausible technical concern; use clustering as supporting context.
3
Review identity and context.
Check records and sample annotations, and consider whether a real biological difference could explain a distinct profile.
4
Document and assess consequences.
Record the evidence, decision, and number of samples affected. If exclusion is justified, report it and assess whether conclusions are sensitive to the decision.

There is no universal numerical cutoff that justifies exclusion for every methylation array, tissue, and study. Establish criteria using platform guidance and study needs, and apply them consistently. Excluding an array changes the analyzed sample set; if the excluded samples differ systematically from those retained, the resulting conclusions may apply to a narrower population. Preserve QC summaries and the reasoning behind each decision so that the procedure is auditable.

Common pitfalls and limitations

  • Treating a detection p-value as a methylation test. It assesses signal relative to background, not whether methylation differs between groups.
  • Using one cutoff as a universal law. A threshold is a QC rule whose suitability depends on platform, processing, and study context; state and justify it.
  • Removing every cluster outlier. A distinct biological profile can be valid. Check other diagnostics and sample context before exclusion.
  • Trusting good overall intensity alone. Adequate channel medians do not rule out problems indicated by controls or detection failures.
  • Confusing sample failure with probe failure. An individual bad probe does not by itself make the whole sample unusable; widespread or coherent problems are more relevant to sample-level decisions.

These checks have limits. They identify evidence of technical concern but do not guarantee that every retained measurement is unbiased, nor can they always identify the cause of an abnormal pattern. Keep sample QC separate from downstream correction and biological modeling, and avoid interpreting technical diagnostics as biological results.

Check Your Understanding

Answer each question, then compare with the solutions.

  1. In a sample with 8,000 valid probes, 64 have detection p-values at or above the chosen cutoff. What is the failed-probe fraction as a percentage?
  2. A sample has an unusual methylation-profile cluster but normal controls and signal distributions. Is exclusion justified from this evidence alone?
  3. Explain what a small detection p-value supports, and name one conclusion it does not support.
  4. A QC plan flags samples when more than 1% of probes fail. One sample has 90 failures among 10,000 probes. Does it cross the stated threshold?

Solutions. (1) \(64/8{,}000=0.008\), or \(0.80\%\). (2) No. The cluster identifies a profile difference, but it could reflect biology; review identity and context and seek independent technical evidence. (3) It supports that the probe signal is distinguishable from the modeled background; it does not show that the site is methylated or differentially methylated. (4) \(90/10{,}000=0.009\), or \(0.90\%\), which does not exceed 1%; it does not cross this particular rule, though other QC evidence may still warrant review.

Clinical Biostats