Tutorials › Statistical Genetics › Variant-Level Quality Filters For Structural Variants

Structural Variants and Copy Number · Tutorial 480 of 989

Variant-Level Quality Filters For Structural Variants

Learn to define and assess variant-level quality filters, validate their trade-offs, and anticipate how filtering can distort structural-variant association signals.

Advanced 12 min read

What You'll Learn

  • Distinguish call confidence from direct evidence supporting a structural variant.
  • Evaluate breakpoint, read-depth, and cross-call consistency evidence in context.
  • Define transparent, variant-level pass and fail rules without assuming universal thresholds.
  • Compare sensitivity and positive predictive value using validation data.
  • Calculate how false-positive and false-negative calls can alter an association estimate.
  • Recognize why phenotype-aware threshold selection can create misleading signals.

Why Filter Structural-Variant Calls?

A structural-variant call is an inference from sequencing evidence, not a direct observation of a biological event. Repetitive sequence, alignment ambiguity, local coverage variation, and limitations of a caller can all produce convincing-looking but incorrect records. Conversely, a real event may have weak or incomplete read support. Variant-level quality filters make this uncertainty explicit: they define which candidate records have enough evidence for the analysis at hand.

The goal is not to find a threshold that eliminates every questionable call. A stricter threshold can remove artifacts, but it can also discard real variants, including variants whose evidence is weaker because of event size, genomic context, or sequencing characteristics. Those two errors have different consequences for association analysis: false calls can create apparent signals, while missed true calls can reduce or distort them.

Definition: A variant-level quality filter is a prespecified rule that uses evidence about a structural-variant record to decide whether to retain it for analysis. The evidence may include a caller's confidence score, reads supporting the breakpoint, read depth compatible with the proposed copy-number change, and consistency of the call across available evidence. A filter is applied to the candidate variant record; it is distinct from a diagnosis of whether an individual participant's overall set of calls is reliable.

Evidence Dimensions and Their Limits

Quality is not a single property. Several partly independent evidence dimensions can support or challenge a call. The relevant evidence and its interpretation depend on the structural-variant class and on the calling method.

  • Call confidence. A caller may report a score or a probability-like quantity reflecting how well the data fit its calling model. A score is not automatically a calibrated probability that the event is real. Its scale and meaning are caller-specific, so a threshold should be justified for the particular software and data.
  • Breakpoint support. Reads that span a junction, split across the breakpoint, or have paired ends consistent with the proposed event can support its location and structure. A high count is not conclusive if the region is difficult to map; a low count may be expected for an event or library with limited informative reads.
  • Read depth. For a copy-number event, normalized depth can provide evidence that the number of copies differs from the reference state. For example, a deletion should generally have lower depth across its interval than nearby expected sequence, while a duplication should generally have higher depth. Local coverage variation can obscure this pattern, and read depth alone may not establish a breakpoint.
  • Call consistency. Evidence may agree across multiple samples carrying the call, supporting reads, or independent call-generation procedures. Consistency is informative only when the sources being compared are sufficiently independent and comparable. Repeated use of the same underlying evidence does not amount to independent confirmation.

For these reasons, a single confidence score should rarely be treated as a complete quality assessment. A more defensible rule specifies which evidence is required and why. For instance, a deletion filter might require adequate confidence and breakpoint support, and also require depth to be compatible with a deletion. A record with one very strong metric but contradictory evidence may deserve review rather than automatic retention.

Key distinction: A quality score ranks or summarizes evidence under a particular method; it does not prove that a call is true. Likewise, a filter that retains calls with strong evidence does not guarantee that retained calls are error-free.

Defining a Filter Before Association Analysis

Write the decision rule in terms of quantities that are available and interpretable for the data being analyzed. One simple rule is a conjunction of thresholds: a record passes only if every required criterion is satisfied. If \(C\) is a confidence measure, \(B\) is breakpoint-support count, and \(R\) is a normalized depth ratio, an illustrative deletion rule might be

$$ \text{Pass} = \mathbb{1}\{C \ge c_0,\ B \ge b_0,\ R \le r_0\}. $$

Here \(c_0\), \(b_0\), and \(r_0\) are thresholds chosen for the caller, event class, and sequencing data; \(\mathbb{1}\{\cdot\}\) equals 1 when all conditions inside the braces hold and 0 otherwise. The ratio \(R\) must be defined consistently, such as normalized depth in the proposed interval relative to an expected reference level. This example is a form for a rule, not a universal prescription. A duplication would generally need a different depth criterion, and different evidence might be needed for other event classes.

Thresholds should be chosen without using the association result they are meant to assess. If a threshold is adjusted until a desired association appears or disappears, the resulting estimate and its uncertainty no longer reflect a prespecified analysis. When feasible, evaluate candidate rules against an independent validation set in which event status has been assessed by a method not used to make the original calls.

Worked Example: Applying a Deletion Filter

Suppose a hypothetical study uses a caller whose confidence measure has been calibrated for its data. For illustration, the team prespecifies that a deletion record passes if confidence is at least 0.99, at least 5 breakpoint-supporting reads are observed, and the normalized depth ratio is at most 0.70. These cutoffs are hypothetical and would need validation for a real analysis.

Candidate A has confidence 0.997, 7 breakpoint-supporting reads, and a depth ratio of 0.52. It passes each test: \(0.997 \ge 0.99\), \(7 \ge 5\), and \(0.52 \le 0.70\). The rule therefore retains Candidate A.

Candidate B has confidence 0.999 and a depth ratio of 0.96, but only 2 breakpoint-supporting reads. Although its confidence exceeds the cutoff, \(2 < 5\), and its depth ratio is also not compatible with the specified deletion rule because \(0.96 > 0.70\). Candidate B fails the conjunction. Its high confidence score cannot override the two criteria that it does not meet.

This decision is only as useful as the assumptions behind the rule. The team should check that the score is interpreted on its stated scale, the read count is comparable across records, and the depth ratio is calculated on a suitable normalization. Passing the rule supports retaining a candidate; it does not establish biological truth.

Quantifying the Trade-Off With Validation Data

A filter can be evaluated by comparing its decisions with an independent reference assessment. Let \(T\) denote that a candidate is truly present and \(F\) denote that it passes the filter. Sensitivity is \(P(F\mid T)\), the fraction of true events retained. Specificity is \(P(\text{fail}\mid \text{not }T)\), the fraction of non-events rejected. Positive predictive value (PPV) is \(P(T\mid F)\), the fraction of retained candidates that are true events. Sensitivity and specificity describe performance conditional on truth status; PPV also depends on how common true events are among candidates.

Worked Example: Comparing Loose and Strict Filters

In a hypothetical validation set, an independent assessment classifies 80 of 100 candidate records as true events and 20 as artifacts. A loose filter retains 72 true events and 18 artifacts. A stricter filter retains 54 true events and 6 artifacts. Assume the strict filter is nested within the loose filter, so every record retained by the strict rule is also retained by the loose rule.

For the loose rule, sensitivity is \(72/80 = 0.900\), or 90.0%. Its PPV is \(72/(72+18) = 72/90 = 0.800\), or 80.0%. It retains many true events, but 18 of its 90 retained records are artifacts.

For the strict rule, sensitivity is \(54/80 = 0.675\), or 67.5%. Its PPV is \(54/(54+6) = 54/60 = 0.900\), or 90.0%. The stricter rule raises the fraction of retained records that are true, from 80.0% to 90.0%, but loses 18 additional true events: \(72-54=18\).

These results do not show that either rule is universally better. The validation set contains 80% true events, and that proportion may differ substantially among candidate records in an actual study. The example instead makes the trade-off visible: higher PPV can come at the cost of lower sensitivity.

The dependence of PPV on event prevalence follows directly from the definition of conditional probability. If \(\pi=P(T)\), sensitivity is \(P(F\mid T)\), and specificity is \(P(\text{fail}\mid \text{not }T)\), then the probability that a retained candidate is true is

$$ P(T\mid F) = \frac{P(F\mid T)P(T)} {P(F\mid T)P(T)+P(F\mid \text{not }T)P(\text{not }T)} = \frac{\text{sensitivity}\times\pi} {\text{sensitivity}\times\pi+(1-\text{specificity})\times(1-\pi)}. $$

The denominator adds the probability of retaining a true event to the probability of retaining an artifact. For example, if sensitivity is 0.90, specificity is 0.80, and only 10% of candidate records are true events, then

$$ \text{PPV} = \frac{0.90(0.10)} {0.90(0.10)+0.20(0.90)} = \frac{0.09}{0.27} = 0.333. $$

Thus, even with 90% sensitivity, only about 33.3% of retained candidates are expected to be true under these assumptions. A filter's performance in a validation set should not be summarized by sensitivity alone.

How Filtering Can Change an Association Signal

A false-positive variant can create an association signal if its calls differ between phenotype groups. Such a difference can arise, for example, when an artifact is more likely to be called in one group than another. In contrast, false-negative calls change the observed carrier counts and can reduce power or bias an effect estimate. The direction and size of bias depend on the error pattern; it is not correct to assume every filter simply moves an estimate toward zero.

The following examples use odds ratios to show how call errors can alter an association estimate. An odds ratio here compares the odds of a recorded variant call in cases with the odds in controls. These calculations illustrate the effect of call classification; they do not by themselves establish statistical significance or biological causation.

Worked Example: A Differential Artifact Creates an Apparent Signal

Consider a hypothetical study with 100 cases and 100 controls. A candidate call is an artifact, and the true event is absent in everyone. Before filtering, the candidate is called in 18 cases and 2 controls. The corresponding noncarrier call counts are 82 cases and 98 controls. The observed odds ratio is

$$ \widehat{\mathrm{OR}} = \frac{18/82}{2/98} = \frac{18\times 98}{82\times 2} = \frac{1764}{164} = 10.76. $$

This large observed odds ratio arises entirely from differential artifact calls in this hypothetical data. Suppose a stricter, phenotype-blind quality rule rejects most of the weakly supported calls, leaving 2 called cases and 2 called controls. Then

$$ \widehat{\mathrm{OR}}_{\text{filtered}} = \frac{2/98}{2/98} = \frac{2\times 98}{98\times 2} = 1.000. $$

The filtered table no longer shows an imbalance in call rates. In an actual analysis, the team would need to justify the rule using technical evidence, not select it because it changes the odds ratio. Filtering can reduce a false signal only when the rejected records are genuinely less reliable; it can also remove valid calls if the threshold is too severe.

Worked Example: Missed True Calls Weaken an Association Estimate

Now suppose a real event is present in 12 of 100 cases and 3 of 100 controls. If all true calls are observed, the carrier-versus-noncarrier odds ratio is

$$ \widehat{\mathrm{OR}}_{\text{true calls}} = \frac{12/88}{3/97} = \frac{12\times 97}{88\times 3} = \frac{1164}{264} = 4.409. $$

Imagine that a stringent breakpoint threshold misses 4 of the 12 case calls and 1 of the 3 control calls. The retained counts are 8 called cases and 2 called controls; the missed calls are treated as noncarriers under this hard-filtering example. The observed odds ratio becomes

$$ \widehat{\mathrm{OR}}_{\text{filtered}} = \frac{8/92}{2/98} = \frac{8\times 98}{92\times 2} = \frac{784}{184} = 4.261. $$

The estimated odds ratio is smaller because some true carriers have been classified as noncarriers. The filter retained two-thirds of the true calls in each group, so the call loss was not deliberately concentrated in cases; nevertheless, the observed carrier counts and estimate changed. This example does not imply that false negatives always attenuate an estimate by a predictable amount. If sensitivity differs by phenotype group or by other factors related to the outcome, bias can be in either direction.

Practical Choices and Common Mistakes

A defensible filtering strategy connects each threshold to the event type, evidence-generation process, and intended analysis. Before applying a rule, specify how its metrics are computed, which records it can exclude, and whether a failed variant is discarded entirely or retained for review. Use independent validation where possible, and report how many records pass each criterion. Where the data allow it, examine whether the filter's decisions are associated with phenotype or study design features; an unexpected imbalance can indicate that technical error is entangled with the comparison of interest.

A common mistake is to assume that a stricter threshold must make the association more trustworthy. The wrong reasoning is: “The strict rule retains fewer calls, so the remaining association must be real.” Fewer calls may mean fewer artifacts, but it may also mean that real events with weak evidence were preferentially removed. The correction is to assess both false-positive and false-negative behavior using validation evidence, then examine how plausible filtering choices affect the association estimate. The filter should be selected on technical grounds and applied consistently, not tuned to deliver a preferred result.

  • Do not treat scores as interchangeable. A numeric score from one caller cannot be assigned another caller's threshold without checking its definition and calibration.
  • Do not rely on one metric when evidence conflicts. Strong confidence paired with incompatible depth or weak breakpoint support calls for scrutiny, not automatic acceptance.
  • Do not assume one cutoff fits every event class. Deletions, duplications, and other structural events can produce different expected evidence patterns.
  • Do not interpret a passing call as proof. Passing means only that the record meets the stated rule under the available data.
  • Do not choose thresholds using the desired association result. That practice makes the reported signal depend on outcome-driven analysis choices.
Key takeaway: A useful variant-level filter is transparent, appropriate to the event and evidence, and evaluated for both retained artifacts and lost true calls. Its association consequences should be checked because either type of classification error can change the result.

Check Your Understanding

Answer each question using the definitions and calculations above.

  1. Why is a caller's confidence score not necessarily the probability that a structural-variant call is real?
  2. A deletion rule requires confidence at least 0.98, 6 breakpoint-supporting reads, and a depth ratio at most 0.65. Does a record with confidence 0.995, 5 supporting reads, and depth ratio 0.50 pass? Explain.
  3. In a validation set, a filter retains 45 of 60 true events and 8 of 40 artifacts. Calculate its sensitivity and PPV.
  4. How can a false-positive variant call create an apparent association even when the biological event is absent in everyone?
  5. Why can a strict filter reduce an association estimate's reliability even if it removes some artifacts?
Clinical Biostats