Tutorials › Multi-Omics Data Integration › Reporting Cohort Flow and Sample Availability

Independent Validation and Replication · Tutorial 514 of 597

Reporting Cohort Flow and Sample Availability

Build auditable cohort-flow summaries that make clear who entered each stage, which omics data were available, and which participants contributed to each analysis.

Intermediate 10 min read

What You'll Learn

  • Define sequential participant counts and mutually exclusive reasons for removal.
  • Reconcile source, screening, enrollment, and analysis totals with flow equations.
  • Report modality availability using explicit and appropriate denominators.
  • Distinguish marginal availability from joint multi-omics availability.
  • Show how exclusions and missing measurements affect discovery and validation analysis samples.
  • Diagnose common reporting errors that obscure cohort selection.

Why Cohort Flow Is Part of the Analysis

A validation result is interpretable only if readers can determine which participants contributed to it and how that set was formed. A report that gives a final sample size alone may conceal substantial exclusions, unavailable assays, or differences between the discovery and validation analysis sets. In multi-omics studies, a participant can have clinical data and one assay but lack another; therefore, “sample size” may refer to several different counts.

A cohort-flow summary is a transparent accounting of participant counts from identification through the analysis population. It is descriptive, not an inferential model: its arithmetic should reconcile, and each count should have a defined unit and denominator. The earlier material on Assessing Cohort Eligibility and Comparability addresses which participants are appropriate for a validation claim; here the emphasis is on showing the resulting flow and availability clearly.

Definition: A cohort-flow summary reports the number of participants at defined stages of cohort formation and analysis, together with the reasons participants leave a stage. A modality availability count is the number of participants with usable data from a specified data modality, such as transcriptomics or proteomics, under a stated availability rule. An analysis denominator is the number of participants who satisfy all inclusion and data-availability requirements for a particular analysis.

The unit should ordinarily be the participant, not the specimen, assay file, aliquot, or measurement. If one participant contributes multiple specimens, report participant counts for the flow and explain separately how specimens were selected or aggregated. Decide and state what “available” means: for example, a quality-controlled assay result that passed the prespecified processing rules, rather than merely a specimen having been collected.

Structure and Accounting Rules

A useful flow has sequential stages: records or participants identified, duplicates resolved, eligibility assessed, eligible people invited or approached, enrollment or inclusion, and the final analysis sets. At each stage, specify the starting count, the number and reasons for removal, and the resulting count. Reasons should be mutually exclusive within a partition: each participant removed at that stage is assigned once, using a stated priority rule if more than one reason applies.

$$ N_{\text{start}} = \sum_{j=1}^{J} E_j + N_{\text{remaining}}, \qquad N_{\text{remaining}} = N_{\text{start}}-\sum_{j=1}^{J}E_j, $$

Here \(E_j\) is the count assigned to exclusion reason \(j\) at that particular stage. This identity is appropriate only when those reason categories are disjoint and exhaustive for the people removed at that stage. A later-stage count must not be added to an earlier-stage count as though they were separate groups: they represent participants who passed through one stage and then another, not distinct people in a single partition.

For each modality, report both its count and the denominator used to calculate availability. A common descriptive rate is the proportion of the enrolled cohort with usable data for modality \(m\):

$$ \widehat{A}_m = \frac{n_m}{N_{\text{enrolled}}}, $$

where \(n_m\) is the number with usable data for modality \(m\). If availability is instead calculated among an eligible subset, state that denominator and why it is the relevant target. Marginal availability rates do not determine the number with all required modalities. That joint count must be tabulated or computed from participant-level availability patterns.

Before interpreting any count, check the cohort definition, participant identifier, deduplication rule, eligibility date, assay usability rule, and data-freeze date. Counts can differ legitimately when they use different rules or cutoffs, but the rules must be stated. A flow diagram, a table, or both can be used; the format is less important than clear stages, reconciled arithmetic, and analysis-specific denominators.

Worked Cohort Flows

Worked Example: Discovery Cohort and Modality Availability

Suppose a hypothetical discovery project identifies 620 records. After duplicate records are removed, 600 unique records remain. Eligibility review finds 45 ineligible people, and 15 eligible people decline participation. The remaining participants are enrolled. At the data freeze, 12 lack the required baseline clinical record. Usable assay counts among enrolled participants are 470 for RNA, 430 for protein, and 455 for methylation. Among the enrolled participants, 405 have the clinical data, RNA, and protein required for the primary analysis; 390 have clinical data and all three omics modalities.

The initial accounting is:

$$ 620 = 20 + 45 + 15 + 540. $$

The 20 are duplicate records, 45 are ineligible, 15 decline, and 540 are enrolled. Looking only at unique records, the separate stage check is \(600=45+15+540\). These equations have disjoint categories at each accounting stage. The 12 participants lacking baseline clinical data leave \(540-12=528\) with that clinical record.

The marginal RNA availability rate among enrolled participants is \(470/540=0.8704\), or 87.04%. The corresponding protein rate is \(430/540=0.7963\), or 79.63%; the methylation rate is \(455/540=0.8426\), or 84.26%. These rates answer modality-specific questions, not the question of how many people have every modality.

For the primary analysis, the relevant denominator is the observed joint count of 405, because that analysis requires clinical data, RNA, and protein. If an additional analysis requires methylation too, its denominator is 390. The 390 are a subset of the 405, while the three marginal modality counts overlap and must not be added to obtain a participant total. The report should label each count with its data requirements and denominator.

Worked Example: Validation Flow With a Further Analysis Restriction

In a hypothetical validation cohort, 420 records are identified. Twelve duplicates are removed, leaving 408 unique records. Eligibility review excludes 38, and 20 eligible people decline, leaving 350 enrolled. Fourteen enrolled participants lack the specified outcome. RNA is usable for 300 participants and protein for 280; 252 have both assays. Among those 252, six lack the outcome and six more lack a prespecified covariate required by the validation analysis.

The screening and enrollment count reconciles as \(408=38+20+350\). The outcome is available for \(350-14=336\) enrolled participants. Of the 252 with both assays, six lack the outcome, leaving \(252-6=246\) with both assays and the outcome. Removing the six additional participants without the required covariate gives \(246-6=240\) in the validation analysis set.

The RNA marginal availability rate is \(300/350=0.8571\), or 85.71%, and the protein rate is \(280/350=0.8000\), or 80.00%. The paired-assay count is 252, or \(252/350=72.00\%\) of enrolled participants. The final analysis denominator is \(240\), or \(240/350=68.57\%\) of enrolled participants; among the 336 with observed outcome, it is \(240/336=71.43\%\). Both percentages can be useful, but they answer different questions. The report must identify whether the denominator is all enrolled participants or those with outcome data.

Joint Availability and Analysis Denominators

A modality-by-modality table is useful for marginal counts, but it cannot reveal all joint patterns. If three modalities are required together, counts for each modality can be high while the complete-case set is appreciably smaller. A pattern table makes that reduction visible and helps identify which missingness combinations are responsible.

Worked Example: Reading a Modality-Pattern Table

Consider a hypothetical cohort of 200 participants. Their usable-assay patterns are mutually exclusive: 120 have all three modalities (RNA, protein, and methylation); 20 have RNA and protein only; 10 have RNA and methylation only; 15 have protein and methylation only; 12 have RNA only; 8 have protein only; 5 have methylation only; and 10 have none.

First check the partition:

$$ 200=120+20+10+15+12+8+5+10. $$

The RNA marginal count is \(120+20+10+12=162\); protein is \(120+20+15+8=163\); and methylation is \(120+10+15+5=150\). The all-three-modality count is the first pattern category, \(120\), not the sum of these marginal counts. Suppose further that all 120 participants with all three assays have complete required clinical covariates, but six lack the outcome. Then the analysis requiring all three assays, covariates, and outcome has \(120-6=114\) participants.

Thus, 162/200 = 81.00% have RNA, whereas 114/200 = 57.00% contribute to the specified complete-case analysis. Within the all-three-assay group, outcome availability is \(114/120=95.00\%\). The first rate describes marginal RNA availability in the cohort; the second describes the analysis fraction of the cohort; the third describes outcome availability conditional on having all three assays. They are not interchangeable.

Derivation, Diagnostics, and Reporting Choices

The key accounting principle follows from a partition. If every participant in a stage is assigned to exactly one of several disjoint outcomes, the total count equals the sum of those outcome counts. For example, when the outcomes are “excluded for reason 1,” “excluded for reason 2,” or “remaining,” every participant appears once, so summing those categories recovers the stage total. If a person can be counted under two reasons, the categories overlap and direct addition overcounts; resolve this by defining a primary reason or report overlapping reasons separately without presenting them as a partition.

Likewise, joint availability cannot generally be recovered by adding marginal counts. For two modalities \(A\) and \(B\), the participant-level count with both is governed by inclusion-exclusion:

$$ n_{A\cap B}=n_A+n_B-n_{A\cup B}. $$

The union count is needed, so knowing only \(n_A\) and \(n_B\) is insufficient. For three or more modalities, the availability pattern table or direct joint count is usually clearest. State whether the final analysis set requires complete data on all listed variables, permits a specified missing-data method, or uses another prespecified rule; the denominator should reflect the actual procedure.

Several checks catch common failures before publication:

  • Recalculate each sequential stage independently; a stage total should equal its mutually exclusive removals plus the remaining count.
  • Check that unique participant identifiers, rather than specimen counts, underlie participant-flow totals.
  • Verify that each assay count uses the stated quality-control and data-freeze rules.
  • Confirm that joint counts cannot exceed any required marginal count, and that analysis counts do not exceed their eligible or available-data parent sets.
  • Compare discovery and validation denominators only after confirming that the count definitions and reporting rules are aligned; otherwise, label the difference rather than implying a like-for-like comparison.

A flow diagram is effective for sequential screening and exclusions. A modality matrix or pattern table is better for showing overlapping availability, and an analysis-set table is useful when different models require different combinations of data. In practice, a concise flow diagram paired with a table of modality counts and analysis denominators often communicates the full structure. The limitation is that counts alone do not explain why data are unavailable or establish that missingness is harmless. Report reasons and timing where known; do not interpret a lower availability rate as evidence of a biological difference without an appropriate analysis.

A frequent mistake is to add a later-stage count to the exclusion counts at an earlier stage. For example, an enrolled count is already the remainder after eligibility exclusions and refusals; adding it again to a count of people eligible at an intermediate stage mixes sequential stages and double-counts participants. The correction is to show each conservation equation separately and label the stage to which it applies. A second common error is to report assay counts as if they were analysis sample sizes. Instead, name the exact variables and rules required for every analysis denominator.

Check Your Understanding

For each question, identify the correct accounting or denominator and then compare with the solutions below.

  1. A study identifies 250 records, removes 10 duplicates, excludes 30 unique people as ineligible, and enrolls the remainder. How many are enrolled, and what equations check the flow?
  2. In a cohort of 120 enrolled participants, 90 have RNA, 80 have protein, and 70 have both. What is the paired-assay availability rate using all enrolled participants as denominator?
  3. Why can the RNA and protein counts not be added to obtain the number with at least one assay?
  4. Of 70 participants with both assays, 5 lack the outcome and 4 more lack a required covariate. What is the analysis denominator if these are distinct groups?
  5. Give two reasons a report should distinguish participants from specimens.

Solutions. (1) After duplicate removal, \(250-10=240\) unique records remain; \(240-30=210\) are enrolled. The checks are \(250=10+30+210\) and \(240=30+210\). (2) \(70/120=0.5833\), so paired-assay availability is 58.33% of enrolled participants. (3) Some participants have both assays and would be counted twice; the overlap must be subtracted or the union counted directly. (4) \(70-5-4=61\), so the analysis denominator is 61. (5) A participant may contribute multiple specimens, and an assay or specimen count therefore need not equal the number of distinct people; analysis denominators are usually participant-based and must be identifiable as such.

Clinical Biostats