Why Block Size Matters
A multi-omics analysis may combine a transcriptomic block with thousands of measured features, a proteomic block with hundreds, and a targeted metabolomic block with only a few dozen. An integrated result can look precise and coherent while being driven mostly by the largest block. The key question is not simply how many features each assay measured, but what role block size should play in the summary.
This tutorial evaluates block-level results under alternative weighting schemes. It assumes each block has already been summarized using a score defined on a comparable scale, with a common direction in which larger values indicate stronger evidence for the result under evaluation. Choosing and validating those scores is a separate analytical task; weighting cannot make incomparable scores meaningful. In a case study, also check the cohort and platform structure, as emphasized in the earlier material on Diagnosing Cohort and Platform Confounding in a Case Study.
Specify the Weighting Rule Before Comparing Results
Three transparent choices are useful for a sensitivity analysis. Equal-block weighting gives every assay block the same total influence, regardless of its feature count. Feature-count weighting gives each measured feature an equal share of the total weight, so a block's weight is proportional to \(p_b\). An intermediate weighting, such as weights proportional to \(\sqrt{p_b}\), acknowledges differences in block size while reducing the dominance of the largest block.
These rules encode different scientific choices; none is universally correct. Equal-block weighting is appropriate when the blocks represent distinct measurement layers that should each have equal standing. Feature-count weighting can be defensible when the intended summary gives every feature an equal vote and block scores correspond to comparable per-feature contributions. It is not justified merely because one assay measured more features. An intermediate rule is a sensitivity check, not a remedy for poor measurement or an automatic compromise.
Before applying any rule, check that the \(q_b\) values are comparable: they must use the same direction, refer to the same target quantity, and be computed with compatible procedures and evaluation data. A raw count, a correlation, and a predictive score cannot be combined just by placing them in one weighted average. If scores are estimated from data, their uncertainty and dependence should also be considered. In particular, blocks measured on the same subjects are not independent replications simply because they are different assays.
Worked Example: Calculating the Effect of Feature-Count Weights
Consider a hypothetical case with three blocks: transcriptomics has 3,000 features, proteomics has 30, and targeted metabolomics has 10. Suppose their comparable block-level evidence scores are \(0.66\), \(0.80\), and \(0.80\), respectively. These illustrative scores are not measurements from a real study.
Under equal-block weighting, each weight is \(1/3\). Thus \(S_{\mathrm{equal}}=(0.66+0.80+0.80)/3=2.26/3=0.7533\).
Under feature-count weighting, there are \(3{,}000+30+10=3{,}040\) features in total. The weights are \(3{,}000/3{,}040\), \(30/3{,}040\), and \(10/3{,}040\). The resulting score is \(S_{\mathrm{count}}=(3{,}000(0.66)+30(0.80)+10(0.80))/3{,}040=(1{,}980+24+8)/3{,}040=2{,}012/3{,}040=0.6618\).
The summaries differ by about \(0.0915\) score units, although every block score is unchanged. The shift occurs because the feature-count rule assigns about \(98.68\%\) of the total weight to transcriptomics. The score does not show that transcriptomics is more reliable; it shows the consequence of the chosen weights.
A Case Comparison and a Sensitivity Derivation
A useful case-study report compares the candidate results under the same set of pre-specified weighting rules. For example, consider two hypothetical candidate patterns, A and B, assessed with the same three block sizes as above. Their block scores, all on the same scale and with higher values indicating stronger support, are:
| Block | Feature count | Candidate A score | Candidate B score |
|---|---|---|---|
| Transcriptomics | 3,000 | 0.66 | 0.60 |
| Proteomics | 30 | 0.80 | 0.70 |
| Targeted metabolomics | 10 | 0.80 | 0.11 |
Worked Example: Comparing Candidates Under Three Weighting Rules
The equal-block summaries are \(S_A=(0.66+0.80+0.80)/3=2.26/3=0.7533\) and \(S_B=(0.60+0.70+0.11)/3=1.41/3=0.4700\). Their difference is \(0.7533-0.4700=0.2833\) score units, using the displayed rounded summaries.
With feature-count weights, Candidate A has numerator \(3{,}000(0.66)+30(0.80)+10(0.80)=2{,}012\), so \(S_A=2{,}012/3{,}040=0.6618421\ldots\), which rounds to \(0.6618\). Candidate B has numerator \(3{,}000(0.60)+30(0.70)+10(0.11)=1{,}800+21+1.1=1{,}822.1\), so \(S_B=1{,}822.1/3{,}040=0.599375\), which rounds to \(0.5994\). Using the displayed rounded summaries, A is higher by \(0.6618-0.5994=0.0624\) score units. Using the unrounded values, the difference is \((2{,}012-1{,}822.1)/3{,}040=189.9/3{,}040=0.0624671\ldots\), which rounds to \(0.0625\).
For square-root feature weights, the unnormalized weights are \(\sqrt{3{,}000}\), \(\sqrt{30}\), and \(\sqrt{10}\), approximately \(54.7723\), \(5.4772\), and \(3.1623\). Their sum is \(63.4118\). Applying these weights gives \(S_A\approx(54.7723(0.66)+5.4772(0.80)+3.1623(0.80))/63.4118=0.6791\), and \(S_B\approx(54.7723(0.60)+5.4772(0.70)+3.1623(0.11))/63.4118=0.5842\). Candidate A ranks higher under all three rules, but the size of its advantage varies substantially. The ranking is less sensitive than the reported score difference.
This example gives a short justification for a basic diagnostic. Since \(S(w)=\sum_b w_bq_b\), changing one block score by \(\Delta q_b\) changes the integrated score by exactly \(w_b\Delta q_b\). This follows by subtracting the original score from the perturbed one:
Thus the block's influence on the summary is determined jointly by its weight and the scale of its score. Under feature-count weighting, a very large block can have high leverage even if its score is only moderately different from the others. A large feature count is not the same thing as a large number of independent pieces of information: correlated or redundant features can make a count-based weight exaggerate a block's effective contribution.
Worked Example: A Perturbation and a Leave-One-Block-Out Check
Return to Candidate A. Suppose a reasonable alternative preprocessing choice changes only its transcriptomic score from \(0.66\) to \(0.64\), a change of \(-0.02\). With feature-count weights, transcriptomics has weight \(3{,}000/3{,}040=0.9868\). The integrated score therefore changes by \(0.9868(-0.02)=-0.01974\) score units (using the unrounded weight, the change is \(-60/3{,}040=-0.0197368\ldots\)). The new score is \(1{,}952/3{,}040=0.6421\).
Under equal-block weighting, the same transcriptomic change shifts the summary by \((1/3)(-0.02)=-0.006667\), from \(0.7533\) to \((0.64+0.80+0.80)/3=0.7467\). The larger movement under feature-count weighting is expected from the leverage calculation; it is a warning to examine whether the large block's score is itself stable.
A leave-one-block-out check asks how the comparison looks when each block is omitted in turn, with the remaining blocks reweighted equally. Omitting transcriptomics gives Candidate A \((0.80+0.80)/2=0.8000\) and Candidate B \((0.70+0.11)/2=0.4050\), a difference of \(0.3950\). The candidates' ordering remains A above B, but this difference is not directly comparable to the three-block feature-weighted difference: the block set and weighting rule have changed. The check is diagnostic, not a replacement estimate.
How to Diagnose Domination and Choose Alternatives
Domination is not established just because one block has the most features. It is indicated when a large block receives most of the total weight and changes in its score substantially alter the integrated conclusion, while other blocks contribute little. Examine both weight concentration and score sensitivity. Report each block's weight, its score, and how the main summary or ranking changes under defensible alternatives.
Confirm that every block score refers to the same target, has the same direction, and was produced on compatible data with compatible procedures.
Give the rationale before interpreting the integrated score. Do not select weights only because they produce a preferred result.
Show the block weights and use perturbation or leave-one-block-out checks to assess whether one block controls the conclusion.
Distinguish a stable ordering from a stable effect size. If conclusions change with reasonable weights, report that dependence rather than choosing the most convenient summary.
The main alternatives answer different questions. Equal-block weighting treats assay layers as the units of contribution. Feature-count weighting treats features as the units of contribution, but can overemphasize highly redundant measurements. Square-root or capped weights reduce size-driven leverage while still allowing some influence from larger blocks; the choice needs a scientific rationale. Concatenating all features and fitting one model is not equivalent to averaging block scores: the fitted model may implicitly weight blocks according to scaling, regularization, feature dependence, and sample size. Learned block weights can adapt to predictive performance, but their estimation adds flexibility and must be evaluated without using the held-out data for weight selection. These approaches should not be presented as interchangeable.
Several failure modes deserve explicit attention. If one block's score is on a wider numerical scale, it can dominate even with equal weights. If features are strongly correlated, feature-count weights may mistake repeated measurements of similar information for independent support. If block scores were selected or tuned using the same observations on which performance is reported, apparent block strength may be optimistic. And if different blocks have different missingness or measurement quality, the simple weighted average does not correct that problem. Check the underlying data and validation design; report uncertainty where available rather than treating small score differences as decisive.
Check Your Understanding
Answer each question, then compare with the brief solutions below.
- Three blocks have 900, 90, and 10 features. What are their feature-count weights?
- With equal-block weights, a block score changes by \(0.03\) in a four-block analysis. By how much does the integrated score change?
- Why does a large feature count not, by itself, justify giving a block most of the total weight?
- Candidate A ranks above Candidate B under equal weights but below it under feature-count weights. What should the report say?
- Why is a leave-one-block-out result a diagnostic rather than an interchangeable estimate of the full integrated score?
Solutions. (1) The total is \(900+90+10=1{,}000\), so the weights are \(0.90\), \(0.09\), and \(0.01\). (2) The block weight is \(1/4\); the score changes by \((1/4)(0.03)=0.0075\). (3) Feature count does not measure independent information or assay reliability; correlated features can make count-based weighting overstate a block's contribution. (4) Report that the ranking is sensitive to the weighting rule, show the block-level scores and weights, and avoid claiming a weight-invariant conclusion. (5) Omitting a block changes both the set of evidence and the normalized weights, so the result answers a different, diagnostic question from the full summary.