From Multilayer Profiles to Candidate Endotypes
Autoimmune disease labels can encompass patients with different molecular patterns and clinical courses. Transcriptomic measurements may reflect immune-cell activation, proteins may capture circulating inflammatory signals, and clinical measurements may summarize disease activity or organ involvement. Integrative clustering asks whether patients can be grouped using these measurements together, without using a preassigned diagnosis as the grouping target.
A cluster is a group formed by a specified algorithm and a specified representation of the data. An endotype is a proposed disease subgroup characterized by a biological pattern that may help explain disease heterogeneity. A cluster can suggest a candidate endotype, but the algorithm does not establish a biological mechanism, a clinical diagnosis, or a treatment recommendation. Those claims require additional evidence.
The clustering unit must be clear: here it is the patient. Measurements from different blocks should refer to the same patient and a scientifically comparable time point. If repeated measurements during treatment are used, a patient’s measurements cannot be treated as independent patients; the design must first define which time point or patient-level summary enters this clustering analysis. This tutorial concerns patient-level grouping, not modeling within-patient change.
A Block-Weighted Distance
For a transparent construction, suppose each block contains continuous features that have been transformed as appropriate and standardized feature by feature. Write \(z_{ij}^{(m)}\) for patient \(i\)'s standardized value on feature \(j\) in block \(m\), and let \(p_m\) be the number of features in that block. For patients \(i\) and \(i'\), define the average squared distance within block \(m\) as the mean squared difference across its features. Combine block distances using nonnegative weights \(w_m\) that sum to 1:
This definition gives each block an explicit role. With equal weights, a block contributes its average squared feature difference, rather than a sum that automatically grows with the number of features. Equal weights do not guarantee equal biological influence: correlated features, differing measurement reliability, and the features chosen within each block still matter. The weights should therefore be selected for a stated scientific reason and reported.
For complete continuous data, one possible clustering rule is weighted \(K\)-means: choose \(K\) groups and minimize the total weighted squared distance from each patient to the centroid of the assigned group. A centroid is the vector of feature means within a group. The optimization objective is:
where \(C_k\) is the set of patients assigned to cluster \(k\), \(z_i^{(m)}\) is patient \(i\)'s vector for block \(m\), and \(\bar{z}_{C_k}^{(m)}\) is the block-specific centroid. This objective is appropriate only if the features and distances represent meaningful patient similarity. \(K\)-means also favors roughly compact groups in this distance representation; it is not a general model for every possible cluster shape.
Worked Examples
Worked Example: Comparing Two Patient Profiles
Suppose a hypothetical analysis uses one standardized summary feature in each of three blocks: a transcriptomic activation score, a proteomic inflammation score, and a clinical activity score. All three blocks receive equal weight, \(w_m=1/3\). Patient A has values \((0,0,0)\), and patient B has values \((1.2,0.6,0.3)\). Calculate their combined distance.
Each block has \(p_m=1\), so the block-specific squared differences are \(1.2^2=1.44\), \(0.6^2=0.36\), and \(0.3^2=0.09\). Thus,
Calculation. \(d^2(A,B)=(1/3)(1.44+0.36+0.09)=1.89/3=0.6300\). The distance is \(d(A,B)=\sqrt{0.6300}=0.7937\) standardized distance units.
The calculation treats the three specified block summaries equally. It does not mean the patients differ by a clinical amount of 0.7937, nor does it establish that they belong in different biological subgroups. That depends on their distances to other patients and the chosen clustering procedure.
Worked Example: Assigning a Patient to One of Two Centroids
Suppose a fitted two-cluster solution has standardized centroids \(A=(1.0,0.8,0.2)\) and \(B=(-1.0,-0.8,-0.2)\), in transcriptomic, proteomic, and clinical block order. A new hypothetical patient has profile \(x=(1.2,0.6,0.0)\). With one feature per block and equal weights, assign the patient to the closer centroid.
Distance to A. The blockwise squared differences are \((1.2-1.0)^2=0.04\), \((0.6-0.8)^2=0.04\), and \((0.0-0.2)^2=0.04\). Therefore \(d^2(x,A)=(0.04+0.04+0.04)/3=0.0400\), so \(d(x,A)=0.2000\).
Distance to B. The squared differences are \((1.2+1.0)^2=4.84\), \((0.6+0.8)^2=1.96\), and \((0.0+0.2)^2=0.04\). Therefore \(d^2(x,B)=(4.84+1.96+0.04)/3=6.84/3=2.280\), so \(d(x,B)=1.510\).
Since \(0.2000<1.510\), the nearest-centroid rule assigns this patient to cluster A. This is an algorithmic assignment, not a diagnosis. In an actual analysis, assigning a patient outside the data used to fit the centroids also requires applying the same transformations, feature definitions, and scaling parameters.
Worked Example: Summarizing a Candidate Endotype
In a hypothetical cohort, a clustering analysis assigns 20 patients to cluster A and 30 to cluster B. The following values are block scores standardized using the full analysis cohort. For illustration, the reported clinical activity score was included in clustering; renal involvement is summarized afterward as a separate clinical feature.
| Profile summary | Cluster A (n = 20) | Cluster B (n = 30) |
|---|---|---|
| Mean transcriptomic activation score | 1.2 SD | -0.4 SD |
| Mean proteomic inflammation score | 0.8 SD | -0.2 SD |
| Mean clinical activity score | 6.0 points | 3.0 points |
| Patients with renal involvement | 9 of 20 | 6 of 30 |
Calculations. The renal-involvement proportions are \(9/20=0.450\), or 45.0%, in cluster A and \(6/30=0.200\), or 20.0%, in cluster B. Cluster A’s mean transcriptomic score is \(1.2-(-0.4)=1.6\) standard-deviation units higher than cluster B’s, and its mean proteomic score is \(0.8-(-0.2)=1.0\) standard-deviation unit higher.
A measured description would be: “Cluster A had higher mean transcriptomic activation, higher mean proteomic inflammation, and a higher observed proportion of renal involvement than cluster B in this cohort.” Because clinical activity contributed to clustering, its difference is partly descriptive of the variables used to create the groups; it is not an independent validation of the grouping. The pattern may motivate a hypothesis about a more inflammatory candidate endotype, but it does not establish a distinct disease mechanism or diagnosis.
Why Scaling and Block Size Matter
Standardizing features and balancing blocks address different issues. Feature standardization prevents a variable measured on a numerically large scale from dominating simply because of its units. Block normalization prevents a block with many measured features from contributing a large sum solely because it contains more terms. Neither step repairs poor measurement, inappropriate transformations, or redundant features.
Worked Example: Feature Counts Change the Distance
Consider two patients with standardized differences of 0.2 on each of 100 transcriptomic features and a difference of 1.0 on each of four proteomic features. Use equal weights for the two blocks. First calculate the unnormalized sum of squared differences across all features; then calculate the block-balanced squared distance defined above.
Unnormalized sum. The transcriptomic contribution is \(100(0.2^2)=100(0.04)=4.00\). The proteomic contribution is \(4(1.0^2)=4.00\). The total is \(4.00+4.00=8.00\).
Block-balanced distance. The average squared transcriptomic difference is \(4.00/100=0.0400\); the average squared proteomic difference is \(4.00/4=1.000\). With weights \(1/2\), the combined squared distance is \((0.0400+1.000)/2=0.5200\), giving distance \(\sqrt{0.5200}=0.7211\).
The two calculations answer different questions. The raw sum allows the 100-feature transcriptomic block to contribute according to its total squared difference. The block-balanced distance gives each block equal weight after averaging its feature differences. Neither is universally correct; the intended meaning of similarity determines the choice.
Interpreting Profiles and Checking the Analysis
To interpret groups, report their sizes and summarize the features that distinguish them, using the original measurement scales where possible. A useful profile distinguishes what was used to create the clusters from what was examined afterward. When the same features are used both to form and describe clusters, separation on those features is expected by construction and should not be presented as independent evidence.
A practical analysis should check whether the data representation supports the intended biological interpretation. For example, examine feature distributions and outliers before distance calculations; confirm that transformations suit skewed measurements; and inspect whether assay platform, collection site, or missingness patterns align with the resulting groups. If a cluster is largely defined by a technical batch or by missing-data patterns, its apparent biological profile may be misleading. Relevant earlier material includes the standard topics of cohort and platform confounding and subjects with incomplete omics profiles.
These checks are diagnostic, not proof that a cluster is real. The forthcoming material on subgroup instability and replication addresses questions of robustness and external confirmation; a profile table alone cannot answer them.
Integrative clustering is one option among several. Single-block clustering is easier to interpret but can miss cross-layer patterns. Early integration combines features before clustering and can be sensitive to feature counts and scaling. The block-weighted distance used here makes each block’s contribution explicit. Latent-factor approaches instead represent shared variation through a smaller set of learned components, which can simplify high-dimensional profiles but may make the resulting clusters harder to explain in the original measurements. Clinical-label-based grouping answers a different question: it groups patients by an existing clinical category rather than discovering groups from the measured profiles.
No method can make an arbitrary partition into a biological endotype. Interpretations are limited by sample size, feature selection, assay quality, treatment and disease timing, and whether the study population represents the intended clinical setting. A clinically useful classification also needs evidence that it improves understanding or decisions beyond the measurements and labels already available.
A Practical Reporting Sequence
State which patients and time points are represented, which transcriptomic, proteomic, and clinical variables enter, and which variables are reserved for subsequent description.
Report transformations, standardization, handling of missingness, block weights, and the distance or objective used. Explain the intended role of each block.
Give the number and sizes of clusters, then summarize their distinguishing molecular and clinical features with units and clear reference scales.
Call the groups candidate endotypes or data-derived subgroups unless stronger evidence supports a clinical or mechanistic claim. State the main limitations and what evidence would be needed next.
Check Your Understanding
Answer each question, then compare your reasoning with the solutions below.
- Why can standardizing every feature still leave a 100-feature block with more influence than a four-feature block under a raw sum of squared differences?
- With two equally weighted blocks, their average squared differences are 0.25 and 1.21. Calculate the combined squared distance and distance.
- A cluster has 8 patients with renal involvement among 16 assigned patients. What is the observed proportion, and what should it not be called automatically?
- Why is a higher mean clinical activity score not independent validation if that score was used to construct the clusters?
Solutions. (1) Standardization makes feature scales comparable, but a raw sum still adds every feature’s squared difference. The larger block contributes more terms and can therefore have a larger total. Block averaging or a justified weighting rule addresses that separate issue. (2) The combined squared distance is \((0.25+1.21)/2=0.7300\); the distance is \(\sqrt{0.7300}=0.8544\) standardized distance units. (3) The observed proportion is \(8/16=0.500\), or 50.0%. It is not automatically a validated diagnostic criterion or evidence that the cluster is a distinct disease mechanism. (4) The clinical activity score helped define the partition, so differences in that score are partly expected from the construction. Independent validation requires evidence not simply reused from the clustering inputs.