Why Look Beyond the Mean Profile?
A batch average can describe the typical amount dissolved at each sampling time, but it does not show whether individual units behave similarly. Two batches can have nearly identical means while one contains tightly clustered units and the other contains a mixture of fast- and slow-dissolving units. Conversely, batches can differ in their average profiles even when units within each batch are consistent. These are distinct sources of variation, and keeping them separate helps identify formulation or manufacturing patterns without hiding unusual units.
The observational unit is one dosage unit tested in one dissolution vessel. At a given time, its result is the percentage of drug dissolved. A profile is the collection of results from that same unit across the scheduled sampling times. The unit-level data should be retained alongside summaries: averaging is useful, but it is a compression of the data, not a substitute for inspecting them.
Summarizing Units at a Sampling Time
For a batch with \(n\) units, let \(x_i\) denote the percentage dissolved for unit \(i\) at one specified time. The sample mean is \(\bar{x}=\sum_{i=1}^{n}x_i/n\). The sample standard deviation \(s\) is the square root of the sum of squared deviations from the mean divided by \(n-1\). It describes the spread of individual unit results around their batch mean, in percentage points. It is not the standard error of the mean, which describes the estimated precision of that mean under a sampling model.
Calculate these summaries separately for each batch and each sampling time before considering an across-batch summary. A mean profile is useful for comparing typical time courses, but it cannot establish that units within the batches are similarly consistent. A standard deviation at a time point likewise does not explain whether the spread arose from an unusual unit, a broad symmetric distribution, or more than one subgroup. Inspection of the individual results and profiles supplies that context.
Worked Example: A Batch Mean and Its Unit-Level Spread
Suppose four hypothetical units from one batch have 30-minute dissolution results of 59%, 61%, 62%, and 63%. Calculate the mean and sample standard deviation.
The mean is \(\bar{x}=(59+61+62+63)/4=245/4=61.25\%\). The deviations from the mean are \(-2.25\), \(-0.25\), \(0.75\), and \(1.75\) percentage points. Their squared deviations sum to \(5.0625+0.0625+0.5625+3.0625=8.75\) squared percentage points.
Thus, \(s=\sqrt{8.75/(4-1)}=\sqrt{2.9167}\approx1.708\) percentage points. The batch mean is 61.25% at 30 minutes, and the observed unit results have a sample standard deviation of about 1.708 percentage points. This small sample describes these four units; it does not by itself establish the variability of all units that could be produced.
A Nested Model for Separating Sources of Variation
At a single sampling time, a simple balanced design has \(B\) batches and \(n\) units sampled from each batch. A useful random-effects model is
Here \(Y_{bi}\) is the dissolution result for unit \(i\) in batch \(b\), \(\mu\) is the overall mean, \(U_b\) is the deviation of batch \(b\) from that mean, and \(E_{bi}\) is the deviation of the unit from its batch mean. The model assumes independent batch effects with mean zero and variance \(\sigma_B^2\), independent unit-level deviations with mean zero and variance \(\sigma_W^2\), and independence between these two sources. In this setting, \(\sigma_B^2\) is the between-batch variance and \(\sigma_W^2\) is the within-batch variance. The model also assumes that the batches are reasonably viewed as sampled from a population of batches and that the variance components are constant across the batches being modeled.
The measured within-batch component ordinarily includes unit-to-unit differences and any measurement error not modeled separately. If replicate assay measurements are available and the scientific question requires assay error to be distinguished from unit variability, an additional measurement level is needed. Results are percentages and are bounded, so a normal random-effects model is an approximation; it is most credible when the observed values are not pressed against the bounds and residual patterns are reasonably regular.
Estimating Variance Components in a Balanced Design
For a balanced design, let \(\bar{Y}_b\) be the mean of the \(n\) units in batch \(b\), and let \(\bar{Y}\) be the mean across all \(Bn\) observations. The within-batch sum of squares is \(\sum_b\sum_i(Y_{bi}-\bar{Y}_b)^2\); its degrees of freedom are \(B(n-1)\). The between-batch sum of squares is \(n\sum_b(\bar{Y}_b-\bar{Y})^2\); its degrees of freedom are \(B-1\). Dividing each sum of squares by its degrees of freedom gives the within-batch mean square \(MS_W\) and between-batch mean square \(MS_B\).
The variance-component estimates follow from the expected mean squares. Within a batch, variation comes from \(E_{bi}\), so \(E(MS_W)=\sigma_W^2\). A batch mean contains the batch effect plus an average of \(n\) unit deviations; multiplying the variance of that mean by \(n\) yields \(E(MS_B)=\sigma_W^2+n\sigma_B^2\). Therefore, the method-of-moments estimates are \(\hat{\sigma}_W^2=MS_W\) and \(\hat{\sigma}_B^2=(MS_B-MS_W)/n\).
This derivation also explains a limitation: sampling variation can make \(MS_B\) smaller than \(MS_W\), producing a negative method-of-moments estimate for a variance that cannot truly be negative. A negative result is not evidence of negative variability. It indicates that the data do not clearly resolve a positive between-batch component by this estimator. Likelihood-based mixed models commonly constrain variance components to be nonnegative; their estimates can then lie on the zero boundary. With few batches, either estimate can be imprecise, and the number of units within a batch cannot compensate fully for having very few independent batches.
Worked Example: Estimating Within- and Between-Batch Variation
Consider hypothetical 30-minute results from three batches, with four units per batch:
Batch A: 54%, 56%, 58%, 60%; Batch B: 59%, 60%, 61%, 62%; Batch C: 59%, 61%, 62%, 63%. Assume the batches are independent and the units are sampled independently within batches. The batch means are 57%, 60.5%, and 61.25%; the grand mean is \( (57+60.5+61.25)/3=59.5833\%\).
The within-batch sums of squared deviations are 20, 5, and 8.75 squared percentage points. For example, Batch C has mean 61.25%, and its squared deviations sum to 8.75. Thus, \(SS_W=20+5+8.75=33.75\), with \(df_W=3(4-1)=9\), so \(MS_W=33.75/9=3.750\) squared percentage points.
The between-batch sum of squares is \(SS_B=4[(57-59.5833)^2+(60.5-59.5833)^2+(61.25-59.5833)^2]\approx41.1667\) squared percentage points. Its degrees of freedom are \(df_B=3-1=2\), giving \(MS_B=41.1667/2=20.5833\) squared percentage points. Therefore, \(\hat{\sigma}_W^2=3.750\), and \(\hat{\sigma}_B^2=(20.5833-3.750)/4=4.2083\), both in squared percentage points. The corresponding estimated standard deviations are \(\sqrt{3.750}\approx1.936\) percentage points within batches and \(\sqrt{4.2083}\approx2.051\) percentage points between batches.
These estimates suggest appreciable variation at both levels in this hypothetical data set. They are descriptive estimates, not proof that future batches will have precisely these variance levels. In particular, only three batches contribute information about the between-batch component.
Profiles Reveal Patterns That Summaries Can Hide
At every time point, report the batch mean and an appropriate measure of spread, but also inspect individual unit results. A persistent fast- or slow-dissolving unit may appear as a distinct trajectory across several times. A single unusual measurement at one time may instead reflect an assay or recording issue, a sampling problem, or ordinary variation. An apparent outlier should be checked against laboratory records and the complete profile; it should not be removed merely because it is inconvenient or changes the mean.
Measurements on the same unit over time are repeated observations, not independent units. Their values are typically related because they belong to one dissolution trajectory. Consequently, treating every unit-time pair as an independent observation would exaggerate the amount of independent information. For a descriptive analysis, calculate summaries at each time and display the unit profiles. For formal modeling across time, the model must account for the dependence of observations within a unit, for example through a specified covariance structure or unit-level random effects. A separate single-time variance decomposition does not describe that full temporal dependence.
Worked Example: An Unusual Unit in an Otherwise Tight Batch
Four hypothetical units have the following 30-minute results: 60%, 62%, 61%, and 80%. The mean is \((60+62+61+80)/4=65.75\%\). The squared deviations from the mean sum to \(33.0625+14.0625+22.5625+203.0625=272.75\), so the sample standard deviation is \(\sqrt{272.75/3}=\sqrt{90.9167}\approx9.535\) percentage points. The median is \((61+62)/2=61.5\%\).
The mean and standard deviation alone indicate a high center and wide spread, while the median and the listed unit values reveal why: three results cluster between 60% and 62%, and one is much higher. If the fourth unit's profile were also unusually fast at earlier sampling times, that would support describing it as a distinct fast-dissolving trajectory. It would not, by itself, establish the cause or justify excluding the unit. The correct next step is to verify the result and its documentation, then report the observed pattern transparently.
Diagnostics, Alternatives, and Limitations
A useful unit-level display plots dissolution percentage against time, with one line per unit and separate panels or clear labels for batches. At a single time point, dot plots show clustering and unusual values more directly than a mean alone. Check whether units are missing, whether sampling and assay procedures were applied consistently, and whether data entry or vessel identification could explain an unusual result. Across batches, compare both the batch means and their within-batch spreads. A trend in spread with time or mean level cautions against assuming a constant variance.
The nested random-effects model is appropriate when the batches represent a broader process of interest and independence assumptions are plausible. If the analysis concerns only a fixed set of specifically chosen batches, treating batch as a fixed effect may better match the question: it estimates differences among those batches but does not estimate a population distribution of batch effects in the same way. When batch sizes are unequal or some unit results are missing, the balanced-design mean-square formulas do not directly apply; a mixed-effects model can accommodate the observed structure under its stated assumptions.
Pooled standard deviations or a single overall standard deviation are simpler alternatives, but they combine sources of variation and can obscure a batch effect. Medians and ranges can help describe skew or unusual units, but they do not themselves separate within- and between-batch variance components. A mean profile is also a useful compact comparison, but two different collections of unit trajectories can produce similar means. These summaries answer different questions; no single one replaces inspection of the unit-level data.
The analysis has limits. Variance estimates based on a small number of batches are uncertain, and a normal model may be poor for strongly skewed or boundary-concentrated percentages. A single time point cannot characterize the shape or dependence of complete profiles. Unit-level variability can be scientifically important even when the average profile is stable, but these descriptive and variance-component analyses alone do not determine product performance in vivo or establish a clinical conclusion.
Common Mistakes
- Using only a grand mean. A pooled mean can conceal a batch with consistently higher results or an individual unit with a distinct trajectory. Show batch means and unit-level data as well.
- Calling the standard deviation the standard error. The sample SD describes spread among observed units; the standard error concerns uncertainty in an estimated mean and depends on the sampling design.
- Treating time points as independent units. Repeated observations from the same vessel or dosage unit are related. Account for that dependence in formal longitudinal modeling.
- Deleting an outlier without a documented reason. Investigate the record and measurement process, and distinguish an assignable error from a valid unusual unit. Report decisions and sensitivity analyses transparently.
- Interpreting a negative method-of-moments variance estimate literally. Variance cannot be negative. The estimate reflects sampling variability and limited evidence for a positive component.
Check Your Understanding
Answer each question, then compare your reasoning with the solutions below.
- A batch has four results of 48%, 50%, 52%, and 54% at one time point. What are the mean and sample standard deviation?
- In the nested model, what happens to the variance of a batch mean as the number of units per batch increases? Which component does not vanish?
- Why is a negative estimate from \((MS_B-MS_W)/n\) not evidence of negative between-batch variance?
- Several units have similar mean profiles, but one unit is high at every sampling time. What should the analyst do before considering any exclusion?
Solutions. (1) The mean is \((48+50+52+54)/4=51\%\). The squared deviations sum to \(9+1+1+9=20\), so \(s=\sqrt{20/3}\approx2.582\) percentage points. (2) The variance of a batch mean is \(\sigma_B^2+\sigma_W^2/n\); increasing \(n\) reduces the within-batch contribution, while the between-batch component \(\sigma_B^2\) remains. (3) Sampling can produce \(MS_B<MS_W\), making the method-of-moments estimate negative even though a true variance cannot be negative; the estimate signals weak or imprecise evidence for a positive component. (4) Verify the data, vessel and assay records, and the complete profile; investigate plausible assignable causes and report the unit transparently. An unusual but valid observation should not be deleted solely because it affects a summary.