Why Full Replication Identifies Reference Variability
Reference-scaled bioequivalence uses variability in repeated reference administrations, not the spread of all observed responses. A full replicate design gives each subject repeated administrations of both the test and reference formulations. The repeated reference measurements make it possible to isolate how much a subject’s reference response changes from one occasion to another.
The response is usually analyzed on the log scale. Let \(Y\) denote a subject’s log-transformed pharmacokinetic endpoint, such as log AUC or log Cmax. The variance of interest, \(\sigma_{WR}^{2}\), is the within-subject reference variance: the variance of occasion-to-occasion reference deviations under the specified model. It is expressed in squared log units. Its square root, \(\sigma_{WR}\), is the within-subject reference standard deviation on the log scale.
The factor of two matters: a difference contains occasion error from both reference administrations. The sign of the contrast is arbitrary for variance estimation, provided the convention is used consistently. The earlier material on reference-replicate contrasts establishes why a repeated-reference contrast carries information about within-subject reference variability; here the focus is how to estimate that variability in a full replicate design.
Model Terms and the Reference Contrast
A useful model for a complete full replicate crossover separates systematic effects, subject-level effects, and occasion-level error. Write the log response for subject \(i\), in sequence \(s\), period \(p\), and formulation \(f\) as
Here \(\mu\) is an overall mean; \(\tau_f\) is the formulation effect; \(\pi_p\) is the fixed period effect; and \(q_s\) is the fixed sequence effect. The term \(b_{i(s)}\) is a subject effect for subject \(i\) nested within sequence \(s\), while \(u_{if}\) represents a subject-by-formulation deviation. The occasion error is \(\varepsilon_{isp}\). For the direct contrast estimator, assume reference occasion errors are independent across the subject’s two reference periods, normally distributed, and have common variance \(\sigma_{WR}^{2}\). Fixed period and sequence effects must be accounted for; the model also assumes that the variance is common across sequences and subjects.
For the two reference observations from one subject, subtract the second from the first. The subject effect \(b_{i(s)}\) cancels because the same subject contributes both measurements. The subject-by-formulation term \(u_{iR}\) also cancels because both measurements use the reference formulation. The formulation effect cancels for the same reason. The fixed period contribution need not cancel, since the two reference administrations occur in different periods.
The period contrast can differ between sequences because their reference administrations occur in different periods. Denote its sequence-specific value by \(\delta_s\). Then \(C_{is}=\delta_s+e_{is}\), where \(e_{is}\) is the difference between the two reference occasion errors. Under the independence and equal-variance assumptions, \(E(e_{is})=0\) and \(\operatorname{Var}(e_{is})=2\sigma_{WR}^{2}\).
Deriving the Pooled Contrast Estimator
In a complete design, let \(n_s\) be the number of subjects in sequence \(s\), and let \(\bar{C}_s\) be the mean reference contrast in that sequence. Centering contrasts within sequence removes the sequence-specific mean contrast, including the systematic period difference. Define the pooled within-sequence sum of squares \(Q\) and its degrees of freedom \(\nu\) as follows.
For each sequence, the centered contrasts fluctuate around their common sequence mean. Under the model, each such contrast has variance \(2\sigma_{WR}^{2}\). The expected sum of squared deviations within sequence \(s\) is therefore \((n_s-1)2\sigma_{WR}^{2}\). Summing across sequences gives \(E(Q)=2\nu\sigma_{WR}^{2}\). Dividing by \(2\nu\) consequently produces an unbiased method-of-moments estimate:
This estimator uses the within-sequence variation, not the variation between sequence means. Under normal errors, \(Q/(2\sigma_{WR}^{2})\) has a chi-square distribution with \(\nu\) degrees of freedom when the sequence means are estimated from the data. That result describes the uncertainty in the estimate; it does not make the estimate itself a measure of uncertainty in the treatment effect. Estimation of degrees of freedom and variance components in more general models requires additional methods.
Worked Example: Pooling Contrasts Across Two Sequences
Suppose eight hypothetical subjects complete a full replicate design, with four subjects per sequence. Their reference contrasts have already been formed so that the sequence-specific mean has been removed. The adjusted contrasts are \(0.10,-0.10,0.20,-0.20\) in sequence A and \(0.30,0.10,-0.10,-0.30\) in sequence B. All values are differences on the log scale.
Both sets have mean zero. The sum of squared adjusted contrasts is \(0.10\) for sequence A and \(0.20\) for sequence B: \(0.10^2+(-0.10)^2+0.20^2+(-0.20)^2=0.10\), and \(0.30^2+0.10^2+(-0.10)^2+(-0.30)^2=0.20\). Thus \(Q=0.30\), and \(\nu=(4-1)+(4-1)=6\).
The estimate is
The corresponding estimated standard deviation is \(\sqrt{0.0250}=0.1581\) log units. This describes estimated reference occasion variability within subjects under the stated model. It is not the standard deviation of all eight subjects’ responses combined.
Worked Contrasts and Period Adjustment
The sequence means in the estimator are not optional if systematic contrast means differ by sequence. For example, in a four-period design, one sequence might receive R in periods 1 and 3, while another receives R in periods 2 and 4. A period effect can therefore shift the average R contrast differently across sequences. Centering within sequence removes a constant sequence-specific shift, but it does not correct for a period pattern that varies across subjects or is otherwise misspecified.
Worked Example: Centering Sequence-Specific Contrasts
Consider eight hypothetical subjects, again with four per sequence. Their uncentered reference contrasts are \(0.40,0.20,0.50,0.30\) in sequence A and \(-0.10,0.10,-0.20,0.00\) in sequence B. The values are log-scale differences. The different sequence means may reflect different period contrasts.
For sequence A, \(\bar{C}_A=(0.40+0.20+0.50+0.30)/4=0.35\). The centered contrasts are \(0.05,-0.15,0.15,-0.05\), whose squared deviations sum to \(0.0500\). For sequence B, \(\bar{C}_B=(-0.10+0.10-0.20+0.00)/4=-0.05\). Its centered contrasts are \(-0.05,0.15,-0.15,0.05\), also giving a squared-deviation sum of \(0.0500\).
Therefore \(Q=0.100\), and \(\nu=6\). The estimate is
If the uncentered contrasts were instead squared around zero, their squared sum would be much larger, largely because the sequence means are nonzero. Treating those systematic shifts as random within-subject variability would inflate the estimate. In a fitted model, period effects are represented explicitly; sequence-centered contrasts are a direct way to show the same essential separation when the sequence-specific mean is appropriate.
What the Estimate Does and Does Not Measure
Worked Example: Subject Differences Are Not Reference Occasion Variability
Suppose three hypothetical subjects have the following pairs of log reference responses: subject 1 has \(4.9\) and \(5.1\), subject 2 has \(6.9\) and \(7.1\), and subject 3 has \(4.4\) and \(4.6\). Assume there is no period effect in this illustration. The subject means are \(5.0\), \(7.0\), and \(4.5\), respectively, while the reference contrasts, formed as first minus second, are \(-0.2,-0.2,-0.2\).
The contrasts have no within-sequence variation: \(Q=0\), so the method-of-moments estimate is \(0/[2(3-1)]=0\) log units squared. The estimate is zero for this tiny hypothetical data set because all three subjects have the same observed difference; it does not imply that the true population variance is known to be zero. The large spread among subject means reflects differences between subjects, which are removed by the within-subject contrast. Pooling all six observations as though they were independent would mix between-subject spread with the target within-subject reference variability.
This distinction is the practical reason to use repeated reference administrations. A subject may have consistently higher responses than another subject, yet show little occasion-to-occasion fluctuation. Conversely, subjects with similar average responses may have appreciable within-subject variation. The contrast targets the latter, not the former.
Assumptions, Diagnostics, and Alternatives
The direct contrast estimator is clearest for a complete, balanced full replicate design with two reference administrations per subject. Its interpretation depends on several conditions:
- Both reference observations are available for each included subject, and their period assignments are known.
- Systematic sequence and period effects are handled in the contrast means or in an equivalent model.
- Reference occasion errors are independent across the two administrations, have mean zero after adjustment, and share a common variance across subjects and sequences.
- The log-scale error distribution is reasonably compatible with the normal model if normal-based inferential results are used.
A contrast plot by sequence is a useful first check. Look for a sequence shift in the contrast means, unusually large contrasts, or a pattern in which contrast magnitude changes with period or subject characteristics. A strong period pattern suggests that a simple sequence-centered contrast is insufficient; the fixed-effects structure should represent the period pattern. Repeated measurements may also be correlated. If the two reference occasion errors have variance \(\sigma_{WR}^{2}\) and correlation \(\rho\), then the contrast variance is \(2\sigma_{WR}^{2}(1-\rho)\), not \(2\sigma_{WR}^{2}\). In that case, dividing by two does not estimate the marginal occasion variance as defined under independence.
For complete balanced data, the contrast calculation is transparent and directly shows which observations identify reference variability. A model-based analysis instead represents the individual period, sequence, subject, subject-by-formulation, and residual terms together; it can be more flexible when the design is unbalanced or when the fixed-effects structure is more involved. The two approaches should target the same reference occasion variance under compatible assumptions, but a model can estimate variance components differently. Later material treats those broader variance-component estimation procedures; they are not needed to understand the contrast estimator here.
The estimate also has limitations. With few subjects, it can be unstable, and a single unusually large contrast can materially increase the squared-deviation sum. A near-zero estimate in a small sample is not proof that reference variability is absent. Missing reference periods prevent the simple paired calculation for the affected subject, and replacing a missing value with an imputed response would not preserve the estimator’s assumptions. Finally, reference variance is endpoint-specific and scale-specific: it should not be substituted with a variance from another endpoint or with the total variability of all observations.
Check Your Understanding
Use the assumptions and calculations in this tutorial to answer the questions. Solutions follow each question.
- Why is the variance of a difference between two independent reference occasion errors \(2\sigma_{WR}^{2}\), rather than \(\sigma_{WR}^{2}\)?
- Two sequences have \(n_1=5\) and \(n_2=7\) subjects. What is the contrast degrees of freedom \(\nu\), and what denominator is used to estimate \(\sigma_{WR}^{2}\) from \(Q\)?
- What happens to the direct contrast if a subject has a high subject effect \(b_{i(s)}\) that affects both reference observations equally?
- Why can correlated errors between repeated reference administrations make the contrast-based estimate differ from the marginal reference occasion variance?
Solutions. (1) For independent errors \(E_1\) and \(E_2\), \(\operatorname{Var}(E_1-E_2)=\operatorname{Var}(E_1)+\operatorname{Var}(E_2)=\sigma_{WR}^{2}+\sigma_{WR}^{2}=2\sigma_{WR}^{2}\). (2) \(\nu=(5-1)+(7-1)=10\), so the estimate is \(Q/(2\nu)=Q/20\). (3) It cancels because the same subject effect appears in both measurements and is subtracted. (4) With correlation \(\rho\), the contrast variance is \(2\sigma_{WR}^{2}(1-\rho)\); dividing by two then targets \(\sigma_{WR}^{2}(1-\rho)\), not \(\sigma_{WR}^{2}\), unless \(\rho=0\).