Why repeated concentrations need a joint check
A concentration profile contains several observations from the same subject. Those observations are generally related: a subject with concentrations above the population prediction at one time may also tend to be above it at another. A check that ranks each time point separately can show whether the model predicts each marginal distribution, but it does not by itself account for the joint predictive covariance of the profile. NPDE addresses this by first decorrelating the observed concentration vector using the covariance predicted by simulations, then converting each decorrelated component to a normal score.
The computation is subject-specific: the simulated vectors must follow the same dosing and observation schedule as the subject’s data. The estimated covariance describes variation across simulated profiles under that design. Whitening uses this covariance to remove linear covariance on the transformed scale; it is not a guarantee that all forms of dependence have been removed.
Whitening and the normal-score transformation
The centering and whitening steps have a precise covariance interpretation. If the predictive concentration vector has mean \(\mu_i\) and covariance \(\Sigma_i=L_iL_i^T\), then \(w_i=L_i^{-1}(y_i-\mu_i)\) has mean zero and covariance \(I\), provided those mean and covariance values are the true ones. This follows directly from the covariance rule for a linear transformation:
This result says that the transformed components have unit variances and zero pairwise covariances. It does not alone say that the components are normally distributed or independent. If the centered vector is jointly multivariate normal, the whitened vector is jointly \(N(0,I)\), so its components are independent standard normal variables. Without joint normality, zero covariance does not establish independence, and whitening can leave non-normal marginal distributions. The empirical rank and normal-score steps provide marginal checks, but their standard normal reference remains an approximation whose adequacy depends on the predictive distribution and on simulation and covariance-estimation accuracy.
In practice, \(\bar y_i\) and \(S_i\) are estimated from the simulated vectors, not known population quantities. For each component, the observed whitened value is compared with the corresponding transformed simulated values. The rank maps its relative position to a probability between zero and one; the inverse normal CDF maps that probability to a normal-score scale. Under a calibrated predictive distribution and sufficiently informative simulations, the scores should be compatible with a standard normal marginal reference. The plotting position above avoids infinite scores at the smallest and largest possible ranks. It does not eliminate the coarseness of a small number of simulations.
Worked Example: Ranking One Whitened Concentration
Suppose a hypothetical subject has one concentration measurement. After centering and whitening, the observed value is 0.9, and nine simulated whitened values in sorted order are \(-1.4,-1.0,-0.7,-0.3,0.1,0.4,0.8,1.2,1.6\). There are no ties.
Seven simulated values are below 0.9, so the observed value has rank \(R=8\) among the ten values including itself. The plotting position is
Thus the NPDE is \(\Phi^{-1}(0.75)=0.6745\), approximately. This is a positive, moderate normal score: the observation is above the center of its simulated predictive distribution, but this one score alone does not diagnose model failure.
Worked repeated-profile calculation
The following hypothetical example uses two concentration times for one subject, with concentrations measured in mg/L. Four simulated profiles are deliberately used to make the arithmetic transparent; four is far too few for a stable practical NPDE analysis. The simulated mean is \(\bar y=(10,5)^T\) mg/L, and the sample covariance is
Worked Example: Whitening and Ranking a Two-Time Profile
The observed profile is \(y=(14,8)^T\) mg/L. The four simulated profiles are shown below. They have the stated mean and sample covariance (using denominator \(K-1=3\)).
| Profile | Concentration at time 1 (mg/L) | Concentration at time 2 (mg/L) |
|---|---|---|
| 1 | 8.2679 | 2.6340 |
| 2 | 8.2679 | 5.6340 |
| 3 | 11.7321 | 4.3660 |
| 4 | 11.7321 | 7.3660 |
First center the observed profile: \(y-\bar y=(4,3)^T\) mg/L. Solve \(Lw=y-\bar y\), which is equivalent to applying \(L^{-1}\):
The observed whitened vector is therefore \((2,0.5774)^T\), which is dimensionless. Applying the same centering and triangular solve to each simulated profile gives whitened values \((-\sqrt{3}/2,-\sqrt{3}/2)\), \((-\sqrt{3}/2,\sqrt{3}/2)\), \((\sqrt{3}/2,-\sqrt{3}/2)\), and \((\sqrt{3}/2,\sqrt{3}/2)\). In each coordinate the simulated values are two copies each of \(-0.8660\) and \(0.8660\).
At the first coordinate, the observed value 2 is larger than all four simulated values, so its rank is \(R_1=5\). Its plotting position is \((5-0.5)/5=0.90\), giving \(z_1=\Phi^{-1}(0.90)=1.282\). At the second coordinate, \(0.5774\) lies above the two negative simulated values and below the two positive values, so \(R_2=3\). Its plotting position is \((3-0.5)/5=0.50\), giving \(z_2=0\). The resulting NPDE vector is approximately \((1.282,0)^T\). The first observed concentration is high relative to its whitened predictive rank; the second is at the center of its rank distribution.
This example also shows why whitening is not the same as independently ranking the raw concentrations. The second whitened component subtracts the contribution of the first through the triangular solve. Its interpretation is relative to the joint predictive covariance, not just the marginal distribution at time 2.
Assess calibration and within-subject dependence
NPDE diagnostics are usually examined across subjects and observation positions, with attention to the sampling design. For marginal calibration, inspect a histogram or normal quantile plot and summarize the NPDE mean and spread. Under a well-calibrated predictive model and adequate simulation, the marginal reference is approximately standard normal: mean near zero, variance near one, and no systematic departure in the distribution’s shape. These are diagnostic expectations, not requirements that finite-sample summaries equal zero and one exactly. Patterns by time, dose, or other relevant design features can reveal misfit hidden by an overall summary.
For repeated observations, also examine dependence after whitening and rank transformation. A trend or serial pattern in NPDE against time, or residual correlation between observation positions within subjects, can indicate remaining structure. The covariance transformation targets the simulated linear covariance, but it cannot guarantee independence in non-Gaussian data; the subsequent componentwise rank transformation is nonlinear and does not necessarily remove residual dependence. These diagnostics therefore assess whether the intended decorrelation is adequate rather than proving independence.
Worked Example: A Small Dependence Diagnostic
Consider four hypothetical subjects with two NPDEs each, listed in time order: \((-1,-1),(-1,-1),(1,1),(1,1)\). At both times the sample mean is \(({-1-1+1+1})/4=0\). The sample variance at each time is \((1+1+1+1)/(4-1)=4/3\), so the sample standard deviation is \(\sqrt{4/3}=1.155\). These small-sample marginal summaries are broadly centered but do not exactly equal the standard normal values.
The sample correlation between the two times is
The perfect positive correlation is a clear dependence pattern in these four pairs, even though both time-specific means are zero. With only four subjects, this is illustrative rather than a precise estimate of population dependence. In a real analysis, examine plots and summaries with many subjects and consider whether the observed pattern is stable across relevant times and design groups.
Assumptions, alternatives, and failure modes
A meaningful repeated-profile NPDE calculation requires simulations from the fitted predictive model at the subjects’ actual observation times and dosing histories, with the same outcome scale and observation process as the data. The simulated vectors must represent the intended predictive target; for example, a check using population-level simulations and one using subject-conditional predictions answer different questions. Earlier material on unconditional and conditional predictive checks distinguishes these targets. Each subject’s simulated covariance must be estimable and nonsingular. If the number of simulations is small relative to the number of repeated measurements, or the components are nearly redundant, the covariance estimate can be unstable or singular and whitening unreliable.
Common warning signs include extreme NPDEs concentrated at particular times, a mean or spread inconsistent with the reference across many subjects, visible skewness or heavy tails, dependence remaining across the profile, and results that change markedly with simulation count or covariance treatment. Inspect the simulated means, variances, and correlations as well as the final scores: an implausible covariance estimate can make the whitening step misleading. Ties, censoring, missing records, and very sparse schedules require attention to how the predictive distribution and rank calculation are defined; the simple continuous-outcome calculation shown here is not automatically appropriate for every observation process.
NPDE complements rather than replaces other predictive checks. A VPC compares observed and simulated summaries over time or strata and preserves an interpretable concentration scale. A prediction-corrected VPC can help compare profiles across design differences such as dose. NPDE supplies a subject-level numerical residual scale and explicitly uses the simulated within-profile covariance. Conversely, NPDE compresses a profile into transformed components and depends on estimated covariance and ranks; it may be less visually informative about concentration-scale discrepancies. Agreement among methods is reassuring, while disagreement calls for checking the prediction target, simulation design, data handling, and covariance estimate rather than declaring one summary definitive.
For each subject, retain the observed schedule and generate repeated concentration vectors for that same design.
Compute the simulated mean and covariance; verify that the covariance is positive definite and not dominated by too few simulations.
Use the same estimated centering and Cholesky factor for the observed and simulated profiles, then apply the stated plotting position and inverse normal CDF.
Assess marginal calibration across subjects and inspect remaining within-subject patterns; do not infer independence from zero covariance alone.
Check Your Understanding
Answer each question, then compare with the solutions.
- If a subject has three repeated concentrations, what dimension is the subject’s covariance matrix?
- With \(K=19\) simulations and an observed value ranked \(R=16\) among the simulations and observation, calculate the plotting position and explain the meaning of the resulting normal score’s sign.
- Does a whitened vector with identity covariance necessarily have independent components? State a condition that would justify independence.
- Why must the simulated profiles use the subject’s actual observation schedule?
- What is one reason that a covariance matrix estimated from too few simulated profiles can make NPDE unreliable?
Solutions. (1) It is a \(3\times3\) covariance matrix. (2) \(p=(16-0.5)/(19+1)=0.775\); since \(p>0.5\), \(\Phi^{-1}(p)\) is positive, indicating an observed whitened value above the center of its simulated rank distribution. (3) No. Identity covariance establishes zero pairwise covariance, not independence; joint multivariate normality would make the whitened components independent. (4) The mean and covariance, and hence the ranks, must describe predictions at the same times as the observed vector. (5) The covariance may be unstable or singular, making the whitening transformation highly sensitive or impossible to calculate.