Tutorials › Pharmacokinetic-Pharmacodynamic (PK/PD) Modeling › Shrinkage-Induced Bias in Sequential PD Fits

Sequential Versus Simultaneous PK/PD Estimation · Tutorial 403 of 598

Shrinkage-Induced Bias in Sequential PD Fits

Learn to diagnose PK empirical Bayes shrinkage and determine how compressed predicted exposures can alter sequential PD slope and potency estimates.

Advanced 12 min read

What You'll Learn

  • Define empirical Bayes shrinkage and calculate a simple shrinkage factor.
  • Explain how shrinkage reduces the between-subject spread of predicted exposures.
  • Distinguish slope rescaling from attenuation caused by noisy exposure estimates.
  • Show how compressed exposure scales can shift an apparent EC50.
  • Identify diagnostics and alternatives for sequential PD fits that use shrunken PK estimates.

Why PK Shrinkage Matters for Sequential PD Fits

In a sequential analysis, PK data are used first to estimate individual PK parameters, and the resulting estimates are then used to predict each subject’s exposure for the PD analysis. When PK data are sparse or noisy, individual empirical Bayes estimates (EBEs) are pulled toward the population mean. This shrinkage can reduce the spread of predicted exposures across subjects. If the PD fit treats those compressed predictions as known, the fitted exposure-response parameters may no longer have the interpretation intended on the true exposure scale.

The effect is not a universal movement in one direction. A simple multiplicative compression of a predictor rescales a slope and potency parameter in predictable ways. Noisy exposure estimates can instead attenuate a slope. In nonlinear models, the consequences also depend on the exposure range, the model, and which parameters are estimated together. The central task is therefore to identify what kind of shrinkage or prediction error is present before interpreting the PD estimates.

Definition: Empirical Bayes shrinkage is the movement of an individual parameter estimate toward its population value because the individual’s data provide limited information relative to the population distribution. In a sequential PK/PD fit, shrinkage matters when individual PK estimates are used to calculate exposure predictors and those predictors are then treated as fixed in the PD fit.

A Simple Shrinkage Model

Let \(\theta_i\) be a subject’s PK parameter, such as log clearance, and suppose the population model is \(\theta_i\sim N(\mu,\omega^2)\). To isolate the mechanism, suppose the individual PK data can be summarized by an estimate \(z_i\) satisfying \(z_i\mid\theta_i\sim N(\theta_i,s^2)\), with the same known standard error \(s\) for each subject. The conditional mean of \(\theta_i\) given \(z_i\) is

$$ \hat{\theta}_{i,\mathrm{EB}}=\mu+\lambda(z_i-\mu), \qquad \lambda=\frac{\omega^2}{\omega^2+s^2}. $$

The factor \(\lambda\) is between zero and one. When individual PK information is strong, \(s^2\) is small and \(\lambda\) is near one, so the estimate remains close to \(z_i\). When individual information is weak, \(s^2\) is large and \(\lambda\) is small, so the estimate is pulled toward \(\mu\). In a nonlinear PK model the posterior estimate need not be this simple, but the same qualitative pull toward the population distribution can occur.

If a predicted exposure is a function of the individual parameter, \(C_i(t)=C(t;\theta_i)\), the sequential analysis often uses \(C(t;\hat{\theta}_{i,\mathrm{EB}})\). Variation in the EBEs is usually less than variation in the underlying individual parameters, so predicted exposure variability can be compressed too. The relationship is not always a simple multiplication: for nonlinear PK models, changing a parameter can alter both the level and shape of the concentration-time profile.

Worked Example: Calculating Shrinkage and Exposure-Scale Compression

Suppose a log-PK parameter has population variance \(\omega^2=0.16\), and an individual PK estimate has sampling variance \(s^2=0.09\). Under the normal model above, calculate the shrinkage factor. Then suppose five hypothetical subjects have centered, unshrunk exposure predictions of \(-2,-1,0,1,2\) in arbitrary exposure units, and the predictions are compressed by that factor.

Shrinkage factor.

$$ \lambda=\frac{0.16}{0.16+0.09} =\frac{0.16}{0.25} =0.64. $$

Each estimated deviation from the population mean is 64% of the corresponding noisy individual estimate’s deviation. Applying that compression to the hypothetical centered exposures gives \(-1.28,-0.64,0,0.64,1.28\). The original mean is zero and the sum of squared deviations is \(4+1+0+1+4=10\), so their population variance is \(10/5=2\). After compression the sum of squares is \(0.64^2(10)=4.096\), giving variance \(4.096/5=0.8192\). Thus the variance is multiplied by \(0.64^2=0.4096\), not by \(0.64\).

This calculation describes a deliberately simple, common-factor compression. Actual exposure predictions may not be exact scaled copies: each subject’s PK information, sampling times, and model nonlinearity can affect the amount and pattern of shrinkage.

How a Compressed Predictor Changes a Slope

Consider a linear PD relationship \(Y_i=a+\beta C_i+\epsilon_i\), where \(C_i\) is the exposure relevant to the response and \(\epsilon_i\) has mean zero. If the sequential fit uses \(C_i^*=cC_i\), with the same known constant \(0<c<1\) for every subject, then the same mean response can be written

$$ a+\beta C_i = a+\frac{\beta}{c}C_i^*. $$

Therefore the fitted slope against the compressed predictor is \(\beta^*=\beta/c\). This is a slope that is larger in magnitude when \(c<1\); it is not attenuation. The numerical coefficient changes because its predictor is expressed on a compressed scale. If the compression factor is known and the coefficient is converted back to the original exposure scale, the corresponding value is \(c\beta^*=\beta\).

This result requires a common multiplicative compression, a linear mean model, and a correctly specified intercept. It does not establish that every use of EBEs inflates slopes. In practice, compression may vary by subject or time, and EBEs can also contain estimation error. Those conditions can produce different bias patterns.

Worked Example: A Linear Slope on a Compressed Exposure Scale

Suppose the hypothetical true exposure values are \(1,2,3,4\) mg/L and the corresponding mean responses are \(2,4,6,8\) response units. The true relationship through the origin has slope \(2\) response units per mg/L. Now suppose sequential PK predictions are exactly 60% of the true exposures.

The predictions used in the PD fit are \(0.6,1.2,1.8,2.4\) mg/L. Fitting a line through the origin gives

$$ \hat{\beta}^* =\frac{\sum_i C_i^*Y_i}{\sum_i(C_i^*)^2} =\frac{0.6(2)+1.2(4)+1.8(6)+2.4(8)} {0.6^2+1.2^2+1.8^2+2.4^2} =\frac{36}{10.8} =3.333\ \text{response units per mg/L}. $$

The coefficient is larger than 2 because \(C_i^*=0.6C_i\), so the expected fitted slope is \(2/0.6=3.333\). This is a scale effect under the stated exact-compression assumption. It should not be described as the universal effect of EBEs on slope estimates.

Why Noisy Exposure Estimates Can Instead Attenuate a Slope

A different mechanism arises when the predictor contains additive estimation error. Suppose \(W_i=C_i+u_i\), where \(u_i\) is independent of \(C_i\) and of the PD residual, has mean zero, and has variance \(\sigma_u^2\). Under the linear model with centered variables, the large-sample regression slope of \(Y_i\) on \(W_i\) is

$$ \frac{\operatorname{Cov}(W,Y)}{\operatorname{Var}(W)} = \frac{\beta\operatorname{Var}(C)} {\operatorname{Var}(C)+\sigma_u^2}. $$

The ratio multiplying \(\beta\) is less than one when \(\sigma_u^2>0\), so this classical noisy-predictor mechanism attenuates the slope toward zero. The assumptions matter: errors must be independent in the specified way, and the expression concerns an additive-error model. EBEs are not generally independent additive errors; they are calculated using a population distribution and may have subject-specific uncertainty. Thus a compressed EBE predictor cannot be analyzed by automatically applying the classical attenuation result.

There is also an important calibration distinction. Under a correctly specified normal model, the posterior mean \(E(C_i\mid\text{PK data})\) is calibrated as a conditional mean. For a linear PD mean and PK data independent of the PD residual, using that conditional mean can preserve the conditional expected response. But plugging it in and treating it as an error-free covariate still omits uncertainty and may not reproduce the intended likelihood or uncertainty estimates. In nonlinear PD models, the response at a posterior mean exposure generally differs from the posterior mean response; the earlier material on nonlinear exposure plug-in addresses that separate issue.

Worked Example: Classical Predictor Error and Slope Attenuation

For a separate hypothetical linear-regression illustration, suppose centered true exposures have variance \(4\) \((\mathrm{mg/L})^2\), the true slope is \(2\) response units per mg/L, and independent exposure-estimation errors have variance \(1\) \((\mathrm{mg/L})^2\). Under the additive-error assumptions, the expected fitted slope using the noisy predictor is

$$ \beta_{\mathrm{noisy}} = 2\left(\frac{4}{4+1}\right) =1.6\ \text{response units per mg/L}. $$

Here the result is attenuation because the predictor has independent additive error. It differs from the previous example, where every exposure was multiplied by the same constant and the fitted slope increased to compensate. The examples are consistent because they use different error structures.

Consequences for Potency Estimates

Potency parameters in nonlinear PD models are also tied to the exposure scale. For an inhibitory or stimulatory Emax relationship, a common mean function is

$$ E(C)=E_0+\frac{E_{\max}C}{EC_{50}+C}. $$

Here \(E_0\) is the baseline response, \(E_{\max}\) is the maximum change from baseline, and \(EC_{50}\) is the exposure producing half of that maximum change. If the predictor is scaled to \(C^*=cC\), the identical response curve is represented by \(EC_{50}^*=cEC_{50}\), because \(C^*/(EC_{50}^*+C^*)=C/(EC_{50}+C)\). A fit using compressed exposure values can therefore return a correspondingly compressed apparent \(EC_{50}\). This is a change in the exposure scale, not evidence by itself that biological potency has changed.

Worked Example: Potency Under a Compressed Exposure Scale

Suppose a hypothetical Emax relationship has \(E_0=10\) response units, \(E_{\max}=60\) response units, and \(EC_{50}=2\) mg/L. At exposures of \(1,2,4\) mg/L, the mean responses are

$$ E(1)=10+\frac{60(1)}{2+1}=30,\quad E(2)=10+\frac{60(2)}{2+2}=40,\quad E(4)=10+\frac{60(4)}{2+4}=50. $$

If the sequential PK predictions are half of those values, the PD fit uses \(0.5,1,2\) mg/L. With \(EC_{50}^*=1\) mg/L, it gives the same means:

$$ E^*(0.5)=10+\frac{60(0.5)}{1+0.5}=30,\quad E^*(1)=10+\frac{60(1)}{1+1}=40,\quad E^*(2)=10+\frac{60(2)}{1+2}=50. $$

The fitted \(EC_{50}^*\) is 1 mg/L on the compressed scale, while the corresponding potency parameter on the original exposure scale is 2 mg/L. If the compressed value is reported as though the predictor were the true exposure, potency is misrepresented.

Diagnostics, Alternatives, and Limitations

Shrinkage is a warning about the information in individual PK estimates, not a stand-alone proof that a PD estimate is biased. Assess the PK-to-exposure step before interpreting the sequential PD fit.

  • Quantify parameter shrinkage. A commonly used descriptive measure for a random effect \(\eta\) is \(1-\mathrm{SD}(\hat{\eta}_{\mathrm{EB}})/\omega\), where \(\omega\) is the population standard deviation. Values nearer one indicate greater compression. This measure is approximate and can be affected by the distribution of the EBEs; it is not a direct estimate of PD bias.
  • Compare exposure distributions. Inspect the spread of individual predicted exposures across subjects at relevant times, and compare it with uncertainty-aware or population-model predictions. Also examine whether compression differs across subjects or concentration ranges.
  • Check the PD fit on the scale it uses. Plot residuals and predictions against the fitted exposure predictor. A narrow predictor range can make the slope or \(EC_{50}\) sensitive to small changes in exposure estimates, even when ordinary residual plots appear acceptable.
  • Test sensitivity to the PK-to-PD handoff. Compare sequential estimates obtained with alternative defensible exposure summaries or with uncertainty propagated from PK. A substantial change indicates that the PD result depends on how individual PK uncertainty is handled.

The main alternatives differ in how they handle individual PK uncertainty. A plug-in sequential fit uses point estimates of PK parameters or exposure and is computationally convenient, but treats those values as fixed. An uncertainty-propagating sequential method carries information about their uncertainty into the PD analysis. A simultaneous PK/PD likelihood estimates PK and PD parameters together and can use both data sources in the joint fit; its validity still depends on suitable model specification and identifiability. These approaches are not interchangeable in every design, and none automatically corrects a misspecified PK or PD model.

The direction of distortion is not universal. Pure multiplicative compression gives an increased linear slope and a proportionally decreased \(EC_{50}\) when those coefficients are reported on the compressed scale. Additive independent predictor error attenuates a linear slope. Subject-specific shrinkage, nonlinear PK predictions, limited exposure coverage, and dependence between PK and PD subject effects can yield more complicated results. The last issue requires explicit modeling rather than a blanket correction factor.

Common pitfall: “The EBEs have less variability, so the exposure-response slope must be attenuated.” This conclusion confuses predictor compression with additive measurement error. Under exact common scaling \(C^*=cC\), a linear slope on the compressed scale is \(\beta/c\), not \(c\beta\). With independent additive predictor error, attenuation can occur. State the assumed error mechanism and the scale of the reported coefficient before deciding the direction of bias.

Check Your Understanding

Answer each question using the stated assumptions. Solutions follow the questions.

  1. If \(\omega^2=0.25\) and \(s^2=0.25\) in the normal shrinkage model, what is \(\lambda\), and what fraction of an observed deviation from the population mean remains in the EB estimate?
  2. A true linear slope is 5 response units per mg/L, and all exposure predictors are exactly \(0.8\) times the true values. What slope is expected when the response is fitted against the compressed predictor?
  3. In a classical additive-error model, \(\operatorname{Var}(C)=9\) and \(\sigma_u^2=3\). What fraction of the true linear slope is expected in the noisy-predictor regression?
  4. If all Emax exposures are scaled by \(c=0.4\), and the original \(EC_{50}\) is 5 mg/L, what \(EC_{50}\) gives the identical curve on the compressed scale?
  5. Why does high EBE shrinkage alone not determine whether the fitted exposure-response slope is biased upward or downward?

Solutions. (1) \(\lambda=0.25/(0.25+0.25)=0.5\), so half of the observed deviation remains. (2) The slope is \(5/0.8=6.25\) response units per mg/L on the compressed scale. (3) The expected fraction is \(9/(9+3)=0.75\), so the expected slope is 75% of the true slope under the stated assumptions. (4) \(EC_{50}^*=0.4(5)=2\) mg/L. (5) Shrinkage describes movement toward a population value, but slope direction depends on the predictor’s error structure and model; exact common scaling and independent additive error produce different results.

Clinical Biostats