Tutorials › Pharmacokinetic-Pharmacodynamic (PK/PD) Modeling › Testing Alternative TMDD Mechanisms With Predictive Checks

Target-Mediated Drug Disposition and PK/PD · Tutorial 268 of 598

Testing Alternative TMDD Mechanisms With Predictive Checks

Use observation-level predictive checks to identify which competing TMDD mechanism better reproduces the joint time-course data, and understand when the available assays cannot distinguish the mechanisms.

Advanced 12 min read

What You'll Learn

  • Specify complex degradation and target recycling as competing TMDD mechanisms
  • Distinguish predictions for free drug, total drug, free target, total target, and complex
  • Calculate and interpret standardized predictive discrepancies
  • Use replicated data and predictive intervals to check model fit across analytes and times
  • Recognize why drug-only data may not identify target fate
  • Choose follow-up measurements that can discriminate the mechanisms

Why Compare TMDD Mechanisms Predictively?

Two TMDD models can fit the same free-drug concentration curve while implying different fates for drug-bound target. In one mechanism, the drug-target complex is degraded and the target is lost with it. In another, the complex is internalized but the target is returned to the free-target pool. These mechanisms can have distinct implications for target recovery and pharmacology, even when the observed drug profiles are similar.

A predictive check asks whether each fitted model can generate observations resembling the data, at the actual sampling times and for the actual assays. It is not enough to compare smooth curves for free drug alone. The model should be checked against every measured quantity that bears on the mechanism: free drug, total drug, free or total target, and drug-target complex. A failure concentrated in target measurements can be more informative about target recycling than a small improvement in a drug-only fit.

Define the Competing Structures

Let \(D\) be free drug concentration, \(R\) free target concentration, and \(C\) drug-target complex concentration. Let \(I_D(t)\) denote drug input expressed as concentration per unit time. The association and dissociation rate constants are \(k_{\mathrm{on}}\) and \(k_{\mathrm{off}}\); \(k_{\mathrm{el}}\) is nonspecific free-drug elimination, \(k_{\mathrm{in}}\) is target production, \(k_{\mathrm{out}}\) is free-target loss, and \(k_{\mathrm{int}}\) is complex internalization or removal. Concentrations use consistent units, and rate constants have units consistent with those concentrations and time.

Definition: In the complex-degradation model, internalization removes complex and degrades its drug and target. In the target-recycling model, internalized complex removes drug, but returns target to the free-target pool. The models below assume complete target recycling in the latter structure, with no explicit delay in returning target.

For the complex-degradation model, one minimal TMDD system is:

$$ \begin{aligned} \frac{dD}{dt} &= I_D(t)-k_{\mathrm{el}}D-k_{\mathrm{on}}DR+k_{\mathrm{off}}C,\\ \frac{dR}{dt} &= k_{\mathrm{in}}-k_{\mathrm{out}}R-k_{\mathrm{on}}DR+k_{\mathrm{off}}C,\\ \frac{dC}{dt} &= k_{\mathrm{on}}DR-(k_{\mathrm{off}}+k_{\mathrm{int}})C. \end{aligned} $$

For the target-recycling model, the drug and complex equations have the same form, while the target equation includes return of target at internalization:

$$ \begin{aligned} \frac{dD}{dt} &= I_D(t)-k_{\mathrm{el}}D-k_{\mathrm{on}}DR+k_{\mathrm{off}}C,\\ \frac{dR}{dt} &= k_{\mathrm{in}}-k_{\mathrm{out}}R-k_{\mathrm{on}}DR+k_{\mathrm{off}}C+k_{\mathrm{int}}C,\\ \frac{dC}{dt} &= k_{\mathrm{on}}DR-(k_{\mathrm{off}}+k_{\mathrm{int}})C. \end{aligned} $$

The equations make the structural difference explicit: the recycling model adds \(k_{\mathrm{int}}C\) to free target. In both systems, drug bound in complex is removed when complex is internalized. In practice, the assay observation model must also be specified. For example, if an assay reports total drug as drug equivalents and detects both free drug and circulating complex, its model prediction is \(D_{\mathrm{tot}}=D+C\). If an assay reports total target and detects free target plus circulating complex, the prediction is \(R_{\mathrm{tot}}=R+C\). Assays that detect only one form require the corresponding prediction, not an assumed total.

A fair comparison holds the dose history, covariates, sampling times, parameterization where appropriate, and observation models constant. Each mechanism must be fitted or otherwise assigned a defensible parameter distribution; predictive differences should not arise merely because one model was given more favorable measurement-error assumptions. Predictions should include relevant uncertainty in parameters, between-subject variation, and residual error.

Why Target Measurements Can Separate the Mechanisms

A short mass-balance derivation shows why target observations are especially useful. Define the circulating total target as \(T=R+C\). Add the free-target and complex equations. In the degradation model, the binding and dissociation terms cancel:

$$ \frac{dT}{dt} =\frac{dR}{dt}+\frac{dC}{dt} =k_{\mathrm{in}}-k_{\mathrm{out}}R-k_{\mathrm{int}}C. $$

Thus, complex internalization is a loss route for circulating target. In the recycling model, the additional \(k_{\mathrm{int}}C\) in the free-target equation cancels the complex loss term:

$$ \frac{dT}{dt} =k_{\mathrm{in}}-k_{\mathrm{out}}R. $$

The models therefore predict different target recovery when appreciable complex has formed. They need not predict equally distinct free-drug trajectories. Binding terms cancel from the derivative of circulating total drug \(D+C\) in both models, giving \(d(D+C)/dt=I_D(t)-k_{\mathrm{el}}D-k_{\mathrm{int}}C\). The drug profile can still differ indirectly because the target trajectory changes binding, but a drug-only comparison may provide weak evidence about target fate. These identities assume the stated compartments and complete recycling; delayed recycling, partial recycling, or additional target pools require different equations.

Run Checks on Observations, Not Just Curves

For each fitted mechanism, simulate replicate data at the same dose, covariates, sampling times, and assay types as the observed data. Each replicate should pass through the observation model, including measurement error and any relevant between-subject variability. Compare simulated and observed values using displays and summaries appropriate to the analyte: time-course overlays, predictive intervals, and patterns in the discrepancy across time and assay.

A simple descriptive discrepancy at one observation is \(z=(y-\mu_{\mathrm{pred}})/s_{\mathrm{pred}}\), where \(y\) is the observed value, and \(\mu_{\mathrm{pred}}\) and \(s_{\mathrm{pred}}\) are the mean and standard deviation of its predictive distribution. A large absolute value indicates that the observation is unusual under that predictive distribution if its location and scale are adequately summarized by the mean and standard deviation. It is not a universal pass/fail threshold: the distribution may be skewed, and many observations are being checked. Prefer empirical predictive intervals or simulation-based ranks when the predictive distribution is nonnormal.

1
Specify each mechanism.
Write the competing state equations and map each state to the assays that were actually collected.
2
Generate replicated observations.
Simulate parameter and subject variability, solve the model at observation times, and generate assay values under the observation model.
3
Compare analytes and times.
Check the observed profiles against predictive distributions, looking for systematic direction, timing, or assay-specific mismatch rather than isolated deviations alone.
4
Interpret the contrast mechanistically.
Ask whether discrepancies occur in measurements that should respond to the structural difference, and whether the data contain enough information to distinguish the models.

Worked Example: A Target Measurement Favors Recycling

Consider hypothetical observations 24 hours after a dose. The measured total target is \(6.8\) nM. Simulations from the fitted complex-degradation model have predictive mean \(4.2\) nM and predictive standard deviation \(0.8\) nM; simulations from the fitted target-recycling model have mean \(6.1\) nM and standard deviation \(0.9\) nM. Assume both predictive distributions include the same target assay error and are based on the same sampling time.

For complex degradation, the standardized discrepancy is \(z=(6.8-4.2)/0.8=2.6/0.8=3.25\). For target recycling, it is \(z=(6.8-6.1)/0.9=0.7/0.9=0.778\), to three significant figures.

The observation is much farther above the degradation-model predictive mean than the recycling-model mean. This supports the recycling model's ability to reproduce this target observation, but it does not establish that recycling is biologically true. The comparison remains conditional on the model equations, parameter uncertainty, and adequacy of the target assay model. A full assessment checks the other measurements and time points as well.

Look for Joint, Time-Structured Evidence

A mechanism is more convincing when it accounts for a coherent pattern across related observations, not merely one favorable point. For example, a degradation model might predict adequate free-drug concentrations but repeatedly underpredict total target during recovery. A recycling model might reproduce the target profile but systematically miss complex concentrations. The second pattern is evidence against that model's adequacy even if its average target prediction is closer.

Before attributing a mismatch to mechanism, check whether it could arise from a different source: an assay that does not measure the assumed molecular forms, an inaccurate assay error model, an incorrect baseline target level, or a misspecified sampling or dosing record. Also check that the numerical solution is stable enough for the comparison. A predictive check cannot distinguish structural error from these other causes without additional information.

Worked Example: Comparing Several Assays at One Time

The following hypothetical 24-hour observations are compared with predictive means and standard deviations. Values are in nM, and all predictions use the same dosing record and assay definitions.

MeasurementObservedDegradation mean (SD)Recycling mean (SD)
Free drug1.701.80 (0.40)1.75 (0.42)
Total drug3.103.00 (0.50)3.05 (0.52)
Total target6.804.20 (0.80)6.10 (0.90)
Complex1.251.20 (0.25)1.22 (0.27)

For total target, the standardized discrepancies are \( (6.80-4.20)/0.80=3.25\) for degradation and \( (6.80-6.10)/0.90=0.778\) for recycling. For free drug under degradation, \( (1.70-1.80)/0.40=-0.250\); for total drug, \( (3.10-3.00)/0.50=0.200\); and for complex, \( (1.25-1.20)/0.25=0.200\). These latter values are small descriptively. The principal contrast in this set is therefore the total-target prediction, not a general improvement across every assay.

This pattern is compatible with similar drug and complex predictions at this time but different target predictions. It does not show that the drug data are irrelevant: other times, especially during target recovery, may reveal indirect consequences for drug disposition. Nor should four standardized discrepancies be treated as independent formal tests; they share model states and may be correlated.

Worked Example: An Empirical Predictive Tail Check

Suppose a prespecified summary is the largest positive standardized total-target discrepancy across the recovery-time observations. Under 1,000 simulated data sets from the fitted degradation model, 31 summaries are at least as large as the observed summary. The estimated simulation tail proportion is \(\hat{q}=31/1000=0.0310\), or 3.10%.

The approximate Monte Carlo standard error of this simulated proportion is \(\sqrt{\hat{q}(1-\hat{q})/1000}=\sqrt{0.0310(0.969)/1000}=0.00548\). Thus, simulation noise alone is about 0.0055 in proportion units. The small tail proportion indicates that this particular observed summary is unusual among simulations under the degradation model, subject to Monte Carlo error and the model assumptions.

This is a predictive diagnostic, not a conventional hypothesis-test p-value and not the probability that the degradation mechanism is false. The summary must be chosen and interpreted in context; checking many summaries and reporting only the most extreme one can exaggerate apparent evidence. More simulations can reduce Monte Carlo error, but cannot repair a misspecified model or observation process.

Alternatives, Limitations, and Practical Decisions

Predictive checks answer whether a fitted model reproduces relevant features of the observations. They complement, rather than replace, other comparisons. Likelihood-based criteria such as AIC summarize fit while penalizing model complexity under their assumptions; they do not show which analyte or time drives a mismatch. A residual-based diagnostic can expose patterns in fitted observations, while simulation-based checks make the variability expected under the full model more explicit. Mechanistic experiments or additional sampling can provide stronger discrimination when the existing data support similar predictions from both structures.

Predictive checks have important limits. If the target assay is absent, noisy, or unable to distinguish free from complexed target, the key mechanistic prediction may be weakly observed. If both models generate nearly identical predictive distributions over the observed dose range and times, no diagnostic can reliably choose between them from those data. Conversely, a better predictive fit does not prove that a model's internal biological story is correct; different mechanisms can be observationally equivalent.

When predictions overlap, report the lack of discrimination rather than selecting a mechanism from a small numerical advantage. Consider whether target and complex assays, later recovery samples, or dose conditions that create different amounts of complex would make the predictions separate. The useful design is the one that targets a predicted contrast while keeping assay measurement and observation models credible.

Common Pitfall

  • Wrong reasoning: “The recycling model fits free drug slightly better, so target recycling has been demonstrated.”
  • Correction: A small drug-only improvement is not direct evidence about target fate. Compare predictive distributions for the target and complex measurements as well, account for uncertainty and assay definitions, and state when the available observations do not discriminate the mechanisms.
Key takeaway: Test alternative TMDD mechanisms by comparing their simulated observations across analytes and time, with the observation model included. Target and complex data can reveal structural differences that free-drug predictions alone may conceal.

Check Your Understanding

Answer each question, then compare with the brief solutions below.

  1. In the two structures defined above, what term distinguishes the target-recycling equation from the complex-degradation equation?
  2. An observation is \(5.4\) nM, with predictive mean \(4.8\) nM and predictive standard deviation \(0.3\) nM. Calculate its standardized discrepancy and interpret it.
  3. Why can a free-drug-only predictive check be weak evidence for or against target recycling?
  4. A complex assay detects only circulating complex, while a total-target assay detects free target plus complex. Give the corresponding model predictions.
  5. If both models reproduce all measured analytes within similar predictive distributions, what is the appropriate conclusion?

Solutions. (1) The recycling model adds \(k_{\mathrm{int}}C\), returning target to the free-target pool. (2) \(z=(5.4-4.8)/0.3=0.6/0.3=2.00\). The observation is two predictive standard deviations above the mean; this is a descriptive discrepancy, not by itself a formal test. (3) The structures can predict similar drug profiles, and target fate is more directly reflected in target measurements. (4) The complex prediction is \(C\); the total-target prediction is \(R+C\). (5) The data do not clearly discriminate the mechanisms under the fitted models and observed design; report that limitation rather than claiming one mechanism is established.

Clinical Biostats