Tutorials › Joint Modeling of Longitudinal and Time-to-Event Data › Observation Intensities Conditional On Patient History

Informative Observation Schedules · Tutorial 39 of 697

Observation Intensities Conditional On Patient History

Learn to define and interpret a visit-rate model conditional on the information observed before each time point, including how changing history modifies the instantaneous rate.

Advanced 12 min read

What You'll Learn

  • Define a visit intensity conditional on a patient’s observed history up to, but not including, the current time.
  • Distinguish an instantaneous visit rate from a probability of a visit over a finite interval.
  • Interpret coefficients for time-varying predictors as conditional rate ratios.
  • Calculate visit intensities when observed covariates or past measurements change.
  • Check risk-set, timing, and model-form assumptions and recognize common diagnostic warnings.
  • Compare conditional intensity models with fixed schedules and marginal visit-rate summaries.

Why Condition Visit Rates on Observed History?

A patient may have more frequent clinical visits after a medication change, a recent symptom report, or a sequence of elevated biomarker measurements. A single average visit rate hides these differences. A conditional visit intensity describes how the instantaneous rate of another visit varies with information already observed for that patient. It makes the time ordering explicit: the predictors are known before the visit whose rate is being described.

The focus here is a model based on observed covariates and observed measurement history. It does not assume that the measurements reveal an unobserved current health state, and it does not make a causal claim about why visits occur. Rather, it specifies a conditional rate given a defined history. As in the earlier material on counting processes and separating visits from terminal events, the visit process is considered only while the patient remains under observation and at risk of another visit.

Definition: Let \(N_i^V(t)\) count patient \(i\)'s visits by time \(t\), and let \(H_i^{\mathrm{obs}}(t-)\) denote that patient's observed covariate and measurement history strictly before \(t\). Let \(Y_i(t)\) equal 1 when the patient is under observation and eligible for another visit, and 0 otherwise. The visit intensity conditional on observed history, \(\lambda_i^V(t\mid H_i^{\mathrm{obs}}(t-))\), is the instantaneous expected rate of visits given that history and the patient’s risk status. When \(Y_i(t)=1\), it is defined through the small-interval relation

\(\displaystyle P\{N_i^V(t+\Delta t)-N_i^V(t)=1\mid H_i^{\mathrm{obs}}(t-)\}=\lambda_i^V(t\mid H_i^{\mathrm{obs}}(t-))\Delta t+o(\Delta t)\)

as \(\Delta t\) approaches zero. The intensity has units of visits per unit time; it is not itself a probability.

The term \(o(\Delta t)\) represents a remainder that becomes negligible relative to \(\Delta t\) as the interval shrinks. Under the usual simple-process condition that the probability of multiple visits in an interval is of smaller order than its length, the intensity captures the first-order chance of one visit. For a sufficiently short interval, the probability is approximately the intensity multiplied by the interval length. For a longer interval, that multiplication is generally not an exact visit probability.

A Conditional Model Using Observed History

A common specification uses a log link so that the modeled intensity is positive. Write \(X_i(t)\) for observed covariates available just before time \(t\), and \(g\{H_i^{\mathrm{obs}}(t-)\}\) for one or more summaries of the patient's past observed measurements or events. A basic model is

$$ \lambda_i^V(t\mid H_i^{\mathrm{obs}}(t-)) = Y_i(t)\lambda_0^V(t) \exp\left\{\beta^\top X_i(t)+\gamma^\top g\bigl(H_i^{\mathrm{obs}}(t-)\bigr)\right\}. $$

Here \(\lambda_0^V(t)\) is a baseline intensity, \(\beta\) and \(\gamma\) are regression coefficients, and the history summary is specified by the analyst. For example, it could indicate whether a medication was changed before \(t\), or record the most recently observed biomarker category. A coefficient describes the conditional association of its predictor with visit intensity, holding the other included predictors and the baseline intensity fixed.

The predictors must be available before the time they are used. If a biomarker is measured at a visit, that measurement cannot be treated as a predictor of the intensity of that same visit: it is observed because the visit occurred. It can contribute to the history used to model visits after the measurement. This distinction prevents information from the event being used to predict itself.

Interpretation: If a predictor increases by one unit while all other model terms remain fixed, the conditional visit intensity is multiplied by \(\exp(\beta_j)\) (or by \(\exp(\gamma_j)\) for a history-summary coefficient). This is a conditional rate ratio, not a difference in visit probabilities and not, by itself, a causal effect.

The model requires a correctly defined risk period and a well-specified observed history. Its interpretation also relies on the chosen functional form being adequate: a linear term on the log-intensity scale assumes a constant multiplicative change per unit of that predictor. A baseline intensity may vary over calendar time even when the predictors stay fixed. If the patient is no longer under observation or is no longer eligible for a visit, \(Y_i(t)=0\) and the visit intensity is zero for the modeled risk process.

Why the Coefficient Gives a Rate Ratio

The rate-ratio interpretation follows directly from comparing two histories at the same time. Suppose the histories differ only in a predictor \(x\), which changes from \(x\) to \(x+1\), and its model coefficient is \(\beta\). The common baseline and other terms cancel:

$$ \frac{\lambda^V(t\mid x+1,\text{ other terms})} {\lambda^V(t\mid x,\text{ other terms})} = \frac{\lambda_0^V(t)\exp\{\beta(x+1)+C\}} {\lambda_0^V(t)\exp\{\beta x+C\}} = \exp(\beta), $$

where \(C\) collects the unchanged terms. Thus, if \(\beta=\log(1.5)\), a one-unit increase in \(x\) corresponds to 1.5 times the conditional intensity, or a 50% higher intensity, at that time and for otherwise equal modeled histories. This ratio concerns instantaneous rates. It does not say that the patient is 50% more likely to have a visit over an entire month, because the rate and the patient’s history may change during that month.

Worked Example: A Recent Medication Change

Suppose a hypothetical clinic models visit intensity per week as \(\lambda_0^V(t)=0.10\), multiplied by \(\exp(0.60M_i(t))\), where \(M_i(t)=1\) if a medication change was recorded before \(t\), and \(M_i(t)=0\) otherwise. For a patient under observation, compare the conditional rates before and after a recorded medication change.

Before the change, \(M_i(t)=0\), so

$$ \lambda_{\mathrm{before}}=0.10\exp(0.60\times0)=0.10\text{ visits per week}. $$

After the change has been recorded and is part of the prior history, \(M_i(t)=1\):

$$ \lambda_{\mathrm{after}}=0.10\exp(0.60\times1) =0.10(1.822)=0.1822\text{ visits per week}. $$

The rate ratio is \(0.1822/0.10=1.822\), also \(\exp(0.60)=1.822\). Under this hypothetical model, the conditional instantaneous visit rate is about 82.2% higher after a recorded medication change, holding the baseline and other terms fixed. This is an association specified by the model, not evidence that the medication change caused the higher rate. The change must have been recorded before the time at which the post-change intensity is evaluated.

Time-Varying Predictors and History Summaries

A time-varying predictor can change the intensity during follow-up, even if the model coefficients remain constant. The update occurs when the predictor’s value changes in the observed history. A past measurement can likewise be represented by a defined summary, such as whether the most recent measured value exceeded a threshold. Such a summary is not the same as a continuously observed current measurement: between measurement visits, the recorded summary remains based on what was last observed.

Worked Example: A Recent Elevated Measurement

Consider a hypothetical model with baseline intensity \(0.08\) visits per month. Let \(E_i(t)=1\) if the most recent biomarker measurement available before \(t\) was above a prespecified threshold, and \(0\) otherwise. Suppose the coefficient for \(E_i(t)\) is \(0.70\). Calculate the intensity when the most recent measurement is below the threshold and when it is above it.

For a below-threshold most recent measurement, \(E_i(t)=0\):

$$ \lambda_{\mathrm{below}}=0.08\exp(0.70\times0) =0.0800\text{ visits per month}. $$

For an above-threshold most recent measurement, \(E_i(t)=1\):

$$ \lambda_{\mathrm{above}}=0.08\exp(0.70\times1) =0.08(2.014)=0.1611\text{ visits per month}. $$

The conditional rate ratio is \(2.014\). If the patient’s most recent measurement changes from below to above the threshold at a visit, the predictor changes only after that visit has supplied the measurement. The model then assigns the higher rate to subsequent times, provided the patient remains at risk. It does not assign the measurement retrospectively to the interval before it was observed.

If an intensity is approximately constant over a short interval of length \(\Delta t\), then the probability of at least one visit in that interval is approximately \(\lambda^V\Delta t\). The approximation is useful only when the interval is sufficiently short for the neglected higher-order terms to be small. The following calculation illustrates both the conversion and its limitation.

Worked Example: Converting a Short-Interval Rate to a Probability

Suppose a hypothetical patient has a conditional intensity of \(0.12\) visits per day over a short two-day interval, and the patient remains under observation with the predictor history unchanged. The first-order approximation to the chance of one visit in that interval is

$$ 0.12\text{ visits per day}\times2\text{ days}=0.24. $$

Thus the short-interval approximation is a 0.24 probability, or 24%, for a visit in that two-day interval. This calculation is an approximation, not a general identity. For an interval that is not short, the intensity may change, and the probability of at least one visit cannot generally be obtained by simply multiplying the starting intensity by the interval length. In particular, an intensity of \(0.12\) visits per day does not mean a 12% visit probability for every interval of any length.

Assumptions, Diagnostics, and Failure Modes

Before interpreting a fitted conditional intensity, check the structure that gives it meaning. The observation window and terminal-event rules must define when a patient is at risk. The history used at time \(t\) must contain only information available before \(t\). The assumed log-linear relationship and any baseline-time structure must be plausible over the range of observed histories. Interpretation also presumes that visit times and predictor updates have been recorded with enough accuracy to establish their order.

Useful diagnostics focus on whether the model describes observed visit patterns across time and history groups. Compare observed and model-predicted visit counts or rates over follow-up intervals and across predictor categories. Examine whether discrepancies persist for particular patients, time periods, or ranges of the history summaries. Large residual patterns, systematic underprediction after a particular type of measurement, or strong variation in observed rates within a model-defined group can indicate omitted predictors, an inadequate time pattern, or a poor functional form. Sparse data may make these checks imprecise, so an apparently small discrepancy is not proof that the model is adequate.

The following assumptions and limitations are especially important:

  • Correct ordering: predictors must be recorded before the visit whose intensity they predict. Using a visit’s own measurement to explain the occurrence of that visit creates outcome-dependent information leakage.
  • Appropriate risk status: a patient who is no longer followed or cannot have another observed visit must not be treated as continuing to contribute at-risk time. Visits and terminal events must be distinguished.
  • Adequate model form: the log-linear specification assumes multiplicative effects unless interactions, nonlinear terms, or time-varying coefficients are included. A single coefficient may conceal changing associations over follow-up.
  • Observed-history limitation: conditioning on recorded history does not guarantee that all determinants of visit timing have been measured. The model describes rates given the included history, not a complete account of the clinical decision process.
  • Association, not intervention: a higher conditional rate after an observed event or measurement does not show that changing that predictor would change the rate. Clinical severity, access, or other factors may be related to both.

How This Model Differs From Alternatives

A fixed appointment schedule describes intended observation times, not necessarily the rate of all visits that actually occur. A marginal visit-rate summary averages across patients and histories; it can be useful descriptively but does not show how rates vary with a particular patient’s observed history. A conditional intensity model instead compares instantaneous rates at the same time for histories that differ in specified predictors. These approaches answer different questions and need not agree numerically.

The choice to condition on observed history also sets a boundary on interpretation. This tutorial does not replace observed measurements with a latent underlying trajectory, nor does it claim that the most recent measurement equals the patient’s exact current state. Nor does a rate model alone describe the full joint behavior of visits, measurements, and terminal events. Its value is narrower and concrete: it gives a precise, time-ordered way to express how the observed information available before \(t\) is associated with the instantaneous rate of a visit at \(t\).

Common Mistake

A common error is to read a coefficient of \(0.70\) as an increase of 0.70 visits per month, or as a 70% increase in the probability of a visit. In a log-intensity model, the rate ratio is \(\exp(0.70)=2.014\), not \(1+0.70\); the corresponding conditional intensity is about twice as large. It is still not a probability ratio. First interpret the coefficient on the log-rate scale, exponentiate it to obtain a rate ratio, and then distinguish that rate ratio from any probability over a specified interval.

Key takeaway: A conditional visit intensity is an instantaneous rate given the patient’s eligible risk status and observed history strictly before the time of interest. Time-varying predictors update that rate as new information becomes available; they do not turn the intensity into a visit probability or establish causation.

Check Your Understanding

Answer each question, then compare your reasoning with the solutions below.

  1. A model has coefficient \(\log(1.4)\) for a binary indicator of a recorded treatment change. What is the conditional rate ratio when the indicator changes from 0 to 1?
  2. A biomarker result is recorded at a visit at time \(t\). Can that result be used as a predictor of the intensity of the visit at \(t\)? When can it enter the observed history used by the model?
  3. A conditional intensity is \(0.05\) visits per day. What is the first-order approximation to the probability of a visit in a sufficiently short three-hour interval? Use 24 hours per day.
  4. Why is a coefficient of \(0.30\) in a log-intensity model not a 30% increase in visit probability?

Solutions. (1) The rate ratio is \(\exp\{\log(1.4)\}=1.4\), a 40% higher conditional intensity, holding other terms fixed. (2) No. The result is only known because the visit occurred; it can enter the history for times after it is recorded. (3) Three hours is \(3/24=0.125\) day, so the approximation is \(0.05\times0.125=0.00625\), or 0.625%, for a sufficiently short interval under the stated rate. (4) Exponentiating gives a rate ratio of \(\exp(0.30)=1.350\), about 35.0% higher conditional intensity. A rate ratio is not a probability ratio, and a probability depends on the interval and how the intensity changes within it.

Clinical Biostats