Why perturb a whole trajectory?
In repeated-measures data, an individual contributes an outcome record rather than a collection of unrelated values. A change at one visit can affect estimation at another because the outcome model connects measurements within a subject. In a selection model, dependence can also affect how the observed outcomes inform the probability of the subject’s missingness pattern. A perturbation that represents a plausible change to a trajectory should therefore specify which observed components move and in what relative amounts.
The aim is local: assess how a small, stated change in observed outcomes would alter the fitted parameters. This is a sensitivity diagnostic, not a claim that the perturbed values are more correct, nor a replacement for modelling missing outcomes. As in the earlier material on perturbing observed outcomes without altering missing values, the missing components remain unperturbed. The focus here is to define the direction jointly across visits and account for within-subject dependence in the resulting calculation.
Model and trajectory perturbation
For subject \(i\), let \(Y_i=(Y_{i1},\ldots,Y_{iT})^\mathsf{T}\) denote the full outcome trajectory and \(R_i\) its response indicators, with \(R_{it}=1\) if the outcome at visit \(t\) is observed. Write \(Y_i^{\mathrm{obs}}\) and \(Y_i^{\mathrm{mis}}\) for the observed and missing components. A longitudinal selection model specifies an outcome density \(f_\theta(Y_i)\) and a response mechanism \(g_\psi(R_i\mid Y_i)\). The combined parameter is \(\eta=(\theta^\mathsf{T},\psi^\mathsf{T})^\mathsf{T}\).
The subject’s observed-data likelihood contribution integrates the full-data likelihood over the missing outcomes. The integral is over the components missing under that subject’s response pattern.
Let \(d_i\) be a fixed vector with one entry for each observed visit for subject \(i\). It specifies a trajectory direction: for example, shifting every observed visit equally, shifting only a particular visit, or increasing later visits more than earlier ones. The perturbed observed outcomes are \(Y_i^{\mathrm{obs}}(\omega_i)=Y_i^{\mathrm{obs}}+\omega_i d_i\). Here \(\omega_i\) is a scalar perturbation size; the missing outcomes and the response indicators are held fixed. A perturbation involving several subjects can use a vector \(\omega\), with a specified direction across subjects and visits.
The perturbed observed log likelihood is \(\ell(\eta;\omega)=\sum_i \log L_i(\eta;Y_i^{\mathrm{obs}}(\omega_i),R_i)\), with \(\ell(\eta;0)\) the unperturbed log likelihood. This construction requires a well-defined observed-data likelihood and enough smoothness to differentiate it with respect to \(\eta\) and \(\omega\). In particular, differentiating under the integral must be justified by suitable regularity conditions. The model and response pattern are fixed during the perturbation; only the stated observed outcomes move.
Local curvature and its justification
Let \(\hat\eta\) maximize \(\ell(\eta;0)\). Assume it is an interior, locally unique maximum, the observed information \(I=-\ell_{\eta\eta}(\hat\eta;0)\) is positive definite, and the perturbed maximum \(\hat\eta(\omega)\) varies smoothly near zero. For a vector of perturbation coordinates, define the cross-derivative matrix \(\Delta=\ell_{\eta\omega}(\hat\eta;0)\). Its columns describe how the parameter score changes, to first order, for each specified trajectory perturbation.
To isolate parameter movement, use the likelihood displacement between the perturbed fit and the original estimate evaluated under the same perturbed likelihood:
This quantity is nonnegative because \(\hat\eta(\omega)\) maximizes the perturbed log likelihood. It is zero at \(\omega=0\), and it measures the loss in perturbed log likelihood from holding the parameters at their original estimate rather than refitting. The definition is especially useful for response perturbations, because the log likelihood at fixed parameters can itself change when observed values change.
For completeness, differentiate the score equation \(\ell_\eta(\hat\eta(\omega);\omega)=0\) at \(\omega=0\). Since \(\ell_{\eta\eta}=-I\), the chain rule gives \(-I\,d\hat\eta/d\omega+\Delta=0\), and hence \(d\hat\eta/d\omega=I^{-1}\Delta\). This is the first-order parameter response to the perturbation.
To obtain the curvature, expand the log likelihood near \((\hat\eta,0)\). Let \(h=\hat\eta(\omega)-\hat\eta\). The terms involving \(h\) that affect the displacement through second order are \(-\tfrac12 h^\mathsf{T}Ih+h^\mathsf{T}\Delta\omega\). The direct terms depending only on \(\omega\) occur in both log likelihoods defining \(D\), so they cancel. At the perturbed maximum, \(h=I^{-1}\Delta\omega+o(\|\omega\|)\). Substitution gives
Thus \(C\) is positive semidefinite. It is a local approximation: it describes sufficiently small perturbations around the fitted model, not the effect of a large change to the data.
Worked Example: A Prespecified Two-Visit Direction
Suppose a fitted longitudinal selection model has one parameter of interest, a mean outcome \(\beta\) measured in mmHg. For a prespecified two-visit perturbation, suppose the observed information is \(I=4.00\ \mathrm{mmHg}^{-2}\) and the score cross-derivative is \(\Delta=0.800\ \mathrm{mmHg}^{-1}\). These are hypothetical derivatives evaluated at the unperturbed fit. The direction \(d_i\) and the perturbation size \(\omega\) are defined so that \(\omega=1\) represents the stated trajectory shift.
The first-order change in the fitted parameter per unit perturbation is
The local curvature is
For a small \(\omega\), the fitted mean changes by approximately \(0.200\omega\) mmHg, and the likelihood displacement is approximately \(\tfrac12 C\omega^2=0.160\omega^2\). This is a local approximation for this specific direction and scaling; it does not say that the perturbation causes a change in the underlying clinical outcome.
How within-subject dependence changes the calculation
The information matrix and the cross-derivative are calculated from the joint observed-data likelihood, not by treating each visit as an independent record. Consequently, both within-subject covariance and the selection mechanism can change the curvature. The following Gaussian calculation isolates the covariance effect in a simple special case: two outcomes are observed, missingness is independent of the outcomes, and the mean at each visit is the common parameter \(\beta\). This is a selection-model special case with a response mechanism that contributes no outcome-dependent selection term.
Worked Example: A Single-Visit Shift With Correlated Outcomes
Suppose \(Y_i\sim N(\beta\mathbf{1},\Sigma)\), where \(\mathbf{1}=(1,1)^\mathsf{T}\), and the covariance matrix is known:
Both visits are observed. Perturb only visit 1 by \(d=(1,0)^\mathsf{T}\) mmHg per unit \(\omega\). The matrix is positive definite because its determinant is \(16-2.4^2=10.24>0\). Its inverse is
For the normal log likelihood, the information for \(\beta\) is \(I=\mathbf{1}^\mathsf{T}\Sigma^{-1}\mathbf{1}\), and the score cross-derivative for this outcome shift is \(\Delta=\mathbf{1}^\mathsf{T}\Sigma^{-1}d\). Substitution gives
Therefore, \(d\hat\beta/d\omega=I^{-1}\Delta=0.5000\) mmHg, and
For comparison, if the visits were independent with the same marginal variance \(4\ \mathrm{mmHg}^2\), then \(I=0.5000\ \mathrm{mmHg}^{-2}\), \(\Delta=0.2500\ \mathrm{mmHg}^{-1}\), and \(C=0.2500\). The difference is not an arithmetic correction applied after treating visits separately: it follows from using the joint covariance in both derivatives. Under positive correlation, the second visit supplies partly redundant information about the common mean, changing how a shift at the first visit moves its estimate.
Worked Example: Combining Visit-Specific Directions
Suppose a two-parameter fitted model has information \(I=\begin{pmatrix}9&0\\0&4\end{pmatrix}\), and the columns of \(\Delta\) correspond to perturbing the observed outcomes at visits 1 and 2, respectively:
Treat these as hypothetical, consistently scaled local derivatives. Since \(I^{-1}=\begin{pmatrix}1/9&0\\0&1/4\end{pmatrix}\), the curvature matrix is
A unit perturbation of visit 1 alone has curvature \(C_{11}=2.222\); a unit perturbation of visit 2 alone has curvature \(C_{22}=1.389\). For the unit joint direction \(a=(1,1)^\mathsf{T}/\sqrt{2}\), which increases both visits equally on the specified scale,
The off-diagonal element matters: the effect of shifting both visits is not obtained by simply averaging the two single-visit curvatures. In an actual longitudinal selection model, the derivatives must come from its observed-data likelihood, including integration over missing outcomes. These numbers illustrate the matrix calculation, not a fitted clinical analysis.
Diagnostics, alternatives, and limitations
A calculated curvature is interpretable only alongside its perturbation definition and scale. Check that each component of \(d_i\) refers to an observed visit, that the response pattern is unchanged, and that the full joint likelihood—not a product that incorrectly assumes independence—was used. For incomplete records, verify that the observed-data integral and its derivatives include the response mechanism and the integration over missing outcomes. If the likelihood is not differentiable or the fitted information matrix is nearly singular, \(I^{-1}\) may be unstable; large curvature can then reflect weak identification or numerical error as well as genuine sensitivity to the chosen direction.
Useful checks include computing derivatives by more than one method, comparing the first-order parameter movement \(I^{-1}\Delta a\) with small refits in both positive and negative directions, and checking that the quadratic approximation improves as the perturbation size decreases. Material disagreement for very small perturbations can indicate an implementation error, an inaccurate Hessian, or failure of the local smoothness assumptions. Agreement at small sizes does not guarantee that the approximation is reliable for large shifts.
Trajectory perturbations answer a different question from several familiar alternatives. Exact case deletion removes a subject’s entire likelihood contribution; a trajectory perturbation preserves the subject and changes specified observed outcomes. Case-weight perturbations rescale a subject’s contribution rather than shifting visits. Covariate perturbations change predictors in the selection equation, not the outcome vector. These diagnostics can complement one another, but their curvature values are not directly comparable unless the perturbation definitions and scales are made commensurate.
A main limitation is scale dependence: multiplying \(d_i\) by a constant multiplies the curvature by the square of that constant. Curvature therefore ranks directions meaningfully only under a stated, comparable scaling. It is also a local, model-dependent diagnostic. It does not establish that a subject is erroneous, identify a causal effect, validate the selection model, or resolve sensitivity to assumptions about unobserved outcomes. A large value signals that the fitted parameters respond strongly to this specified local change under the fitted model.
Check Your Understanding
Answer each question, then compare with the brief solutions below.
- If \(d_i\) has a nonzero entry for a visit with \(R_{it}=0\), what must be changed to make it a trajectory perturbation as defined here?
- For a unit direction \(a\), write the local curvature in terms of \(I\), \(\Delta\), and \(a\).
- If the perturbation direction is multiplied by 3, by what factor does its curvature change?
- Why can the curvature for a joint shift at two visits differ from the average of their separate curvatures?
Solutions. (1) Set the direction’s missing-visit components to zero, or otherwise redefine the perturbation so it changes observed outcomes only. (2) \(C(a)=2a^\mathsf{T}\Delta^\mathsf{T}I^{-1}\Delta a\). (3) It is multiplied by \(3^2=9\), because curvature is quadratic in the direction. (4) The cross-derivative terms in the curvature matrix contribute to a joint shift; within-subject dependence is represented in the joint likelihood and cannot generally be removed by averaging separate values.