Tutorials › Competing Risks and Multi-State Models › Martingale Isometry for Variance Derivation

Counting Processes and Martingale Theory · Tutorial 465 of 699

Martingale Isometry for Variance Derivation

Use predictable variation and the martingale isometry to derive variances for compensated event counts, including weighted and multitype integrals.

Advanced 12 min read

What You'll Learn

  • Define the predictable variation of a unit-jump counting-process martingale.
  • State the integrability and predictability conditions for the martingale isometry.
  • Derive the variance of a predictable integral from its predictable variation.
  • Calculate variances for constant, risk-set-weighted, and baseline-weighted integrals.
  • Distinguish predictable variation from realized quadratic variation.
  • Identify conditions that invalidate a variance calculation, including nonpredictable weights and infinite expected variation.

Why Predictable Variation Gives a Variance

An event count fluctuates around its compensator: the part of its cumulative expected count determined by the event intensity and the information available over time. Subtracting that compensator from the count produces a martingale. A predictable integral against this martingale is therefore a centered accumulation of weighted event-count fluctuations. The martingale isometry turns its variance into an expectation involving the squared weights and the process's predictable variation.

This result is useful because it gives a direct route from a specified intensity model to the variance of an event-history quantity. It also clarifies why the weights must be predictable: they may use information available just before each time point, but not the future event increments they are weighting.

Definition: Let \(N(t)\) be a simple counting process with intensity \(\lambda(t)\) relative to a filtration \(\mathcal{F}_t\), and let \(A(t)=\int_0^t\lambda(u)\,du\) be its compensator. Assume \(A\) is continuous. The compensated counting-process martingale is \(M(t)=N(t)-A(t)\). Its predictable variation is \(\langle M\rangle(t)=A(t)\). If \(H(t)\) is predictable, then \(\int_0^t H(u)\,dM(u)\) is the predictable weighted accumulation of the martingale increments.

Here, a process is predictable if its value at time \(t\) is determined by information available immediately before \(t\). A risk-set indicator and a weight determined by baseline covariates are common examples. Throughout, the basic formula assumes unit jumps of \(N\), no simultaneous multiple jumps within this counting process, and a continuous compensator. These are the usual conditions for a counting process with an intensity.

The Isometry and Its Conditions

The martingale isometry states that a predictable integral has second moment equal to the expected predictable variation of that integral. For a square-integrable integrand over \([0,\tau]\), the result is

$$ E\left[\left\{\int_0^\tau H(u)\,dM(u)\right\}^2\right] = E\left[\int_0^\tau H(u)^2\,d\langle M\rangle(u)\right] = E\left[\int_0^\tau H(u)^2\,dA(u)\right]. $$

A sufficient condition for this finite-variance statement is \(E[\int_0^\tau H(u)^2\,dA(u)]<\infty\). Under the martingale assumptions above, the integral has mean zero. Its variance is therefore the displayed second moment. For an intensity expressed as \(A(t)=\int_0^t \lambda(u)\,du\), the same result can be written as

$$ \operatorname{Var}\left\{\int_0^\tau H(u)\,dM(u)\right\} = E\left[\int_0^\tau H(u)^2\lambda(u)\,du\right]. $$

The right side is an expectation: the predictable variation \(\int H^2\,dA\) is generally random when \(H\) or \(A\) is random. It is not correct to treat one observed value of that variation as automatically equal to the sampling variance.

Why the Formula Holds

The core argument is that martingale increments over disjoint intervals are orthogonal in expectation, and the conditional second moment of a martingale increment is governed by its predictable variation. To see the structure, first take a simple predictable integrand that is constant on successive intervals:

$$ H(u)=\sum_{k=0}^{m-1}\xi_k\,\mathbf{1}_{(t_k,t_{k+1}]}(u), \qquad \xi_k\text{ is }\mathcal{F}_{t_k}\text{-measurable}. $$

The corresponding integral is \(\sum_k \xi_k\{M(t_{k+1})-M(t_k)\}\). For \(j<k\), the earlier increment and \(\xi_j\) are known by time \(t_k\). Since the conditional mean of the later martingale increment given \(\mathcal{F}_{t_k}\) is zero, the expectation of the cross-product of these two terms is zero. Thus only the squared increments contribute to the second moment. For each interval, the martingale square identity gives

$$ E\left[\{M(t_{k+1})-M(t_k)\}^2\mid\mathcal{F}_{t_k}\right] = E\left[\langle M\rangle(t_{k+1})-\langle M\rangle(t_k)\mid\mathcal{F}_{t_k}\right]. $$

Multiplying by the \(\mathcal{F}_{t_k}\)-measurable \(\xi_k^2\), taking expectations, and summing yields

$$ E\left[\left\{\sum_k\xi_k\Delta_k M\right\}^2\right] = E\left[\sum_k\xi_k^2\{\langle M\rangle(t_{k+1})-\langle M\rangle(t_k)\}\right], $$

where \(\Delta_k M=M(t_{k+1})-M(t_k)\). The expression on the right is the expected integral of \(H^2\) against \(\langle M\rangle\). General predictable square-integrable integrands are obtained by approximating them with simple predictable integrands in this squared-integral norm. The equality extends by that approximation, giving the isometry.

For a simple unit-jump counting process with continuous \(A\), each jump of \(M=N-A\) is a unit jump at an event time. Its realized quadratic variation is \([M](t)=N(t)\), while its predictable variation is \(\langle M\rangle(t)=A(t)\). For the weighted integral, the corresponding predictable variation is \(\int_0^t H(u)^2\,dA(u)\). This explains why the variance uses the compensator rather than the realized event count.

Worked Example: A Constant Weight on a Poisson Count

Suppose, hypothetically, that \(N(t)\) is a Poisson counting process with constant intensity 3 events per hour, observed for 2 hours. Let \(H(t)=2\) throughout. The weight is deterministic and hence predictable; the compensator is \(A(t)=3t\), and the expected squared integral is finite.

The weighted martingale integral is \(S=2\{N(2)-A(2)\}=2\{N(2)-6\}\). Its mean is zero. By the isometry,

$$ \operatorname{Var}(S) = E\left[\int_0^2 2^2(3)\,du\right] = 4\times 3\times 2 = 24. $$

Thus the variance is 24 squared weighted-count units. Equivalently, \(N(2)\) has variance 6 events squared, and multiplying its centered value by 2 multiplies its variance by \(2^2=4\). The two calculations agree.

Risk-Set Weights and Random Predictable Weights

In event-history applications, the intensity often has the multiplicative form \(\lambda_N(t)=Y(t)\lambda(t)\), where \(Y(t)\) is a predictable at-risk process and \(\lambda(t)\) is an event rate per at-risk unit. A common weight is \(H(t)=1/Y(t)\), used only while \(Y(t)>0\). The isometry then reduces the variance calculation to

$$ E\left[\int_0^\tau \frac{1}{Y(u)^2}Y(u)\lambda(u)\,du\right] = E\left[\int_0^\tau \frac{\lambda(u)}{Y(u)}\,du\right], $$

with the integrand defined as zero when the process is not being integrated and \(Y(u)=0\). This calculation requires that the risk-set process be predictable and that the expected integral be finite. It does not require the risk set to be deterministic.

Worked Example: A Risk-Set-Weighted Integral

For a hypothetical illustration, suppose a known, predictable risk-set schedule has \(Y(t)=10\) from hour 0 to hour 2 and \(Y(t)=5\) from hour 2 to hour 3. Assume the event rate per at-risk unit is constant at \(\lambda(t)=0.2\) events per hour. The aggregate event intensity is \(Y(t)\lambda(t)\). Use \(H(t)=1/Y(t)\) on these intervals.

The schedule is stipulated to be known predictably, and the risk set stays positive, so the weight is defined and predictable. The total expected predictable variation is

$$ \begin{aligned} E\left[\int_0^3 H(u)^2\,dA(u)\right] &=\int_0^2 \left(\frac{1}{10}\right)^2(10)(0.2)\,du +\int_2^3 \left(\frac{1}{5}\right)^2(5)(0.2)\,du\\ &=2(0.02)+1(0.04)\\ &=0.08. \end{aligned} $$

The variance of this weighted martingale integral is therefore 0.08 in squared weighted-count units. The smaller risk set contributes more variance per hour: with \(Y=5\), the rate of predictable variation is \(0.2/5=0.04\), twice the rate \(0.2/10=0.02\) when \(Y=10\).

A predictable weight need not be fixed in advance. It may depend on observed history, provided its value at each time is determined by information just before that time. The isometry then averages over the randomness in both the event process and the predictable weight. Conditioning on baseline information can make that averaging especially transparent.

Worked Example: A Weight Determined by a Baseline Group

Suppose a hypothetical subject has a baseline group indicator \(Z\), known at time zero, with \(P(Z=1)=0.4\) and \(P(Z=2)=0.6\). Conditional on \(Z=1\), let the event intensity be 1 event per hour; conditional on \(Z=2\), let it be 3 events per hour. Observe for 2 hours and use the constant-in-time weight \(H(t)=Z\). This weight is predictable because \(Z\) is known before follow-up.

Conditional on \(Z\), the isometry gives variance \(Z^2\lambda_Z(2)\). Averaging over the two groups gives

$$ \begin{aligned} \operatorname{Var}\left\{\int_0^2 Z\,dM(u)\right\} &=0.4(1^2\times 1\times 2)+0.6(2^2\times 3\times 2)\\ &=0.4(2)+0.6(24)\\ &=0.8+14.4\\ &=15.2. \end{aligned} $$

The mean is zero conditional on either baseline group, so it is also zero unconditionally. The variance is 15.2 squared weighted-count units. The larger group-specific variance in the \(Z=2\) stratum reflects both its larger weight and its higher event intensity.

Multiple Event Types and Covariance

For several compensated counting processes \(M_j=N_j-A_j\), the isometry also describes covariances. If \(H_j\) are predictable and the integrals are square-integrable, then

$$ \operatorname{Cov}\left(\int_0^\tau H_j\,dM_j,\int_0^\tau H_k\,dM_k\right) = E\left[\int_0^\tau H_j(u)H_k(u)\,d\langle M_j,M_k\rangle(u)\right]. $$

Here \(\langle M_j,M_k\rangle\) is the predictable covariation, the predictable compensator of the joint quadratic variation. For distinct event types that cannot jump simultaneously, with continuous compensators, this cross predictable variation is zero. Their martingale integrals are then uncorrelated, though that statement alone does not assert independence. If simultaneous jumps are possible, the cross term must be considered rather than discarded.

Checks, Failure Modes, and Alternatives

Before using the isometry, verify that the process being compensated is a martingale under the stated information and intensity model; that the weight is predictable; and that the expected weighted predictable variation is finite. For a risk-set weight, also check that the weight is only used where the risk set is positive. A formula may be algebraically correct but still describe the wrong variance if any of these conditions fails.

A useful distinction is between predictable variation and realized quadratic variation. For a simple counting-process martingale, the realized quadratic variation of the unweighted martingale is the observed count \(N(\tau)\), whereas the predictable variation is its compensator \(A(\tau)\). For a weighted integral, the realized quadratic variation is \(\int H^2\,dN\); the predictable variation is \(\int H^2\,dA\). The former is observable from the path, while the isometry expresses the sampling variance as the expectation of the latter. In some settings the realized quantity can serve as a data-based estimate of variation, but it is not the identity that derives the variance.

Another route in simple models is to calculate the variance directly from a known count distribution or independent increments. The isometry is more general: it handles predictable weights and random risk sets without requiring a closed-form distribution for the full count. It is still model-dependent, because the compensator must correctly represent the event intensity. If that intensity or the filtration is misspecified, the resulting variance need not describe the actual sampling variation.

Common warning signs include a weight that uses whether an event occurs at the same time it is applied, a zero risk set in a denominator, or an infinite or undefined expected value of \(\int H^2\,dA\). In these cases the standard finite-variance result cannot simply be invoked. If the expected variation is infinite, the integral may still be defined under weaker local conditions, but this formula does not establish that it has a finite variance.

Common mistake: “The variance is \(\int H^2\,dA\) evaluated on this observed path.” That treats a random predictable variation as if it were the variance itself. The correction is \(\operatorname{Var}(\int H\,dM)=E[\int H^2\,dA]\), under the martingale and integrability conditions. The observed path's \(\int H^2\,dN\) is a different quantity.
Key takeaway: For a square-integrable predictable weight and a unit-jump counting-process martingale with continuous compensator, the variance of the weighted compensated count is the expected integral of the squared weight against the compensator.

Check Your Understanding

Answer each question, then compare your work with the solutions below.

  1. A Poisson counting process has intensity 2 events per hour for 3 hours. For \(H(t)=3\), calculate the variance of \(\int_0^3 H\,dM\).
  2. A process has intensity \(Y(t)\lambda(t)\), with constant \(Y=4\), constant \(\lambda=0.5\) per hour, and \(H=1/Y\) over 2 hours. Calculate the variance.
  3. Why is a weight that depends on whether an event occurs at time \(t\) generally not a permissible predictable integrand at that time?
  4. For two distinct event types that cannot jump simultaneously and have continuous compensators, what is the covariance of their square-integrable predictable martingale integrals?

Solutions. (1) The isometry gives \(E[\int_0^3 3^2(2)\,du]=9\times2\times3=54\) squared weighted-count units. (2) The variance is \(\int_0^2 (1/4)^2(4)(0.5)\,du=2(0.125)=0.25\) squared weighted-count units. (3) Predictability requires the weight at time \(t\) to be determined by information immediately before \(t\); using the event at \(t\) incorporates the increment being weighted and generally violates that condition. (4) Their cross predictable variation is zero under the stated assumptions, so the covariance is zero. They are uncorrelated; zero covariance does not by itself imply independence.

Clinical Biostats