Verifying Thiele Reserves Against Prospective Values

Why Verify a Thiele Reserve?

A solution to Thiele’s differential equations is a reserve only if it represents the expected present value of the future cash flows under the model. Solving the equations backward is one way to obtain that value; conditioning on the next transition provides a direct interpretation and an independent check. The connection is especially useful in a multi-state model, where an incorrect transition benefit, sign, or boundary condition can produce a plausible-looking but incorrect reserve path.

The setup below uses a finite-state, continuous-time Markov model over a fixed term $[0,T]$. Transition intensities and the force of interest may vary with time. Cash flows are valued from the time at which the reserve is calculated, and all continuous cash flows are assumed to be integrable over the term.

Definition: Let $J_t$ denote the state occupied at time $t$. In state $i$, let $c_i(t)$ be the rate of continuous net outgo, taken as positive for payments by the insurer and negative for income such as premiums. For a transition from $i$ to $j$, let $b_{ij}(t)$ be the lump-sum net outgo paid at the transition, positive for an insurer payment. Let $G_i$ be the net outgo paid at time $T$ if the process is in state $i$. The prospective reserve $V_i(t)$ is the expected present value, at time $t$, of all future net outgo conditional on $J_t=i$.

Write $q_{ij}(t)$ for the transition intensity from $i$ to $j$, for $i\ne j$, and let $\lambda_i(t)=\sum_{j\ne i}q_{ij}(t)$ be the total intensity of leaving state $i$. The force of interest at time $t$ is $\delta(t)$. A transition benefit is included once, in $b_{ij}(t)$; the value $V_j(t)$ represents the future cash flows after entering the destination state.

The Thiele Equation and Its Prospective Meaning

With these conventions, the reserve satisfies a terminal-value system: its value is specified at $T$, then the equations are solved backward in time. For each state $i$,

V_i(T)=G_i,\qquad \frac{dV_i(t)}{dt} = \delta(t)V_i(t)-c_i(t) -\sum_{j\ne i}q_{ij}(t)\bigl(b_{ij}(t)+V_j(t)-V_i(t)\bigr).

The term $b_{ij}+V_j-V_i$ is the change in the insurer’s expected liability associated with a transition: the transition payment plus the destination reserve, less the reserve that would have applied if the process had remained in state $i$. The continuous outgo enters with a minus sign because it is paid out during the upcoming interval, reducing the reserve needed at the start of that interval.

First-transition representation: Conditional on being in state $i$ at time $t$, the prospective value can be written $$ V_i(t)= \int_t^T e^{-\int_t^s(\delta(u)+\lambda_i(u))\,du} \left[c_i(s)+\sum_{j\ne i}q_{ij}(s)\bigl(b_{ij}(s)+V_j(s)\bigr)\right]ds + e^{-\int_t^T(\delta(u)+\lambda_i(u))\,du}G_i. $$ The integral accounts for cash flows while still in state $i$, and for a first transition at time $s$. The final term accounts for reaching $T$ without leaving state $i$.

This representation is a conditioning identity, not an assumption that the process can transition only once. It conditions on the first transition after time $t$. After that transition, the future value is $V_j(s)$, which itself includes the possibility of any subsequent transitions.

Why the Differential Equation Holds

A short-interval argument shows how the first-transition representation leads to the Thiele equation. Suppose the process is in state $i$ at time $t$, and consider a small interval of length $h$. Up to terms that are negligible relative to $h$, the probability of a transition to state $j$ is $q_{ij}(t)h$, and the probability of no transition is $1-\lambda_i(t)h$. The continuous outgo over the interval is $c_i(t)h$. Discounting the value at the end of the interval to time $t$ gives

V_i(t)=c_i(t)h+ \bigl(1-\delta(t)h\bigr) \left[ \bigl(1-\lambda_i(t)h\bigr)V_i(t+h) +\sum_{j\ne i}q_{ij}(t)h\bigl(b_{ij}(t)+V_j(t+h)\bigr) \right]+o(h).

Expand $V_i(t+h)=V_i(t)+V_i'(t)h+o(h)$ and $V_j(t+h)=V_j(t)+o(1)$. Products of two terms of order $h$ are of order $h^2$ and disappear after division by $h$ and passage to the limit. Equating the coefficients of $h$ yields

0=c_i(t)+V_i'(t)-\delta(t)V_i(t) +\sum_{j\ne i}q_{ij}(t)\bigl(b_{ij}(t)+V_j(t)-V_i(t)\bigr),

which rearranges to the stated Thiele equation. The terminal condition follows directly from the definition: at $T$, only the cash flow $G_i$ remains due under the stated model.

The argument also explains the backward direction of solution. The value at $t$ depends on values just after $t$, while the known boundary values are at $T$. When the coefficients are suitably integrable and the transition intensities are bounded on the finite term, this linear terminal-value system has a unique solution. Consequently, if a proposed solution satisfies the equations and terminal conditions, it agrees with the prospective reserve. Direct calculation of the expected present value is a useful independent verification of that match.

Worked Verification Examples

Worked Example: Continuous Outgo in a Single State

A hypothetical one-state contract runs for one year. The insurer pays continuous net outgo at the rate of $100 per year, and there is no terminal payment. The effective annual interest rate is $i=1.00$, so the constant force is $\delta=\ln(1+i)=\ln 2$. Find the reserve at time 0 from the prospective definition and verify it using Thiele’s equation.

Prospective method. The continuous payment made at time $s$ is discounted by $e^{-\delta s}$. Thus

V(0)=\int_0^1 100e^{-(\ln 2)s}\,ds =\frac{100}{\ln 2}\left(1-e^{-\ln 2}\right) =\frac{50}{\ln 2} =72.1348\ldots.

To verify with the differential equation, there are no transitions and $G=0$. Therefore $V'(t)=(\ln 2)V(t)-100$, with $V(1)=0$. Solving backward gives

V(t)=\frac{100}{\ln 2}\left(1-e^{-(\ln 2)(1-t)}\right).

At $t=0$, this gives $V(0)=50/\ln 2$, exactly the prospective value. Rounded to the nearest cent, the reserve is $72.13. The method is direct integration of discounted continuous outgo; it avoids treating an annual payment rate as a single payment at the start or end of the year.

Worked Example: A Transition Benefit Followed by Disability Outgo

A hypothetical policy has an active state $A$ and a disabled state $D$. The only transition is $A\to D$, at constant intensity $\lambda=\ln 2$ per year. The term is one year and the constant force of interest is also $\delta=\ln 2$, corresponding to effective annual rate $i=1.00$. At transition, the insurer pays $40. While disabled, it pays continuous outgo of $20 per year. There is no continuous outgo while active and no terminal payment. Calculate $V_A(0)$ and check it using the first-transition representation.

First calculate the reserve in state $D$. There are no further transitions, so for $0\le t\le1$,

V_D(t)=\int_t^1 20e^{-(\ln 2)(s-t)}\,ds =\frac{20}{\ln 2}\left(1-e^{-(\ln 2)(1-t)}\right).

From state $A$, the first transition has density $\lambda e^{-\lambda s}$. Discounting to time 0 and including both the transition payment and the subsequent disabled-state reserve gives

V_A(0)=\int_0^1 e^{-(\ln 2)s}(\ln 2)e^{-(\ln 2)s} \bigl(40+V_D(s)\bigr)\,ds.

The transition-payment part is

40\ln 2\int_0^1e^{-2(\ln 2)s}\,ds =40\ln 2\cdot\frac{1-\tfrac14}{2\ln 2} =15.

For the disabled-state outgo part, substitute the expression for $V_D(s)$:

\begin{aligned} \int_0^1e^{-(\ln 2)s}(\ln 2)e^{-(\ln 2)s}V_D(s)\,ds &=20\int_0^1 e^{-(\ln 2)s} \left(e^{-(\ln 2)s}-\frac12\right)ds\\ &=20\left(\frac{3}{8\ln 2}-\frac{1}{4\ln 2}\right) =\frac{2.5}{\ln 2} =3.6067\ldots. \end{aligned}

The total is $V_A(0)=15+3.6067\ldots=18.6067\ldots$, or $18.61 to the nearest cent. This calculation checks the Thiele reserve by integrating over the first-transition time. A common error is to include the $40 transition benefit but omit $V_D(s)$, thereby leaving out the future payments after disability begins.

Worked Example: Distinct Terminal Values and a Transition Payment

A hypothetical two-state contract has states $A$ and $B$, with a single possible transition $A\to B$ at constant intensity $\lambda=\ln 2$. The term is one year, the force of interest is $\delta=\ln 2$, and there are no continuous payments. A $10 payment is made on transition. At time 1, the terminal payment is $100 in state $A$ and $40 in state $B$. Find the prospective reserve in state $A$ at time 0 and verify it using the differential equations.

In state $B$, no further transition is possible, so its reserve is just the discounted terminal payment:

V_B(t)=40e^{-(\ln 2)(1-t)}.

For the active state, the equation and terminal condition are

V_A'(t)=2(\ln 2)V_A(t)-(\ln 2)\bigl(10+V_B(t)\bigr), \qquad V_A(1)=100.

The prospective calculation separates three mutually exclusive contributions. First, the probability of no transition by time 1 is $e^{-\lambda}=1/2$; the discount factor to time 1 is also $1/2$. The expected present value of the state-$A$ terminal payment is therefore

100\cdot\frac12\cdot\frac12=25.

Second, the probability of a transition by time 1 is $1-e^{-\lambda}=1/2$. The state-$B$ terminal payment is discounted by $1/2$, giving

40\cdot\frac12\cdot\frac12=10.

Third, the expected present value of the transition payment is

10\int_0^1(\ln 2)e^{-2(\ln 2)s}\,ds =10\cdot\frac{3}{8} =3.75.

Thus $V_A(0)=25+10+3.75=\mathbf{38.75}$. The differential-equation representation gives the same decomposition: a no-transition terminal term $e^{-2\ln 2}100=25$, plus the first-transition integral of $(\ln 2)e^{-2(\ln 2)s}(10+V_B(s))$, whose two parts are $3.75 and $10. The check avoids confusing the terminal payment in state $B$ with a payment made at the transition time.

Checks That Matter in Practice

A Thiele reserve should pass more than a numerical spot check. Confirm that the model and calculation use the same timing and cash-flow definitions. In particular, the transition intensity is a rate per unit of time, while a transition probability over a finite interval is not generally equal to that intensity times the interval except as a small-interval approximation. Also confirm that the terminal value applies to the state occupied at $T$, and that a transition payment is included at the transition rather than at the end of the term.

The cash-flow sign convention is a frequent source of errors. In this tutorial, $c_i(t)$ is positive for insurer outgo. If there are no transitions, the equation is $V_i'=\delta V_i-c_i$. For example, in the first worked example, changing this to $V'=\delta V+100$ while keeping $V(1)=0$ gives $V(0)=-50/\ln 2$, a negative value for a stream of positive payments. That result contradicts the prospective integral and signals the sign error. If premiums are represented as income, they enter as negative net outgo; they should not be added as positive insurer payments.

For a proposed reserve vector, useful verification steps are:

Check the boundary values.
At $T$, verify $V_i(T)=G_i$ for each state, including states that are absorbing before $T$.

Check the cash-flow convention.
Confirm that continuous outgo, premium income, and each transition payment have the signs and timing used in the model.

Check a prospective value.
Condition on the first transition and calculate the expected present value from at least one state and time where the arithmetic is manageable.

Check the differential equation.
Substitute the proposed reserve functions into the Thiele system and confirm that the terminal conditions also hold.

The differential equation is valuable because it gives the reserve path at every time and state. The prospective definition is valuable because it makes the cash flows being valued explicit. Their agreement is not an extra modelling assumption: it follows from conditioning under the same transition, interest, and payment assumptions. If the two calculations disagree, inspect the model specification, signs, transition timing, and terminal conditions before attributing the discrepancy to numerical error. This is a core verification skill aligned with the SOA Exam ALTAM (Advanced Long-Term Actuarial Mathematics) syllabus.

Check Your Understanding

For each problem, use the stated outgo convention and verify the reserve using a prospective calculation.

A one-state contract pays continuous outgo of $105 per year for one year, with no terminal payment. The effective annual interest rate is $i=0.05$. Find the reserve at time 0. (Answer: $102.48)
In a two-state model, $A\to B$ has constant intensity $0.4$ per year over two years. The force of interest is $0.1$. There is a $30 transition payment, and a $50 terminal payment if the process is in $B$ at time 2; there are no other payments. Find $V_A(0)$, rounded to cents. (Answer: $37.71)
A one-state contract has constant force of interest $0.04$, continuous outgo of $30 per year for two years, and no terminal payment. State the Thiele equation and calculate $V(0)$, rounded to cents. (Answer: $V'=0.04V-30$; $V(0)=\$57.66$)
From state $A$, a process can transition once to $B$ at intensity $0.2$ per year over one year. The force of interest is $\ln 2$. There are no continuous payments; the transition payment is $5, and terminal payments are $20 in $A$ and $40 in $B$. Find $V_A(0)$, rounded to cents. (Answer: $12.47)
A proposed one-state reserve for constant continuous outgo $c>0$, force of interest $\delta$, and zero terminal value is said to satisfy $V'=\delta V+c$. Identify the sign error and state the correct reserve at time $t$ for a term ending at $T$. (Answer: The outgo sign is wrong; $V'=\delta V-c$ and $V(t)=\frac{c}{\delta}(1-e^{-\delta(T-t)})$ for $\delta\ne0$.)

What You'll Learn