Why Transitions Affect the Reserve Derivative
In a multi-state model, the reserve depends on the policyholder’s current state. A transition changes that state and therefore changes the liability represented by the reserve. If a transition also triggers an immediate benefit, that payment changes the liability at the same moment. Thiele’s equation accounts for both effects through a transition term for each possible destination state.
The key is to keep two related quantities distinct. At a transition from state \(i\) to state \(j\), the insurer’s liability changes by the destination reserve plus the transition payment, less the reserve just before the transition. The contribution of this expected jump to the derivative of a prospective reserve has the opposite sign.
Assume that the state process is a continuous-time Markov chain, with transition intensities and cash-flow rates specified by the current state and time. Assume also that the reserve functions are differentiable and that simultaneous transitions have probability \(o(h)\) over a short interval of length \(h\). Write \(g_i(t)\) for the continuous net outgo rate in state \(i\): continuous benefits and expenses less continuous premium income. Thus \(g_i\) is positive when, on balance, money flows out of the insurer.
Under these conventions, the transition contribution to the reserve derivative is \(\mu_{ij}(t)\bigl(V_i(t)-V_j(t)-b_{ij}(t)\bigr)\). It is the transition intensity multiplied by the current reserve minus the destination reserve and immediate transition benefit.
Deriving the Transition Term
Consider a short interval from \(t\) to \(t+h\), starting in state \(i\). Let \(\lambda_i(t)=\sum_{j\ne i}\mu_{ij}(t)\) be the total intensity of leaving state \(i\). Over this interval, the probability of remaining in \(i\) is \(1-\lambda_i(t)h+o(h)\), and the probability of moving to \(j\) is \(\mu_{ij}(t)h+o(h)\).
The reserve at time \(t\) equals the discounted expected value of the net outgo during the interval and the reserve at its end, including any transition benefit. Expanding this short-interval balance to first order gives the following derivation.
With force of interest \(\delta(t)\), the discount factor over the interval is \(1-\delta(t)h+o(h)\). The expected end-of-interval amount, before discounting, is \((1-\lambda_i h)\bigl(V_i(t+h)+g_i h\bigr)+\sum_{j\ne i}\mu_{ij}h\bigl(b_{ij}+V_j(t+h)\bigr)+o(h)\). Time arguments are suppressed within this expansion.
Use \(V_k(t+h)=V_k(t)+V_k'(t)h+o(h)\) for each state \(k\). Products of two terms of order \(h\) are \(o(h)\) and do not affect the first-order balance.
After discounting and expanding, the coefficient of \(h\) on the right side of the balance is \(g_i+V_i'-\delta V_i+\sum_{j\ne i}\mu_{ij}(b_{ij}+V_j-V_i)\). The left side is \(V_i(t)\), so this coefficient must equal zero.
The transition part can equivalently be written as \(-\sum_{j\ne i}\mu_{ij}(t)\bigl(b_{ij}(t)+V_j(t)-V_i(t)\bigr)\). The expression inside the parentheses is the insurer’s liability jump at a transition: pay \(b_{ij}\), then replace the current-state reserve \(V_i\) by the destination-state reserve \(V_j\). The negative sign arises because Thiele’s equation describes how the reserve changes with time, not the jump in liability when a transition occurs.
The equation uses the prospective-reserve convention: reserves are future outgo less future income. That is why the continuous net outgo rate enters as \(-g_i\). If premiums exceed benefits and expenses in state \(i\), then \(g_i<0\), so \(-g_i\) increases the reserve derivative. If there are no transitions out of a state, its transition sum is zero. The equation does not by itself specify a reserve at a terminal time; that requires an appropriate terminal condition.
Worked Applications
In each example, intensities are annual rates under a continuous-time Markov model. A constant intensity corresponds to an exponential holding time while in the state. All reserves and transition benefits are measured at the stated time; the calculations find an instantaneous reserve derivative, not a reserve over a full year.
Worked Example: A Transition to a Higher-Reserve State
A hypothetical contract has states \(A\) and \(B\), with only a transition from \(A\) to \(B\). At the valuation time, \(\delta=0.04\), \(V_A=1{,}000\), and \(V_B=1{,}400\) dollars. The constant transition intensity is \(\mu_{AB}=0.10\) per year. A benefit of \(b_{AB}=50\) dollars is paid on transition. In state \(A\), the annual continuous premium is 30 dollars, the continuous expense rate is 10 dollars, and the continuous benefit rate is zero. Find \(V_A'\).
Method. First find the continuous net outgo rate. Premium is income, so \(g_A=0+10-30=-20\) dollars per year.
The interest contribution is \(\delta V_A=0.04(1{,}000)=40\) dollars per year.
The transition contribution is \(\mu_{AB}(V_A-V_B-b_{AB})=0.10(1{,}000-1{,}400-50)=0.10(-450)=-45\) dollars per year.
Therefore, \(V_A'=40-(-20)-45=15\) dollars per year. The reserve is increasing at this instant despite the transition to a state with a higher reserve, because premium income more than offsets the continuous outgo and the transition effect.
Check. The liability jump on transition is \(50+1{,}400-1{,}000=450\) dollars. Its intensity-weighted expected jump is \(0.10(450)=45\) dollars per year, so its contribution to the reserve derivative is \(-45\), as used. A common mistake is to add \(+45\) directly to the derivative; that would give \(105\), reversing the transition effect.
Worked Example: Two Destinations, Including Death
A hypothetical policyholder in state \(H\) can move to state \(L\) or die, state \(D\). At the valuation time, the force of interest is \(\delta=0.03\). The reserves are \(V_H=500\), \(V_L=900\), and \(V_D=0\) dollars. The constant intensities are \(\mu_{HL}=0.08\) and \(\mu_{HD}=0.02\) per year. Transition benefits are \(b_{HL}=100\) dollars and \(b_{HD}=200\) dollars. In \(H\), the continuous premium, expense, and benefit rates are 60, 10, and 5 dollars per year, respectively. Find \(V_H'\).
Method. The continuous net outgo rate is \(g_H=10+5-60=-45\) dollars per year. The interest contribution is \(\delta V_H=0.03(500)=15\) dollars per year.
For the transition to \(L\), the contribution is \(0.08(500-900-100)=0.08(-500)=-40\) dollars per year. For the transition to \(D\), it is \(0.02(500-0-200)=0.02(300)=6\) dollars per year.
The total transition contribution is \(-40+6=-34\) dollars per year. Hence \(V_H'=15-(-45)-34=26\) dollars per year.
Check. The liability jumps are \(100+900-500=500\) dollars on \(H\to L\), and \(200+0-500=-300\) dollars on \(H\to D\). Their intensity-weighted sum is \(0.08(500)+0.02(-300)=40-6=34\) dollars per year. Negating that sum gives the reserve-derivative contribution \(-34\). The negative jump on death reflects that the death payment is less than the reserve released when the contract terminates.
Worked Example: Recovery and Death From a Care State
A hypothetical long-term care contract has a care state \(C\), with transitions to a recovery state \(R\) and a death state \(D\). At the valuation time, \(\delta=0.05\), \(V_C=1{,}200\), \(V_R=800\), and \(V_D=0\) dollars. The constant intensities are \(\mu_{CR}=0.12\) and \(\mu_{CD}=0.03\) per year. A transition benefit of 75 dollars is paid on recovery and 300 dollars on death. In state \(C\), the continuous benefit and expense rates are 30 and 5 dollars per year, and there is no premium. Find \(V_C'\).
Method. The continuous net outgo rate is \(g_C=30+5-0=35\) dollars per year. The interest contribution is \(0.05(1{,}200)=60\) dollars per year.
The recovery contribution is \(0.12(1{,}200-800-75)=0.12(325)=39\) dollars per year. The death contribution is \(0.03(1{,}200-0-300)=0.03(900)=27\) dollars per year.
The total transition contribution is \(39+27=66\) dollars per year. Thus \(V_C'=60-35+66=91\) dollars per year.
Check. On recovery, the liability jump is \(75+800-1{,}200=-325\) dollars; its expected jump per year is \(0.12(-325)=-39\). On death, the liability jump is \(300+0-1{,}200=-900\); its expected jump per year is \(0.03(-900)=-27\). The derivative includes the negatives of those expected jumps, \(39+27=66\), agreeing with the calculation. In particular, omitting the transition benefits would incorrectly give a recovery contribution of \(0.12(1{,}200-800)=48\) and a death contribution of \(0.03(1{,}200)=36\).
Common Sign and Accounting Traps
The most frequent error is to confuse the liability jump with its contribution to the reserve derivative. For a transition \(i\to j\), calculate the jump first: \[ \text{liability jump}=b_{ij}+V_j-V_i. \] Then its contribution to \(V_i'\) is the negative of the intensity-weighted jump: \[ -\mu_{ij}(b_{ij}+V_j-V_i)=\mu_{ij}(V_i-V_j-b_{ij}). \] This two-step check makes the sign convention visible rather than relying on memorization.
- Omitting the immediate benefit. The destination reserve alone is not the full post-transition liability. Include \(b_{ij}\), with positive values for insurer outgo.
- Using only one destination. Every possible exit from state \(i\) contributes its own intensity-weighted term. A death transition is included just like recovery or disability transitions.
- Reversing the reserve difference. The derivative term is current reserve minus destination reserve and transition benefit. Destination reserve plus benefit minus current reserve is the liability jump, not the derivative contribution.
- Mixing time units. The transition intensity must use the same time unit as \(V_i'\), the force of interest, and continuous cash-flow rates. If time is measured in years, all these rates must be per year.
This transition accounting matters in product profit analysis because state-specific reserves feed into projected profit and reserve changes. A correct transition term captures both the probability of leaving the current state and the financial change conditional on each destination. It also provides a useful diagnostic: if the destination liability plus immediate payment is greater than the current reserve, the liability jump is positive and the corresponding contribution to the current-state reserve derivative is negative.
These equations are aligned with the SOA Exam ALTAM (Advanced Long-Term Actuarial Mathematics) syllabus. In a calculation, state the reserve convention, the sign of transition payments, and the time unit before substituting values. That makes the transition term auditable even when a model has several states and different benefits on each transition.
Check Your Understanding
For each problem, use the prospective-reserve convention and report the instantaneous reserve derivative in dollars per year.
- A hypothetical contract is in state \(A\), with \(\delta=0.02\), \(V_A=600\), and a single transition to \(B\) with intensity \(0.05\). Let \(V_B=900\), and let the transition benefit be 40 dollars. In \(A\), continuous expenses and benefits are 8 and 2 dollars per year, and the premium is 30 dollars per year. Find \(V_A'\). (Answer: 15 dollars per year)
- In state \(H\), a contract has \(\delta=0.04\), reserve \(V_H=1{,}000\), and continuous net outgo \(g_H=12\) dollars per year. Transitions are to \(L\) and \(D\), with \((\mu_{HL},V_L,b_{HL})=(0.10,700,50)\) and \((\mu_{HD},V_D,b_{HD})=(0.02,0,250)\), where reserves and benefits are in dollars. Find \(V_H'\). (Answer: 68 dollars per year)
- A state has reserve \(V_i=800\), force of interest \(\delta=0.03\), continuous net outgo \(g_i=15\) dollars per year, and one transition to \(j\) with intensity \(\mu_{ij}=0.08\). If \(V_j=1{,}100\) and the observed derivative is \(V_i'=-20\) dollars per year, find the transition benefit \(b_{ij}\). (Answer: 62.50 dollars)
- A care state has reserve \(V_C=900\), \(\delta=0.05\), and \(g_C=20\) dollars per year. It has transitions to \(R\) and \(D\), with \((\mu_{CR},V_R,b_{CR})=(0.04,1{,}200,100)\) and \((\mu_{CD},V_D,b_{CD})=(0.01,0,300)\). Find \(V_C'\). (Answer: 15 dollars per year)
- For a transition with intensity \(0.06\), current reserve 1,500 dollars, destination reserve 1,000 dollars, and immediate benefit 200 dollars, calculate (a) the intensity-weighted liability jump and (b) the transition contribution to the reserve derivative. (Answer: (a) \(-18\) dollars per year; (b) \(18\) dollars per year)