Observed Experience And Complementary Information

Introduction

A segment’s own claim experience is directly relevant to its expected cost, but it may also be uneven because it comes from a limited set of observations. Broader or otherwise related information can provide context. The central judgment is not simply whether more data are available; it is whether the additional information tells us something useful about the segment being assessed.

This tutorial distinguishes observed experience, which comes from the segment itself, from complementary information, which supplies a reference point or additional evidence. Both sources have a role in a credibility assessment, but they answer different questions. The exact calculation used to combine them is a separate step.

Definition: Observed experience is the claim or loss information recorded for the particular segment whose expected cost is being estimated. Complementary information is additional information used as a reference or source of evidence for that estimate, such as experience from a broader portfolio, a related group, a prior period, or a prospective expectation. A complement is relevant only to the extent that it is appropriate for the segment and the measure being estimated.

What Each Source Contributes

Observed experience has a direct connection to the segment: it reflects the claims that actually occurred for that group. It may reveal segment-specific features that a broad portfolio average would conceal. For example, the segment may have a different mix of vehicles, geographic areas, coverage limits, or insured activities than the rest of the portfolio.

At the same time, an observed result is not automatically a stable estimate of what the segment will experience in the future. A small number of claims, a short observation period, or an unusually large claim can make the recorded result differ substantially from the segment’s underlying expected cost. That difference may be random fluctuation rather than a lasting change in risk.

Complementary information provides context for interpreting the observed result. A suitably chosen complement can indicate the broader level of expected cost, offer evidence when the segment’s own data are limited, or help distinguish a segment-specific pattern from a portfolio-wide change. It does not automatically replace the segment’s experience: a broad average may conceal real differences between the segment and the broader group.

For a comparison to be meaningful, the sources should refer to compatible measures. Before interpreting a difference, check that the experience periods, coverage, loss basis, exposure definition, and adjustment basis are aligned. A difference caused by inconsistent definitions is not evidence of a difference in underlying risk.

Key distinction: Observed experience answers, “What happened in this segment?” Complementary information answers, “What other evidence or reference point helps interpret that result?” A useful complement should be relevant to the segment, not merely large or convenient.

Why a Complement Can Help

A simple representation explains why these sources have different roles. Suppose the segment’s observed rate can be written as its underlying expected rate plus random fluctuation. A related group’s rate can be represented as a shared level, a difference between that group and the target segment, and its own fluctuation:

R_{\text{segment}} = \theta_{\text{segment}} + \varepsilon_{\text{segment}}, \qquad R_{\text{complement}} = \theta_{\text{segment}} + \Delta + \varepsilon_{\text{complement}}.

Here, $\theta_{\text{segment}}$ is the target segment’s underlying expected rate; $\varepsilon_{\text{segment}}$ and $\varepsilon_{\text{complement}}$ represent random variation in the recorded results; and $\Delta$ represents a structural difference between the complement and the target. This is a conceptual decomposition, not a claim that the values are known or that a particular statistical model has been fitted.

The complement can provide useful context when its structural difference, $\Delta$, is small enough for the comparison to be informative. If the complement is very different from the target segment, it may point to a different underlying level rather than clarify the target’s experience. A larger set of data may reduce the effect of random fluctuation in the complement, but it does not remove a mismatch in risk characteristics. Volume and relevance are separate questions.

This reasoning also shows why complementary information should not be described as “the correct rate” simply because it is broader. The segment’s own data may contain real evidence of a difference. The assessment must consider both sources and the reasons they may disagree; the later calculation determines how their evidence is reflected in an estimate.

Choosing a Relevant Complement

Possible complements include a parent portfolio, a neighboring class, a prior experience period, or a prospective expectation developed for the segment. The best choice depends on the question being asked and on which characteristics are shared. A complement should be examined for both its strengths and its limitations.

Parent portfolio: often offers a broad reference level, but may include risks unlike the target segment.
Related class or territory: may better match the target’s risk characteristics, but can have less experience of its own.
Prior period: may show the segment’s own history, but must be considered for changes in exposure, coverage, conditions, and level over time.
Prospective expectation: can incorporate information not fully represented in historical claims, but depends on the assumptions used to develop it.

A practical review starts by naming the target segment and the quantity to be estimated. Then it checks whether each source measures that quantity on a compatible basis. Finally, it asks what each source captures that the other may miss. This prevents a common shortcut: selecting whichever source has more observations without checking whether those observations apply to the target.

Define the target.
Specify the segment, period, coverage, loss measure, and exposure basis whose expected cost is being assessed.

Describe the observed experience.
State what the segment’s own record measures and note possible limitations, such as a short period or a small number of claims.

Evaluate candidate complements.
Check similarities and differences in risk mix, coverage, time period, and data basis. Identify what useful information each candidate adds.

Interpret disagreement before combining.
Consider whether the gap reflects random fluctuation, a structural difference, an adjustment mismatch, or some combination of these explanations.

Worked Examples

Worked Example: Comparing Segment Experience With a Portfolio Reference

A hypothetical insurer is reviewing the expected loss cost for a small group of specialty repair shops. The group has 16,000 earned exposure units and $448,000 of losses. A broader portfolio complement, excluding the target group, has 84,000 earned exposure units and $2,016,000 of losses. Both figures are already on the same coverage, period, and loss basis. Calculate the two observed rates and describe what each source contributes.

This is a comparison of hypothetical experience totals. No interest or mortality assumption is involved, and no parametric loss distribution is assumed.

Step 1: Calculate the target group’s rate. Divide the group’s losses by its exposure:

\frac{\$448{,}000}{16{,}000\text{ exposure units}} = \$28\text{ per exposure unit}.

Step 2: Calculate the complement’s rate.

\frac{\$2{,}016{,}000}{84{,}000\text{ exposure units}} = \$24\text{ per exposure unit}.

Step 3: Compare the results. The segment’s recorded rate is $ \$28-\$24=\$4 $ per exposure unit higher than the complement’s rate. The segment’s own result captures the experience of the repair shops; the complement supplies a broader reference level. The $4 difference does not, by itself, establish that the segment has a persistently higher expected cost. It could reflect a real difference, random variation, or another feature of the data that needs investigation.

Method and mistake avoided: Calculate both rates using the same loss-per-exposure definition, then interpret the difference in context. Comparing the raw loss totals, $448,000 and $2,016,000, would be misleading because the two sources have different exposure volumes.

Worked Example: Choosing Between a Broad and a Closely Matched Complement

A hypothetical insurer is reviewing the expected loss cost for a specialized local delivery-van class. The target class has 600 exposure units and $51,000 of losses. Two possible complements are available: a national fleet portfolio with 42,000 exposure units and $2,520,000 of losses, and a related local commercial-delivery group with 6,000 exposure units and $450,000 of losses. The national portfolio includes several vehicle uses and coverages that are not part of the target class. The related local group is closer in coverage and geography. Calculate the rates and identify the more informative complement, explaining the basis for the choice.

The data are hypothetical experience summaries on a common loss-per-exposure basis. No interest or mortality assumption is involved, and no parametric loss distribution is assumed.

Step 1: Calculate the target rate.

\frac{\$51{,}000}{600\text{ exposure units}} = \$85\text{ per exposure unit}.

Step 2: Calculate the national portfolio rate.

\frac{\$2{,}520{,}000}{42{,}000\text{ exposure units}} = \$60\text{ per exposure unit}.

Step 3: Calculate the related local group rate.

\frac{\$450{,}000}{6{,}000\text{ exposure units}} = \$75\text{ per exposure unit}.

Step 4: Assess relevance. The national portfolio gives a broad reference, but its different vehicle uses and coverages make it less directly comparable. The related local group’s rate of $75 is based on a smaller volume, but it is closer to the target in coverage and geography. On the facts given, the related local group is the more informative complement; the national portfolio can still provide broader context.

Method and mistake avoided: Choose a complement by considering both its size and its similarity to the target. Automatically selecting the largest pool would favor the national portfolio while ignoring the stated differences in risk and coverage.

Worked Example: Aggregating Unequal Years of Segment Experience

A hypothetical specialty class has the following experience, already adjusted to a common coverage and period basis: in Year 1, 3,000 exposure units and $90,000 of losses; in Year 2, 1,000 exposure units and $50,000 of losses. A related portfolio complement has 160,000 exposure units and $5,120,000 of losses. Calculate the segment’s aggregate observed rate and the complement’s rate, then explain what the annual results reveal.

These are hypothetical, adjusted experience figures. No interest or mortality assumption is involved, and no parametric loss distribution is assumed.

Step 1: Calculate each year’s segment rate.

\text{Year 1 rate} = \frac{\$90{,}000}{3{,}000} = \$30\text{ per exposure unit}, \qquad \text{Year 2 rate} = \frac{\$50{,}000}{1{,}000} = \$50\text{ per exposure unit}.

Step 2: Aggregate the segment totals. Total losses are $ \$90{,}000+\$50{,}000=\$140{,}000 $, and total exposure is $3{,}000+1{,}000=4{,}000$ units. Therefore:

\frac{\$140{,}000}{4{,}000\text{ exposure units}} = \$35\text{ per exposure unit}.

Step 3: Calculate the complement’s rate.

\frac{\$5{,}120{,}000}{160{,}000\text{ exposure units}} = \$32\text{ per exposure unit}.

The aggregate segment rate is $35, compared with $32 for the complement. The segment’s own result preserves its specific experience, while the complement supplies a related portfolio reference. The annual rates also show that the smaller-exposure second year had a higher recorded rate. That fact is worth investigating, but it does not alone demonstrate a lasting increase in the segment’s expected cost.

Method and mistake avoided: Aggregate losses and exposure before calculating the segment’s overall rate. Taking the unweighted average of the annual rates gives $(\$30+\$50)/2=\$40$, which is not the rate for the combined experience. The correct rate is $35 because the years have unequal exposure.

Common Mistakes and Exam Traps

A credibility assessment can be misdirected before any combining calculation begins. The following checks help keep the interpretation grounded in what the data actually measure.

Treating the complement as automatically correct. A broad portfolio rate may not represent a specialized segment. Explain why the risks are comparable before treating it as a useful reference.
Assuming a large complement is necessarily relevant. A high-volume group with different coverage or risk mix can be less informative than a smaller, closely matched group.
Comparing incompatible quantities. Loss totals, rates per exposure, and claim severities answer different questions. Make sure both sources measure the same quantity before comparing them.
Ignoring time and basis differences. If the periods, coverage, or loss adjustments differ, a rate gap may reflect those differences rather than the risks being compared.
Reading a high segment result as proof of a structural difference. Observed experience includes both information about underlying risk and random fluctuation. A difference deserves investigation, not an automatic conclusion.
Calling every other data source a good complement. A source contributes only if its relationship to the target is defensible. State both what it contributes and what may make it imperfect.

Key takeaway: Observed experience supplies direct evidence about the target segment; complementary information supplies context or additional evidence. A sound assessment identifies what each source measures, checks that the basis is comparable, and considers structural differences before deciding how the evidence should inform the estimate.

Check Your Understanding

For each hypothetical case, identify the relevant source contribution or calculate the requested rate. Use the stated exposure basis and explain the comparison where asked.

A hypothetical class has $126,000 in losses over 4,200 exposure units. A related portfolio has $720,000 in losses over 30,000 exposure units. Calculate both rates per exposure unit and state which is the segment’s observed experience. (Answer: Segment rate $30; complement rate $24 per exposure unit; the segment’s $126,000 and 4,200 units are its observed experience.)
A target class has 200 exposure units and $18,000 in losses. A broad complement has 50,000 exposure units and $2,500,000 in losses, but includes a different coverage not present in the target. Calculate both rates and identify the key limitation on the comparison. (Answer: Target rate $90; complement rate $50 per exposure unit; the coverage difference limits the complement’s comparability.)
A segment has 2,000 exposure units and $64,000 in losses in one year, then 500 exposure units and $22,500 in losses the next year. Calculate the aggregate rate across both years. (Answer: $86,500 divided by 2,500, or $34.60 per exposure unit.)
A target segment’s rate is $42 per exposure unit. A broad portfolio rate is $29, but the portfolio includes several unrelated types of risks. A smaller related group’s rate is $37 and it shares the target’s coverage and territory. Which complement is more directly relevant, and why? (Answer: The related group at $37 is more directly relevant because its coverage and territory match the target more closely; the broad portfolio may still provide context.)
A segment and a potential complement both report losses per exposure unit, but the segment’s data are on a current coverage basis and the complement’s are on an older, narrower coverage basis. Is the raw rate difference enough to conclude that the segment has a different expected cost? (Answer: No; the measures are not on a comparable coverage basis, so align the basis before interpreting the difference.)

What You'll Learn