Tutorials › CAS Exam 8 - Advanced Ratemaking › Dependence Between Periods In Credibility Data

CAS Exam 8 · Bühlmann-Straub Credibility · Tutorial 413 of 989

Dependence Between Periods In Credibility Data

Adjust Bühlmann-Straub weighted means and credibility for serial covariance, and identify when a weighted mean is no longer the optimal linear predictor.

Intermediate 11 min read

What You'll Learn

  • State the usual conditional independence assumption in Bühlmann-Straub credibility and distinguish it from zero conditional covariance.
  • Calculate the variance of a weighted mean when period results have nonzero conditional covariances.
  • Adjust a scalar credibility factor for the conditional variance of dependent experience.
  • Assess when exposure weights remain appropriate and when a covariance-aware linear estimator may be preferable.
  • Recognize how positive and negative serial covariance affect the effective information in a history.

Why Dependence Between Periods Matters

Bühlmann-Straub credibility uses repeated period results to estimate a risk’s expected result. Under the usual model, results from different periods are conditionally independent given the risk’s underlying mean. That assumption makes the conditional variance of an exposure-weighted average decrease in a simple way as total exposure grows. If period results are serially correlated, the same calculation generally understates or overstates the average’s process variance, and therefore changes the credibility assigned to the risk’s experience.

The issue is not simply whether periods are “related.” Statistical dependence is broader than covariance: dependent variables can have zero covariance. This tutorial focuses on the second-moment adjustment when conditional covariances are specified, and distinguishes that adjustment from the stronger question of conditional independence.

Definition: Let \(\Theta\) be a risk’s underlying expected result per exposure unit, and let \(X_j\) be its result in period \(j\), with exposure \(w_j>0\). The standard Bühlmann-Straub moment assumptions are \(E[X_j\mid\Theta]=\Theta\) and \(\operatorname{Var}(X_j\mid\Theta)=\phi/w_j\), where \(\phi>0\) is the process-variance parameter. The usual additional assumption is conditional independence across periods. A dependence-adjusted calculation replaces that independence assumption with a specified conditional covariance structure.

Write \(W=\sum_{j=1}^n w_j\). The exposure-weighted mean is \(\bar X_w=\sum_j w_jX_j/W\). Conditional on \(\Theta\), it still has mean \(\Theta\) whenever each period has conditional mean \(\Theta\), regardless of whether the periods are independent. Its variance, however, depends on all the conditional covariances:

$$ \operatorname{Var}(\bar X_w\mid\Theta) = \frac{1}{W^2} \left[ \sum_{j=1}^n w_j^2\operatorname{Var}(X_j\mid\Theta) + 2\sum_{j<k}w_jw_k\operatorname{Cov}(X_j,X_k\mid\Theta) \right]. $$

Using \(\operatorname{Var}(X_j\mid\Theta)=\phi/w_j\), this becomes

$$ \operatorname{Var}(\bar X_w\mid\Theta) = \frac{\phi}{W} + \frac{2}{W^2} \sum_{j<k}w_jw_k\operatorname{Cov}(X_j,X_k\mid\Theta). $$

The familiar \(\phi/W\) result follows when all the conditional covariances are zero. Conditional independence implies zero conditional covariance when the relevant moments exist, but the converse is not generally true. Thus, zero covariances recover this variance calculation without proving conditional independence.

Equal Exposures and Exchangeable Correlation

A useful special case has \(n\) equally exposed periods, with common conditional variance \(\sigma^2\), and the same conditional correlation \(\rho\) between every pair. This is an exchangeable second-moment structure. Since each pair’s conditional covariance is \(\rho\sigma^2\), the variance of the arithmetic mean is

$$ \operatorname{Var}(\bar X\mid\Theta) = \frac{\sigma^2}{n}\left[1+(n-1)\rho\right]. $$

For this exchangeable correlation matrix to be positive semidefinite, \(-1/(n-1)\leq\rho\leq1\). Positive correlation increases the variance relative to independent periods; negative correlation decreases it. The quantity \(n/[1+(n-1)\rho]\) can be read as an effective number of independent observations for this variance comparison, not as a general replacement for the actual data structure.

Worked Example: Variance of an Exchangeable Period Average

A hypothetical insurer records three equally exposed annual loss-cost results for one risk. Conditional on the risk’s expected loss cost, each result has variance \(9\), and each pair has conditional correlation \(0.20\). Find the conditional variance of the arithmetic mean and compare it with the independence calculation. No distributional form is assumed; only the stated conditional moments are used. Interest and mortality assumptions do not apply.

Method. Use the exchangeable variance formula with \(n=3\), \(\sigma^2=9\), and \(\rho=0.20\):

$$ \operatorname{Var}(\bar X\mid\Theta) = \frac{9}{3}\left[1+(3-1)(0.20)\right] = 3(1.40) = 4.20. $$

As a check from the covariance sum, each pair covariance is \(0.20(9)=1.80\). The sum of the three conditional variances is \(3(9)=27\), while twice the sum of the three pair covariances is \(2(3)(1.80)=10.80\). Therefore, the variance of the sum is \(27+10.80=37.80\), and the variance of the average is \(37.80/3^2=4.20\).

If independence were assumed, the variance would instead be \(9/3=3.00\). Here the common positive covariance adds \(1.20\) to the variance. The effective independent sample size for this comparison is \(9/4.20\approx2.1429\), less than the three actual periods. The common mistake is to divide the period variance by three while ignoring the pair covariances; that gives \(3.00\), not \(4.20\).

Effect on a Scalar Credibility Estimate

Suppose a scalar estimate is formed from the weighted mean. Let the collective mean be \(\mu=E[\Theta]\), with between-risk variance \(a=\operatorname{Var}(\Theta)\). Assume the conditional variance \(V=\operatorname{Var}(\bar X_w\mid\Theta)\) is constant across risks. The best linear predictor of \(\Theta\) based on this mean is \(\mu+Z(\bar X_w-\mu)\), where

$$ Z=\frac{a}{a+V}. $$

This result requires the stated moment assumptions; it does not require a normal distribution. It is a linear credibility result, not in general a statement that the full conditional distribution or posterior mean has this form.

1
Center the observed mean.
The prediction uses the deviation \(\bar X_w-\mu\) from the collective mean.
2
Calculate its total variance.
Since \(E[\bar X_w\mid\Theta]=\Theta\), the variance decomposition gives \(\operatorname{Var}(\bar X_w)=a+V\).
3
Calculate its covariance with the risk mean.
\(\operatorname{Cov}(\Theta,\bar X_w)=\operatorname{Cov}(\Theta,E[\bar X_w\mid\Theta])=a\).

For a linear predictor \(\mu+c(\bar X_w-\mu)\), minimizing mean squared error gives \(c=\operatorname{Cov}(\Theta,\bar X_w)/\operatorname{Var}(\bar X_w)\). Substituting the covariance \(a\) and total variance \(a+V\) yields \(Z=a/(a+V)\). This also explains why serial covariance matters: it changes \(V\), even though the conditional mean remains \(\Theta\).

Worked Example: Credibility with Positive Conditional Correlation

For a hypothetical risk class, the collective mean is \(6\) loss-cost units and the between-risk variance is \(0.12\). The risk has three equally exposed period results, each with conditional variance \(0.20\) and exchangeable conditional correlation \(0.25\). Its observed arithmetic mean is \(8\). Find the dependence-adjusted linear credibility estimate. No normality or other distributional assumption is made; interest and mortality assumptions do not apply.

Method. First calculate the conditional variance \(V\) of the period mean:

$$ V = \frac{0.20}{3}\left[1+(3-1)(0.25)\right] = \frac{0.20}{3}(1.50) = 0.10. $$

Then calculate credibility:

$$ Z = \frac{0.12}{0.12+0.10} = \frac{0.12}{0.22} = \frac{6}{11} \approx0.5455. $$

The estimate is

$$ 6+\frac{6}{11}(8-6) = 6+\frac{12}{11} = \frac{78}{11} \approx7.0909. $$

Thus the dependence-adjusted estimate is approximately \(7.0909\) loss-cost units. As a check, the result lies between the collective mean \(6\) and the observed mean \(8\), as it should for \(0<Z<1\). The common mistake is to treat the periods as independent: that gives \(V=0.20/3\approx0.0667\), \(Z\approx0.6429\), and an estimate of approximately \(7.2857\). Positive covariance makes the three observations less informative than that calculation assumes, so the corrected credibility is lower.

Unequal Exposures and the Limits of Exposure Weighting

The covariance-sum formula applies directly when exposures differ. If conditional correlations \(\rho_{jk}\) are specified, then \(\operatorname{Cov}(X_j,X_k\mid\Theta)=\rho_{jk}\sqrt{\operatorname{Var}(X_j\mid\Theta)\operatorname{Var}(X_k\mid\Theta)}\). Under the standard marginal variances \(\phi/w_j\), each covariance is \(\rho_{jk}\phi/\sqrt{w_jw_k}\). Substitution gives

$$ \operatorname{Var}(\bar X_w\mid\Theta) = \frac{\phi}{W} + \frac{2\phi}{W^2} \sum_{j<k}\rho_{jk}\sqrt{w_jw_k}. $$

This formula adjusts the variance of the usual exposure-weighted mean; it does not prove that the exposure-weighted mean is the minimum-variance estimator under dependence. With a known conditional covariance matrix \(\Sigma\), the minimum-variance linear unbiased estimator of a common conditional mean, when \(\Sigma\) is invertible, uses weights proportional to \(\Sigma^{-1}\mathbf{1}\). Exposure weights are optimal under particular variance structures, including the independent Bühlmann-Straub structure, but need not remain optimal for arbitrary serial covariance. A scalar credibility factor applied to the exposure-weighted mean is therefore a clear adjustment for that chosen summary, not necessarily the best predictor using the entire period vector.

Worked Example: Unequal Exposures with a Specified Covariance

A hypothetical risk has two period results with exposures \(w_1=1\) and \(w_2=4\). Given its expected result \(\Theta\), the results have means \(\Theta\), variances \(4\) and \(1\), and correlation \(0.50\). The observed results are \(10\) and \(12\). Find the exposure-weighted mean and its conditional variance. No distributional form is assumed; interest and mortality assumptions do not apply.

Method. The total exposure is \(W=1+4=5\), so the observed exposure-weighted mean is

$$ \bar X_w = \frac{1(10)+4(12)}{5} = \frac{58}{5} = 11.6. $$

The conditional covariance is \(0.50\sqrt{4\cdot1}=1\). Applying the variance formula to the weighted sum gives

$$ \operatorname{Var}(\bar X_w\mid\Theta) = \frac{1^2(4)+4^2(1)+2(1)(4)(1)}{5^2} = \frac{4+16+8}{25} = \frac{28}{25} = 1.12. $$

Under conditional independence, the variance would be \(4/25+16/25=0.80\), equivalently \(\phi/W=4/5\) with \(\phi=4\). The covariance adds \(8/25=0.32\). The covariance matrix is valid: its diagonal entries are \(4\) and \(1\), its off-diagonal entries are \(1\), and its determinant is \(4(1)-1^2=3>0\). The common mistake is to use the independent-period variance formula solely because the marginal variances follow \(\phi/w_j\); the nonzero covariance must also be included.

Interpretation and Exam Traps

Positive serial covariance usually means adjacent or otherwise related periods share information, so an exposure-weighted mean contains less independent process information than the standard formula indicates. Negative covariance can have the opposite effect, but it must be consistent with a valid covariance matrix. Neither conclusion means that the risk’s underlying expected result has changed; this discussion holds the conditional mean fixed across periods.

  • Do not equate dependence with covariance. Dependence can exist even when covariance is zero. A zero covariance changes the second-moment calculation but does not establish conditional independence.
  • Do not omit pair terms. Every distinct pair contributes twice in the variance of a sum, which is why the formula contains \(2\sum_{j<k}\).
  • Do not use the independent-period credibility factor automatically. First calculate the conditional variance of the actual summary being used, then use \(Z=a/(a+V)\) if its variance is constant and the scalar linear-prediction assumptions hold.
  • Do not assume exposure weighting is always optimal. Under general dependence, the covariance structure can change the minimum-variance weights as well as the variance of the exposure-weighted mean.
Key takeaway: Serial covariance changes the conditional variance of period experience through pairwise covariance terms. That variance feeds directly into scalar credibility. Zero covariance is enough for the usual variance formula, but not enough to conclude conditional independence or validate every other assumption of the model.

Check Your Understanding

For each question, use the stated conditional moments; no distributional form is required unless specified.

  1. Four equally exposed periods have common conditional variance \(5\) and exchangeable conditional correlation \(0.10\). Find the conditional variance of their mean. (Answer: \(1.625\))
  2. Five equally exposed period results have conditional variance \(3\) and exchangeable conditional correlation \(-0.10\). Check that the correlation is admissible, then find the variance of their mean. (Answer: Admissible; \(0.36\))
  3. A hypothetical risk has collective mean \(9\), between-risk variance \(0.08\), and four equally exposed results with conditional variance \(0.30\) and exchangeable conditional correlation \(0.20\). If the observed mean is \(11\), find the adjusted credibility factor and linear estimate. (Answer: \(V=0.12\), \(Z=0.40\), estimate \(9.8\))
  4. Two results have exposures \(1\) and \(3\), conditional variances \(6\) and \(2\), and conditional correlation \(0.25\). Find the conditional variance of their exposure-weighted mean. (Answer: Approximately \(1.8248\))
  5. Two equally exposed results have conditional means \(\Theta\), conditional variances \(4\), and conditional covariance zero. The results are known to be conditionally dependent. If \(\operatorname{Var}(\Theta)=2\), find the mean’s conditional variance and the scalar linear credibility factor based on that mean. Can conditional independence be concluded? (Answer: Conditional variance \(2\), \(Z=0.5000\); no, zero conditional covariance does not establish conditional independence.)
Clinical Biostats