CAS Exam 9 · Risk Measurement and Monitoring · Tutorial 136 of 995

Building Actionable Risk Dashboards

Design and evaluate risk dashboards that show what each metric means, how it compares with its threshold, when it was measured, and who is accountable for it.

Intermediate 13 min read

What You'll Learn

  • Specify the information needed to make a risk metric interpretable on a dashboard.
  • Distinguish a metric’s current value from its threshold and its threshold-utilization ratio.
  • Show dated prior values without implying more than the data establish.
  • Assess sample dashboard layouts for clarity, comparability, and decision usefulness.
  • Recognize display and calculation errors that can mislead dashboard users.

Introduction

A dashboard can contain accurate numbers and still fail its purpose. A red cell marked “0.8” is difficult to act on if the viewer cannot tell whether 0.8 is a loss ratio, a limit-utilization ratio, or a score; what period it covers; what threshold applies; or who is responsible for the metric. An actionable dashboard connects the measure to its meaning and its context.

The design task here is not to infer what a pattern in the data means. It is to present each measure so a decision-maker can identify the metric, compare its current value with the relevant threshold, see dated prior observations, and find its owner. This builds on precise metric definitions, KRI thresholds, ownership, data lineage, and monitoring frequency: the dashboard should display those choices, not obscure them.

Definition: An actionable risk dashboard is a concise display of risk measures that provides enough context for a user to understand what each measure represents, when it was observed, how it relates to its applicable threshold, and who is responsible for it. At a minimum, a dashboard row should identify the metric and unit, its current value and measurement cutoff, the relevant threshold or limit, dated prior values where they are useful, and the accountable owner.

What a Dashboard Row Needs to Say

A useful row is more than a number beside a colored cell. Its elements should answer different questions without requiring the reader to guess:

  • Metric and definition: What is measured, including the numerator, denominator, exclusions, and unit where relevant?
  • Current value and cutoff: What is the latest value, and what date or period does it represent?
  • Threshold: What comparison value applies, and is it a watch threshold, a limit, or another defined boundary?
  • Historical values: What were the values in earlier, explicitly dated periods? These help establish context, but a sequence of values alone does not establish a cause or a forecast.
  • Owner and data status: Who is accountable for the metric, and is the data complete and timely enough for the displayed comparison?

Show units consistently. A value of 6% and a value of 0.06 may describe the same quantity, but mixing these formats makes comparisons error-prone. Likewise, a threshold should be shown in the same unit as the metric, or the dashboard should clearly label any calculated ratio between them.

Takeaway: Present the current value and threshold separately. If you also show threshold utilization, label it as a ratio and state its direction: for a higher-is-worse metric with a positive threshold, utilization is the current value divided by that threshold. It is not the metric’s current value.

Threshold Utilization: A Display Aid, Not a Substitute

For a higher-is-worse measure with current value \(x\) and a positive threshold \(T\), the utilization ratio is \(x/T\). It is dimensionless, so it can make comparisons across differently scaled metrics easier. However, it does not replace the underlying value or threshold: users still need both to understand what is being measured and what boundary applies.

$$ \text{Utilization}=\frac{x}{T}, \qquad T>0 $$

The reason this ratio is useful follows directly from its construction. If both the measure and the threshold are expressed in the same unit, multiplying both by the same positive conversion factor \(c\) leaves their ratio unchanged:

$$ \frac{cx}{cT}=\frac{x}{T} $$

For example, converting both a dollar-valued exposure and its dollar threshold to thousands of dollars does not alter utilization. That makes the ratio scale-free. But it is only a meaningful comparison when the metric and threshold use compatible definitions, units, and periods. It also assumes a positive threshold and a measure for which “more” has the intended direction. For a lower-is-worse metric, \(x/T\) does not generally express proximity to the adverse boundary in a useful way; show the defined threshold and current value directly, or use a separately specified comparison measure.

Worked Example: Showing Loss-Ratio Utilization Correctly

A hypothetical portfolio has incurred losses of $96,000 and earned premium of $1,600,000 for the quarter ending September 30. Its risk dashboard uses a 7.5% loss-ratio reference threshold. For illustration, the dashboard defines values from 0.75 up to, but not including, 1.00 of that threshold as amber. Calculate the loss ratio and threshold utilization, then specify what the dashboard should display.

Method. Calculate the metric in its own units first. Then compare it with the threshold using the utilization ratio. The amber band is part of this hypothetical dashboard’s stated convention, not a general rule.

Step 1: Calculate the loss ratio. The definition is incurred losses divided by earned premium:

$$ \frac{\$96{,}000}{\$1{,}600{,}000}=0.06=6\% $$

Step 2: Calculate utilization. Express both the current ratio and the threshold as decimals:

$$ \frac{0.06}{0.075}=0.8 $$

Step 3: Assign the stated display band. Since \(0.75 \le 0.8 < 1.00\), the example’s convention labels the row amber.

Dashboard display: “Loss ratio: 6.0%; threshold: 7.5%; utilization: 0.8000; cutoff: quarter ending September 30; status: amber.” The accountable portfolio owner and data source should also be named in the row or an immediately accessible detail.

Check and common mistake. The loss ratio is 6%, not 0.8. The value 0.8 is the ratio of the loss ratio to its 7.5% reference. A common display error is to calculate \(0.06/0.075\) and label the resulting 0.8 as though it were the loss ratio, or to report utilization as 80.0 when the agreed dashboard convention is to show a dimensionless ratio. Keeping the metric, threshold, and ratio in separate labeled fields avoids both errors.

Make Time and Responsibility Visible

A current value without a measurement date can be misleading. “Current” might mean the last day of a month, the last completed quarter, or the latest available data point. Put the cutoff or covered period next to the value. If prior observations are shown, label each one with its date or period. This makes the displayed history auditable and prevents readers from assuming that values refer to equal or identical periods when they do not.

Ownership should also be visible. A role or named accountable function is usually more useful than a generic label such as “Risk.” The owner is responsible for the metric’s definition and reporting process or for coordinating review, according to the organization’s governance. The dashboard should not imply that the owner necessarily controls every underlying exposure. Where data are delayed, incomplete, or subject to a known qualification, make that status apparent instead of presenting an apparently precise number without context.

Worked Example: Comparing a Current Percentage with Its Threshold

A hypothetical servicing team tracks late settlements as a share of settlements due. For the month ending October 31, 84 of 420 settlements were late. The threshold is 22%. The dashboard also retains values for August and September: 17% for the month ending August 31 and 19% for the month ending September 30. Calculate the current metric and its utilization, then state the required labels.

Step 1: Calculate the current metric. The numerator is late settlements, and the denominator is all settlements due in the same period:

$$ \frac{84}{420}=0.20=20\% $$

Step 2: Calculate utilization. Compare the current 20% with the 22% threshold, using decimals for both:

$$ \frac{0.20}{0.22}=0.909090\ldots \approx 0.9091 $$

The utilization is 0.9091 when rounded to four decimal places. It is not the current metric: the current metric remains 20%, and the threshold remains 22%.

Step 3: Display the periods. A clear row or compact history could read: “Late settlements: current 20% (84 of 420), month ending October 31; threshold 22%; utilization 0.9091; prior monthly values: August 31, 17%; September 30, 19%.” The dashboard should also show the accountable servicing owner and an appropriate source or data-status indicator.

Check and common mistake. The calculation \(84/420\) gives 0.20, or 20%. Dividing that by 0.22 gives 0.9091. A common error is to confuse these stages and report 0.9091 as the late-settlement percentage. Another is to show prior values without dates, leaving the reader unsure which periods they cover. The current cutoff and both prior month-ends are stated explicitly here.

Evaluate the Layout, Not Just the Numbers

A dashboard should make the relationship between a metric and its comparison point easy to find. Consider this hypothetical draft row:

“Complaints | 18 | 4 | Green | Operations”

The row is not yet decision-useful. It does not say whether 18 is a count or a rate, what period it covers, whether 4 is a threshold or a prior value, what “Green” means, or which operations role owns the measure. A reader cannot reliably compare the numbers or check their meaning.

Draft fieldProblemMore useful presentation
ComplaintsMetric and unit are unclear.Customer complaints per 1,000 policies in force.
18No definition or cutoff is provided.18 complaints / 6,000 policies = 3.0 per 1,000; month ending October 31.
4It is unclear whether this is a threshold, prior value, or something else.Threshold: 4.0 complaints per 1,000 policies.
GreenThe display convention is not defined.Use the approved status convention and provide the current comparison value alongside it.
OperationsAccountability is too broad to identify a responsible owner.Name the accountable role or function specified by governance.

Worked Example: Repairing an Incomplete Dashboard Row

A hypothetical insurer monitors complaints per 1,000 policies in force. For the month ending October 31, it records 18 complaints and 6,000 policies in force. The stated threshold is 4.0 complaints per 1,000. For this example, a utilization below 0.80 is displayed as green; the dashboard owner is the Customer Operations Manager. Evaluate the draft “Complaints | 18 | 4 | Green | Operations” and write a clearer row.

Step 1: Calculate the defined metric. Divide complaints by policies in force, then multiply by 1,000 to express the rate per 1,000 policies:

$$ \frac{18}{6{,}000}\times 1{,}000=3.0 $$

The current metric is 3.0 complaints per 1,000 policies.

Step 2: Calculate utilization. The current value and threshold use the same unit:

$$ \frac{3.0}{4.0}=0.75 $$

Since \(0.75<0.80\), the example’s stated convention gives a green status.

Step 3: Repair the row. A clearer display is: “Complaints per 1,000 policies in force: 3.0; numerator/denominator: 18/6,000; cutoff: month ending October 31; threshold: 4.0 per 1,000; utilization: 0.75; status: green under the stated convention; owner: Customer Operations Manager.” A source or data-quality note should be included if needed to interpret the result.

Check and common mistake. The calculated rate is 3.0 per 1,000, not 18 per 1,000: the latter would omit the denominator and scaling. The utilization is 0.75, not the rate itself. The repaired row names the metric, basis, cutoff, threshold, comparison ratio, status convention, and owner; the original did not.

Common Dashboard Design Traps

  • Showing a color instead of a comparison. A color alone hides the current value, applicable threshold, and status convention. Show the values and label the convention.
  • Using a ratio without naming it. A value such as 0.8 could be a metric, a fraction, or threshold utilization. Label its meaning and keep it separate from the metric itself.
  • Omitting units or denominators. A count, rate, percentage, and dollar amount are not interchangeable. Include the unit and, where necessary, the numerator and denominator.
  • Leaving the cutoff implicit. A current value without a dated measurement period may not be comparable with prior observations.
  • Using ambiguous history. Label each prior value with its date or covered period. Do not rely on an unlabeled sparkline or an unexplained sequence.
  • Displaying stale data as current. Distinguish the date the value measures from the date it was reported when a reporting lag matters.
  • Applying one ratio mechanically to every measure. Utilization \(x/T\) is appropriate only when the metric and threshold are comparable, the threshold is positive, and the direction of risk makes the ratio interpretable.

A compact dashboard can still be complete. If space is limited, keep the metric, value, unit, cutoff, threshold, and accountable owner visible; use a linked detail view for definitions, source lineage, and dated history only when the summary clearly signals where to find them. The design is successful when a reader can interpret a row without guessing what its fields mean.

Check Your Understanding

For each problem, identify the calculation or display choice that makes the metric interpretable. Answers are provided at the end of each question.

  1. A hypothetical risk team reports $135,000 in losses against $2,000,000 of earned premium. Its reference threshold is a 9% loss ratio. Calculate the loss ratio and utilization. (Answer: loss ratio 6.75%; utilization 0.7500.)
  2. A service unit reports 54 delayed cases out of 300 cases due for the month. The threshold is 18%. Calculate the current metric and utilization. (Answer: current metric 18%; utilization 1.0000.)
  3. A dashboard lists “open incidents: 12; threshold: 15” but does not state a cutoff. Name two pieces of context, in addition to the owner, that should be added before the row can be interpreted reliably. (Answer: define what counts as an open incident and state the measurement cutoff or covered period; the unit and threshold basis should also be explicit if not already defined.)
  4. A hypothetical portfolio has 45 high-risk policies among 900 policies reviewed. Its threshold is 6%. Calculate the current percentage and utilization, and state why reporting only the utilization would be incomplete. (Answer: current percentage 5%; utilization 0.8333; utilization alone omits the metric’s value and threshold context.)
  5. A dashboard shows values of 7%, 8%, and 9% but gives no dates or period labels. What is the most important display correction before a user compares the values as a time series? (Answer: label each value with its measurement date or covered period, including the current cutoff.)
Clinical Biostats