Tutorials › Exam PA - Predictive Analytics › Outcome Horizons And Label Maturity

Exam PA · Data Design and Study Structure · Tutorial 40 of 966

Outcome Horizons And Label Maturity

Set a clear future outcome window and determine when a record has matured enough for reliable labeling.

Beginner 9 min read

What You'll Learn

  • Define an outcome horizon relative to a prediction index date.
  • Apply a clear convention for events on the start and end dates.
  • Distinguish the end of follow-up from the date a label becomes mature.
  • Use a reporting allowance and data cutoff to assess label maturity.
  • Avoid treating an unobserved or immature outcome as a negative label.

Why the Outcome Horizon Matters

A prediction needs a specific future period in which its outcome will be assessed. “Will this policy cancel?” is incomplete unless the analyst also specifies by when. A cancellation in the next 30 days and a cancellation in the next year are different targets, even when they concern the same policy and prediction date. The selected horizon should reflect the decision the prediction is intended to support.

A second issue is timing: the event may occur during the defined period, but the data needed to confirm it may arrive later. A record with no event shown in an incomplete data extract cannot automatically be labeled negative. The outcome period must have elapsed, and enough time must have passed for the relevant records to be reported and reconciled.

Definition: The outcome horizon is the fixed duration after a prediction index date during which a specified event is counted as an outcome. Label maturity is the point at which enough follow-up and reporting time have elapsed to assign a dependable label for that horizon. A mature negative label requires evidence that the full horizon was observed and that the outcome data are sufficiently complete.

This is aligned with the SOA Exam PA (Predictive Analytics) syllabus. The focus here is the future period used to define the outcome and the timing needed to label it—not the choice of prediction method.

Define the Horizon and Its Boundaries

Let \(t_0\) be the prediction index date and let \(H\) be the outcome horizon, measured in a stated unit such as calendar days. For this tutorial, an event is counted if it occurs in the interval \((t_0,t_0+H]\): an event on the index date is excluded, while an event exactly at the horizon endpoint is included. This convention makes the boundary explicit. A different convention can be used if the business question requires it, but it must be stated and applied consistently.

$$ Y = \begin{cases} 1, & \text{if the specified event occurs in } (t_0,t_0+H],\\ 0, & \text{if no such event occurs in } (t_0,t_0+H]\text{ and the label is mature.} \end{cases} $$

The outcome event itself must also be defined precisely—for example, whether it is a submitted cancellation request or a completed cancellation. The horizon does not resolve ambiguity about what counts as the event. Nor does a long horizon make a poorly specified target precise.

Date arithmetic depends on the calendar and the chosen time unit. The examples below use calendar-day durations and explicitly state the year. For a 60-day horizon beginning January 10, 2025, the endpoint is March 11, 2025: January 11 through January 31 contributes 21 days, February contributes 28, and March 1 through March 11 contributes 11, for \(21+28+11=60\) days. The resulting event interval is \((\text{January 10},\text{March 11}]\).

Worked Example: Applying the Horizon Boundary

A hypothetical insurer scores policies for a renewal outreach decision on January 10, 2025. The target is whether a policyholder submits a cancellation request within 60 calendar days after the index date. Requests are captured by their submission date. A request is recorded on March 11. Is it in the outcome horizon?

Method. First calculate the endpoint, then compare the event date with the interval boundaries. January 11–31 contributes 21 days, February 1–28 contributes 28 days, and March 1–11 contributes 11 days. Thus the endpoint is March 11 because \(21+28+11=60\).

The defined interval is \((\text{January 10},\text{March 11}]\). March 11 is the included endpoint, so the request is within the horizon and the event indicator is positive, assuming the request is valid and captured reliably.

Check. The elapsed duration from January 10 to March 11 is 60 calendar days. The answer follows the stated convention: the start is excluded and the endpoint is included. The common mistake avoided is treating “within 60 days” as an unspecified set of calendar dates.

When Is a Label Mature?

The horizon endpoint is not necessarily the date on which the data can support a final label. Suppose a qualifying event can take time to appear in the data source. Let \(L\) be a stated reporting or reconciliation allowance after the horizon endpoint, and let \(C\) be the latest date through which the data are considered reliable. Under the assumption that the data capture the specified outcome completely by the end of that allowance, a record is mature when the reliable-data cutoff reaches or passes the end of the allowance.

$$ \text{Maturity date}=t_0+H+L, \qquad \text{mature at cutoff } C \text{ if } C \geq t_0+H+L. $$

Here, \(L\) is a bound or operationally chosen allowance, not a guarantee that every imaginable data error has been eliminated. The maturity rule is defensible only if its assumptions are appropriate: the outcome source is sufficiently complete through \(C\), the allowance reflects the relevant reporting process, and the record was actually observable for the intended period. If data are not reliable through the cutoff, or the record was not under observation for the full horizon, the absence of an event does not establish a mature negative.

A verified event may sometimes establish a positive outcome before the full horizon has elapsed. However, if labels are intended to be comparable and final, a consistent maturity rule helps prevent differences in reporting delay from being mistaken for differences in outcome. The analyst should document whether early positives are accepted or whether every record must reach the common maturity date before labels are finalized.

Why the Maturity Rule Holds

The maturity date follows directly from what must be observed to label the entire horizon. Starting at the index date, first allow the full duration \(H\) for the event to occur. That reaches \(t_0+H\). Then allow up to \(L\) additional time for an event from that horizon to be recorded and reconciled. The latest expected completion date is therefore the horizon endpoint plus the allowance:

1
Complete the outcome period.
By \(t_0+H\), every event within the defined horizon has had an opportunity to occur.
2
Allow for reporting.
By \(t_0+H+L\), the assumed reporting and reconciliation delay has also elapsed.
3
Compare with the data cutoff.
If \(C\geq t_0+H+L\), the record has reached the maturity date, subject to the completeness and observation assumptions. If \(C<t_0+H+L\), the full negative outcome is not yet established.

The logic is especially important for a negative label. To conclude that no qualifying event occurred in the whole interval, the analyst needs both the completed interval and sufficiently complete event reporting for that interval. Before then, “no event recorded so far” describes the extract, not necessarily the outcome.

Worked Example: Deciding Whether a No-Event Record Is Mature

A hypothetical service plan is indexed on February 1, 2025. The target is a qualifying service interruption within the following 28 calendar days. The data team uses a 14-calendar-day reporting allowance. The data are considered reliable through March 15, 2025, and no interruption is recorded. Can the record be assigned a mature negative label?

Step 1: Find the horizon endpoint. February 2025 has 28 days. February 1 plus 28 calendar days is March 1, 2025. The outcome interval is \((\text{February 1},\text{March 1}]\).

Step 2: Add the allowance. Fourteen calendar days after March 1 is March 15. This is the maturity date.

Step 3: Compare with the cutoff. The reliable-data cutoff is March 15, and \( \text{March 15}\geq\text{March 15}\). The cutoff is on the maturity date, so the record is mature under the stated completeness assumption. Because no qualifying interruption is recorded, assign a negative label.

Check. The 28-day horizon ends March 1, and the allowance ends March 15. Both calculations use the stated non-leap year and calendar-day convention. The common mistake avoided is stopping at the horizon endpoint and ignoring the additional reporting time.

Worked Example: An Immature Record at the Data Cutoff

A hypothetical lender defines an outcome as a missed payment within 60 calendar days after an October 2, 2025 index date. There is no additional reporting allowance. The extract is reliable through November 30, 2025, and no missed payment is shown. Is the record mature, and what label can be assigned?

Step 1: Calculate the endpoint. October 3–31 contributes 29 days. November 1–30 contributes 30 days, bringing the elapsed total to \(29+30=59\) days. One more day, December 1, gives 60. The horizon endpoint is December 1, 2025.

Step 2: Apply the allowance. Since \(L=0\), the maturity date is also December 1, 2025.

Step 3: Compare with the cutoff. November 30 is before December 1. Therefore the record is not mature as of the cutoff. The missing event record cannot be treated as a negative label; the record remains unresolved for this horizon.

Check. October 2 plus 60 calendar days is December 1, not November 30. The common mistake avoided is assuming that the record is mature because the cutoff is close to the endpoint.

Common Traps and Practical Checks

A horizon and maturity rule should be written down before labels are produced. That makes it possible to identify which records are eligible for final labeling at a particular data cutoff and to avoid silently mixing complete follow-up with incomplete follow-up.

  • Using an ambiguous duration. “Next quarter” could mean a calendar quarter, three months, or a fixed number of days. State the duration and the unit.
  • Leaving the boundary implicit. Specify whether an event on the index date counts and whether one on the endpoint counts. Here, the convention is \((t_0,t_0+H]\).
  • Ignoring reporting delay. The horizon may have ended even though the data are not yet complete enough to trust a no-event label.
  • Calling an immature record negative. An empty event field can mean “not reported yet.” Use an unresolved status until the maturity condition is met, rather than forcing a zero.
  • Mixing time units. If \(H\) is in calendar days, do not calculate it as business days. If a real process uses business days, specify the calendar and holiday convention.

A useful audit is to select a few records near the cutoff and calculate their horizon endpoints and maturity dates by hand. Check that boundary events are treated consistently and that no record labeled negative lacks a complete, reliable observation period. These checks address label timing; they do not replace a precise definition of the event or an assessment of whether the records were observable.

Key takeaway: Define the event window from the index date, state its endpoint convention, and add a justified reporting allowance before treating the absence of an event as a reliable negative. A record that has not matured is not evidence that the outcome did not occur.

Check Your Understanding

For each problem, use calendar-day durations and the interval convention \((t_0,t_0+H]\). Assume the stated data cutoff is reliable, and use the stated reporting allowance when deciding maturity.

  1. A hypothetical equipment-monitoring record is indexed April 10, 2025, with a 45-day horizon. A qualifying fault is recorded May 25. Is the fault within the horizon? (Answer: Yes; the endpoint is May 25, so the endpoint event is included.)
  2. A hypothetical account is indexed August 5, 2025, with a 30-day horizon and a 6-day reporting allowance. No event is recorded, and the reliable-data cutoff is September 9. Is the record mature? (Answer: No; the horizon ends September 4 and the maturity date is September 10.)
  3. A hypothetical inspection program uses a 90-day horizon from November 1, 2025, with a 5-day reporting allowance. No event is found, and reliable data extend through February 4, 2026. Is a negative label supported? (Answer: Yes; the horizon ends January 30, the maturity date is February 4, and the cutoff reaches that date.)
  4. A hypothetical subscription is indexed June 15, 2025, with a 14-day horizon and a 3-day reporting allowance. No qualifying event is recorded; the reliable-data cutoff is July 2. What label can be assigned? (Answer: Mature negative; the horizon ends June 29 and the maturity date is July 2.)
  5. A hypothetical device record is indexed September 1, 2025, with a 10-day horizon and a 4-day reporting allowance. A qualifying event occurred September 10 and was recorded September 14. Reliable data extend through September 15. Is the event in the horizon, and is the record mature? (Answer: Yes; September 10 is within \((\text{September 1},\text{September 11}]\), and the September 15 cutoff reaches the maturity date.)
Clinical Biostats