Topic: Absorption, Hitting Times and First-Step Analysis

Hitting Times and Boundary Events

First-Step Equations for Hitting Probabilities

First-Step Equations for Expected Hitting Times

Finite-Time Absorption Probabilities from Matrix Powers

Expected Visits from the Fundamental Matrix

Expected Time to Absorption from the Fundamental Matrix

Expected Time to Hit a Target Set

Expected Rewards Accumulated Before Absorption

Deriving the Absorption Probability Formula

Computing Absorption Probabilities with N and R