What Regeneration Means
A regenerative model divides a process into successive cycles so that, at the end of each cycle, its future starts afresh. This is stronger than saying that cycles have similar shapes: the future must have the same law as a fresh process and must be independent of the past. When this structure holds, questions about a long path can often be organized around a sequence of cycle records.
Let \((\Omega,\mathcal{F},\mathbb{P})\) be a probability space, let \(S\) be a finite or countable state space, and let \((X_t)_{t\ge0}\) be an \(S\)-valued process in continuous time. Let \((\mathcal{F}_t)_{t\ge0}\) be a filtration to which the process is adapted. A random time \(T\) is a stopping time if \(\{T\le t\}\in\mathcal{F}_t\) for every \(t\ge0\). Write \(\mathcal{F}_T\) for the information available up to \(T\). We assume the path-valued random variables below are measurable and that the times considered are finite almost surely.
The equality of laws refers to the entire future path, not just the state at one time. Independence means that for every event \(A\in\mathcal{F}_{T_k}\) and every measurable set \(H\) of future paths, the probability that \(A\) occurs and the shifted path belongs to \(H\) is \(\mathbb{P}(A)\mathbb{P}((X_t)_{t\ge0}\in H)\). In particular, the future is not merely independent of a summary of the past; it is independent of all information in \(\mathcal{F}_{T_k}\).
Define the length of cycle \(k\) by \(L_k=T_k-T_{k-1}\), for \(k\ge1\). A cycle record may contain \(L_k\) and the path observed within the cycle, measured relative to its start. A convenient convention is to record the path on \(0\le u<L_k\), assigning the endpoint \(T_k\) to the next cycle. If the endpoint itself carries information needed to describe a cycle, include that information explicitly and use the same convention for every cycle.
Regeneration and the Cycle Records
Regeneration gives a precise reason that cycle records can be treated as repeated independent observations. To state the implication carefully, assume that the rule identifying the next regeneration time is the same after every regeneration: applying it to the shifted future identifies the next cycle in that shifted path. Let \(C_{k+1}\) be the resulting record of the cycle from \(T_k\) to \(T_{k+1}\). Suppose the cycle record is a measurable function of the shifted path up to its next regeneration time, and the law of that record in a fresh process is a fixed probability distribution \(\nu\).
Proof. The shifted future at \(T_k\) has the fresh-process law and is independent of \(\mathcal{F}_{T_k}\). Applying the same measurable cycle-extraction rule to that future shows that \(C_{k+1}\) has law \(\nu\) and is independent of \(\mathcal{F}_{T_k}\). Each earlier record \(C_1,\ldots,C_k\) is determined by the path up to \(T_k\), so it is \(\mathcal{F}_{T_k}\)-measurable. For measurable sets \(A_1,\ldots,A_{k+1}\) of cycle records, independence therefore gives \(\mathbb{P}(C_1\in A_1,\ldots,C_k\in A_k,C_{k+1}\in A_{k+1})=\mathbb{P}(C_1\in A_1,\ldots,C_k\in A_k)\nu(A_{k+1})\). Starting with \(k=0\) and applying this identity successively factors the joint probability as \(\prod_{j=1}^{k+1}\nu(A_j)\). This is the definition of independence, and the same law \(\nu\) for each record gives identical distribution. \(\square\)
The proposition uses both parts of regeneration. Independence from the past gives independence of the records; the common shifted-future law and common extraction rule give identical distribution. The converse is also useful when building models.
Proof. Fix a cycle boundary \(T_k\). The shifted future from \(T_k\) is formed by concatenating records \(C_{k+1},C_{k+2},\ldots\). Because the records are independent and identically distributed, this sequence has the same law as \(C_1,C_2,\ldots\). The shifted path, being formed from that sequence by the same concatenation rule, consequently has the same law as the process started at time \(0\). The information up to \(T_k\) is determined by the first \(k\) records. Independence of the records implies that the sequence from \(C_{k+1}\) onward is independent of those first \(k\) records, hence of \(\mathcal{F}_{T_k}\) when that filtration contains no additional information about future records. Thus the shifted path is independent of the past. The boundary times are stopping times by assumption, so they satisfy the definition of regeneration times. \(\square\)
Worked Example: Renewal Counts Regenerate After Recentring
Let \(X_1,X_2,\ldots\) be independent random variables with \(\mathbb{P}(X_j=1)=\mathbb{P}(X_j=2)=\tfrac12\). Set \(S_0=0\), \(S_n=\sum_{j=1}^n X_j\), and \(N(t)=\max\{n:S_n\le t\}\). Take the state space \(S=\{0,1,2,\ldots\}\) and the natural filtration generated by the renewal observations up to time \(t\). The renewal epochs \(T_n=S_n\) are stopping times.
The absolute count process \(N\) does not restart at \(T_n\): \(N(T_n)=n\), whereas \(N(0)=0\). The relevant fresh future is instead the recentered count \(N(T_n+t)-N(T_n)\). For every \(t\ge0\), this count is determined by \(X_{n+1},X_{n+2},\ldots\), while the observed history through \(T_n\) is determined by \(X_1,\ldots,X_n\). Independence and identical distribution of the interarrivals show that the recentered process has the same law as \(N\) and is independent of the past.
For example, at \(t=1\), the fresh count is \(0\) if \(X_1=2\), and \(1\) if \(X_1=1\). In the latter case the second arrival cannot occur by time \(1\), since \(X_1+X_2\ge2\). Thus \(\mathbb{P}(N(1)=0)=\tfrac12\) and \(\mathbb{P}(N(1)=1)=\tfrac12\). The same two probabilities hold for \(N(T_n+1)-N(T_n)\), independently of the past through \(T_n\).
The cycle record must also be recentered. Let \(L_k=X_k\), and record the within-cycle count \(C_k(u)=N(T_{k-1}+u)-N(T_{k-1})\) for \(0\le u\le L_k\). It equals \(0\) for \(u<L_k\) and \(1\) at \(u=L_k\). Each record is determined by \(X_k\), so the records are independent and identically distributed. By contrast, the uncentered path segment begins at \(N(T_{k-1})=k-1\); those uncentered segments do not have the same distribution across cycles.
Check: \(L_k\) takes values \(1\) and \(2\), each with probability \(\tfrac12\), so \(\mathbb{E}[L_k]=1\cdot\tfrac12+2\cdot\tfrac12=\tfrac32\). This agrees with the cycle record: its within-cycle count stays at \(0\) until its endpoint, where it increases to \(1\).
Worked Example: A Process Built from Independent Cycles
Construct a discrete-time process on \(S=\{r,a,b,c\}\). At each visit to \(r\), independently choose type A with probability \(\tfrac13\) or type B with probability \(\tfrac23\). A type A cycle has length \(2\) and visits \(r,a\) before returning to \(r\); a type B cycle has length \(3\) and visits \(r,b,c\) before returning to \(r\). The cycle records are the chosen type, its length, and its listed within-cycle path. Time indices are \(n\ge0\), and \(X_0=r\).
Equivalently, the transition probabilities are \(p_{ra}=\tfrac13\), \(p_{rb}=\tfrac23\), \(p_{ar}=1\), \(p_{bc}=1\), and \(p_{cr}=1\), with all other entries zero. The row sums are \(\tfrac13+\tfrac23=1\), \(1\), \(1\), and \(1\), respectively. The return times to \(r\) are stopping times for the natural filtration. Since each new type is sampled independently with the same probabilities, the future after each return has the same law as the process started at \(r\), independently of the observed cycles.
The first cycle length \(L_1\) is \(2\) with probability \(\tfrac13\) and \(3\) with probability \(\tfrac23\), so \(\mathbb{E}[L_1]=2\cdot\tfrac13+3\cdot\tfrac23=\tfrac83\). At time \(1\), \(\mathbb{P}(X_1=a)=\tfrac13\) and \(\mathbb{P}(X_1=b)=\tfrac23\). At time \(2\), the process is at \(r\) if the first cycle was A, and at \(c\) if it was B; hence \(\mathbb{P}(X_2=r)=\tfrac13\) and \(\mathbb{P}(X_2=c)=\tfrac23\).
Check: The probability that the first cycle is A and the second is B is \(\tfrac13\cdot\tfrac23=\tfrac29\). It is also the product of their marginal probabilities, as required by independence. The same cycle-type probabilities apply after every return to \(r\), so the records are identically distributed as well.
Worked Example: Equal Cycle Marginals Do Not Guarantee Regeneration
Let \(B\) be a single random variable with \(\mathbb{P}(B=1)=\mathbb{P}(B=2)=\tfrac12\), and set \(L_1=L_2=B\). Consider two successive cycles with these lengths and let the past at the end of the first cycle include its observed length \(L_1\). Each length separately has the same marginal distribution: it is \(1\) or \(2\), each with probability \(\tfrac12\).
However, the lengths are not independent. Directly, \(\mathbb{P}(L_1=1,L_2=1)=\mathbb{P}(B=1)=\tfrac12\), whereas independence would require \(\mathbb{P}(L_1=1)\mathbb{P}(L_2=1)=\tfrac12\cdot\tfrac12=\tfrac14\). Thus the future cycle length \(L_2\) is not independent of the past at the first boundary. Identical marginal cycle laws alone do not establish regeneration.
Check: The joint probability \(\tfrac12\) differs from the product \(\tfrac14\), so the independence condition fails even though the two cycle lengths have identical distributions.
What to Verify in a Regenerative Model
When proposing regeneration times, check the definition rather than relying on the visual appearance of repeated cycles. In particular, identify the filtration, verify that the times are stopping times, and specify exactly what is meant by the future process after a boundary. If the state accumulates a count or another quantity that cannot restart, determine whether the intended property is instead regeneration of recentered increments or of a cycle-relative path.
A common mistake is to call renewal epochs regeneration times for the absolute renewal count because the interarrival times after each epoch are fresh. The calculation \(N(T_n+0)=N(T_n)=n\), while \(N(0)=0\), shows why that claim is false under the shifted-process definition: even at time zero, the shifted absolute path does not have the fresh-process value. The correction is to use \(N(T_n+t)-N(T_n)\), or to define cycle records using within-cycle counts. The distinction matters whenever the process retains accumulated history in its state.
Finally, regeneration is not the same as stationarity. Regeneration asserts independence and a repeated law after selected times; it does not assert that the distribution of \(X_t\) is constant in \(t\). Nor does the definition by itself give a long-run average formula. Cycle lengths and cycle rewards provide the structure for such calculations, but the corresponding limit theorems require their own hypotheses and arguments.
Check Your Understanding
For each question, distinguish the law of a shifted future from the law of a recentered or cycle-relative quantity.
- State the two probabilistic requirements in the definition of a regeneration time.
- For the renewal count, why does \(N(T_n+t)\) fail to be the fresh count process, and what recentered process has the fresh law?
- In the four-state construction, what are the two possible cycle lengths and their probabilities? Compute their mean.
- Why do independence from the past and a common cycle-extraction rule imply that cycle records are identically distributed?
- In the shared-\(B\) example, compare \(\mathbb{P}(L_1=1,L_2=1)\) with \(\mathbb{P}(L_1=1)\mathbb{P}(L_2=1)\). What condition fails?