Tutorials › Quantitative Systems Pharmacology (QSP) › Hybrid Stochastic-Deterministic Models for Rare Cell Events

Delay and Stochastic Extensions · Tutorial 107 of 799

Hybrid Stochastic-Deterministic Models for Rare Cell Events

Build hybrid models that preserve randomness in rare cell events while representing abundant populations with deterministic dynamics, and evaluate the consequences of the partition.

Advanced 12 min read

What You'll Learn

  • Define a hybrid state with integer-valued rare populations and continuous abundant states.
  • Derive event probabilities when propensities change along deterministic trajectories.
  • Partition reactions by event counts, state representation, and biological importance.
  • Work through rare-transition and competing-event calculations.
  • Identify switching artifacts, conservation errors, and conditions that make a hybrid model unsuitable.
  • Compare hybrid models with full stochastic and fully deterministic alternatives.

Why Combine Stochastic and Deterministic Dynamics?

A cell population can contain both abundant compartments and rare events. For example, a large susceptible population may change smoothly at the scale of interest, while the first few resistant cells, infected cells, or cells entering a new state occur as discrete events. A fully deterministic model can represent the large population efficiently, but it may erase the randomness in the timing or occurrence of those rare transitions. A fully stochastic model preserves that randomness, but simulating every event in a very large population can be computationally expensive.

A hybrid stochastic-deterministic model keeps selected states as integer counts and evolves other states as continuous quantities. The partition is a modeling assumption, not a claim that some biological processes are intrinsically random and others intrinsically deterministic. It is appropriate when the stochastic events are consequential at the scale of interest and the fluctuations omitted from the deterministic states are acceptably small.

Definition: Let \(X\) denote a vector of discrete, integer-valued cell counts and \(Z\) a vector of continuous states, such as abundant cell populations or concentrations. Between stochastic events, the continuous state follows an ordinary differential equation \(dZ/dt=f(X,Z,t)\). A stochastic event of type \(j\) occurs with propensity \(a_j(X,Z,t)\), changing the discrete state by a specified jump vector. If the event also changes a continuous state, that change must be included explicitly as a jump or an appropriately scaled update.

The propensity \(a_j\) is an instantaneous event rate: conditional on the current state, the probability of one event of type \(j\) in a short interval of length \(dt\) is \(a_jdt+o(dt)\), while the probability of two or more such events is \(o(dt)\). The total propensity is \(a_0=\sum_j a_j\). The earlier material on cellular continuous-time Markov chains and exact simulation supplies the interpretation of propensities and discrete jumps; the hybrid extension is that propensities may evolve because \(Z\) follows a continuous trajectory between events.

Specifying the Partition

A useful partition is made at the level of states and reaction channels, with attention to what each channel does. A reaction whose occurrence represents a consequential rare cell transition should generally remain stochastic. A process involving a large population may be represented by a deterministic flux when its event count is large enough that individual fluctuations are negligible for the question being asked. A channel that consumes or produces both types of state needs special care: a discrete event can update a continuous concentration by a small amount, but a continuous flux cannot create a fractional individual in a state that is being treated as an integer count.

For a stochastic channel \(j\), let \(\nu_j\) be its change to \(X\), and let \(\zeta_j\) be any corresponding jump to \(Z\). At an event, the update is \((X,Z)\mapsto(X+\nu_j,Z+\zeta_j)\). Between events, \(X\) remains fixed and \(Z\) follows its differential equation. Deterministic channels contribute to \(f\), the continuous-state drift. This description also makes an important bookkeeping requirement visible: if a reaction moves material between represented states, the corresponding changes must preserve the intended mass or cell balance.

Partition criterion: Treat a transition stochastically when its discrete occurrence, small event count, extinction possibility, or timing is important to the prediction. A deterministic representation is more defensible for a state or process when its population or event count is sufficiently large over the relevant time interval, omitted fluctuations do not change the scientific conclusion, and continuous updates respect the model’s balances and boundaries. There is no universal count threshold that guarantees these conditions.

The criterion is therefore purpose-dependent. A population can be abundant in absolute terms yet require stochastic representation if the outcome depends on a small difference between competing event counts. Conversely, a rare species may be approximated deterministically in a narrowly defined setting if only its mean trajectory is needed and variability is demonstrably unimportant. The modeler should state which features are retained as random and which are intentionally averaged.

Event Probabilities Along a Deterministic Trajectory

Between stochastic events, \(X\) is fixed but \(Z(t)\) may change. Consequently, a channel’s propensity can vary with time even when the discrete state does not. Write \(a_0(t)=\sum_j a_j(X,Z(t),t)\) along the no-event trajectory. The cumulative hazard over an interval of length \(T\) is \(H(T)=\int_0^T a_0(u)\,du\). It determines the probability of no stochastic event during that interval.

$$ P(\text{no event by }T)=\exp\left(-\int_0^T a_0(u)\,du\right)=e^{-H(T)}, \qquad P(\text{at least one event by }T)=1-e^{-H(T)}. $$

This result follows from the conditional event-rate definition. If \(S(t)\) is the probability of no event by time \(t\), then over a sufficiently short interval \(dt\), survival is multiplied by \(1-a_0(t)dt+o(dt)\). Thus \(dS/dt=-a_0(t)S(t)\), with \(S(0)=1\). Separating variables and integrating gives \(\log S(T)=-\int_0^T a_0(u)\,du\), hence the displayed survival probability. If an event occurs at time \(t\), the probability that it is of type \(j\), conditional on an event at that instant, is \(a_j(t)/a_0(t)\) when \(a_0(t)>0\).

Worked Example: Probability of a Rare Transition in a Growing Population

Suppose an abundant susceptible population follows \(N(t)=N_0e^{rt}\), with \(N_0=10{,}000\) cells and \(r=0.20\) per day. Each susceptible cell initiates a rare transition at rate \(\mu=1.0\times10^{-5}\) per cell per day. Treat \(N(t)\) as deterministic and the rare transitions as stochastic. Assume the rare events do not appreciably deplete the susceptible population over the two-day interval.

The event propensity at time \(t\) is \(a(t)=\mu N(t)\). Therefore, over \(T=2\) days,

$$ H(2)=\int_0^2 \mu N_0e^{rt}\,dt =\frac{\mu N_0}{r}\left(e^{2r}-1\right) =\frac{(1.0\times10^{-5})(10{,}000)}{0.20}\left(e^{0.40}-1\right) =0.2459. $$

The probability of at least one rare transition is \(1-e^{-0.2459}=0.2180\), or about 21.80% over two days. This is not the expected number of transitions: the expected event count is \(H(2)=0.2459\) under the specified time-varying Poisson event model. The calculation is appropriate only while treating the susceptible trajectory as unaffected by those events is reasonable. If each event removes a susceptible cell and many events occur, that depletion should be represented in the coupled model.

Worked Hybrid Model with Competing Rare Events

The next example shows how stochastic rare transitions can coexist with an abundant state that follows a deterministic equation. It also illustrates why one must check the time-variation assumption used in an event-probability calculation.

Worked Example: Competing Activation and Death Events

Let \(X\) be the integer count of rare precursor cells and \(Z\) an abundant signal concentration. The signal obeys \(dZ/dt=-0.05Z\) concentration units per day, and is initially \(Z(0)=1.0\). Each precursor activates at rate \(0.40Z/(1+Z)\) per day and dies at rate \(0.10\) per day. At the start of a one-day interval, \(X=3\). To make a transparent numerical calculation, approximate \(Z\) as constant at its initial value during this short interval; assess that approximation separately.

At \(Z=1.0\), the activation rate per precursor is \(0.40(1)/(1+1)=0.20\) per day. The total activation propensity is \(a_{\mathrm{act}}=3(0.20)=0.60\) per day. The total death propensity is \(a_{\mathrm{death}}=3(0.10)=0.30\) per day, giving \(a_0=0.90\) per day. With constant propensities over one day, the probability of at least one event is

$$ P(\text{at least one event})=1-e^{-a_0T} =1-e^{-(0.90)(1)} =0.5934. $$

The probability that the first event is an activation during the interval is the probability of any first event multiplied by the activation share of the total propensity:

$$ P(\text{first event is activation by day 1}) =\frac{0.60}{0.90}\left(1-e^{-0.90}\right) =0.3956. $$

Similarly, the probability that the first event is a death by day 1 is \((0.30/0.90)(1-e^{-0.90})=0.1978\). The remaining probability, \(e^{-0.90}=0.4066\), is the probability of no event. These are probabilities for the first event, not probabilities of exactly one event in the interval; additional events could follow the first.

Because the signal would actually decline to \(e^{-0.05}\approx0.9512\) by day 1, holding it fixed slightly overstates the activation propensity relative to the specified signal dynamics. For a longer interval or faster signal change, the correct hybrid calculation integrates the propensities along \(Z(t)\), rather than using the initial rate as if it were constant.

When a Population Can Become Deterministic

A hybrid model may keep a newly appearing or very small cell population stochastic, then represent it deterministically after it becomes sufficiently large. Such a switch is not automatically valid at a particular count. Its acceptability depends on the desired accuracy, the event rates, and whether outcomes such as extinction or threshold crossing remain important.

Worked Example: Assessing a Stochastic-to-Deterministic Switch

Consider a growing clone with stochastic birth and death propensities \(a_b=0.30X\) per day and \(a_d=0.10X\) per day. Suppose a modeler proposes to switch from stochastic to deterministic evolution at \(X=400\). Over a short interval \(\Delta t=1\) day, approximate the two event counts as independent Poisson counts with rates held fixed at their initial values.

At \(X=400\), the expected birth count is \(0.30(400)(1)=120\), and the expected death count is \(0.10(400)(1)=40\). The expected net change is \(120-40=80\) cells. For independent Poisson counts, the variance of their difference is the sum of their variances, so the net-change variance is \(120+40=160\), and its standard deviation is \(\sqrt{160}=12.65\) cells. Relative to the population size, this standard deviation is \(12.65/400=0.0316\), or 3.16%. Relative to the expected net increase of 80 cells, it is \(12.65/80=0.158\), or 15.8%.

Thus, a deterministic switch might be adequate if the goal is the broad population trajectory and fluctuations of this scale do not affect the conclusion. It may not be adequate if the outcome is the precise one-day net increase, a narrow threshold crossing, or a rare extinction event. The calculation is a local approximation: rates change as \(X\) changes, and a longer interval requires a more careful assessment. It supports a decision; it does not establish a universal threshold of 400.

Diagnostics, Alternatives, and Limitations

Several checks help determine whether a hybrid specification is behaving as intended. First, inspect whether the chosen discrete states remain integer-valued and whether continuous states remain in their biologically valid ranges. Second, check the bookkeeping for every transition: cell gains, losses, and transfers should match the model’s stated conservation or balance relationships. Third, compare predictions under plausible alternative partitions or switch thresholds. If a small change in the partition changes the predicted event probability, extinction frequency, or time to a clinically meaningful threshold, the result may depend materially on the approximation.

A further check concerns time variation. If a deterministic driver changes substantially during an interval, a calculation based on a fixed propensity can misrepresent event timing and probability. Use the integrated hazard along the deterministic trajectory, and verify that numerical integration or simulation resolves the trajectory sufficiently. Likewise, a deterministic approximation should not silently allow negative populations or concentrations. Boundary handling must be part of the model, not an afterthought.

The main alternatives serve different purposes. A full stochastic simulation treats all modeled reactions as discrete events and is preferable when fluctuations throughout the system matter, but may require many event updates for very large populations. A fully deterministic model is efficient and can be suitable when only smooth average behavior is needed, but it cannot represent the chance that a rare event has not occurred or the random timing of its first occurrence. A hybrid model lies between these choices: it saves effort on abundant dynamics while retaining randomness for selected events. Its limitation is that it combines two representations and can therefore introduce errors at their interface, particularly through inconsistent transfers or abrupt switching.

A common mistake is to classify every low-abundance species as stochastic and every high-abundance species as deterministic without considering the reactions and predictions of interest. The correction is to assess event counts, coupling, boundaries, and the scientific question together. A large population can still have a consequential rare transition, while a small population’s fluctuations may be irrelevant to a narrowly defined average prediction. The partition and its rationale should be reported so that readers can judge which sources of variability the model retains.

1
Name the prediction of interest.
Decide whether the model must capture first-event timing, extinction, threshold crossing, or only a broad population trajectory.
2
Assign state and reaction representations.
Specify integer states, continuous states, stochastic propensities, deterministic fluxes, and all transfer updates.
3
Check validity and sensitivity.
Check units, boundaries, balances, and sensitivity to the partition or switching rule; refine the stochastic representation if important predictions change.

Check Your Understanding

Answer each question, then compare your reasoning with the solutions below.

  1. A discrete rare-cell state has total propensity \(0.25\) per day, constant over four days. What is the probability of no event and the probability of at least one event?
  2. Why might a large population still require a stochastic representation for one of its transitions?
  3. In a model with a continuous concentration that declines over time, what must be considered when calculating the probability of a rare event driven by that concentration?
  4. Give one reason a switch from stochastic to deterministic dynamics can produce a misleading result even when the population at the switch is large.

Solutions. 1. The cumulative hazard is \(H=(0.25)(4)=1\). Thus \(P(\text{no event})=e^{-1}=0.3679\), and \(P(\text{at least one event})=1-e^{-1}=0.6321\). 2. The transition may be rare relative to the population but important to the prediction, for example because its first occurrence initiates a consequential clone; representing it only by its average rate can erase whether or when it occurs. 3. The propensity changes along the concentration trajectory, so calculate the cumulative hazard by integrating the time-varying propensity rather than assuming its initial value remains fixed. 4. Fluctuations may still determine extinction, a narrow threshold crossing, or another key outcome; a large count alone does not show that those fluctuations are unimportant.

Clinical Biostats