Tutorials › Bayesian Clinical Trials › State Variables for Single-Arm Predictive Monitoring

Phase 2 Single-Arm Monitoring · Tutorial 593 of 696

State Variables for Single-Arm Predictive Monitoring

Learn to define the key state variables in single-arm predictive monitoring and check that they align with the planned design and terminal rule.

Intermediate 9 min read

What You'll Learn

  • Distinguish planned sample size from interim sample size and observed responses
  • Define the number of future responses and its feasible range
  • Separate the benchmark response rate from the unknown treatment response probability
  • Represent a terminal decision as a pre-specified rule applied to final response data
  • Check count consistency and recognize when aggregate counts may not be an adequate state
  • Identify design details that must be fixed before predictive monitoring is specified

Why State Variables Matter

A predictive monitoring rule asks what the data observed so far imply about a decision that will be made at the end of a trial. Before any probability can be calculated, the design must say how many participants are planned, how many have supplied an assessable outcome, how many responses have been observed, and what final result would lead to each terminal action. If these pieces are ambiguous, a predictive calculation may be arithmetically correct but answer the wrong question.

This tutorial specifies those pieces for a single-arm phase 2 trial with a binary response endpoint. It focuses on defining the state that is supplied to a monitoring rule, not on calculating predictive probabilities. Those calculations require additional probability-model and prior-distribution details.

Definition: Let \(N\) be the planned total number of participants with an assessable binary response, \(n\) the number with assessable responses at an interim look, and \(x\) the number of responses among those \(n\) participants. The number of remaining participants is \(m=N-n\). Write \(Y\) for the number of responses among those \(m\) future assessable outcomes. The final response count is therefore \(T=x+Y\).

The counts refer to participants, not to visits, doses, or response assessments. “Assessable” must have a protocol-defined meaning: for example, a participant may need to complete a specified assessment window before being counted in \(n\). In the basic formulation here, every planned participant contributes one binary outcome, and the interim data contain only outcomes whose response status has been resolved.

Assumptions and the Monitoring State

The basic state is meaningful under a fixed-horizon design: \(N\) is set in advance, and monitoring does not change the planned total. Each participant has one response indicator, coded 1 for response and 0 for nonresponse, according to a defined endpoint and assessment time. For the simplest model, outcomes are conditionally independent given a common response probability \(\theta\). This common-probability assumption means that participants are treated as having the same response chance within the modeled trial population.

The clinical benchmark response rate is denoted \(p_0\). It is a reference value specified for the trial’s clinical question; it is not the same thing as the unknown response probability \(\theta\). For example, a design may ask whether the treatment’s response performance is promising relative to a benchmark of 20%. Specifying \(p_0\) does not assert that the true response probability equals \(p_0\), nor does it by itself determine a terminal action.

A complete monitoring state also includes the terminal decision rule. It is useful to write this rule abstractly as \(\delta(T)\), where the input is the final response count \(T\) and the output is the prespecified terminal action. For a simple binary-response design, an illustrative rule might declare a result favorable when \(T\) reaches a specified count \(c\). The actual endpoint definition, count threshold or other decision criterion, and actions attached to its possible outcomes must be specified by the design.

Key takeaway: A basic single-arm monitoring state can be recorded as \((N,n,x,p_0,\delta)\), together with the endpoint and assessment definition. The implied future count is \(m=N-n\), and the final count is \(T=x+Y\). These quantities define the setup; they do not, by themselves, give the probability of any terminal action.

The count \(Y\) cannot take arbitrary values. Since it counts responses among \(m\) people, \(Y\) must be an integer from 0 to \(m\). Thus \(T\) can range from \(x\) to \(x+m=N\). If the terminal rule is a count threshold \(c\), the number of additional responses needed to reach it is \(\max(0,c-x)\). This is a statement about arithmetic feasibility, not a probability calculation.

Checking the State Before Using It

The state should pass basic consistency checks before it is used in a monitoring calculation:

  • \(N\), \(n\), and \(x\) are whole-number counts with \(0\leq n\leq N\) and \(0\leq x\leq n\).
  • The remaining sample size \(m=N-n\) is nonnegative, and the future response count is restricted to \(0\leq Y\leq m\).
  • The benchmark \(p_0\) is a response rate on the probability scale, so \(0\leq p_0\leq1\), and its clinical meaning is stated.
  • The endpoint, assessment timing, and rules for classifying response are the same for the interim and terminal counts.
  • The terminal decision rule is specified before looking at the interim result; it is not improvised to favor the observed data.

If participants can have pending assessments, then “enrolled,” “treated,” and “with assessable outcomes” are not interchangeable counts. The basic state above uses \(n\) as the number with resolved outcomes and does not assign an unresolved participant a response or nonresponse. A design that explicitly models pending outcomes needs additional state information; treating unresolved outcomes as failures or silently excluding them changes the monitoring question.

Worked Example: Writing Down a Single-Arm State

Suppose a hypothetical phase 2 study plans to obtain assessable responses from \(N=40\) participants. At an interim look, \(n=15\) outcomes are resolved, including \(x=6\) responses. The clinical benchmark is \(p_0=0.20\). The protocol has also specified a terminal count rule for the final analysis.

First check the observed counts: \(0\leq 6\leq15\leq40\), so the sample and response counts are internally possible. The number of future assessable outcomes is \[ m=N-n=40-15=25. \] If \(Y\) is the response count among those 25 outcomes, then \(0\leq Y\leq25\), and the final response count is \[ T=x+Y=6+Y. \] Consequently, the feasible final count ranges from 6 to 31.

The state records \(N=40\), \(n=15\), \(x=6\), \(p_0=0.20\), and the prespecified terminal rule. The benchmark of 20% is not substituted for \(Y\), and it is not the observed interim response rate. The observed interim proportion is \(x/n=6/15=0.400\), or 40.0%; that descriptive proportion is based on the interim data and is distinct from the benchmark.

This specification is enough to identify the inputs and count constraints for subsequent predictive calculations. It does not yet tell us the probability that the terminal rule will be met.

Why the Final Count Is the Observed Count Plus the Future Count

The relationship \(T=x+Y\) follows by partitioning the planned participants into two disjoint groups: the \(n\) participants whose outcomes are observed at the interim look, and the \(N-n\) participants whose outcomes are still future. Each response counted at the end belongs to exactly one of these groups.

1
Partition the planned sample.
The interim group has \(n\) participants, and the future group has \(N-n\), so the two groups together contain \(N\) participants.
2
Count responses in each group.
The observed group contributes \(x\) responses by definition. Let the future group contribute \(Y\) responses.
3
Add the disjoint counts.
Every final response is in exactly one group, so \(T=x+Y\). Since \(0\leq Y\leq N-n\), it follows that \(x\leq T\leq N\).

This identity relies on consistent outcome definitions and a fixed planned total. If the design changes the sample size, the rule for what counts as a final outcome must also state which participants contribute to \(T\). If the study records more than one response assessment per person, the count must still be defined at the participant level or the model must explicitly use a different unit.

Worked Example: Translating a Terminal Count Rule

Consider a hypothetical design with \(N=32\), an interim sample of \(n=12\), and \(x=4\) observed responses. Suppose, solely for illustration, the protocol’s terminal rule assigns the favorable action if the final response count is at least \(c=10\).

The number of remaining outcomes is \[ m=32-12=20. \] The final count is \(T=4+Y\), where \(Y\) ranges from 0 to 20. The terminal rule is met when \[ T\geq10 \quad\Longleftrightarrow\quad 4+Y\geq10 \quad\Longleftrightarrow\quad Y\geq6. \] Thus at least 6 of the 20 future participants would need to respond to reach the illustrative count criterion. The maximum possible final count is \(4+20=24\), so the criterion is arithmetically attainable. No probability of reaching it has been calculated.

The rule must be read in context: \(c=10\) is an example of a prespecified terminal criterion, not a universal cutoff and not a conclusion about clinical efficacy. The appropriate criterion depends on the design’s clinical and statistical objectives.

What the State Captures—and What It Can Miss

Under a common response probability and conditionally independent binary outcomes, the aggregate counts \(n\) and \(x\) summarize the interim response data for the basic single-arm model. In that setting, the order in which the responses occurred does not affect the count-based state. This is one reason to define the endpoint and population clearly: the compact state is useful only insofar as its assumptions are reasonable for the intended model.

The aggregate state may not be adequate when response probabilities differ systematically across groups or over time. For example, if the trial population changes during recruitment or the treatment response probability drifts over calendar time, the order and timing of responses may contain information not represented by \(x\) alone. The earlier material on temporal drift is relevant to recognizing that possibility. A design may then need additional state variables, such as counts by cohort or period, and a model that represents the variation.

Likewise, if the terminal action depends on more than the total response count—such as a safety condition, a subgroup requirement, or a particular follow-up window—then \(\delta(T)\) alone is not a complete representation. The state and terminal rule must include the information those conditions use. A single count should not be treated as sufficient merely because it is easy to record.

Worked Example: Same Count, Different Information

Imagine a hypothetical study with \(N=30\), and consider two possible interim records after \(n=10\) participants: each record has \(x=4\) responses. In the first record, the responses are spread across the 10 participants’ recruitment period. In the second, all 4 responses occur among the first 5 participants and none among the next 5.

For a model that assumes a common response probability and conditionally independent outcomes, both records have the same count state: \(N=30\), \(n=10\), \(x=4\), and \(m=30-10=20\). Both have the same feasible future count range, \(0\leq Y\leq20\), and the same possible final totals, \(4\leq T\leq24\).

But if response probability is plausibly changing with calendar time, the timing pattern could matter. The two records then need not represent equivalent interim information. A count-only state would omit the feature that the model considers relevant; the remedy is not to reinterpret \(x\), but to specify an appropriate richer state and model. This example is a diagnostic warning, not evidence that either hypothetical pattern proves a time trend.

Common Mistakes and Alternatives

  • Confusing \(p_0\) with the unknown response probability. The benchmark is a design reference; \(\theta\) represents the response probability in the model. They can be compared in a clinical question, but they are not interchangeable quantities.
  • Calling all recruited participants “observed.” The interim count \(n\) is defined here by resolved, assessable outcomes. Enrollment alone does not establish a binary response result.
  • Using \(N-n\) as if it were the number of future responses. It is the number of future participants with outcomes; their response count \(Y\) is unknown and can range from 0 to \(N-n\).
  • Choosing a terminal cutoff after seeing the interim count. Doing so changes the decision rule in response to the data. The terminal criterion should be set as part of the design.
  • Assuming aggregate counts always suffice. They are suitable for the basic common-probability model, but a design with relevant time, subgroup, or safety structure may require additional state variables.

A fixed-sample analysis that waits for all \(N\) outcomes has no interim future-count state: at the terminal analysis, \(n=N\) and \(Y=0\). A boundary-based monitoring design may instead express interim actions directly in terms of observed counts. Predictive monitoring uses the same core count definitions but asks about future completion under a specified model. These approaches differ in what they use to guide interim action; none removes the need to define the endpoint, sample counts, benchmark, and terminal rule precisely.

The main limitation of the compact state is therefore structural: it does not repair a poorly defined endpoint, an unsuitable common-probability assumption, or a terminal rule that omits clinically important conditions. It is a carefully organized description of the design inputs, not a guarantee that the model is appropriate.

Check Your Understanding

Answer each question using the definitions above. Short solutions follow the questions.

  1. A hypothetical trial plans \(N=50\) assessable outcomes. At an interim look, \(n=18\) outcomes are resolved and \(x=7\) are responses. What are \(m\), the feasible range for \(Y\), and the feasible range for \(T\)?
  2. In a design with \(N=28\), \(n=10\), and \(x=3\), a hypothetical terminal count criterion is \(T\geq9\). How many future responses are needed to reach it, and is it attainable?
  3. Why is a benchmark \(p_0=0.25\) not the same as the interim observed response proportion when \(n=16\) and \(x=6\)?
  4. What is wrong with setting \(n\) equal to the number enrolled if some enrolled participants have unresolved response assessments?
  5. When might two interim records with the same \(n\) and \(x\) not be equivalent for monitoring?

Solutions. (1) \(m=N-n=50-18=32\), so \(0\leq Y\leq32\); since \(T=x+Y\), the final count ranges from 7 to \(7+32=39\). (2) The requirement is \(Y\geq9-3=6\). There are \(28-10=18\) future outcomes, so 6 responses are attainable. (3) The observed proportion is \(x/n=6/16=0.375\), or 37.5%; \(p_0=0.25\) is a prespecified benchmark, not a calculation from these interim data. (4) Enrollment does not mean an outcome is resolved; counting pending assessments as observed would misstate the available response count and the remaining outcomes. (5) If response behavior may vary by time, cohort, or another modeled feature, the pattern omitted by aggregate counts may matter and require additional state variables.

Clinical Biostats