Tutorials › Adaptive Clinical Trial Design › ANTICOV And Adaptive Trials In African Settings

Case Studies · Tutorial 793 of 799

ANTICOV And Adaptive Trials In African Settings

Learn how ANTICOV’s platform context shapes treatment comparisons and what must be checked before applying trial findings to a wider population.

Advanced 11 min read

What You'll Learn

  • Describe ANTICOV’s purpose as a multi-country platform for evaluating early COVID-19 treatments.
  • Distinguish a treatment’s biological promise from its local feasibility and relevance.
  • Identify recruitment and follow-up constraints that can affect who is represented in a trial.
  • Derive a standardized treatment effect for a target population from trial subgroup effects.
  • Check transportability assumptions, including conditional exchangeability and positivity.
  • Recognize why changing recruitment, care, or platform arms complicates comparisons.

Why ANTICOV’s Setting Matters

A treatment can be scientifically promising and still be a poor choice for a particular setting if it is hard to obtain, difficult to administer, or unlikely to address the outcomes that matter there. Conversely, a treatment that is inexpensive and locally available is not effective merely because it is practical. Adaptive trial design has to connect these questions: which comparisons are worth making, how can eligible participants be recruited and followed, and to whom do the results apply?

ANTICOV was an open-label, multi-country randomized platform trial focused on early treatment for people with mild-to-moderate COVID-19 in African settings. Its motivating clinical question was whether early treatment could help prevent progression to severe disease. A platform structure can evaluate multiple treatment options under a shared framework, while allowing the set of comparisons to change over time. That structure does not, by itself, guarantee that treatment choices are locally suitable, recruitment is representative, or effects will generalize across countries.

Definition: Transportability is the extent to which a treatment effect estimated in a trial population can be used to describe the effect in a specified target population. It requires more than a similar disease label: the populations, treatment versions, care context, outcome definition, and effect-modifying characteristics must be considered.

The case-study lesson is to separate three questions. First, is a treatment comparison internally credible among the people randomized? Second, can sites recruit and retain enough eligible participants to answer it? Third, does the estimated effect apply to the population and care settings for which a decision is being made? A sound answer to one question does not automatically answer the others.

Local Relevance Is a Design Question

A locally relevant treatment option is not simply one developed or manufactured nearby. Relevance depends on the clinical question and the treatment’s practical use in the intended setting. Useful considerations include whether the drug can be procured consistently, whether its formulation and dosing are feasible, whether monitoring is available, whether it has important interactions with common therapies, and whether the expected benefit is meaningful for the population being treated.

For early COVID-19, the intended patients may have relatively mild symptoms at enrollment, while the outcome of greatest concern is later deterioration. This can make recruitment and follow-up difficult: people who feel only mildly unwell may not seek care promptly, live near a study site, or return for repeated assessment. A trial needs an outcome definition that is clinically meaningful and ascertainable across participating sites. It also needs to distinguish inability to observe an outcome from evidence that the outcome did not occur.

In a platform trial, local relevance should inform which comparisons are proposed and whether they remain feasible as evidence and care change. A shared protocol can support efficient evaluation, but a platform is not a license to treat all arms, sites, or calendar periods as interchangeable. Treatment availability, usual care, and the distribution of recruited participants can differ across sites and over time.

Recruitment Constraints and Who Enters the Trial

Recruitment is part of the scientific design because it determines which people contribute outcome data. For mild-to-moderate illness, a participant may need to be identified soon after symptom onset for an early-treatment question. Distance to a clinic, transport costs, language, health-system capacity, and the ability to complete follow-up can all shape enrollment. These factors are not merely administrative inconveniences: they can select a trial population that differs from people who do not enroll.

A recruitment shortfall also affects precision. If the event of interest is uncommon, enrolling fewer participants than planned may leave a wide interval around the estimated effect. A low event rate can be clinically important and still make it difficult to distinguish a useful treatment effect from chance variation. Operational monitoring should therefore track screened, eligible, approached, enrolled, treated, and followed participants, as well as reasons for non-enrollment and missing outcomes.

Worked Example: Locating a Recruitment Bottleneck

Hypothetical illustration: Suppose a participating network screens 300 people with mild-to-moderate COVID-19 over a defined period. Of these, 180 meet the clinical eligibility criteria, 120 are approached, and 72 enroll. Assume the counts refer to successive stages of the same recruitment flow.

The fraction meeting clinical eligibility among those screened is \(180/300=0.60\), or 60%. The approach fraction among eligible people is \(120/180=0.667\), or 66.7%. The enrollment fraction among those approached is \(72/120=0.60\), or 60%. Overall, \(72/300=0.24\), or 24% of screened people enroll.

The largest numerical loss is from screened to eligible (120 people), but that loss may reflect clinically appropriate criteria. The 60 eligible people who were not approached and the 48 approached people who did not enroll point to different operational questions. The first group may indicate staffing or timing limitations; the second may indicate consent, travel, or treatment concerns. These hypothetical counts do not establish why anyone declined. Reasons must be recorded to distinguish explanations.

If the study needs 100 enrollments and the same overall 24% screening-to-enrollment fraction continues, the required screening volume is \(100/0.24=416.7\), or about 417 people. This is a planning approximation, not a guarantee: the fraction can change across sites or as recruitment conditions change.

A high enrollment fraction is not automatically evidence of representativeness. A site might enroll most people who can reach it while failing to reach people who live farther away. Comparing participant characteristics with the intended target population, where reliable data exist, can reveal such gaps. Recruitment reports should also be examined by site and time period rather than only as a pooled total.

From Trial Effects to a Target Population

Suppose the treatment effect differs across characteristics such as age or baseline disease risk. Then the average effect in the trial depends partly on the mix of those characteristics among enrolled participants. If the target population has a different mix, a trial-wide average may not describe the target average even when the trial’s within-group comparisons are credible.

Let \(S=1\) indicate trial participation and \(S=0\) indicate membership in the target population outside the trial. Let \(X\) denote measured baseline characteristics, and let \(Y^a\) denote the outcome that would be observed under treatment \(a\). For a binary outcome, define the conditional risk difference at \(X=x\) as \(\tau(x)=E(Y^1\mid X=x,S=1)-E(Y^0\mid X=x,S=1)\).

Transport standardization: If the conditional treatment effect is transportable given \(X\), the target-population average risk difference is \(\tau_{\text{target}}=E\{\tau(X)\mid S=0\}\). For discrete strata \(x\), this is \(\tau_{\text{target}}=\sum_x \tau(x)P(X=x\mid S=0)\). The weights are the proportions of those strata in the target population, not their proportions in the trial.

This calculation relies on assumptions. Treatment must be well-defined and consistently delivered; the randomized comparison must identify the relevant conditional effects in the trial; the variables in \(X\) must capture the effect modifiers needed for transport; and every target-population stratum with positive weight must have adequate trial representation. The last requirement is called positivity. If a target group is absent from the trial, its effect cannot be recovered by reweighting observed groups alone.

A short justification shows why the standardization formula is appropriate. If the conditional mean outcome under treatment \(a\) is equal between trial participants and the target population given \(X\), then the target mean under \(a\) is the target-weighted average of the trial conditional means:

$$ E(Y^a\mid S=0) =\sum_x E(Y^a\mid X=x,S=0)P(X=x\mid S=0) =\sum_x E(Y^a\mid X=x,S=1)P(X=x\mid S=0). $$

Subtract the corresponding expression for \(a=0\) from the expression for \(a=1\). The result is the target-weighted average of the conditional trial risk differences. This derivation also exposes the limitation: if conditional outcomes differ between trial and target populations even after accounting for \(X\), the equality does not hold.

Worked Example: Standardizing to a Different Risk Mix

Hypothetical illustration, not an ANTICOV result: Suppose trial participants fall into two baseline-risk groups. In the lower-risk group, the estimated risk difference for progression under treatment versus control is \(-0.02\), or 2 percentage points fewer progressions. In the higher-risk group, it is \(-0.10\), or 10 percentage points fewer. Suppose 30% of the target population is higher risk, compared with 50% of the trial participants.

The unstandardized trial average, using the trial’s 50% higher-risk share, is

$$ (0.50)(-0.02)+(0.50)(-0.10)=-0.01-0.05=-0.06. $$

This is an estimated reduction of 6 percentage points in the trial’s risk mix. For the target mix, the estimate is

$$ (0.70)(-0.02)+(0.30)(-0.10)=-0.014-0.030=-0.044. $$

The standardized target estimate is a 4.4 percentage-point reduction in progression risk. The difference between \(-6.0\) and \(-4.4\) percentage points arises from different group weights, not from a change in the assumed group-specific effects. This interpretation is justified only if the group-specific effects are applicable to the target groups and the groups are measured comparably.

Comparisons, Adaptation, and Changing Context

The main alternative to transporting a trial estimate by standardization is to report the randomized estimate for the enrolled participants and avoid claiming that it represents a different population. That is often the more defensible choice when important effect modifiers are unknown or target-population data are unavailable. Standardization can improve relevance when the required data and assumptions are credible; it cannot repair missing information by itself.

A platform also differs from a set of unrelated fixed trials. It can use a shared infrastructure and control group, and can add or discontinue comparisons under its governance and protocol. However, a control observed during one period may not be a suitable comparison for an intervention observed during another if standard care, circulating variants, eligibility, or outcome assessment have changed. A comparison should therefore be interpreted with attention to calendar time, site, and the platform’s prespecified analysis plan. Shared infrastructure is an efficiency, not an assumption of identical conditions.

Worked Example: A Changing Recruitment Mix

Hypothetical illustration: In an early enrollment period, 80 of 100 randomized participants are recruited at urban sites; in a later period, 30 of 100 are urban and 70 are recruited at rural sites. Suppose the urban proportion is therefore 80% early and 30% later. If rural participants have a higher baseline progression risk, a pooled outcome rate can change across periods even if treatment effects within each site type do not change.

For example, assume a hypothetical control-group progression risk of 10% in urban participants and 20% in rural participants. The expected control risk under the early mix is \((0.80)(0.10)+(0.20)(0.20)=0.12\), or 12%. Under the later mix it is \((0.30)(0.10)+(0.70)(0.20)=0.17\), or 17%. The five-point difference is explained by the changed mix under these assumptions; it does not by itself show that care worsened or an intervention became less effective.

The practical response is to inspect outcome and recruitment patterns by site and period, and to use the comparison and adjustment strategy specified in the protocol. This illustration does not imply that ANTICOV had these site proportions or risks.

Diagnostics and Common Pitfalls

Several warning signs merit investigation: large differences in eligibility or enrollment across sites; substantial missing outcome follow-up; changing definitions or timing of outcome assessment; target groups with little or no trial representation; or recruitment and control outcomes that shift over calendar time. These patterns do not automatically invalidate a trial, but they limit what can be concluded until their causes and analytic consequences are assessed.

  • Confusing feasibility with efficacy. A treatment that is easy to distribute has practical value, but feasibility alone is not evidence that it reduces progression.
  • Assuming a multicountry average applies everywhere. A pooled effect is an average for the enrolled mix under the trial conditions. It is not automatically the effect in each participating country or in all African settings.
  • Reweighting without overlap. If the target population includes a group that the trial did not enroll, assigning it a weight cannot supply its unobserved treatment effect.
  • Treating non-enrollment as random. People who cannot reach a site or decline participation may differ systematically from participants. Recruitment counts alone do not show the direction or size of the resulting selection.
  • Reading a changing pooled rate as a treatment effect. Changes in participant mix, time, or usual care can alter crude rates. The randomized treatment comparison and relevant context must be examined.

The limitations are consequential. Transportability depends on the quality and completeness of baseline and target-population data, and an unmeasured effect modifier can undermine standardization. Local treatment availability and care pathways may also change after a trial begins. Adaptive governance should therefore include ongoing checks of feasibility and relevance, while preserving clear documentation of which comparisons and populations support each conclusion.

Check Your Understanding

Answer each question, then compare with the solutions below.

  1. A target population is 25% in a higher-risk group. Estimated trial risk differences are \(-0.03\) in the lower-risk group and \(-0.11\) in the higher-risk group. What is the standardized target risk difference?
  2. Why does enrolling many participants at a few easily accessible sites not, by itself, establish that the trial represents the wider target population?
  3. What does positivity require when standardizing a trial effect to a target population?
  4. A crude control outcome rate rises after the participant mix changes. Name one reason this need not indicate a change in treatment effectiveness.

Solutions. (1) The lower-risk share is \(1-0.25=0.75\), so the standardized difference is \((0.75)(-0.03)+(0.25)(-0.11)=-0.0225-0.0275=-0.050\), or 5 percentage points fewer outcomes under treatment, under the stated assumptions. (2) Accessibility can select who enrolls; people outside the sites’ reach may differ in baseline risk, care, or effect modifiers. (3) Every target stratum with positive population weight must have adequate representation in the trial for its conditional effect to be estimated. (4) A different proportion of higher-risk participants can raise the crude rate even if within-group risks and treatment effects are unchanged.

Clinical Biostats