← Clinical Trials
Actinic Keratosis Phase 3 Binary Endpoint NCT02799082

Evaluation of Efficacy and Safety of BF-200 ALA Used With Photodynamic Therapy in Patients With Actinic Keratosis.: Complete Statistical Analysis

This randomized, double-blind Phase III study evaluated BF-200 ALA used with photodynamic therapy for actinic keratosis. The primary result is the percentage of participants with complete clearance of all target-area lesions 12 weeks after the last treatment.

Trial start: 2007-12  ·  Enrollment: 122  ·  Sponsor: Biofrontera Bioscience GmbH
Scope of this record

This page provides an independent statistical analysis and educational interpretation of publicly reported results. ClinicalTrials.gov provides the official trial registry record. Numerical trial results on this page are restricted to the results posted in the ClinicalTrials.gov record; calculations added by Clinical Biostats are labelled as such.

1. Trial at a Glance

This page covers the registry results for Evaluation of Efficacy and Safety of BF-200 ALA Used With Photodynamic Therapy in Patients With Actinic Keratosis. (NCT02799082), a randomized phase 3 study. The primary outcome is Total Patient Clearance Rate 12 Weeks After the Last Photodynamic Therapy (PDT).

122
Enrollment
Phase 3
2
Arms
In the primary outcome
+53.8 pts
Risk difference
BF-200 ALA
39.2 to 68.3 pts
95% CI
Two-sided
FeatureRegistry value
ClinicalTrials.gov identifierNCT02799082
PhasePhase 3
ConditionActinic Keratosis
AllocationRandomized
Design modelParallel
MaskingDouble
Enrollment122
Arms in the primary outcome2
Lead sponsorBiofrontera Bioscience GmbH
Results postedYes

2. Clinical Question

Population

Participants with actinic keratosis were enrolled in a multicenter study. The primary outcome was reported for the full analysis set, overall. The registry record gives enrollment as 122; the primary outcome results list 40 participants in the Vehicle group and 80 in the BF-200 ALA group.

Intervention

BF-200 ALA was applied topically as a gel containing 78 mg/g 5-aminolevulinic acid, followed by photodynamic therapy. The application description specifies a 1 mm layer covering each lesion and a 0.5 cm to 1.0 cm surrounding margin.

Comparator

The comparator was a matched placebo gel without active ingredient, called Vehicle in the registry record. Its application description gives the same layer thickness and surrounding margin as the BF-200 ALA description.

Primary question

Among participants with actinic keratosis, what percentage had complete remission of all actinic keratosis lesions in the target area or areas 12 weeks after the last photodynamic therapy? The outcome could be assessed after the first treatment or, in cases of retreatment, after the second treatment.

The question concerns complete clearance at the participant level, not the response of an individual lesion. A participant counted as clear only if all target-area lesions were in complete remission at the assessment. The registry record also lists lesion-level clearance, changes in lesion size and area, and other clearance and cosmetic outcomes as secondary measures. Those outcomes address related but distinct aspects of treatment response; they do not replace the primary question about complete patient clearance.

3. Trial Design

The registry describes a randomized, double-blind, Phase III, multicenter study with a parallel design. It compared topical BF-200 ALA with a matched Vehicle gel in participants with actinic keratosis, with photodynamic therapy used in both treatment descriptions. The study title and brief description identify evaluation of efficacy and safety as its purpose. The registry lists Biofrontera Bioscience GmbH as sponsor and reports a completed study.

Enrollment was 122. For the primary endpoint, the full analysis set included 40 participants in the Vehicle group and 80 in the BF-200 ALA group. The registry describes that endpoint as the percentage of participants with complete remission of all actinic keratosis lesions in the target area or areas. The assessment took place 12 weeks after the last photodynamic therapy, up to 24 weeks. The endpoint description allows assessment after the first photodynamic therapy or, if retreatment occurred, after the second.

The arm descriptions specify topical application of a 1 mm thick layer over each lesion and a 0.5 cm to 1.0 cm surrounding margin. The BF-200 ALA gel contained 78 mg/g 5-aminolevulinic acid, while the Vehicle gel contained no active ingredient. The registry record identifies randomization and double masking but does not report the method used to generate the allocation sequence, how allocation was concealed, or the practical procedures used to maintain masking.

The study start is reported as 2007-12 and primary completion as 2008-10. The registry record does not report the original sample-size justification or the detailed design assumptions behind the trial’s planned enrollment. Those details cannot be inferred from the results or from the planning illustrations based on the observed effects.

4. Participant Flow and Accounting

The registry reports how participants moved through each stage of the study. All counts below are exactly as posted; missing counts are not inferred from other stages.

Before assignment: 128 patients were screened, of whom 122 patients were randomized (41 patients to the vehicle/placebo group, 81 patients to the BF-200 ALA group); 6 patients were screening failures (3 patients refused to participate, 3 patients meet exclusion criteria).

Overall Study

StageVehicleBF-200 ALA
STARTED4181
COMPLETED3777
NOT COMPLETED44

Reasons for not completing this period:

ReasonVehicleBF-200 ALA
Refused second PDT or withdraw consent43
Protocol Violation01

Analysis population for the primary outcome, as defined in the registry: Full analysis set (FAS), Overall

5. Baseline Characteristics

The table reproduces the baseline characteristics posted in the registry, which describe the participants analysed at baseline and help show whether the randomized groups were comparable.

Population: Baseline description is given for the FAS (Full Analysis Set). One patient each in the vehicle/placebo groupd and in the BF-200 ALA group dropped out without a post-treatment assessment of the target lesions and thus were not considered for the FAS.

CharacteristicUnitVehicleBF-200 ALATotal
Participants analysed4080120
Age, Categorical: <=18 yearsParticipants000
Age, Categorical: Between 18 and 65 yearsParticipants51015
Age, Categorical: >=65 yearsParticipants3570105
Age, Continuousyears70.8 (SD 6.7)70.4 (SD 5.2)70.5 (SD 5.7)
Sex: Female, Male: FemaleParticipants9817
Sex: Female, Male: MaleParticipants3172103
Race (NIH/OMB): American Indian or Alaska NativeParticipants000
Race (NIH/OMB): AsianParticipants000
Race (NIH/OMB): Native Hawaiian or Other Pacific IslanderParticipants000
Race (NIH/OMB): Black or African AmericanParticipants000
Race (NIH/OMB): WhiteParticipants4080120
Race (NIH/OMB): More than one raceParticipants000
Race (NIH/OMB): Unknown or Not ReportedParticipants000
Region of Enrollment: Germanyparticipants4080120
Maximal severity of AK at baseline: mildparticipants111930
Maximal severity of AK at baseline: moderateparticipants296190

6. Primary Endpoint

The registry lists the primary outcome as Total Patient Clearance Rate 12 Weeks After the Last Photodynamic Therapy (PDT), measured over 12 weeks after the last photodynamic therapy (PDT), up to 24 weeks.

ElementRegistry entry
Result typeNumber
Measure of spread95% Confidence Interval
Unitpercentage of participants
Endpoint classificationBinary Endpoint

The primary endpoint is the total patient clearance rate 12 weeks after the last photodynamic therapy. It measures the percentage of participants whose actinic keratosis lesions in the target area or areas were all in complete remission at the assessment. This is a participant-level binary outcome: each participant either met the complete-clearance definition or did not.

Complete patient clearance is useful because it captures an outcome across the full target area rather than describing the average response of individual lesions. It therefore asks whether a participant reached complete remission across all lesions included in the target area or areas. That is a stricter outcome than partial clearance or clearance of some lesions, which the registry lists separately among secondary outcomes.

The timing matters to interpretation. Assessment was 12 weeks after the last photodynamic therapy, with the registry timeframe extending up to 24 weeks. The description states that the assessment followed the first photodynamic therapy, or the second when retreatment occurred. The endpoint consequently reflects status at the specified post-treatment assessment, not a longer-term measure of persistence or recurrence. Such longer-term outcomes are not reported in the registry record.

The primary outcome is reported as a percentage with a 95% confidence interval for each arm. The interval conveys uncertainty around each estimated arm-specific percentage; the comparison between arms is a separate statistical question. Neither the percentage nor its interval alone establishes how the trial handled missing endpoint assessments or whether all randomized participants were included in the analysis. Those details are not reported in the registry record.

7. Results Posted in the Registry

Risk difference: BF-200 ALA

+53.8

95% CI: 39.2 to 68.3 percentage points

Recalculated from the posted summary statistics

Primary outcome by arm, with 95% confidence intervals
Primary outcome by arm with 95% confidence intervals0.016.533.149.666.182.7Vehicle (n=40)BF-200 ALA (n=80)% of participants (95% CI)
Treatment effect versus the control arm
Forest plot of risk difference (percentage points) vs control (95% CI)BF-200 ALA-5.471026425874risk difference (percentage points) vs control (95% CI)

8. Secondary Efficacy Endpoints

The registry also posts results for secondary outcomes. For each outcome below, the endpoint type, the test applied to the posted summary statistics, the result and its interpretation are given in turn. Secondary endpoints are usually not adjusted for multiple testing, so they support rather than confirm the primary finding.

Secondary outcomeTypeEffect measureEstimate (95% CI)Planning size, 80% power
Change in Total Lesion Size 12 Weeks After the Last PDTContinuous EndpointMean difference-249.90 (-327.15 to -172.65)10 per arm
Change in Total Lesion Area 12 Weeks After the Last PDT (Treated Area Face)Continuous EndpointMean difference-220.90 (-313.80 to -128.00)14 per arm
Change in Total Lesion Area 12 Weeks After the Last PDT (Treated Area Scalp)Continuous EndpointMean difference-227.90 (-331.83 to -123.97)11 per arm

Change in Total Lesion Size 12 Weeks After the Last PDT

Treatment effect versus the control arm
Forest plot of mean difference vs control (95% CI)BF-200 ALA-353-277-202-126-5026mean difference vs control (95% CI)

Change in Total Lesion Area 12 Weeks After the Last PDT (Treated Area Face)

Treatment effect versus the control arm
Forest plot of mean difference vs control (95% CI)BF-200 ALA-339-266-193-120-4825mean difference vs control (95% CI)

Change in Total Lesion Area 12 Weeks After the Last PDT (Treated Area Scalp)

Treatment effect versus the control arm
Forest plot of mean difference vs control (95% CI)BF-200 ALA-358-281-204-127-5027mean difference vs control (95% CI)

The registry lists a range of secondary outcomes, including lesion-level complete remission, remission with a narrow spectrum lamp, changes in lesion size and treated area, participant clearance outcomes, and overall cosmetic outcome. The posted continuous results concern change in total lesion size and changes in treated area for the face and scalp. The reported mean changes are negative in both groups for those measures, with larger decreases in the BF-200 ALA group than in the Vehicle group. Each posted unadjusted comparison has p < 0.001.

These secondary measures are directionally consistent with the primary result in that they describe greater observed lesion reduction in the BF-200 ALA group. They are related outcomes, not interchangeable definitions of success: changes in size or area quantify average change, whereas the primary endpoint requires complete remission of every target-area lesion for a participant. The secondary outcomes can therefore add context about response without replacing the primary endpoint.

Secondary analyses generally carry less confirmatory weight when many outcomes are examined, especially when no adjustment for multiple testing is reported. Testing multiple outcomes increases the chance that some comparisons appear statistically notable by chance alone. The registry record lists 15 outcome measures and 4 analyses, but does not report a multiplicity adjustment or identify a hierarchy for interpreting secondary endpoints. The posted secondary p-values should therefore be treated as unadjusted evidence rather than as a set of independent confirmations.

The registry record does not provide detailed results for every listed secondary outcome in the registry record for this analysis. The pattern should not be generalized to outcomes whose numerical estimates are not reported. Nor do the posted results establish persistence, recurrence, or effects beyond the stated assessment. Overall, the secondary findings offer supportive context for the primary clearance result, while the primary endpoint remains the main basis for the study’s efficacy comparison and the unadjusted secondary findings remain exploratory in interpretation.

Secondary outcomes registered for this trial, for reference (only those above were recalculated):

9. Statistical Interpretation

Clinical Biostats interpretation

In the full analysis set, the reported complete patient clearance rate was 66.3% for BF-200 ALA and 12.5% for Vehicle. The corresponding 95% confidence intervals were 54.8% to 76.4% and 4.2% to 26.8%. These estimates describe the proportion meeting the registry’s definition of complete remission of all lesions in the target area or areas at the specified follow-up assessment.

The posted arm estimates show a higher observed clearance percentage in the BF-200 ALA group than in the Vehicle group. The recalculated unadjusted risk difference is 0.537, with a 95% confidence interval from 0.392 to 0.683. This expresses the absolute separation between the observed percentages on the proportion scale. The interval is entirely above zero, indicating that this unadjusted estimate is not compatible with no difference under the calculation used. The registry’s own analysis is separate and should take precedence for the trial’s reported inferential conclusion.

The registry reports a Cochran-Mantel-Haenszel analysis with p < 0.001. A simple unadjusted recalculation from the posted summary counts gives p < 0.001. These are not competing versions of the same analysis: the registry analysis uses the named Cochran-Mantel-Haenszel method, while the recalculation is an unadjusted comparison based on the posted counts. Their p-value thresholds differ, but both are reported as less than their stated thresholds. The sponsor’s own analysis takes precedence when describing the trial’s formal result.

The confidence intervals also matter. The point estimates are not exact population values; they are estimates based on the participants in the analysis. The arm-specific intervals indicate uncertainty about each percentage, and the interval for the risk difference indicates uncertainty about the unadjusted comparison. The observed results support a clear separation in this study, but they do not by themselves establish that the magnitude would be identical in another population, setting, or follow-up period.

The primary outcome is a complete-clearance measure at a particular assessment time. It does not describe every lesion-level response, the duration of clearance beyond the stated assessment, or the balance of all benefits and harms. Nor does a statistical comparison answer every clinical question. The registry record does not report the detailed analysis plan, the original sample-size justification, or how missing outcome data were handled. These omissions limit how fully the primary analysis can be reconstructed from the registry entry.

The result should therefore be read narrowly: the posted full-analysis-set percentages and the registry’s reported comparison show a higher complete-clearance percentage for BF-200 ALA than for Vehicle at the specified assessment. The statistical evidence is strong according to the reported analysis, while the exact precision and scope of inference remain bounded by the confidence intervals, the outcome definition, the analysis population, and the information available in the registry record.

10. Statistical Methods Explained

The primary endpoint is binary at the participant level. A participant is classified according to whether all actinic keratosis lesions in the target area or areas were in complete remission at the assessment. The arm-specific clearance rate is the percentage of participants meeting that definition. For this kind of outcome, results are naturally expressed as proportions or percentages, and comparisons can be made using measures such as a risk difference, risk ratio, or odds ratio. The registry’s reported inferential method is Cochran-Mantel-Haenszel; the separately posted unadjusted recalculation gives a risk difference, risk ratio, odds ratio, and unadjusted p-value.

What the arm percentages mean

The percentage for an arm estimates the proportion of participants in that analysis group who met the endpoint definition. The estimate is not a guarantee that the same percentage would occur in every population. It is based on the observed participants and is subject to sampling uncertainty. The 95% confidence interval gives a range of values compatible with the observed data under the interval method’s assumptions. Wider intervals indicate less precision than narrower intervals, although the interval also needs to be interpreted in light of the design and analysis population.

The outcome is complete clearance, rather than a graded score. This distinction is important: a participant with substantial improvement but not complete remission of all target-area lesions does not meet the stated primary endpoint definition. The registry separately lists partial clearance and lesion-level remission outcomes, which can describe response patterns that the complete-clearance endpoint does not capture.

Comparing the arms

A risk difference is the absolute difference between the two estimated proportions. It is expressed on the proportion scale and directly describes how far apart the observed rates are. A risk ratio compares the two proportions as a relative measure, while an odds ratio compares the odds of the outcome. These measures answer different questions and can have different numerical scales. The recalculated measures are unadjusted summaries of the posted group counts; they are not substitutes for the trial’s own analysis.

The registry reports a Cochran-Mantel-Haenszel analysis. In general, this method compares categorical outcomes while accounting for strata, when strata are included in the analysis. The registry record does not identify the specific stratification variables or provide a detailed statistical analysis plan, so the precise implementation cannot be reconstructed. Its reported p-value is p < 0.001. The recalculated unadjusted comparison reports p < 0.001. Because the methods differ, the values should be described as results from their respective analyses rather than treated as an inconsistency.

What a p-value says

In general, a p-value describes how unusual data at least as inconsistent with a specified null hypothesis would be if that null hypothesis and the analysis assumptions held. A small p-value is evidence against that null hypothesis under those assumptions. It is not the probability that the null hypothesis is true, and it does not measure the size or practical importance of an effect. The estimated percentages and confidence intervals are needed to describe magnitude and precision alongside the p-value.

The registry’s p-value supports a statistical comparison under its reported method. It does not establish that every participant had the same response, that the result persists beyond the stated follow-up, or that the outcome applies unchanged to people outside the study population. Those are separate questions that the reported analysis does not answer.

Over-dispersion and binary outcomes

For a binary outcome, each participant contributes an event status rather than a continuous measurement. In general, simple binomial methods assume that participants contribute independent outcomes and that the event probability is adequately described by the model. Over-dispersion means the observed variability is greater than the model expects. It can arise when outcomes are more heterogeneous or correlated than the model accounts for; in that circumstance, standard errors may be too small if the extra variability is ignored. The registry record does not report an over-dispersion assessment or a model-based variance adjustment, so no such adjustment should be presumed for this trial.

Because the registry’s reported method is Cochran-Mantel-Haenszel, the result should be understood according to that named categorical-outcome approach, not as a continuous-outcome model. The available registry entry does not provide enough detail to determine all assumptions or implementation choices. The recalculated unadjusted comparison is simpler and uses only the posted summary counts, without adjustment for any strata.

Analysis population and endpoint timing

The primary population is called the full analysis set, overall. The registry record does not explain the full analysis set’s operational definition, the treatment of participants who did not complete follow-up, or the handling of missing endpoint data. It also does not report whether the analysis followed an intention-to-treat principle as defined in a protocol. The population label should therefore be quoted as reported without assigning additional meaning to it.

The assessment occurred 12 weeks after the last photodynamic therapy, up to 24 weeks, and could follow the first or second photodynamic therapy in the case of retreatment. This timing defines the estimand represented by the endpoint: clearance at that post-treatment assessment. It is not a measure of time to clearance, durability beyond the assessment, or recurrence after an initially clear result.

11. Confidence Intervals and Precision

For the primary endpoint, the BF-200 ALA clearance estimate is 66.3%, with a 95% confidence interval from 54.8% to 76.4%. The Vehicle estimate is 12.5%, with a 95% confidence interval from 4.2% to 26.8%. These intervals express uncertainty around the arm-specific percentages; they should not be read as containing 95% of individual participant outcomes.

The recalculated unadjusted risk difference is 0.537, with a 95% confidence interval from 0.392 to 0.683. This interval describes uncertainty around the absolute difference between the posted proportions under the unadjusted calculation. Its endpoints are both above zero, so the interval excludes a null difference for this calculation. The registry’s own inferential analysis remains the primary reported comparison and has p < 0.001.

Confidence intervals are useful because they show more than whether a test crossed a significance threshold. They indicate a range of effect values compatible with the data and method, while the width conveys precision. The arm-specific intervals and the interval for the difference are different quantities and should not be interchanged. Their interpretation also depends on the analysis method and assumptions, which are not fully documented in the registry record.

These estimates apply to the full analysis set at the endpoint’s stated assessment. The registry record does not report missing-data methods or a sensitivity analysis. Consequently, the intervals cannot resolve uncertainty about how missing observations may have affected the estimates. They also do not quantify uncertainty about generalizing to other settings or about outcomes beyond the follow-up assessment.

12. Planning a Similar Trial: Sample Size

This is a planning illustration, not a re-evaluation of the original trial. It asks: if a new study wanted to detect a difference like the one observed, or a smaller one, how large would it need to be? It is deliberately not “observed power” of the finished trial, which is not a meaningful quantity.

Effect to detectParticipants per arm, 80% powerParticipants per arm, 90% power
100% of the observed effect1216
75% of the observed effect2127
50% of the observed effect4154
Sample size needed versus the size of the effect to detect
Sample size needed versus size of effect to detect10205010040%60%80%100%80% power90% powersize of effect to detect, as % of the effect observed (log vertical scale: participants per arm)
Method and assumptions. Two-sided α = 0.05, 1:1 allocation, pooled-variance normal approximation for two proportions. Counts were reconstructed from the posted percentages and arm sizes, so small rounding differences are possible. Calculated for the comparison: BF-200 ALA.

The planning illustrations show participants per arm for 80% power and participants per arm for 90% power. These are planning quantities, not observed trial results. The registry record does not report the original sample-size justification or the trial’s own design assumptions; the figures in these illustrations use the observed effect as a starting point.

The stated planning assumptions are a two-sided significance level of 0.05, equal allocation between the two arms, and a normal approximation. The effect to detect is set to the stated fraction of the observed effect. For the binary primary outcome and the continuous secondary outcomes, the figures are participants per arm. The note about total events applies to time-to-event tables, and these results do not include a time-to-event outcome.

The 80% power column represents the planned number of participants per arm under which the calculation would have an 80% chance of detecting the specified effect if the assumptions held and the effect were real. The 90% power column uses a higher probability of detecting that specified effect under the same planning framework. Greater planned power generally requires a larger sample size for a given effect and assumptions.

Rows planning for a smaller fraction of the observed effect call for more participants per arm than rows planning for the full observed effect. This is because smaller differences are harder to distinguish from random variation. The observed effect is not guaranteed to recur in a future study, and the calculations depend on the assumptions stated for the illustration. This is not observed power.

These figures should not be read as evidence that the completed trial was designed around the posted effects, nor as a recommendation for a future trial’s sample size. A design decision would require a target effect and assumptions chosen before the study, along with considerations not documented in the registry record. The illustrations are best read as showing how required sample size changes as the target effect and desired power change under the listed assumptions.

13. How the Sample Size Is Derived

Power is the probability that a study of a given size rejects the null hypothesis when a specific true effect exists. It depends on four things: the effect to detect, the variability of the outcome, the significance level (here a two-sided α of 0.05, so z1−α/2 = 1.960) and the desired power (z1−β = 0.842 for 80% and 1.282 for 90%).

Formula

n = [ z1−α/2 √(2p̄(1−p̄)) + z1−β √(p0(1−p0) + p1(1−p1)) ]2 / (p1 − p0)2

n is the number of participants in each arm, p0 and p1 are the control and treatment proportions, and p̄ is their average.

Worked calculation for this trial

  1. Control proportion p0 = 0.125; treatment proportion p1 = 0.662; average p̄ = 0.394.
  2. First term: z1−α/2 × √[2p̄(1−p̄)] = 1.96 × 0.6910 = 1.3543.
  3. Second term: z1−β × √[p0(1−p0) + p1(1−p1)] = 0.842 × 0.5770 = 0.4856.
  4. n = (1.3543 + 0.4856)2 / (0.5375)2 = 11.7, rounded up to 12 participants per arm for 80% power.

The smaller-effect rows in the table above repeat the same calculation with the effect multiplied by 0.75 and 0.5 (for ratios, applied to the logarithm of the ratio).

R code

alpha <- 0.05
z_a   <- qnorm(1 - alpha / 2)          # two-sided
p0 <- 0.125                          # control proportion
p1 <- 0.6625                          # treatment proportion
n_per_arm <- function(power, frac = 1) {
  q1 <- p0 + (p1 - p0) * frac               # smaller effect = fraction of the observed difference
  pbar <- (p0 + q1) / 2
  z_b <- qnorm(power)
  ceiling(round((z_a * sqrt(2 * pbar * (1 - pbar)) + z_b * sqrt(p0 * (1 - p0) + q1 * (1 - q1)))^2 / (q1 - p0)^2, 6))
}
for (f in c(1, 0.75, 0.5))
  cat(sprintf("%3.0f%% of observed effect: n per arm = %s (80%% power), %s (90%% power)\n", 100 * f,
              format(n_per_arm(0.80, f), big.mark = ","), format(n_per_arm(0.90, f), big.mark = ",")))

# Check against R's built-in function (unrounded n per arm)
cat("power.prop.test:", round(power.prop.test(p1 = p0, p2 = p1, power = 0.80)$n, 1), "\n")

# Simulation: how often does the z-test reject at the 80%-power sample size?
set.seed(2799082)
n    <- n_per_arm(0.80)
reps <- 20000
x0 <- rbinom(reps, n, p0); x1 <- rbinom(reps, n, p1)
ph <- (x0 + x1) / (2 * n)
z  <- ((x1 - x0) / n) / sqrt(ph * (1 - ph) * 2 / n)
cat(sprintf("Simulated power at n = %s per arm: %.3f (%d replicates)\n", format(n, big.mark = ","), mean(abs(z) > z_a, na.rm = TRUE), reps))

Output from running the code

100% of observed effect: n per arm = 12 (80% power), 16 (90% power)
 75% of observed effect: n per arm = 21 (80% power), 27 (90% power)
 50% of observed effect: n per arm = 41 (80% power), 54 (90% power)
power.prop.test: 11.7 
Simulated power at n = 12 per arm: 0.840 (20000 replicates)

The simulation draws many pairs of event counts at the planned sample size and counts how often the two-proportion z-test rejects the null. It should land close to the target power; at very small required sample sizes it can fall below it, because the normal approximation is rough there.

Very small required sample. The formula gives a very small requirement because the observed effect is very large relative to the variability. Normal-approximation formulas are unreliable at such sizes, and the simulation above shows the power actually achieved. An exact or simulation-based design would be needed in practice.

14. Analyses Reported by the Sponsor

MethodEstimate95% CIP-value
Cochran-Mantel-Haenszelnot reported< 0.001

The registry’s own analysis compares the Vehicle and BF-200 ALA groups using the Cochran-Mantel-Haenszel method and reports p < 0.001. This is the trial’s posted inferential result. The recalculated unadjusted comparison uses the posted group counts and reports a risk difference of 0.537 with a 95% confidence interval from 0.392 to 0.683, along with p < 0.001.

The two analyses are not identical procedures. The recalculation is an unadjusted summary based on the reported counts; the registry analysis is the named method reported by the study. A difference in the exact p-value threshold is therefore not, by itself, evidence of an error. The sponsor’s own analysis takes precedence when reporting the trial’s formal statistical result.

The registry record does not provide the strata or other implementation details for the Cochran-Mantel-Haenszel analysis, nor a complete statistical analysis plan. The recalculation can make the posted summaries easier to interpret, but it cannot recover those details or replace the reported method. The arm percentages and confidence intervals remain useful for describing the observed magnitude and uncertainty, while the sponsor analysis supplies the trial’s own reported inferential comparison.

15. Multiplicity, Missing Data and Analysis Populations

The registry lists 15 outcome measures and 4 analyses. With several endpoints or comparisons, the chance of at least one apparently unusual result can increase if each is assessed separately without accounting for the number of tests. In general, multiplicity procedures can control this issue by adjusting the testing threshold or by defining an ordered testing strategy. The registry record does not report whether any multiplicity adjustment was used, whether outcomes were tested hierarchically, or which secondary outcomes were designated as key confirmatory endpoints. The secondary p-values should therefore be read as unadjusted where they are described that way, rather than as family-wise confirmatory evidence.

The primary endpoint and its reported analysis are identifiable in the registry record, but the complete statistical analysis plan is not. Details such as prespecified covariates, subgroup analyses, handling of protocol deviations, and sensitivity analyses are not reported in the registry record. It is not appropriate to infer these choices from the reported endpoint or from the test result.

The primary population is described as the full analysis set, overall. The registry record does not define eligibility for that set, clarify how participants were handled after randomization if they lacked a usable endpoint, or report the number of missing primary assessments. The methods used to address missing data, if any, are not reported in the registry record. Missing outcomes can affect both the estimated percentages and their uncertainty, so this absence limits independent assessment of robustness.

The participant counts differ across the registry’s outcome summaries: the primary result lists 40 participants for Vehicle and 80 for BF-200 ALA, while safety summaries list 41 and 81 at risk. These are outcome-specific analysis denominators as reported. The registry record does not explain the difference in denominators, so no reason should be assumed. The safety counts should not be substituted for the primary analysis counts.

The registry provides a Cochran-Mantel-Haenszel p-value for the primary comparison but not the stratification details. It does not report a protocol-based sample-size justification or the trial’s original design assumptions. These limitations do not negate the posted estimates; they constrain the ability to reconstruct the full analysis and to judge all possible sources of bias or uncertainty.

16. Safety Results

The registry reports serious adverse events as affected participants divided by participants at risk.

ArmParticipants with serious adverse eventsParticipants at riskPercentage
Vehicle2414.9%
BF-200 ALA0810.0%
Participants with at least one serious adverse event
Serious adverse events by armVehicle4.9%BF-200 ALA0.0%% of participants with at least one serious adverse event

Other (non-serious) adverse events

Participants with at least one non-serious event at or above the registry's 5% reporting threshold.

ArmParticipants affected of at risk
Vehicle20 of 41
BF-200 ALA78 of 81

Most frequent serious adverse event terms

Event termOrgan systemVehicleBF-200 ALA
Myocardial infarctionCardiac disorders1 of 410 of 81
MyositisMusculoskeletal and connective tissue disorders1 of 410 of 81

Most frequent non-serious adverse event terms

Event termOrgan systemVehicleBF-200 ALA
Application site erythemaGeneral disorders15 of 4172 of 81
Application site irritationGeneral disorders10 of 4170 of 81
Application site painGeneral disorders4 of 4144 of 81
Application site oedemaGeneral disorders1 of 4132 of 81
Application site pruritusGeneral disorders0 of 4127 of 81
Application site indurationGeneral disorders0 of 4112 of 81
Application site reactionGeneral disorders2 of 419 of 81

Serious events with the highest arm-level rate: myocardial infarction (2.4%), myositis (2.4%).

Do not overextend the safety comparison. Serious-adverse-event counts are safety observations, not efficacy outcomes, and should not be combined with the primary result into a single benefit-risk number.

The registry reports serious adverse events for 2 participants at risk in the Vehicle group and none in the BF-200 ALA group, with 41 and 81 participants at risk, respectively. The listed serious-event terms are myocardial infarction and myositis, each reported as 2.4%. The registry record does not establish from these summary figures whether the listed terms occurred in particular treatment groups, so they should not be attributed to an arm without further detail.

Other adverse events are reported for 20 of 41 participants at risk in the Vehicle group and 78 of 81 in the BF-200 ALA group. These are counts of participants affected as presented in the registry summary, not a complete description of event severity, duration, recurrence, or causal relationship to treatment. The registry record does not report deaths as a numerical result, so the absence of a death count should not be interpreted as evidence that no deaths occurred.

These safety figures are descriptive. They do not by themselves determine whether an event was caused by the study treatment, and the summary does not provide enough detail to compare event types, exposure duration, or clinical seriousness beyond the registry categories. The numbers also should not be combined with the primary efficacy denominators, which are reported for a different analysis population.

17. What the Result Does, and Does Not, Mean

The posted primary result describes complete clearance in the full analysis set at 12 weeks after the last photodynamic therapy, up to 24 weeks. BF-200 ALA had a reported clearance rate of 66.3%, compared with 12.5% for Vehicle. The registry’s Cochran-Mantel-Haenszel analysis reported p < 0.001. These findings describe the participants and endpoint represented in the registry record.

The result does not mean that every participant receiving BF-200 ALA achieved complete clearance. The endpoint is a proportion, and the reported percentage is below 100%. It also does not mean that no Vehicle participant achieved clearance; the Vehicle percentage is above zero. The study’s average group results do not predict the outcome for any particular person.

The measure is limited to complete remission of all target-area lesions at a specified assessment. It does not tell readers how long clearance persisted after that assessment, whether lesions later recurred, or how every lesion responded. The registry record does not report longer-term follow-up for those questions. Nor does the primary efficacy estimate summarize all safety considerations; the adverse-event summaries require separate interpretation.

Statistical significance does not establish the practical importance of an effect or resolve all uncertainties about study conduct. The registry record does not report the original sample-size rationale, a detailed statistical analysis plan, multiplicity handling, or methods for missing primary outcomes. The confidence intervals describe sampling uncertainty under their methods, but they cannot address every limitation in the available record.

The most defensible interpretation is specific: the posted primary endpoint estimates and the sponsor’s reported comparison show a higher complete-clearance percentage in the BF-200 ALA group than in the Vehicle group at the stated follow-up. Broader conclusions about other populations, longer-term outcomes, individual treatment choices, or the full balance of benefits and harms are not established by these registry results alone.

18. Why This Trial Matters Statistically

This trial illustrates why a clinical outcome needs a precise statistical definition. Complete patient clearance is not the same as improvement in an average lesion measure: it requires all target-area lesions to be in complete remission. The primary endpoint therefore answers a clear participant-level question, while secondary lesion-size and lesion-area measures describe other dimensions of response.

It also shows why effect size and uncertainty should be considered together. The arm-specific percentages communicate the observed outcomes, while their confidence intervals indicate uncertainty in those estimates. The risk difference gives an absolute comparison that can be read directly on the proportion scale. The p-value addresses a different issue: how compatible the data are with a null comparison under the analysis assumptions. These statistics complement rather than replace one another.

The distinction between the registry’s reported analysis and an unadjusted recalculation is also important. A summary-data recalculation can help readers understand the magnitude of the observed contrast, but it does not reproduce unreported analysis details. The trial’s reported Cochran-Mantel-Haenszel result remains the formal sponsor analysis, and the registry record does not provide enough information to reconstruct every choice behind it.

Finally, the record emphasizes the role of endpoint timing, analysis population, multiplicity, and missing-data methods. The primary outcome was assessed at a specified time after the last photodynamic therapy, and the listed population is the full analysis set. The registry does not report all details needed to judge how missing observations were handled or how secondary comparisons were prioritized. Those are not minor editorial details: they affect how confidently results can be generalized and how much weight to place on a collection of outcomes.

19. Limitations

The registry record supports interpretation of the posted results but leaves several trial-specific details unavailable. It does not report the original sample-size justification, so the rationale for the planned enrollment cannot be evaluated from this entry. Planning illustrations based on observed effects are not evidence of the assumptions used when the trial was designed.

The registry identifies randomization and double masking but does not describe the allocation-generation procedure, allocation concealment, or how masking was maintained. It also does not provide the full protocol or statistical analysis plan. Specific analysis choices, including any prespecified covariates, stratification variables for the Cochran-Mantel-Haenszel analysis, and sensitivity analyses, are not reported in the registry record.

The primary population is named as the full analysis set, but its definition and the handling of participants without an observed endpoint are not reported. No missing-data method or sensitivity analysis is described. This matters because the primary endpoint is a percentage and could be affected by how incomplete follow-up is addressed. The registry’s different denominators for the primary efficacy and safety summaries are reported, but the reason is not given.

Although many secondary outcomes are listed, the registry record does not report a multiplicity strategy or a clear hierarchy for interpreting them. Secondary p-values should therefore be treated cautiously. The reported follow-up describes a specific post-treatment assessment; durability, recurrence, and outcomes beyond that assessment are not reported in the registry record. The adverse-event summaries also lack detail on timing, duration, relatedness, and event-level context. These limitations narrow the conclusions that can be drawn from the record, without changing the numerical results it reports.

20. Related Tutorials

21. Related Statistical Calculators

22. Sources

Continue through the Clinical Biostats statistical pathway

Use this trial's endpoint as a starting point for deeper study of effect measures, confidence intervals, and sample-size planning.

23. Record Summary

The registry record describes a completed randomized, double-blind, Phase III, multicenter, parallel study of BF-200 ALA gel with photodynamic therapy versus matched Vehicle gel in participants with actinic keratosis. Enrollment was 122. The primary endpoint was complete remission of all target-area lesions 12 weeks after the last photodynamic therapy, up to 24 weeks, in the full analysis set.

The reported clearance rates were 66.3% for BF-200 ALA and 12.5% for Vehicle. The registry reports a Cochran-Mantel-Haenszel comparison with p < 0.001. The record also lists secondary clearance, lesion-size, lesion-area, and cosmetic outcomes, and provides safety summaries. Original design assumptions, missing-data methods, multiplicity handling, and several analysis details are not reported in the registry record.

Clinical Biostats