← Clinical Trials
Pregnancy NA Continuous Endpoint NCT02914301

Mobile App for Prenatal Care to Reduce Visits and Improve Satisfaction Study: Complete Statistical Analysis

This analysis concerns a non-randomized, parallel-group study of a prenatal care mobile app and total visit number. The registry record describes the trial design and endpoint but does not report numerical results for the primary outcome.

Trial start: 2015-07  ·  Enrollment: 118  ·  Sponsor: Andrew Meltzer
Scope of this record

This page provides an independent statistical analysis and educational interpretation of publicly reported results. ClinicalTrials.gov provides the official trial registry record. Numerical trial results on this page are restricted to the results posted in the ClinicalTrials.gov record; calculations added by Clinical Biostats are labelled as such.

1. Trial at a Glance

This page covers the registry results for Mobile App for Prenatal Care to Reduce Visits and Improve Satisfaction Study (NCT02914301), a non-randomized na study. The primary outcome is Total Visit Number.

118
Enrollment
NA
n/a
Arms
In the primary outcome
n/a
Effect
No re-analysis shown
n/a
95% CI
See limitations
FeatureRegistry value
ClinicalTrials.gov identifierNCT02914301
PhaseNA
ConditionPregnancy
AllocationNon-Randomized
Design modelParallel
MaskingNone (open label)
Enrollment118
Arms in the primary outcomen/a
Lead sponsorAndrew Meltzer
Results postedYes

2. Clinical Question

Population

People receiving prenatal care during pregnancy. The registry record lists Pregnancy as the condition and describes enrollment during prenatal care. It does not report additional eligibility details in the record summarized for this analysis.

Intervention

The Babyscripts Prenatal App. The arm description says participants in the experimental group would be assisted with downloading the app and setting up a connected weight scale and blood pressure cuff.

Comparator

The arm is named Placebo in the registry. Its description says clinicians would discuss management and scheduling in their usual fashion, and patients would not receive app access. This is described as usual care rather than an app-based comparison.

Primary question

How does total visit number, measured from the first trimester through postpartum, compare between the app arm and the usual-care arm? The registry describes reducing in-person visits as an aim, but the outcome is total visit number; no numerical comparison is reported in the registry record.

The central statistical question is whether the recorded number of visits differs between the two study arms. The registry record identifies this as a prospective, quasi-randomized trial, while its allocation field specifies NON RANDOMIZED. That distinction matters: the comparison is not a randomized estimate, and differences between groups could reflect factors other than app access. The registry itself flags that the arms are not a like-for-like control comparison.

The study description frames the app as a way to provide tailored prenatal educational content and facilitate checks of vital signs and weight between visits. Those proposed functions are rationale, not evidence that the app changed care or outcomes. The primary endpoint was selected after discussions with obstetricians about the relative importance of a reduced visit schedule versus usual care, with patient safety also noted in that rationale. The record does not report the observed visit counts, an effect estimate, or uncertainty around a group comparison, so the clinical question cannot be answered from the registered results.

3. Trial Design

The registry identifies this as a multicenter prospective quasi-randomized trial. Its allocation is recorded as non-randomized, its masking as none, and its model as parallel. The record lists the study as completed, with enrollment of 118. The registered dates are 2015-07 for study start and 2016-03 for primary completion.

The parallel structure means that the record describes separate groups receiving different care approaches rather than a crossover in which the same participant receives both approaches. One arm is named Babyscripts Prenatal App; the other is named Placebo. However, the control-arm description says clinicians would discuss management options and scheduling in their usual fashion, and that patients would not receive the app. This does not describe an app-based placebo experience. The naming and the actual care descriptions should therefore be read separately.

For the app arm, the description says a research assistant would help with app download and setup of a connected weight scale and blood pressure cuff, and would collect baseline demographic and clinical data at enrollment. The control description refers to usual clinician practice and consent for study data collection. The record does not report enough detail to establish whether all other aspects of care were standardized between arms.

Non-random allocation limits the strength of a causal interpretation. In general, randomization is used to balance measured and unmeasured prognostic characteristics across groups on average. Without random allocation, group differences in baseline characteristics, clinician practice, or other influences can contribute to any observed outcome contrast. The registry specifically cautions that the arms are not a like-for-like control comparison. The allocation procedure and any adjustment strategy are not reported in the registry record.

The record lists total visit number as the primary outcome, measured from the first trimester up to postpartum, between 6 and 9 months. Gestational Weight Gain is listed as a secondary outcome. It does not report numerical results for either outcome in the information summarized for this analysis.

4. Participant Flow and Accounting

The registry reports how participants moved through each stage of the study. All counts below are exactly as posted; missing counts are not inferred from other stages.

Overall Study

StageBabyscripts Prenatal AppPlacebo
STARTED6058
COMPLETED4741
NOT COMPLETED1317

5. Baseline Characteristics

The table reproduces the baseline characteristics posted in the registry, which describe the participants analysed at baseline and help show whether the randomized groups were comparable.

CharacteristicUnitBabyscripts Prenatal AppPlaceboTotal
Participants analysed474188
Age, Continuousyears33.0 (SD 3.3)32.2 (SD 3.2)32.6 (SD 3)
Sex: Female, Male: FemaleParticipants474188
Sex: Female, Male: MaleParticipants000
Race/Ethnicity, Customized: African-AmericanParticipants141327
Race/Ethnicity, Customized: OtherParticipants332861
Region of Enrollment: United Statesparticipants474188
College GraduateParticipants453681
Gravidity Per Patient: OneParticipants252247
Gravidity Per Patient: Greater than OneParticipants221941
Parity Per Patient: ZeroParticipants302555
Parity Per Patient: Greater than OneParticipants171633

6. Primary Endpoint

The registry lists the primary outcome as Total Visit Number, measured over From first trimester up to postpartum, between 6 and 9 months.

ElementRegistry entry
Result typeMean
Measure of spreadStandard Deviation
Unitvisits
Endpoint classificationContinuous Endpoint

The primary endpoint is total visit number, measured in visits. The registry says it would be assessed by reviewing the electronic health record, over the period from the first trimester up to postpartum, between 6 and 9 months. It also states that total visit number was selected after discussions with obstetricians because the advantages and disadvantages of a reduced visit schedule versus usual care were considered important, with patient safety noted as a consideration.

As a count of visits, this endpoint captures the amount of in-person care recorded over the specified period. In general, a group mean can describe the average number of visits, while a standard deviation describes how spread out individual counts are around that mean. The registry classifies the endpoint as a continuous measure summarized by a mean and standard deviation. This is the stated summary approach, not a numerical finding: the registry record does not report the arm-specific means, standard deviations, or a between-arm effect estimate.

The endpoint does not by itself describe the appropriateness or quality of each visit, the clinical reasons for visits, or whether a change in visit frequency was safe. Nor does a total count distinguish scheduled visits from other encounters unless the outcome definition specifies that distinction; additional detail on the exact counting rules is not reported in the registry record. The app’s proposed functions and the stated objective of reducing visits are not substitutes for observed endpoint data. Without reported outcome estimates and uncertainty, the registered endpoint definition alone cannot establish whether visit number differed between the groups.

7. Why No Re-analysis Is Shown

Reported as posted, not recalculated. Not a randomized comparison (allocation: non-randomized); arms are not a like-for-like control comparison. A result is recalculated only when the posted data support a clean two-arm comparison, so no result is shown beyond what the sponsor posted.

8. Statistical Interpretation

Clinical Biostats interpretation

The registry record describes a completed study with a primary endpoint and a stated method of measurement, but it does not report numerical results for total visit number. There are no arm-specific means or standard deviations, no estimated difference between arms, and no confidence interval or p-value in the record summarized for this analysis. Consequently, the size, direction, and precision of any primary outcome contrast cannot be assessed from the registry record.

The stated primary endpoint is a mean of a continuous measure: total visit number. In general, a difference in means expresses how far apart the groups’ average outcomes are, in the outcome’s units. A confidence interval, when reported, describes a range of values compatible with the data and analysis under its assumptions. It helps distinguish a precise estimate from one that leaves substantial uncertainty. No such interval is reported for this primary outcome, so neither the estimated contrast nor its precision is available.

The registry’s non-randomized allocation is important to interpretation even if numerical estimates were available. A contrast between non-randomized groups can reflect differences in who entered each arm, clinical setting, clinician decisions, or other factors, as well as any effect associated with the intervention. The registry explicitly warns that the arms are not a like-for-like control comparison. The record does not report an adjustment method that would address possible differences between groups.

The stated study objective includes safely reducing in-person visits and improving satisfaction, but the listed primary endpoint is total visit number. Satisfaction is not listed among the outcome information in this record, and safety cannot be established from visit counts alone. The registry lists Gestational Weight Gain as a secondary outcome, but does not report its numerical result in the information summarized for this analysis. The absence of posted outcome estimates should not be interpreted as evidence of no difference, nor as evidence of a difference.

The safety record lists zero serious adverse events and zero other adverse events in each arm, with zero deaths listed. These are the counts recorded for the safety groups, not a complete account of all possible safety outcomes. The registry record does not provide event descriptions, follow-up details for adverse-event collection, or a broader safety analysis. The group counts at risk are recorded as 45 for the app arm and 51 for the Placebo arm; those safety denominators should not be treated as a substitute for reported outcome data.

Overall, the available record supports a description of the trial question and design, not a conclusion about the intervention’s effect. A reader would need numerical outcome estimates, their uncertainty, and a fuller account of analysis methods to evaluate the primary comparison.

9. Statistical Methods Explained

The registry classifies total visit number as a continuous outcome summarized by a mean and standard deviation. Although visit number is a count, the registered outcome specification uses this summary. In general, the mean describes the average observed value, and the standard deviation describes variability among individual observations. Neither quantity alone shows how certain a comparison between groups is. For that, an analysis would typically report an estimate of the group contrast and an uncertainty measure, such as a confidence interval. Those numerical results are not reported in the registry record.

What does a mean comparison describe?

In general, a mean comparison summarizes the difference between group averages on the outcome’s original scale. For this endpoint, that scale is visits. Such a contrast is easy to interpret as an average change in visit count between groups, but it does not show the full distribution of individual counts. Two groups could have similar averages but different variability or different patterns in the tails. The registry specifies a mean and standard deviation, but it does not report the observed values or a model used to compare them.

Why might count outcomes need special consideration?

General statistical guidance is that count outcomes can have features that matter for model choice. Counts cannot take negative values and can be unevenly distributed. Some count data also show over-dispersion, meaning that variability is greater than a chosen model would expect from its mean. When over-dispersion is present, a model that assumes less variability may produce uncertainty estimates that are too narrow. This is a general consideration only: the registry record does not report a distributional assessment, a model for count data, or whether over-dispersion was evaluated. It would be inappropriate to infer which analysis was used.

What does non-random allocation change?

In general, random allocation helps make the groups comparable in expectation at the point of assignment. Non-random allocation does not provide that same protection. Differences in baseline health, care-seeking, clinician practice, or other characteristics could be associated with both group membership and visit number. Statistical adjustment can sometimes address measured differences, but it cannot automatically remove confounding from unmeasured factors. The registry records allocation as non-randomized and warns that the arms are not a like-for-like control comparison. The allocation process, baseline balance, and any covariate adjustment are not reported in the registry record.

What can a confidence interval add?

In general, a confidence interval communicates the uncertainty around an estimated effect under the assumptions of the analysis. A narrow interval indicates greater precision than a wide interval, while the interval’s location indicates which effects remain compatible with the estimate and its method. An interval is not a guarantee that the true effect lies within its limits, and its interpretation depends on the analysis assumptions. No confidence interval for the primary endpoint is reported in the registry record. Statistical significance, clinical importance, and precision are distinct considerations; the record does not supply the numerical results needed to assess any of them.

How should planning illustrations be understood?

The record describes planning illustrations based on the observed effect, using a two-sided significance level of 0.05, equal allocation between arms, and a normal approximation. It describes effects to detect as stated fractions of the observed effect. In general, sample-size calculations estimate the number of participants needed under specified assumptions to reach a chosen power for a target effect. They do not show that a study actually achieved that power, and they do not establish the observed effect. These figures are planning illustrations, not observed power. The record does not report the numerical illustration results in the information summarized for this analysis, nor does it report the trial’s own sample-size justification. The illustrations should not be confused with evidence that the enrolled study could detect a particular effect.

In general, the assumptions in a planning calculation matter: the target effect, variability, allocation, significance level, and analysis model all influence the estimate. Here the stated calculation assumptions include equal allocation and a normal approximation, but actual assignment was non-randomized. This contrast between an illustration’s assumptions and the registered allocation is a reason to read planning calculations as hypothetical guidance, not as a description of the trial’s analysis or design. The registry does not report whether the planning illustration assumptions correspond to the observed groups.

Finally, analysis choices must be judged alongside the outcome definition, missing-data handling, and population included in analysis. Those details can affect both the estimate and its uncertainty. The registry record does not report a statistical analysis plan, the final analysis population, or the handling of missing primary endpoint data. In the absence of those details and numerical outcome results, the statistical methods used to produce a primary comparison cannot be reconstructed from the registry record.

10. Confidence Intervals for Each Arm

No two-arm comparison is shown for this trial, but each arm's mean can be given with a t-based 95% confidence interval computed from the posted mean, spread and number of participants.

ArmParticipantsMeanStandard deviation95% CI for the mean
Babyscripts Prenatal App457.9001.8007.359 to 8.441
Placebo5110.2001.8009.694 to 10.706

R code and output

arm <- c("Babyscripts Prenatal App", "Placebo")
n   <- c(45, 51)
m   <- c(7.9, 10.2)
sp  <- c(1.8, 1.8)
sd  <- sp      # posted standard deviations
for (i in seq_along(n)) {
  se <- sd[i] / sqrt(n[i]); h <- qt(0.975, n[i] - 1) * se
  cat(sprintf("CARM|%s|%d|%.3f|%.3f|%.3f|%.3f\n", arm[i], n[i], m[i], sd[i], m[i] - h, m[i] + h))
}
CARM  Babyscripts Prenatal App  45  7.900  1.800  7.359  8.441
CARM  Placebo  51  10.200  1.800  9.694  10.706

11. Multiplicity, Missing Data and Analysis Populations

The registry lists total visit number as the primary outcome and Gestational Weight Gain as a secondary outcome. It also records two outcome measures and one analysis. These administrative counts do not establish how many statistical tests were conducted, which outcomes were included in the reported analysis, or whether any multiplicity adjustment was planned. The testing hierarchy and handling of multiple comparisons are not reported in the registry record.

In general, testing several outcomes or several contrasts can increase the chance of a false-positive finding if each is interpreted as a separate confirmatory test. A prespecified primary outcome can help clarify which question is central, while adjustment or other prespecified strategies may address multiplicity. The registry identifies a primary endpoint, but the statistical plan for distinguishing confirmatory from exploratory results is not reported. No numerical outcome results or p-values are available in the record summarized for this analysis, so multiplicity cannot be evaluated from observed findings.

Missing-data methods are also not reported in the registry record. The outcome was to be measured through electronic health record review, but the record does not specify how incomplete records, missing visits, or participants without a complete measurement period would be handled. In general, missingness can affect an estimate when availability of outcome data is related to participant characteristics or outcomes. The amount and pattern of missing primary endpoint data, and any sensitivity analyses, are not reported.

The analysis population is not described. The record does not state whether the primary analysis included all enrolled participants, only those with available endpoint data, or another defined group. It does not report protocol deviations or exclusions from the analysis. These omissions limit assessment of how the registered population relates to the population included in any analysis. A completed-study status and enrollment figure do not, by themselves, establish the analysis denominator or completeness of follow-up.

12. Safety Results

The registry reports serious adverse events as affected participants divided by participants at risk.

ArmParticipants with serious adverse eventsParticipants at riskPercentage
Babyscripts Prenatal App0450.0%
Placebo0510.0%

Deaths

ArmDeaths (participants affected of at risk)
Babyscripts Prenatal App0 of 45
Placebo0 of 51

Other (non-serious) adverse events

Participants with at least one non-serious event at or above the registry's 0% reporting threshold.

ArmParticipants affected of at risk
Babyscripts Prenatal App0 of 45
Placebo0 of 51
Do not overextend the safety comparison. Serious-adverse-event counts are safety observations, not efficacy outcomes, and should not be combined with the primary result into a single benefit-risk number.

The adverse-event record lists the app arm with 45 at risk, zero serious adverse events, zero other adverse events, and zero deaths. The Placebo arm is listed with 51 at risk, zero serious adverse events, zero other adverse events, and zero deaths. No serious adverse-event terms are listed.

These are the safety counts recorded in the registry, not proof that no adverse events occurred outside the record’s definitions or observation process. The record does not describe how events were collected, the duration or completeness of safety follow-up, or whether the listed at-risk counts represent all participants enrolled in each arm. The safety denominators should therefore be read as the counts attached to the adverse-event entries, not as group sizes inferred from the overall enrollment.

In general, an observed count of zero means that no events of that specified type were recorded in the reported data; it does not establish that the underlying risk is zero. Sparse or absent events can also leave substantial uncertainty about the frequency of uncommon outcomes. No further event-level details or safety estimates are reported in the registry record. The study’s stated aim of reducing visits safely cannot be established by these counts alone, especially without numerical primary outcome results and fuller safety methods.

13. What the Result Does, and Does Not, Mean

The registry record establishes that a prospective, multicenter study compared a prenatal care app approach with a usual-care approach and identified total visit number as its primary endpoint. It also records that the study was completed and that enrollment was 118. The record does not provide the primary outcome estimates needed to determine how many visits were observed in either arm or how the group averages compared.

Accordingly, the posted information does not establish whether total visit number was lower, higher, or similar in the app arm. It also does not establish the precision of a possible difference or whether a difference would be clinically important. The stated objective of reducing visits is a research aim, not a reported result. The same distinction applies to the proposed app functions, including educational content and checks of weight and vital signs between visits: they describe the intervention rationale rather than measured effects.

Even if a numerical group contrast were available, the non-randomized allocation would limit causal interpretation. Differences between groups might arise from factors other than the intervention, and the registry cautions that the arms are not a like-for-like control comparison. The record does not report an adjustment strategy or enough information to assess baseline comparability. Therefore, an unadjusted difference, if reported elsewhere, would not by itself show that app access caused the difference.

The safety entries list no serious adverse events, other adverse events, or deaths in either recorded safety group. Those entries are limited to the safety information in the registry and do not establish that the approach is safe in all settings or for all participants. The record does not report the listed satisfaction objective as a numerical outcome, and Gestational Weight Gain is identified as secondary without a numerical result in the information summarized for this analysis.

The appropriate reading is therefore descriptive and bounded: the registry specifies a question, intervention, comparator, design, and outcome, but does not report enough outcome data to answer the central comparison. No conclusion about benefit, lack of benefit, or safety can be drawn from the endpoint definition or study objective alone.

14. Why This Trial Matters Statistically

This trial raises a useful statistical question because it measures care utilization rather than a laboratory value or a single clinical event. Total visit number is directly interpretable as an average count, but its meaning depends on what encounters were counted and on the period of observation. The registry gives the general measurement period and says the electronic health record would be reviewed, while the exact counting rules are not reported in the registry record.

The study also illustrates why the design should shape interpretation. A non-randomized comparison may be vulnerable to differences in patient characteristics and clinical practice between groups. That concern is especially relevant when the outcome is a care-use measure, because visit frequency may reflect clinical need, access, clinician decisions, and follow-up practices in addition to the intervention. The registry explicitly warns that the arms are not a like-for-like control comparison.

Statistically, the outcome is specified as a mean with standard deviation, although visits are counted. General methods for count outcomes can require attention to distribution and variability, including possible over-dispersion. The registry record does not report which analytical model was used or whether these features were assessed. This makes transparent reporting of the estimate, uncertainty, outcome distribution, and analysis approach especially important.

The record states that total visit number was prioritized after discussion with obstetricians, while Gestational Weight Gain was listed as a secondary outcome. That helps identify the intended primary question. Yet the absence of numerical estimates and analysis details means readers cannot assess effect size, precision, missingness, or the relationship between the planned question and reported findings. The statistical importance of the case lies in how clearly it shows that a completed trial record and a defined endpoint are not substitutes for interpretable outcome reporting.

15. Limitations

A key limitation is that numerical results for the primary outcome are not reported in the registry record summarized for this analysis. Without arm-specific means, standard deviations, an effect estimate, or its uncertainty, the primary comparison cannot be evaluated. Numerical results for the listed secondary outcome are also not reported in the information.

The non-randomized allocation is an additional limitation. The registry cautions that the arms are not a like-for-like control comparison, and the allocation procedure is not reported. The record also does not report baseline characteristics by arm or an adjustment method. These gaps prevent assessment of how well the groups were comparable or whether an analysis addressed measured differences.

The arm naming may cause confusion: one group is called Placebo, but its description specifies usual clinician practice and no access to the app. The record does not describe a matching app-based placebo. The app-arm description includes setup of a connected scale and blood pressure cuff, so the intervention includes more than app content alone as described. The record does not report whether all participants used the equipment or how adherence was assessed.

The outcome definition is limited in detail. It names total visit number and a broad period extending from the first trimester up to postpartum, between 6 and 9 months, but does not report exact counting rules or how missing electronic health record data would be handled. The analysis population, multiplicity approach, statistical model, and sensitivity analyses are not reported in the registry record.

Finally, the safety entries contain zero recorded adverse events and deaths in each listed group, but the event collection procedures and follow-up completeness are not reported. These safety counts do not resolve the stated safety question or establish the completeness of adverse-event ascertainment.

16. Related Tutorials

17. Related Statistical Calculators

18. Sources

Continue through the Clinical Biostats statistical pathway

Use this trial's endpoint as a starting point for deeper study of effect measures, confidence intervals, and sample-size planning.

19. Record Summary

The registry record describes a completed, multicenter prospective quasi-randomized trial with non-randomized allocation, no masking, and a parallel model. Enrollment is recorded as 118. The intervention is the Babyscripts Prenatal App, compared with an arm named Placebo whose description specifies usual clinician practice without app access.

Total visit number, measured through electronic health record review from the first trimester up to postpartum, between 6 and 9 months, is the primary endpoint. Gestational Weight Gain is listed as a secondary outcome. The record describes the trial’s aims and measurement approach but does not report numerical results for the primary outcome in the information summarized for this analysis. It also cautions that the arms are not a like-for-like control comparison. Safety entries list zero serious adverse events, zero other adverse events, and zero deaths in each recorded group.

Clinical Biostats