Skills Training to Enhance Vocational Outcomes in Veterans With Serious Mental Illness: Complete Statistical Analysis

1. Trial at a Glance

This page covers the registry results for Skills Training to Enhance Vocational Outcomes in Veterans With Serious Mental Illness (NCT02663349), a na na study. The primary outcome is Bell-Lysaker Emotion Recognition Task Total Score.

2. Clinical Question

The clinical question combines feasibility with assessment of possible change in social cognition and functioning. Those aims are not equivalent: feasibility concerns whether the intervention can be delivered in the target setting, while outcome assessment concerns measured scores over time. The registry record states these aims, but the posted results do not include numerical primary endpoint results with which to describe change.

The study is not a randomized comparison. Any comparison of participants’ scores across time would be a within-group comparison, not an estimate of the difference between supported SCIT and another intervention or usual care. Without a separate control group, changes cannot be separated from other influences that may occur during follow-up.

3. Trial Design

The registry record describes a completed, single-group behavioral study sponsored by Minneapolis Veterans Affairs Medical Center. Enrollment was 22. The listed condition categories are schizophrenia, bipolar disorder, and psychotic disorders. The study description also refers to schizoaffective disorder and to participants engaged in compensated work activity.

The intervention is Social Cognition and Interaction Training, with social mentoring intended to help participants complete homework and practice skills outside treatment. The study summary describes a 12-week group intervention. It explains that SCIT focuses on recognizing emotions and evaluating interpretations of social exchanges, with mentoring intended to support transfer of training to everyday functioning. These are descriptions of the intervention’s rationale and planned content, not evidence that participants completed every component.

The primary completion date is recorded as 2018-10, and the status is COMPLETED. The start date is recorded as 2016-01. The record lists the masking field as NONE, while the study summary describes a single-blind study. It does not clarify how those two descriptions relate or how masking was implemented.

There is no listed randomized allocation or distinct control arm. This makes the design suitable for describing the intervention group and its measured outcomes, but it does not provide a concurrent control comparison. The record’s stated aims include feasibility, social-cognitive and work or social performance, and durability of change 3 months after intervention. A complete statistical protocol, including the planned analysis model and the handling of repeated observations, is not reported in the registry record.

The primary outcome is a continuous score measured at baseline and 3 months. The record notes that one participant’s result on this measure was invalid and that the data were removed. It does not report the number of valid observations at each time point or provide the outcome summaries needed to describe the observed scores.

4. Participant Flow and Accounting

The registry reports how participants moved through each stage of the study. All counts below are exactly as posted; missing counts are not inferred from other stages.

Before assignment: Participants were not excluded after enrollment in the study. Several enrolled participants chose not to participate when they were informed of their eligibility, citing being too busy, changes in schedule, or new plans to move out of the area.

Overall Study

Reasons for not completing this period:

Analysis population for the primary outcome, as defined in the registry: One participant produced invalid results on this measure and their data was removed

5. Baseline Characteristics

The table reproduces the baseline characteristics posted in the registry, which describe the participants analysed at baseline and help show whether the randomized groups were comparable.

Population: Analysis was done only with participants who completed the study. Baseline data is for the 16 participants who completed the study.

6. Primary Endpoint

The registry lists the primary outcome as Bell-Lysaker Emotion Recognition Task Total Score, measured over Total score at Baseline and 3 months.

The primary endpoint is the Bell-Lysaker Emotion Recognition Task Total Score. The task is described as measuring emotion-recognition ability, with scores ranging from 0-21 and higher scores indicating better performance. Emotion recognition is relevant to the study’s rationale because the registry summary describes difficulty interpreting social exchanges as a challenge for people with serious mental illness in work settings.

The endpoint is recorded at baseline and 3 months. Repeated measurement can describe whether scores differ over time within the intervention group. It does not, by itself, establish that any change was caused by the intervention. In a single-group study, other changes over the same period cannot be ruled out by comparison with a control group.

A mean is a measure of the group’s average score, while a standard deviation describes how spread out individual scores are around that average. The registry record identifies the mean and standard deviation as the summary measure and dispersion, but does not report the numerical values for either time point. It also does not report an estimated change, confidence interval, or statistical test for this endpoint. As a result, the direction, magnitude, and precision of any observed change cannot be described from the posted results.

The record states that one participant produced invalid results on this measure and that their data were removed. This affects the analysis population for the endpoint, but the record does not describe the validity criteria or how the removal was handled in the full analysis plan.

7. Why No Re-analysis Is Shown

8. Statistical Interpretation

9. Statistical Methods Explained

The registry record identifies a single-group design, continuous primary outcome, mean summary measure, and standard deviation as the dispersion measure. These details indicate the basic form of the intended outcome summary, but they do not specify the full analysis method. The statistical plan, including the model, test, assumptions, and treatment of repeated measurements, is not reported in the registry record.

What a mean and standard deviation describe

In general, a mean condenses a set of scores into an average. A standard deviation gives context by describing how far individual scores tend to vary around that average. Reporting both can help readers understand the group’s central score and spread. They do not convey the whole distribution, and they do not alone quantify uncertainty in the mean or in a change between time points.

For a longitudinal question, analysts may compare scores measured on the same participants at different times, or use a model that accounts for repeated observations. These approaches have different assumptions and answer questions in somewhat different ways. The registry record does not state which approach was planned or used. Without the actual values and method, no estimate of the change or its uncertainty can be reconstructed from the record.

What a confidence interval would add

In general, a confidence interval describes uncertainty around an estimated quantity under the assumptions of the analysis. A narrow interval indicates greater precision than a wide interval, while an interval that includes values on both sides of no change may be compatible with multiple interpretations. A confidence interval does not remove bias from a weak design, and it does not establish causality. No confidence interval for the primary endpoint is reported in the registry record.

Why the design matters

In general, a single-group before-and-after study can describe how observed scores differ over time among participants with measurements. It cannot directly contrast those changes with what would have occurred in a concurrent untreated or alternative-treatment group. Natural variation, outside events, and changes unrelated to the intervention may contribute to a time difference. This limitation applies regardless of the statistical method used to summarize the repeated measurements.

The record lists allocation as NA and the model as single-group. Accordingly, there is no randomized treatment contrast to interpret. The study description’s reference to single blinding sits alongside a registry masking field of NONE; the record does not explain this discrepancy. Neither description changes the fact that no comparison arm is listed.

Over-dispersion and count outcomes

General statistical note: over-dispersion refers to count data varying more than a simple statistical model expects. It can lead to uncertainty estimates that are too small if ignored. The primary outcome in this record is a continuous score, not a count outcome, so over-dispersion is not the central issue for interpreting this endpoint. The record does not provide a statistical model for the secondary outcomes.

Planning calculations are not observed results

The registry information describes sample-size illustrations based on the observed effect, using a two-sided significance level of 0.05, equal allocation between two arms, and a normal approximation. It says that the effect to detect is expressed as a stated fraction of the observed effect. These are planning assumptions, not a description of the single-group study design, which has no two-arm allocation.

Such illustrations are not observed power and do not establish that an analysis had a particular probability of detecting an effect. They are planning calculations that depend on their assumptions, including the effect size used. The numerical planning outputs and the observed effect are not reported in the registry record, so no numerical sample-size interpretation can be made from these details. They should not be read as evidence that the study was adequately powered or that an outcome was detected.

The registry record does not report a sample-size justification for the actual single-group study. It also does not report whether interim analyses were planned, whether adjustments were made for repeated measurements, or what threshold was used for statistical significance in the outcome analyses. Those details cannot be inferred from the general planning assumptions.

Multiplicity and interpretation

Multiple outcomes and analyses create multiple opportunities to observe results that appear notable by chance. General approaches to this issue include defining a primary endpoint in advance, adjusting tests, or interpreting secondary analyses as exploratory. The record identifies one primary outcome and lists 17 outcome measures and 26 analyses, but does not state whether or how multiplicity was addressed. Without the analysis plan and numerical findings, readers cannot determine the role of any adjustment or distinguish confirmatory from exploratory analyses.

For this record, the most important methodological point is the separation between design information and outcome evidence. The design and endpoint are described, but the primary results and the statistical plan are not. General statistical concepts can clarify what a mean, standard deviation, or confidence interval would mean; they cannot substitute for the missing outcome estimates.

10. Multiplicity, Missing Data and Analysis Populations

The registry record lists 17 outcome measures and 26 analyses. It identifies the Bell-Lysaker Emotion Recognition Task Total Score as the primary outcome, with additional outcomes concerning social skill performance, social functioning, mentoring and communication support, and vocational efficacy. The record does not report whether statistical testing across these outcomes was adjusted for multiplicity, or whether secondary analyses were designated as exploratory.

Multiplicity matters because testing several outcomes can increase the chance of finding an apparently notable result even when there is no true effect. In general, an adjustment can change how evidence across tests is interpreted, while a prespecified hierarchy can clarify which analyses carry the main inferential weight. The registry record does not report the relevant plan or provide numerical outcome results to evaluate.

Missing-data handling is also not fully described. The primary outcome description states that one participant produced invalid results and that the data were removed. The record does not explain the rule used to classify the result as invalid, whether other observations were missing, or whether any imputation or sensitivity analysis was performed. The number of valid scores at each time point is not reported.

The analysis population is not described in sufficient detail to determine whether the reported analyses, if any, included all enrolled participants, only participants with valid outcome measurements, or another group. No primary endpoint estimates are reported, so the impact of exclusions or missing observations on the result cannot be assessed.

11. Safety Results

The registry reports serious adverse events as affected participants divided by participants at risk.

Deaths

Other (non-serious) adverse events

Participants with at least one non-serious event at or above the registry's 5% reporting threshold.

The safety record lists 22 participants at risk for serious adverse events and 0 affected. It also lists 22 at risk for other adverse events and 0 affected, with 0 deaths. No serious adverse event terms are listed. These are the counts recorded for the Supported SCIT group.

A zero count means that no event of the specified category was recorded among the participants counted at risk in this registry entry. It does not demonstrate that an intervention has no possible risks, nor does it establish that no adverse experiences of any kind occurred. The registry record does not provide event descriptions, follow-up-specific exposure information, or further detail about adverse-event collection and reporting.

These safety counts should be read as descriptive observations from a group of 22, not as a comparison with another group. There is no listed control arm from which to estimate a difference in event frequency. The absence of reported serious events is therefore not a comparative safety estimate and does not resolve uncertainty about less common events.

12. What the Result Does, and Does Not, Mean

The registry record documents a study of supported SCIT in a single group, with an enrollment of 22 and a primary measure of emotion recognition assessed at baseline and 3 months. It also documents the intervention rationale, additional areas of interest, and recorded adverse-event counts. These registry entries describe what the study set out to examine and what the registry entry reports about its design.

The record does not provide numerical primary outcome results. It therefore cannot show whether average emotion-recognition scores changed, how large any change was, or how precise an estimate would be. It does not provide evidence in the posted results for a conclusion about the direction of change. Missing numerical results are not equivalent to a finding of no change.

Even if a within-group change estimate were available, the single-group design would not establish that the intervention caused it. There is no concurrent comparison group listed, so other explanations for changes over time would remain. The study’s stated interest in social and vocational functioning is not itself evidence that those outcomes improved.

The safety counts report 0 serious adverse events, 0 other adverse events, and 0 deaths in the recorded group. They are descriptive counts and do not compare the intervention with another approach. They should not be interpreted as proof that no risk exists.

Overall, the record is informative about the clinical question, intervention, design, and chosen primary outcome, but the absence of posted outcome estimates limits statistical interpretation. The findings necessary to quantify change, assess precision, and evaluate the broader aims are not reported in the registry record.

13. Why This Trial Matters Statistically

This trial matters statistically because it illustrates the difference between a well-described research question and an interpretable estimate of an outcome. The record identifies an emotion-recognition measure, a measurement schedule, and the intended intervention. Those elements clarify what was to be studied. Without the numerical outcome summaries and an analysis estimate, however, readers cannot judge the observed pattern or its uncertainty.

The single-group design is also important. Repeated measurements can describe change within a group, but do not create the counterfactual comparison needed to distinguish intervention effects from other changes over time. This distinction is central to interpreting studies of behavioral interventions, where participants’ experiences outside treatment may also influence measured outcomes.

The registry lists multiple outcome measures and analyses. That breadth can be useful for describing different domains of functioning, but it makes the prespecified status of analyses and any multiplicity strategy important for interpretation. Those details are not reported in the registry record. A reader should therefore avoid treating the list of intended outcomes as a list of positive findings.

Finally, the primary measure excludes one participant’s invalid result, while the number of valid observations at each time point is not given. This underscores why analysis populations and missing-data decisions are part of the evidence, not merely technical details. The registry entry offers enough information to identify these interpretive questions, but not enough to resolve them.

14. Limitations

• The posted summary statistics are the only data these results rest on; patient-level data, full protocols and statistical analysis plans are not available.
• Recalculated results are simple, unadjusted calculations from posted summaries. They do not replace the sponsor's prespecified analysis.

The main limitation for interpreting this study is that numerical results for the primary endpoint are not reported in the registry record. Without baseline and follow-up summaries, an estimated change, or a measure of uncertainty, the outcome cannot be assessed quantitatively. The same issue applies to the secondary outcomes listed in the record.

The single-group design has no concurrent comparison group. Consequently, even a reported difference between baseline and follow-up would not isolate the effect of supported SCIT from other influences over time. The record does not describe a randomized comparison, and the allocation field is listed as NA.

The primary measure description notes that one participant’s result was invalid and removed. The registry record does not give the number of participants with valid measurements at each time point, explain the validity rule, or detail other missing-data procedures. This limits assessment of how exclusions and incomplete follow-up may affect outcome summaries.

The record lists 17 outcome measures and 26 analyses, but does not report a multiplicity plan or clarify which secondary analyses were confirmatory. It also does not report the statistical analysis plan, sample-size justification for the single-group design, or whether interim analyses were planned. These omissions limit evaluation of the intended inferential framework.

There is an unresolved difference in the masking descriptions: the masking field is NONE, while the summary calls the study single blind. The record does not explain the distinction. Finally, the enrollment count is 22, and the recorded safety counts are descriptive; the entry does not give a comparison group or additional event detail for evaluating comparative safety.

15. Related Tutorials

16. Related Statistical Calculators

17. Sources

• ClinicalTrials.gov: Skills Training to Enhance Vocational Outcomes in Veterans With Serious Mental Illness — NCT02663349.
• Registry record last updated 2023-03-23; status last verified 2022-06.
• Results first posted 2023-03-23.
• Data retrieved from ClinicalTrials.gov on 2026-11-09.
• Group sizes, means, event counts and sponsor-reported p-values are reproduced as posted. Effect estimates, confidence intervals and p-values not attributed to the sponsor are independently calculated from the posted summary statistics.

18. Record Summary

NCT02663349 is a completed single-group behavioral study sponsored by Minneapolis Veterans Affairs Medical Center. The registry record lists enrollment of 22 and evaluates supported Social Cognition and Interaction Training for people with serious mental illness engaged in compensated work activity.

The primary outcome is the Bell-Lysaker Emotion Recognition Task Total Score, measured at baseline and 3 months. The score ranges from 0-21, with higher scores indicating better performance. One participant’s result was invalid and removed. Numerical primary outcome results and estimates of change are not reported in the registry record.

The study description identifies feasibility, social-cognitive and functional outcomes, and durability of change as aims. The record lists 17 outcome measures and 26 analyses, but does not report a multiplicity strategy or full statistical plan. Safety counts list 0 serious adverse events, 0 other adverse events, and 0 deaths among the 22 participants at risk.