The study’s design was straightforward but methodologically careful. The researchers collected responses from 97 third-year nursing students across two campuses of the University of Santiago de Compostela, in Santiago de Compostela and Lugo. They then administered a selection of items from the Spanish Health Barometer to this student group and compared the resulting answers with secondary data from 411 young adults aged 18 to 25 who had participated in the 2024 edition of the national survey. This created a natural comparison between two populations of similar age, one embedded in professional training and one drawn from the general public. The descriptive comparative design was applied across both sites of the single university, and ethical approval for the anonymised analysis of student responses was granted by the university’s Research Ethics Committee in January 2025, with all participants providing informed consent before completing the questionnaire.

The statistical treatment deserves attention because it reflects a growing trend toward rigor in educational research. Rather than relying on raw significance tests alone, the authors employed an omnibus chi-squared test for categorical comparisons and Welch’s t-tests for continuous measures, the latter being a variant that does not assume equal variances between groups and is therefore more robust when sample sizes and spreads differ. Crucially, they reported effect sizes using Hedges’ g, a measure that expresses the magnitude of a difference in standardized units, and they adjusted their p-values using the Benjamini–Hochberg procedure, which controls the false discovery rate when many comparisons are made simultaneously. This combination means the reported differences are not merely statistical artifacts of multiple testing; they survived a correction designed to filter out spurious findings.

The headline numerical result was that students rated the overall functioning of the health system at a mean of 7.00 on the survey’s scale, while young adults in the national dataset averaged 6.47. The difference was highly significant, with a p-value below 0.001 and an effect size of g = 0.326, which conventionally falls in the small-to-moderate range. On its face, this suggests that nursing students hold a somewhat more favorable view of the system’s overall performance than their peers outside health professional training. One plausible interpretation is that immersion in clinical placements and coursework gives students a more textured, less media-mediated picture of how the system operates day to day, including its successes as well as its strains.

Yet the categorical item told a different and more intriguing story. When asked to characterize how the system works in broader terms, only 4.1 percent of students judged that it worked quite well, compared with 11.0 percent of young adults in the national sample. Meanwhile, 40.2 percent of students said fundamental changes were required, against 31.1 percent of the general young adult population. In other words, the same students who awarded the system a higher average score were simultaneously more likely to call for deep structural reform. This divergence between a continuous rating and a categorical judgment is a textbook illustration of why survey methodology matters: the format of a question can shape, or at least reframe, the attitudes it captures, and researchers who read only one item risk drawing incomplete conclusions about public and professional sentiment.

The item-level comparisons deepened the pattern. Students rated hospital emergency services significantly higher than their young adult counterparts, with the difference again significant at p < 0.001 and an effect size of g = 0.312. This enthusiasm for emergency care may reflect direct exposure to hospital departments during clinical rotations, where students witness the machinery of acute medicine at close range. By contrast, students expressed significantly lower trust in primary care physicians, with an effect size of g = −0.318, and gave significantly lower ratings to the time that physicians dedicate to patients, at g = −0.423, the largest effect recorded in the study. Both findings remained significant after the Benjamini–Hochberg correction. One of the most notable null results concerned nursing itself: trust in nurses did not differ significantly between the two groups, suggesting that whatever professional socialization occurs during a nursing degree, it does not measurably inflate students’ confidence in their own future profession relative to the public’s view.

Why would nursing students be more critical of primary care than the general public? The study does not definitively answer this question, but the educational context offers reasonable hypotheses that the authors frame carefully. Students in their third year have typically completed rotations that include community and primary care settings, where they may observe time pressures, administrative burdens, and continuity-of-care challenges from an insider’s vantage point. Their lower ratings of the time physicians dedicate to patients could reflect an acute awareness of consultation length as a determinant of care quality, a theme heavily emphasized in nursing curricula that foreground holistic, patient-centered practice. At the same time, the authors are explicit that these are perceptions, not objective measures of system performance, and that the educational application arising from the study requires formal implementation and evaluation before any causal claims can be made.

The larger significance of the work lies in its proposal to treat national health surveys as pedagogical instruments. Surveys such as the Spanish Health Barometer, along with international counterparts like the European Health Interview Survey, the United States Behavioral Risk Factor Surveillance System, and national instruments in other countries, generate rich, publicly available datasets that policymakers rely on routinely. Yet, as the authors note, these resources remain underexplored in nursing education as tools for fostering critical thinking and systems-level awareness. The approach tested here inverts the usual classroom dynamic: instead of students merely answering survey questions, they compare their own answers against a nationally representative benchmark, forcing them to confront where their views align with the public and where they diverge, and to reason about why. That exercise sits at the intersection of survey methodology, health policy literacy, and professional identity formation, three competencies that modern nursing programs increasingly aim to cultivate together.

The study’s limitations are worth stating plainly, and the authors do so. The student sample came from a single university across two campuses, with 97 participants, which limits generalizability to nursing students in other regions or countries. The comparison group was restricted to young adults aged 18 to 25 within the national survey, so the findings speak to generational perceptions rather than the full population. The questionnaire had originally been administered as a voluntary and anonymous educational activity, and the research use involved secondary analysis of anonymised responses, a design that is ethically efficient but constrains the depth of data collection. And because the design is descriptive and comparative rather than experimental, it can document differences in perception but cannot explain their causes or test whether exposure to survey data actually improves educational outcomes.

Those caveats aside, the study opens a concrete agenda for future research. The authors call for intervention studies that formally evaluate whether the structured use of national survey data in nursing curricula supports critical thinking, systems literacy, and policy awareness. If such studies succeed, the implications could extend well beyond Spain. Health ministries and statistical agencies worldwide already invest heavily in opinion and health surveys; harnessing those same datasets as mirrors for health professional students would cost little and could reshape how the next generation of nurses understands the systems they will staff, defend, and reform. In an era when health systems everywhere face workforce shortages, aging populations, and eroding public trust, teaching future nurses to read the public’s verdict on their own institutions, and to compare it honestly with their own, may prove to be one of the most quietly consequential innovations in nursing education. This study, modest in size but rigorous in method, offers the first empirical foothold for that idea.

Subject of Research: Comparing nursing students' and young adults' perceptions of the Spanish health system using national survey data for nursing education

Article Title: National health survey data as a resource for nursing education: a comparative study of nursing students’ and young adults’ perceptions of the health system

Article References: Díaz, M. J. F., & Tuñas, M. C. A. (2026). National health survey data as a resource for nursing education: a comparative study of nursing students’ and young adults’ perceptions of the health system. BMC Nursing. https://doi.org/10.1186/s12912-026-05462-6

Image Credits: AI Generated

DOI: 10.1186/s12912-026-05462-6

Keywords: nursing education, Spanish Health Barometer, health system perceptions, survey methodology, critical thinking, primary care, comparative study, health policy, nursing students, effect sizes, public trust, systems literacy

The article, authored by Ashley D. Kendall of the University of Illinois Chicago, Noah Robinson of XRHealth USA, Robin J. Mermelstein of the University of Illinois Chicago, and Steven D. Hollon of Vanderbilt University, makes a deceptively simple point with far-reaching consequences. When a mental health app is tested against a treatment control — a comparison condition that itself contains some active therapeutic ingredient, such as psychoeducation, mood tracking, relaxation exercises or generic support — the trial is not measuring whether the app works. It is measuring whether the app works better than another intervention that may already deliver a meaningful share of the benefit. A null result in that context is not evidence of treatment failure. It may simply be evidence that two modestly effective treatments are, on average, equally effective.

The authors ground this argument in decades of psychotherapy research, a literature that digital mental health has often ignored when importing the randomized controlled trial as its gold standard. Landmark studies in face-to-face therapy, including the widely cited 2010 JAMA analysis by Fournier and colleagues on antidepressant medication and psychotherapy, established long ago that the difference between an active treatment and a credible control tends to shrink as controls become more structurally similar to treatments. Meta-analytic work by Cuijpers and colleagues on psychotherapy for depression reached the same conclusion: the choice of control condition can swing effect sizes dramatically, and pill placebos, psychological placebos and waitlists produce systematically different estimates of how well a therapy works. In other words, the problem Kendall and her colleagues describe is not unique to apps. It is an old and well-understood feature of clinical trials design that the app field has largely failed to absorb.

The technical logic is straightforward. A treatment control in a mental health app trial is not inert. It typically involves contact with researchers, expectation of benefit, structured engagement with content derived from therapeutic principles, and regular self-monitoring — all of which are known to produce symptom improvement on their own. When the active app and the control app both reduce symptoms by a comparable amount, the trial’s statistical machinery reports no significant difference. But the absolute benefit experienced by participants in both arms may be substantial. Reporting that result as a treatment failure conflates comparative advantage with clinical efficacy, two entirely different questions. The first asks whether the app beats a competitor; the second asks whether it helps people relative to no treatment at all. Treatment controls are designed to answer the first question, yet their results are routinely interpreted as answers to the second.

This interpretive habit has real-world costs. Apps that fail to beat treatment controls may be deprioritized by funders, rejected by regulators, passed over by health systems and dismissed by clinicians, even when the trials show that users improved meaningfully. Meanwhile, the enormous unmet need in mental health care — driven by workforce shortages, cost barriers and geographic inequity — means that even modestly effective scalable tools could deliver enormous public health value. The Comment argues that holding apps to a standard of superiority over other active interventions is a standard that many established, widely reimbursed psychotherapies would themselves struggle to meet, particularly against well-constructed psychological placebos. Chambless and Hollon’s influential 1998 framework for establishing empirically supported treatments recognized this problem nearly thirty years ago, emphasizing that efficacy must be demonstrated against appropriate comparison conditions and that equivalence to an established treatment can itself constitute evidence of effectiveness.

The authors also point to a related distortion: expectation effects and common factors. Any intervention that engages a person in a structured effort to feel better recruits hope, motivation, self-efficacy and the therapeutic alliance in diluted form. These ingredients are not noise to be controlled away; they are part of why psychological treatments work. A treatment control deliberately packages many of them. When both arms of a trial contain them, the measured difference between arms reflects only the incremental contribution of the app’s specific content over and above a foundation of generic benefit. For interventions whose mechanisms overlap heavily with those of their controls — as is often the case for apps built on behavioral activation, cognitive restructuring or mindfulness — small incremental effects are close to a statistical inevitability, not a signal of clinical worthlessness.

What, then, should the field do instead? The Comment calls for a diversification of trial designs rather than an abandonment of rigor. Single-case experimental designs, in which each participant serves as their own control across staggered phases of exposure to the intervention, can isolate within-person change with far fewer participants and are well suited to digital platforms that can randomize in real time. Sequential multiple assignment randomized trials, described in recent methodological reviews by Collins and colleagues, allow researchers to evaluate adaptive interventions in which the app’s content changes in response to a user’s progress. Hybrid effectiveness-implementation designs, formalized by Curran and colleagues, evaluate both whether an intervention works and how it functions in real-world care settings, providing information that traditional efficacy trials systematically omit. Dismantling and additive designs can determine which components of an app contribute to benefit, rather than asking only whether the whole package beats a competitor.

The authors also emphasize the value of alternative control strategies borrowed from other areas of medicine. Work by Mulla, Guyatt and colleagues on the interpretation of trials against active comparators shows that non-inferiority and equivalence designs, properly powered and pre-specified, can establish that a new treatment preserves most of the benefit of an existing one while offering advantages in cost, access or tolerability. For mental health apps, whose defining advantages are scalability and low marginal cost, demonstrating equivalence to clinician-delivered care in a non-inferiority framework may be a far more informative and honest question than chasing small superiority effects against enriched controls. Furukawa and colleagues’ work on minimally important differences provides the statistical scaffolding: what matters clinically is not whether a p-value crosses a threshold, but whether the difference between arms — or the improvement within an arm — exceeds the smallest change patients would consider meaningful.

The timing of this intervention matters. The digital mental health sector has matured rapidly, with recent syntheses by Torous and colleagues in World Psychiatry and by Linardon and colleagues mapping a crowded landscape of apps, growing regulatory attention and persistent uncertainty about which products deserve clinical endorsement. A 2022 analysis by Goldberg and colleagues found that while app-based interventions show pooled benefits for depression and anxiety, effects measured against active controls were markedly smaller than those measured against waitlists — precisely the pattern the new Comment predicts. As health systems begin to prescribe apps and payers consider reimbursement, getting the evaluation framework right is no longer an academic quibble. Misreading null superiority results could throttle the pipeline of accessible care just when demand for it has never been higher.

None of this means the authors are asking for a lower bar. They are asking for a more precise one. An app that helps users improve but does no better than a thoughtful control deserves scrutiny of its mechanisms, its engagement design and its incremental value — not a blanket verdict of failure. Conversely, the framework they propose would still condemn apps that produce no meaningful improvement at all, and non-inferiority and single-case designs are arguably more demanding than the status quo, requiring explicit specification of what counts as a clinically meaningful change. The core message is statistical as much as clinical: a null difference between two active treatments is an uninformative result about efficacy, and decades of psychotherapy research already knew it. Digital mental health, the Comment suggests, will only fulfill its promise once its trials start asking the questions its technology can actually answer.

Subject of Research: Evaluation methodology for mental health app clinical trials

Article Title: Failure to outperform treatment controls does not imply treatment failure for mental health apps

Article References: Failure to outperform treatment controls does not imply treatment failure for mental health apps. (n.d.). https://doi.org/10.1038/s44220-026-00715-4

Image Credits: AI Generated

DOI: 10.1038/s44220-026-00715-4

Keywords: mental health apps, digital mental health, treatment controls, randomized controlled trials, clinical trial design, psychotherapy research, non-inferiority trials, effect sizes, Nature Mental Health, outcomes research, implementation science, depression and anxiety