In one sentence
For basic cardiac point-of-care ultrasound skills, a serious video game was statistically non-inferior to mannequin simulation — yet after a shared workshop, neither reinforcement path produced further gains over two weeks.
What the researchers did
Lintschinger and colleagues ran a prospective, single-blind, randomised controlled non-inferiority trial at the Medical University of Vienna (registered as NCT06106178). Participants were medical students with basic anatomy knowledge but no prior cardiac point-of-care ultrasound (POCUS) experience.
Everyone completed a two-hour workshop and a baseline skills check using a modified Objective Structured Assessment of Ultrasound Skills (OSAUS) score (total 4–20, subdomains 1–5). Then students were randomised to four training sessions over two weeks: either the serious game Underwater or traditional mannequin-based simulator practice. A final OSAUS assessment followed. The primary outcome was the change in total modified OSAUS from baseline to final; non-inferiority used a one-sided 5% test. Of 103 enrolled, 97 were analysed (5.8% dropout; training window reported as October–May 2024).
What they found
- Mean OSAUS change was −1.24 ± 3.72 (simulator) vs −0.57 ± 3.51 (game) — meeting the study’s non-inferiority criterion (p < 0.001 for that test).
- Hand-eye / image-optimisation subdomain changes did not differ between arms (−0.16 ± 1.40 vs −0.23 ± 1.18, p = 0.780).
- Helpfulness ratings (helpful or very helpful) were 78.0% for the simulator arm and 63.8% for the game arm.
- Critically, neither modality produced measurable improvement beyond the initial workshop; both groups showed a small decline on average by the final check.
What this means for learners and educators
- A well-designed game can stand beside a mannequin for short reinforcement of basic cardiac POCUS hand-eye skill — useful when simulator access is scarce or costly.
- Equivalence is not automatic effectiveness: if the workshop already did the heavy lifting, spaced “more of the same” may only slow forgetting, not lift the ceiling.
- Plan distributed practice and deliberate reinforcement across a longer curriculum rather than four sessions in two weeks as a stand-alone booster.
- Collect learner preference data separately from skill scores — here the simulator felt more helpful to more students even when scores were statistically similar.
Limitations and what we don't know yet
Non-inferiority shows the game was not meaningfully worse than the simulator on this primary change score — it does not prove either method teaches well after a strong workshop. The window was short, the skill set basic, and decline on average means we lack evidence for long-term retention or clinical transfer. Single-centre medical students may differ from residents or practising clinicians. OSAUS captures structured exam performance, not bedside decision quality. Game design details and exact non-inferiority margins live in the full paper beyond this abstract-level summary.