Rugby union presents a formidable injury problem. The professional game carries an injury incidence of roughly 91 injuries per 1000 player hours, far exceeding elite soccer at 36 per 1000 hours and Gaelic football at 56 per 1000 hours, reflecting the sport's unique blend of collisions and intermittent high-speed running. Lower limb injuries are the most common, and previous research has shown that teams with higher injury burden perform worse in league competition. Both the International Olympic Committee and World Rugby have called for better injury surveillance and data analytics to protect athletes, fuelling interest in machine learning approaches that can detect subtle patterns in high-dimensional athlete data.

The appeal of machine learning in this context is easy to understand. Modern professional teams generate enormous volumes of information every day, from satellite-derived running loads to subjective wellness scores and clinical screening measurements. Traditional statistical approaches, which typically examine one or a handful of variables at a time, struggle to interrogate datasets of this size and complexity. Machine learning algorithms, by contrast, are designed to identify nonlinear interactions among hundreds of variables simultaneously, and they have shown promise in other domains of sports science, including performance forecasting and load management. It was against this backdrop of optimism that the Irish research team designed their study.

However, most machine learning studies in rugby have been confined to a single team or a single season, limiting generalisability and often relying on inconsistent injury definitions. Findings from one club's squad, trained on one season's worth of data, may simply reflect the idiosyncrasies of that playing style, that medical team's record-keeping, or that particular year's fixture congestion. The Irish research team set out to address both shortcomings by pooling longitudinal data from Connacht, Leinster, Munster and Ulster Rugby, along with the Ireland men's national team, across the 2021/22, 2022/23 and 2023/24 seasons. The study adopted a strict, consensus-based definition of injury: any non-contact, soft-tissue injury to the muscles, ligaments or tendons of the lower limb that caused the player to miss a subsequent training session or match.

This definitional rigour matters more than it might first appear. Much of the existing literature on injury prediction has used looser criteria, counting any complaint of pain or any medical attention event regardless of time loss. By restricting the analysis to injuries with genuine functional consequences, the researchers reduced the noise in their outcome variable, but they also drastically reduced the number of positive cases available for the algorithms to learn from, a trade-off that would prove consequential.

The datasets were substantial. Wearable Global Navigation Satellite System units manufactured by STATSports recorded external workload for 47,547 training sessions and 5,773 match exposures, capturing metrics such as total distance, maximal speed, metabolic load and acceleration-deceleration demands. Players also logged self-perceived wellness scores on a mobile application, rating sleep quality, appetite, fatigue, stress, muscle tightness and soreness on Likert scales from 0 to 10. Team medical staff administered musculoskeletal screening tests, including knee-to-wall ankle dorsiflexion, sit-and-reach flexibility and adductor squeeze strength measured with a sphygmomanometer. All injury records were centrally collated in the IRFU's athlete management system, and where the nature of an injury was unclear from clinical notes, the researchers reviewed match footage to determine whether the inciting event involved contact.

From an initial pool of 281 registered players, inclusion was restricted to the 129 athletes with complete GNSS, wellness and musculoskeletal data across all three seasons, a decision the authors acknowledge may have introduced selection bias toward players with greater availability. Applying the strict injury definition reduced 1,047 recorded time-loss injuries to 261 in-scope events. The median player sustained two such injuries over the study period, while 26 players escaped entirely. Back three players had the highest injury rate per player at 2.64, followed by half backs at 2.45. The median time loss per injury was 13 days, with the most severe case sidelining a player for 160 days. Injury incidence rates were 12.6 per 1000 hours in matches and 2.4 per 1000 hours in training.

Data preprocessing was extensive. GNSS features with more than 20% missing data were dropped, reducing 234 variables to 89, and collinearity checks using Pearson correlation and variance inflation factors removed redundant metrics. Outliers beyond three standard deviations of positional match demands were excluded as likely sensor malfunctions, accounting for 2% of records. Missing GNSS data were imputed using multiple imputation by chained equations, wellness data with k-nearest neighbours, and musculoskeletal values with last observation carried forward. The team then engineered temporal features, calculating exponentially weighted moving averages over 3-, 7-, 14-, 21- and 28-day windows, cumulative seven-day loads, and week-over-week percentage changes. Crucially, the models were never shown data from the day of injury, and predictions were only generated for days with training or match exposure, preventing the model from inflating its accuracy by correctly predicting "no injury" on rest days.

These design choices reflect hard-won lessons from earlier work in the field. Several high-profile injury prediction studies in other sports have been criticised for data leakage, in which information from the injury day itself, such as a truncated training session, inadvertently signals that something has gone wrong. Others have reported deceptively high accuracy simply because the models learned to predict the overwhelmingly common outcome of "no injury" on any given day. By withholding injury-day data and restricting predictions to exposure days, the Irish team built safeguards against both pitfalls, ensuring that whatever performance the models achieved would be an honest reflection of their predictive ability.

Five algorithms were compared: logistic regression and support vector machines as linear and kernel-based benchmarks, alongside Random Forest, XGBoost and CatBoost ensemble methods. Class imbalance was addressed through cost-sensitive learning with weighted loss functions. To avoid information leakage, the data were split temporally, with everything before 1 October 2023 used for training and the remainder reserved for testing, yielding a 75/25 split. Hyperparameter optimisation was performed with nested stratified three-fold cross-validation using the Optuna framework, and model explainability was assessed post hoc with SHapley Additive exPlanations (SHAP) analysis.

The results were sobering. All five models fell into the "poor" predictive category, defined as a receiver operating characteristic area under the curve between 0.5 and 0.7. CatBoost performed best, achieving a test ROC AUC of 0.66, an area under the precision-recall curve of 0.008 against an injury prevalence of just 0.39%, and a precision of 0.013. XGBoost was the only other model to exceed a test ROC AUC of 0.6, at 0.61. Logistic regression matched Random Forest on the test set but failed to beat chance during cross-validation, a fluctuation the authors attribute to high variance in performance estimation under severe class imbalance.

The precision-recall figure deserves particular attention, because it speaks directly to clinical usefulness. With injuries occurring on fewer than one in 250 exposure days, even a model with apparently respectable ROC AUC can be practically useless, flagging far too many false positives to be actionable. This is precisely what the Irish data showed.

The practical implications of these numbers are stark. Of the 54 injuries sustained during the nine-month testing period, the model correctly flagged only eight, involving six players. Across 13,833 observations, the model issued 626 high-risk alerts, roughly four per provincial team each week, but only one in 78 alerts was correct. The authors warn that such a high false-positive rate would likely induce "alarm fatigue" among medical practitioners, desensitising them to warnings and undermining any real-world deployment. Injury severity also showed no clear relationship with predicted risk, and while 52% of injuries occurred at risk scores of 0.5 or above, that region comprised 27% of all predictions, with injuries scattered across the entire risk profile.

Imagine, for a moment, the operational reality behind those statistics. A team doctor receiving four alerts per week, nearly all of them false, would face an impossible choice: either restrict or modify the training of a healthy player on the basis of a warning that is almost certainly wrong, or ignore the alerts altogether and lose whatever marginal benefit the system might have offered. Neither option is defensible in a professional environment where training decisions carry competitive and financial consequences.

The SHAP analysis offered a further cautionary insight: four of the five most influential features were non-modifiable risk factors. The strongest predictor was simply whether the next day's session was a match or a training session, reflecting the fivefold higher injury incidence in matches. Injury history to date and time since last injury ranked second and third, with age also prominent. The only workload metric in the top five was the 28-day exponentially weighted moving average of maximal speed, which appeared protective at higher values, consistent with prior evidence that chronic sprint exposure mitigates lower limb injury risk. The authors stress that SHAP values reflect contribution to predictions, not causal relationships, and should be interpreted cautiously given the model's weak performance.

That the most informative signals were things teams already know, that matches are riskier than training, that previously injured and older players are more vulnerable, is itself instructive. The models, given hundreds of sophisticated workload and screening variables, essentially rediscovered basic epidemiology without adding new actionable insight on top of it.

The study's strengths lie in its unprecedented scale and standardisation: identical GNSS hardware, wellness applications and screening protocols across all teams, with injuries logged in a single centralised athlete management system. Yet the authors acknowledge limitations, including potential differences in playing styles and surfaces between clubs, selection bias toward durable players, within-player correlation from including recurrent injuries, unthresholded last-observation-carried-forward imputation of musculoskeletal data, non-uniform screening frequency for players under clinical care, and the absence of calibration or decision-analytic evaluation. No sample size calculation was performed, and no observational machine learning finding should be read causally.

The new device, known as the Mizzou Point-of-Care Assessment System, offers a compact and affordable alternative to the expensive, lab-bound concussion assessment machines currently available. At its core, this system integrates a force plate, a depth camera, and an interface board, allowing it to measure subtle variations in body motion with remarkable precision. The system’s portability fundamentally broadens access to concussion evaluation beyond specialized medical facilities and into settings like athletic fields, military locations, and emergency response scenarios.

In recent experimental research involving 40 collegiate athletes—half diagnosed with concussions—the system was employed to capture data on movement, balance, and reaction times. Through the use of force plates, the apparatus detected weight distribution and balance stability, while the depth camera meticulously tracked motion patterns in three dimensions. The collected data was then fed into machine learning algorithms capable of discerning differences between healthy subjects and those suffering from concussive trauma.

Machine learning algorithms were trained on discrete physical outcome measures, learning to identify hallmark characteristics indicative of concussion. Individuals with a concussion typically exhibited slower reaction times, reduced walking speeds, and impaired balance, especially during tasks designed to stress vestibular and cognitive functions. Notably, tasks performed with eyes closed or involving backward counting from 100 in sevens intensified the difficulty, allowing the system to detect even subtle deficits in motor control.

The system’s basis in machine learning offers a dynamic advantage: baseline assessments can be recorded when individuals are healthy. This personalized data allows subsequent post-injury evaluations to be compared against individual baselines, vastly improving diagnostic accuracy. According to Trent Guess, associate professor and research lead, “If someone undergoes a head injury, our system can compare their current motor and reaction metrics against their baseline, giving clinicians a clear picture of changes linked to concussion.”

Beyond the technical framework, the multidisciplinary collaboration at the University of Missouri stands out. Engineering expertise melds with clinical insights from orthopedics, physical therapy, sports rehabilitation, and exercise science, fostering a holistic approach to concussion identification and management. This fusion ensures that the system is both biomechanically sound and clinically relevant, with direct applications in everyday medical practice.

The potential implications for sports medicine are profound. Rapid onsite assessment could prevent premature return-to-play decisions, reducing risks of further injury. However, the system’s utility extends to professions such as military personnel and first responders, groups who face higher concussion risks in varied environments. The portability of this technology means that evaluations can happen in the field or in non-clinical settings, aiding in timely medical interventions.

Recovery monitoring is another critical application. The Mizzou system can track improvements in balance and reaction over time, providing data-driven evidence to guide rehabilitation protocols. This continuous monitoring is essential to ensure that individuals are genuinely ready to resume physical activity or return to work, emphasizing safety and reducing long-term neurological consequences.

Currently, only a limited number of these devices exist for research purposes. Nonetheless, the research team envisions mass production in the near future, envisioning widespread deployment across sports arenas, clinics, battlefields, and emergency response units. This scaling would democratize concussion assessment, making it accessible outside specialized institutions and enhancing public health outcomes.

The research study documenting this advancement, titled “A machine learning approach to concussive group classification using discrete outcome measures from a low-cost movement-based assessment system,” was published in Medical Engineering & Physics. The study’s experimental design used objective movement metrics and demonstrates the efficacy of machine learning in enhancing concussion diagnostics.

Engineering challenges in system development centered around balancing accuracy, affordability, and usability. The chosen components—force plates capable of detecting minute shifts in pressure distribution, combined with depth cameras that map spatial body movements—represent an intersection of biomechanics and computer vision. The interface board facilitates seamless data communication between hardware and the analytic software, enabling real-time processing.

Machine learning models—likely leveraging classification algorithms such as support vector machines or random forests—parsed through multivariate datasets composed of reaction times, balance parameters, and gait characteristics. These models identify patterns that elude human observation, underpinning the system’s ability to flag concussion-related impairments objectively and efficiently.

As this technology advances, questions remain about integration into existing medical workflows and acceptance by clinicians and athletic trainers. However, the promise of a portable, affordable, and accurate concussion detection tool could revolutionize how concussions are managed worldwide, reducing risks from misdiagnosis and enhancing outcomes for those affected.

—

Subject of Research: People
Article Title: A machine learning approach to concussive group classification using discrete outcome measures from a low-cost movement-based assessment system
News Publication Date: 24-Jul-2025
Web References: http://dx.doi.org/10.1016/j.medengphy.2025.104402
Image Credits: University of Missouri
Keywords: Health care, Emergency medicine, Patient monitoring, Personalized medicine, Medical products, Medical facilities, Health counseling, Sports rehabilitation, Machine learning, Biomechanics, Concussion detection, Medical engineering