A Two-Phased Approach to Quantifying Head Impact Sensor Accuracy: In-Laboratory and On-Field Assessments

Influence of the frame of reference on head acceleration events recorded by instrumented mouthguards in community rugby players

Objectives

To highlight the need for standardisation in the communication of head impact telemetry from instrumented mouthguards (iMG). The purpose of this study is to examine how the frame of reference for reporting head acceleration events (HAE) may affect the interpretation of head impacts recorded from iMGs in community rugby players.

Methods

An analytical investigation of 825 video verified HAEs recorded from male community players during 5 rugby match exposures. HAEs were captured with an iMG, known to be reliable and valid for this purpose. The linear and angular head acceleration at the centre of mass (head_CG) was calculated from filtered iMG accelerometer and gyroscope data, and the location of impact was estimated. The iMG and head_CG data were examined for systematic bias, geometric differences and the degree of concordance. Finally, mixed model analyses were fitted to assess the differences in peak resultant acceleration (PLA) by impact locations and directions of head motion while controlling for intra-athlete correlations.

Results

The degree of concordance between the iMG versus head_CG measures varied by impact location. The mixed model confirmed differences in the PLA by location (F_(8,819) = 16.55, p<0.001) and by direction of head motion (F_(5,417) = 7.78, p<0.001).

Conclusion

The head acceleration reported at the iMG is not proportional to measurements that have been transformed to the head_CG. Depending on the impact location and direction of head motion, the acceleration measured at the iMG may overestimate, underestimate or miss entirely the PLA with respect to the head_CG. We recommend standardising the reporting of iMG data within the head_CG frame of reference.

Consensus Head Acceleration Measurement Practices (CHAMP): Laboratory Validation of Wearable Head Kinematic Devices

Wearable devices are increasingly used to measure real-world head impacts and study brain injury mechanisms. These devices must undergo validation testing to ensure they provide reliable and accurate information for head impact sensing, and controlled laboratory testing should be the first step of validation. Past validation studies have applied varying methodologies, and some devices have been deployed for on-field use without validation. This paper presents best practices recommendations for validating wearable head kinematic devices in the laboratory, with the goal of standardizing validation test methods and data reporting. Key considerations, recommended approaches, and specific considerations were developed for four main aspects of laboratory validation, including surrogate selection, test conditions, data collection, and data analysis. Recommendations were generated by a group with expertise in head kinematic sensing and laboratory validation methods and reviewed by a larger group to achieve consensus on best practices. We recommend that these best practices are followed by manufacturers, users, and reviewers to conduct and/or review laboratory validation of wearable devices, which is a minimum initial step prior to on-field validation and deployment. We anticipate that the best practices recommendations will lead to more rigorous validation of wearable head kinematic devices and higher accuracy in head impact data, which can subsequently advance brain injury research and management.

On-Field Deployment and Validation for Wearable Devices

Wearable sensors are an important tool in the study of head acceleration events and head impact injuries in sporting and military activities. Recent advances in sensor technology have improved our understanding of head kinematics during on-field activities; however, proper utilization and interpretation of data from wearable devices requires careful implementation of best practices. The objective of this paper is to summarize minimum requirements and best practices for on-field deployment of wearable devices for the measurement of head acceleration events in vivo to ensure data evaluated are representative of real events and limitations are accurately defined. Best practices covered in this document include the definition of a verified head acceleration event, data windowing, video verification, advanced post-processing techniques, and on-field logistics, as determined through review of the literature and expert opinion. Careful use of best practices, with accurate acknowledgement of limitations, will allow research teams to ensure data evaluated is representative of real events, will improve the robustness of head acceleration event exposure studies, and generally improve the quality and validity of research into head impact injuries.

Time Delta Head Impact Frequency: An Analysis on Head Impact Exposure in the Lead Up to a Concussion: Findings from the NCAA-DOD Care Consortium

Sport-related concussions can result from a single high magnitude impact that generates concussive symptoms, repeated subconcussive head impacts aggregating to generate concussive symptoms, or a combined effect from the two mechanisms. The array of symptoms produced by these mechanisms may be clinically interpreted as a sport-related concussion. It was hypothesized that head impact exposure resulting in concussion is influenced by severity, total number, and frequency of subconcussive head impacts. The influence of total number and magnitude of impacts was previously explored, but frequency was investigated to a lesser degree. In this analysis, head impact frequency was investigated over a new metric called ‘time delta’, the time difference from the first recorded head impact of the day until the concussive impact. Four exposure metrics were analyzed over the time delta to determine whether frequency of head impact exposure was greater for athletes on their concussion date relative to other dates of contact participation. Those metrics included head impact frequency, head impact accrual rate, risk weighted exposure (RWE), and RWE accrual rate. Athletes experienced an elevated median number of impacts, RWE, and RWE accrual rate over the time delta on their concussion date compared to non-injury sessions. This finding suggests elevated frequency of head impact exposure on the concussion date compared to other dates that may precipitate the onset of concussion.

Ready for impact? A validity and feasibility study of instrumented mouthguards (iMGs)

OBJECTIVES

Assess the validity and feasibility of current instrumented mouthguards (iMGs) and associated systems.

METHODS

Phase I; four iMG systems (Biocore-Football Research Inc (FRI), HitIQ, ORB, Prevent) were compared against dummy headform laboratory criterion standards (25, 50, 75, 100 g). Phase II; four iMG systems were evaluated for on-field validity of iMG-triggered events against video-verification to determine true-positives, false-positives and false-negatives (20±9 player matches per iMG). Phase III; four iMG systems were evaluated by 18 rugby players, for perceptions of fit, comfort and function. Phase IV; three iMG systems (Biocore-FRI, HitIQ, Prevent) were evaluated for practical feasibility (System Usability Scale (SUS)) by four practitioners.

RESULTS

Phase I; total concordance correlation coefficients were 0.986, 0.965, 0.525 and 0.984 for Biocore-FRI, HitIQ, ORB and Prevent. Phase II; different on-field kinematics were observed between iMGs. Positive predictive values were 0.98, 0.90, 0.53 and 0.94 for Biocore-FRI, HitIQ, ORB and Prevent. Sensitivity values were 0.51, 0.40, 0.71 and 0.75 for Biocore-FRI, HitIQ, ORB and Prevent. Phase III; player perceptions of fit, comfort and function were 77%, 6/10, 55% for Biocore-FRI, 88%, 8/10, 61% for HitIQ, 65%, 5/10, 43% for ORB and 85%, 8/10, 67% for Prevent. Phase IV; SUS (preparation-management) was 51.3-50.6/100, 71.3-78.8/100 and 83.8-80.0/100 for Biocore-FRI, HitIQ and Prevent.

CONCLUSION

This study shows differences between current iMG systems exist. Sporting organisations can use these findings when evaluating which iMG system is most appropriate to monitor head acceleration events in athletes, supporting player welfare initiatives related to concussion and head acceleration exposure.

Quantification of Head Acceleration Events in Rugby League: An Instrumented Mouthguard and Video Analysis Pilot Study

Instrumented mouthguards (iMG) were used to collect head acceleration events (HAE) in men's professional rugby league matches. Peak linear acceleration (PLA), peak angular acceleration (PAA) and peak change in angular velocity (ΔPAV) were collected using custom-fit iMG set with a 5 g single iMG-axis recording threshold. iMG were fitted to ten male Super League players for thirty-one player matches. Video analysis was conducted on HAE to identify the contact event; impacted player; tackle stage and head loading type. A total of 1622 video-verified HAE were recorded. Approximately three-quarters of HAE (75.7%) occurred below 10 g. Most (98.2%) HAE occurred during tackles (59.3% to tackler; 40.7% to ball carrier) and the initial collision stage of the tackle (43.9%). The initial collision stage resulted in significantly greater PAA and ΔPAV than secondary contact and play the ball tackle stages (p < 0.001). Indirect HAE accounted for 29.8% of HAE and resulted in significantly greater ΔPAV (p < 0.001) than direct HAE, but significantly lower PLA (p < 0.001). Almost all HAE were sustained in the tackle, with the majority occurring during the initial collision stage, making it an area of focus for the development of player protection strategies for both ball carriers and tacklers. League-wide and community-level implementation of iMG could enable a greater understanding of head acceleration exposure between playing positions, cohorts, and levels of play.

Development of a Machine-Learning-Based Classifier for the Identification of Head and Body Impacts in Elite Level Australian Rules Football Players

Background: Exposure to thousands of head and body impacts during a career in contact and collision sports may contribute to current or later life issues related to brain health. Wearable technology enables the measurement of impact exposure. The validation of impact detection is required for accurate exposure monitoring. In this study, we present a method of automatic identification (classification) of head and body impacts using an instrumented mouthguard, video-verified impacts, and machine-learning algorithms.

Methods: Time series data were collected via the Nexus A9 mouthguard from 60 elite level men (mean age = 26.33; SD = 3.79) and four women (mean age = 25.50; SD = 5.91) from the Australian Rules Football players from eight clubs, participating in 119 games during the 2020 season. Ground truth data labeling on the captures used in this machine learning study was performed through the analysis of game footage by two expert video reviewers using SportCode and Catapult Vision. The visual labeling process occurred independently of the mouthguard time series data. True positive captures (captures where the reviewer directly observed contact between the mouthguard wearer and another player, the ball, or the ground) were defined as hits. Spectral and convolutional kernel based features were extracted from time series data. Performances of untuned classification algorithms from scikit-learn in addition to XGBoost were assessed to select the best performing baseline method for tuning.

Results: Based on performance, XGBoost was selected as the classifier algorithm for tuning. A total of 13,712 video verified captures were collected and used to train and validate the classifier. True positive detection ranged from 94.67% in the Test set to 100% in the hold out set. True negatives ranged from 95.65 to 96.83% in the test and rest sets, respectively.

Discussion and conclusion: This study suggests the potential for high performing impact classification models to be used for Australian Rules Football and highlights the importance of frequencies <150 Hz for the identification of these impacts.

Head Impact Sensor Triggering Bias Introduced by Linear Acceleration Thresholding

Contact sports players frequently sustain head impacts, most of which are mild impacts exhibiting 10-30 g peak head center-of-gravity (CG) linear acceleration. Wearable head impact sensors are commonly used to measure exposure and typically detect impacts using a linear acceleration threshold. However, linear acceleration across the head can substantially vary during 6-degree-of-freedom motion, leading to triggering biases that depend on sensor location and impact condition. We conducted an analytical investigation with impact characteristics extracted from on-field American football and soccer data. We assumed typical mouthguard sensor locations and evaluated whether simulated multi-directional impacts would trigger recording based on per-axis or resultant acceleration thresholding. Across 1387 impact directions, a 10g peak CG linear acceleration impact would trigger at only 24.7% and 31.8% of directions based on a 10 g per-axis and resultant acceleration threshold, respectively. Anterior impact locations had lower trigger rates and even a 30 g impact would not trigger recording in some directions. Such triggering biases also varied by sensor location and linear-rotational head kinematics coupling. Our results show that linear acceleration-based impact triggering could lead to considerable bias in head impact exposure measurements. We propose a set of recommendations to consider for sensor manufacturers and researchers to mitigate this potential exposure measurement bias.

Head Impact Research Using Inertial Sensors in Sport: A Systematic Review of Methods, Demographics, and Factors Contributing to Exposure

BACKGROUND

The number and magnitude of head impacts have been assessed in-vivo using inertial sensors to characterise the exposure in various sports and to help understand their potential relationship to concussion.

OBJECTIVES

We aimed to provide a comprehensive review of the field of in-vivo sensor acceleration event research in sports via the summary of data collection and processing methods, population demographics and factors contributing to an athlete's exposure to sensor acceleration events.

METHODS

The systematic search resulted in 185 cohort or cross-sectional studies that recorded sensor acceleration events in-vivo during sport participation.

RESULTS

Approximately 5800 participants were studied in 20 sports using 18 devices that included instrumented helmets, headbands, skin patches, mouthguards and earplugs. Female and youth participants were under-represented and ambiguous results were reported for these populations. The number and magnitude of sensor acceleration events were affected by a variety of contributing factors, suggesting sport-specific analyses are needed. For collision sports, being male, being older, and playing in a game (as opposed to a practice), all contributed to being exposed to more sensor acceleration events.

DISCUSSION

Several issues were identified across the various sensor technologies, and efforts should focus on harmonising research methods and improving the accuracy of kinematic measurements and impact classification. While the research is more mature for high-school and collegiate male American football players, it is still in its early stages in many other sports and for female and youth populations. The information reported in the summarised work has improved our understanding of the exposure to sport-related head impacts and has enabled the development of prevention strategies, such as rule changes.

CONCLUSIONS

Head impact research can help improve our understanding of the acute and chronic effects of head impacts on neurological impairments and brain injury. The field is still growing in many sports, but technological improvements and standardisation of processes are needed.

Quantifying head acceleration exposure via instrumented mouthguards (iMG): a validity and feasibility study protocol to inform iMG suitability for the TaCKLE project

Instrumented mouthguards (iMGs) have the potential to quantify head acceleration exposures in sport. The Rugby Football League is looking to deploy iMGs to quantify head acceleration exposures as part of the Tackle and Contact Kinematics, Loads and Exposure (TaCKLE) project. iMGs and associated software platforms are novel, thus limited validation studies exist. The aim of this paper is to describe the methods that will determine the validity (ie, laboratory validation of kinematic measures and on-field validity) and feasibility (ie, player comfort and wearability and practitioner considerations) of available iMGs for quantifying head acceleration events in rugby league. Phase 1 will determine the reliability and validity of iMG kinematic measures (peak linear acceleration, peak rotational velocity, peak rotational acceleration), based on laboratory criterion standards. Players will have three-dimensional dental scans and be provided with available iMGs for phase 2 and phase 3. Phase 2 will determine the on-field validity of iMGs (ie, identifying true positive head acceleration events during a match). Phase 3 will evaluate player perceptions of fit (too loose, too tight, bulky, small/thin, held mouth open, held teeth apart, pain in jaw muscles, uneven bite), comfort (on lips, gum, tongue, teeth) and function (speech, swallowing, dry mouth). Phase 4 will evaluate the practical feasibility of iMGs, as determined by practitioners using the system usability scale (preparing iMG system and managing iMG data). The outcome will provide a systematic and robust assessment of a range of iMGs, which will help inform the suitability of each iMG system for the TaCKLE project.

Identifying Factors Associated with Head Impact Kinematics and Brain Strain in High School American Football via Instrumented Mouthguards

Repeated head impact exposure and concussions are common in American football. Identifying the factors associated with high magnitude impacts aids in informing sport policy changes, improvements to protective equipment, and better understanding of the brain's response to mechanical loading. Recently, the Stanford Instrumented Mouthguard (MiG2.0) has seen several improvements in its accuracy in measuring head kinematics and its ability to correctly differentiate between true head impact events and false positives. Using this device, the present study sought to identify factors (e.g., player position, helmet model, direction of head acceleration, etc.) that are associated with head impact kinematics and brain strain in high school American football athletes. 116 athletes were monitored over a total of 888 athlete exposures. 602 total impacts were captured and verified by the MiG2.0's validated impact detection algorithm. Peak values of linear acceleration, angular velocity, and angular acceleration were obtained from the mouthguard kinematics. The kinematics were also entered into a previously developed finite element model of the human brain to compute the 95th percentile maximum principal strain. Overall, impacts were (mean ± SD) 34.0 ± 24.3 g for peak linear acceleration, 22.2 ± 15.4 rad/s for peak angular velocity, 2979.4 ± 3030.4 rad/s² for peak angular acceleration, and 0.262 ± 0.241 for 95th percentile maximum principal strain. Statistical analyses revealed that impacts resulting in Forward head accelerations had higher magnitudes of peak kinematics and brain strain than Lateral or Rearward impacts and that athletes in skill positions sustained impacts of greater magnitude than athletes in line positions. 95th percentile maximum principal strain was significantly lower in the observed cohort of high school football athletes than previous reports of collegiate football athletes. No differences in impact magnitude were observed in athletes with or without previous concussion history, in athletes wearing different helmet models, or in junior varsity or varsity athletes. This study presents novel information on head acceleration events and their resulting brain strain in high school American football from our advanced, validated method of measuring head kinematics via instrumented mouthguard technology.

Time Window of Head Impact Kinematics Measurement for Calculation of Brain Strain and Strain Rate in American Football

Wearable devices have been shown to effectively measure the head's movement during impacts in sports like American football. When a head impact occurs, the device is triggered to collect and save the kinematic measurements during a predefined time window. Then, based on the collected kinematics, finite element (FE) head models can calculate brain strain and strain rate, which are used to evaluate the risk of mild traumatic brain injury. To find a time window that can provide a sufficient duration of kinematics for FE analysis, we investigated 118 on-field video-confirmed football head impacts collected by the Stanford Instrumented Mouthguard. The simulation results based on the kinematics truncated to a shorter time window were compared with the original to determine the minimum time window needed for football. Because the individual differences in brain geometry influence these calculations, we included six representative brain geometries and found that larger brains need a longer time window of kinematics for accurate calculation. Among the different sizes of brains, a pre-trigger time of 40 ms and a post-trigger time of 70 ms were found to yield calculations of brain strain and strain rate that were not significantly different from calculations using the original 200 ms time window recorded by the mouthguard. Therefore, approximately 110 ms is recommended for complete modeling of impacts for football.

Development of a Low-Power Instrumented Mouthpiece for Directly Measuring Head Acceleration in American Football

Instrumented mouthpieces (IM) offer a means of measuring head impacts that occur in sport. Direct measurement of angular head kinematics is preferential for accuracy; however, existing IMs measure angular velocity and differentiate the measurement to calculate angular acceleration, which can limit bandwidth and consume more power. This study presents the development and validation of an IM that uses new, low-power accelerometers for direct measurement of linear and angular acceleration over a broad range of head impact conditions in American football. IM sensor accuracy for measuring six-degree-of-freedom head kinematics was assessed using two helmeted headforms instrumented with a custom-fit IM and reference sensor instrumentation. Head impacts were performed at 10 locations and 6 speeds representative of the on-field conditions associated with injurious and non-injurious impacts in American football. Sensor measurements from the IM were highly correlated with those from the reference instrumentation located at the maxilla and skull center of gravity. Based on pooled data across headform and impact location, R² ≥ 0.94, mean absolute error (AE) ≤ 7%, and mean relative impact angle ≤ 11° for peak linear and angular acceleration and angular velocity while R² ≥ 0.90 and mean AE ≤ 7% for kinematic-based injury metrics used in helmet tests.

An Experimental Platform Generating Simulated Blunt Impacts to the Head Due to Rearward Falls

Impacts to the back of the head due to rearward falls, also referred to as "backfall" events, represent a common source of TBI for athletes and soldiers. A new experimental apparatus is described for replicating the linear and rotational kinematics of the head during backfall events. An anthropomorphic test device (ATD) with a head-borne sensor suite was configured to fall backwards from a standing height, inducing contact between the rear of the head and a ground surface simulant. A pivoting swing arm and release strap were used to generate consistent and realistic head kinematics. Backfall experiments were performed with the ATD fitted with an American football helmet and the resulting linear and rotational head kinematics, as well as calculated injury metrics, compared favorably with those of football players undergoing similar impacts during games or play reconstructions. This test method complements existing blunt impact helmet performance experiments, such as drop tower and pneumatic ram test methods, which may not be able to fully reproduce head-neck-torso kinematics during a backfall event.

Head impact exposure and concussion in women's collegiate club lacrosse

This study sought to describe head impact exposure in women's collegiate club lacrosse. Eleven women's collegiate club lacrosse players wore head impact sensors during eight intercollegiate competitions. Video recordings of competitions were used to verify impact data. Athletes completed questionnaires detailing their concussion history and perceived head impact exposure. During the monitored games, no diagnosed concussions were sustained. Three athletes reported sustaining head impacts (median = 0; range: 0-3 impacts per game). Six impacts registered by the sensors were verified on video across a total of 81 athlete-game exposures. Verified impacts had a median peak linear acceleration of 21.0 g (range: 18.3 g - 48.3 g) and peak rotational acceleration of 1.1 krad/s² (range: 0.7 krad/s² - 5.7 krad/s²). Women competing in collegiate club lacrosse are at a low risk of sustaining head impacts, comparable to previous reports of the high school and collegiate varsity levels of play.

The Hammer and the Nail: Biomechanics of Striking and Struck Canadian University Football Players

This study sought to evaluate head accelerations in both players involved in a football collision. Players on two opposing Canadian university teams were equipped with helmet mounted sensors during one game per season, for two consecutive seasons. A total of 276 collisions between 58 instrumented players were identified via video and cross-referenced with sensor timestamps. Player involvement (striking and struck), impact type (block or tackle), head impact location (front, back, left and right), and play type were recorded from video footage. While struck players did not experience significantly different linear or rotational accelerations between any play types, striking players had the highest linear and rotational head accelerations during kickoff plays (p ≤ .03). Striking players also experienced greater linear and rotational head accelerations than struck players during kickoff plays (p = .001). However, struck players experienced greater linear and rotational accelerations than striking players during kick return plays (p ≤ .008). Other studies have established that the more severe the head impact, the greater risk for injury to the brain. This paper's results highlight that kickoff play rule changes, as implemented in American college football, would decrease head impact exposure of Canadian university football athletes and make the game safer.

High Energy Side and Rear American Football Head Impacts Cause Obvious Performance Decrement on Video

The objective of this study was to compare head impact data acquired with an impact monitoring mouthguard (IMM) to the video-observed behavior of athletes' post-collision relative to their pre-collision behaviors. A total of n = 83 college and high school American football players wore the IMM and were video-recorded over 260 athlete-exposures. Ex-athletes and clinicians reviewed the video in a two-step process and categorized abnormal post-collision behaviors according to previously published Obvious Performance Decrement (OPD) definitions. Engineers qualitatively reviewed datasets to check head impact and non-head impact signal frequency and magnitude. The ex-athlete reviewers identified 2305 head impacts and 16 potential OPD impacts, 13 of which were separately categorized as Likely-OPD impacts by the clinical reviewers. All 13 Likely-OPD impacts were in the top 1% of impacts measured by the IMM (ranges 40-100 g, 3.3-7.0 m/s and 35-118 J) and 12 of the 13 impacts (92%) were to the side or rear of the head. These findings require confirmation in a larger data set before proposing any type of OPD impact magnitude or direction threshold exists. However, OPD cases in this study compare favorably with previously published impact monitoring studies in high school and college American football players that looked for OPD signs, impact magnitude and direction. Our OPD findings also compare well with NFL reconstruction studies for ranges of concussion and sub-concussive impact magnitudes in side/rear collisions, as well as prior theory, analytical models and empirical research that suggest a directional sensitivity to brain injury exists for single high-energy impacts.