Predictive Accuracy of the Sport Concussion Assessment Tool 3 and Vestibular/Ocular-Motor Screening, Individually and In Combination: A National Collegiate Athletic Association-Department of Defense Concussion Assessment, Research and Education Consortium Analysis

Utility of the Vestibular/Ocular Motor Screening in Military Medicine: A Systematic Review

INTRODUCTION

The Vestibular/Ocular Motor Screening (VOMS) was created as a brief clinical screening tool for identifying vestibular and ocular motor symptoms and impairments post-concussion. It was found to have predictive validity in correctly identifying concussed athletes from healthy controls. In 2018, the Military Acute Concussion Evaluation 2 (MACE2) replaced the original Military Acute Concussion Evaluation (MACE); the most prominent change between the MACE and MACE2 was the addition of the VOMS. Despite its adoption into military medicine, it is not known if the addition of the VOMS to the MACE2 is acutely helpful, and if it provides additional information for diagnosis, prognosis, and/or management. The purposes of this systematic review were: (1) to determine the utility of the VOMS in correctly identifying concussed individuals, particularly as it pertains to military medicine; (2) to explore the extent to which the VOMS can inform concussion prognosis; and (3) to establish the value of the VOMS as a measure for monitoring the evolution of symptoms throughout a service member's course of care.

MATERIALS AND METHODS

A comprehensive search of PubMed was performed from January 1, 2014 through August 16, 2023. Articles were included if they researched concussion or a related health condition or healthy controls and administered the VOMS. Articles were excluded if they discussed health conditions other than concussion; did not administer the VOMS; or were written in languages other than English. The tools used to assess methodological quality and risk of bias varied according to study design. Articles were classified into three primary domains: diagnosis, prognosis, and/or rehabilitation/recovery over time.

RESULTS

A total of 231 articles were retrieved and 3 were duplicates, leaving 228 articles for review. Of the 228 articles screened, 100 relevant full-text articles were assessed for eligibility. Fifty-nine articles met our inclusion and exclusion criteria while the other 41 articles were rejected. Thirty-two articles helped to inform diagnosis, 15 prognosis, and 16 rehabilitation/recovery over time.

CONCLUSIONS

The VOMS had excellent internal consistency and moderate to good test-retest reliability; however, a false-positive rate of 21.9% was found. Most studies indicated that a positive VOMS was associated with a delayed recovery. Several studies indicated that VOMS scores improved with targeted, active interventions and/or a symptom-guided progressive return to activity. The greatest limitation was the paucity of published evidence in the military population. More research is needed on the use of the VOMS in service members.

Psychometric Properties of Vestibular and Ocular Measures Used for Concussion Assessments: A Scoping Review

BACKGROUND

Concussions most commonly affect the vestibular and ocular systems. Clinical measures used in the assessment of vestibular and ocular deficits should contain strong psychometric properties so that clinicians can accurately detect abnormality to guide treatment interventions.

OBJECTIVES

The aim of this scoping review was: (1) to identify the measures used to evaluate the vestibular and ocular domains postconcussion and (2) to document the psychometric properties of the measures.

METHODS

Two databases (Medline (Ovid) and Embase) were searched from inception to May 2023. An updated search was completed in January 2024 using the same databases and search terms. Studies were screened and data were extracted independently by 2 reviewers. Measures were categorized into vestibular, ocular, or both (vestibular and ocular) domains, and relevant psychometric properties were documented.

RESULTS

Fifty-two studies were included in this review. 28 studies explored the use of vestibular measures, 12 explored ocular measures, and 12 explored both vestibular and ocular measures or explored the use of vestibulo-ocular reflex measures. Most studies explored the properties associated with balance measures, particularly the balance error scoring system. Diagnostic accuracy (sensitivity and specificity metrics) of the associated measures was the most frequently documented characteristic in the literature.

CONCLUSION

Identification of clinical measures used to evaluate vestibular and ocular deficits postconcussion is needed to understand the evidence supporting their use in practice. Documenting the psychometric properties will allow clinicians and researchers to understand the status of the current literature and support for the use of certain measures in practice in terms of their ability to appropriately detect deficits in people with concussion when deficits are truly present.

Clinical Utility of Ocular Assessments in Sport-Related Concussion: A Scoping Review

Background/objectives: Ocular tools and technologies may be used in the diagnosis of sport-related concussions (SRCs), but their clinical utility can vary. The following study aimed to review the literature pertaining to the reliability and diagnostic accuracy of such assessments. Methods: The preferred reporting items for systematic reviews and meta-analysis (PRISMA) extension for scoping reviews was adhered to. Reference standard reliability (RSR ≥ 0.75) and diagnostic accuracy (RSDA ≥ 0.80) were implemented to aid interpretation. Results: In total, 5223 articles were screened using the PCC acronym (Population, Concept, Context) with 74 included in the final analysis. Assessments included the King-Devick (KD) (n = 34), vestibular-ocular motor screening (VOMs) and/or near point of convergence (NPC) (n = 25), and various alternative tools and technologies (n = 20). The KD met RSR, but RSDA beyond amateur sport was limited. NPC met RSR but did not have RSDA to identify SRCs. The VOMs had conflicting RSR for total score and did not meet RSR in its individual tests. The VOMs total score did perform well in RSDA for SRCs. No alternative tool or technology met both RSR and RSDA. Conclusion: Ocular tools are useful, rapid screening tools but should remain within a multi-modal assessment for SRCs at this time.

Optimizing baseline and post-concussion assessments through identification, confirmation, and equivalence of latent factor structures: Findings from the NCAA-DoD CARE Consortium

Objective: Concussion evaluations use a multidimensional assessment to evaluate unique patient function dimensions (e.g., subjective symptoms differ from balance assessments), but the overarching latent factor structure has not been empirically substantiated. Our objective was to determine the cumulative latent factor structure of pre-injury baseline and acute (<48-h) post-concussion assessment battery outcomes, and determine measurement equivalence among common factors in collegiate student-athletes. Methods: Collegiate student-athletes at baseline (n = 21,865) and post-concussion (n = 1,537) across 25-institutions completed standardized assessments. Individual items were used from the baseline and post-concussion assessments and consisted of: Sport Concussion Assessment Tool, Brief Symptom Inventory-18, Standardized Assessment of Concussion, Balance Error Scoring System, Immediate Post-Concussion Assessment and Cognitive Test, and vestibular-ocular motor screening. Exploratory factor analysis was used on half the baseline data, and confirmatory factor analysis on the remaining baseline data and post-concussion data separately. Measurement equivalence was assessed between sex, sport contact classification, concussion history, and time. Results: A 10-factor exploratory model was established and comprised of: depression, somatic, vestibulo-ocular, headache, postural stability, neurocognition, emotional, fatigue, cognitive, consciousness clouding. The 10-factor model was confirmed at baseline and post-concussion with strong measurement equivalence between timepoints. Strong to strict measurement equivalence was observed for sex, sport contact classification, and concussion history at both timepoints separately. Conclusion: Our findings established a robust 10-factor latent factor model equivalent across timepoints and common factors among healthy and concussed collegiate athletes. Clinicians can use these findings to target specific factors while reducing redundant elements to provide efficient, comprehensive post-concussion assessments.

False-Positive Rates, Risk Factors, and Interpretations of the Vestibular/Ocular Motor Screening in Collegiate Athletes

CONTEXT

Biological sex and history of motion sickness are known modifiers associated with a false-positive baseline Vestibular/Ocular Motor Screening (VOMS). However, other factors may be associated with a false-positive VOMS in collegiate athletes.

OBJECTIVE

To identify contributing factors to false-positive VOMS assessments using population-specific criteria. We also critically appraised previously reported interpretation criteria.

DESIGN

Descriptive laboratory study.

SETTING

Single-site collegiate athletic training clinic.

PATIENTS OR OTHER PARTICIPANTS

National Collegiate Athletic Association Division I athletes (n = 462 [41% female]) aged 18.8 ± 1.4 years.

MAIN OUTCOME MEASURE(S)

Participants completed the Athlete Sleep Behavior Questionnaire, the 7-Item Generalized Anxiety Index, the Immediate Postconcussion Assessment and Cognitive Testing battery, the Patient Health Questionnaire-9, the Revised Head Injury Scale, the Sensory Organization Test, and the VOMS as part of a multidimensional baseline concussion assessment. Participants were classified into 2 groups based on whether they had a total symptom score of greater than or equal to 8 after VOMS administration, excluding the baseline checklist. We used χ2 and independent t tests to compare group demographics. A binary logistic regression with adjusted odds ratios (ORs) was used to evaluate the influence of sex, corrected vision, attention-deficit/hyperactivity disorder, Immediate Postconcussion Assessment and Cognitive Testing composite scores, concussion history, history of treatment for headache and/or migraine, Generalized Anxiety Index scores, Patient Health Questionnaire-9 scores, Athlete Sleep Behavior Questionnaire scores, and Sensory Organization Test equilibrium scores and somatosensory, visual, and vestibular sensory ratios on false-positive rates.

RESULTS

Approximately 9.1% (42 of 462 [30 females]) met criteria for a false-positive VOMS. A significantly greater proportion of females had false positives (χ21 = 18.37, P < .001). Female sex (OR = 2.79; 95% CI = 1.17, 6.65; P = .02) and history of treatment for headache (OR = 4.99; 95% CI = 1.21, 20.59; P = .026) were the only significant predictors of false-positive VOMS. Depending on cutoff interpretation, false-positive rates using our data ranged from 9.1% to 22.5%.

CONCLUSIONS

Our results support the most recent interpretation guidelines for the VOMS in collegiate athletes due to a low false-positive rate and ease of interpretation. Biological sex and history of headaches should be considered when administering the VOMS in the absence of a baseline.

Maximizing the Accuracy of Adolescent Concussion Diagnosis Using Individual Elements of Common Standardized Clinical Assessment Tools

CONTEXT

Multiple clinical evaluation tools exist for adolescent concussion with various degrees of correlation, presenting challenges for clinicians in identifying which elements of these tools provide the greatest diagnostic utility.

OBJECTIVE

To determine the combination of elements from 4 commonly used clinical concussion batteries that maximize discrimination of adolescents with concussion from those without concussion.

DESIGN

Cross-sectional study.

SETTING

Suburban school and concussion program of a tertiary care academic center.

PATIENTS OR OTHER PARTICIPANTS

A total of 231 participants with concussion (from a suburban school and a concussion program) and 166 participants without concussion (from a suburban school) between the ages of 13 and 19 years.

MAIN OUTCOME MEASURE(S)

Individual elements of the visio-vestibular examination (VVE), Sport Concussion Assessment Tool, fifth edition (SCAT5; including the modified Balance Error Scoring System), King-Devick test (K-D), and Postconcussion Symptom Inventory (PCSI) were evaluated. The 24 subcomponents of these tests were grouped into interpretable factors using sparse principal component analysis. The 13 resultant factors were combined with demographic and clinical covariates into a logistic regression model and ranked by frequency of inclusion into the ideal model, and the predictive performance of the ideal model was compared with each of the clinical batteries using the area under the receiver operating characteristic curve (AUC).

RESULTS

A cluster of 4 factors (factor 1 [VVE saccades and vestibulo-ocular reflex], factor 2 [modified Balance Error Scoring System double-legged stance], factor 3 [SCAT5/PCSI symptom scores], and factor 4 [K-D completion time]) emerged. A model fit with the top factors performed as well as each battery in predicting concussion status (AUC = 0.816 [95% CI = 0.731, 0.889]) compared with the SCAT5 (AUC = 0.784 [95% CI = 0.692, 0.866]), PCSI (AUC = 0.776 [95% CI = 0.674, 0.863]), VVE (AUC = 0.711 [95% CI = 0.602, 0.814]), and K-D (AUC = 0.708 [95% CI = 0.590, 0.819]).

CONCLUSIONS

A multifaceted assessment for adolescents with concussion, comprising symptoms, attention, balance, and the visio-vestibular system, is critical. Current diagnostic batteries likely measure overlapping domains, and the sparse principal component analysis demonstrated strategies for streamlining comprehensive concussion assessment across a variety of settings.

Early Exercise is Associated with Faster Concussion Recovery Among Collegiate Athletes: Findings from the NCAA-DoD CARE Consortium

BACKGROUND

Growing evidence indicates early exercise may improve symptoms and reduce clinical recovery time after concussion, but research examining collegiate student-athletes is scarce.

OBJECTIVE

The aim of this study was to compare symptom recovery time, clinical recovery time, and persisting post-concussion symptom (i.e., symptoms ≥ 28 days) prevalence by the timing of light exercise initiation before the graded return to play (RTP) protocol among concussed participants.

METHODS

Collegiate student-athletes (n = 1228; age 18.4 ± 0.9 years; 56.5% male, 76.3% division I; 33.7% ≥ 1 prior concussion) across 30 institutions enrolled in the CARE Consortium completed post-concussion assessments and were monitored over time. Symptom recovery (days from injury to symptom resolution) and clinical recovery (days from injury to return to play protocol completion) was determined by the student-athletes' clinicians. Student-athletes were categorized by timing of light exercise initiation. Early (< 2 days post-concussion; n = 161), typical (3-7 days post-concussion; n = 281), and late exercise (≥ 8 days post-concussion; n = 169) groups were compared with the no-exercise group (n = 617; i.e., did not exercise prior to beginning the RTP protocol) for all analyses. Multivariable Cox regression models with hazard ratios (HR) and survival curves and a multivariable binomial regression model with prevalence ratios (PR) compared recovery outcomes between exercise groups while accounting for covariates.

RESULTS

Compared to the no-exercise group, the early exercise group was 92% more probable to experience symptom recovery (HR 1.92; 95% CI 1.57-2.36), 88% more probable to reach clinical recovery (HR 1.88; 95% CI 1.55-2.28) and took a median of 2.4 and 3.2 days less to recover, respectively. The late exercise group relative to the no-exercise group was 57% less probable to reach symptom recovery (HR 0.43; 95% CI 0.35-0.53), 46% less probable to achieve clinical recovery (HR 0.54; 95% CI 0.45-0.66) and took 5.3 days and 5.7 days more to recover, respectively. The typical exercise group did not differ in hazard for symptom or clinical recovery (p ≥ 0.329) compared with the no-exercise group. The prevalence of persisting post-concussion symptoms in the combined sample was 6.6%. Early exercise had 4% lower prevalence (PR 0.96, 95% CI 0.94-0.99) and typical exercise had 3% lower prevalence (PR 0.97, 95% CI 0.94-0.99) of persisting post-concussion symptoms, while the late exercise group had an elevated prevalence (PR 1.11, 95% CI 1.04-1.18) compared with the no-exercise group.

CONCLUSION

Exercise < 2 days post-concussion was associated with more probable and faster symptom and clinical recovery, and lower persisting post-concussion symptom prevalence. When considering our findings and existing literature, qualified clinicians may implement early exercise into their clinical practice to provide therapeutic treatment and improve student-athlete recovery.

Vision as a piece of the head trauma puzzle

Approximately half of the brain's circuits are involved in vision and control of eye movements. Therefore, visual dysfunction is a common symptom of concussion, the mildest form of traumatic brain injury (TBI). Photosensitivity, vergence dysfunction, saccadic abnormalities, and distortions in visual perception have been reported as vision-related symptoms following concussion. Impaired visual function has also been reported in populations with a lifetime history of TBI. Consequently, vision-based tools have been developed to detect and diagnose concussion in the acute setting, and characterize visual and cognitive function in those with a lifetime history of TBI. Rapid automatized naming (RAN) tasks have provided widely accessible and quantitative measures of visual-cognitive function. Laboratory-based eye tracking approaches demonstrate promise in measuring visual function and validating results from RAN tasks in patients with concussion. Optical coherence tomography (OCT) has detected neurodegeneration in patients with Alzheimer's disease and multiple sclerosis and may provide critical insight into chronic conditions related to TBI, such as traumatic encephalopathy syndrome. Here, we review the literature and discuss the future directions of vision-based assessments of concussion and conditions related to TBI.

Acute evaluation of sport-related concussion and implications for the Sport Concussion Assessment Tool (SCAT6) for adults, adolescents and children: a systematic review

OBJECTIVES

To systematically review the scientific literature regarding the acute assessment of sport-related concussion (SRC) and provide recommendations for improving the Sport Concussion Assessment Tool (SCAT6).

DATA SOURCES

Systematic searches of seven databases from 2001 to 2022 using key words and controlled vocabulary relevant to concussion, sports, SCAT, and acute evaluation.

ELIGIBILITY CRITERIA

(1) Original research articles, cohort studies, case-control studies, and case series with a sample of >10; (2) ≥80% SRC; and (3) studies using a screening tool/technology to assess SRC acutely (<7 days), and/or studies containing psychometric/normative data for common tools used to assess SRC.

DATA EXTRACTION

Separate reviews were conducted involving six subdomains: Cognition, Balance/Postural Stability, Oculomotor/Cervical/Vestibular, Emerging Technologies, and Neurological Examination/Autonomic Dysfunction. Paediatric/Child studies were included in each subdomain. Risk of Bias and study quality were rated by coauthors using a modified SIGN (Scottish Intercollegiate Guidelines Network) tool.

RESULTS

Out of 12 192 articles screened, 612 were included (189 normative data and 423 SRC assessment studies). Of these, 183 focused on cognition, 126 balance/postural stability, 76 oculomotor/cervical/vestibular, 142 emerging technologies, 13 neurological examination/autonomic dysfunction, and 23 paediatric/child SCAT. The SCAT discriminates between concussed and non-concussed athletes within 72 hours of injury with diminishing utility up to 7 days post injury. Ceiling effects were apparent on the 5-word list learning and concentration subtests. More challenging tests, including the 10-word list, were recommended. Test-retest data revealed limitations in temporal stability. Studies primarily originated in North America with scant data on children.

CONCLUSION

Support exists for using the SCAT within the acute phase of injury. Maximal utility occurs within the first 72 hours and then diminishes up to 7 days after injury. The SCAT has limited utility as a return to play tool beyond 7 days. Empirical data are limited in pre-adolescents, women, sport type, geographical and culturally diverse populations and para athletes.

PROSPERO REGISTRATION NUMBER

CRD42020154787.

Beyond acute concussion assessment to office management: a systematic review informing the development of a Sport Concussion Office Assessment Tool (SCOAT6) for adults and children

OBJECTIVES

To systematically review the scientific literature regarding the assessment of sport-related concussion (SRC) in the subacute phase (3-30 days) and provide recommendations for developing a Sport Concussion Office Assessment Tool (SCOAT6).

DATA SOURCES

MEDLINE, Embase, PsycINFO, Cochrane CENTRAL, CINAHL, SPORTDiscus and Web of Science searched from 2001 to 2022. Data extracted included study design, population, definition of SRC diagnosis, outcome measure(s) and results.

ELIGIBILITY CRITERIA

(1) Original research, cohort studies, case-control studies, diagnostic accuracy and case series with samples >10; (2) SRC; (3) screening/technology that assessed SRC in the subacute period and (4) low risk of bias (ROB). ROB was performed using adapted Scottish Intercollegiate Guidelines Network criteria. Quality of evidence was evaluated using the Strength of Recommendation Taxonomy classification.

RESULTS

Of 9913 studies screened, 127 met inclusion, assessing 12 overlapping domains. Results were summarised narratively. Studies of acceptable (81) or high (2) quality were used to inform the SCOAT6, finding sufficient evidence for including the assessment of autonomic function, dual gait, vestibular ocular motor screening (VOMS) and mental health screening.

CONCLUSION

Current SRC tools have limited utility beyond 72 hours. Incorporation of a multimodal clinical assessment in the subacute phase of SRC may include symptom evaluation, orthostatic hypotension screen, verbal neurocognitive tests, cervical spine evaluation, neurological screen, Modified Balance Error Scoring System, single/dual task tandem gait, modified VOMS and provocative exercise tests. Screens for sleep disturbance, anxiety and depression are recommended. Studies to evaluate the psychometric properties, clinical feasibility in different environments and time frames are needed.

PROSPERO REGISTRATION NUMBER

CRD42020154787.

Association of Multidomain Assessment Outcomes With Referral for Vestibular Therapy After Concussion

CONTEXT

Multiple aspects of a multidomain assessment have been validated for identifying concussion; however, researchers have yet to determine which components are related to referral for vestibular therapy.

OBJECTIVE

To identify which variables from a multidomain assessment were associated with receiving a referral for vestibular therapy after a concussion.

DESIGN

Retrospective chart review, level of evidence 3.

PATIENTS OR OTHER PARTICIPANTS

Participants (n = 331; age = 16.9 ± 7.2 years; 39.3% female) were diagnosed with a concussion per international consensus criteria by a clinical neuropsychologist after presenting to a concussion specialty clinic.

MAIN OUTCOME MEASURE(S)

Medical chart data were extracted from the first clinical visit regarding preinjury medical history, computerized neurocognition, Post-Concussion Symptom Scale, Concussion Clinical Profiles Screen, and Vestibular Ocular Motor Screening within 16.2 ± 46.7 days of injury. We built 5 backwards logistic regression models to associate the outcomes from each of the 5 assessments with referral for vestibular therapy. A final logistic regression model was generated using variables retained in the previous 5 models as potential predictors of referral for vestibular therapy.

RESULTS

The 5 models built from individual components of the multidomain assessment predicted referral for vestibular therapy (R2 = 0.01-0.28) with 1 to 6 statistically significant variables. The final multivariate model (R2 = 0.40) retained 9 significant variables, represented by each of the 5 multidomain assessments except neurocognition. Variables that had the strongest association with vestibular therapy referral were motor vehicle accident mechanism of injury (odds ratio [OR] = 15.45), migraine history (OR = 3.25), increased headache when concentrating (OR = 1.81), and horizontal vestibular ocular reflex (OR = 1.63).

CONCLUSIONS

We demonstrated the utility of a multidomain assessment and identified outcomes associated with a referral for vestibular therapy after a concussion.

The Implementation of a Return-to-Play Protocol with Standardized Physical Therapy Referrals in a Collegiate Football Program: PT's Role in Return-to-Play, A Clinical Commentary

Sport-related concussions (SRCs) are multi-faceted injuries requiring coordinated care for return-to-play (RTP). Although the number of concussions in collegiate football is increasing annually, there is poor standardization among RTP protocols. Recent evidence suggests there is an increased risk of lower extremity injury, neuropsychiatric consequences, and re-injury after SRC, and risk factors for a prolonged recovery from SRC have also been identified. Evidence demonstrates a faster RTP and improved outcomes with early physical therapy intervention; however, this is not yet common practice in the treatment of acute SRC. There is little guidance available on the development and implementation of a multidisciplinary RTP rehabilitation protocol for SRC that incorporates standardized physical therapy. By describing an evidence-based RTP protocol with standardized physical therapy management, and measures taken to implement this protocol, this clinical commentary aims to identify steps in treating SRC that can be used to improve recovery. The purpose of this commentary is to: a) survey the current state of standardization of RTP protocols in collegiate football; b) highlight the development and implementation of a RTP protocol with standardized physical therapy referral and management in an NCAA Division II collegiate football program; and c) describe results of a full-season pilot study, including time to evaluation, time to RTP, rate of re-injury or lower extremity injury, and the clinical significance of protocol implementation.

Level of Evidence

Level V.

Vestibular/ocular motor screening (VOMS) score for identification of concussion in cases of non-severe head injury: A systematic review

Background

and importance Each year, 1.4 million patients attend a UK ED with a head injury. Mild traumatic brain injury affects up to 300/100 000 admitted patients/year and a greater number of non-admitted patients. Identifying those patients with a head injury that have concussion, and of those, which will have a prolonged recovery, is critical for discharge planning. The Vestibular/Ocular Motor Screening test (VOMS) has been reported as a useful “sideline tool” to evaluate for sports-related concussion (SRC). VOMS has been assessed for utility primarily for predicting in head-injured, which cases will have concussion, and secondarily in predicting in concussed patients, which will have prolonged recovery. Originally described in 2014, VOMS has not been subject to systematic review or meta-analysis, with regard to its predictive performance for concussion.

Objective

To assess the state of VOMS evidence for dichotomously classifying concussion status in patients with non-severe head injury

Design

Systematic review.

Setting and participants

Studies comprising the review enrolled ambulatory head-injured adults and children, usually from sports-related settings, in Europe or the USA.

Exposure

VOMS.

Outcome measures

Presence of concussion, presence of prolonged recovery in concussed patients

Main results

The review identified 17 studies, characterized by a wide variety of specific approaches to administering and scoring VOMS. While VOMS showed promise as a screening tool for concussion, marked study heterogeneity precluded generation of a pooled effect estimate for VOMS performance.

Conclusion

VOMS is potentially useful as a concussion screening tool. Available evidence from the SRC arena suggests sensitivity ranging from 58–96%, with specificity 46−92%. Directions for future VOMS research should include evaluation of standardized administration and scoring, potentially of a simpler VOMS (with fewer components), in a general head-injured population. Further analysis of precisely defined VOMS application may be useful to determine the proper place of VOMS screening for the head-injured.

Optimizing VOMS for identifying acute concussion in collegiate athletes: Findings from the NCAA-DoD CARE consortium

The Vestibular/Ocular-Motor Screening (VOMS), an important component in acute (<72 h) sport-related concussion (SRC) assessment, is increasingly used alongside the Sport Concussion Assessment Tool (SCAT) and as part of the Military Acute Concussion Evaluation 2 (MACE2). VOMS demonstrates clinically useful diagnostic accuracy for acute SRC and improves the overall utility when added to the SCAT3. However, potential overlap among VOMS's vestibular and oculomotor items suggests the possibility of a more efficient version. VOMS and SCAT3 scores were analyzed for 3,958 preseason (47.8% female) and 496 acute-SRC (37.5% female) NCAA-DoD Concussion Assessment, Research, and Education (CARE) consortium collegiate athlete evaluations. Analyses revealed very large effect sizes (d = 2.39-2.45) and high correlations (rho = 0.95-0.99) among all VOMS items except near point of convergence distance (d = 0.79, rho ≤ 0.341). Receiver operating characteristic (ROC) curve analyses showed clinically useful discriminative utility for VOMS Total (AUC = 0.85) and the VOMS Total change score, where pretest symptoms were incorporated (AUC = 0.81). A modified VOMS (mVOMS) consisting of four items (smooth pursuits, horizontal saccades, horizontal vestibulo-ocular reflex, visual motion sensitivity) yielded identical AUCs to VOMS Total. Integer cutoff analyses suggest a score of ≥4 for VOMS Total and ≥4 for mVOMS Total optimizes concussion identification. Incorporating VOMS or mVOMS into SCAT3 (AUC = 0.79) significantly improved the combined tool's acute utility for acute concussion identification by a maximum of 4% (SCAT3+VOMS AUC = 0.84, SCAT3+mVOMS AUC = 0.83). Future versions of SCAT or MACE may want to consider incorporating a more parsimonious VOMS for the purpose of identifying acute concussion.

Factors Associated With a Prolonged Time to Return to Play After a Concussion

BACKGROUND

Prognosticating recovery times for individual athletes with a concussion remains a challenge for health care providers. Several preinjury and postinjury factors have been proposed to be predictive of prolonged return-to-play (RTP) times, but the data in this area are still sparse.

PURPOSES

This study aimed to identify risk factors associated with prolonged recovery times and determine which are most predictive of prolonged recovery times in a head-to-head comparison.

STUDY DESIGN

Case-control study; Level of evidence, 3.

METHODS

All concussions occurring between September 2017 and August 2020 at a single National Collegiate Athletic Association Division I institution were reviewed and included in this study. Preinjury modifiers including age, sex, sport, concussion history, and past medical problems were collected from the electronic medical records. Postinjury modifiers analyzed included initial and follow-up Sport Concussion Assessment Tool 5th Edition scores, vestibular evaluation findings, and eye tracking results.

RESULTS

A total of 159 athletes and 187 concussion cases were included. Preinjury factors that were correlated with prolonged RTP times included a history of concussions (P = .015), a history of migraines (P = .013), and whether an athlete participated in an individual sport (P = .009). Postinjury factors correlated with prolonged RTP times included the total number (P = .020) and severity (P = .023) of symptoms as well as abnormal Vestibular Ocular Motor Screening findings (P = .002). Overall, 6 different symptoms (balance problems, difficulty concentrating, light sensitivity, drowsiness, fatigue/low energy, and difficulty remembering) were significantly correlated with prolonged RTP times. The study also found that the number and severity of symptoms were additive in a dose-dependent fashion. On multivariable analysis of all these factors, a history of concussions was found to be the most predictive of prolonged RTP times, while participation in an individual sport had the largest effect on recovery times.

CONCLUSION

Several preinjury and postinjury risk factors were identified as being correlated with prolonged recovery times. Many of these risk factors were also found to be additive in nature. This information provides clinicians with a valuable tool in prognosticating and estimating recovery times for athletes. The study also revealed that athletes participating in individual sports had longer RTP times compared with athletes in team sports, which is a novel finding that requires further research.

Safeguarding Athletes Against Head Injuries Through Advances in Technology: A Scoping Review of the Uses of Machine Learning in the Management of Sports-Related Concussion

Sports injury prevention is an important part of the athlete welfare and safeguarding research field. In sports injury prevention, sport-related concussion (SRC) has proved to be one of the most difficult and complex injuries to manage in terms of prevention, diagnosis, classification, treatment and rehabilitation. SRC can cause long-term health issues and is a commonly reported injury in both adult and youth athletes around the world. Despite increased knowledge of the prevalence of SRC, very few tools are available for diagnosing SRC in athletic settings. Recent technological innovations have resulted in different machine learning and deep learning methodologies being tested to improve the management of this complex sports injury. The purpose of this article is to summarize and map the existing research literature on the use of machine learning in the management of SRC, ascertain where there are gaps in the existing research and identify recommendations for future research. This is explored through a scoping review. A systematic search in the three electronic databases SPORTDiscus, PubMed and Scopus identified an initial 522 studies, of which 24 were included in the final review, the majority of which focused on machine learning for the prediction and prevention of SRC (N = 10), or machine learning for the diagnosis and classification of SRC (N = 11). Only 3 studies explored machine learning approaches for the treatment and rehabilitation of SRC. A main finding is that current research highlights promising practical uses (e.g., more accurate and rapid injury assessment or return-to-sport participation criteria) of machine learning in the management of SRC. The review also revealed a narrow research focus in the existing literature. As current research is primarily conducted on male adolescents or adults from team sports in North America there is an urgent need to include wider demographics in more diverse samples and sports contexts in the machine learning algorithms. If research datasets continue to be based on narrow samples of athletes, the development of any new diagnostic and predictive tools for SRC emerging from this research will be at risk. Today, these risks appear to mainly affect the health and safety of female athletes.

Determining Sport Concussion Assessment Tool fifth Edition (SCAT5) reliable change in male professional hockey players

OBJECTIVES

The purpose of this paper is to provide reliable change metrics and assess the test-retest psychometrics of the Sport Concussion Assessment Tool fifth Edition (SCAT5) in a multilingual sample of professional ice hockey players.

METHODS

The SCAT5 was administered to National Hockey League and American Hockey League male professional ice hockey players as part of the 2018 and 2019 season medical evaluations. We extracted data from an existing clinical database of players who were administered two consecutive baseline evaluations and had no intervening concussions to assess psychometric properties (eg, test-retest reliability) and develop reliable change metrics.

RESULTS

Overall, 1007 players met inclusion criteria. Players were reassessed on average 344.52 (±62.52) days following their first baseline. Test-retest reliability ranged from r=0.3 to r=0.5. Reliable change metrics for Immediate Memory varied considerably dependent on form order. Significant differences were found between English versus non-English language preference on Immediate Memory and Concentration but not Delayed Memory or the modified Balance Error Scoring System (mBESS). Reliable change indices at the 90% CI were: Symptom Severity (5), Total Symptoms (3), Immediate Memory (3-8), Concentration (2), mBESS (5) and Delayed Memory (2-4).

CONCLUSIONS

Our findings highlight the importance of considering form differences and language preference when determining reliable change from baseline on the SCAT5 in male professional hockey players. The relatively modest test-retest reliability of the measures leaves room for improved psychometric properties and increased sensitivity to concussion in future iterations of the SCAT.

Utility of VOMS, SCAT3, and ImPACT Baseline Evaluations for Acute Concussion Identification in Collegiate Athletes: Findings From the NCAA-DoD Concussion Assessment, Research and Education (CARE) Consortium

BACKGROUND

The Vestibular/Ocular-Motor Screening (VOMS) is a valuable component of acute (<72 hours) sports-related concussion (SRC) assessments and is increasingly used with the Immediate Post-concussion Assessment and Cognitive Testing (ImPACT) instrument and the third edition of the Sport Concussion Assessment Tool (SCAT3). Research has suggested that VOMS acute postinjury scores are useful in identifying acute concussion. However, the utility of preseason baseline measurements to improve diagnostic accuracy remains ambiguous. To this end, there is a need to determine how reliable VOMS baseline assessments are across years and whether incorporating individuals' baseline performance improves diagnostic yield for acute concussions.

PURPOSE

To analyze VOMS, SCAT3, and ImPACT to evaluate the test-retest reliability of consecutive-year preseason baseline assessments to directly compare the diagnostic utility of these tools when incorporating baseline assessments versus using postinjury data alone to identify acute SRC.

STUDY DESIGN

Cohort study (diagnosis); Level of evidence, 2.

METHODS

Preseason and postinjury VOMS, SCAT3, ImPACT Post-Concussion Symptom Scale (PCSS), and ImPACT composite scores were analyzed for 3958 preseason (47.7% female) and 496 acute (≤48 hours) SRC (37.5% female) collegiate athlete evaluations in the National Collegiate Athletic Association-Department of Defense Concussion Assessment Research and Education Consortium. Descriptive statistics, Kolmogorov-Smirnov significance, and Cohen d effect size were calculated. Consecutive-year baseline reliability was evaluated for a subset of 447 athlete encounters using Pearson r, Cohen κ, Cohen d, and 2-way mixed intraclass correlation coefficients (ICCs). Wilcoxon signed rank tests were used to determine the statistical significance between population performances, and the 90% reliable change index (RCI) was calculated from the test-retest results. Preseason to postinjury change scores were then calculated from each tool's RCI. Finally, receiver operating characteristic (ROC) curve analyses were conducted, and DeLong method was used to compare the area under the curve (AUC) of raw postinjury scores versus change scores from preseason baseline assessments. Potential effects of sex, medical history (learning disorders or attention-deficit/hyperactivity disorder), and outlier data were also explored.

RESULTS

Effect sizes were large, and overall predictive utilities were clinically useful for postinjury VOMS Total (d = 2.44; AUC = 0.85), the SCAT3 Symptom Evaluation total severity score (d = 1.74; AUC = 0.82), and the ImPACT PCSS total severity score (d = 1.67; AUC = 0.80). Comparatively, effect sizes were small and predictive utilities were poor for Standardized Assessment of Concussion (SAC), modified Balance Error Scoring System (mBESS), and all ImPACT composites (d = 0.11-0.46; AUC = 0.48-0.59). Preseason baseline test-retest reliability was poor to moderate (r = 0.23-0.52; κ = 0.32-0.36; ICC = 0.36-0.68) for all assessments except ImPACT Visual Motion Sensitivity (r = 0.73; ICC = 0.85). Incorporating baseline scores for VOMS Total, SCAT3 (Symptom Evaluation, SAC, mBESS), ImPACT PCSS, or ImPACT composites did not significantly improve AUCs.

CONCLUSION

VOMS Total and symptom severity (SCAT3, PCSS) total scores had large effect sizes and clinically useful AUCs for identifying acute concussion. However, all tools demonstrated high within-patient test-retest variability, resulting in poor reliability. The findings in this sample of collegiate athletes suggest that incorporating baseline assessments does not significantly increase diagnostic yield for acute concussion.