Discriminative Validity of Vestibular Ocular Motor Screening in Identifying Concussion Among Collegiate Athletes: A National Collegiate Athletic Association-Department of Defense Concussion Assessment, Research, and Education Consortium Study

Virtual Reality Application for Vestibular/Ocular Motor Screening: Current Clinical Protocol Versus a Novel Prototype

BACKGROUND

Virtual reality (VR) has been explored to improve baseline and postinjury assessments in sport-related concussion (SRC). Some experience symptoms related to VR, unrelated to concussion. This may deter use of vestibular/ocular motor screening (VOMS) using VR. Baseline VR VOMS symptomatology differentiates baseline from overall symptomatology.

HYPOTHESIS

There will be no difference between current clinical manual VOMS (MAN), a clinical prototype (PRO), and VR for symptom provocation change score (SPCS) and near point of convergence (NPC) average score in a healthy population and sex differences among the 3 modes of administration.

STUDY DESIGN

Cohort study.

LEVEL OF EVIDENCE

Level 3.

METHODS

A total of 688 National Collegiate Athletic Association Division I student-athletes completed VOMS using 3 methods (MAN, N = 111; female athletes, N = 47; male athletes, N = 64; average age, 21 years; PRO, N = 365; female athletes, N = 154; male athletes, N = 211; average age, 21 years; VR, N = 212; female athletes, N = 78; male athletes, N = 134; average age = 20 years) over a 3-year period (2019-2021) during annual baseline testing. Exclusion criteria were as follows: self-reported motion sickness in the past 6 months, existing or previous neurological insult, attention deficit hyperactivity disorder, learning disabilities, or noncorrected vision impairment. Administration of MAN followed the current clinical protocols, PRO used a novel prototype, and VR used an HTC Vive Pro Eye head mounted display. Symptom provocation was compared using Mann-Whitney U tests across each VOMS subtest with total SPCS and NPC average by each method.

RESULTS

MAN had significantly (P < 0.01) more baseline SPCS (MAN = 0.466 ± 1.165, PRO = 0.163 ± 0.644, VR = 0.161 ± 0.933) and significantly (P < 0.01) and more SPCS (MAN = 0.396 ± 1.081, PRO = 0.128 ± 0.427, VR = 0.48 ± 0.845) when compared with PRO and VR. NPC average measurements for VR (average, 2.99 ± 0.684 cm) were significantly greater than MAN (average, 2.91 ± 3.35 cm; P < 0.01; Cohen's d = 0.03) and PRO (average, 2.21 ± 1.81 cm; P < 0.01; Cohen's d = 0.57). For sex differences, female athletes reported greater SPCS with PRO (female athletes, 0.29 ± 0.87; male athletes, 0.06 ± 0.29; P < 0.01) but not in VR or MAN.

CONCLUSION

Using a VR system to administer the VOMS may not elicit additional symptoms, resulting in fewer false positives and is somewhat stable between sexes.

CLINICAL RELEVANCE

VOMS may allow for standardization among administrators and reduce possible false positives.

Reconsidering Vestibular/Ocular Motor Screening Cutoff Scores for Concussion

INTRODUCTION

Vestibular/Ocular Motor Screening (VOMS) is often part of a comprehensive evaluation to identify acute mild traumatic brain injury. Most of the reports describe the use of the VOMS in adolescents/young adults and not in older adults or military service members. The purpose of this study was to describe VOMS findings in healthy civilians and active duty military service members up to the age of 50 years.

MATERIALS AND METHODS

Seventy-seven healthy civilians between 18 and 50 years of age (22 males, age 31.8 [9.0] years) participated across three sites in addition to 40 healthy active duty service members (25 males, age 27.5 [4.9] years) from one site. Demographics, Neurobehavioral Symptom Inventory scores, mean near point convergence (NPC) distance, and Total Symptom Change (TSS) scores from the VOMS were evaluated.

RESULTS

For civilians, the group mean NPC distance was 4.98 (3.8) cm. For military service members, the group mean NPC distance was 6.17 (4.57) cm. For civilians, the mean TSS was 1.2 (2.3) with 53.2% reporting 0 TSS, 27.3% reporting one TSS, and 19.5% reporting two or more TSS. For military service members, the mean TSS was 0.20 (0.72) with 92.5% reporting 0 TSS, 0% reporting one TSS, and 7.5% reporting two or more TSS. Age did not correlate with the mean NPC distance and TSS in healthy civilians and active duty military service members.

CONCLUSIONS

Reconsideration of the Military Acute Concussion Evaluation, Version 2 cutoff value for abnormal mean NPC distance may be warranted to improve diagnostic accuracy in both civilian and military adult populations. Similarly, re-evaluating criteria for interpreting the TSS results of the VOMS, specifically in civilians, may be warranted.

Return to Sports Following Sports-Related Concussion in Collision Sports: An Expert Consensus Statement Using the Modified Delphi Technique

PURPOSE

To perform a Delphi consensus for return to sports (RTS) following sports-related concussion (SRC).

METHODS

Open-ended questions in rounds 1 and 2 were answered. The results of the first 2 rounds were used to develop a Likert-style questionnaire for round 3. If agreement at round 3 was ≤80% for an item, if panel members were outside consensus or there were >30% neither agree/disagree responses, the results were carried forward into round 4. The level of agreement and consensus was defined as 90%.

RESULTS

Individualized graduated RTS protocols should be used. A normal clinical, ocular and balance examination with no more headaches, and asymptomatic exertional test allows RTS. Earlier RTS can be considered if athletes are symptom free. The Sports Concussion Assessment Tool 5 and vestibular and ocular motor screening are recognized as useful tools to assist in decision-making. Ultimately RTS is a clinical decision. Baseline assessments should be performed at both collegiate and professional level and a combination of neurocognitive and clinical tests should be used. A specific number of recurrent concussions for season-or career-ending decisions could not be determined but will affect decision making for RTS.

CONCLUSIONS

Consensus was achieved for 10 of the 25 RTS criteria: early RTS can be considered earlier than 48 to 72 hours if athletes are completely symptom-free with no headaches, a normal clinical, ocular and balance examination. A graduated RTS should be used but should be individualized. Only 2 of the 9 assessment tools were considered to be useful: Sports Concussion Assessment Tool 5 and vestibular and ocular motor screening. RTS is mainly a clinical decision. Only 31% of the baseline assessment items achieved consensus: baseline assessments should be performed at collegiate and professional levels using a combination of neurocognitive and clinical tests. The panel disagreed on the number of recurrent concussions that should be season- or career-ending.

LEVEL OF EVIDENCE

Level V, expert Opinion.

On-Field and Pitch-Side (Sideline) Assessment of Sports Concussion in Collision Sports: An Expert Consensus Statement Using the Modified Delphi Technique

PURPOSE

To perform a Delphi consensus for on-field and pitch-side assessment of sports-related concussion (SRC).

METHODS

Open-ended questions in rounds 1 and 2 were answered. The results of the first 2 rounds were used to develop a Likert-style questionnaire for round 3. If agreement at round 3 was ≤80% for an item, if panel members were outside consensus, or there were >30% neither agree/disagree responses, the results were carried forward into round 4. The level of agreement and consensus was defined as 90%.

RESULTS

Loss of consciousness (LOC) or suspected LOC, motor incoordination/ataxia, balance disturbance, confusion/disorientation, memory disturbance/amnesia, blurred vision/light sensitivity, irritability, slurred speech, slow reaction time, lying motionless, dizziness, headaches/pressure in the head, falling to the ground with no protective action, slow to get up after a hit, dazed look, and posturing/seizures were clinical signs of SRC and indicate removal from play. Video assessment is helpful but should not replace clinical judgment. LOC/unresponsiveness, signs of cervical spine injury, suspicion of other fractures (skull/maxillo-facial), seizures, Glasgow Coma Scale score <14 and abnormal neurologic examination findings are indications for hospitalization. Return to play should only be considered when no clinical signs of SRC are present. Every suspected concussion should be referred to an experienced physician.

CONCLUSIONS

Consensus was achieved for 85% of the clinical signs indicating concussion. On-field and pitch-side assessment should include the observation of the mechanism, a clinical examination, and cervical spine assessment. Of the 19 signs and red flags requiring removal from play, consensus was reached for 74%. Normal clinical examination and HIA with no signs of concussion allow return to play. Video assessment should be mandatory for professional games but should not replace clinical decision-making. Sports Concussion Assessment Tool, Glasgow Coma Scale, vestibular/ocular motor screening, Head Injury Assessment Criteria 1, and Maddocks questions are useful tools. Guidelines are helpful for non-health professionals.

LEVEL OF EVIDENCE

Level V, expert opinion.

Optimizing baseline and post-concussion assessments through identification, confirmation, and equivalence of latent factor structures: findings from the NCAA-DoD CARE Consortium

Objective: Concussion evaluations use a multidimensional assessment to evaluate unique patient function dimensions (e.g., subjective symptoms differ from balance assessments), but the overarching latent factor structure has not been empirically substantiated. Our objective was to determine the cumulative latent factor structure of pre-injury baseline and acute (<48-h) post-concussion assessment battery outcomes, and determine measurement equivalence among common factors in collegiate student-athletes. Methods: Collegiate student-athletes at baseline (n = 21,865) and post-concussion (n = 1,537) across 25-institutions completed standardized assessments. Individual items were used from the baseline and post-concussion assessments and consisted of: Sport Concussion Assessment Tool, Brief Symptom Inventory-18, Standardized Assessment of Concussion, Balance Error Scoring System, Immediate Post-Concussion Assessment and Cognitive Test, and vestibular-ocular motor screening. Exploratory factor analysis was used on half the baseline data, and confirmatory factor analysis on the remaining baseline data and post-concussion data separately. Measurement equivalence was assessed between sex, sport contact classification, concussion history, and time. Results: A 10-factor exploratory model was established and comprised of: depression, somatic, vestibulo-ocular, headache, postural stability, neurocognition, emotional, fatigue, cognitive, consciousness clouding. The 10-factor model was confirmed at baseline and post-concussion with strong measurement equivalence between timepoints. Strong to strict measurement equivalence was observed for sex, sport contact classification, and concussion history at both timepoints separately. Conclusion: Our findings established a robust 10-factor latent factor model equivalent across timepoints and common factors among healthy and concussed collegiate athletes. Clinicians can use these findings to target specific factors while reducing redundant elements to provide efficient, comprehensive post-concussion assessments.

Baseline Computerized Neurocognitive Testing and Oculomotor Measures are not Altered by Hormonal Contraceptive Use

OBJECTIVE

Neurocognitive testing and oculomotor assessment have been an integral component to provide objective measures for sport-related concussion (SRC) detection and management. Hormonal contraceptive (HC) use is common among collegiate female athletes and may modify baseline SRC performance. The purpose was to examine the effects of HC use on baseline computerized neurocognitive testing (CNT) and oculomotor testing in college-aged individuals.

METHOD

A total of 63 participants (22 HC using females, 22 non-HC using females, 19 males) completed a baseline SRC battery consisting of CNT, near point of convergence (NPC), and the King-Devick (KD) test. CNT measures were composite scores of verbal and visual memory, visual motor processing speed and reaction time, impulse control, and cognitive efficiency index (CEI). NPC was measured as the average convergence distance across three trials. KD time was recorded as total time for each of the two trials and best trial marked as baseline.

RESULTS

There were no group differences between HC, non-HC, and male control groups on all baseline CNT composite scores (p = .13-.98), impulse control (p = .47), and CEI (p = .49). NPC distance was similar between groups (p = .41), as well as KD time by trial (Trial 1 p = .65; 2 p = .48) and best time (p = .49).

CONCLUSIONS

HC use does not appear to influence baseline SRC measures of neurocognition and oculomotor assessment. Clinicians should continue to consider the effects of modifying factors at baseline and post-concussion. Additional research is needed to better understand sex hormone levels and SRC performance measures.

Acute evaluation of sport-related concussion and implications for the Sport Concussion Assessment Tool (SCAT6) for adults, adolescents and children: a systematic review

OBJECTIVES

To systematically review the scientific literature regarding the acute assessment of sport-related concussion (SRC) and provide recommendations for improving the Sport Concussion Assessment Tool (SCAT6).

DATA SOURCES

Systematic searches of seven databases from 2001 to 2022 using key words and controlled vocabulary relevant to concussion, sports, SCAT, and acute evaluation.

ELIGIBILITY CRITERIA

(1) Original research articles, cohort studies, case-control studies, and case series with a sample of >10; (2) ≥80% SRC; and (3) studies using a screening tool/technology to assess SRC acutely (<7 days), and/or studies containing psychometric/normative data for common tools used to assess SRC.

DATA EXTRACTION

Separate reviews were conducted involving six subdomains: Cognition, Balance/Postural Stability, Oculomotor/Cervical/Vestibular, Emerging Technologies, and Neurological Examination/Autonomic Dysfunction. Paediatric/Child studies were included in each subdomain. Risk of Bias and study quality were rated by coauthors using a modified SIGN (Scottish Intercollegiate Guidelines Network) tool.

RESULTS

Out of 12 192 articles screened, 612 were included (189 normative data and 423 SRC assessment studies). Of these, 183 focused on cognition, 126 balance/postural stability, 76 oculomotor/cervical/vestibular, 142 emerging technologies, 13 neurological examination/autonomic dysfunction, and 23 paediatric/child SCAT. The SCAT discriminates between concussed and non-concussed athletes within 72 hours of injury with diminishing utility up to 7 days post injury. Ceiling effects were apparent on the 5-word list learning and concentration subtests. More challenging tests, including the 10-word list, were recommended. Test-retest data revealed limitations in temporal stability. Studies primarily originated in North America with scant data on children.

CONCLUSION

Support exists for using the SCAT within the acute phase of injury. Maximal utility occurs within the first 72 hours and then diminishes up to 7 days after injury. The SCAT has limited utility as a return to play tool beyond 7 days. Empirical data are limited in pre-adolescents, women, sport type, geographical and culturally diverse populations and para athletes.

PROSPERO REGISTRATION NUMBER

CRD42020154787.

Vestibular/ocular motor screening (VOMS) score for identification of concussion in cases of non-severe head injury: A systematic review

Background

and importance Each year, 1.4 million patients attend a UK ED with a head injury. Mild traumatic brain injury affects up to 300/100 000 admitted patients/year and a greater number of non-admitted patients. Identifying those patients with a head injury that have concussion, and of those, which will have a prolonged recovery, is critical for discharge planning. The Vestibular/Ocular Motor Screening test (VOMS) has been reported as a useful “sideline tool” to evaluate for sports-related concussion (SRC). VOMS has been assessed for utility primarily for predicting in head-injured, which cases will have concussion, and secondarily in predicting in concussed patients, which will have prolonged recovery. Originally described in 2014, VOMS has not been subject to systematic review or meta-analysis, with regard to its predictive performance for concussion.

Objective

To assess the state of VOMS evidence for dichotomously classifying concussion status in patients with non-severe head injury

Design

Systematic review.

Setting and participants

Studies comprising the review enrolled ambulatory head-injured adults and children, usually from sports-related settings, in Europe or the USA.

Exposure

VOMS.

Outcome measures

Presence of concussion, presence of prolonged recovery in concussed patients

Main results

The review identified 17 studies, characterized by a wide variety of specific approaches to administering and scoring VOMS. While VOMS showed promise as a screening tool for concussion, marked study heterogeneity precluded generation of a pooled effect estimate for VOMS performance.

Conclusion

VOMS is potentially useful as a concussion screening tool. Available evidence from the SRC arena suggests sensitivity ranging from 58–96%, with specificity 46−92%. Directions for future VOMS research should include evaluation of standardized administration and scoring, potentially of a simpler VOMS (with fewer components), in a general head-injured population. Further analysis of precisely defined VOMS application may be useful to determine the proper place of VOMS screening for the head-injured.

Optimizing VOMS for identifying acute concussion in collegiate athletes: Findings from the NCAA-DoD CARE consortium

The Vestibular/Ocular-Motor Screening (VOMS), an important component in acute (<72 h) sport-related concussion (SRC) assessment, is increasingly used alongside the Sport Concussion Assessment Tool (SCAT) and as part of the Military Acute Concussion Evaluation 2 (MACE2). VOMS demonstrates clinically useful diagnostic accuracy for acute SRC and improves the overall utility when added to the SCAT3. However, potential overlap among VOMS's vestibular and oculomotor items suggests the possibility of a more efficient version. VOMS and SCAT3 scores were analyzed for 3,958 preseason (47.8% female) and 496 acute-SRC (37.5% female) NCAA-DoD Concussion Assessment, Research, and Education (CARE) consortium collegiate athlete evaluations. Analyses revealed very large effect sizes (d = 2.39-2.45) and high correlations (rho = 0.95-0.99) among all VOMS items except near point of convergence distance (d = 0.79, rho ≤ 0.341). Receiver operating characteristic (ROC) curve analyses showed clinically useful discriminative utility for VOMS Total (AUC = 0.85) and the VOMS Total change score, where pretest symptoms were incorporated (AUC = 0.81). A modified VOMS (mVOMS) consisting of four items (smooth pursuits, horizontal saccades, horizontal vestibulo-ocular reflex, visual motion sensitivity) yielded identical AUCs to VOMS Total. Integer cutoff analyses suggest a score of ≥4 for VOMS Total and ≥4 for mVOMS Total optimizes concussion identification. Incorporating VOMS or mVOMS into SCAT3 (AUC = 0.79) significantly improved the combined tool's acute utility for acute concussion identification by a maximum of 4% (SCAT3+VOMS AUC = 0.84, SCAT3+mVOMS AUC = 0.83). Future versions of SCAT or MACE may want to consider incorporating a more parsimonious VOMS for the purpose of identifying acute concussion.

Determining Sport Concussion Assessment Tool fifth Edition (SCAT5) reliable change in male professional hockey players

OBJECTIVES

The purpose of this paper is to provide reliable change metrics and assess the test-retest psychometrics of the Sport Concussion Assessment Tool fifth Edition (SCAT5) in a multilingual sample of professional ice hockey players.

METHODS

The SCAT5 was administered to National Hockey League and American Hockey League male professional ice hockey players as part of the 2018 and 2019 season medical evaluations. We extracted data from an existing clinical database of players who were administered two consecutive baseline evaluations and had no intervening concussions to assess psychometric properties (eg, test-retest reliability) and develop reliable change metrics.

RESULTS

Overall, 1007 players met inclusion criteria. Players were reassessed on average 344.52 (±62.52) days following their first baseline. Test-retest reliability ranged from r=0.3 to r=0.5. Reliable change metrics for Immediate Memory varied considerably dependent on form order. Significant differences were found between English versus non-English language preference on Immediate Memory and Concentration but not Delayed Memory or the modified Balance Error Scoring System (mBESS). Reliable change indices at the 90% CI were: Symptom Severity (5), Total Symptoms (3), Immediate Memory (3-8), Concentration (2), mBESS (5) and Delayed Memory (2-4).

CONCLUSIONS

Our findings highlight the importance of considering form differences and language preference when determining reliable change from baseline on the SCAT5 in male professional hockey players. The relatively modest test-retest reliability of the measures leaves room for improved psychometric properties and increased sensitivity to concussion in future iterations of the SCAT.

Fixational eye movements following concussion

The purpose of this study was to evaluate fixational eye movements (FEMs) with high spatial and temporal resolution following concussion, where oculomotor symptoms and impairments are common. Concussion diagnosis was determined using current consensus guidelines. A retinal eye-tracking device, the tracking scanning laser ophthalmoscope (TSLO), was used to measure FEMs in adolescents and young adults following a concussion and in an unaffected control population. FEMs were quantified in two fixational paradigms: (1) when fixating on the center, or (2) when fixating on the corner of the TSLO imaging raster. Fixational saccade amplitude in recent concussion patients (≤ 21 days) was significantly greater, on average, in the concussion group (mean = 1.03°; SD = 0.36°) compared with the controls (mean = 0.82°; SD = 0.31°), when fixating on the center of the imaging raster (t = 2.87, df = 82, p = 0.005). These fixational saccades followed the main sequence and therefore also had greater peak velocity (t = 2.86, df = 82, p = 0.006) and peak acceleration (t = 2.80, df = 82, p = 0.006). These metrics significantly differentiated concussed from controls (AUC = 0.67-0.68, minimum p = 0.005). No group differences were seen for the drift metrics in either task or for any of the FEMs metrics in the corner-of-raster fixation task. Fixational saccade amplitudes were significantly different in the concussion group, but only when fixating on the center of the raster. This task specificity suggests that task optimization may improve differentiation and warrants further study. FEMs measured in the acute-to-subacute period of concussion recovery may provide a quick (<3 minutes), objective, sensitive, and accurate ocular dysfunction assessment. Future work should assess the impact of age, mechanism of injury, and post-concussion recovery on FEM alterations following concussion.