Sensitivity and specificity of an eye movement tracking-based biomarker for concussion

Psychometric Properties of Vestibular and Ocular Measures Used for Concussion Assessments: A Scoping Review

BACKGROUND

Concussions most commonly affect the vestibular and ocular systems. Clinical measures used in the assessment of vestibular and ocular deficits should contain strong psychometric properties so that clinicians can accurately detect abnormality to guide treatment interventions.

OBJECTIVES

The aim of this scoping review was: (1) to identify the measures used to evaluate the vestibular and ocular domains postconcussion and (2) to document the psychometric properties of the measures.

METHODS

Two databases (Medline (Ovid) and Embase) were searched from inception to May 2023. An updated search was completed in January 2024 using the same databases and search terms. Studies were screened and data were extracted independently by 2 reviewers. Measures were categorized into vestibular, ocular, or both (vestibular and ocular) domains, and relevant psychometric properties were documented.

RESULTS

Fifty-two studies were included in this review. 28 studies explored the use of vestibular measures, 12 explored ocular measures, and 12 explored both vestibular and ocular measures or explored the use of vestibulo-ocular reflex measures. Most studies explored the properties associated with balance measures, particularly the balance error scoring system. Diagnostic accuracy (sensitivity and specificity metrics) of the associated measures was the most frequently documented characteristic in the literature.

CONCLUSION

Identification of clinical measures used to evaluate vestibular and ocular deficits postconcussion is needed to understand the evidence supporting their use in practice. Documenting the psychometric properties will allow clinicians and researchers to understand the status of the current literature and support for the use of certain measures in practice in terms of their ability to appropriately detect deficits in people with concussion when deficits are truly present.

Evaluation of sport-related concussion using objective eye tracking

OBJECTIVE

Evaluate EyeBOX in an adolescent sport-related concussion (SRC) population by comparing scores between concussed and non-concussed athletes, examining sensitivity/specificity, and assessing clinical recovery associations.

METHODS

A prospective, unmatched case-control study examined concussed adolescents (11-22 years) treated in a sports concussion clinic who underwent EyeBOX testing. Concussed participants completed symptom scales and follow-up assessments. Analyses included t-tests comparing groups, sensitivity/specificity analyses, and models examining relationships between BOX scores and recovery outcomes, including initial post-concussion symptom severity (PCSS) scores, return to learn (RTL), symptom resolution (SR), and return to play (RTP).

RESULTS

Participants included 36 youth athletes with SRCs and 30 non-concussed controls. BOX scores were significantly higher in concussed participants (7.9 ± 5.2) compared to controls (5.4 ± 5.1; t = 2.062, p = 0.043, Cohen's d = 0.479). Sensitivity for detecting concussion ranged from 22% (BOX>10) to 61% (BOX>5), while specificity ranged from 63%-87%. Multivariable linear regression showed that higher BOX scores predicted higher initial PCSS scores (β = 0.323, p = 0.049) but did not predict RTL, SR, or RTP.

CONCLUSION

EyeBOX demonstrated moderate specificity but limited sensitivity for identifying SRC and scores were associated with initial symptom severity. While it may not be useful as a standalone diagnostic tool, EyeBOX may serve as an adjunct for confirming concussion in youth athletes.

Effects of recent cannabis consumption on eye-tracking and pupillometry

Introduction

Cannabis consumption is known to immediately affect ocular and oculomotor function, however, cannabis consumption is also known to affect it for a prolonged period of time. The purpose of this study is to identify an eye tracking or pupillometry metric which is affected after recent cannabis consumption but is not confounded by cannabis consumption history or demographic variables.

Methods

Quasi-experimental design. Participants who would consume inhalable cannabis (n = 159, mean age 31.0 years, 54% male) performed baseline neurobehavioral testing and eye-function assessments when they were sober. Eye function assessments included eye-tracking [gaze (point of visual focus), saccades (smooth movement)] and pupillometry. Participants then inhaled cannabis until they self-reported to be high and performed the same assessment again. Controls who were cannabis naïve or infrequent users (n = 30, mean age 32.6 years, 57% male) performed the same assessments without consuming cannabis in between.

Results

Cannabis significantly affected several metrics of pupil dynamics and gaze. Pupil size variability was the most discriminant variable after cannabis consumption. This variable did not change in controls on repeat assessment (i.e., no learning effect), did not correlate with age, gender, race/ethnicity, or self-reported level of euphoria, but did correlate with THC concentration of cannabis inhaled.

Discussion

A novel eye-tracking metric was identified that is affected by recent cannabis consumption and is not different from non-users at baseline. A future study that assesses pupil size variability at multiple intervals over several hours and quantifies cannabis metabolites in biofluids should be performed to identify when this variable normalizes after consumption and if it correlates with blood THC levels.

The Selective Social Attention task in children with autism spectrum disorder: Results from the Autism Biomarkers Consortium for Clinical Trials (ABC-CT) feasibility study

The Selective Social Attention (SSA) task is a brief eye-tracking task involving experimental conditions varying along socio-communicative axes. Traditionally the SSA has been used to probe socially-specific attentional patterns in infants and toddlers who develop autism spectrum disorder (ASD). This current work extends these findings to preschool and school-age children. Children 4- to 12-years-old with ASD (N = 23) and a typically-developing comparison group (TD; N = 25) completed the SSA task as well as standardized clinical assessments. Linear mixed models examined group and condition effects on two outcome variables: percent of time spent looking at the scene relative to scene presentation time (%Valid), and percent of time looking at the face relative to time spent looking at the scene (%Face). Age and IQ were included as covariates. Outcome variables' relationships to clinical data were assessed via correlation analysis. The ASD group, compared to the TD group, looked less at the scene and focused less on the actress' face during the most socially-engaging experimental conditions. Additionally, within the ASD group, %Face negatively correlated with SRS total T-scores with a particularly strong negative correlation with the Autistic Mannerism subscale T-score. These results highlight the extensibility of the SSA to older children with ASD, including replication of between-group differences previously seen in infants and toddlers, as well as its ability to capture meaningful clinical variation within the autism spectrum across a wide developmental span inclusive of preschool and school-aged children. The properties suggest that the SSA may have broad potential as a biomarker for ASD.

Smart Contact Lenses as Wearable Ophthalmic Devices for Disease Monitoring and Health Management

The eye contains a complex network of physiological information and biomarkers for monitoring disease and managing health, and ocular devices can be used to effectively perform point-of-care diagnosis and disease management. This comprehensive review describes the target biomarkers and various diseases, including ophthalmic diseases, metabolic diseases, and neurological diseases, based on the physiological and anatomical background of the eye. This review also includes the recent technologies utilized in eye-wearable medical devices and the latest trends in wearable ophthalmic devices, specifically smart contact lenses for the purpose of disease management. After introducing other ocular devices such as the retinal prosthesis, we further discuss the current challenges and potential possibilities of smart contact lenses.

An Evaluation of the Emerging Techniques in Sports-Related Concussion

SUMMARY

Sports-related concussion is now in public awareness more than ever before. Investigations into underlying pathophysiology and methods of assessment have correspondingly increased at an exponential rate. In this review, we aim to highlight some of the evidence supporting emerging techniques in the fields of neurophysiology, neuroimaging, vestibular, oculomotor, autonomics, head sensor, and accelerometer technology in the setting of the current standard: clinical diagnosis and management. In summary, the evidence we reviewed suggests that (1) head impact sensors and accelerometers may detect possible concussions that would not otherwise receive evaluation; (2) clinical diagnosis may be aided by sideline vestibular, oculomotor, and portable EEG techniques; (3) clinical decisions on return-to-play eligibility are currently not sensitive at capturing the neurometabolic, cerebrovascular, neurophysiologic, and microstructural changes that biomarkers have consistently detected days and weeks after clinical clearance. Such biomarkers include heart rate variability, quantitative electroencephalography, as well as functional, metabolic, and microstructural neuroimaging. The current challenge is overcoming the lack of consistency and replicability of any one particular technique to reach consensus.

Sports related concussion: an emerging era in digital sports technology

Sports-related concussion (SRC) is defined as a mild traumatic brain injury (mTBI) leading to complex impairment(s) in neurological function with many seemingly hidden or difficult to measure impairments that can deteriorate rapidly without any prior indication. Growing numbers of SRCs in professional and amateur contact sports have prompted closer dialog regarding player safety and welfare. Greater emphasis on awareness and education has improved SRC management, but also highlighted the difficulties of diagnosing SRC in a timely manner, particularly during matches or immediately after competition. Therefore, challenges exist in off-field assessment and return to play (RTP) protocols, with current traditional (subjective) approaches largely based on infrequent snapshot assessments. Low-cost digital technologies may provide more objective, integrated and personalized SRC assessment to better inform RTP protocols whilst also enhancing the efficiency and precision of healthcare assessment. To fully realize the potential of digital technologies in the diagnosis and management of SRC will require a significant paradigm shift in clinical practice and mindset. Here, we provide insights into SRC clinical assessment methods and the translational utility of digital approaches, with a focus on off-field digital techniques to detect key SRC metrics/biomarkers. We also provide insights and recommendations to the common benefits and challenges facing digital approaches as they aim to transition from novel technologies to an efficient, valid, reliable, and integrated clinical assessment tool for SRC. Finally, we highlight future opportunities that digital approaches have in SRC assessment and management including digital twinning and the "digital athlete".

Impaired eye tracking is associated with symptom severity but not dynamic postural control in adolescents following concussion

PURPOSE

The purpose of the study was to (1) examine the relationship between self-reported symptoms and concussion-related eye tracking impairments, and (2) compare gait performance between (a) adolescents with a concussion who have normal eye tracking, (b) adolescents with a concussion who have abnormal eye tracking, and (c) healthy controls.

METHODS

A total of 30 concussed participants (age: 14.4 ± 2.2 years, mean ± SD, 50% female) and 30 controls (age: 14.2 ± 2.2 years, 47% female) completed eye tracking and gait assessments. The BOX score is a metric of pupillary disconjugacy, with scores <10 classified as normal and ≥10 abnormal. Symptoms were collected using the Post-Concussion Symptom Scale (PCSS), and gait speed was measured with triaxial inertial measurement units. We conducted a linear regression to examine the relationship between PCSS and BOX scores and a two-way mixed effects analysis of variance to examine the effect of group (abnormal BOX, normal BOX, and healthy control) on single- and dual-task gait speed.

RESULTS

There was a significant association between total PCSS score and BOX score in the concussion group (β = 0.16, p = 0.004, 95% confidence interval (95%CI): 0.06‒0.27), but not in the control group (β = 0.21, p = 0.08, 95%CI: -0.03 to 0.45). There were no significant associations between PCSS symptom profiles and BOX scores in the concussion or control groups. There were also no significant differences in single-task (Abnormal: 1.00 ± 0.14 m/s; Normal: 1.11 ± 0.21 m/s; Healthy: 1.14 ± 0.18 m/s; p = 0.08) or dual-task (Abnormal: 0.77 ± 0.15 m/s; Normal: 0.84 ± 0.21 m/s; Healthy: 0.90 ± 0.18 m/s; p = 0.16) gait speed.

CONCLUSION

The concussed group with impaired eye tracking reported higher total symptom severity, as well as worse symptom severity across the 5 PCSS symptom domain profiles. However, eye tracking deficits did not appear to be driven by any particular symptom domain. While not statistically significant, the slower gait speeds in those with abnormal BOX scores may still be clinically relevant since gait-related impairments may persist beyond clinical recovery.

Classification of Comprehensive Neuro-Ophthalmologic Measures of Postacute Concussion

IMPORTANCE

Symptom-based methods of concussion diagnosis in contact sports result in underdiagnosis and repeated head injury exposure, increasing the risk of long-term disability. Measures of neuro-ophthalmologic (NO) function have the potential to serve as objective aids, but their diagnostic utility is unknown.

OBJECTIVE

To identify NO measures that accurately differentiate athletes with and without concussion.

DESIGN, SETTING, AND PARTICIPANTS

This cohort study was conducted among athletes with and without concussion who were aged 17 to 22 years between 2016 and 2017. Eye movements and cognitive function were measured a median of 19 days after injury among patients who had an injury meeting the study definition of concussion while playing a sport (retrospectively selected from a concussion clinic), then compared with a control group of participants without concussion (enrolled from 104 noncontact collegiate athlete volunteers without prior head injury). Data analysis was conducted from November 2019 through May 2020.

EXPOSURE

Concussion.

MAIN OUTCOMES AND MEASURES

Classification accuracy of clinically important discriminator eye-tracking (ET) metrics. Participants' eye movements were evaluated with a 12-minute ET procedure, yielding 42 metrics related to smooth pursuit eye movement (SPEM), saccades, dynamic visual acuity, and reaction time. Clinically important discriminator metrics were defined as those with significantly different group differences and area under the receiver operator characteristic curves (AUROCs) of at least 0.70.

RESULTS

A total of 34 participants with concussions (mean [SD] age, 19.7 [2.4] years; 20 [63%] men) and 54 participants without concussions (mean [SD] age, 20.8 [2.2] years; 31 [57%] men) completed the study. Six ET metrics (ie, simple reaction time, discriminate reaction time, discriminate visual reaction speed, choice visual reaction speed, and reaction time on 2 measures of dynamic visual acuity 2) were found to be clinically important; all were measures of reaction time, and none were related to SPEM. Combined, these 6 metrics had an AUROC of 0.90 (95% CI, 0.80-0.99), a sensitivity of 77.8%, and a specificity of 92.6%. The 6 metrics remained significant on sensitivity testing.

CONCLUSIONS AND RELEVANCE

In this study, ET measures of slowed visual reaction time had high classification accuracy for concussion. Accurate, objective measures of NO function have the potential to improve concussion recognition and reduce the disability associated with underdiagnosis.

Sideline Concussion Assessment: The Current State of the Art

More than 200 million American adults and children participate in organized physical activity. Growing awareness has highlighted that concussion, especially when repeated, may be associated with prolonged neurological, cognitive, and/or neuropsychiatric sequelae. Objective diagnosis of concussion remains challenging. Although some concussion symptoms may be apparent even to nonmedical observers, diagnosis and removal from play for evaluation depend on validated assessment tools and trained, vigilant healthcare personnel. Over the past 2 decades, sideline concussion measures have undergone significant revision and augmentation to become more comprehensive batteries in order to detect a wide spectrum of symptomatology, eg, neurocognitive function, postconcussive symptoms, gait/balance, and saccadic eye movements. This review summarizes the current state-of-the-art concussion evaluation instruments, ranging from the Sports Concussion Assessment Tool (SCAT) and tools that may enhance concussion detection, to near-term blood-based biomarkers and emerging technology (eg, head impact sensors, vestibulo-ocular/eye-tracking, and mobile applications). Special focus is directed at feasibility, utility, generalizability, and challenges to implementation of each measure on-field and on the sidelines. This review finds that few instruments beyond the SCAT provide guidance for removal from play, and establishing thresholds for concussion detection and removal from play in qualification/validation of future instruments is of high importance. Integration of emerging sideline concussion evaluation tools should be supported by resources and education to athletes, caregivers, athletic staff, and medical professionals for standardized administration as well as triage, referral, and prevention strategies. It should be noted that concussion evaluation instruments are used to assist the clinician in sideline diagnosis, and no single test can diagnose concussion as a standalone investigation.

Physiological Vibration Acceleration (Phybrata) Sensor Assessment of Multi-System Physiological Impairments and Sensory Reweighting Following Concussion

Objective

To assess the utility of a head-mounted wearable inertial motion unit (IMU)-based physiological vibration acceleration (“phybrata”) sensor to support the clinical diagnosis of concussion, classify and quantify specific concussion-induced physiological system impairments and sensory reweighting, and track individual patient recovery trajectories.

Methods

Data were analyzed from 175 patients over a 12-month period at three clinical sites. Comprehensive clinical concussion assessments were first completed for all patients, followed by testing with the phybrata sensor. Phybrata time series data and spatial scatter plots, eyes open (Eo) and eyes closed (Ec) phybrata powers, average power (Eo+Ec)/2, Ec/Eo phybrata power ratio, time-resolved phybrata spectral density (TRPSD) distributions, and receiver operating characteristic (ROC) curves are compared for individuals with no objective impairments and those clinically diagnosed with concussions and accompanying vestibular impairment, other neurological impairment, or both vestibular and neurological impairments. Finally, pre- and post-injury phybrata case report results are presented for a participant who was diagnosed with a concussion and subsequently monitored during treatment, rehabilitation, and return-to-activity clearance.

Results

Phybrata data demonstrate distinct features and patterns for individuals with no discernable clinical impairments, diagnosed vestibular pathology, and diagnosed neurological pathology. ROC curves indicate that the average power (Eo+Ec)/2 may be utilized to support clinical diagnosis of concussion, while Eo and Ec/Eo may be utilized as independent measures to confirm accompanying neurological and vestibular impairments, respectively. All 3 measures demonstrate area under the curve (AUC), sensitivity, and specificity above 90% for their respective diagnoses. Phybrata spectral analyses demonstrate utility for quantifying the severity of concussion-induced physiological impairments, sensory reweighting, and subsequent monitoring of improvements throughout treatment and rehabilitation.

Conclusion

Phybrata testing assists with objective concussion diagnosis and provides an important adjunct to standard concussion assessment tools by objectively ascertaining neurological and vestibular impairments, guiding targeted rehabilitation strategies, monitoring recovery, and assisting with return-to-sport/work/learn decision-making.

Eye movement performance and clinical outcomes among female athletes post-concussion

BACKGROUND

Most post-concussion eye movement (EM) research involves predominantly male samples. We evaluated pro- (PRO; reflexive shift of visual attention to target) and anti- (ANTI; executive control of visual attention away from target) computer-based saccade task performance among female, collegiate athletes with recent concussion (CON) versus healthy-control athletes (HC). We evaluated the relationship between EM performance and post-concussion outcomes. We hypothesized ANTI performance would differ among CON and HC due to greater executive control demands, and that EM performance (both tasks) would be associated with clinical outcomes in CON.

METHODS

16 CON (assessed 4-10 days post-injury [M = 6.87, SD = 2.15 days]) and 16 age-matched HC athletes were recruited. General linear mixed modeling and Pearson's correlations were used.

RESULTS

On ANTI, CON demonstrated higher error rate [F(1,2863) = 12.650, p<.001] and shorter latency on error trials [F(1,469) = 5.976, p=.015] relative to HC. Multiple EM measures were associated with clinical outcomes: PRO duration predicted days to symptom remission (r=.44, p <.05); ANTI error rate was associated with symptom burden on the day of testing (r=.27, p <.05).

CONCLUSION

This study demonstrates promising utility of EM measures to detect cognitive control and sensorimotor effects of concussion among female athletes and their use as a prognostic indicators of recovery.

Awareness and Perceived Value of Eye Tracking Technology for Concussion Assessment among Sports Medicine Clinicians: A Multinational Study

Objective: The awareness of concussion as a serious and frequently occurring sports injury and its management has evolved significantly. One viable objective diagnostic tool is eye tracking technology. The authors hypothesized that while clinicians may be aware that assessing eye movements in concussed athletes can be beneficial, it is possible that, due to the novelty of the eye tracking technology and limited exposure, only a few actually use it in their practice. The study aimed to assess the awareness of eye movement deficits associated with concussion amongst sports medicine clinicians and to determine the utilization and perceptions of the eye tracking technology for concussion diagnosis.Methods: An online 18-question survey was distributed internationally from January until December 2017 and completed by 171 sports medicine clinicians (sport physicians, therapists, general practitioners, neuropsychologists) from 32 countries.Results: Respondents indicated that subjectivity of assessments remained a major limitation of established diagnostic tools. Eye tracking technology, despite its potential to attenuate this limitation, was only used by 12% of respondents. To diagnose concussion, 77% did not use any eye movement assessment tools other than own clinical assessment. With the exception of abnormal pupil light reflex, which was checked by 68%, eye movement deficits were inspected by less than half of the respondents (46.3 ± 12%).Conclusion: Even among sports medicine clinicians who regularly attend to patients with concussions, there is insufficient awareness that concussion can lead to abnormal eye tracking behavior. Lack of exposure to the sensitive eye tracking equipment may be a limiting factor for using eye movement metrics for concussion diagnostics. Facilitating the awareness of objective methods, like eye tracking technology, may help assure the appropriate continuum of identification and treatment for concussed athletes. Increasing educational opportunities and practical experience of clinicians regarding concussive symptoms and potential innovative technology is strongly advocated.

Baseline profiles of auditory, vestibular, and visual functions in youth tackle football players

Aim

Neurosensory tests have emerged as components of sport-related concussion management. Limited normative data are available in healthy, nonconcussed youth athletes.

Patients & methods/results

In 2017 and 2018, we tested 108 youth tackle football players immediately before their seasons on the frequency-following response, Balance Error Scoring System, and King-Devick test. We compared results with published data in older and/or and nonathlete populations. Performance on all tests improved with age. Frequency-following response and Balance Error Scoring System results aligned with socioeconomic status. Performance was not correlated across neurosensory domains.

Conclusion

Baseline neurosensory functions in seven 14-year-old male tackle football players are consistent with previously published data. Results reinforce the need for individual baselines or demographic-specific norms and the use of multiple neurosensory measures in sport-related concussion management.

Toward development of clinically translatable diagnostic and prognostic metrics of traumatic brain injury using animal models: A review and a look forward

Traumatic brain injury is a leading cause of cognitive and behavioral deficits in children in the US each year. There is an increasing interest in both clinical and pre-clinical studies to discover biomarkers to accurately diagnose traumatic brain injury (TBI), predict its outcomes, and monitor its progression especially in the developing brain. In humans, the heterogeneity of TBI in terms of clinical presentation, injury causation, and mechanism has contributed to the many challenges associated with finding unifying diagnosis, treatment, and management practices. In addition, findings from adult human research may have little application to pediatric TBI, as age and maturation levels affect the injury biomechanics and neurophysiological consequences of injury. Animal models of TBI are vital to address the variability and heterogeneity of TBI seen in human by isolating the causation and mechanism of injury in reproducible manner. However, a gap between the pre-clinical findings and clinical applications remains in TBI research today. To take a step toward bridging this gap, we reviewed several potential TBI tools such as biofluid biomarkers, electroencephalography (EEG), actigraphy, eye responses, and balance that have been explored in both clinical and pre-clinical studies and have shown potential diagnostic, prognostic, or monitoring utility for TBI. Each of these tools measures specific deficits following TBI, is easily accessible, non/minimally invasive, and is potentially highly translatable between animals and human outcomes because they involve effort-independent and non-verbal tasks. Especially conspicuous is the fact that these biomarkers and techniques can be tailored for infants and toddlers. However, translation of preclinical outcomes to clinical applications of these tools necessitates addressing several challenges. Among the challenges are the heterogeneity of clinical TBI, age dependency of some of the biomarkers, different brain structure, life span, and possible variation between temporal profiles of biomarkers in human and animals. Conducting parallel clinical and pre-clinical research, in addition to the integration of findings across species from several pre-clinical models to generate a spectrum of TBI mechanisms and severities is a path toward overcoming some of these challenges. This effort is possible through large scale collaborative research and data sharing across multiple centers. In addition, TBI causes dynamic deficits in multiple domains, and thus, a panel of biomarkers combining these measures to consider different deficits is more promising than a single biomarker for TBI. In this review, each of these tools are presented along with the clinical and pre-clinical findings, advantages, challenges and prospects of translating the pre-clinical knowledge into the human clinical setting.