A Meta-analysis on the Effect of Expertise on Eye Movements during Music Reading

On the Validity and Benefit of Manual and Automated Drift Correction in Reading Tasks

Drift represents a common distortion that affects the position of fixations in eye tracking data. While manual correction is considered very accurate, it is considered subjective and time-consuming. On the other hand, automated correction is fast, objective, and considered less accurate. An objective comparison of the accuracy of manual and automated correction has not been conducted before, and the extent of subjectivity in manual correction is not entirely quantified. In this paper, we compare the accuracy of manual and automated correction of eye tracking data in reading tasks through a novel approach that relies on synthetic data with known ground truth. Moreover, we quantify the subjectivity in manual human correction with real eye tracking data. Our results show that expert human correction is significantly more accurate than automated algorithms, yet novice human correctors are on par with the best automated algorithms. In addition, we found that human correctors show excellent agreement in their correction, challenging the notion that manual correction is "highly subjective". Our findings provide unique insights, quantifying the benefits of manual and automated correction.

Reading comics: The effect of expertise on eye movements

The theory of expertise suggests that there should be observable differences in the eye movement patterns between experts and non-experts. Previous studies have investigated how expertise influences eye movement patterns during cognitive tasks like reading. However, the impact of expertise on eye movements in comics, a multimodal form of text, remains unexplored. This article reports on a study that uses eye tracking to examine patterns in the ways that experts and non-experts read comics. Expert participants (14) with experience in reading comics than non-expert participants (17). When controlling for variables such as layout and text quantity, we found significant differences in visual scanning between experts and non-experts. Experts exhibited more frequent saccades and greater amplitude of saccades. Further analysis revealed distinct strategies in processing text and image content between the two groups: the interaction between expertise level and content type in specific AOI showed significant differences across multiple visual measurement metrics, including Average duration of fixations, number of fixations, and number of saccades within AOI. These findings not only support the applicability of the expertise level theory in the field of comic reading but also provide a new perspective for understanding the reading processing of multimodal texts.

Gaze behavior reveals automaticity and attention allocation during music teaching vs. observing

In a unique case-study approach in which I served as both the research participant and the experimenter, I wore eye-tracking glasses while teaching a brief music lesson to two university students learning trumpet, then approximately two weeks later, I watched a video of the lesson and tracked my gaze again. To investigate unconscious perceptual processes engaged during music teaching, I compared my attention allocation while teaching to my attention allocation during selfobservation. My gaze behavior while teaching revealed a high level of automaticity regarding lesson sequencing and allocation of attention. Strategic moment-to-moment shifts in attention between the two students occurred entirely below my conscious awareness, yet post hoc analyses revealed precisely timed changes that were related to momentary goals. While watching the video, absent the demands of behavioral interaction and momentary decision-making, I directed more sustained attention to both students than I had while teaching. These results reveal important features of "teacher thinking" that are not directly observable or typically construed as conscious behavior. That this component of teaching practice does not involve volitional control suggests that teachers' descriptions of their thinking may not reveal to novices important elements of pedagogical expertise.

Gender Selection Dilemma in Fast Moving Consumer Goods (FMCG) Advertising: Insights from Eye- Tracking Research

Selecting the gender of a celebrity for fast-moving consumer goods (FMCG) advertising presents a strategic challenge. Previous research has predominantly concentrated on comparing celebrity spokespersons with non-celebrities, frequently neglecting the intricate distinctions in the effectiveness of male versus female endorsers. This study addresses this research gap by employing both traditional and neuromarketing methodologies. By integrating eye-tracking technology via RealEye and questionnaire-based surveys, the results indicate that female celebrities are more effective in capturing visual attention, whereas male celebrities are more effective in enhancing perceived trustworthiness. These findings are pivotal for both academic research and commercial strategy, as they elucidate the optimal selection of celebrity gender for maximizing FMCG advertising efficacy.

Myogenic artifacts masquerade as neuroplasticity in the auditory frequency-following response

The frequency-following response (FFR) is an evoked potential that provides a neural index of complex sound encoding in the brain. FFRs have been widely used to characterize speech and music processing, experience-dependent neuroplasticity (e.g., learning and musicianship), and biomarkers for hearing and language-based disorders that distort receptive communication abilities. It is widely assumed that FFRs stem from a mixture of phase-locked neurogenic activity from the brainstem and cortical structures along the hearing neuraxis. In this study, we challenge this prevailing view by demonstrating that upwards of ~50% of the FFR can originate from an unexpected myogenic source: contamination from the postauricular muscle (PAM) vestigial startle reflex. We measured PAM, transient auditory brainstem responses (ABRs), and sustained frequency-following response (FFR) potentials reflecting myogenic (PAM) and neurogenic (ABR/FFR) responses in young, normal-hearing listeners with varying degrees of musical training. We first establish that PAM artifact is present in all ears, varies with electrode proximity to the muscle, and can be experimentally manipulated by directing listeners' eye gaze toward the ear of sound stimulation. We then show this muscular noise easily confounds auditory FFRs, spuriously amplifying responses 3-4-fold with tandem PAM contraction and even explaining putative FFR enhancements observed in highly skilled musicians. Our findings expose a new and unrecognized myogenic source to the FFR that drives its large inter-subject variability and cast doubt on whether changes in the response typically attributed to neuroplasticity/pathology are solely of brain origin.

Myogenic artifacts masquerade as neuroplasticity in the auditory frequency-following response (FFR)

The frequency-following response (FFR) is an evoked potential that provides a "neural fingerprint" of complex sound encoding in the brain. FFRs have been widely used to characterize speech and music processing, experience-dependent neuroplasticity (e.g., learning, musicianship), and biomarkers for hearing and language-based disorders that distort receptive communication abilities. It is widely assumed FFRs stem from a mixture of phase-locked neurogenic activity from brainstem and cortical structures along the hearing neuraxis. Here, we challenge this prevailing view by demonstrating upwards of ~50% of the FFR can originate from a non-neural source: contamination from the postauricular muscle (PAM) vestigial startle reflex. We first establish PAM artifact is present in all ears, varies with electrode proximity to the muscle, and can be experimentally manipulated by directing listeners' eye gaze toward the ear of sound stimulation. We then show this muscular noise easily confounds auditory FFRs, spuriously amplifying responses by 3-4x fold with tandem PAM contraction and even explaining putative FFR enhancements observed in highly skilled musicians. Our findings expose a new and unrecognized myogenic source to the FFR that drives its large inter-subject variability and cast doubt on whether changes in the response typically attributed to neuroplasticity/pathology are solely of brain origin.

An Eye Tracking Based Framework for Safety Improvement of Offshore Operations

Offshore drilling operations consist of complex and high-risk processes. Lack of situational awareness in drilling operations has become an important human factor issue that causes safety accidents. Prolonged work shifts and fatigue are some of the crucial issues that impact performance. Eye tracking technology can be used to distinguish the degree of awareness or alertness of participants that might be related to fatigue or onsite distractions. Oculomotor activity can be used to obtain visual cues that can quantify the drilling operators' situational awareness that might enable us to develop warning alarms to alert the driller. Such systems can help reduce accidents and save non-productive time. In this paper, eye movement char-acteristics were investigated to differentiate the situational awareness between a representa-tive expert and a group of novices using a scenario-based Virtual Reality Drilling Simulator. Significant visual oculomotor activity differences were identified between the expert and the novices that indicate an eye-tracking based system can detect the distraction and alert-ness exhibited by the workers. Results show promise on developing a framework which implements a real-time eye tracking technology in various drilling operations at drilling rigs and Real Time Operation Centers to improve process safety.