The impact of environmental noise on drivers' cognitive abilities: A case study on in-vehicle voice interaction interfaces

To investigate the impact of environmental noise on the cognitive abilities of drivers, this study, using in-vehicle voice interaction as an example, conducted laboratory experiments to assess the effects of road traffic noise, entertainment noise, and white noise stimuli on drivers' attention and short-term memory. The noise levels simulated to mimic acoustic conditions during car driving ranged from 35 dB(A) to 65 dB(A). The conclusions drawn were as follows: (1) Noise levels directly influenced subjective annoyance levels, with annoyance linearly increasing as noise levels escalated; (2) Both attention and short-term memory task reaction times of drivers were significantly influenced by noise types. Compared to traffic noise and white noise, drivers' cognitive efficiency was lower under entertainment noise. (3) Performance in complex cognitive tasks was more susceptible to noise levels compared to simple cognitive tasks; (4) Experimentally, it was found that drivers exhibited the highest cognitive efficiency in cognitive tasks when the environmental noise level was 55 dB(A), as opposed to noise levels of 35 dB(A), 45 dB(A), and 65 dB(A).

Recognition and evaluation of mental workload in different stages of perceptual and cognitive information processing using a multimodal approach

This study explores the effects of different perceptual and cognitive information processing stages on mental workload by assessing multimodal indicators of mental workload such as the NASA-TLX, task performance, ERPs and eye movements. Repeated measures ANOVA of the data showed that among ERP indicators, P1, N1 and N2 amplitudes were sensitive to perceptual load (P-load), P3 amplitude was sensitive to P-load only in the prefrontal region during high cognitive load (C-load) states, and P3 amplitude in the occipital and parietal regions was sensitive to C-load. Among the eye movement indicators, blink frequency was sensitive to P-load in all C-load states, but to C-load in only low P-load states; pupil diameter and blink duration were sensitive to both P-load and C-load. Based on the above indicators, the k-nearest neighbours (KNN) algorithm was used to propose a classification method for the four different mental workload states with an accuracy of 97.89%.Practitioner summary: Based on the results of this study, it is possible to implement the monitoring of mental workload states and optimise brain task allocation in operations involving high mental workload, such as human-computer interaction.

An updating-based working memory load alters the dynamics of eye movements but not their spatial extent during free viewing of natural scenes

The relationship between spatial deployments of attention and working memory load is an important topic of study, with clear implications for real-world tasks such as driving. Previous research has generally shown that attentional breadth broadens under higher load, while exploratory eye-movement behaviour also appears to change with increasing load. However, relatively little research has compared the effects of working memory load on different kinds of spatial deployment, especially in conditions that require updating of the contents of working memory rather than simple retrieval. The present study undertook such a comparison by measuring participants' attentional breadth (via an undirected Navon task) and their exploratory eye-movement behaviour (a free-viewing recall task) under low and high updating working memory loads. While spatial aspects of task performance (attentional breadth, and peripheral extent of image exploration in the free-viewing task) were unaffected by the load manipulation, the exploratory dynamics of the free-viewing task (including fixation durations and scan-path lengths) changed under increasing load. These findings suggest that temporal dynamics, rather than the spatial extent of exploration, are the primary mechanism affected by working memory load during the spatial deployment of attention. Further, individual differences in exploratory behaviour were observed on the free-viewing task: all metrics were highly correlated across working memory load blocks. These findings suggest a need for further investigation of individual differences in eye-movement behaviour; potential factors associated with these individual differences, including working memory capacity and persistence versus flexibility orientations, are discussed.

The effect of unisensory and multisensory information on lexical decision and free recall in young and older adults

Studies using simple low-level stimuli show that multisensory stimuli lead to greater improvements in processing speed for older adults than young adults. However, there is insufficient evidence to explain how these benefits influence performance for more complex processes such as judgement and memory tasks. This study examined how presenting stimuli in multiple sensory modalities (audio-visual) instead of one (audio-only or visual-only) may help older adults to improve their memory and cognitive processing compared to young adults. Young and older adults completed lexical decision (real word vs. pseudoword judgement) and word recall tasks, either independently, or in combination (dual-task), with and without perceptual noise. Older adults were better able to remember words when encoding independently. In contrast, young adults were better able to remember words when encoding in combination with lexical decisions. Both young and older adults had better word recall in the audio-visual condition compared with the audio-only condition. The findings indicate significant age differences when dealing with multiple tasks during encoding. Crucially, there is no greater multisensory benefit for older adults compared to young adults in more complex processes, rather multisensory stimuli can be useful in enhancing cognitive performance for both young and older adults.

The role of perceptual and cognitive load on inattentional blindness: A systematic review and three meta-analyses

The inattentional blindness phenomenon refers to situations in which a visible but unexpected stimulus remains consciously unnoticed by observers. This phenomenon is classically explained as the consequence of insufficient attention, because attentional resources are already engaged elsewhere or vary between individuals. However, this attentional-resources view is broad and often imprecise regarding the variety of attentional models, the different pools of resources that can be involved in attentional tasks, and the heterogeneity of the experimental paradigms. Our aim was to investigate whether a classic theoretical model of attention, namely the Load Theory, could account for a large range of empirical findings in this field by distinguishing the role of perceptual and cognitive resources in attentional selection and attentional capture by irrelevant stimuli. As this model has been mostly built on implicit measures of distractor interference, it is unclear whether its predictions also hold when explicit and subjective awareness of an unexpected stimulus is concerned. Therefore, we conducted a systematic review and meta-analyses of inattentional blindness studies investigating the role of perceptual and/or cognitive resources. The results reveal that, in line with the perceptual account of the Load Theory, inattentional blindness significantly increases with the perceptual load of the task. However, the cognitive account of this theory is not clearly supported by the empirical findings analysed here. Furthermore, the interaction between perceptual and cognitive load on inattentional blindness remains understudied. Theoretical implications for the Load Theory are discussed, notably regarding the difference between attentional capture and subjective awareness paradigms, and further research directions are provided.

Flexible attention system: Appearance time of split attention changes in accordance with the task difficulty level

Although it is often assumed that spatial attention exists in the form of a unitary focus, the split-attention hypothesis proposes that attention can be simultaneously divided into two spatially noncontiguous positions and that the space in between can be ignored. However, whether split attention occurs directly based on the generation of attentional benefit or whether it requires a gradual divide from a unitary focus over time has not been clarified. In the present study, by using two spatial salient cues to direct the attention allocation of participants, we aimed to investigate whether attention requires time to divide from a unitary focus and whether the appearance time of split attention varies when the task difficulty level increases between experiments. The results showed that attention required time to divide from a unitary focus, and the position between the two cued positions was not excluded by attention when the stimulus-onset asynchrony (SOA) was 60 ms. However, as the task difficulty increased between experiments, the appearance time of split attention was earlier. These findings suggest that the appearance time of split attention has a certain flexibility and can be changed according to the task requirement, thus implying that split attention and unitary attention present some common attention mechanisms and that a split or unitary mode can be flexibly selected for an attention system.

Psychopathy is associated with an exaggerated attention bottleneck: EEG and behavioral evidence from a dual-task paradigm

Psychopathy is a personality disorder associated with a chronic disregard for the welfare of others. The attention bottleneck model of psychopathy asserts that the behavior of individuals higher on psychopathy is due to an exaggerated attention bottleneck that constrains all information processing, regardless of the information's potential goal-relevance. To date, the majority of research on the attention bottleneck model of psychopathy conceptually applied the tenets of the model but did not implement methods that directly test an exaggeration of the bottleneck in psychopathy. Accordingly, the presence of an exaggerated bottleneck, the exact expression of that bottleneck, and its potential mechanistic relevance for behavior in individuals higher on psychopathy remains untested. To address these gaps, a sample of 78 male community members, evaluated for psychopathic traits using the Self-Report Psychopathy-III scale, completed an EEG-based dual-task paradigm examining short stimulus onset asynchrony (SOA; 300 ms), long SOA (1,100 ms), and single-task baseline conditions. Additionally, participants were asked about their frequency of real-world risky, impulsive, and antisocial behaviors. Psychopathy was associated with slower reaction times to second targets (T2s) presented during the dual-task conditions, relative to the baseline condition. Psychopathy also was associated with blunted P300 responses, a neural index of stimulus evaluation, across all types of T2 events. Finally, bottleneck-related interference during the short SOA events mediated the relationship between psychopathy and real-world behavior. These findings suggested that individuals higher on psychopathy exhibit an exaggerated bottleneck which produces intense and long-lasting interference, impacting all information processing and partially contributing to their maladaptive behavior.

A critical review of the cognitive and perceptual factors influencing attentional scaling and visual processing

An important mechanism used to selectively process relevant information in the environment is spatial attention. One fundamental way in which spatial attention is deployed is attentional scaling - the process of focusing attentional resources either narrowly or broadly across the visual field. Although early empirical work suggested that narrowing attention improves all aspects of visual processing, recent studies have demonstrated that narrowing attention can also have no effect or even a detrimental impact when it comes to vision that is thought to be mediated via the magnocellular pathway of the visual system. Here, for the first time, we synthesize empirical evidence measuring the behavioral effects of attentional scaling on tasks gauging the contribution of the major neural pathways of the visual system, with the purpose of determining the potential factors driving these contradictory empirical findings. This analysis revealed that attentional scaling could be best understood by considering the unique methodologies used in the research literature to date. The implications of this analysis for theoretical frameworks of attentional scaling are discussed, and methodological improvements for future research are proposed.

Cultural differences in performance on Eriksen's flanker task

Eriksen's zoom model of attention implies a trade-off between the breadth and resolution of representations of information. Following this perspective, we used Eriksen's flanker task to investigate culture's influence on attentional allocation and attentional resolution. In Experiment 1, the spatial distance of the flankers was varied to test whether people from Eastern cultures (here, Turks) experienced more interference than people from Western cultures (here, Americans) when flankers were further from the target. In Experiment 2, the contrast of the flankers was varied. The pattern of results shows that congruency of the flankers (Experiment 1) as well as the degree of contrast of the flankers compared with the target (Experiment 2) interact with participants' cultural background to differentially influence accuracy or reaction times. In addition, we used evidence accumulation modeling to jointly consider measures of speed and accuracy. Results indicate that to make decisions in the Eriksen flanker task, Turks both accumulate evidence faster and require more evidence than Americans do. These cultural differences in visual attention and decision-making have implications for a wide variety of cognitive processes.

Dynamics of auditory spatial attention gradients

Auditory spatial attention faces the conflicting demands of focusing on the current task while also rapidly shifting location to unexpected stimuli. We examined the interplay of sustained focus and intermittent shifts in an auditory spatial attention task. Most trials required a choice response from a standard location in virtual space (L-R: -90°, 0°, +90°), but occasionally the location shifted between 45°-180°. Reaction time curves for angular shifts had a quadratic shape, with slowing for small shifts but faster reaction times for larger shifts. The reaction time curves were maintained at faster stimulus rates and usually scaled to fit the range of stimulus locations. However, focus on the right had an attenuated curve, and did not scale to the range of locations. The findings suggest two mechanisms: a top-down bias centered on standard locations that decreases with distance, and a bottom-up bias that under these conditions increases with distance from the standard location.

Cognitive load effects on early visual perceptual processing

Contrast-based early visual processing has largely been considered to involve autonomous processes that do not need the support of cognitive resources. However, as spatial attention is known to modulate early visual perceptual processing, we explored whether cognitive load could similarly impact contrast-based perception. We used a dual-task paradigm to assess the impact of a concurrent working memory task on the performance of three different early visual tasks. The results from Experiment 1 suggest that cognitive load can modulate early visual processing. No effects of cognitive load were seen in Experiments 2 or 3. Together, the findings provide evidence that under some circumstances cognitive load effects can penetrate the early stages of visual processing and that higher cognitive function and early perceptual processing may not be as independent as was once thought.

Salience of Somatosensory Stimulus Modulating External-to-Internal Orienting Attention

Shifting between one’s external and internal environments involves orienting attention. Studies on differentiating subprocesses associated with external-to-internal orienting attention are limited. This study aimed to reveal the characteristics of the disengagement, shifting and reengagement subprocesses by using somatosensory external stimuli and internally generated images. Study participants were to perceive nociceptive external stimuli (External Low (E_L) or External High (E_H)) induced by electrical stimulations (50 ms) followed by mentally rehearsing learned subnociceptive images (Internal Low (I_L) and Internal High (I_H)). Behavioral responses and EEG signals of the participants were recorded. The three significant components elicited were: fronto-central negativity (FCN; 128–180 ms), fronto-central P2 (200–260 ms), and central P3 (320–380 ms), which reflected the three subprocesses, respectively. Differences in the FCN and P2 amplitudes during the orienting to the subnociceptive images revealed only in the E_H but not E_L stimulus condition that are new findings. The results indicated that modulations of the disengagement and shifting processes only happened if the external nociceptive stimuli were of high salience and the external-to-internal incongruence was large. The reengaging process reflected from the amplitude of P3 correlated significantly with attenuation of the pain intensity felt from the external nociceptive stimuli. These findings suggested that the subprocesses underlying external-to-internal orienting attention serve different roles. Disengagement subprocess tends to be stimulus dependent, which is bottom-up in nature. Shifting and reengagement tend to be top-down subprocesses, which taps on cognitive control. This subprocess may account for the attenuation effects on perceived pain intensity after orienting attention.

Effects of Motion in the Far Peripheral Visual Field on Cognitive Test Performance and Cognitive Load

Cognitive load theory posits that limited attention is in actuality a limitation in working memory resources. The load theory of selective attention and cognitive control sees the interplay between attention and awareness as separate modifying functions that act on working memory. Reconciling the theoretical differences in these two theories has important implications for learning. Thirty-nine adult participants performed a cognitively demanding test, with and without movement in the far peripheral field. Although the results for movement effects on cognitive load in this experiment were not statistically significant, men spent less time on the cognitive test in the peripheral movement condition than in the conditions without peripheral movement. No such difference was found for women. The implications of these results and recommendations for future research that extends the present study are presented.

Relationships between trait impulsivity and cognitive control: the effect of attention switching on response inhibition and conflict resolution

This study examined the relationship between trait impulsivity and cognitive control, as measured by the Barratt Impulsiveness Scale (BIS) and a focused attention dichotic listening to words task, respectively. In the task, attention was manipulated in two attention conditions differing in their cognitive control demands: one in which attention was directed to one ear at a time for a whole block of trials (blocked condition) and another in which attention was switched pseudo-randomly between the two ears from trial to trial (mixed condition). Results showed that high impulsivity participants exhibited more false alarm and intrusion errors as well as a lesser ability to distinguish between stimuli in the mixed condition, as compared to low impulsivity participants. In the blocked condition, the performance levels of the two groups were comparable with respect to these measures. In addition, total BIS scores were correlated with intrusions and laterality index in the mixed but not the blocked condition. The findings suggest that high impulsivity individuals may be less prone to attentional difficulties when cognitive load is relatively low. In contrast, when attention switching is involved, high impulsivity is associated with greater difficulty in inhibiting responses and resolving cognitive conflict than is low impulsivity, as reflected in error-prone information processing. The conclusion is that trait impulsivity in a non-clinical population is manifested more strongly when attention switching is required than during maintained attention. This may have important implications for the conceptualization and treatment of impulsivity in both non-clinical and clinical populations.

Domain-specific control of selective attention

Previous research has shown that loading information on working memory affects selective attention. However, whether the load effect on selective attention is domain-general or domain-specific remains unresolved. The domain-general effect refers to the findings that load in one content (e.g. phonological) domain in working memory influences processing in another content (e.g., visuospatial) domain. Attentional control supervises selection regardless of information domain. The domain-specific effect refers to the constraint of influence only when maintenance and processing operate in the same domain. Selective attention operates in a specific content domain. This study is designed to resolve this controversy. Across three experiments, we manipulated the type of representation maintained in working memory and the type of representation upon which the participants must exert control to resolve conflict and select a target into the focus of attention. In Experiments 1a and 1b, participants maintained digits and nonverbalized objects, respectively, in working memory while selecting a target in a letter array. In Experiment 2, we presented auditory digits with a letter flanker task to exclude the involvement of resource competition within the same input modality. In Experiments 3a and 3b, we replaced the letter flanker task with an object flanker task while manipulating the memory load on object and digit representation, respectively. The results consistently showed that memory load modulated distractibility only when the stimuli of the two tasks were represented in the same domain. The magnitude of distractor interference was larger under high load than under low load, reflecting a lower efficacy of information prioritization. When the stimuli of the two tasks were represented in different domains, memory load did not modulate distractibility. Control of processing priority in selective attention demands domain-specific resources.

Effects of load on the time course of attentional engagement, disengagement, and orienting in reading

We examined how the frequency of the fixated word influences the spatiotemporal distribution of covert attention during reading. Participants discriminated gaze-contingent probes that occurred with different spatial and temporal offsets from randomly chosen fixation points during reading. We found that attention was initially focused at fixation and that subsequent defocusing was slower when the fixated word was lower in frequency. Later in a fixation, attention oriented more towards the next saccadic target for high- than for low-frequency words. These results constitute the first report of the time course of the effect of load on attentional engagement and orienting in reading. They are discussed in the context of serial and parallel models of reading.

Using multisensory cues to facilitate air traffic management

OBJECTIVE

In the present study, we sought to investigate whether auditory and tactile cuing could be used to facilitate a complex, real-world air traffic management scenario.

BACKGROUND

Auditory and tactile cuing provides an effective means of improving both the speed and accuracy of participants' performance in a variety of laboratory-based visual target detection and identification tasks.

METHOD

A low-fidelity air traffic simulation task was used in which participants monitored and controlled aircraft.The participants had to ensure that the aircraft landed or exited at the correct altitude, speed, and direction and that they maintained a safe separation from all other aircraft and boundaries. The performance measures recorded included en route time, handoff delay, and conflict resolution delay (the performance measure of interest). In a baseline condition, the aircraft in conflict was highlighted in red (visual cue), and in the experimental conditions, this standard visual cue was accompanied by a simultaneously presented auditory, vibrotactile, or audiotactile cue.

RESULTS

Participants responded significantly more rapidly, but no less accurately, to conflicts when presented with an additional auditory or audiotactile cue than with either a vibrotactile or visual cue alone.

CONCLUSION

Auditory and audiotactile cues have the potential for improving operator performance by reducing the time it takes to detect and respond to potential visual target events.

APPLICATION

These results have important implications for the design and use of multisensory cues in air traffic management.