Audiovisual Multisensory Integration and Evoked Potentials in Young Adults With and Without Attention-Deficit/Hyperactivity Disorder

Impaired emotional multimodal integration in inhibition of return in children with attention-deficit/hyperactivity disorder

Attention-deficit/hyperactivity disorder (ADHD) is a common neurodevelopmental disorder in children. Previous studies have shown that children with ADHD have impaired processing of emotional stimuli, but it is unclear whether their ability to integrate multimodal emotional stimuli is impaired and at which processing pathway this impairment exists. The present study investigated the ability of children with ADHD to integrate emotional audiovisual stimuli under different emotional conditions, and the effect of audiovisual integration on IOR to reveal the impaired processing pathway of their emotional audiovisual integration. Fifty-eight school-age children (29 with ADHD and 29 matched typically developing (TD) children) performed an emotional valence discrimination task with a cue-target paradigm. The results showed that children with ADHD did not exhibit audiovisual integration of emotional stimuli in all experimental conditions. In addition, the IOR effect was significantly smaller for audiovisual targets than for visual targets under the negative but not the neutral emotion condition in children with ADHD, whereas this effect was present in all emotion conditions in TD children. These results indicate that the ability to integrate emotional audiovisual information is impaired in children with ADHD and this impairment exists in both bottom-up and top-down pathways. Additionally, although presenting emotional auditory stimuli at the same time as emotional faces reduced IOR both in children with ADHD and TD, the manner of reduction differed. These findings provide new evidence of emotional processing deficits and multimodal integration deficits in children with ADHD, and help provide support for children in educational settings.

Exploring potential ADHD biomarkers through advanced machine learning: An examination of audiovisual integration networks

Attention deficit hyperactivity disorder (ADHD) is a neurodevelopmental condition marked by inattention and impulsivity, linked to disruptions in functional brain connectivity and structural alterations in large-scale brain networks. Although sensory pathway anomalies have been implicated in ADHD, the exploration of sensory integration regions remains limited. In this study, we adopted an exploratory approach to investigate the connectivity profile of auditory-visual integration networks (AVIN) in children with ADHD and neurotypical controls using the ADHD-200 rs-fMRI dataset. We expanded our exploration beyond network-based statistics (NBS) by extracting a diverse range of graph theoretical features. These features formed the basis for applying machine learning (ML) techniques to discern distinguishing patterns between the control group and children with ADHD. To address class imbalance and sample heterogeneity, we employed ensemble learning models, including balanced random forest (BRF), XGBoost, and EasyEnsemble classifier (EEC). Our findings revealed significant differences in AVIN between ADHD individuals and neurotypical controls, enabling automated diagnosis with moderate accuracy (74.30%). Notably, the EEC model demonstrated balanced sensitivity and specificity metrics, crucial for diagnostic applications, offering valuable insights for potential clinical use. These results contribute to understanding ADHD's neural underpinnings and highlight the diagnostic potential of AVIN measures. However, the exploratory nature of this study underscores the need for future research to confirm and refine these findings with specific hypotheses and rigorous statistical controls.

Audiovisual Integration Decreases Inhibition of Return in Children With ADHD

OBJECTIVES

Previous studies have widely demonstrated that inhibition of return (IOR) with audiovisual targets decreases due to audiovisual integration (AVI). It is currently unclear, however, whether the impaired AVI in children with ADHD has effects on IOR. The present study used the cue-target paradigm to explore differences between the IOR of audiovisual targets and the IOR of visual targets in ADHD and typically developing (TD) children.

METHOD

A total of 81 native Chinese speakers aged 6 to 13 years were recruited, including 38 children with ADHD and 43 age- and sex-matched TD children.

RESULTS

The results showed that there was a smaller magnitude of IOR with audiovisual targets as compared with visual targets in the two groups. Importantly, the reduction of IOR in audiovisual conditions was significantly smaller in children with ADHD than in children with TD. Race model analyses further confirmed that differences in IOR between ADHD and TD are due to deficits of audiovisual integration in ADHD.

CONCLUSION

The results indicated that children with ADHD have impaired audiovisual integration, which has a minimal impact on IOR.

The dissociating effects of fear and disgust on multisensory integration in autism: evidence from evoked potentials

Background

Deficits in Multisensory Integration (MSI) in ASD have been reported repeatedly and have been suggested to be caused by altered long-range connectivity. Here we investigate behavioral and ERP correlates of MSI in ASD using ecologically valid videos of emotional expressions.

Methods

In the present study, we set out to investigate the electrophysiological correlates of audiovisual MSI in young autistic and neurotypical adolescents. We employed dynamic stimuli of high ecological validity (500 ms clips produced by actors) that depicted fear or disgust in unimodal (visual and auditory), and bimodal (audiovisual) conditions.

Results

We report robust MSI effects at both the behavioral and electrophysiological levels and pronounced differences between autistic and neurotypical participants. Specifically, neurotypical controls showed robust behavioral MSI for both emotions as seen through a significant speed-up of bimodal response time (RT), confirmed by Miller's Race Model Inequality (RMI), with greater MSI effects for fear than disgust. Adolescents with ASD, by contrast, showed behavioral MSI only for fear. At the electrophysiological level, the bimodal condition as compared to the unimodal conditions reduced the amplitudes of the visual P100 and auditory P200 and increased the amplitude of the visual N170 regardless of group. Furthermore, a cluster-based analysis across all electrodes revealed that adolescents with ASD showed an overall delayed and spatially constrained MSI effect compared to controls.

Conclusion

Given that the variables we measured reflect attention, our findings suggest that MSI can be modulated by the differential effects on attention that fear and disgust produce. We also argue that the MSI deficits seen in autistic individuals can be compensated for at later processing stages by (a) the attention-orienting effects of fear, at the behavioral level, and (b) at the electrophysiological level via increased attentional effort.

Seeing is believing: Larger Colavita effect in school-aged children with attention-deficit/hyperactivity disorder

Attention-deficit/hyperactivity disorder (ADHD) is a common neurodevelopmental disorder that leads to visually relevant compensatory activities and cognitive strategies in children. Previous studies have identified difficulties with audiovisual integration in children with ADHD, but the characteristics of the visual dominance effect when processing multisensory stimuli are not clear in children with ADHD. The current study used the Colavita paradigm to explore the visual dominance effect in school-aged children with ADHD. The results found that, compared with typically developing children, children with ADHD had a higher proportion of "visual-auditory" trials and a lower proportion of "simultaneous" trials. The study also found that the proportion of visual-auditory trials in children with ADHD decreased as their Swanson, Nolan, and Pelham-IV rating scale (SNAP-IV) inattention scores increased. The results showed that school-aged children with ADHD had a larger Colavita effect, which decreased with the severity of inattentive symptoms. This may be due to an overreliance on visual information and an abnormal integration time window. The connection between multisensory cognitive processing performance and clinical symptoms found in the current study provides empirical and theoretical support for the knowledge base of multisensory and cognitive abilities in disorders.

Sex Differences in Low-Level Multisensory Integration in Developmental Dyslexia

Reading acquisition involves the integration of auditory and visual stimuli. Thus, low-level audiovisual multisensory integration might contribute to disrupted reading in developmental dyslexia. Although dyslexia is more frequently diagnosed in males and emerging evidence indicates that the neural basis of dyslexia might differ between sexes, previous studies examining multisensory integration did not evaluate potential sex differences nor tested its neural correlates. In the current study on 88 adolescents and young adults, we found that only males with dyslexia showed a deficit in multisensory integration of simple nonlinguistic stimuli. At the neural level, both females and males with dyslexia presented smaller differences in response to multisensory compared to those in response to unisensory conditions in the N1 and N2 components (early components of event-related potentials associated with sensory processing) than the control group. Additionally, in a subsample of 80 participants matched for nonverbal IQ, only males with dyslexia exhibited smaller differences in the left hemisphere in response to multisensory compared to those in response to unisensory conditions in the N1 component. Our study indicates that deficits of multisensory integration seem to be more severe in males than females with dyslexia. This provides important insights into sex-modulated cognitive processes that might confer vulnerability to reading difficulties.

Neck Muscle Vibration Alters Cerebellar Processing Associated with Motor Skill Acquisition of a Proprioceptive-Based Task

Experimentally induced neck fatigue and neck pain have been shown to impact cortico-cerebellar processing and sensorimotor integration, assessed using a motor learning paradigm. Vibration specifically impacts muscle spindle feedback, yet it is unknown whether transient alterations in neck sensory input from vibration impact these neural processing changes following the acquisition of a proprioceptive-based task. Twenty-five right-handed participants had electrical stimulation over the right median nerve to elicit short- and middle-latency somatosensory evoked potentials (SEPs) pre- and post-acquisition of a force matching tracking task. Following the pre-acquisition phase, controls (CONT, n = 13, 6 F) received 10 min of rest and the vibration group (VIB, n = 12, 6 F) received 10 min of 60 Hz vibration on the right sternocleidomastoid and left cervical extensors. Task performance was measured 24 h later to assess retention. Significant time by group interactions occurred for the N18 SEP peak, 21.77% decrease in VIB compared to 58.74% increase in CONT (F(1,23) = 6.475, p = 0.018, np2 = 0.220), and the N24 SEP peak, 16.31% increase in VIB compared to 14.05% decrease in CONT (F(1,23) = 5.787, p = 0.025, np2 = 0.201). Both groups demonstrated improvements in motor performance post-acquisition (F(1,23) = 52.812, p < 0.001, np2 = 0.697) and at retention (F(1,23) = 35.546, p < 0.001, np2 = 0.607). Group-dependent changes in the SEP peaks associated with cerebellar input (N18) and cerebellar processing (N24) suggests that an altered proprioceptive input from neck vibration impacts cerebellar pathways.

Network-Based Differences in Top-Down Multisensory Integration between Adult ADHD and Healthy Controls-A Diffusion MRI Study

BACKGROUND

Attention-deficit-hyperactivity disorder (ADHD) is a neurodevelopmental disorder neurobiologically conceptualized as a network disorder in white and gray matter. A relatively new branch in ADHD research is sensory processing. Here, altered sensory processing i.e., sensory hypersensitivity, is reported, especially in the auditory domain. However, our perception is driven by a complex interplay across different sensory modalities. Our brain is specialized in binding those different sensory modalities to a unified percept-a process called multisensory integration (MI) that is mediated through fronto-temporal and fronto-parietal networks. MI has been recently described to be impaired for complex stimuli in adult patients with ADHD. The current study relates MI in adult ADHD with diffusion-weighted imaging. Connectome-based and graph-theoretic analysis was applied to investigate a possible relationship between the ability to integrate multimodal input and network-based ADHD pathophysiology.

METHODS

Multishell, high-angular resolution diffusion-weighted imaging was performed on twenty-five patients with ADHD (six females, age: 30.08 (SD: 9.3) years) and twenty-four healthy controls (nine females; age: 26.88 (SD: 6.3) years). Structural connectome was created and graph theory was applied to investigate ADHD pathophysiology. Additionally, MI scores, i.e., the percentage of successful multisensory integration derived from the McGurk paradigm, were groupwise correlated with the structural connectome.

RESULTS

Structural connectivity was elevated in patients with ADHD in network hubs mirroring altered default-mode network activity typically reported for patients with ADHD. Compared to controls, MI was associated with higher connectivity in ADHD between Heschl's gyrus and auditory parabelt regions along with altered fronto-temporal network integrity.

CONCLUSION

Alterations in structural network integrity in adult ADHD can be extended to multisensory behavior. MI and the respective network integration in ADHD might represent the maturational cortical delay that extends to adulthood with respect to sensory processing.

Sensorimotor integration and motor learning during a novel visuomotor tracing task in young adults with attention-deficit/hyperactivity disorder

Attention-deficit/hyperactivity disorder (ADHD) is a neurodevelopmental disorder that has noted alterations to motor performance and coordination, potentially affecting learning processes and the acquisition of motor skills. This work will provide insight into the role of altered neural processing and sensorimotor integration (SMI) while learning a novel visuomotor task in young adults with ADHD. This work compared adults with ADHD (n = 12) to neurotypical controls (n = 16), using a novel visuomotor tracing task, where participants used their right-thumb to trace a sinusoidal waveform that varied in both frequency and amplitude. This learning paradigm was completed in pre, acquisition, and post blocks, where participants additionally returned and completed a retention and transfer test 24 h later. Right median nerve short latency somatosensory-evoked potentials (SEPs) were collected pre and post motor acquisition. Performance accuracy and variability improved at post and retention measures for both groups for both normalized (P < 0.001) and absolute (P < 0.001) performance scores. N18 SEP: increased in the ADHD group post motor learning and decreased in controls (P < 0.05). N20 SEP: increased in both groups post motor learning (P < 0.01). P25: increased in both groups post motor learning (P < 0.001). N24: increased for both groups at post measures (P < 0.05). N30: decreased in the ADHD group and increased in controls (P < 0.05). These findings suggest that there may be differences in cortico-cerebellar and prefrontal processing in response to novel visuomotor tasks in those with ADHD.NEW & NOTEWORTHY Alterations to somatosensory-evoked potentials (SEPs) were present in young adults with attention-deficit/hyperactivity disorder (ADHD), when compared with neurotypical controls. The N18 and N30 SEP peak had differential changes between groups, suggesting alterations to olivary-cerebellar-M1 processing and SMI in those with ADHD when acquiring a novel visuomotor tracing task. This suggests that short-latency SEPs may be a useful biomarker in the assessment of differential responses to motor acquisition in those with ADHD.

Multisensory Enhancement of Cognitive Control over Working Memory Capture of Attention in Children with ADHD

Attention deficit hyperactivity disorder (ADHD) is a common neurodevelopmental disorder in school-age children. Although it has been well documented that children with ADHD are associated with impairment of executive functions including working memory (WM) and inhibitory control, there is not yet a consensus as to the relationship between ADHD and memory-driven attentional capture (i.e., representations in WM bias attention toward the WM-matched distractors). The present study herein examined whether children with ADHD have sufficient cognitive control to modulate memory-driven attentional capture. 73 school-age children (36 with ADHD and 37 matched typically developing (TD) children) were instructed to perform a visual search task while actively maintaining an item in WM. In such a paradigm, the modality and the validity of the memory sample were manipulated. The results showed that under the visual WM encoding condition, no memory-driven attentional capture was observed in TD children, but significant capture was found in children with ADHD. In addition, under the audiovisual WM encoding condition, memory-matched distractors did not capture the attention of both groups. The results indicate a deficit of cognitive control over memory-driven attentional capture in children with ADHD, which can be improved by multisensory WM encoding. These findings enrich the relationship between ADHD and cognitive control and provide new insight into the influence of cross-modal processing on attentional guidance.

Robust perceptual-load-dependent audiovisual integration in adult ADHD

We perceive our daily-life surrounded by different senses (e.g., visual, and auditory). For a coherent percept, our brain binds those multiple streams of sensory stimulations, i.e., multisensory integration (MI). Dependent on stimulus complexity, early MI is triggered by bottom-up or late via top-down attentional deployment. Adult attention-deficit/hyperactivity disorder (ADHD) is associated with successful bottom-up MI and deficient top-down MI. In the current study, we investigated the robustness of the bottom-up MI by adding additional task demand varying the perceptual load. We hypothesized diminished bottom-up MI for high perceptual load for patients with ADHD. 18 adult patients with ADHD and 18 age- and gender-matched healthy controls participated in this study. In the visual search paradigm, a target letter was surrounded by uniform distractors (low load) or by different letters (high load). Additionally, either unimodal (visual flash, auditory beep) or multimodal (audiovisual) flanked the visual search. Linear-mixed modeling was used to investigate the influence of load on reaction times. Further, the race model inequality was calculated. Patients with ADHD showed a similar degree of MI performance like healthy controls, irrespective of perceptual load manipulation. ADHD patients violated the race model for the low load but not for the high-load condition. There seems to be robust bottom-up MI independent of perceptual load in ADHD patients. However, the sensory accumulation might be altered when attentional demands are high.

Source Localization of Audiovisual Multisensory Neural Generators in Young Adults with Attention-Deficit/Hyperactivity Disorder

Attention-Deficit/Hyperactivity Disorder (ADHD) is a neurodevelopmental disorder that exhibits unique neurological and behavioural characteristics. Our previous work using event-related potentials demonstrated that adults with ADHD process audiovisual multisensory stimuli somewhat differently than neurotypical controls. This study utilised an audiovisual multisensory two-alternative forced-choice discrimination task. Continuous whole-head electroencephalography (EEG) was recorded. Source localization (sLORETA) software was utilised to determine differences in the contribution made by sources of neural generators pertinent to audiovisual multisensory processing in those with ADHD versus neurotypical controls. Source localization techniques elucidated that the controls had greater neural activity 164 ms post-stimulus onset when compared to the ADHD group, but only when responding to audiovisual stimuli. The source of the increased activity was found to be Brodmann Area 2, postcentral gyrus, right-hemispheric parietal lobe referenced to Montreal Neurological Institute (MNI) coordinates of X = 35, Y = −40, and Z = 70 (p < 0.05). No group differences were present during either of the unisensory conditions. Differences in the integration areas, particularly in the right-hemispheric parietal brain regions, were found in those with ADHD. These alterations may correspond to impaired attentional capabilities when presented with multiple simultaneous sensory inputs, as is the case during a multisensory condition.

Disentangling early versus late audiovisual integration in adult ADHD: a combined behavioural and resting-state connectivity study

BACKGROUND

Studies investigating sensory processing in attention-deficit/hyperactivity disorder (ADHD) have shown altered visual and auditory processing. However, evidence is lacking for audiovisual interplay - namely, multisensory integration. As well, neuronal dysregulation at rest (e.g., aberrant within- or between-network functional connectivity) may account for difficulties with integration across the senses in ADHD. We investigated whether sensory processing was altered at the multimodal level in adult ADHD and included resting-state functional connectivity to illustrate a possible overlap between deficient network connectivity and the ability to integrate stimuli.

METHODS

We tested 25 patients with ADHD and 24 healthy controls using 2 illusionary paradigms: the sound-induced flash illusion and the McGurk illusion. We applied the Mann-Whitney U test to assess statistical differences between groups. We acquired resting-state functional MRIs on a 3.0 T Siemens magnetic resonance scanner, using a highly accelerated 3-dimensional echo planar imaging sequence.

RESULTS

For the sound-induced flash illusion, susceptibility and reaction time were not different between the 2 groups. For the McGurk illusion, susceptibility was significantly lower for patients with ADHD, and reaction times were significantly longer. At a neuronal level, resting-state functional connectivity in the ADHD group was more highly regulated in polymodal regions that play a role in binding unimodal sensory inputs from different modalities and enabling sensory-to-cognition integration.

LIMITATIONS

We did not explicitly screen for autism spectrum disorder, which has high rates of comorbidity with ADHD and also involves impairments in multisensory integration. Although the patients were carefully screened by our outpatient department, we could not rule out the possibility of autism spectrum disorder in some participants.

CONCLUSION

Unimodal hypersensitivity seems to have no influence on the integration of basal stimuli, but it might have negative consequences for the multisensory integration of complex stimuli. This finding was supported by observations of higher resting-state functional connectivity between unimodal sensory areas and polymodal multisensory integration convergence zones for complex stimuli.

When two is worse than one: The deleterious impact of multisensory stimulation on response inhibition

Multisensory facilitation is known to improve the perceptual performances and reaction times of participants in a wide range of tasks, from detection and discrimination to memorization. We asked whether a multimodal signal can similarly improve action inhibition using the stop-signal paradigm. Indeed, consistent with a crossmodal redundant signal effect that relies on multisensory neuronal integration, the threshold for initiating behavioral responses is known for being reached faster with multisensory stimuli. To evaluate whether this phenomenon also occurs for inhibition, we compared stop signals in unimodal (human faces or voices) versus audiovisual modalities in natural or degraded conditions. In contrast to the expected multisensory facilitation, we observed poorer inhibition efficiency in the audiovisual modality compared with the visual and auditory modalities. This result was corroborated by both response probabilities and stop-signal reaction times. The visual modality (faces) was the most effective. This is the first demonstration of an audiovisual impairment in the domain of perception and action. It suggests that when individuals are engaged in a high-level decisional conflict, bimodal stimulation is not processed as a simple multisensory object improving the performance but is perceived as concurrent visual and auditory information. This absence of unity increases task demand and thus impairs the ability to revise the response.

Audiohaptic Feedback Enhances Motor Performance in a Low-Fidelity Simulated Drilling Task

When used in educational settings, simulations utilizing virtual reality (VR) technologies can reduce training costs while providing a safe and effective learning environment. Tasks can be easily modified to maximize learning objectives of different levels of trainees (e.g., novice, intermediate, expert), and can be repeated for the development of psychomotor skills. VR offers a multisensory experience, providing visual, auditory, and haptic sensations with varying levels of fidelity. While simulating visual and auditory stimuli is relatively easy and cost-effective, similar representations of haptic sensation still require further development. Evidence suggests that mixing high- and low-fidelity realistic sensations (e.g., audition and haptic) can improve the overall perception of realism, however, whether this also leads to improved performance has not been examined. The current study examined whether audiohaptic stimuli presented in a virtual drilling task can lead to improved motor performance and subjective realism, compared to auditory stimuli alone. Right-handed participants (n = 16) completed 100 drilling trials of each stimulus type. Performance measures indicated that participants overshot the target during auditory trials, and undershot the target during audiohaptic trials. Undershooting is thought to be indicative of improved performance, optimizing both time and energy requirements.

The Influence of Subclinical Neck Pain on Neurophysiological and Behavioral Measures of Multisensory Integration

Multisensory integration (MSI) is necessary for the efficient execution of many everyday tasks. Alterations in sensorimotor integration (SMI) have been observed in individuals with subclinical neck pain (SCNP). Altered audiovisual MSI has previously been demonstrated in this population using performance measures, such as reaction time. However, neurophysiological techniques have not been combined with performance measures in the SCNP population to determine differences in neural processing that may contribute to these behavioral characteristics. Electroencephalography (EEG) event-related potentials (ERPs) have been successfully used in recent MSI studies to show differences in neural processing between different clinical populations. This study combined behavioral and ERP measures to characterize MSI differences between healthy and SCNP groups. EEG was recorded as 24 participants performed 8 blocks of a simple reaction time (RT) MSI task, with each block consisting of 34 auditory (A), visual (V), and audiovisual (AV) trials. Participants responded to the stimuli by pressing a response key. Both groups responded fastest to the AV condition. The healthy group demonstrated significantly faster RTs for the AV and V conditions. There were significant group differences in neural activity from 100-140 ms post-stimulus onset, with the control group demonstrating greater MSI. Differences in brain activity and RT between individuals with SCNP and a control group indicate neurophysiological alterations in how individuals with SCNP process audiovisual stimuli. This suggests that SCNP alters MSI. This study presents novel EEG findings that demonstrate MSI differences in a group of individuals with SCNP.