1
|
Pan WN, Zhao YW, Luo ZX, Chen Y, Cai YC. Attention modulates early visual processing: An association between subjective contrast perception and early C1 ERP component. Psychophysiology 2024; 61:e14507. [PMID: 38146152 DOI: 10.1111/psyp.14507] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/04/2023] [Revised: 11/26/2023] [Accepted: 11/28/2023] [Indexed: 12/27/2023]
Abstract
The question of whether spatial attention can modulate initial afferent activity in area V1, as measured by the earliest visual event-related potential (ERP) component "C1", is still the subject of debate. Because attention always enhances behavioral performance, previous research has focused on finding evidence of attention-related enhancements in visual neural responses. However, recent psychophysical studies revealed a complex picture of attention's influence on visual perception: attention amplifies the perceived contrast of low-contrast stimuli while dampening the perceived contrast of high-contrast stimuli. This evidence suggests that attention may not invariably augment visual neural responses but could instead exert inhibitory effects under certain circumstances. Whether this bi-directional modulation of attention also manifests in C1 and whether the modulation of C1 underpins the attentional influence on contrast perception remain unknown. To address these questions, we conducted two experiments (N = 67 in total) by employing a combination of behavioral and ERP methodologies. Our results did not unveil a uniform attentional enhancement or attenuation effect of C1 across all subjects. However, an intriguing correlation between the attentional effects of C1 and contrast appearance for high-contrast stimuli did emerge, revealing an association between attentional modulation of C1 and the attentional modulation of contrast appearance. This finding offers new insights into the relationship between attention, perceptual experience, and early visual neural processing, suggesting that the attentional effect on subjective visual perception could be mediated by the attentional modulation of the earliest visual cortical response.
Collapse
Affiliation(s)
- Wang-Nan Pan
- Department of Psychology and Behavioral Sciences, Zhejiang University, Hangzhou, China
| | - Yu-Wan Zhao
- Department of Psychology and Behavioral Sciences, Zhejiang University, Hangzhou, China
| | - Zi-Xi Luo
- Department of Psychology and Behavioral Sciences, Zhejiang University, Hangzhou, China
| | - Yue Chen
- Department of Psychology and Behavioral Sciences, Zhejiang University, Hangzhou, China
| | - Yong-Chun Cai
- Department of Psychology and Behavioral Sciences, Zhejiang University, Hangzhou, China
| |
Collapse
|
2
|
Ramamurthy M, White AL, Yeatman JD. Children with dyslexia show no deficit in exogenous spatial attention but show differences in visual encoding. Dev Sci 2024; 27:e13458. [PMID: 37985400 DOI: 10.1111/desc.13458] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/04/2023] [Revised: 08/30/2023] [Accepted: 10/23/2023] [Indexed: 11/22/2023]
Abstract
In the search for mechanisms that contribute to dyslexia, the term "attention" has been invoked to explain performance in a variety of tasks, creating confusion since all tasks do, indeed, demand "attention." Many studies lack an experimental manipulation of attention that would be necessary to determine its influence on task performance. Nonetheless, an emerging view is that children with dyslexia have an impairment in the exogenous (automatic/reflexive) orienting of spatial attention. Here we investigated the link between exogenous attention and reading ability by presenting exogenous spatial cues in the multi-letter processing task-a task relevant for reading. The task was gamified and administered online to a large sample of children (N = 187) between 6 and 17 years. Children with dyslexia performed worse overall at rapidly recognizing and reporting strings of letters. However, we found no evidence for a difference in the utilization of exogenous spatial cues, resolving two decades of ambiguity in the field. Previous studies that claimed otherwise may have failed to distinguish attention effects from overall task performance or found spurious group differences in small samples. RESEARCH HIGHLIGHTS: We manipulated exogenous visual spatial attention using pre-cues in a task that is relevant for reading and we see robust task effects of exogenous attention. We found no evidence for a deficit in utilizing exogenous spatial pre-cues in children with dyslexia. However, children with dyslexia showed reduced recognition ability for all letter positions. Children with dyslexia were just as likely to make letter transposition errors as typical readers.
Collapse
Affiliation(s)
- Mahalakshmi Ramamurthy
- School of Medicine, Division of Developmental-Behavioral Pediatrics, & Graduate School of Education, Stanford University, Stanford, California, USA
| | - Alex L White
- Department of Neuroscience & Behavior, Barnard College, New York, New York, USA
| | - Jason D Yeatman
- School of Medicine, Division of Developmental-Behavioral Pediatrics, & Graduate School of Education, Stanford University, Stanford, California, USA
| |
Collapse
|
3
|
Peylo C, Romberg-Taylor C, Behnke L, Sauseng P. Dynamic alpha power modulations and slow negative potentials track natural shifts of spatio-temporal attention. Psychophysiology 2024; 61:e14498. [PMID: 38071405 DOI: 10.1111/psyp.14498] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/12/2023] [Revised: 10/17/2023] [Accepted: 11/16/2023] [Indexed: 04/17/2024]
Abstract
Alpha power modulations and slow negative potentials have previously been associated with anticipatory processes in spatial and temporal top-down attention. In typical experimental designs, however, neural responses triggered by transient stimulus onsets can interfere with attention-driven activity patterns and our interpretation of such. Here, we investigated these signatures of spatio-temporal attention in a dynamic paradigm free from potentially confounding stimulus-driven activity using electroencephalography. Participants attended the cued side of a bilateral stimulus rotation and mentally counted how often one of two remembered sample orientations (i.e., the target) was displayed while ignoring the uncued side and non-target orientation. Afterwards, participants performed a delayed match-to-sample task, in which they indicated if the orientation of a probe stimulus matched the corresponding sample orientation (previously target or non-target). We observed dynamic alpha power reductions and slow negative waves around task-relevant points in space and time (i.e., onset of the target orientation in the cued hemifield) over posterior electrodes contralateral to the locus of attention. In contrast to static alpha power lateralization, these dynamic signatures correlated with subsequent memory performance (primarily detriments for matching probes of the non-target orientation), suggesting a preferential allocation of attention to task-relevant locations and time points at the expense of reduced resources and impaired performance for information outside the current focus of attention. Our findings suggest that humans can naturally and dynamically focus their attention at relevant points in space and time and that such spatio-temporal attention shifts can be reflected by dynamic alpha power modulations and slow negative potentials.
Collapse
Affiliation(s)
- Charline Peylo
- Department of Psychology, Universität Zürich, Zurich, Switzerland
- Graduate School of Systemic Neurosciences, Ludwig-Maximilians-Universität München, Planegg, Germany
- Department of Psychology, Ludwig-Maximilians-Universität München, Munich, Germany
| | | | - Larissa Behnke
- Department of Psychology, Universität Zürich, Zurich, Switzerland
- Graduate School of Systemic Neurosciences, Ludwig-Maximilians-Universität München, Planegg, Germany
- Department of Psychology, Ludwig-Maximilians-Universität München, Munich, Germany
| | - Paul Sauseng
- Department of Psychology, Universität Zürich, Zurich, Switzerland
- Department of Psychology, Ludwig-Maximilians-Universität München, Munich, Germany
| |
Collapse
|
4
|
Halicka M, Cousins OR, Ten Brink AF, Vittersø AD, Proulx MJ, Bultitude JH. Reduced Visuo spatial Attention in Personal Space is Not Limited to the Affected Limb in Complex Regional Pain Syndrome. J Pain Res 2024; 17:1519-1529. [PMID: 38686102 PMCID: PMC11056436 DOI: 10.2147/jpr.s437366] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/27/2023] [Accepted: 11/27/2023] [Indexed: 05/02/2024] Open
Abstract
Purpose Alterations in spatial attention have been reported in people with chronic pain and may be relevant to understanding its cortical mechanisms and developing novel treatments. There is conflicting evidence as to whether people with Complex Regional Pain Syndrome (CRPS) have reduced visuospatial attention to their affected limb and/or its surrounding space, with some evidence that these deficits may be greater in personal (bodily) space. We aimed to test the competing hypotheses of whether the visuospatial attentional bias is specific to the personal space of the affected limb or generalizes to the personal space of other parts of the affected side of the body. Patients and Methods Using visual Temporal Order Judgement tasks, we measured spatial attention in the personal space of the hands and feet of patients with upper (n=14) or lower (n=14) limb CRPS and pain-free controls (n=17). Participants judged the order of two light flashes presented at different temporal offsets on each of their hands or feet. Slower processing of the flash on one side relative to the other reflects reduced attention to that side of space. Results Controls prioritized stimuli on the non-dominant (left) relative to dominant side, consistent with the well-documented normal leftward bias of attention (ie "pseudoneglect"). Regardless of the location (upper or lower limb) of the pain or visual stimuli, people with CRPS showed no such asymmetry, representing reduced attention to the affected side (compared to the greater attention of controls to their non-dominant side). More severe CRPS symptoms were associated with a greater tendency to deprioritize stimuli on the affected side. Conclusion Our findings suggest that relative visuospatial bias in CRPS is generalized to the personal space of the affected side of the body, rather than being specific to the personal space of the CRPS-affected limb.
Collapse
Affiliation(s)
- Monika Halicka
- Institute of Neuroscience, Universite catholique de Louvain, Brussels, Belgium
- Centre for Pain Research, University of Bath, Bath, UK
- Department of Psychology, University of Bath, Bath, UK
| | | | - Antonia F Ten Brink
- Centre for Pain Research, University of Bath, Bath, UK
- Department of Psychology, University of Bath, Bath, UK
- Department of Experimental Psychology, Helmholtz Institute, Utrecht University, Utrecht, the Netherlands
| | - Axel D Vittersø
- Centre for Pain Research, University of Bath, Bath, UK
- Department of Psychology, University of Bath, Bath, UK
- Division of Mental Health Services, Akershus University Hospital, Lørenskog, Norway
| | | | - Janet H Bultitude
- Centre for Pain Research, University of Bath, Bath, UK
- Department of Psychology, University of Bath, Bath, UK
| |
Collapse
|
5
|
Kirsch W, Kunde W. An attentional approach to geometrical illusions. Front Psychol 2024; 15:1360160. [PMID: 38686092 PMCID: PMC11056548 DOI: 10.3389/fpsyg.2024.1360160] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/22/2023] [Accepted: 04/01/2024] [Indexed: 05/02/2024] Open
Abstract
It is known for a long time that some drawings composed of points, lines, and areas are systematically misperceived. The origin of these geometrical illusions is still unknown. Here we outline how a recent progress in attentional research contributes to a better understanding of such perceptual distortions. The basic idea behind this approach is that crucial elements of a drawing are differently attended. These changes in the allocation of spatial attention go along with systematic changes in low-level spatial coding. As a result, changes in the perception of spatial extent, angles, positions, and shapes can arise. How this approach can be applied to individual illusions is discussed.
Collapse
Affiliation(s)
- Wladimir Kirsch
- Department of Psychology, University of Würzburg, Würzburg, Germany
| | | |
Collapse
|
6
|
Qin Y, Li B, Wang W, Shi X, Peng C, Lu Y. Classification Algorithm for fNIRS-based Brain Signals Using Convolutional Neural Network with Spatiotemporal Feature Extraction Mechanism. Neuroscience 2024; 542:59-68. [PMID: 38369007 DOI: 10.1016/j.neuroscience.2024.02.011] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/04/2023] [Revised: 01/17/2024] [Accepted: 02/14/2024] [Indexed: 02/20/2024]
Abstract
Brain Computer Interface (BCI) is a highly promising human-computer interaction method that can utilize brain signals to control external devices. BCI based on functional near-infrared spectroscopy (fNIRS) is considered a relatively new and promising paradigm. fNIRS is a technique of measuring functional changes in cerebral hemodynamics. It detects changes in the hemodynamic activity of the cerebral cortex by measuring oxyhemoglobin and deoxyhemoglobin (HbR) concentrations and inversely predicts the neural activity of the brain. At the present time, Deep learning (DL) methods have not been widely used in fNIRS decoding, and there are fewer studies considering both spatial and temporal dimensions for fNIRS classification. To solve these problems, we proposed an end-to-end hybrid neural network for feature extraction of fNIRS. The method utilizes a spatial-temporal convolutional layer for automatic extraction of temporally valid information and uses a spatial attention mechanism to extract spatially localized information. A temporal convolutional network (TCN) is used to further utilize the temporal information of fNIRS before the fully connected layer. We validated our approach on a publicly available dataset including 29 subjects, including left-hand and right-hand motor imagery (MI), mental arithmetic (MA), and a baseline task. The results show that the method has few training parameters and high accuracy, providing a meaningful reference for BCI development.
Collapse
Affiliation(s)
- Yuxin Qin
- The School of Electrical Engineering, Shanghai DianJi University, Shanghai, China; Intelligent Decision and Control Technology Institute, Shanghai Dianji University, Shanghai, China
| | - Baojiang Li
- The School of Electrical Engineering, Shanghai DianJi University, Shanghai, China; Intelligent Decision and Control Technology Institute, Shanghai Dianji University, Shanghai, China
| | - Wenlong Wang
- The School of Electrical Engineering, Shanghai DianJi University, Shanghai, China; Intelligent Decision and Control Technology Institute, Shanghai Dianji University, Shanghai, China
| | - Xingbin Shi
- The School of Electrical Engineering, Shanghai DianJi University, Shanghai, China; Intelligent Decision and Control Technology Institute, Shanghai Dianji University, Shanghai, China
| | - Cheng Peng
- The School of Electrical Engineering, Shanghai DianJi University, Shanghai, China; Intelligent Decision and Control Technology Institute, Shanghai Dianji University, Shanghai, China
| | - Yifan Lu
- The School of Electrical Engineering, Shanghai DianJi University, Shanghai, China; Intelligent Decision and Control Technology Institute, Shanghai Dianji University, Shanghai, China
| |
Collapse
|
7
|
Ning M, Duwadi S, Yücel MA, von Lühmann A, Boas DA, Sen K. fNIRS dataset during complex scene analysis. Front Hum Neurosci 2024; 18:1329086. [PMID: 38576451 PMCID: PMC10991699 DOI: 10.3389/fnhum.2024.1329086] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/27/2023] [Accepted: 03/06/2024] [Indexed: 04/06/2024] Open
Affiliation(s)
- Matthew Ning
- Department of Biomedical Engineering, Neurophotonics Center, Boston University, Boston, MA, United States
| | - Sudan Duwadi
- Department of Biomedical Engineering, Neurophotonics Center, Boston University, Boston, MA, United States
| | - Meryem A. Yücel
- Department of Biomedical Engineering, Neurophotonics Center, Boston University, Boston, MA, United States
| | - Alexander von Lühmann
- Department of Biomedical Engineering, Neurophotonics Center, Boston University, Boston, MA, United States
- BIFOLD – Berlin Institute for the Foundations of Learning and Data, Berlin, Germany
- Intelligent Biomedical Sensing (IBS) Lab, Technical University Berlin, Berlin, Germany
| | - David A. Boas
- Department of Biomedical Engineering, Neurophotonics Center, Boston University, Boston, MA, United States
| | - Kamal Sen
- Department of Biomedical Engineering, Neurophotonics Center, Boston University, Boston, MA, United States
| |
Collapse
|
8
|
Wang Y, Shi T, Gao F, Tian S, Yu L. Celiac disease diagnosis from endoscopic images based on multi-scale adaptive hybrid architecture model. Phys Med Biol 2024; 69:075014. [PMID: 38306971 DOI: 10.1088/1361-6560/ad25c1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/31/2023] [Accepted: 02/02/2024] [Indexed: 02/04/2024]
Abstract
Objective. Celiac disease (CD) has emerged as a significant global public health concern, exhibiting an estimated worldwide prevalence of approximately 1%. However, existing research pertaining to domestic occurrences of CD is confined mainly to case reports and limited case analyses. Furthermore, there is a substantial population of undiagnosed patients in the Xinjiang region. This study endeavors to create a novel, high-performance, lightweight deep learning model utilizing endoscopic images from CD patients in Xinjiang as a dataset, with the intention of enhancing the accuracy of CD diagnosis.Approach. In this study, we propose a novel CNN-Transformer hybrid architecture for deep learning, tailored to the diagnosis of CD using endoscopic images. Within this architecture, a multi-scale spatial adaptive selective kernel convolution feature attention module demonstrates remarkable efficacy in diagnosing CD. Within this module, we dynamically capture salient features within the local channel feature map that correspond to distinct manifestations of endoscopic image lesions in the CD-affected areas such as the duodenal bulb, duodenal descending segment, and terminal ileum. This process serves to extract and fortify the spatial information specific to different lesions. This strategic approach facilitates not only the extraction of diverse lesion characteristics but also the attentive consideration of their spatial distribution. Additionally, we integrate the global representation of the feature map obtained from the Transformer with the locally extracted information via convolutional layers. This integration achieves a harmonious synergy that optimizes the diagnostic prowess of the model.Main results. Overall, the accuracy, specificity, F1-Score, and precision in the experimental results were 98.38%, 99.04%, 98.66% and 99.38%, respectively.Significance. This study introduces a deep learning network equipped with both global feature response and local feature extraction capabilities. This innovative architecture holds significant promise for the accurate diagnosis of CD by leveraging endoscopic images captured from diverse anatomical sites.
Collapse
Affiliation(s)
- Yilei Wang
- College of Software, Xinjiang University, Urumqi, Xinjiang, People's Republic of China
- Key Laboratory of Software Engineering Technology, College of Software, Xin Jiang University, Urumqi, People's Republic of China
| | - Tian Shi
- Department of Gastroenterologys, People's Hospital of Xinjiang Uyghur Autonomous Region, Urumqi, Xinjiang Uyghur Autonomous Region, People's Republic of China
- Xinjiang Clinical Research Center for Digestive Diseases, Urumqi, People's Republic of China
| | - Feng Gao
- Department of Gastroenterologys, People's Hospital of Xinjiang Uyghur Autonomous Region, Urumqi, Xinjiang Uyghur Autonomous Region, People's Republic of China
- Xinjiang Clinical Research Center for Digestive Diseases, Urumqi, People's Republic of China
| | - Shengwei Tian
- College of Software, Xinjiang University, Urumqi, Xinjiang, People's Republic of China
- Key Laboratory of Software Engineering Technology, College of Software, Xin Jiang University, Urumqi, People's Republic of China
| | - Long Yu
- College of Network Center, Xinjiang University, Urumqi, People's Republic of China
- Signal and Signal Processing Laboratory, College of Information Science and Engineering, Xinjiang University, Urumqi, People's Republic of China
| |
Collapse
|
9
|
Tünçok E, Carrasco M, Winawer J. Spatial attention alters visual cortical representation during target anticipation. bioRxiv 2024:2024.03.02.583127. [PMID: 38496524 PMCID: PMC10942396 DOI: 10.1101/2024.03.02.583127] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 03/19/2024]
Abstract
Attention enables us to efficiently and flexibly interact with the environment by prioritizing some image features, such as location or orientation, even before stimulus onset. We investigated how covert spatial attention affects responses in human visual cortex prior to target onset and how it affects behavioral performance after target onset, using a concurrent psychophysics-fMRI experiment. Performance improved at cued locations and worsened at uncued locations, relative to distributed attention. BOLD responses in cortical visual field maps changed in two ways: First, there was a stimulus-independent baseline shift, positive in map locations near the cued location and negative elsewhere. Second, population receptive field centers shifted toward the attended location. Both effects increased in higher visual areas. Together, the results show that spatial attention has large effects on visual cortex prior to target appearance, altering neural response properties across the entirety of multiple visual field maps.
Collapse
Affiliation(s)
- Ekin Tünçok
- Department of Psychology, New York University, New York, NY, 10003, USA
| | - Marisa Carrasco
- Department of Psychology, New York University, New York, NY, 10003, USA
- Center for Neural Science, New York University, New York, NY, 10003, USA
| | - Jonathan Winawer
- Department of Psychology, New York University, New York, NY, 10003, USA
- Center for Neural Science, New York University, New York, NY, 10003, USA
| |
Collapse
|
10
|
Wentura D, Messeh L, Wirth BE. Attentional bias towards happy faces in the dot-probe paradigm: it depends on which task is used. Cogn Emot 2024; 38:217-231. [PMID: 37987765 DOI: 10.1080/02699931.2023.2283014] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/20/2023] [Accepted: 10/29/2023] [Indexed: 11/22/2023]
Abstract
Two recent articles [Gronchi et al., 2018. Automatic and controlled attentional orienting in the elderly: A dual-process view of the positivity effect. Acta Psychologica, 185, 229-234; Wirth & Wentura, 2020. It occurs after all: Attentional bias towards happy faces in the dot-probe task. Attention, Perception, & Psychophysics, 82(5), 2463-2481] report attentional biases for happy facial expressions in the dot-probe paradigm, albeit in different directions. While Wirth and Wentura report a bias towards happy expressions, Gronchi et al. found a reversed effect. A striking difference between the studies was the task performed by the participants. While in Wirth and Wentura, participants performed a discrimination task, they performed a location task in Gronchi et al. In Experiment 1, we directly compared the two versions of the dot-probe paradigm. With the discrimination task, the bias towards happy faces was replicated. However, the location task yielded a null effect. In Experiment 2, we found a cueing effect with an abrupt onset cue in both tasks. However, for the location task a congruence-sequence effect (a typical characteristic of response-priming processes) occurred. This result suggests that in the location task, attentional processes are confounded with response-priming processes. We recommend to generally use discrimination tasks.
Collapse
|
11
|
Masson N, Dormal V, Stephany M, Schiltz C. Eye movements reveal that young school children shift attention when solving additions and subtractions. Dev Sci 2024; 27:e13452. [PMID: 37800410 DOI: 10.1111/desc.13452] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/21/2022] [Revised: 08/29/2023] [Accepted: 09/19/2023] [Indexed: 10/07/2023]
Abstract
Adults shift their attention to the right or to the left along a spatial continuum when solving additions and subtractions, respectively. Studies suggest that these shifts not only support the exact computation of the results but also anticipatively narrow down the range of plausible answers when processing the operands. However, little is known on when and how these attentional shifts arise in childhood during the acquisition of arithmetic. Here, an eye-tracker with high spatio-temporal resolution was used to measure spontaneous eye movements, used as a proxy for attentional shifts, while children of 2nd (8 y-o; N = 50) and 4th (10 y-o; N = 48) Grade solved simple additions (e.g., 4+3) and subtractions (e.g., 3-2). Gaze patterns revealed horizontal and vertical attentional shifts in both groups. Critically, horizontal eye movements were observed in 4th Graders as soon as the first operand and the operator were presented and thus before the beginning of the exact computation. In 2nd Graders, attentional shifts were only observed after the presentation of the second operand just before the response was made. This demonstrates that spatial attention is recruited when children solve arithmetic problems, even in the early stages of learning mathematics. The time course of these attentional shifts suggests that with practice in arithmetic children start to use spatial attention to anticipatively guide the search for the answer and facilitate the implementation of solving procedures. RESEARCH HIGHLIGHTS: Additions and subtractions are associated to right and left attentional shifts in adults, but it is unknown when these mechanisms arise in childhood. Children of 8-10 years old solved single-digit additions and subtractions while looking at a blank screen. Eye movements showed that children of 8 years old already show spatial biases possibly to represent the response when knowing both operands. Children of 10 years old shift attention before knowing the second operand to anticipatively guide the search for plausible answers.
Collapse
Affiliation(s)
- Nicolas Masson
- Faculty of Humanities, Education and Social Sciences (FHSE), Department, of Behavioural and Cognitive Sciences (DBCS), Institute of Cognitive Science and Assessment (COSA), University of Luxembourg, Esch-sur-Alzette, Luxembourg
- Psychological Sciences Research Institute, Université catholique de Louvain, Louvain-la-Neuve, Belgium
| | - Valérie Dormal
- Psychological Sciences Research Institute, Université catholique de Louvain, Louvain-la-Neuve, Belgium
| | - Martine Stephany
- Faculty of Humanities, Education and Social Sciences (FHSE), Department, of Behavioural and Cognitive Sciences (DBCS), Institute of Cognitive Science and Assessment (COSA), University of Luxembourg, Esch-sur-Alzette, Luxembourg
| | - Christine Schiltz
- Faculty of Humanities, Education and Social Sciences (FHSE), Department, of Behavioural and Cognitive Sciences (DBCS), Institute of Cognitive Science and Assessment (COSA), University of Luxembourg, Esch-sur-Alzette, Luxembourg
| |
Collapse
|
12
|
Davost T, Rouland JF, Blanckaert E, Warniez A, Boucart M. Spatial attention and central crowding in primary open angle glaucoma. Clin Exp Optom 2024; 107:219-226. [PMID: 36862980 DOI: 10.1080/08164622.2023.2182185] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/16/2022] [Revised: 02/13/2023] [Accepted: 02/14/2023] [Indexed: 03/04/2023] Open
Abstract
CLINICAL RELEVANCE Measuring the impact of spatial attention on signal detection in damaged parts of the visual field can be a useful tool for eye care practitioners. BACKGROUND Studies on letter perception have shown that glaucoma exacerbates difficulties to detect a target within flankers (crowding) in parafoveal vision. A target can be missed because it is not seen or because attention was not focused at that location. This prospective study evaluates the contribution of spatial pre-cueing on target detection. METHOD Fifteen patients and 15 age-matched controls were presented with letters displayed for 200 ms. Participants were asked to identify the orientation of the target letter T in two conditions: an isolated letter (uncrowded condition) and a letter with two flankers (crowded condition). The spacing between target and flankers was manipulated. The stimuli were randomly displayed at the fovea and at the parafovea at 5° left or right of fixation. A spatial cue preceded the stimuli in 50% of the trials. When present, the cue always signalled the correct location of the target. RESULTS Pre-cueing the spatial location of the target significantly improved performance for both foveal and parafoveal presentations in patients but not in controls who were at ceiling level. Unlike controls, patients exhibited an effect of crowding at the fovea with a higher accuracy for the isolated target than for the target flanked by two letters with no spacing between the elements. CONCLUSION Higher susceptibility to central crowding supports data showing abnormal foveal vision in glaucoma. Exogenous orienting of attention facilitates perception in parts of the visual field with reduced sensitivity.
Collapse
Affiliation(s)
- Theophile Davost
- Department of Ophthalmology, Lille University Hospital, Hôpital Huriez, Lille, France
| | - Jean François Rouland
- Department of Ophthalmology, Lille University Hospital, Hôpital Huriez, Lille, France
- Lille Neurosciences and Cognition, University of Lille, Lille, France
| | - Edouard Blanckaert
- Department of Ophthalmology, Lille University Hospital, Hôpital Huriez, Lille, France
| | - Aude Warniez
- Lille Neurosciences and Cognition, University of Lille, Lille, France
| | - Muriel Boucart
- Lille Neurosciences and Cognition, University of Lille, Lille, France
| |
Collapse
|
13
|
Liu S, Yin C, Zhang H. CESA-MCFormer: An Efficient Transformer Network for Hyperspectral Image Classification by Eliminating Redundant Information. Sensors (Basel) 2024; 24:1187. [PMID: 38400345 PMCID: PMC10891997 DOI: 10.3390/s24041187] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/03/2023] [Revised: 02/05/2024] [Accepted: 02/07/2024] [Indexed: 02/25/2024]
Abstract
Hyperspectral image (HSI) classification is a highly challenging task, particularly in fields like crop yield prediction and agricultural infrastructure detection. These applications often involve complex image types, such as soil, vegetation, water bodies, and urban structures, encompassing a variety of surface features. In HSI, the strong correlation between adjacent bands leads to redundancy in spectral information, while using image patches as the basic unit of classification causes redundancy in spatial information. To more effectively extract key information from this massive redundancy for classification, we innovatively proposed the CESA-MCFormer model, building upon the transformer architecture with the introduction of the Center Enhanced Spatial Attention (CESA) module and Morphological Convolution (MC). The CESA module combines hard coding and soft coding to provide the model with prior spatial information before the mixing of spatial features, introducing comprehensive spatial information. MC employs a series of learnable pooling operations, not only extracting key details in both spatial and spectral dimensions but also effectively merging this information. By integrating the CESA module and MC, the CESA-MCFormer model employs a "Selection-Extraction" feature processing strategy, enabling it to achieve precise classification with minimal samples, without relying on dimension reduction techniques such as PCA. To thoroughly evaluate our method, we conducted extensive experiments on the IP, UP, and Chikusei datasets, comparing our method with the latest advanced approaches. The experimental results demonstrate that the CESA-MCFormer achieved outstanding performance on all three test datasets, with Kappa coefficients of 96.38%, 98.24%, and 99.53%, respectively.
Collapse
Affiliation(s)
| | - Changqing Yin
- School of Software, Tongji University, Shanghai 201800, China; (S.L.); (H.Z.)
| | | |
Collapse
|
14
|
Yu Z, Xie K, Wen C, He J, Zhang W. A Lightweight Image Super-Resolution Reconstruction Algorithm Based on the Residual Feature Distillation Mechanism. Sensors (Basel) 2024; 24:1049. [PMID: 38400207 PMCID: PMC10892053 DOI: 10.3390/s24041049] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/16/2024] [Revised: 01/29/2024] [Accepted: 02/04/2024] [Indexed: 02/25/2024]
Abstract
In recent years, the development of image super-resolution (SR) has explored the capabilities of convolutional neural networks (CNNs). The current research tends to use deeper CNNs to improve performance. However, blindly increasing the depth of the network does not effectively enhance its performance. Moreover, as the network depth increases, more issues arise during the training process, requiring additional training techniques. In this paper, we propose a lightweight image super-resolution reconstruction algorithm (SISR-RFDM) based on the residual feature distillation mechanism (RFDM). Building upon residual blocks, we introduce spatial attention (SA) modules to provide more informative cues for recovering high-frequency details such as image edges and textures. Additionally, the output of each residual block is utilized as hierarchical features for global feature fusion (GFF), enhancing inter-layer information flow and feature reuse. Finally, all these features are fed into the reconstruction module to restore high-quality images. Experimental results demonstrate that our proposed algorithm outperforms other comparative algorithms in terms of both subjective visual effects and objective evaluation quality. The peak signal-to-noise ratio (PSNR) is improved by 0.23 dB, and the structural similarity index (SSIM) reaches 0.9607.
Collapse
Affiliation(s)
- Zihan Yu
- School of Electronic Information and Electrical Engineering, Yangtze University, Jingzhou 434023, China;
| | - Kai Xie
- School of Electronic Information and Electrical Engineering, Yangtze University, Jingzhou 434023, China;
| | - Chang Wen
- School of Computer Science, Yangtze University, Jingzhou 434023, China;
| | - Jianbiao He
- School of Computer Science, Central South University, Changsha 410083, China;
| | - Wei Zhang
- School of Electronic Information, Central South University, Changsha 410083, China;
| |
Collapse
|
15
|
Wu Y, Gao M, Wang X, Tang X. Spatial attention modulates multisensory integration: The dissociation between exogenous and endogenous orienting. Q J Exp Psychol (Hove) 2024; 77:418-432. [PMID: 37092806 DOI: 10.1177/17470218231173925] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 04/25/2023]
Abstract
Previous studies have separately found that exogenous orienting decreases multisensory integration (MSI), while endogenous orienting enhances MSI. It is currently unclear, however, why the two orientations have opposite effects on MSI. In the current study, we investigated the interaction between spatial attention and MSI in two experiments based on the cue-target paradigm. Experiment 1 separated exogenous and endogenous orienting to investigate the effect of spatial attention on MSI by varying the predictability of the cue. Experiment 2 further explored the effect of endogenous orienting on MSI. We found that exogenous orienting induced by the directionality of the cue decreased MSI, while endogenous orienting induced by the predictability of the cue enhanced MSI. The role of spatial orienting need and spatial attention bias in the modulation of MSI by exogenous and endogenous orienting was discussed. The present study sheds new light on how spatial attention modulates MSI processes.
Collapse
Affiliation(s)
- Yingnan Wu
- School of Psychology, Liaoning Collaborative Innovation Center of Children and Adolescents Healthy Personality Assessment and Cultivation, Liaoning Normal University, Dalian, China
| | - Min Gao
- School of Psychology, Liaoning Collaborative Innovation Center of Children and Adolescents Healthy Personality Assessment and Cultivation, Liaoning Normal University, Dalian, China
| | - Xueli Wang
- School of Psychology, Liaoning Collaborative Innovation Center of Children and Adolescents Healthy Personality Assessment and Cultivation, Liaoning Normal University, Dalian, China
| | - Xiaoyu Tang
- School of Psychology, Liaoning Collaborative Innovation Center of Children and Adolescents Healthy Personality Assessment and Cultivation, Liaoning Normal University, Dalian, China
- School of Foreign Languages, Ningbo University of Technology, Ningbo, China
| |
Collapse
|
16
|
Moratti S, Gundlach C, de Echegaray J, Müller MM. Distinct patterns of spatial attentional modulation of steady-state visual evoked magnetic fields (SSVEFs) in subdivisions of the human early visual cortex. Psychophysiology 2024; 61:e14452. [PMID: 37787386 DOI: 10.1111/psyp.14452] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/12/2023] [Revised: 08/23/2023] [Accepted: 09/15/2023] [Indexed: 10/04/2023]
Abstract
In recent years, steady-state visual evoked potentials (SSVEPs) became an increasingly valuable tool to investigate neural dynamics of competitive attentional interactions and brain-computer interfaces. This is due to their good signal-to-noise ratio, allowing for single-trial analysis, and their ongoing oscillating nature that enables to analyze temporal dynamics of facilitation and suppression. Given the popularity of SSVEPs, it is surprising that only a few studies looked at the cortical sources of these responses. This is in particular the case when searching for studies that assessed the cortical sources of attentional SSVEP amplitude modulations. To address this issue, we used a typical spatial attention task and recorded neuromagnetic fields (MEG) while presenting frequency-tagged stimuli in the left and right visual fields, respectively. Importantly, we controlled for attentional deployment in a baseline period before the shifting cue. Subjects either attended to a central fixation cross or to two peripheral stimuli simultaneously. Results clearly showed that signal sources and attention effects were restricted to the early visual cortex: V1, V2, hMT+, precuneus, occipital-parietal, and inferior-temporal cortex. When subjects attended to central fixation first, shifting attention to one of the peripheral stimuli resulted in a significant activation increase for the to-be-attended stimulus with no activation decrease for the to-be-ignored stimulus in hMT+ and inferio-temporal cortex, but significant SSVEF decreases from V1 to occipito-parietal cortex. When attention was first deployed to both rings, shifting attention away from one ring basically resulted in a significant activation decrease in all areas for the then-to-be-ignored stimulus.
Collapse
Affiliation(s)
- Stephan Moratti
- Department of Experimental Psychology, Complutense University of Madrid, Madrid, Spain
- Center for Cognitive and Computational Neuroscience, Complutense University of Madrid, Madrid, Spain
| | | | - Javier de Echegaray
- Wilhelm Wundt Institute for Psychology, University of Leipzig, Leipzig, Germany
| | - Matthias M Müller
- Wilhelm Wundt Institute for Psychology, University of Leipzig, Leipzig, Germany
| |
Collapse
|
17
|
Chapman AF, Störmer VS. Representational structures as a unifying framework for attention. Trends Cogn Sci 2024:S1364-6613(24)00002-0. [PMID: 38280837 DOI: 10.1016/j.tics.2024.01.002] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/13/2023] [Revised: 01/04/2024] [Accepted: 01/05/2024] [Indexed: 01/29/2024]
Abstract
Our visual system consciously processes only a subset of the incoming information. Selective attention allows us to prioritize relevant inputs, and can be allocated to features, locations, and objects. Recent advances in feature-based attention suggest that several selection principles are shared across these domains and that many differences between the effects of attention on perceptual processing can be explained by differences in the underlying representational structures. Moving forward, it can thus be useful to assess how attention changes the structure of the representational spaces over which it operates, which include the spatial organization, feature maps, and object-based coding in visual cortex. This will ultimately add to our understanding of how attention changes the flow of visual information processing more broadly.
Collapse
Affiliation(s)
- Angus F Chapman
- Department of Psychological and Brain Sciences, Boston University, Boston, MA, USA.
| | - Viola S Störmer
- Department of Psychological and Brain Sciences, Dartmouth College, Hanover, NH, USA.
| |
Collapse
|
18
|
Ning M, Duwadi S, Yücel MA, Von Lühmann A, Boas DA, Sen K. fNIRS Dataset During Complex Scene Analysis. bioRxiv 2024:2024.01.23.576715. [PMID: 38328139 PMCID: PMC10849700 DOI: 10.1101/2024.01.23.576715] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/09/2024]
Abstract
When analyzing complex scenes, humans often focus their attention on an object at a particular spatial location. The ability to decode the attended spatial location would facilitate brain computer interfaces for complex scene analysis (CSA). Here, we investigated capability of functional near-infrared spectroscopy (fNIRS) to decode audio-visual spatial attention in the presence of competing stimuli from multiple locations. We targeted dorsal frontoparietal network including frontal eye field (FEF) and intra-parietal sulcus (IPS) as well as superior temporal gyrus/planum temporal (STG/PT). They all were shown in previous functional magnetic resonance imaging (fMRI) studies to be activated by auditory, visual, or audio-visual spatial tasks. To date, fNIRS has not been applied to decode auditory and visual-spatial attention during CSA, and thus, no such dataset exists yet. This report provides an open-access fNIRS dataset that can be used to develop, test, and compare machine learning algorithms for classifying attended locations based on the fNIRS signals on a single trial basis.
Collapse
Affiliation(s)
- Matthew Ning
- Berenson-Allen Center for Noninvasive Brain Stimulation, Beth Israel Deaconess Medical Center, Boston, MA, USA
| | - Sudan Duwadi
- Neurophotonics Center, Department of Biomedical Engineering, Boston University
| | - Meryem A. Yücel
- Neurophotonics Center, Department of Biomedical Engineering, Boston University
| | - Alexander Von Lühmann
- Neurophotonics Center, Department of Biomedical Engineering, Boston University
- BIFOLD – Berlin Institute for the Foundations of Learning and Data, 10587 Berlin, Germany
- Intelligent Biomedical Sensing (IBS) Lab, Technische Universität Berlin, 10587 Berlin, Germany
| | - David A. Boas
- Neurophotonics Center, Department of Biomedical Engineering, Boston University
| | - Kamal Sen
- Neurophotonics Center, Department of Biomedical Engineering, Boston University
| |
Collapse
|
19
|
Huillcen Baca HA, Palomino Valdivia FDL, Gutierrez Caceres JC. Efficient Human Violence Recognition for Surveillance in Real Time. Sensors (Basel) 2024; 24:668. [PMID: 38276360 PMCID: PMC10818792 DOI: 10.3390/s24020668] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/01/2023] [Revised: 01/10/2024] [Accepted: 01/17/2024] [Indexed: 01/27/2024]
Abstract
Human violence recognition is an area of great interest in the scientific community due to its broad spectrum of applications, especially in video surveillance systems, because detecting violence in real time can prevent criminal acts and save lives. The majority of existing proposals and studies focus on result precision, neglecting efficiency and practical implementations. Thus, in this work, we propose a model that is effective and efficient in recognizing human violence in real time. The proposed model consists of three modules: the Spatial Motion Extractor (SME) module, which extracts regions of interest from a frame; the Short Temporal Extractor (STE) module, which extracts temporal characteristics of rapid movements; and the Global Temporal Extractor (GTE) module, which is responsible for identifying long-lasting temporal features and fine-tuning the model. The proposal was evaluated for its efficiency, effectiveness, and ability to operate in real time. The results obtained on the Hockey, Movies, and RWF-2000 datasets demonstrated that this approach is highly efficient compared to various alternatives. In addition, the VioPeru dataset was created, which contains violent and non-violent videos captured by real video surveillance cameras in Peru, to validate the real-time applicability of the model. When tested on this dataset, the effectiveness of our model was superior to the best existing models.
Collapse
Affiliation(s)
- Herwin Alayn Huillcen Baca
- Academic Department of Engineering and Information Technology, Professional School of Systems Engineering, Faculty of Engineering, Jose Maria Arguedas National University, Andahuaylas 03701, Peru;
| | - Flor de Luz Palomino Valdivia
- Academic Department of Engineering and Information Technology, Professional School of Systems Engineering, Faculty of Engineering, Jose Maria Arguedas National University, Andahuaylas 03701, Peru;
| | - Juan Carlos Gutierrez Caceres
- Academic Department of Systems and Informatics Engineering, Professional School of Computer Science, Faculty of Production and Services Engineering, San Agustin of Arequipa National University, Arequipa 04001, Peru;
| |
Collapse
|
20
|
Hüer J, Saxena P, Treue S. Pathway-selective optogenetics reveals the functional anatomy of top-down attentional modulation in the macaque visual cortex. Proc Natl Acad Sci U S A 2024; 121:e2304511121. [PMID: 38194453 PMCID: PMC10801865 DOI: 10.1073/pnas.2304511121] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/18/2023] [Accepted: 10/07/2023] [Indexed: 01/11/2024] Open
Abstract
Spatial attention represents a powerful top-down influence on sensory responses in primate visual cortical areas. The frontal eye field (FEF) has emerged as a key candidate area for the source of this modulation. However, it is unclear whether the FEF exerts its effects via its direct axonal projections to visual areas or indirectly through other brain areas and whether the FEF affects both the enhancement of attended and the suppression of unattended sensory responses. We used pathway-selective optogenetics in rhesus macaques performing a spatial attention task to inhibit the direct input from the FEF to area MT, an area along the dorsal visual pathway specialized for the processing of visual motion information. Our results show that the optogenetic inhibition of the FEF input specifically reduces attentional modulation in MT by about a third without affecting the neurons' sensory response component. We find that the direct FEF-to-MT pathway contributes to both the enhanced processing of target stimuli and the suppression of distractors. The FEF, thus, selectively modulates firing rates in visual area MT, and it does so via its direct axonal projections.
Collapse
Affiliation(s)
- Janina Hüer
- Cognitive Neuroscience Laboratory, German Primate Center, Leibniz Institute for Primate Research, Göttingen37077, Germany
- Ernst Strüngmann Institute for Neuroscience in Cooperation with Max Planck Society, Frankfurt60528, Germany
| | - Pankhuri Saxena
- Cognitive Neuroscience Laboratory, German Primate Center, Leibniz Institute for Primate Research, Göttingen37077, Germany
| | - Stefan Treue
- Cognitive Neuroscience Laboratory, German Primate Center, Leibniz Institute for Primate Research, Göttingen37077, Germany
- Faculty of Biology and Psychology, University of Göttingen, Göttingen37073, Germany
- Leibniz-ScienceCampus Primate Cognition, Göttingen37077, Germany
- Bernstein Center for Computational Neuroscience, Göttingen37073, Germany
| |
Collapse
|
21
|
Das A, Nandi N, Ray S. Alpha and SSVEP power outperform gamma power in capturing attentional modulation in human EEG. Cereb Cortex 2024; 34:bhad412. [PMID: 37948668 DOI: 10.1093/cercor/bhad412] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/28/2023] [Revised: 10/18/2023] [Accepted: 10/19/2023] [Indexed: 11/12/2023] Open
Abstract
Attention typically reduces power in the alpha (8-12 Hz) band and increases power in gamma (>30 Hz) band in brain signals, as reported in macaque local field potential (LFP) and human electro/magneto-encephalogram (EEG/MEG) studies. In addition, EEG studies often use flickering stimuli that produce a specific measure called steady-state-visually-evoked-potential (SSVEP), whose power also increases with attention. However, effectiveness of these neural measures in capturing attentional modulation is unknown since stimuli and task paradigms vary widely across studies. In a recent macaque study, attentional modulation was more salient in the gamma band of the LFP, compared to alpha or SSVEP. To compare this with human EEG, we designed an orientation change detection task where we presented both static and counterphasing stimuli of matched difficulty levels to 26 subjects and compared attentional modulation of various measures under similar conditions. We report two main results. First, attentional modulation was comparable for SSVEP and alpha. Second, non-foveal stimuli produced weak gamma despite various stimulus optimizations and showed negligible attentional modulation although full-screen gratings showed robust gamma activity. Our results are useful for brain-machine-interfacing studies where suitable features are used for decoding attention, and also provide clues about spatial scales of neural mechanisms underlying attention.
Collapse
Affiliation(s)
- Aritra Das
- Centre for Neuroscience, Indian Institute of Science, Bangalore, 560012, India
| | - Nilanjana Nandi
- Centre for Neuroscience, Indian Institute of Science, Bangalore, 560012, India
| | - Supratim Ray
- Centre for Neuroscience, Indian Institute of Science, Bangalore, 560012, India
| |
Collapse
|
22
|
Bhimavarapu U, Chintalapudi N, Battineni G. Automatic Detection and Classification of Hypertensive Retinopathy with Improved Convolution Neural Network and Improved SVM. Bioengineering (Basel) 2024; 11:56. [PMID: 38247933 PMCID: PMC10813404 DOI: 10.3390/bioengineering11010056] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/08/2023] [Revised: 12/22/2023] [Accepted: 01/01/2024] [Indexed: 01/23/2024] Open
Abstract
Hypertensive retinopathy (HR) results from the microvascular retinal changes triggered by hypertension, which is the most common leading cause of preventable blindness worldwide. Therefore, it is necessary to develop an automated system for HR detection and evaluation using retinal images. We aimed to propose an automated approach to identify and categorize the various degrees of HR severity. A new network called the spatial convolution module (SCM) combines cross-channel and spatial information, and the convolution operations extract helpful features. The present model is evaluated using publicly accessible datasets ODIR, INSPIREVR, and VICAVR. We applied the augmentation to artificially increase the dataset of 1200 fundus images. The different HR severity levels of normal, mild, moderate, severe, and malignant are finally classified with the reduced time when compared to the existing models because in the proposed model, convolutional layers run only once on the input fundus images, which leads to a speedup and reduces the processing time in detecting the abnormalities in the vascular structure. According to the findings, the improved SVM had the highest detection and classification accuracy rate in the vessel classification with an accuracy of 98.99% and completed the task in 160.4 s. The ten-fold classification achieved the highest accuracy of 98.99%, i.e., 0.27 higher than the five-fold classification accuracy and the improved KNN classifier achieved an accuracy of 98.72%. When computation efficiency is a priority, the proposed model's ability to quickly recognize different HR severity levels is significant.
Collapse
Affiliation(s)
- Usharani Bhimavarapu
- Department of Computer Science and Engineering, Koneru Lakshmaiah Education Foundation, Vaddeswaram 522302, India
| | - Nalini Chintalapudi
- Clinical Research Centre, School of Medicinal and Health Products Sciences, University of Camerino, 62032 Camerino, Italy;
| | - Gopi Battineni
- Clinical Research Centre, School of Medicinal and Health Products Sciences, University of Camerino, 62032 Camerino, Italy;
| |
Collapse
|
23
|
Forenzo D, Liu Y, Kim J, Ding Y, Yoon T, He B. Integrating Simultaneous Motor Imagery and Spatial Attention for EEG-BCI Control. IEEE Trans Biomed Eng 2024; 71:282-294. [PMID: 37494151 PMCID: PMC10803074 DOI: 10.1109/tbme.2023.3298957] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 07/28/2023]
Abstract
OBJECTIVE EEG-based brain-computer interfaces (BCI) are non-invasive approaches for replacing or restoring motor functions in impaired patients, and direct brain-to-device communication in the general population. Motor imagery (MI) is one of the most used BCI paradigms, but its performance varies across individuals and certain users require substantial training to develop control. In this study, we propose to integrate a MI paradigm simultaneously with a recently proposed Overt Spatial Attention (OSA) paradigm, to accomplish BCI control. METHODS We evaluated a cohort of 25 human subjects' ability to control a virtual cursor in one- and two-dimensions over 5 BCI sessions. The subjects used 5 different BCI paradigms: MI alone, OSA alone, MI, and OSA simultaneously towards the same target (MI+OSA), and MI for one axis while OSA controls the other (MI/OSA and OSA/MI). RESULTS Our results show that MI+OSA reached the highest average online performance in 2D tasks at 49% Percent Valid Correct (PVC), and statistically outperforms both MI alone (42%) and OSA alone (45%). MI+OSA had a similar performance to each subject's best individual method between MI alone and OSA alone (50%) and 9 subjects reached their highest average BCI performance using MI+OSA. CONCLUSION Integrating MI and OSA leads to improved performance over both individual methods at the group level and is the best BCI paradigm option for some subjects. SIGNIFICANCE This work proposes a new BCI control paradigm that integrates two existing paradigms and demonstrates its value by showing that it can improve users' BCI performance.
Collapse
Affiliation(s)
- Dylan Forenzo
- Department of Biomedical Engineering at Carnegie Mellon University, Pittsburgh, PA
| | - Yixuan Liu
- Department of Biomedical Engineering at Carnegie Mellon University, Pittsburgh, PA
| | - Jeehyun Kim
- Department of Biomedical Engineering at Carnegie Mellon University, Pittsburgh, PA
| | - Yidan Ding
- Department of Biomedical Engineering at Carnegie Mellon University, Pittsburgh, PA
| | - Taehyung Yoon
- Department of Biomedical Engineering at Carnegie Mellon University, Pittsburgh, PA
| | - Bin He
- Department of Biomedical Engineering at Carnegie Mellon University, Pittsburgh, PA
| |
Collapse
|
24
|
Joe J, Kim MS. Spatial Attention in Visual Working Memory Strengthens Feature-Location Binding. Vision (Basel) 2023; 7:79. [PMID: 38133482 PMCID: PMC10748131 DOI: 10.3390/vision7040079] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/31/2023] [Revised: 12/07/2023] [Accepted: 12/16/2023] [Indexed: 12/23/2023] Open
Abstract
There is a debate about whether working memory (WM) representations are individual features or bound objects. While spatial attention is reported to play a significant role in feature binding, little is known about the role of spatial attention in WM. To address this gap, the current study required participants to maintain multiple items in their WM and employed a memory-driven attention capture paradigm. Spatial attention in WM was manipulated by presenting an exogenous cue at one of the locations that memory items had occupied. The effects of spatial attention on attention guidance in visual search (Experiment 1) and memory performance (Experiments 1 and 2) were explored. The results show that WM-driven attention guidance did not vary based on whether the search features came from the same object in WM; instead, it depended on the number of features, regardless of their source object. In memory tasks, the cued object outperformed the uncued object. Specifically, the test item was better rejected when the features were mis-bound in the cued location than in the uncued location. These findings suggest that memory-driven attention guidance is feature-based, and spatial attention in WM helps bind features into object structures based on location.
Collapse
Affiliation(s)
| | - Min-Shik Kim
- Department of Psychology, Yonsei University, Seoul 03722, Republic of Korea;
| |
Collapse
|
25
|
Di Dona G, Ronconi L. Beta oscillations in vision: a (preconscious) neural mechanism for the dorsal visual stream? Front Psychol 2023; 14:1296483. [PMID: 38155693 PMCID: PMC10753839 DOI: 10.3389/fpsyg.2023.1296483] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/18/2023] [Accepted: 11/15/2023] [Indexed: 12/30/2023] Open
Abstract
Neural oscillations in alpha (8-12 Hz) and beta (13-30 Hz) frequency bands are thought to reflect feedback/reentrant loops and large-scale cortical interactions. In the last decades a main effort has been made in linking perception with alpha-band oscillations, with converging evidence showing that alpha oscillations have a key role in the temporal and featural binding of visual input, configuring the alpha rhythm a key determinant of conscious visual experience. Less attention has been historically dedicated to link beta oscillations and visual processing. Nonetheless, increasing studies report that task conditions that require to segregate/integrate stimuli in space, to disentangle local/global shapes, to spatially reorganize visual inputs, and to achieve motion perception or form-motion integration, rely on the activity of beta oscillations, with a main hub in parietal areas. In the present review, we summarize the evidence linking oscillations within the beta band and visual perception. We propose that beta oscillations represent a neural code that supports the functionality of the magnocellular-dorsal (M-D) visual pathway, serving as a fast primary neural code to exert top-down influences on the slower parvocellular-ventral visual pathway activity. Such M-D-related beta activity is proposed to act mainly pre-consciously, providing the spatial coordinates of vision and guiding the conscious extraction of objects identity that are achieved with slower alpha rhythms in ventral areas. Finally, within this new theoretical framework, we discuss the potential role of M-D-related beta oscillations in visuo-spatial attention, oculo-motor behavior and reading (dis)abilities.
Collapse
Affiliation(s)
- Giuseppe Di Dona
- Division of Neuroscience, IRCCS San Raffaele Scientific Institute, Milan, Italy
- School of Psychology, Vita-Salute San Raffaele University, Milan, Italy
| | - Luca Ronconi
- Division of Neuroscience, IRCCS San Raffaele Scientific Institute, Milan, Italy
- School of Psychology, Vita-Salute San Raffaele University, Milan, Italy
| |
Collapse
|
26
|
Luo Y, He Y, Bao Y. Perifoveal and peripheral attentional modulation on order perception. Psych J 2023; 12:835-837. [PMID: 37905921 DOI: 10.1002/pchj.700] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/28/2023] [Accepted: 10/04/2023] [Indexed: 11/02/2023]
Abstract
The present study demonstrates that spatial attention modulates temporal order perception differently in the perifoveal and peripheral regions, with a more pronounced effect in the left peripheral visual field, suggesting a dissociation in attentional systems for event timing at the sub-second level.
Collapse
Affiliation(s)
- Yingrui Luo
- School of Psychological and Cognitive Sciences, Peking University, Beijing, China
| | - Ying He
- School of Psychological and Cognitive Sciences, Peking University, Beijing, China
- Department of Philosophy and Religious Studies, Peking University, Beijing, China
| | - Yan Bao
- School of Psychological and Cognitive Sciences, Peking University, Beijing, China
- Institute of Medical Psychology, Ludwig Maximilian University, Munich, Germany
- Beijing Key Laboratory of Behavior and Mental Health, Peking University, Beijing, China
| |
Collapse
|
27
|
Nuiten SA, de Gee JW, Zantvoord JB, Fahrenfort JJ, van Gaal S. Catecholaminergic neuromodulation and selective attention jointly shape perceptual decision-making. eLife 2023; 12:RP87022. [PMID: 38038722 PMCID: PMC10691802 DOI: 10.7554/elife.87022] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/02/2023] Open
Abstract
Perceptual decisions about sensory input are influenced by fluctuations in ongoing neural activity, most prominently driven by attention and neuromodulator systems. It is currently unknown if neuromodulator activity and attention differentially modulate perceptual decision-making and/or whether neuromodulatory systems in fact control attentional processes. To investigate the effects of two distinct neuromodulatory systems and spatial attention on perceptual decisions, we pharmacologically elevated cholinergic (through donepezil) and catecholaminergic (through atomoxetine) levels in humans performing a visuo-spatial attention task, while we measured electroencephalography (EEG). Both attention and catecholaminergic enhancement improved decision-making at the behavioral and algorithmic level, as reflected in increased perceptual sensitivity and the modulation of the drift rate parameter derived from drift diffusion modeling. Univariate analyses of EEG data time-locked to the attentional cue, the target stimulus, and the motor response further revealed that attention and catecholaminergic enhancement both modulated pre-stimulus cortical excitability, cue- and stimulus-evoked sensory activity, as well as parietal evidence accumulation signals. Interestingly, we observed both similar, unique, and interactive effects of attention and catecholaminergic neuromodulation on these behavioral, algorithmic, and neural markers of the decision-making process. Thereby, this study reveals an intricate relationship between attentional and catecholaminergic systems and advances our understanding about how these systems jointly shape various stages of perceptual decision-making.
Collapse
Affiliation(s)
- Stijn A Nuiten
- Department of Psychology, University of AmsterdamAmsterdamNetherlands
- Amsterdam Brain & Cognition, University of AmsterdamAmsterdamNetherlands
- Department of Psychiatry (UPK), University of BaselBaselSwitzerland
| | - Jan Willem de Gee
- Amsterdam Brain & Cognition, University of AmsterdamAmsterdamNetherlands
- Jan and Dan Duncan Neurological Research Institute, Texas Children’s HospitalHoustonUnited States
- Department of Neuroscience, Baylor College of MedicineHoustonUnited States
- Cognitive and Systems Neuroscience, Swammerdam Institute for Life Sciences, University of AmsterdamAmsterdamNetherlands
| | - Jasper B Zantvoord
- Department of Psychiatry, Amsterdam UMC location University of AmsterdamAmsterdamNetherlands
- Amsterdam NeuroscienceAmsterdamNetherlands
| | - Johannes J Fahrenfort
- Department of Psychology, University of AmsterdamAmsterdamNetherlands
- Amsterdam Brain & Cognition, University of AmsterdamAmsterdamNetherlands
- Institute for Brain and Behavior Amsterdam, Vrije Universiteit AmsterdamAmsterdamNetherlands
- Department of Experimental and Applied Psychology - Cognitive Psychology, Vrije Universiteit AmsterdamAmsterdamNetherlands
| | - Simon van Gaal
- Department of Psychology, University of AmsterdamAmsterdamNetherlands
- Amsterdam Brain & Cognition, University of AmsterdamAmsterdamNetherlands
| |
Collapse
|
28
|
Raposo I, Szczepanski SM, Haaland K, Endestad T, Solbakk AK, Knight RT, Helfrich RF. Periodic attention deficits after frontoparietal lesions provide causal evidence for rhythmic attentional sampling. Curr Biol 2023; 33:4893-4904.e3. [PMID: 37852264 PMCID: PMC10842514 DOI: 10.1016/j.cub.2023.09.065] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/23/2023] [Revised: 08/08/2023] [Accepted: 09/26/2023] [Indexed: 10/20/2023]
Abstract
Contemporary models conceptualize spatial attention as a blinking spotlight that sequentially samples visual space. Hence, behavior fluctuates over time, even in states of presumed "sustained" attention. Recent evidence has suggested that rhythmic neural activity in the frontoparietal network constitutes the functional basis of rhythmic attentional sampling. However, causal evidence to support this notion remains absent. Using a lateralized spatial attention task, we addressed this issue in patients with focal lesions in the frontoparietal attention network. Our results revealed that frontoparietal lesions introduce periodic attention deficits, i.e., temporally specific behavioral deficits that are aligned with the underlying neural oscillations. Attention-guided perceptual sensitivity was on par with that of healthy controls during optimal phases but was attenuated during the less excitable sub-cycles. Theta-dependent sampling (3-8 Hz) was causally dependent on the prefrontal cortex, while high-alpha/low-beta sampling (8-14 Hz) emerged from parietal areas. Collectively, our findings reveal that lesion-induced high-amplitude, low-frequency brain activity is not epiphenomenal but has immediate behavioral consequences. More generally, these results provide causal evidence for the hypothesis that the functional architecture of attention is inherently rhythmic.
Collapse
Affiliation(s)
- Isabel Raposo
- Hertie Institute for Clinical Brain Research, University Medical Center Tübingen, 72076 Tübingen, Germany; International Max Planck Research School for the Mechanisms of Mental Function and Dysfunction, University of Tübingen, Tübingen, Germany
| | - Sara M Szczepanski
- Department of Psychology and the Helen Wills Neuroscience Institute, UC Berkeley, Berkeley, CA 94720, USA
| | - Kathleen Haaland
- Department of Psychiatry and Behavioral Sciences, University of New Mexico Health Sciences, Albuquerque, NM 87102, USA
| | - Tor Endestad
- Department of Psychology, University of Oslo, 0373 Oslo, Norway; RITMO Centre for Interdisciplinary Studies in Rhythm, Time, and Motion, University of Oslo, 0371 Oslo, Norway
| | - Anne-Kristin Solbakk
- Department of Psychology, University of Oslo, 0373 Oslo, Norway; RITMO Centre for Interdisciplinary Studies in Rhythm, Time, and Motion, University of Oslo, 0371 Oslo, Norway; Department of Neurosurgery, Oslo University Hospital, 0372 Oslo, Norway; Department of Neuropsychology, Helgeland Hospital, 8656 Mosjøen, Norway
| | - Robert T Knight
- Department of Psychology and the Helen Wills Neuroscience Institute, UC Berkeley, Berkeley, CA 94720, USA
| | - Randolph F Helfrich
- Hertie Institute for Clinical Brain Research, University Medical Center Tübingen, 72076 Tübingen, Germany.
| |
Collapse
|
29
|
Hesselmann G, Knops A. No conclusive evidence for number-induced attentional shifts in a temporal order judgement task. Q J Exp Psychol (Hove) 2023; 76:2570-2578. [PMID: 36632653 DOI: 10.1177/17470218231152406] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/13/2023]
Abstract
The Spatial Numerical Association of Response Codes (SNARC) effect refers to the observation that relatively small (e.g., 1) and large numbers (e.g., 9) elicit faster left- and right-sided manual responses, respectively. In a variation known as the attentional SNARC effect, merely looking at numbers caused a left- or right-ward shift in covert spatial attention, depending on the number's magnitude. In our study, we probed the notion that numbers induce shifts of spatial attention in accordance with their position on a mental number line (MNL). Critically, we removed any putative spatial response code that may contaminate the responses. We used a square and a tilted square as targets, thereby situating the decisive response dimension in the ventral, non-spatial processing stream. In two experiments where numbers were used as non-informative cues preceding a temporal order judgement (TOJ) task, we did not observe a deflection of the locus of spatial attention as a function of the numerical magnitude of the cue. In a third experiment, finding a significant modulation of TOJ performance as a function of the pointing direction of arrow cues allowed us to rule out the possibility that the absence of any significant modulation in Experiments 1 and 2 was due to a lack of sensitivity of our task set-up. We conclude from the current findings that the spatial codes that the perception and naming of numbers potentially elicit are not in and by themselves sufficient to elicit deflections of spatial attention.
Collapse
Affiliation(s)
- Guido Hesselmann
- Department of General and Biological Psychology, Psychologische Hochschule Berlin, Berlin, Germany
| | - André Knops
- UMR CNRS 8240, Department of Psychology, Université Paris Cité, Paris, France
| |
Collapse
|
30
|
Fan X, Kolodny T, Woodard KM, Tasevac A, Ganz WR, Rea HM, Kurtz-Nelson EC, Webb SJ, Murray SO. Rhythmic attentional sampling in autism. Autism Res 2023; 16:2090-2099. [PMID: 37676241 PMCID: PMC10840939 DOI: 10.1002/aur.3021] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/27/2023] [Accepted: 08/16/2023] [Indexed: 09/08/2023]
Abstract
Individuals diagnosed with autism often display alterations in visual spatial attention toward visual stimuli, but the underlying cause of these differences remains unclear. Recent evidence has demonstrated that covert spatial attention, rather than remaining constant at a cued location, samples stimuli rhythmically at a frequency of 4-8 Hz (theta). Here we tested whether rhythmic sampling of attention is altered in autism. Participants were asked to monitor three locations to detect a brief target presented 300-1200 ms after a spatial cue. Visual attention was oriented to the cue and modified visual processing at the cued location, consistent with previous studies. We measured detection performance at different cue-target intervals when the target occurred at the cued location. Significant oscillations in detection performance were identified using both a traditional time-shuffled approach and a new autoregressive surrogate method developed by Brookshire in 2022. We found that attention enhances behavioral performance rhythmically at the same frequency in both autism and control group at the cued location. However, rhythmic temporal structure was not observed in a subgroup of autistic individuals with co-occurring attention-deficit/hyperactivity disorder (ADHD). Our results imply that intrinsic brain rhythms which organize neural activity into alternating attentional states is functional in autistic individuals, but may be altered in autistic participants who have a concurrent ADHD diagnosis.
Collapse
Affiliation(s)
- Xiaoxu Fan
- Department of Psychology, University of Washington, Seattle, Washington, USA
| | - Tamar Kolodny
- Department of Psychology, University of Washington, Seattle, Washington, USA
| | - Kristin M Woodard
- Department of Psychology, University of Washington, Seattle, Washington, USA
| | - Aydin Tasevac
- Department of Psychology, University of Washington, Seattle, Washington, USA
| | - Wesley R Ganz
- Department of Psychiatry and Behavioral Science, University of Washington, Seattle, Washington, USA
| | - Hannah M Rea
- Department of Psychiatry and Behavioral Science, University of Washington, Seattle, Washington, USA
| | | | - Sara Jane Webb
- Department of Psychiatry and Behavioral Science, University of Washington, Seattle, Washington, USA
| | - Scott O Murray
- Department of Psychology, University of Washington, Seattle, Washington, USA
| |
Collapse
|
31
|
Sendjasni A, Larabi MC. Attention-Aware Patch-Based CNN for Blind 360-Degree Image Quality Assessment. Sensors (Basel) 2023; 23:8676. [PMID: 37960376 PMCID: PMC10647793 DOI: 10.3390/s23218676] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/29/2023] [Revised: 10/05/2023] [Accepted: 10/08/2023] [Indexed: 11/15/2023]
Abstract
An attention-aware patch-based deep-learning model for a blind 360-degree image quality assessment (360-IQA) is introduced in this paper. It employs spatial attention mechanisms to focus on spatially significant features, in addition to short skip connections to align them. A long skip connection is adopted to allow features from the earliest layers to be used at the final level. Patches are properly sampled on the sphere to correspond to the viewports displayed to the user using head-mounted displays. The sampling incorporates the relevance of patches by considering (i) the exploration behavior and (ii) a latitude-based selection. An adaptive strategy is applied to improve the pooling of local patch qualities to global image quality. This includes an outlier score rejection step relying on the standard deviation of the obtained scores to consider the agreement, as well as a saliency to weigh them based on their visual significance. Experiments on available 360-IQA databases show that our model outperforms the state of the art in terms of accuracy and generalization ability. This is valid for general deep-learning-based models, multichannel models, and natural scene statistic-based models. Furthermore, when compared to multichannel models, the computational complexity is significantly reduced. Finally, an extensive ablation study gives insights into the efficacy of each component of the proposed model.
Collapse
|
32
|
Jing Y, Numssen O, Weise K, Kalloch B, Buchberger L, Haueisen J, Hartwigsen G, Knösche TR. Modeling the effects of transcranial magnetic stimulation on spatial attention. Phys Med Biol 2023; 68:214001. [PMID: 37783213 DOI: 10.1088/1361-6560/acff34] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/12/2023] [Accepted: 10/02/2023] [Indexed: 10/04/2023]
Abstract
Objectives. Transcranial magnetic stimulation (TMS) has been widely used to modulate brain activity in healthy and diseased brains, but the underlying mechanisms are not fully understood. Previous research leveraged biophysical modeling of the induced electric field (E-field) to map causal structure-function relationships in the primary motor cortex. This study aims at transferring this localization approach to spatial attention, which helps to understand the TMS effects on cognitive functions, and may ultimately optimize stimulation schemes.Approach. Thirty right-handed healthy participants underwent a functional magnetic imaging (fMRI) experiment, and seventeen of them participated in a TMS experiment. The individual fMRI activation peak within the right inferior parietal lobule (rIPL) during a Posner-like attention task defined the center target for TMS. Thereafter, participants underwent 500 Posner task trials. During each trial, a 5-pulse burst of 10 Hz repetitive TMS (rTMS) was given over the rIPL to modulate attentional processing. The TMS-induced E-fields for every cortical target were correlated with the behavioral modulation to identify relevant cortical regions for attentional orientation and reorientation.Main results. We did not observe a robust correlation between E-field strength and behavioral outcomes, highlighting the challenges of transferring the localization method to cognitive functions with high neural response variability and complex network interactions. Nevertheless, TMS selectively inhibited attentional reorienting in five out of seventeen subjects, resulting in task-specific behavioral impairments. The BOLD-measured neuronal activity and TMS-evoked neuronal effects showed different patterns, which emphasizes the principal distinction between the neural activity being correlated with (or maybe even caused by) particular paradigms, and the activity of neural populations exerting a causal influence on the behavioral outcome.Significance. This study is the first to explore the mechanisms of TMS-induced attentional modulation through electrical field modeling. Our findings highlight the complexity of cognitive functions and provide a basis for optimizing attentional stimulation protocols.
Collapse
Affiliation(s)
- Ying Jing
- Methods and Development Group Brain Networks, Max Planck Institute for Human Cognitive and Brain Sciences, Stephanstraße 1a, D-04103, Leipzig, Germany
- Lise Meitner Research Group Cognition and Plasticity, Max Planck Institute for Human Cognitive and Brain Sciences, Stephanstraße 1a, D-04103, Leipzig, Germany
| | - Ole Numssen
- Methods and Development Group Brain Networks, Max Planck Institute for Human Cognitive and Brain Sciences, Stephanstraße 1a, D-04103, Leipzig, Germany
- Lise Meitner Research Group Cognition and Plasticity, Max Planck Institute for Human Cognitive and Brain Sciences, Stephanstraße 1a, D-04103, Leipzig, Germany
| | - Konstantin Weise
- Methods and Development Group Brain Networks, Max Planck Institute for Human Cognitive and Brain Sciences, Stephanstraße 1a, D-04103, Leipzig, Germany
- Advanced Electromagnetics Group, Technische Universität Ilmenau, Helmholtzplatz 2, D-98693, Ilmenau, Germany
| | - Benjamin Kalloch
- Methods and Development Group Brain Networks, Max Planck Institute for Human Cognitive and Brain Sciences, Stephanstraße 1a, D-04103, Leipzig, Germany
- Institute of Biomedical Engineering and Informatics, Technische Universität Ilmenau, Gustav-Kirchhoff-Straße 2, D-98693, Ilmenau, Germany
| | - Lena Buchberger
- Lise Meitner Research Group Cognition and Plasticity, Max Planck Institute for Human Cognitive and Brain Sciences, Stephanstraße 1a, D-04103, Leipzig, Germany
| | - Jens Haueisen
- Institute of Biomedical Engineering and Informatics, Technische Universität Ilmenau, Gustav-Kirchhoff-Straße 2, D-98693, Ilmenau, Germany
| | - Gesa Hartwigsen
- Lise Meitner Research Group Cognition and Plasticity, Max Planck Institute for Human Cognitive and Brain Sciences, Stephanstraße 1a, D-04103, Leipzig, Germany
- Wilhelm Wundt Institute for Psychology, Leipzig University, Neumarkt 9-19, D-04109, Leipzig, Germany
| | - Thomas R Knösche
- Methods and Development Group Brain Networks, Max Planck Institute for Human Cognitive and Brain Sciences, Stephanstraße 1a, D-04103, Leipzig, Germany
- Institute of Biomedical Engineering and Informatics, Technische Universität Ilmenau, Gustav-Kirchhoff-Straße 2, D-98693, Ilmenau, Germany
| |
Collapse
|
33
|
Houborg C, Pascucci D, Tanrikulu ÖD, Kristjánsson Á. The effects of visual distractors on serial dependence. J Vis 2023; 23:1. [PMID: 37792362 PMCID: PMC10565705 DOI: 10.1167/jov.23.12.1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/03/2022] [Accepted: 08/21/2023] [Indexed: 10/05/2023] Open
Abstract
Attractive serial dependence occurs when perceptual decisions are attracted toward previous stimuli. This effect is mediated by spatial attention and is most likely to occur when similar stimuli are attended at nearby locations. Attention, however, also involves the suppression of distracting information and of spatial locations where distracting stimuli have frequently appeared. Although distractors form an integral part of our visual experience, how they affect the processing of subsequent stimuli is unknown. Here, in two experiments, we tested serial dependence from distractor stimuli during an orientation adjustment task. We interleaved adjustment trials with a discrimination task requiring observers to ignore a peripheral distractor randomly appearing on half of the trials. Distractors were either similar to the adjustment probe (Experiment 1) or differed in spatial frequency and contrast (Experiment 2) and were shown at predictable or random locations in separate blocks. The results showed that the distractor caused considerable attentional capture in the discrimination task, with observers likely using proactive strategies to anticipate distractors at predictable locations. However, there was no evidence that the distractors affected the perceptual stream leading to positive serial dependence. Instead, they left a weak repulsive trace in Experiment 1 and more generally interfered with the effect of the previous adjustment probe in the serial dependence task. We suggest that this repulsive bias may reflect the operation of mechanisms involved in attentional suppression.
Collapse
Affiliation(s)
- Christian Houborg
- Vision Sciences Laboratory, School of Health Sciences, University of Iceland, Reykjavik, Iceland
| | - David Pascucci
- Laboratory of Psychophysics, Ecole Polytechnique Fédérale de Lausanne (EPFL), Lausanne, Switzerland
| | - Ömer Daglar Tanrikulu
- Vision Sciences Laboratory, School of Health Sciences, University of Iceland, Reykjavik, Iceland
- Department of Psychology, University of New Hampshire, Durham, NH, USA
| | - Árni Kristjánsson
- Vision Sciences Laboratory, School of Health Sciences, University of Iceland, Reykjavik, Iceland
| |
Collapse
|
34
|
Weise A, Hartmann T, Parmentier F, Weisz N, Ruhnau P. Involuntary shifts of spatial attention contribute to distraction-Evidence from oscillatory alpha power and reaction time data. Psychophysiology 2023; 60:e14353. [PMID: 37246813 DOI: 10.1111/psyp.14353] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/14/2021] [Revised: 02/18/2023] [Accepted: 05/06/2023] [Indexed: 05/30/2023]
Abstract
Imagine you are focusing on the traffic on a busy street to ride your bike safely when suddenly you hear the siren of an ambulance. This unexpected sound involuntarily captures your attention and interferes with ongoing performance. We tested whether this type of distraction involves a spatial shift of attention. We measured behavioral data and magnetoencephalographic alpha power during a cross-modal paradigm that combined an exogenous cueing task and a distraction task. In each trial, a task-irrelevant sound preceded a visual target (left or right). The sound was usually the same animal sound (i.e., standard sound). Rarely, it was replaced by an unexpected environmental sound (i.e., deviant sound). Fifty percent of the deviants occurred on the same side as the target, and 50% occurred on the opposite side. Participants responded to the location of the target. As expected, responses were slower to targets that followed a deviant compared to a standard. Crucially, this distraction effect was mitigated by the spatial relationship between the targets and the deviants: responses were faster when targets followed deviants on the same versus different side, indexing a spatial shift of attention. This was further corroborated by a posterior alpha power modulation that was higher in the hemisphere ipsilateral (vs. contralateral) to the location of the attention-capturing deviant. We suggest that this alpha power lateralization reflects a spatial attention bias. Overall, our data support the contention that spatial shifts of attention contribute to deviant distraction.
Collapse
Affiliation(s)
- Annekathrin Weise
- CCNS and Division of Physiological Psychology, Paris Lodron University of Salzburg, Salzburg, Austria
- Department of Psychology, Ludwig-Maximilians-University Munich, Munich, Germany
| | - Thomas Hartmann
- CCNS and Division of Physiological Psychology, Paris Lodron University of Salzburg, Salzburg, Austria
| | - Fabrice Parmentier
- Neuropsychology & Cognition Group, Department of Psychology and Institute of Health Sciences (iUNICS), University of the Balearic Islands, Palma, Spain
- Balearic Islands Health Research Institute (IdISBa), Palma, Spain
- Department of Psychology, University of Western Australia, Perth, Western Australia, Australia
| | - Nathan Weisz
- CCNS and Division of Physiological Psychology, Paris Lodron University of Salzburg, Salzburg, Austria
- Neuroscience Institute, Christian Doppler University Hospital, Paracelsus Medical University, Salzburg, Austria
| | - Philipp Ruhnau
- School of Psychology, University of Central Lancashire, Preston, UK
| |
Collapse
|
35
|
Lehnert J, Cha K, Halperin J, Yang K, Zheng DF, Khadra A, Cook EP, Krishnaswamy A. Visual attention to features and space in mice using reverse correlation. Curr Biol 2023; 33:3690-3701.e4. [PMID: 37611588 DOI: 10.1016/j.cub.2023.07.060] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/13/2022] [Revised: 05/17/2023] [Accepted: 07/27/2023] [Indexed: 08/25/2023]
Abstract
Visual attention allows the brain to evoke behaviors based on the most important visual features. Mouse models offer immense potential to gain a circuit-level understanding of this phenomenon, yet how mice distribute attention across features and locations is not well understood. Here, we describe a new approach to address this limitation by training mice to detect weak vertical bars in a background of dynamic noise while spatial cues manipulate their attention. By adapting a reverse-correlation method from human studies, we linked behavioral decisions to stimulus features and locations. We show that mice deployed attention to a small rostral region of the visual field. Within this region, mice attended to multiple features (orientation, spatial frequency, contrast) that indicated the presence of weak vertical bars. This attentional tuning grew with training, multiplicatively scaled behavioral sensitivity, approached that of an ideal observer, and resembled the effects of attention in humans. Taken together, we demonstrate that mice can simultaneously attend to multiple features and locations of a visual stimulus.
Collapse
Affiliation(s)
- Jonas Lehnert
- Department of Physiology, McGill University, Montreal, QC H3G 1Y6, Canada; Quantitative Life Sciences, McGill University, Montreal, QC H3A 1E3, Canada
| | - Kuwook Cha
- Department of Physiology, McGill University, Montreal, QC H3G 1Y6, Canada
| | - Jamie Halperin
- Department of Physiology, McGill University, Montreal, QC H3G 1Y6, Canada
| | - Kerry Yang
- Department of Physiology, McGill University, Montreal, QC H3G 1Y6, Canada
| | - Daniel F Zheng
- Department of Physiology, McGill University, Montreal, QC H3G 1Y6, Canada
| | - Anmar Khadra
- Department of Physiology, McGill University, Montreal, QC H3G 1Y6, Canada; Quantitative Life Sciences, McGill University, Montreal, QC H3A 1E3, Canada; Centre for Applied Mathematics in Bioscience and Medicine, McGill University, Montreal, QC H3G 0B1, Canada
| | - Erik P Cook
- Department of Physiology, McGill University, Montreal, QC H3G 1Y6, Canada; Quantitative Life Sciences, McGill University, Montreal, QC H3A 1E3, Canada; Centre for Applied Mathematics in Bioscience and Medicine, McGill University, Montreal, QC H3G 0B1, Canada.
| | - Arjun Krishnaswamy
- Department of Physiology, McGill University, Montreal, QC H3G 1Y6, Canada; Quantitative Life Sciences, McGill University, Montreal, QC H3A 1E3, Canada.
| |
Collapse
|
36
|
Li J, Hao J, Wang X, Wang Y, Wang Y, Wang H, Wang X. Fourier Ptychographic Microscopic Reconstruction Method Based on Residual Hybrid Attention Network. Sensors (Basel) 2023; 23:7301. [PMID: 37631836 PMCID: PMC10458985 DOI: 10.3390/s23167301] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/19/2023] [Revised: 08/07/2023] [Accepted: 08/15/2023] [Indexed: 08/27/2023]
Abstract
Fourier ptychographic microscopy (FPM) is a novel technique for computing microimaging that allows imaging of samples such as pathology sections. However, due to the influence of systematic errors and noise, the quality of reconstructed images using FPM is often poor, and the reconstruction efficiency is low. In this paper, a hybrid attention network that combines spatial attention mechanisms with channel attention mechanisms into FPM reconstruction is introduced. Spatial attention can extract fine spatial features and reduce redundant features while, combined with residual channel attention, it adaptively readjusts the hierarchical features to achieve the conversion of low-resolution complex amplitude images to high-resolution ones. The high-resolution images generated by this method can be applied to medical cell recognition, segmentation, classification, and other related studies, providing a better foundation for relevant research.
Collapse
Affiliation(s)
| | | | - Xiaoli Wang
- Electrical and Electronic Teaching Center, Electronics Information Engineering College, Changchun University, Changchun 130022, China
| | | | | | | | | |
Collapse
|
37
|
Cai M, Bao Y. Spatial attention modulates auditory dominance in audiovisual order judgment. Psych J 2023; 12:537-539. [PMID: 37394228 DOI: 10.1002/pchj.661] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/13/2023] [Accepted: 04/16/2023] [Indexed: 07/04/2023]
Abstract
Auditory dominance in audiovisual temporal order judgment is shown here to be modulated by exogenous orienting of attention to a spatial cue independent of the cue modality. The visual stimulus has to lead the auditory one further in advance for cued relative to uncued locations in order for the two to be perceived simultaneously, possibly suggesting an inhibitory function of spatial attention on temporal processing.
Collapse
Affiliation(s)
- Mengtong Cai
- School of Psychological and Cognitive Sciences, Peking University, Beijing, China
| | - Yan Bao
- School of Psychological and Cognitive Sciences, Peking University, Beijing, China
- Institute of Medical Psychology, Ludwig Maximilian University, Munich, Germany
- Beijing Key Laboratory of Behavior and Mental Health, Peking University, Beijing, China
| |
Collapse
|
38
|
Erratum: Attentional capture by fearful faces requires consciousness and is modulated by task-relevancy: a dot-probe EEG study. Front Neurosci 2023; 17:1247546. [PMID: 37469835 PMCID: PMC10352943 DOI: 10.3389/fnins.2023.1247546] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/26/2023] [Accepted: 06/26/2023] [Indexed: 07/21/2023] Open
Abstract
[This corrects the article DOI: 10.3389/fnins.2023.1152220.].
Collapse
|
39
|
Hu Z, Yang H, Yan H. Attention-Guided Instance Segmentation for Group-Raised Pigs. Animals (Basel) 2023; 13:2181. [PMID: 37443979 DOI: 10.3390/ani13132181] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/16/2023] [Revised: 06/19/2023] [Accepted: 06/26/2023] [Indexed: 07/15/2023] Open
Abstract
In the pig farming environment, complex factors such as pig adhesion, occlusion, and changes in body posture pose significant challenges for segmenting multiple target pigs. To address these challenges, this study collected video data using a horizontal angle of view and a non-fixed lens. Specifically, a total of 45 pigs aged 20-105 days in 8 pens were selected as research subjects, resulting in 1917 labeled images. These images were divided into 959 for training, 192 for validation, and 766 for testing. The grouped attention module was employed in the feature pyramid network to fuse the feature maps from deep and shallow layers. The grouped attention module consists of a channel attention branch and a spatial attention branch. The channel attention branch effectively models dependencies between channels to enhance feature mapping between related channels and improve semantic feature representation. The spatial attention branch establishes pixel-level dependencies by applying the response values of all pixels in a single-channel feature map to the target pixel. It further guides the original feature map to filter spatial location information and generate context-related outputs. The grouped attention, along with data augmentation strategies, was incorporated into the Mask R-CNN and Cascade Mask R-CNN task networks to explore their impact on pig segmentation. The experiments showed that introducing data augmentation strategies improved the segmentation performance of the model to a certain extent. Taking Mask-RCNN as an example, under the same experimental conditions, the introduction of data augmentation strategies resulted in improvements of 1.5%, 0.7%, 0.4%, and 0.5% in metrics AP50, AP75, APL, and AP, respectively. Furthermore, our grouped attention module achieved the best performance. For example, compared to the existing attention module CBAM, taking Mask R-CNN as an example, in terms of the metric AP50, AP75, APL, and AP, the grouped attention outperformed 1.0%, 0.3%, 1.1%, and 1.2%, respectively. We further studied the impact of the number of groups in the grouped attention on the final segmentation results. Additionally, visualizations of predictions on third-party data collected using a top-down data acquisition method, which was not involved in the model training, demonstrated that the proposed model in this paper still achieved good segmentation results, proving the transferability and robustness of the grouped attention. Through comprehensive analysis, we found that grouped attention is beneficial for achieving high-precision segmentation of individual pigs in different scenes, ages, and time periods. The research results can provide references for subsequent applications such as pig identification and behavior analysis in mobile settings.
Collapse
Affiliation(s)
- Zhiwei Hu
- College of Information Science and Engineering, Shanxi Agricultural University, Jinzhong 030801, China
| | - Hua Yang
- College of Information Science and Engineering, Shanxi Agricultural University, Jinzhong 030801, China
| | - Hongwen Yan
- College of Information Science and Engineering, Shanxi Agricultural University, Jinzhong 030801, China
| |
Collapse
|
40
|
He Z, Zhang L, Wang H. Corrigendum: An initial prediction and fine-tuning model based on improving GCN for 3D human motion prediction. Front Comput Neurosci 2023; 17:1232765. [PMID: 37384118 PMCID: PMC10296160 DOI: 10.3389/fncom.2023.1232765] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/01/2023] [Accepted: 06/02/2023] [Indexed: 06/30/2023] Open
Abstract
[This corrects the article DOI: 10.3389/fncom.2023.1145209.].
Collapse
Affiliation(s)
- Zhiquan He
- Guangdong Key Laboratory of Intelligent Information Processing, Shenzhen, China
- Guangdong Multimedia Information Service Engineering Technology Research Center, Shenzhen University, Shenzhen, China
| | - Lujun Zhang
- Guangdong Multimedia Information Service Engineering Technology Research Center, Shenzhen University, Shenzhen, China
| | - Hengyou Wang
- School of Science, Beijing University of Civil Engineering and Architecture, Beijing, China
| |
Collapse
|
41
|
Ajana K, Everard G, Lejeune T, Edwards MG. A feature and conjunction visual search immersive virtual reality serious game for measuring spatial and distractor inhibition attention using response time and action kinematics. J Clin Exp Neuropsychol 2023:1-12. [PMID: 37260369 DOI: 10.1080/13803395.2023.2218571] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 06/02/2023]
Abstract
BACKGROUND Treisman (1980) proposed that visual-spatial attention to targets presented with distractors involves parallel and serial cognition. When the target is different from distractors by a single feature, the number of distractors does not influence search speed (parallel). However, when the target is different from the distractor by a conjunction of features, increased numbers of distractors increase task difficulty (serial). Here, we developed a serious game in immersive virtual reality (IVR) for evaluating spatial and distractor inhibition attention. METHODS We tested 60 healthy participants. They performed the serious game in which they had to find a target mole wearing a red miner's helmet. In the single feature parallel conditions, the distractor moles wore blue (miner's or horned) helmets, and in the conjunction feature serial conditions, the distractor moles wore blue miner's helmets or red horned helmets. There were 11-17-23 distractors. Responses were made with the dominant hand by hitting the target with a virtual hammer. We measured mean response time (RT), mean velocity (MV) and coefficient of variance of speed (CV). RESULTS Participants were significantly slower (RT and MV) and showed greater CV when responding to targets in conjunction compared to single feature search tasks. Further, participants were slower (RT and MV) and showed greater CV when the number of distractors increased. A significant interaction between search tasks and distractors showed that RT and CV only increased with distractor number for the conjunction search tasks. MV decreased with distractor number for both single and conjunction tasks, with a stronger decrease for conjunction relative to single feature search. CONCLUSION The results replicated previous findings, providing support for the use of immersive virtual reality technology for the simultaneous evaluation of spatial and distractor inhibition attention using complex 3D objects.
Collapse
Affiliation(s)
- Khawla Ajana
- Secteur Des Sciences Humaines, Institut de recherche en sciences psychologiques (IPSY), Université Catholique de Louvain, Louvain-la-Neuve, Belgium
- Louvain Bionics, Université Catholique de Louvain, Louvain-la-Neuve, Belgium
| | - Gauthier Everard
- Louvain Bionics, Université Catholique de Louvain, Louvain-la-Neuve, Belgium
- Secteur des Sciences de la Santé, Institut de Recherche Expérimentale et Clinique, Neuro Musculo Skeletal Laboratory (NMSK), Université catholique de Louvain, Brussels, Belgium
| | - Thierry Lejeune
- Louvain Bionics, Université Catholique de Louvain, Louvain-la-Neuve, Belgium
- Secteur des Sciences de la Santé, Institut de Recherche Expérimentale et Clinique, Neuro Musculo Skeletal Laboratory (NMSK), Université catholique de Louvain, Brussels, Belgium
- Cliniques universitaires Saint-Luc, Service de médecine physique et réadaptation, Brussels, Belgium
| | - Martin Gareth Edwards
- Secteur Des Sciences Humaines, Institut de recherche en sciences psychologiques (IPSY), Université Catholique de Louvain, Louvain-la-Neuve, Belgium
- Louvain Bionics, Université Catholique de Louvain, Louvain-la-Neuve, Belgium
| |
Collapse
|
42
|
Agac S, Durmaz Incel O. On the Use of a Convolutional Block Attention Module in Deep Learning-Based Human Activity Recognition with Motion Sensors. Diagnostics (Basel) 2023; 13:diagnostics13111861. [PMID: 37296713 DOI: 10.3390/diagnostics13111861] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/05/2023] [Revised: 05/21/2023] [Accepted: 05/23/2023] [Indexed: 06/12/2023] Open
Abstract
Sensor-based human activity recognition with wearable devices has captured the attention of researchers in the last decade. The possibility of collecting large sets of data from various sensors in different body parts, automatic feature extraction, and aiming to recognize more complex activities have led to a rapid increase in the use of deep learning models in the field. More recently, using attention-based models for dynamically fine-tuning the model features and, in turn, improving the model performance has been investigated. However, the impact of using channel, spatial, or combined attention methods of the convolutional block attention module (CBAM) on the high-performing DeepConvLSTM model, a hybrid model proposed for sensor-based human activity recognition, has yet to be studied. Additionally, since wearables have limited resources, analysing the parameter requirements of attention modules can serve as an indicator for optimizing resource consumption. In this study, we explored the performance of CBAM on the DeepConvLSTM architecture both in terms of recognition performance and the number of additional parameters required by attention modules. In this direction, the effect of channel and spatial attention, individually and in combination, were examined. To evaluate the model performance, the Pamap2 dataset containing 12 daily activities and the Opportunity dataset with its 18 micro activities were utilized. The results showed that the performance for Opportunity increased from 0.74 to 0.77 in the macro f1-score owing to spatial attention, while for Pamap2, the performance increased from 0.95 to 0.96 owing to the channel attention applied to DeepConvLSTM with a negligible number of additional parameters. Moreover, when the activity-based results were analysed, it was observed that the attention mechanism increased the performance of the activities with the worst performance in the baseline model without attention. We present a comparison with related studies that use the same datasets and show that we could achieve higher scores on both datasets by combining CBAM and DeepConvLSTM.
Collapse
Affiliation(s)
- Sumeyye Agac
- Department of Computer Engineering, Bogazici University, Istanbul 34342, Turkey
| | - Ozlem Durmaz Incel
- Department of Computer Engineering, Bogazici University, Istanbul 34342, Turkey
| |
Collapse
|
43
|
Hong Y, Qiu Z, Chen H, Zhu B, Lei H. MAS-UNet: a U-shaped network for prostate segmentation. Front Med (Lausanne) 2023; 10:1190659. [PMID: 37275383 PMCID: PMC10232949 DOI: 10.3389/fmed.2023.1190659] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/21/2023] [Accepted: 04/25/2023] [Indexed: 06/07/2023] Open
Abstract
Prostate cancer is a common disease that seriously endangers the health of middle-aged and elderly men. MRI images are the gold standard for assessing the health status of the prostate region. Segmentation of the prostate region is of great significance for the diagnosis of prostate cancer. In the past, some methods have been used to segment the prostate region, but segmentation accuracy still has room for improvement. This study has proposed a new image segmentation model based on Attention UNet. The model improves Attention UNet by using GN instead of BN, adding dropout to prevent overfitting, introducing the ASPP module, adding channel attention to the attention gate module, and using different channels to output segmentation results of different prostate regions. Finally, we conducted comparative experiments using five existing UNet-based models, and used the dice coefficient as the metric to evaluate the segmentation result. The proposed model achieves dice scores of 0.807 and 0.907 in the transition region and the peripheral region, respectively. The experimental results show that the proposed model is better than other UNet-based models.
Collapse
Affiliation(s)
- YuQi Hong
- School of Computer Science and Technology, Hainan University, Haikou, China
| | - Zhao Qiu
- School of Computer Science and Technology, Hainan University, Haikou, China
| | - Huajing Chen
- Hainan Provincial Public Security Department, Haikou, China
| | - Bing Zhu
- Haikou Hospital of the Maternal and Child Health, Haikou, China
| | - Haodong Lei
- School of Computer Science and Technology, Hainan University, Haikou, China
| |
Collapse
|
44
|
Zheng Z, Hu Q, Bu X, Jiang H, Sui X, Li L, Chai X, Chen Y. Spatial Attention Modulates Neuronal Interactions between Simple and Complex Cells in V1. Int J Mol Sci 2023; 24:ijms24098229. [PMID: 37175939 PMCID: PMC10179430 DOI: 10.3390/ijms24098229] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/30/2023] [Revised: 04/25/2023] [Accepted: 04/29/2023] [Indexed: 05/15/2023] Open
Abstract
Visual perception is profoundly modulated by spatial attention, which can selectively prioritize goal-related information. Previous studies found spatial attention facilitated the efficacy of neuronal communication between visual cortices with hierarchical organizations. In the primary visual cortex (V1), there is also a hierarchical connection between simple (S) and complex (C) cells. We wonder whether and how spatial attention modulates neuronal communication within V1, especially for neuronal pairs with heterogeneous visual input. We simultaneously recorded the pairs' activity from macaque monkeys when they performed a spatial-attention-involved task, then applied likelihood-based Granger causality analysis to explore attentional modulation of neuronal interactions. First, a significant attention-related decrease in Granger causality was found in S-C pairs, which primarily displayed in the S-to-C feedforward connection. Second, the interaction strength of the feedforward connection was significantly higher than that of the feedback under attend toward (AT) conditions. Although information flow did not alter as the attentional focus shifted, the strength of communications between target- and distractor-stimuli-covered neurons differed only when attending to complex cells' receptive fields (RFs). Furthermore, pairs' communications depended on the attentional modulation of neurons' firing rates. Our findings demonstrate spatial attention does not induce specific information flow but rather amplifies directed communication within V1.
Collapse
Affiliation(s)
- Zhiyan Zheng
- School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai 200240, China
| | - Qiyi Hu
- School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai 200240, China
| | - Xiangdong Bu
- School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai 200240, China
| | - Hongru Jiang
- School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai 200240, China
| | - Xiaohong Sui
- School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai 200240, China
| | - Liming Li
- School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai 200240, China
| | - Xinyu Chai
- School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai 200240, China
| | - Yao Chen
- School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai 200240, China
| |
Collapse
|
45
|
Meyyappan S, Rajan A, Mangun GR, Ding M. Top-down control of the left visual field bias in cued visual spatial attention. Cereb Cortex 2023; 33:5097-5107. [PMID: 36245213 PMCID: PMC10151882 DOI: 10.1093/cercor/bhac402] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/18/2022] [Revised: 09/13/2022] [Accepted: 09/14/2022] [Indexed: 11/13/2022] Open
Abstract
A left visual field (LVF) bias in perceptual judgments, response speed, and discrimination accuracy has been reported in humans. Cognitive factors, such as visual spatial attention, are known to modulate or even eliminate this bias. We investigated this problem by recording pupillometry together with functional magnetic resonance imaging (fMRI) in a cued visual spatial attention task. We observed that (i) the pupil was significantly more dilated following attend-right than attend-left cues, (ii) the task performance (e.g. reaction time [RT]) did not differ between attend-left and attend-right trials, and (iii) the difference in cue-related pupil dilation between attend-left and attend-right trials was inversely related to the corresponding difference in RT. Neuroscientically, correlating the difference in cue-related pupil dilation with the corresponding cue-related fMRI difference yielded activations primarily in the right hemisphere, including the right intraparietal sulcus and the right ventrolateral prefrontal cortex. These results suggest that (i) there is an asymmetry in visual spatial attention control, with the rightward attention control being more effortful than the leftward attention control, (ii) this asymmetry underlies the reduction or the elimination of the LVF bias, and (iii) the components of the attentional control networks in the right hemisphere are likely part of the neural substrate of the observed asymmetry in attentional control.
Collapse
Affiliation(s)
- Sreenivasan Meyyappan
- J. Crayton Pruitt Family Department of Biomedical Engineering, University of Florida, Gainesville, FL 32611, USA
- Center for Mind and Brain, University of California, Davis, CA 95618, USA
| | - Abhijit Rajan
- J. Crayton Pruitt Family Department of Biomedical Engineering, University of Florida, Gainesville, FL 32611, USA
| | - George R Mangun
- Center for Mind and Brain, University of California, Davis, CA 95618, USA
- Departments of Psychology and Neurology, University of California, Davis, CA 95616, USA
| | - Mingzhou Ding
- J. Crayton Pruitt Family Department of Biomedical Engineering, University of Florida, Gainesville, FL 32611, USA
| |
Collapse
|
46
|
Tınok AA, Karabay A, Jong JD, Balta G, Akyürek EG. Effects of gamma-aminobutyric acid on working memory and attention: A randomized, double-blinded, placebo-controlled, crossover trial. J Psychopharmacol 2023:2698811231161579. [PMID: 36988214 DOI: 10.1177/02698811231161579] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 03/30/2023]
Abstract
BACKGROUND γ-Aminobutyric acid (GABA) is a primary inhibitory neurotransmitter that plays a significant role in the central nervous system. Studies on both animals and humans show that GABA has the pharmacological potential for reducing the impact of cognitive disorders, as well as enhancing cognitive functions and mood. However, its specific effects on human attention and working memory have not yet been extensively studied. AIMS In this randomized, double-blind, placebo-controlled, and crossover trial, we aimed to test whether the administration of 800 mg GABA, dissolved in a drink, acutely affected visual working memory (VWM) maintenance, as well as temporal and spatial attention in healthy adults. METHODS The participants were 32 young adults (16 females and 16 males). Working memory recall precision, spatial attention and temporal attention were measured by a delayed match-to-sample task, a visual search (VS) task and a speeded rapid serial visual presentation task, respectively. Participants completed two experimental sessions (GABA and Placebo) in randomized and counterbalanced order. In each session, 45 min after administration of the drink, they completed all three aforementioned cognitive tasks. RESULTS Linear mixed model analysis results showed that GABA increased VS time, compared to the placebo, but did not affect VS accuracy, temporal attention, nor VWM precision. CONCLUSIONS The results suggest that GABA increases VS time but does not affect temporal attention and memory, and that previously reported effects on cognition might rely on other functions.
Collapse
Affiliation(s)
- Ahmet Al Tınok
- Department of Experimental Psychology, University of Groningen, Groningen, The Netherlands
| | - Aytaç Karabay
- Department of Experimental Psychology, University of Groningen, Groningen, The Netherlands
- Department of Psychology, New York University Abu Dhabi, Abu Dhabi, United Arab Emirates
| | - Joost de Jong
- Department of Experimental Psychology, University of Groningen, Groningen, The Netherlands
| | - Gülşen Balta
- Department of Experimental Psychology, University of Groningen, Groningen, The Netherlands
| | - Elkan G Akyürek
- Department of Experimental Psychology, University of Groningen, Groningen, The Netherlands
| |
Collapse
|
47
|
Majeed MA, Shafri HZM, Zulkafli Z, Wayayok A. A Deep Learning Approach for Dengue Fever Prediction in Malaysia Using LSTM with Spatial Attention. Int J Environ Res Public Health 2023; 20:4130. [PMID: 36901139 PMCID: PMC10002017 DOI: 10.3390/ijerph20054130] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 01/16/2023] [Revised: 02/19/2023] [Accepted: 02/21/2023] [Indexed: 06/18/2023]
Abstract
This research aims to predict dengue fever cases in Malaysia using machine learning techniques. A dataset consisting of weekly dengue cases at the state level in Malaysia from 2010 to 2016 was obtained from the Malaysia Open Data website and includes variables such as climate, geography, and demographics. Six different long short-term memory (LSTM) models were developed and compared for dengue prediction in Malaysia: LSTM, stacked LSTM (S-LSTM), LSTM with temporal attention (TA-LSTM), S-LSTM with temporal attention (STA-LSTM), LSTM with spatial attention (SA-LSTM), and S-LSTM with spatial attention (SSA-LSTM). The models were trained and evaluated on a dataset of monthly dengue cases in Malaysia from 2010 to 2016, with the task of predicting the number of dengue cases based on various climate, topographic, demographic, and land-use variables. The SSA-LSTM model, which used both stacked LSTM layers and spatial attention, performed the best, with an average root mean squared error (RMSE) of 3.17 across all lookback periods. When compared to three benchmark models (SVM, DT, ANN), the SSA-LSTM model had a significantly lower average RMSE. The SSA-LSTM model also performed well in different states in Malaysia, with RMSE values ranging from 2.91 to 4.55. When comparing temporal and spatial attention models, the spatial models generally performed better at predicting dengue cases. The SSA-LSTM model was also found to perform well at different prediction horizons, with the lowest RMSE at 4- and 5-month lookback periods. Overall, the results suggest that the SSA-LSTM model is effective at predicting dengue cases in Malaysia.
Collapse
Affiliation(s)
- Mokhalad A. Majeed
- Department of Civil Engineering, Faculty of Engineering, Universiti Putra Malaysia (UPM), Serdang 43400, Selangor, Malaysia
| | - Helmi Zulhaidi Mohd Shafri
- Department of Civil Engineering, Faculty of Engineering, Universiti Putra Malaysia (UPM), Serdang 43400, Selangor, Malaysia
- Geospatial Information Science Research Centre (GISRC), Faculty of Engineering, Universiti Putra Malaysia (UPM), Serdang 43400, Selangor, Malaysia
| | - Zed Zulkafli
- Department of Civil Engineering, Faculty of Engineering, Universiti Putra Malaysia (UPM), Serdang 43400, Selangor, Malaysia
| | - Aimrun Wayayok
- Department of Biological and Agricultural Engineering, Faculty of Engineering, Universiti Putra Malaysia (UPM), Serdang 43400, Selangor, Malaysia
| |
Collapse
|
48
|
Abstract
The external noise paradigm and perceptual template model (PTM) have successfully been applied to characterize observer properties and mechanisms of observer state changes (e.g. attention and perceptual learning) in several research domains, focusing on individual level analysis. In this study, we developed a new hierarchical Bayesian perceptual template model (HBPTM) to model the trial-by-trial data from all individuals and conditions in a published spatial cuing study within a single structure and compared its performance to that of a Bayesian Inference Procedure (BIP), which separately infers the posterior distributions of the model parameters for each individual subject without the hierarchical structure. The HBPTM allowed us to compute the joint posterior distribution of the hyperparameters and parameters at the population, observer, and experiment levels and make statistical inferences at all these levels. In addition, we ran a large simulation study that varied the number of observers and number of trials in each condition and demonstrated the advantage of the HBPTM over the BIP across all the simulated datasets. Although it is developed in the context of spatial attention, the HBPTM and its extensions can be used to model data from the external noise paradigm in other domains and enable predictions of human performance at both the population and individual levels.
Collapse
Affiliation(s)
- Zhong-Lin Lu
- Division of Arts and Sciences, NYU Shanghai, Shanghai, China Center for Neural Science and Department of Psychology, New York University, New York, NY, USA.,NYU-ECNU Institute of Brain and Cognitive Science, Shanghai, China.,
| | - Barbara Anne Dosher
- Department of Cognitive Sciences, University of California, Irvine, CA, USA.,
| |
Collapse
|
49
|
Fang W, Wang K, Zhang K, Qian J. Spatial attention based on 2D location and relative depth order modulates visual working memory in a 3D environment. Br J Psychol 2023; 114:112-131. [PMID: 36161427 DOI: 10.1111/bjop.12599] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/08/2022] [Revised: 06/22/2022] [Accepted: 08/31/2022] [Indexed: 01/11/2023]
Abstract
The attentional effect on visual working memory (VWM) has been a heated research topic in the past two decades. Studies show that VWM performance for an attended memory item can be improved by cueing its two-dimensional (2D) spatial location during retention. However, few studies have investigated the effect of attentional selection on VWM in a three-dimensional setting, and it remains unknown whether depth information can produce beneficial attentional effects on 2D visual representations similar to 2D spatial information. Here we conducted four experiments, displaying memory items at various stereoscopic depth planes, and examined the retro-cue effects of four types of cues - a cue would either indicate the 2D or depth location of a memory item, and either in the form of physical (directly pointing to a location) or symbolic (numerically mapping onto a location) cues. We found that retro-cue benefits were only observed for cues directly pointing to a 2D location, whereas a null effect was observed for cues directly pointing to a depth location. However, there was a retro-cue effect when cueing the relative depth order, though the effect was weaker than that for cueing the 2D location. The selective effect on VWM based on 2D spatial attention is different from depth-based attention, and the divergence suggests that an object representation is primarily bound with its 2D spatial location, weakly bound with its depth order but not with its metric depth location. This indicates that attentional selection based on memory for depth, particularly metric depth, is ineffective.
Collapse
Affiliation(s)
- Wei Fang
- Department of Psychology, Sun Yat-Sen University, Guangzhou, China.,Departments of Biomedical Sciences and Neuroscience, City University of Hong Kong, Hong Kong, China
| | - Kaiyue Wang
- Department of Psychology, Sun Yat-Sen University, Guangzhou, China
| | - Ke Zhang
- Department of Psychology, Sun Yat-Sen University, Guangzhou, China
| | - Jiehui Qian
- Department of Psychology, Sun Yat-Sen University, Guangzhou, China
| |
Collapse
|
50
|
Reynaert B, Morales C, Mpodozis J, Letelier JC, Marín GJ. A blinking focal pattern of re-entrant activity in the avian tectum. Curr Biol 2023; 33:1-14.e4. [PMID: 36446352 DOI: 10.1016/j.cub.2022.10.070] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/25/2022] [Revised: 09/06/2022] [Accepted: 10/31/2022] [Indexed: 11/30/2022]
Abstract
Re-entrant connections are inherent to nervous system organization; however, a comprehensive understanding of their operation is still lacking. In birds, topographically organized re-entrant signals, carried by axons from the nucleus-isthmi-parvocellularis (Ipc), are distinctly recorded as bursting discharges across the optic tectum (TeO). Here, we used up to 48 microelectrodes regularly spaced on the superficial tectal layers of anesthetized pigeons to characterize the spatial-temporal pattern of this axonal re-entrant activity in response to different visual stimulation. We found that a brief luminous spot triggered repetitive waves of bursting discharges that, appearing from initial sources, propagated horizontally to areas representing up to 28° of visual space, widely exceeding the area activated by the retinal fibers. In response to visual motion, successive burst waves started along and around the stimulated tectal path, tracking the stimulus in discontinuous steps. When two stimuli were presented, the burst-wave sources alternated between the activated tectal loci, as if only one source could be active at any given time. Because these re-entrant signals boost the retinal input to higher visual areas, their peculiar dynamics mimic a blinking "spotlight," similar to the internal searching mechanism classically used to explain spatial attention. Tectal re-entry from Ipc is thus highly structured and intrinsically discontinuous, and higher tectofugal areas, which lack retinotopic organization, will thus receive incoming visual activity in a sequential and piecemeal fashion. We anticipate that analogous re-entrant patterns, perhaps hidden in less bi-dimensionally organized topographies, may organize the flow of neural activity in other parts of the brain as well.
Collapse
Affiliation(s)
- Bryan Reynaert
- Departamento de Biología, Facultad de Ciencias, Universidad de Chile, Santiago 7800003, Chile
| | - Cristian Morales
- Departamento de Biología, Facultad de Ciencias, Universidad de Chile, Santiago 7800003, Chile
| | - Jorge Mpodozis
- Departamento de Biología, Facultad de Ciencias, Universidad de Chile, Santiago 7800003, Chile
| | - Juan Carlos Letelier
- Departamento de Biología, Facultad de Ciencias, Universidad de Chile, Santiago 7800003, Chile
| | - Gonzalo J Marín
- Departamento de Biología, Facultad de Ciencias, Universidad de Chile, Santiago 7800003, Chile; Facultad de Medicina, Universidad Finis Terrae, Santiago 7501015, Chile.
| |
Collapse
|