1
|
Carollo A, Esposito G. Hyperscanning Literature After Two Decades of Neuroscientific Research: a Scientometric Review. Neuroscience 2024:S0306-4522(24)00255-0. [PMID: 38866073 DOI: 10.1016/j.neuroscience.2024.05.045] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/02/2024] [Revised: 05/24/2024] [Accepted: 05/30/2024] [Indexed: 06/14/2024]
Abstract
Hyperscanning, a neuroimaging approach introduced in 2002 for simultaneously recording the brain activity of multiple participants, has significantly contributed to our understanding of social interactions. Nevertheless, the existing literature requires systematic organization to advance our knowledge. This study, after two decades of hyperscanning research, aims to identify the primary thematic domains and the most influential documents in the field. We conducted a scientometric analysis to examine co-citation patterns quantitatively, using a sample of 548 documents retrieved from Scopus and their 32,022 cited references. Our analysis revealed ten major thematic domains in hyperscanning research, with the most impactful document authored by Czeszumski and colleagues in 2020. Notably, while hyperscanning was initially developed for functional magnetic resonance imaging (fMRI), our findings indicate a substantial influence of research conducted using electroencephalography (EEG) and functional near-infrared spectroscopy (fNIRS). The introduction of fNIRS and advancements in EEG methods have enabled the implementation of more ecologically valid experiments for investigating social interactions. The study also highlights the need for more research that combines multi-brain neural stimulation with neuroimaging techniques to understand the causal role played by interpersonal neural synchrony in social interactions.
Collapse
Affiliation(s)
- Alessandro Carollo
- Department of Psychology and Cognitive Science, University of Trento, Rovereto, Italy.
| | - Gianluca Esposito
- Department of Psychology and Cognitive Science, University of Trento, Rovereto, Italy.
| |
Collapse
|
2
|
Green GD, Jacewicz E, Santosa H, Arzbecker LJ, Fox RA. Evaluating Speaker-Listener Cognitive Effort in Speech Communication Through Brain-to-Brain Synchrony: A Pilot Functional Near-Infrared Spectroscopy Investigation. JOURNAL OF SPEECH, LANGUAGE, AND HEARING RESEARCH : JSLHR 2024; 67:1339-1359. [PMID: 38535722 DOI: 10.1044/2024_jslhr-23-00476] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/09/2024]
Abstract
PURPOSE We explore a new approach to the study of cognitive effort involved in listening to speech by measuring the brain activity in a listener in relation to the brain activity in a speaker. We hypothesize that the strength of this brain-to-brain synchrony (coupling) reflects the magnitude of cognitive effort involved in verbal communication and includes both listening effort and speaking effort. We investigate whether interbrain synchrony is greater in native-to-native versus native-to-nonnative communication using functional near-infrared spectroscopy (fNIRS). METHOD Two speakers participated, a native speaker of American English and a native speaker of Korean who spoke English as a second language. Each speaker was fitted with the fNIRS cap and told short stories. The native English speaker provided the English narratives, and the Korean speaker provided both the nonnative (accented) English and Korean narratives. In separate sessions, fNIRS data were obtained from seven English monolingual participants ages 20-24 years who listened to each speaker's stories. After listening to each story in native and nonnative English, they retold the content, and their transcripts and audio recordings were analyzed for comprehension and discourse fluency, measured in the number of hesitations and articulation rate. No story retellings were obtained for narratives in Korean (an incomprehensible language for English listeners). Utilizing fNIRS technique termed sequential scanning, we quantified the brain-to-brain synchronization in each speaker-listener dyad. RESULTS For native-to-native dyads, multiple brain regions associated with various linguistic and executive functions were activated. There was a weaker coupling for native-to-nonnative dyads, and only the brain regions associated with higher order cognitive processes and functions were synchronized. All listeners understood the content of all stories, but they hesitated significantly more when retelling stories told in accented English. The nonnative speaker hesitated significantly more often than the native speaker and had a significantly slower articulation rate. There was no brain-to-brain coupling during listening to Korean, indicating a break in communication when listeners failed to comprehend the speaker. CONCLUSIONS We found that effortful speech processing decreased interbrain synchrony and delayed comprehension processes. The obtained brain-based and behavioral patterns are consistent with our proposal that cognitive effort in verbal communication pertains to both the listener and the speaker and that brain-to-brain synchrony can be an indicator of differences in their cumulative communicative effort. SUPPLEMENTAL MATERIAL https://doi.org/10.23641/asha.25452142.
Collapse
Affiliation(s)
- Geoff D Green
- Department of Speech and Hearing Science, The Ohio State University, Columbus
| | - Ewa Jacewicz
- Department of Speech and Hearing Science, The Ohio State University, Columbus
| | | | - Lian J Arzbecker
- Department of Speech and Hearing Science, The Ohio State University, Columbus
| | - Robert A Fox
- Department of Speech and Hearing Science, The Ohio State University, Columbus
| |
Collapse
|
3
|
Jia T, Sun J, McGeady C, Ji L, Li C. Enhancing Brain-Computer Interface Performance by Incorporating Brain-to-Brain Coupling. CYBORG AND BIONIC SYSTEMS 2024; 5:0116. [PMID: 38680535 PMCID: PMC11052607 DOI: 10.34133/cbsystems.0116] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/15/2023] [Accepted: 03/24/2024] [Indexed: 05/01/2024] Open
Abstract
Human cooperation relies on key features of social interaction in order to reach desirable outcomes. Similarly, human-robot interaction may benefit from integration with human-human interaction factors. In this paper, we aim to investigate brain-to-brain coupling during motor imagery (MI)-based brain-computer interface (BCI) training using eye-contact and hand-touch interaction. Twelve pairs of friends (experimental group) and 10 pairs of strangers (control group) were recruited for MI-based BCI tests concurrent with electroencephalography (EEG) hyperscanning. Event-related desynchronization (ERD) was estimated to measure cortical activation, and interbrain functional connectivity was assessed using multilevel statistical analysis. Furthermore, we compared BCI classification performance under different social interaction conditions. In the experimental group, greater ERD was found around the contralateral sensorimotor cortex under social interaction conditions compared with MI without any social interaction. Notably, EEG channels with decreased power were mainly distributed around the frontal, central, and occipital regions. A significant increase in interbrain coupling was also found under social interaction conditions. BCI decoding accuracies were significantly improved in the eye contact condition and eye and hand contact condition compared with the no-interaction condition. However, for the strangers' group, no positive effects were observed in comparisons of cortical activations between interaction and no-interaction conditions. These findings indicate that social interaction can improve the neural synchronization between familiar partners with enhanced brain activations and brain-to-brain coupling. This study may provide a novel method for enhancing MI-based BCI performance in conjunction with neural synchronization between users.
Collapse
Affiliation(s)
- Tianyu Jia
- Lab of Intelligent and Biomimetic Machinery, Department of Mechanical Engineering,
Tsinghua University, Beijing, China
- Department of Bioengineering,
Imperial College London, London, UK
| | - Jingyao Sun
- Lab of Intelligent and Biomimetic Machinery, Department of Mechanical Engineering,
Tsinghua University, Beijing, China
| | - Ciarán McGeady
- Department of Bioengineering,
Imperial College London, London, UK
| | - Linhong Ji
- Lab of Intelligent and Biomimetic Machinery, Department of Mechanical Engineering,
Tsinghua University, Beijing, China
| | - Chong Li
- Lab of Intelligent and Biomimetic Machinery, Department of Mechanical Engineering,
Tsinghua University, Beijing, China
- School of Clinical Medicine,
Tsinghua University, Beijing, China
- Beijing Tsinghua Changgung Hospital,
Tsinghua University, Beijing, China
| |
Collapse
|
4
|
Long J, Peng L, Li Q, Niu L, Dai H, Zhang J, Chen K, Lee TMC, Huang M, Zhang R. Acute stress impairs intentional memory suppression through aberrant prefrontal cortex activation in high trait ruminators. Int J Clin Health Psychol 2024; 24:100463. [PMID: 38699400 PMCID: PMC11063604 DOI: 10.1016/j.ijchp.2024.100463] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/16/2023] [Accepted: 04/15/2024] [Indexed: 05/05/2024] Open
Abstract
Objective Research shows that the effect of acute stress on intentional memory suppression could be modulated by individual differences in psychological traits. However, whether acute stress distinctly affects intentional memory suppression in high trait ruminators, a high at-risk group of stress-related disorders, and the neural correlations, remains unclear. Method 55 healthy college students were divided into high and low trait ruminators (HTR and LTR), Following stress manipulation, a Think/No Think task assessed the memory suppression performance. Functional near-infrared spectroscopy was applied to explore the neural correlates. Psychophysiological interaction analyses were used to assess how the functional connectivity between a seed region and another brain region was modulated by tasks during memory suppression, further mediating memory suppression performance and state rumination. Results The HTR exhibited poorer memory suppression performance than the LTR under the stress condition. Aberrant activation patterns and task-modulated functional connectivity in the dorsal prefrontal cortex (DLPFC) and superior temporal gyrus (STG) were observed only in the HTR during memory suppression under the stress condition. The effect of memory suppression performance on the state rumination of individuals was significantly mediated by the task-modulated functional connectivity between the DLPFC and STG. Conclusions The findings could provide insights for prevention or early intervention in the development of stress-related disorders in HTR.
Collapse
Affiliation(s)
- Jixin Long
- Laboratory of Cognitive Control and Brain Healthy, Department of Psychology, School of Public Health, Southern Medical University, Guangzhou, PR China
- Guangdong-Hong Kong-Macao Greater Bay Area Center for Brain Science and Brain-Inspired Intelligence, Guangdong-Hong Kong Joint Laboratory for Psychiatric Disorders, Guangdong Basic Research Center of Excellence for Integrated Traditional and Western Medicine for Qingzhi Diseases, PR China
- Department of Applied Social Science, The Hong Kong Polytechnic University, Hong Kong, SAR, PR China
| | - Lanxin Peng
- Laboratory of Cognitive Control and Brain Healthy, Department of Psychology, School of Public Health, Southern Medical University, Guangzhou, PR China
- Guangdong-Hong Kong-Macao Greater Bay Area Center for Brain Science and Brain-Inspired Intelligence, Guangdong-Hong Kong Joint Laboratory for Psychiatric Disorders, Guangdong Basic Research Center of Excellence for Integrated Traditional and Western Medicine for Qingzhi Diseases, PR China
| | - Qian Li
- Laboratory of Cognitive Control and Brain Healthy, Department of Psychology, School of Public Health, Southern Medical University, Guangzhou, PR China
- Guangdong-Hong Kong-Macao Greater Bay Area Center for Brain Science and Brain-Inspired Intelligence, Guangdong-Hong Kong Joint Laboratory for Psychiatric Disorders, Guangdong Basic Research Center of Excellence for Integrated Traditional and Western Medicine for Qingzhi Diseases, PR China
| | - Lijing Niu
- Laboratory of Cognitive Control and Brain Healthy, Department of Psychology, School of Public Health, Southern Medical University, Guangzhou, PR China
- Guangdong-Hong Kong-Macao Greater Bay Area Center for Brain Science and Brain-Inspired Intelligence, Guangdong-Hong Kong Joint Laboratory for Psychiatric Disorders, Guangdong Basic Research Center of Excellence for Integrated Traditional and Western Medicine for Qingzhi Diseases, PR China
| | - Haowei Dai
- Laboratory of Cognitive Control and Brain Healthy, Department of Psychology, School of Public Health, Southern Medical University, Guangzhou, PR China
- Guangdong-Hong Kong-Macao Greater Bay Area Center for Brain Science and Brain-Inspired Intelligence, Guangdong-Hong Kong Joint Laboratory for Psychiatric Disorders, Guangdong Basic Research Center of Excellence for Integrated Traditional and Western Medicine for Qingzhi Diseases, PR China
| | - Jiayuan Zhang
- Laboratory of Cognitive Control and Brain Healthy, Department of Psychology, School of Public Health, Southern Medical University, Guangzhou, PR China
- Guangdong-Hong Kong-Macao Greater Bay Area Center for Brain Science and Brain-Inspired Intelligence, Guangdong-Hong Kong Joint Laboratory for Psychiatric Disorders, Guangdong Basic Research Center of Excellence for Integrated Traditional and Western Medicine for Qingzhi Diseases, PR China
| | - Keyin Chen
- Laboratory of Cognitive Control and Brain Healthy, Department of Psychology, School of Public Health, Southern Medical University, Guangzhou, PR China
- Guangdong-Hong Kong-Macao Greater Bay Area Center for Brain Science and Brain-Inspired Intelligence, Guangdong-Hong Kong Joint Laboratory for Psychiatric Disorders, Guangdong Basic Research Center of Excellence for Integrated Traditional and Western Medicine for Qingzhi Diseases, PR China
| | - Tatia MC Lee
- State Key Laboratory of Brain and Cognitive Sciences, The University of Hong Kong, Hong Kong, SAR, PR China
- Laboratory of Neuropsychology and Human Neuroscience, The University of Hong Kong, Hong Kong, SAR, PR China
| | - Meiyan Huang
- School of Biomedical Engineering, Southern Medical University, Guangzhou, PR China
| | - Ruibin Zhang
- Laboratory of Cognitive Control and Brain Healthy, Department of Psychology, School of Public Health, Southern Medical University, Guangzhou, PR China
- Guangdong-Hong Kong-Macao Greater Bay Area Center for Brain Science and Brain-Inspired Intelligence, Guangdong-Hong Kong Joint Laboratory for Psychiatric Disorders, Guangdong Basic Research Center of Excellence for Integrated Traditional and Western Medicine for Qingzhi Diseases, PR China
- Department of Psychiatry, Zhujiang Hospital, Southern Medical University, Guangzhou, PR China
| |
Collapse
|
5
|
Wohltjen S, Wheatley T. Interpersonal eye-tracking reveals the dynamics of interacting minds. Front Hum Neurosci 2024; 18:1356680. [PMID: 38532792 PMCID: PMC10963423 DOI: 10.3389/fnhum.2024.1356680] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/16/2023] [Accepted: 02/20/2024] [Indexed: 03/28/2024] Open
Abstract
The human eye is a rich source of information about where, when, and how we attend. Our gaze paths indicate where and what captures our attention, while changes in pupil size can signal surprise, revealing our expectations. Similarly, the pattern of our blinks suggests levels of alertness and when our attention shifts between external engagement and internal thought. During interactions with others, these cues reveal how we coordinate and share our mental states. To leverage these insights effectively, we need accurate, timely methods to observe these cues as they naturally unfold. Advances in eye-tracking technology now enable real-time observation of these cues, shedding light on mutual cognitive processes that foster shared understanding, collaborative thought, and social connection. This brief review highlights these advances and the new opportunities they present for future research.
Collapse
Affiliation(s)
- Sophie Wohltjen
- Department of Psychology, University of Wisconsin–Madison, Madison, WI, United States
| | - Thalia Wheatley
- Department of Psychological and Brain Sciences, Consortium for Interacting Minds, Dartmouth College, Hanover, NH, United States
- Santa Fe Institute, Santa Fe, NM, United States
| |
Collapse
|
6
|
Konrad K, Gerloff C, Kohl SH, Mehler DMA, Mehlem L, Volbert EL, Komorek M, Henn AT, Boecker M, Weiss E, Reindl V. Interpersonal neural synchrony and mental disorders: unlocking potential pathways for clinical interventions. Front Neurosci 2024; 18:1286130. [PMID: 38529267 PMCID: PMC10962391 DOI: 10.3389/fnins.2024.1286130] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/30/2023] [Accepted: 01/30/2024] [Indexed: 03/27/2024] Open
Abstract
Introduction Interpersonal synchronization involves the alignment of behavioral, affective, physiological, and brain states during social interactions. It facilitates empathy, emotion regulation, and prosocial commitment. Mental disorders characterized by social interaction dysfunction, such as Autism Spectrum Disorder (ASD), Reactive Attachment Disorder (RAD), and Social Anxiety Disorder (SAD), often exhibit atypical synchronization with others across multiple levels. With the introduction of the "second-person" neuroscience perspective, our understanding of interpersonal neural synchronization (INS) has improved, however, so far, it has hardly impacted the development of novel therapeutic interventions. Methods To evaluate the potential of INS-based treatments for mental disorders, we performed two systematic literature searches identifying studies that directly target INS through neurofeedback (12 publications; 9 independent studies) or brain stimulation techniques (7 studies), following PRISMA guidelines. In addition, we narratively review indirect INS manipulations through behavioral, biofeedback, or hormonal interventions. We discuss the potential of such treatments for ASD, RAD, and SAD and using a systematic database search assess the acceptability of neurofeedback (4 studies) and neurostimulation (4 studies) in patients with social dysfunction. Results Although behavioral approaches, such as engaging in eye contact or cooperative actions, have been shown to be associated with increased INS, little is known about potential long-term consequences of such interventions. Few proof-of-concept studies have utilized brain stimulation techniques, like transcranial direct current stimulation or INS-based neurofeedback, showing feasibility and preliminary evidence that such interventions can boost behavioral synchrony and social connectedness. Yet, optimal brain stimulation protocols and neurofeedback parameters are still undefined. For ASD, RAD, or SAD, so far no randomized controlled trial has proven the efficacy of direct INS-based intervention techniques, although in general brain stimulation and neurofeedback methods seem to be well accepted in these patient groups. Discussion Significant work remains to translate INS-based manipulations into effective treatments for social interaction disorders. Future research should focus on mechanistic insights into INS, technological advancements, and rigorous design standards. Furthermore, it will be key to compare interventions directly targeting INS to those targeting other modalities of synchrony as well as to define optimal target dyads and target synchrony states in clinical interventions.
Collapse
Affiliation(s)
- Kerstin Konrad
- Child Neuropsychology Section, Department of Child and Adolescent Psychiatry, Psychosomatics and Psychotherapy, University Hospital RWTH, Aachen, Germany
- JARA Brain Institute II, Molecular Neuroscience and Neuroimaging (INM-11), Jülich Research Centre, Jülich, Germany
| | - Christian Gerloff
- Child Neuropsychology Section, Department of Child and Adolescent Psychiatry, Psychosomatics and Psychotherapy, University Hospital RWTH, Aachen, Germany
- JARA Brain Institute II, Molecular Neuroscience and Neuroimaging (INM-11), Jülich Research Centre, Jülich, Germany
- Department of Applied Mathematics and Theoretical Physics, Cambridge Centre for Data-Driven Discovery, University of Cambridge, Cambridge, United Kingdom
| | - Simon H. Kohl
- Child Neuropsychology Section, Department of Child and Adolescent Psychiatry, Psychosomatics and Psychotherapy, University Hospital RWTH, Aachen, Germany
- JARA Brain Institute II, Molecular Neuroscience and Neuroimaging (INM-11), Jülich Research Centre, Jülich, Germany
| | - David M. A. Mehler
- Department of Psychiatry, Psychotherapy and Psychosomatics, Medical School, RWTH Aachen University, Aachen, Germany
- Institute for Translational Psychiatry, University of Münster, Münster, Germany
- School of Psychology, Cardiff University Brain Research Imaging Center (CUBRIC), Cardiff University, Cardiff, United Kingdom
| | - Lena Mehlem
- Child Neuropsychology Section, Department of Child and Adolescent Psychiatry, Psychosomatics and Psychotherapy, University Hospital RWTH, Aachen, Germany
| | - Emily L. Volbert
- Child Neuropsychology Section, Department of Child and Adolescent Psychiatry, Psychosomatics and Psychotherapy, University Hospital RWTH, Aachen, Germany
| | - Maike Komorek
- Child Neuropsychology Section, Department of Child and Adolescent Psychiatry, Psychosomatics and Psychotherapy, University Hospital RWTH, Aachen, Germany
| | - Alina T. Henn
- Child Neuropsychology Section, Department of Child and Adolescent Psychiatry, Psychosomatics and Psychotherapy, University Hospital RWTH, Aachen, Germany
| | - Maren Boecker
- Child Neuropsychology Section, Department of Child and Adolescent Psychiatry, Psychosomatics and Psychotherapy, University Hospital RWTH, Aachen, Germany
- Institute of Medical Psychology and Medical Sociology, University Hospital RWTH, Aachen, Germany
| | - Eileen Weiss
- Child Neuropsychology Section, Department of Child and Adolescent Psychiatry, Psychosomatics and Psychotherapy, University Hospital RWTH, Aachen, Germany
- Institute of Medical Psychology and Medical Sociology, University Hospital RWTH, Aachen, Germany
| | - Vanessa Reindl
- Child Neuropsychology Section, Department of Child and Adolescent Psychiatry, Psychosomatics and Psychotherapy, University Hospital RWTH, Aachen, Germany
- Department of Psychology, School of Social Sciences, Nanyang Technological University, Singapore, Singapore
| |
Collapse
|
7
|
Papoutselou E, Harrison S, Mai G, Buck B, Patil N, Wiggins I, Hartley D. Investigating mother-child inter-brain synchrony in a naturalistic paradigm: A functional near infrared spectroscopy (fNIRS) hyperscanning study. Eur J Neurosci 2024; 59:1386-1403. [PMID: 38155106 DOI: 10.1111/ejn.16233] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/19/2022] [Revised: 11/27/2023] [Accepted: 12/01/2023] [Indexed: 12/30/2023]
Abstract
Successful social interactions between mothers and children are hypothesised to play a significant role in a child's social, cognitive and language development. Earlier research has confirmed, through structured experimental paradigms, that these interactions could be underpinned by coordinated neural activity. Nevertheless, the extent of neural synchrony during real-life, ecologically valid interactions between mothers and their children remains largely unexplored. In this study, we investigated mother-child inter-brain synchrony using a naturalistic free-play paradigm. We also examined the relationship between neural synchrony, verbal communication patterns and personality traits to further understand the underpinnings of brain synchrony. Twelve children aged between 3 and 5 years old and their mothers participated in this study. Neural synchrony in mother-child dyads were measured bilaterally over frontal and temporal areas using functional Near Infra-red Spectroscopy (fNIRS) whilst the dyads were asked to play with child-friendly toys together (interactive condition) and separately (independent condition). Communication patterns were captured via video recordings and conversational turns were coded. Compared to the independent condition, mother-child dyads showed increased neural synchrony in the interactive condition across the prefrontal cortex and temporo-parietal junction. There was no significant relationship found between neural synchrony and turn-taking and between neural synchrony and the personality traits of each member of the dyad. Overall, we demonstrate the feasibility of measuring inter-brain synchrony between mothers and children in a naturalistic environment. These findings can inform future study designs to assess inter-brain synchrony between parents and pre-lingual children and/or children with communication needs.
Collapse
Affiliation(s)
- Efstratia Papoutselou
- Hearing Sciences, Division of Clinical Neuroscience, School of Medicine, University of Nottingham, Nottingham, UK
- Nottingham Biomedical Research Centre (BRC), National Institute for Health Research (NIHR), Nottingham, UK
| | - Samantha Harrison
- Hearing Sciences, Division of Clinical Neuroscience, School of Medicine, University of Nottingham, Nottingham, UK
- Nottingham Biomedical Research Centre (BRC), National Institute for Health Research (NIHR), Nottingham, UK
| | - Guangting Mai
- Hearing Sciences, Division of Clinical Neuroscience, School of Medicine, University of Nottingham, Nottingham, UK
- Nottingham Biomedical Research Centre (BRC), National Institute for Health Research (NIHR), Nottingham, UK
| | - Bryony Buck
- Hearing Sciences - Scottish Section, Division of Clinical Neuroscience, School of Medicine, University of Nottingham, Nottingham, UK
| | - Nikita Patil
- Nottingham Biomedical Research Centre (BRC), National Institute for Health Research (NIHR), Nottingham, UK
- School of Medicine, University of Nottingham, Nottingham, UK
| | - Ian Wiggins
- Hearing Sciences, Division of Clinical Neuroscience, School of Medicine, University of Nottingham, Nottingham, UK
- Nottingham Biomedical Research Centre (BRC), National Institute for Health Research (NIHR), Nottingham, UK
| | - Douglas Hartley
- Hearing Sciences, Division of Clinical Neuroscience, School of Medicine, University of Nottingham, Nottingham, UK
- Nottingham Biomedical Research Centre (BRC), National Institute for Health Research (NIHR), Nottingham, UK
- Nottingham University Hospitals NHS Trust, Queen's Medical Centre, Nottingham, UK
| |
Collapse
|
8
|
Bánki A, Köster M, Cichy RM, Hoehl S. Communicative signals during joint attention promote neural processes of infants and caregivers. Dev Cogn Neurosci 2024; 65:101321. [PMID: 38061133 PMCID: PMC10754706 DOI: 10.1016/j.dcn.2023.101321] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/12/2023] [Revised: 10/13/2023] [Accepted: 11/04/2023] [Indexed: 01/01/2024] Open
Abstract
Communicative signals such as eye contact increase infants' brain activation to visual stimuli and promote joint attention. Our study assessed whether communicative signals during joint attention enhance infant-caregiver dyads' neural responses to objects, and their neural synchrony. To track mutual attention processes, we applied rhythmic visual stimulation (RVS), presenting images of objects to 12-month-old infants and their mothers (n = 37 dyads), while we recorded dyads' brain activity (i.e., steady-state visual evoked potentials, SSVEPs) with electroencephalography (EEG) hyperscanning. Within dyads, mothers either communicatively showed the images to their infant or watched the images without communicative engagement. Communicative cues increased infants' and mothers' SSVEPs at central-occipital-parietal, and central electrode sites, respectively. Infants showed significantly more gaze behaviour to images during communicative engagement. Dyadic neural synchrony (SSVEP amplitude envelope correlations, AECs) was not modulated by communicative cues. Taken together, maternal communicative cues in joint attention increase infants' neural responses to objects, and shape mothers' own attention processes. We show that communicative cues enhance cortical visual processing, thus play an essential role in social learning. Future studies need to elucidate the effect of communicative cues on neural synchrony during joint attention. Finally, our study introduces RVS to study infant-caregiver neural dynamics in social contexts.
Collapse
Affiliation(s)
- Anna Bánki
- University of Vienna, Faculty of Psychology, Vienna, Austria.
| | - Moritz Köster
- University of Regensburg, Institute for Psychology, Regensburg, Germany; Freie Universität Berlin, Faculty of Education and Psychology, Berlin, Germany
| | | | - Stefanie Hoehl
- University of Vienna, Faculty of Psychology, Vienna, Austria
| |
Collapse
|
9
|
Moffat R, Casale CE, Cross ES. Mobile fNIRS for exploring inter-brain synchrony across generations and time. FRONTIERS IN NEUROERGONOMICS 2024; 4:1260738. [PMID: 38234472 PMCID: PMC10790948 DOI: 10.3389/fnrgo.2023.1260738] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/18/2023] [Accepted: 12/01/2023] [Indexed: 01/19/2024]
Abstract
While still relatively rare, longitudinal hyperscanning studies are exceptionally valuable for documenting changes in inter-brain synchrony, which may in turn underpin how behaviors develop and evolve in social settings. The generalizability and ecological validity of this experimental approach hinges on the selected imaging technique being mobile-a requirement met by functional near-infrared spectroscopy (fNIRS). fNIRS has most frequently been used to examine the development of inter-brain synchrony and behavior in child-parent dyads. In this position paper, we contend that dedicating attention to longitudinal and intergenerational hyperscanning stands to benefit the fields of social and cognitive neuroscience more broadly. We argue that this approach is particularly relevant for understanding the neural mechanisms underpinning intergenerational social dynamics, and potentially for benchmarking progress in psychological and social interventions, many of which are situated in intergenerational contexts. In line with our position, we highlight areas of intergenerational research that stand to be enhanced by longitudinal hyperscanning with mobile devices, describe challenges that may arise from measuring across generations in the real world, and offer potential solutions.
Collapse
Affiliation(s)
- Ryssa Moffat
- Social Brain Sciences, ETH Zurich, Zurich, Switzerland
| | - Courtney E. Casale
- School of Psychological Sciences, Macquarie University, Sydney, NSW, Australia
| | | |
Collapse
|
10
|
Hakim U, De Felice S, Pinti P, Zhang X, Noah JA, Ono Y, Burgess PW, Hamilton A, Hirsch J, Tachtsidis I. Quantification of inter-brain coupling: A review of current methods used in haemodynamic and electrophysiological hyperscanning studies. Neuroimage 2023; 280:120354. [PMID: 37666393 DOI: 10.1016/j.neuroimage.2023.120354] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/08/2023] [Revised: 08/25/2023] [Accepted: 08/28/2023] [Indexed: 09/06/2023] Open
Abstract
Hyperscanning is a form of neuroimaging experiment where the brains of two or more participants are imaged simultaneously whilst they interact. Within the domain of social neuroscience, hyperscanning is increasingly used to measure inter-brain coupling (IBC) and explore how brain responses change in tandem during social interaction. In addition to cognitive research, some have suggested that quantification of the interplay between interacting participants can be used as a biomarker for a variety of cognitive mechanisms aswell as to investigate mental health and developmental conditions including schizophrenia, social anxiety and autism. However, many different methods have been used to quantify brain coupling and this can lead to questions about comparability across studies and reduce research reproducibility. Here, we review methods for quantifying IBC, and suggest some ways moving forward. Following the PRISMA guidelines, we reviewed 215 hyperscanning studies, across four different brain imaging modalities: functional near-infrared spectroscopy (fNIRS), functional magnetic resonance (fMRI), electroencephalography (EEG) and magnetoencephalography (MEG). Overall, the review identified a total of 27 different methods used to compute IBC. The most common hyperscanning modality is fNIRS, used by 119 studies, 89 of which adopted wavelet coherence. Based on the results of this literature survey, we first report summary statistics of the hyperscanning field, followed by a brief overview of each signal that is obtained from each neuroimaging modality used in hyperscanning. We then discuss the rationale, assumptions and suitability of each method to different modalities which can be used to investigate IBC. Finally, we discuss issues surrounding the interpretation of each method.
Collapse
Affiliation(s)
- U Hakim
- Department of Medical Physics and Biomedical Engineering, University College London, Malet Place Engineering Building, Gower Street, London WC1E 6BT, United Kingdom.
| | - S De Felice
- Institute of Cognitive Neuroscience, University College London, London, United Kingdom; Department of Psychology, University of Cambridge, United Kingdom
| | - P Pinti
- Department of Medical Physics and Biomedical Engineering, University College London, Malet Place Engineering Building, Gower Street, London WC1E 6BT, United Kingdom; Centre for Brain and Cognitive Development, Birkbeck, University of London, London, United Kingdom
| | - X Zhang
- Department of Psychiatry, Yale School of Medicine, New Haven, CT, United States
| | - J A Noah
- Department of Psychiatry, Yale School of Medicine, New Haven, CT, United States
| | - Y Ono
- Department of Electronics and Bioinformatics, School of Science and Technology, Meiji University, Kawasaki, Kanagawa, Japan
| | - P W Burgess
- Institute of Cognitive Neuroscience, University College London, London, United Kingdom
| | - A Hamilton
- Institute of Cognitive Neuroscience, University College London, London, United Kingdom
| | - J Hirsch
- Department of Medical Physics and Biomedical Engineering, University College London, Malet Place Engineering Building, Gower Street, London WC1E 6BT, United Kingdom; Department of Psychiatry, Yale School of Medicine, New Haven, CT, United States; Departments of Neuroscience and Comparative Medicine, Yale School of Medicine, New Haven, CT, United States; Yale University, Wu Tsai Institute, New Haven, CT, United States
| | - I Tachtsidis
- Department of Medical Physics and Biomedical Engineering, University College London, Malet Place Engineering Building, Gower Street, London WC1E 6BT, United Kingdom
| |
Collapse
|
11
|
Chuang C, Hsu H. Pseudo-mutual gazing enhances interbrain synchrony during remote joint attention tasking. Brain Behav 2023; 13:e3181. [PMID: 37496332 PMCID: PMC10570487 DOI: 10.1002/brb3.3181] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/06/2023] [Revised: 06/29/2023] [Accepted: 07/13/2023] [Indexed: 07/28/2023] Open
Abstract
INTRODUCTION Mutual gaze enables people to share attention and increase engagement during social interactions through intentional and implicit messages. Although previous studies have explored gaze behaviors and neural mechanisms underlying in-person eye contact, the growing prevalence of remote communication has raised questions about how to establish mutual gaze remotely and how the brains of interacting individuals synchronize. METHODS To address these questions, we conducted a study using eye trackers to create a pseudo-mutual gaze channel that mirrors the gazes of each interacting dyad on their respective remote screens. To demonstrate fluctuations in coupling across brains, we incorporated electroencephalographic hyperscanning techniques to simultaneously record the brain activity of interacting dyads engaged in a joint attention task in player-observer, collaborative, and competitive modes. RESULTS Our results indicated that mutual gaze could improve the efficiency of joint attention activities among remote partners. Moreover, by employing the phase locking value, we could estimate interbrain synchrony (IBS) and observe low-frequency couplings in the frontal and temporal regions that varied based on the interaction mode. While dyadic gender composition significantly affected gaze patterns, it did not impact the IBS. CONCLUSION These results provide insight into the neurological mechanisms underlying remote interaction through the pseudo-mutual gaze channel and have significant implications for developing effective online communication environments.
Collapse
Affiliation(s)
- Chun‐Hsiang Chuang
- Research Center for Education and Mind Sciences, College of EducationNational Tsing Hua UniversityHsinchuTaiwan
- Institute of Information Systems and ApplicationsCollege of Electrical Engineering and Computer ScienceNational Tsing Hua UniversityHsinchuTaiwan
| | - Hao‐Che Hsu
- Research Center for Education and Mind Sciences, College of EducationNational Tsing Hua UniversityHsinchuTaiwan
- Department of Computer ScienceNational Yang Ming Chiao Tung UniversityHsinchuTaiwan
- Department of Computer Science and EngineeringNational Taiwan Ocean UniversityKeelungTaiwan
| |
Collapse
|
12
|
Pfaus JG, Safron A, Zakreski E. From distal to proximal to interactive: behavioral and brain synchrony during attraction, courtship, and sexual interaction-implications for clinical assessments of relationship style and quality. Sex Med Rev 2023; 11:312-322. [PMID: 37544764 DOI: 10.1093/sxmrev/qead034] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/20/2023] [Revised: 07/03/2023] [Accepted: 07/04/2023] [Indexed: 08/08/2023]
Abstract
INTRODUCTION Synchronous behaviors between individuals are nonverbal signs of closeness and common purpose. In the flow from initial attraction to intimate sexual interaction, attention and synchrony move from distal to proximal to interactive and are mediated by sensitized activation of neural systems for sexual motivation, arousal, and desire and those that recognize and mimic common facial and body movements between individuals. When reinforced by sexual pleasure and other relationship rewards, this results in the strengthening of attraction and bonding and the display of more common motor patterns. As relationships falter, nonverbal behaviors likely become asynchronous. OBJECTIVES To define behavioral, romantic, and sexual synchrony during phases of attraction and how their disruption can be observed and utilized by clinicians to assess individual relationship styles and quality. METHODS We review the literature on behavioral and attentional synchrony in humans and animals in an effort to understand experiential and innate mechanisms of synchrony and asynchrony and how they develop, as well as implications for attraction, relationship initiation, maintenance of romantic and sexual closeness, and relationship disintegration. RESULTS Evidence is presented that behavioral synchrony and the neural mechanisms that underlie it are vital to relationship formation and satisfaction. CONCLUSION Behavioral synchrony helps to create feelings of sexual and romantic synergy, cohesion, and arousal among individuals. Asynchrony is aversive and can spark feelings of discontent, aversion, and jealousy. Thus, observing patterns of nonverbal sexual and romantic synchrony between individuals offers insights into the potential quality of their relationships.
Collapse
Affiliation(s)
- James G Pfaus
- Department of Psychology and Life Sciences, Faculty of Humanities, Charles University, Prague, 18200, Czech Republic
- Center for Sexual Health and Intervention, Czech National Institute of Mental Health, Klecany, 25067, Czech Republic
| | - Adam Safron
- Center for Psychedelic and Consciousness Research, Johns Hopkins Bayview Medical Center, Baltimore, MD, 21224, United States
| | - Ellen Zakreski
- Department of Psychology and Life Sciences, Faculty of Humanities, Charles University, Prague, 18200, Czech Republic
- Center for Sexual Health and Intervention, Czech National Institute of Mental Health, Klecany, 25067, Czech Republic
| |
Collapse
|
13
|
Troje NF. Depth from motion parallax: Deictic consistency, eye contact, and a serious problem with Zoom. J Vis 2023; 23:1. [PMID: 37656465 PMCID: PMC10479236 DOI: 10.1167/jov.23.10.1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/31/2023] [Accepted: 07/24/2023] [Indexed: 09/02/2023] Open
Abstract
The dynamics of head and eye gaze between two or more individuals displayed during verbal and nonverbal face-to-face communication contains a wealth of information and is used for both volitionary and unconscious signaling. Current video communication systems convey visual signals about gaze behavior and other directional cues, but the information they carry is often spurious and potentially misleading. I discuss the consequences of this situation, identify the source of the problem as a more general lack of deictic consistency, and demonstrate that using display technologies that simulate motion parallax are both necessary and sufficient to alleviate it. I then devise an avatar-based remote communication solution that achieves deictic consistency and provides natural, dynamic eye contact for computer-mediated audiovisual communication.
Collapse
Affiliation(s)
- Nikolaus F Troje
- Centre for Vision Research and Department of Biology, York University, Toronto, Ontario, Canada
| |
Collapse
|
14
|
Kikuchi Y, Tanioka K, Hiroyasu T, Hiwa S. Interpersonal brain synchronization during face-to-face economic exchange between acquainted dyads. OXFORD OPEN NEUROSCIENCE 2023; 2:kvad007. [PMID: 38596234 PMCID: PMC10913825 DOI: 10.1093/oons/kvad007] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 12/15/2022] [Revised: 06/13/2023] [Accepted: 06/15/2023] [Indexed: 04/11/2024]
Abstract
Interpersonal brain synchronization (IBS) has been observed during social interactions and involves various factors, such as familiarity with the partner and type of social activity. A previous study has shown that face-to-face (FF) interactions in pairs of strangers increase IBS. However, it is unclear whether this can be observed when the nature of the interacting partners is different. Herein, we aimed to extend these findings to pairs of acquaintances. Neural activity in the frontal and temporal regions was recorded using functional near-infrared spectroscopy hyperscanning. Participants played an ultimatum game that required virtual economic exchange in two experimental settings: face-to-face and face-blocked conditions. Random pair analysis confirmed whether IBS was induced by social interaction. Contrary to the aforementioned study, our results did not show any cooperative behavior or task-induced IBS increase. Conversely, the random pair analysis results revealed that the pair-specific IBS was significant only in the task condition at the left and right superior frontal, middle frontal, orbital superior frontal, right superior temporal, precentral and postcentral gyri. Our results tentatively suggested that FF interaction in acquainted pairs did not increase IBS and supported the idea that IBS is affected by 'with whom we interact and how'.
Collapse
Affiliation(s)
- Yuto Kikuchi
- Graduate School of Life and Medical Sciences, Doshisha University, 1-3 Tatara Miyakodani, Kyotanabe, Kyoto610-0394, Japan
| | - Kensuke Tanioka
- Department of Biomedical Sciences and Informatics, Doshisha University, 1-3 Tatara Miyakodani, Kyotanabe, Kyoto 610-0394, Japan
| | - Tomoyuki Hiroyasu
- Department of Biomedical Sciences and Informatics, Doshisha University, 1-3 Tatara Miyakodani, Kyotanabe, Kyoto 610-0394, Japan
| | - Satoru Hiwa
- Department of Biomedical Sciences and Informatics, Doshisha University, 1-3 Tatara Miyakodani, Kyotanabe, Kyoto 610-0394, Japan
| |
Collapse
|
15
|
Koul A, Ahmar D, Iannetti GD, Novembre G. Spontaneous dyadic behaviour predicts the emergence of interpersonal neural synchrony. Neuroimage 2023:120233. [PMID: 37348621 DOI: 10.1016/j.neuroimage.2023.120233] [Citation(s) in RCA: 7] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/21/2022] [Revised: 06/14/2023] [Accepted: 06/15/2023] [Indexed: 06/24/2023] Open
Abstract
Synchronization of neural activity across brains - interpersonal neural synchrony (INS) - is emerging as a powerful marker of social interaction that predicts success of multi-person coordination, communication, and cooperation. As the origins of INS are poorly understood, we tested whether and how INS might emerge from spontaneous dyadic behavior. We recorded neural activity (EEG) and human behavior (full-body kinematics, eye movements and facial expressions) while dyads of participants were instructed to look at each other without speaking or making co-verbal gestures. We made four fundamental observations. First, despite the absence of a structured social task, INS emerged spontaneously only when participants were able to see each other. Second, we show that such spontaneous INS, comprising specific spectral and topographic profiles, did not merely reflect intra-personal modulations of neural activity, but it rather reflected real-time and dyad-specific coupling of neural activities. Third, using state-of-art video-image processing and deep learning, we extracted the temporal unfolding of three notable social behavioral cues - body movement, eye contact, and smiling - and demonstrated that these behaviors also spontaneously synchronized within dyads. Fourth, we probed the correlates of INS in such synchronized social behaviors. Using cross-correlation and Granger causality analyses, we show that synchronized social behaviors anticipate and in fact Granger cause INS. These results provide proof-of-concept evidence for studying interpersonal neural and behavioral synchrony under natural and unconstrained conditions. Most importantly, the results suggest that INS could be conceptualized as an emergent property of two coupled neural systems: an entrainment phenomenon, promoted by real-time dyadic behavior.
Collapse
Affiliation(s)
- Atesh Koul
- Neuroscience of Perception and Action Lab, Italian Institute of Technology (IIT), Viale Regina Elena 291, Rome, Italy.
| | - Davide Ahmar
- Neuroscience of Perception and Action Lab, Italian Institute of Technology (IIT), Viale Regina Elena 291, Rome, Italy
| | - Gian Domenico Iannetti
- Neuroscience and Behavior Lab, Italian Institute of Technology (IIT), Viale Regina Elena 291, Rome, Italy; Department of Neuroscience, Physiology and Pharmacology, University College London (UCL), WC1E 6BT, London, UK
| | - Giacomo Novembre
- Neuroscience of Perception and Action Lab, Italian Institute of Technology (IIT), Viale Regina Elena 291, Rome, Italy.
| |
Collapse
|
16
|
Stangl M, Maoz SL, Suthana N. Mobile cognition: imaging the human brain in the 'real world'. Nat Rev Neurosci 2023; 24:347-362. [PMID: 37046077 PMCID: PMC10642288 DOI: 10.1038/s41583-023-00692-y] [Citation(s) in RCA: 13] [Impact Index Per Article: 13.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 03/03/2023] [Indexed: 04/14/2023]
Abstract
Cognitive neuroscience studies in humans have enabled decades of impactful discoveries but have primarily been limited to recording the brain activity of immobile participants in a laboratory setting. In recent years, advances in neuroimaging technologies have enabled recordings of human brain activity to be obtained during freely moving behaviours in the real world. Here, we propose that these mobile neuroimaging methods can provide unique insights into the neural mechanisms of human cognition and contribute to the development of novel treatments for neurological and psychiatric disorders. We further discuss the challenges associated with studying naturalistic human behaviours in complex real-world settings as well as strategies for overcoming them. We conclude that mobile neuroimaging methods have the potential to bring about a new era of cognitive neuroscience in which neural mechanisms can be studied with increased ecological validity and with the ability to address questions about natural behaviour and cognitive processes in humans engaged in dynamic real-world experiences.
Collapse
Affiliation(s)
- Matthias Stangl
- Department of Psychiatry and Biobehavioral Sciences, Jane and Terry Semel Institute for Neuroscience and Human Behaviour, University of California, Los Angeles, Los Angeles, CA, USA.
| | - Sabrina L Maoz
- Department of Bioengineering, University of California, Los Angeles, Los Angeles, CA, USA
| | - Nanthia Suthana
- Department of Psychiatry and Biobehavioral Sciences, Jane and Terry Semel Institute for Neuroscience and Human Behaviour, University of California, Los Angeles, Los Angeles, CA, USA.
- Department of Bioengineering, University of California, Los Angeles, Los Angeles, CA, USA.
- Department of Neurosurgery, David Geffen School of Medicine, University of California, Los Angeles, Los Angeles, CA, USA.
- Department of Psychology, University of California, Los Angeles, Los Angeles, CA, USA.
| |
Collapse
|
17
|
Troje NF. Zoom disrupts eye contact behaviour: problems and solutions. Trends Cogn Sci 2023; 27:417-419. [PMID: 37003879 DOI: 10.1016/j.tics.2023.02.004] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/13/2023] [Revised: 02/20/2023] [Accepted: 02/22/2023] [Indexed: 04/03/2023]
Abstract
Natural, dynamic eye contact behaviour is critical to social interaction but is dysfunctional in video conferencing. In analysing the problem, I introduce the concept of directionality and emphasize the critical role of motion parallax. I then sketch approaches towards re-establishing directionality and enabling natural, dynamic eye contact in video conferences.
Collapse
Affiliation(s)
- Nikolaus F Troje
- Centre for Vision Research and Department of Biology, York University, 4700 Keele Street, Toronto, ON M3J 1P3, Canada.
| |
Collapse
|
18
|
Hirsch J, Zhang X, Noah JA, Bhattacharya A. Neural mechanisms for emotional contagion and spontaneous mimicry of live facial expressions. Philos Trans R Soc Lond B Biol Sci 2023; 378:20210472. [PMID: 36871593 PMCID: PMC9985973 DOI: 10.1098/rstb.2021.0472] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/23/2022] [Accepted: 01/16/2023] [Indexed: 03/07/2023] Open
Abstract
Viewing a live facial expression typically elicits a similar expression by the observer (facial mimicry) that is associated with a concordant emotional experience (emotional contagion). The model of embodied emotion proposes that emotional contagion and facial mimicry are functionally linked although the neural underpinnings are not known. To address this knowledge gap, we employed a live two-person paradigm (n = 20 dyads) using functional near-infrared spectroscopy during live emotive face-processing while also measuring eye-tracking, facial classifications and ratings of emotion. One dyadic partner, 'Movie Watcher', was instructed to emote natural facial expressions while viewing evocative short movie clips. The other dyadic partner, 'Face Watcher', viewed the Movie Watcher's face. Task and rest blocks were implemented by timed epochs of clear and opaque glass that separated partners. Dyadic roles were alternated during the experiment. Mean cross-partner correlations of facial expressions (r = 0.36 ± 0.11 s.e.m.) and mean cross-partner affect ratings (r = 0.67 ± 0.04) were consistent with facial mimicry and emotional contagion, respectively. Neural correlates of emotional contagion based on covariates of partner affect ratings included angular and supramarginal gyri, whereas neural correlates of the live facial action units included motor cortex and ventral face-processing areas. Findings suggest distinct neural components for facial mimicry and emotional contagion. This article is part of a discussion meeting issue 'Face2face: advancing the science of social interaction'.
Collapse
Affiliation(s)
- Joy Hirsch
- Brain Function Laboratory, Department of Psychiatry, Yale School of Medicine, New Haven, CT 06511, USA
- Department of Neuroscience, Yale School of Medicine, New Haven, CT 06511, USA
- Department of Comparative Medicine, Yale School of Medicine, New Haven, CT 06511, USA
- Wu Tsai Institute, Yale University, PO Box 208091, New Haven, CT 06520, USA
- Haskins Laboratories, 300 George Street, New Haven, CT 06511, USA
- Department of Medical Physics and Biomedical Engineering, University College London, London WC1E 6BT, UK
| | - Xian Zhang
- Brain Function Laboratory, Department of Psychiatry, Yale School of Medicine, New Haven, CT 06511, USA
| | - J. Adam Noah
- Brain Function Laboratory, Department of Psychiatry, Yale School of Medicine, New Haven, CT 06511, USA
| | | |
Collapse
|
19
|
Zhang Q, Liu Z, Qian H, Hu Y, Gao X. Interpersonal Competition in Elderly Couples: A Functional Near-Infrared Spectroscopy Hyperscanning Study. Brain Sci 2023; 13:brainsci13040600. [PMID: 37190565 DOI: 10.3390/brainsci13040600] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/06/2023] [Revised: 03/14/2023] [Accepted: 03/29/2023] [Indexed: 04/05/2023] Open
Abstract
Elderly people tend not to compete with others, and if they do, the mechanism behind the competition is not clear. In this study, groups of elderly couples and matched cross-sex controls were recruited to perform a competitive button-pressing task, while their brain signals were simultaneously collected using functional near-infrared spectroscopy (fNIRS) hyperscanning. Several fundamental observations were made. First, controls showed attenuated interpersonal competition across task processes, but couples held the competition with each other. Second, couples demonstrated increased inter-brain synchronization (IBS) between the middle temporal cortex and the temporoparietal junction across task processes. Third, Granger causality analysis in couples revealed significant differences between the directions (i.e., from men to women, and from women to men) in the first half of the competitive task, whereas there was no significant difference in the second half. Finally, the groups of couples and controls could be successfully discriminated against based on IBS by using a machine-learning approach. In sum, these findings indicate that elderly couples can maintain interpersonal competition, and such maintenance might be associated with changes in the IBS of the mentalizing system. It suggests the possible positive impact of long-term spouse relationships on interpersonal interactions, both behaviorally and neurally, in terms of competition.
Collapse
Affiliation(s)
- Qian Zhang
- Department of Psychology, Education College, Shanghai Normal University, Shanghai 200234, China
| | - Zhennan Liu
- Department of Psychology, Education College, Shanghai Normal University, Shanghai 200234, China
| | - Haoyue Qian
- Institute of Neuroscience, Key Laboratory of Primate Neurobiology, CAS Center for Excellence in Brain Science and Intelligence Technology, Chinese Academy of Sciences, Shanghai 200031, China
- Shanghai Institute of Early Childhood Education, Shanghai Normal University, Shanghai 200234, China
| | - Yinying Hu
- Department of Psychology, Education College, Shanghai Normal University, Shanghai 200234, China
| | - Xiangping Gao
- Department of Psychology, Education College, Shanghai Normal University, Shanghai 200234, China
| |
Collapse
|
20
|
Endevelt-Shapira Y, Feldman R. Mother-Infant Brain-to-Brain Synchrony Patterns Reflect Caregiving Profiles. BIOLOGY 2023; 12:biology12020284. [PMID: 36829560 PMCID: PMC9953313 DOI: 10.3390/biology12020284] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 12/21/2022] [Revised: 02/05/2023] [Accepted: 02/08/2023] [Indexed: 02/16/2023]
Abstract
Biobehavioral synchrony, the coordination of physiological and behavioral signals between mother and infant during social contact, tunes the child's brain to the social world. Probing this mechanism from a two-brain perspective, we examine the associations between patterns of mother-infant inter-brain synchrony and the two well-studied maternal behavioral orientations-sensitivity and intrusiveness-which have repeatedly been shown to predict positive and negative socio-emotional outcomes, respectively. Using dual-electroencephalogram (EEG) recordings, we measure inter-brain connectivity between 60 mothers and their 5- to 12-month-old infants during face-to-face interaction. Thirty inter-brain connections show significantly higher correlations during the real mother-infant face-to-face interaction compared to surrogate data. Brain-behavior correlations indicate that higher maternal sensitivity linked with greater mother-infant neural synchrony, whereas higher maternal intrusiveness is associated with lower inter-brain coordination. Post hoc analysis reveals that the mother-right-frontal-infant-left-temporal connection is particularly sensitive to the mother's sensitive style, while the mother-left-frontal-infant-right-temporal connection indexes the intrusive style. Our results support the perspective that inter-brain synchrony is a mechanism by which mature brains externally regulate immature brains to social living and suggest that one pathway by which sensitivity and intrusiveness exert their long-term effect may relate to the provision of coordinated inputs to the social brain during its sensitive period of maturation.
Collapse
Affiliation(s)
- Yaara Endevelt-Shapira
- Center for Developmental Social Neuroscience, Reichman University, Herzliya 4610101, Israel
- Correspondence: (Y.E.-S.); (R.F.)
| | - Ruth Feldman
- Center for Developmental Social Neuroscience, Reichman University, Herzliya 4610101, Israel
- Child Study Center, Yale University, New Haven, CT 06520, USA
- Correspondence: (Y.E.-S.); (R.F.)
| |
Collapse
|
21
|
Horowitz-Kraus T, Gashri C. Multimodal Approach for Characterizing the Quality of Parent-Child Interaction: A Single Synchronization Source May Not Tell the Whole Story. BIOLOGY 2023; 12:biology12020241. [PMID: 36829518 PMCID: PMC9952901 DOI: 10.3390/biology12020241] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 12/29/2022] [Revised: 01/31/2023] [Accepted: 02/01/2023] [Indexed: 02/05/2023]
Abstract
The interaction between the parent and child is essential for the child's cognitive and emotional development and sets the path for future well-being. These interactions, starting from birth, are necessary for providing the sensory stimulation the child needs in the critical time window of brain development. The characterization of parent-child interactions is traditionally performed by human decoding. This approach is considered the leading and most accurate way of characterizing the quality of these interactions. However, the development of computational tools and especially the concept of parent-child synchronization opened up an additional source of data characterizing these interactions in an objective, less human-labor manner. Such sources include brain-to-brain, voice/speech, eye contact, motor, and heart-rate synchronization. However, can a single source synchronization dataset accurately represent parent-child interaction? Will attending to the same stimulation, often resulting in a higher brain-to-brain synchronization, be considered an interactive condition? In this perspective, we will try to convey a new concept of the child-parent interaction synchronization (CHIPS) matrix, which includes the different sources of signals generated during an interaction. Such a model may assist in explaining the source of interaction alterations in the case of child/parent developmental/emotional or sensory deficits and may open up new ways of assessing interventions and changes in parent-child interactions along development. We will discuss this interaction during one of the parent-child joint activities providing opportunities for interaction, i.e., storytelling.
Collapse
Affiliation(s)
- Tzipi Horowitz-Kraus
- Educational Neuroimaging Group, Faculty of Education in Science and Technology, Technion, Haifa 3200003, Israel
- Faculty of Biomedical Engineering, Technion, Haifa 3200003, Israel
- Neuropsychology Department, Kennedy Krieger Institute, Baltimore, MD 21205, USA
- Department of Psychiatry and Behavioral Sciences, Johns Hopkins School of Medicine, Baltimore, MD 21205, USA
- Correspondence: ; Tel.: +972-522-989298
| | - Carmel Gashri
- Faculty of Biomedical Engineering, Technion, Haifa 3200003, Israel
| |
Collapse
|
22
|
Parker TC, Zhang X, Noah JA, Tiede M, Scassellati B, Kelley M, McPartland JC, Hirsch J. Neural and visual processing of social gaze cueing in typical and ASD adults. MEDRXIV : THE PREPRINT SERVER FOR HEALTH SCIENCES 2023:2023.01.30.23284243. [PMID: 36778502 PMCID: PMC9915835 DOI: 10.1101/2023.01.30.23284243] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/05/2023]
Abstract
Atypical eye gaze in joint attention is a clinical characteristic of autism spectrum disorder (ASD). Despite this documented symptom, neural processing of joint attention tasks in real-life social interactions is not understood. To address this knowledge gap, functional-near infrared spectroscopy (fNIRS) and eye-tracking data were acquired simultaneously as ASD and typically developed (TD) individuals engaged in a gaze-directed joint attention task with a live human and robot partner. We test the hypothesis that face processing deficits in ASD are greater for interactive faces than for simulated (robot) faces. Consistent with prior findings, neural responses during human gaze cueing modulated by face visual dwell time resulted in increased activity of ventral frontal regions in ASD and dorsal parietal systems in TD participants. Hypoactivity of the right dorsal parietal area during live human gaze cueing was correlated with autism spectrum symptom severity: Brief Observations of Symptoms of Autism (BOSA) scores (r = âˆ'0.86). Contrarily, neural activity in response to robot gaze cueing modulated by visual acquisition factors activated dorsal parietal systems in ASD, and this neural activity was not related to autism symptom severity (r = 0.06). These results are consistent with the hypothesis that altered encoding of incoming facial information to the dorsal parietal cortex is specific to live human faces in ASD. These findings open new directions for understanding joint attention difficulties in ASD by providing a connection between superior parietal lobule activity and live interaction with human faces. Lay Summary Little is known about why it is so difficult for autistic individuals to make eye contact with other people. We find that in a live face-to-face viewing task with a robot, the brains of autistic participants were similar to typical participants but not when the partner was a live human. Findings suggest that difficulties in real-life social situations for autistic individuals may be specific to difficulties with live social interaction rather than general face gaze.
Collapse
|
23
|
Russo C, Senese VP. Functional near-infrared spectroscopy is a useful tool for multi-perspective psychobiological study of neurophysiological correlates of parenting behaviour. Eur J Neurosci 2023; 57:258-284. [PMID: 36485015 DOI: 10.1111/ejn.15890] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/04/2022] [Revised: 12/02/2022] [Accepted: 12/08/2022] [Indexed: 12/13/2022]
Abstract
The quality of the relationship between caregiver and child has long-term effects on the cognitive and socio-emotional development of children. A process involved in human parenting is the bio-behavioural synchrony that occurs between the partners in the relationship during interaction. Through interaction, bio-behavioural synchronicity allows the adaptation of the physiological systems of the parent to those of the child and promotes the positive development and modelling of the child's social brain. The role of bio-behavioural synchrony in building social bonds could be investigated using functional near-infrared spectroscopy (fNIRS). In this paper we have (a) highlighted the importance of the quality of the caregiver-child relationship for the child's cognitive and socio-emotional development, as well as the relevance of infantile stimuli in the activation of parenting behaviour; (b) discussed the tools used in the study of the neurophysiological substrates of the parental response; (c) proposed fNIRS as a particularly suitable tool for the study of parental responses; and (d) underlined the need for a multi-systemic psychobiological approach to understand the mechanisms that regulate caregiver-child interactions and their bio-behavioural synchrony. We propose to adopt a multi-system psychobiological approach to the study of parental behaviour and social interaction.
Collapse
Affiliation(s)
- Carmela Russo
- Psychometric Laboratory, Department of Psychology, University of Campania "Luigi Vanvitelli", Caserta, Italy
| | - Vincenzo Paolo Senese
- Psychometric Laboratory, Department of Psychology, University of Campania "Luigi Vanvitelli", Caserta, Italy
| |
Collapse
|
24
|
Xu M, Morimoto S, Hoshino E, Suzuki K, Minagawa Y. Two-in-one system and behavior-specific brain synchrony during goal-free cooperative creation: an analytical approach combining automated behavioral classification and the event-related generalized linear model. NEUROPHOTONICS 2023; 10:013511. [PMID: 36789283 PMCID: PMC9917717 DOI: 10.1117/1.nph.10.1.013511] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 06/30/2022] [Accepted: 01/13/2023] [Indexed: 06/18/2023]
Abstract
SIGNIFICANCE In hyperscanning studies of natural social interactions, behavioral coding is usually necessary to extract brain synchronizations specific to a particular behavior. The more natural the task is, the heavier the coding effort is. We propose an analytical approach to resolve this dilemma, providing insights and avenues for future work in interactive social neuroscience. AIM The objective is to solve the laborious coding problem for naturalistic hyperscanning by proposing a convenient analytical approach and to uncover brain synchronization mechanisms related to human cooperative behavior when the ultimate goal is highly free and creative. APPROACH This functional near-infrared spectroscopy hyperscanning study challenged a cooperative goal-free creative game in which dyads can communicate freely without time constraints and developed an analytical approach that combines automated behavior classification (computer vision) with a generalized linear model (GLM) in an event-related manner. Thirty-nine dyads participated in this study. RESULTS Conventional wavelet-transformed coherence (WTC) analysis showed that joint play induced robust between-brain synchronization (BBS) among the hub-like superior and middle temporal regions and the frontopolar and dorsomedial/dorsolateral prefrontal cortex (PFC) in the right hemisphere, in contrast to sparse within-brain synchronization (WBS). Contrarily, similar regions within a single brain showed strong WBS with similar connection patterns during independent play. These findings indicate a two-in-one system for performing creative problem-solving tasks. Further, WTC-GLM analysis combined with computer vision successfully extracted BBS, which was specific to the events when one of the participants raised his/her face to the other. This brain-to-brain synchrony between the right dorsolateral PFC and the right temporo-parietal junction suggests joint functioning of these areas when mentalization is necessary under situations with restricted social signals. CONCLUSIONS Our proposed analytical approach combining computer vision and WTC-GLM can be applied to extract inter-brain synchrony associated with social behaviors of interest.
Collapse
Affiliation(s)
- Mingdi Xu
- Keio University, Center for Life-span Development of Communication Skills, Yokohama, Japan
- Keio University, Global Research Institute, Tokyo, Japan
| | - Satoshi Morimoto
- Keio University, Center for Life-span Development of Communication Skills, Yokohama, Japan
- Keio University, Global Research Institute, Tokyo, Japan
| | - Eiichi Hoshino
- Keio University, Center for Life-span Development of Communication Skills, Yokohama, Japan
- Keio University, Global Research Institute, Tokyo, Japan
| | - Kenji Suzuki
- University of Tsukuba, Faculty of Engineering, Information and Systems, Tsukuba, Japan
| | - Yasuyo Minagawa
- Keio University, Center for Life-span Development of Communication Skills, Yokohama, Japan
- Keio University, Department of Psychology, Faculty of Letters, Tokyo, Japan
| |
Collapse
|
25
|
Schwartz L, Levy J, Endevelt-Shapira Y, Djalovski A, Hayut O, Dumas G, Feldman R. Technologically-assisted communication attenuates inter-brain synchrony. Neuroimage 2022; 264:119677. [PMID: 36244598 DOI: 10.1016/j.neuroimage.2022.119677] [Citation(s) in RCA: 14] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/18/2022] [Revised: 10/06/2022] [Accepted: 10/07/2022] [Indexed: 11/06/2022] Open
Abstract
The transition to technologically-assisted communication has permeated all facets of human social life; yet, its impact on the social brain is still unknown and the effects may be particularly intense during periods of developmental transitions. Applying a two-brain perspective, the current preregistered study utilized hyperscanning EEG to measure brain-to-brain synchrony in 62 mother-child pairs at the transition to adolescence (child age; M = 12.26, range 10-14) during live face-to-face interaction versus technologically-assisted remote communication. The live interaction elicited 9 significant cross-brain links between densely inter-connected frontal and temporal areas in the beta range [14-30 Hz]. Mother's right frontal region connected with the child's right and left frontal, temporal, and central regions, suggesting its regulatory role in organizing the two-brain dynamics. In contrast, the remote interaction elicited only 1 significant cross-brain-cross-hemisphere link, attenuating the robust right-to-right-brain connectivity during live social moments that communicates socio-affective signals. Furthermore, while the level of social behavior was comparable between the two interactions, brain-behavior associations emerged only during the live exchange. Mother-child right temporal-temporal synchrony linked with moments of shared gaze and the degree of child engagement and empathic behavior correlated with right frontal-frontal synchrony. Our findings indicate that human co-presence is underpinned by specific neurobiological processes that should be studied in depth. Much further research is needed to tease apart whether the "Zoom fatigue" experienced during technological communication may stem, in part, from overload on more limited inter-brain connections and to address the potential cost of social technology for brain maturation, particularly among youth.
Collapse
Affiliation(s)
- Linoy Schwartz
- Center for Developmental Social Neuroscience, Reichman University, Herzliya, Israel
| | - Jonathan Levy
- Center for Developmental Social Neuroscience, Reichman University, Herzliya, Israel; Department of Neuroscience and Biomedical Engineering, Aalto University, Finland
| | | | - Amir Djalovski
- Center for Developmental Social Neuroscience, Reichman University, Herzliya, Israel
| | - Olga Hayut
- Center for Developmental Social Neuroscience, Reichman University, Herzliya, Israel
| | - Guillaume Dumas
- Precision Psychiatry and Social Physiology laboratory, CHU Sainte-Justine Research Center, Department of Psychiatry, Université de Montréal, Montreal, QC, Canada
| | - Ruth Feldman
- Center for Developmental Social Neuroscience, Reichman University, Herzliya, Israel; Child Study Center, Yale University, United States.
| |
Collapse
|
26
|
Hasegawa Y, Sakuramoto A, Suzuki T, Sakagami J, Shiramizu M, Tachibana Y, Kishimoto H, Ono Y, Ono T. Emotional modulation of cortical activity during gum chewing: A functional near-infrared spectroscopy study. Front Neurosci 2022; 16:964351. [DOI: 10.3389/fnins.2022.964351] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/08/2022] [Accepted: 11/10/2022] [Indexed: 11/30/2022] Open
Abstract
Distinct brain regions are known to be associated with various emotional states. Cortical activity may be modulated by emotional states that are triggered by flavors during food intake. We examined cortical activity during chewing with different flavors and assessed the emotional modulation of cortical activity using multichannel near-infrared spectroscopy. Thirty-six right-handed volunteers participated in this crossover trial. The participants experienced positive and negative emotions from chewing flavorful (palatable) or less flavorful (unpalatable) gums, respectively for 5 min. Participants rated the taste, odor, and deliciousness of each gum using a visual analog scale. Bilateral hemodynamic responses in the frontal and parietal lobes, bilateral masseter muscle activation, and heart rate were measured during gum chewing. Changes in all measured data during gum chewing were also evaluated. The ratings of the tastes and odors of each gum significantly differed among the participants (P < 0.001). Hemodynamic response changes were significantly elevated in the bilateral primary sensorimotor cortex during gum-chewing, in comparison to resting. The difference in hemodynamic responses between palatable and unpalatable gum conditions was detected in the left frontopolar/dorsolateral prefrontal cortex. Muscle activation and heart rate were not significantly different between different gum types. Our findings indicate that differential processing in the left prefrontal cortex might be responsible for the emotional states caused by palatable and unpalatable foods.
Collapse
|
27
|
Hirsch J, Zhang X, Noah JA, Dravida S, Naples A, Tiede M, Wolf JM, McPartland JC. Neural correlates of eye contact and social function in autism spectrum disorder. PLoS One 2022; 17:e0265798. [PMID: 36350848 PMCID: PMC9645655 DOI: 10.1371/journal.pone.0265798] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/07/2022] [Accepted: 10/06/2022] [Indexed: 11/11/2022] Open
Abstract
Reluctance to make eye contact during natural interactions is a central diagnostic criterion for autism spectrum disorder (ASD). However, the underlying neural correlates for eye contacts in ASD are unknown, and diagnostic biomarkers are active areas of investigation. Here, neuroimaging, eye-tracking, and pupillometry data were acquired simultaneously using two-person functional near-infrared spectroscopy (fNIRS) during live "in-person" eye-to-eye contact and eye-gaze at a video face for typically-developed (TD) and participants with ASD to identify the neural correlates of live eye-to-eye contact in both groups. Comparisons between ASD and TD showed decreased right dorsal-parietal activity and increased right ventral temporal-parietal activity for ASD during live eye-to-eye contact (p≤0.05, FDR-corrected) and reduced cross-brain coherence consistent with atypical neural systems for live eye contact. Hypoactivity of right dorsal-parietal regions during eye contact in ASD was further associated with gold standard measures of social performance by the correlation of neural responses and individual measures of: ADOS-2, Autism Diagnostic Observation Schedule, 2nd Edition (r = -0.76, -0.92 and -0.77); and SRS-2, Social Responsiveness Scale, Second Edition (r = -0.58). The findings indicate that as categorized social ability decreases, neural responses to real eye-contact in the right dorsal parietal region also decrease consistent with a neural correlate for social characteristics in ASD.
Collapse
Affiliation(s)
- Joy Hirsch
- Brain Function Laboratory, Department of Psychiatry, Yale School of Medicine, New Haven, CT, United States of America
- Interdepartmental Neuroscience Program, Yale School of Medicine, New Haven, CT, United States of America
- Department of Neuroscience, Yale School of Medicine, New Haven, CT, United States of America
- Department of Comparative Medicine, Yale School of Medicine, New Haven, CT, United States of America
- Department of Medical Physics and Biomedical Engineering, University College London, London, United Kingdom
- Haskins Laboratories, New Haven, CT, United States of America
| | - Xian Zhang
- Brain Function Laboratory, Department of Psychiatry, Yale School of Medicine, New Haven, CT, United States of America
| | - J. Adam Noah
- Brain Function Laboratory, Department of Psychiatry, Yale School of Medicine, New Haven, CT, United States of America
| | - Swethasri Dravida
- Brain Function Laboratory, Department of Psychiatry, Yale School of Medicine, New Haven, CT, United States of America
- Interdepartmental Neuroscience Program, Yale School of Medicine, New Haven, CT, United States of America
| | - Adam Naples
- Yale Child Study Center, New Haven, CT, United States of America
| | - Mark Tiede
- Brain Function Laboratory, Department of Psychiatry, Yale School of Medicine, New Haven, CT, United States of America
- Haskins Laboratories, New Haven, CT, United States of America
| | - Julie M. Wolf
- Yale Child Study Center, New Haven, CT, United States of America
| | | |
Collapse
|
28
|
Tsoi L, Burns SM, Falk EB, Tamir DI. The promises and pitfalls of functional magnetic resonance imaging hyperscanning for social interaction research. SOCIAL AND PERSONALITY PSYCHOLOGY COMPASS 2022; 16:e12707. [PMID: 36407123 PMCID: PMC9667901 DOI: 10.1111/spc3.12707] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/03/2022] [Revised: 08/23/2022] [Accepted: 08/26/2022] [Indexed: 11/28/2022]
Abstract
Social neuroscience combines tools and perspectives from social psychology and neuroscience to understand how people interact with their social world. Here we discuss a relatively new method-hyperscanning-to study real-time, interactive social interactions using functional magnetic resonance imaging (fMRI). We highlight three contributions that fMRI hyperscanning makes to the study of the social mind: (1) Naturalism: it shifts the focus from tightly-controlled stimuli to more naturalistic social interactions; (2) Multi-person Dynamics: it shifts the focus from individuals as the unit of analysis to dyads and groups; and (3) Neural Resolution: fMRI hyperscanning captures high-resolution neural patterns and dynamics across the whole brain, unlike other neuroimaging hyperscanning methods (e.g., electroencephalogram, functional near-infrared spectroscopy). Finally, we describe the practical considerations and challenges that fMRI hyperscanning researchers must navigate. We hope researchers will harness this powerful new paradigm to address pressing questions in today's society.
Collapse
Affiliation(s)
- Lily Tsoi
- School of Psychology and CounselingCaldwell UniversityCaldwellNew JerseyUSA
| | - Shannon M. Burns
- Department of Psychological SciencePomona CollegeClaremontCaliforniaUSA,Department of NeurosciencePomona CollegeClaremontCaliforniaUSA
| | - Emily B. Falk
- Annenberg School for CommunicationUniversity of PennsylvaniaPhiladelphiaPennsylvaniaUSA,Department of PsychologyUniversity of PennsylvaniaPhiladelphiaPennsylvaniaUSA,Wharton Marketing DepartmentUniversity of PennsylvaniaPhiladelphiaPennsylvaniaUSA,Operations, Information, and Decisions DepartmentUniversity of PennsylvaniaPhiladelphiaPennsylvaniaUSA
| | - Diana I. Tamir
- Department of PsychologyPrinceton UniversityPrincetonNew JerseyUSA,Princeton Neuroscience InstitutePrinceton UniversityPrincetonNew JerseyUSA
| |
Collapse
|
29
|
Hsu CT, Sato W, Kochiyama T, Nakai R, Asano K, Abe N, Yoshikawa S. Enhanced Mirror Neuron Network Activity and Effective Connectivity during Live Interaction Among Female Subjects. Neuroimage 2022; 263:119655. [PMID: 36182055 DOI: 10.1016/j.neuroimage.2022.119655] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/10/2022] [Revised: 09/26/2022] [Accepted: 09/27/2022] [Indexed: 11/24/2022] Open
Abstract
Facial expressions are indispensable in daily human communication. Previous neuroimaging studies investigating facial expression processing have presented pre-recorded stimuli and lacked live face-to-face interaction. Our paradigm alternated between presentations of real-time model performance and pre-recorded videos of dynamic facial expressions to participants. Simultaneous functional magnetic resonance imaging (fMRI) and facial electromyography activity recordings, as well as post-scan valence and arousal ratings were acquired from 44 female participants. Live facial expressions enhanced the subjective valence and arousal ratings as well as facial muscular responses. Live performances showed greater engagement of the right posterior superior temporal sulcus (pSTS), right inferior frontal gyrus (IFG), right amygdala and right fusiform gyrus, and modulated the effective connectivity within the right mirror neuron system (IFG, pSTS, and right inferior parietal lobule). A support vector machine algorithm could classify multivoxel activation patterns in brain regions involved in dynamic facial expression processing in the mentalizing networks (anterior and posterior cingulate cortex). These results indicate that live social interaction modulates the activity and connectivity of the right mirror neuron system and enhances spontaneous mimicry, further facilitating emotional contagion.
Collapse
Affiliation(s)
- Chun-Ting Hsu
- Psychological Process Research Team, Guardian Robot Project, RIKEN, 2-2-2 Hikaridai, Seika-cho, Soraku-gun, Kyoto 619-0288, Japan..
| | - Wataru Sato
- Psychological Process Research Team, Guardian Robot Project, RIKEN, 2-2-2 Hikaridai, Seika-cho, Soraku-gun, Kyoto 619-0288, Japan..
| | - Takanori Kochiyama
- Brain Activity Imaging Center, ATR- Promotions, Inc., 2-2-2 Hikaridai, Seika-cho, Soraku-gun, Kyoto 619-0288, Japan
| | - Ryusuke Nakai
- Institute for the Future of Human Society, Kyoto University, 46 Yoshidashimoadachi-cho, Sakyo-ku, Kyoto, 606-8501 Japan
| | - Kohei Asano
- Institute for the Future of Human Society, Kyoto University, 46 Yoshidashimoadachi-cho, Sakyo-ku, Kyoto, 606-8501 Japan; Department of Children Education, Osaka University of Comprehensive Children Education, 6-chome-4-26 Yuzato, Higashisumiyoshi Ward, Osaka, 546-0013, Japan
| | - Nobuhito Abe
- Institute for the Future of Human Society, Kyoto University, 46 Yoshidashimoadachi-cho, Sakyo-ku, Kyoto, 606-8501 Japan
| | - Sakiko Yoshikawa
- Institute of Philosophy and Human Values, Kyoto University of the Arts, 2-116 Uryuyama Kitashirakawa, Sakyo, Kyoto, Kyoto 606-8271, Japan
| |
Collapse
|
30
|
Lin JFL, Imada T, Meltzoff AN, Hiraishi H, Ikeda T, Takahashi T, Hasegawa C, Yoshimura Y, Kikuchi M, Hirata M, Minabe Y, Asada M, Kuhl PK. Dual-MEG interbrain synchronization during turn-taking verbal interactions between mothers and children. Cereb Cortex 2022; 33:4116-4134. [PMID: 36130088 PMCID: PMC10068303 DOI: 10.1093/cercor/bhac330] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/29/2021] [Revised: 07/26/2022] [Accepted: 07/27/2022] [Indexed: 11/14/2022] Open
Abstract
Verbal interaction and imitation are essential for language learning and development in young children. However, it is unclear how mother-child dyads synchronize oscillatory neural activity at the cortical level in turn-based speech interactions. Our study investigated interbrain synchrony in mother-child pairs during a turn-taking paradigm of verbal imitation. A dual-MEG (magnetoencephalography) setup was used to measure brain activity from interactive mother-child pairs simultaneously. Interpersonal neural synchronization was compared between socially interactive and noninteractive tasks (passive listening to pure tones). Interbrain networks showed increased synchronization during the socially interactive compared to noninteractive conditions in the theta and alpha bands. Enhanced interpersonal brain synchrony was observed in the right angular gyrus, right triangular, and left opercular parts of the inferior frontal gyrus. Moreover, these parietal and frontal regions appear to be the cortical hubs exhibiting a high number of interbrain connections. These cortical areas could serve as a neural marker for the interactive component in verbal social communication. The present study is the first to investigate mother-child interbrain neural synchronization during verbal social interactions using a dual-MEG setup. Our results advance our understanding of turn-taking during verbal interaction between mother-child dyads and suggest a role for social "gating" in language learning.
Collapse
Affiliation(s)
- Jo-Fu Lotus Lin
- Institute for Learning & Brain Sciences (I-LABS), University of Washington, Portage Bay Building, University of Washington, Seattle, WA 98105, USA.,Research Center for Child Mental Development, Graduate School of Medical Science, Kanazawa University, 13-1 Takaramachi, Kanazawa-City, Ishikawa-Ken 920-8640, Japan.,Institute of Linguistics, National Tsing Hua University, 101, Section 2, Kuang-Fu Road, Hsinchu 300044, Taiwan
| | - Toshiaki Imada
- Institute for Learning & Brain Sciences (I-LABS), University of Washington, Portage Bay Building, University of Washington, Seattle, WA 98105, USA.,Research Center for Child Mental Development, Graduate School of Medical Science, Kanazawa University, 13-1 Takaramachi, Kanazawa-City, Ishikawa-Ken 920-8640, Japan
| | - Andrew N Meltzoff
- Institute for Learning & Brain Sciences (I-LABS), University of Washington, Portage Bay Building, University of Washington, Seattle, WA 98105, USA
| | - Hirotoshi Hiraishi
- Hamamatsu University School of Medicine, 1 Chome-20-1 Handayama, Higashi Ward, Hamamatsu, Shizuoka 431-3192, Japan
| | - Takashi Ikeda
- Research Center for Child Mental Development, Graduate School of Medical Science, Kanazawa University, 13-1 Takaramachi, Kanazawa-City, Ishikawa-Ken 920-8640, Japan
| | | | - Chiaki Hasegawa
- Research Center for Child Mental Development, Graduate School of Medical Science, Kanazawa University, 13-1 Takaramachi, Kanazawa-City, Ishikawa-Ken 920-8640, Japan
| | - Yuko Yoshimura
- Research Center for Child Mental Development, Graduate School of Medical Science, Kanazawa University, 13-1 Takaramachi, Kanazawa-City, Ishikawa-Ken 920-8640, Japan
| | - Mitsuru Kikuchi
- Research Center for Child Mental Development, Graduate School of Medical Science, Kanazawa University, 13-1 Takaramachi, Kanazawa-City, Ishikawa-Ken 920-8640, Japan
| | - Masayuki Hirata
- Department of Neurosurgery, Osaka University Medical School, 2 Chome-2 Yamadaoka, Suita, Osaka 565-0871, Japan
| | - Yoshio Minabe
- Research Center for Child Mental Development, Graduate School of Medical Science, Kanazawa University, 13-1 Takaramachi, Kanazawa-City, Ishikawa-Ken 920-8640, Japan
| | - Minoru Asada
- Department of Adaptive Machine Systems, Graduate School of Engineering, Osaka University, 2-1 Yamadaoka, Suita, Osaka 565-0871, Japan
| | - Patricia K Kuhl
- Institute for Learning & Brain Sciences (I-LABS), University of Washington, Portage Bay Building, University of Washington, Seattle, WA 98105, USA
| |
Collapse
|
31
|
Jackson ES, Dravida S, Zhang X, Noah JA, Gracco V, Hirsch J. Activation in Right Dorsolateral Prefrontal Cortex Underlies Stuttering Anticipation. NEUROBIOLOGY OF LANGUAGE (CAMBRIDGE, MASS.) 2022; 3:469-494. [PMID: 37216062 PMCID: PMC10158639 DOI: 10.1162/nol_a_00073] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 08/02/2021] [Accepted: 05/16/2022] [Indexed: 05/24/2023]
Abstract
People who stutter learn to anticipate many of their overt stuttering events. Despite the critical role of anticipation, particularly how responses to anticipation shape stuttering behaviors, the neural bases associated with anticipation are unknown. We used a novel approach to identify anticipated and unanticipated words, which were produced by 22 adult stutterers in a delayed-response task while hemodynamic activity was measured using functional near infrared spectroscopy (fNIRS). Twenty-two control participants were included such that each individualized set of anticipated and unanticipated words was produced by one stutterer and one control participant. We conducted an analysis on the right dorsolateral prefrontal cortex (R-DLPFC) based on converging lines of evidence from the stuttering and cognitive control literatures. We also assessed connectivity between the R-DLPFC and right supramarginal gyrus (R-SMG), two key nodes of the frontoparietal network (FPN), to assess the role of cognitive control, and particularly error-likelihood monitoring, in stuttering anticipation. All analyses focused on the five-second anticipation phase preceding the go signal to produce speech. The results indicate that anticipated words are associated with elevated activation in the R-DLPFC, and that compared to non-stutterers, stutterers exhibit greater activity in the R-DLPFC, irrespective of anticipation. Further, anticipated words are associated with reduced connectivity between the R-DLPFC and R-SMG. These findings highlight the potential roles of the R-DLPFC and the greater FPN as a neural substrate of stuttering anticipation. The results also support previous accounts of error-likelihood monitoring and action-stopping in stuttering anticipation. Overall, this work offers numerous directions for future research with clinical implications for targeted neuromodulation.
Collapse
Affiliation(s)
- Eric S. Jackson
- Department of Communicative Sciences and Disorders, New York University, New York, USA
| | - Swethasri Dravida
- Department of Psychiatry, Yale School of Medicine, New Haven, CT, USA
| | - Xian Zhang
- Department of Psychiatry, Yale School of Medicine, New Haven, CT, USA
| | - J. Adam Noah
- Department of Psychiatry, Yale School of Medicine, New Haven, CT, USA
| | - Vincent Gracco
- Haskins Laboratories, New Haven, CT, USA
- McGill University, Montreal, Canada
| | - Joy Hirsch
- Department of Psychiatry, Yale School of Medicine, New Haven, CT, USA
- Department of Neuroscience, Department of Comparative Medicine, Yale School of Medicine, New Haven, CT, USA
- Department of Medical Physics and Biomedical Engineering, University College London, London, UK
| |
Collapse
|
32
|
Ayaz H, Baker WB, Blaney G, Boas DA, Bortfeld H, Brady K, Brake J, Brigadoi S, Buckley EM, Carp SA, Cooper RJ, Cowdrick KR, Culver JP, Dan I, Dehghani H, Devor A, Durduran T, Eggebrecht AT, Emberson LL, Fang Q, Fantini S, Franceschini MA, Fischer JB, Gervain J, Hirsch J, Hong KS, Horstmeyer R, Kainerstorfer JM, Ko TS, Licht DJ, Liebert A, Luke R, Lynch JM, Mesquida J, Mesquita RC, Naseer N, Novi SL, Orihuela-Espina F, O’Sullivan TD, Peterka DS, Pifferi A, Pollonini L, Sassaroli A, Sato JR, Scholkmann F, Spinelli L, Srinivasan VJ, St. Lawrence K, Tachtsidis I, Tong Y, Torricelli A, Urner T, Wabnitz H, Wolf M, Wolf U, Xu S, Yang C, Yodh AG, Yücel MA, Zhou W. Optical imaging and spectroscopy for the study of the human brain: status report. NEUROPHOTONICS 2022; 9:S24001. [PMID: 36052058 PMCID: PMC9424749 DOI: 10.1117/1.nph.9.s2.s24001] [Citation(s) in RCA: 40] [Impact Index Per Article: 20.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/14/2023]
Abstract
This report is the second part of a comprehensive two-part series aimed at reviewing an extensive and diverse toolkit of novel methods to explore brain health and function. While the first report focused on neurophotonic tools mostly applicable to animal studies, here, we highlight optical spectroscopy and imaging methods relevant to noninvasive human brain studies. We outline current state-of-the-art technologies and software advances, explore the most recent impact of these technologies on neuroscience and clinical applications, identify the areas where innovation is needed, and provide an outlook for the future directions.
Collapse
Affiliation(s)
- Hasan Ayaz
- Drexel University, School of Biomedical Engineering, Science, and Health Systems, Philadelphia, Pennsylvania, United States
- Drexel University, College of Arts and Sciences, Department of Psychological and Brain Sciences, Philadelphia, Pennsylvania, United States
| | - Wesley B. Baker
- Children’s Hospital of Philadelphia, Division of Neurology, Philadelphia, Pennsylvania, United States
- Perelman School of Medicine at the University of Pennsylvania, Philadelphia, Pennsylvania, United States
| | - Giles Blaney
- Tufts University, Department of Biomedical Engineering, Medford, Massachusetts, United States
| | - David A. Boas
- Boston University Neurophotonics Center, Boston, Massachusetts, United States
- Boston University, College of Engineering, Department of Biomedical Engineering, Boston, Massachusetts, United States
| | - Heather Bortfeld
- University of California, Merced, Departments of Psychological Sciences and Cognitive and Information Sciences, Merced, California, United States
| | - Kenneth Brady
- Lurie Children’s Hospital, Northwestern University Feinberg School of Medicine, Department of Anesthesiology, Chicago, Illinois, United States
| | - Joshua Brake
- Harvey Mudd College, Department of Engineering, Claremont, California, United States
| | - Sabrina Brigadoi
- University of Padua, Department of Developmental and Social Psychology, Padua, Italy
| | - Erin M. Buckley
- Georgia Institute of Technology, Wallace H. Coulter Department of Biomedical Engineering, Atlanta, Georgia, United States
- Emory University School of Medicine, Department of Pediatrics, Atlanta, Georgia, United States
| | - Stefan A. Carp
- Massachusetts General Hospital, Harvard Medical School, Athinoula A. Martinos Center for Biomedical Imaging, Charlestown, Massachusetts, United States
| | - Robert J. Cooper
- University College London, Department of Medical Physics and Bioengineering, DOT-HUB, London, United Kingdom
| | - Kyle R. Cowdrick
- Georgia Institute of Technology, Wallace H. Coulter Department of Biomedical Engineering, Atlanta, Georgia, United States
| | - Joseph P. Culver
- Washington University School of Medicine, Department of Radiology, St. Louis, Missouri, United States
| | - Ippeita Dan
- Chuo University, Faculty of Science and Engineering, Tokyo, Japan
| | - Hamid Dehghani
- University of Birmingham, School of Computer Science, Birmingham, United Kingdom
| | - Anna Devor
- Boston University, College of Engineering, Department of Biomedical Engineering, Boston, Massachusetts, United States
| | - Turgut Durduran
- ICFO – The Institute of Photonic Sciences, The Barcelona Institute of Science and Technology, Castelldefels, Barcelona, Spain
- Institució Catalana de Recerca I Estudis Avançats (ICREA), Barcelona, Spain
| | - Adam T. Eggebrecht
- Washington University in St. Louis, Mallinckrodt Institute of Radiology, St. Louis, Missouri, United States
| | - Lauren L. Emberson
- University of British Columbia, Department of Psychology, Vancouver, British Columbia, Canada
| | - Qianqian Fang
- Northeastern University, Department of Bioengineering, Boston, Massachusetts, United States
| | - Sergio Fantini
- Tufts University, Department of Biomedical Engineering, Medford, Massachusetts, United States
| | - Maria Angela Franceschini
- Massachusetts General Hospital, Harvard Medical School, Athinoula A. Martinos Center for Biomedical Imaging, Charlestown, Massachusetts, United States
| | - Jonas B. Fischer
- ICFO – The Institute of Photonic Sciences, The Barcelona Institute of Science and Technology, Castelldefels, Barcelona, Spain
| | - Judit Gervain
- University of Padua, Department of Developmental and Social Psychology, Padua, Italy
- Université Paris Cité, CNRS, Integrative Neuroscience and Cognition Center, Paris, France
| | - Joy Hirsch
- Yale School of Medicine, Department of Psychiatry, Neuroscience, and Comparative Medicine, New Haven, Connecticut, United States
- University College London, Department of Medical Physics and Biomedical Engineering, London, United Kingdom
| | - Keum-Shik Hong
- Pusan National University, School of Mechanical Engineering, Busan, Republic of Korea
- Qingdao University, School of Automation, Institute for Future, Qingdao, China
| | - Roarke Horstmeyer
- Duke University, Department of Biomedical Engineering, Durham, North Carolina, United States
- Duke University, Department of Electrical and Computer Engineering, Durham, North Carolina, United States
- Duke University, Department of Physics, Durham, North Carolina, United States
| | - Jana M. Kainerstorfer
- Carnegie Mellon University, Department of Biomedical Engineering, Pittsburgh, Pennsylvania, United States
- Carnegie Mellon University, Neuroscience Institute, Pittsburgh, Pennsylvania, United States
| | - Tiffany S. Ko
- Children’s Hospital of Philadelphia, Division of Cardiothoracic Anesthesiology, Philadelphia, Pennsylvania, United States
| | - Daniel J. Licht
- Children’s Hospital of Philadelphia, Division of Neurology, Philadelphia, Pennsylvania, United States
| | - Adam Liebert
- Polish Academy of Sciences, Nalecz Institute of Biocybernetics and Biomedical Engineering, Warsaw, Poland
| | - Robert Luke
- Macquarie University, Department of Linguistics, Sydney, New South Wales, Australia
- Macquarie University Hearing, Australia Hearing Hub, Sydney, New South Wales, Australia
| | - Jennifer M. Lynch
- Children’s Hospital of Philadelphia, Division of Cardiothoracic Anesthesiology, Philadelphia, Pennsylvania, United States
| | - Jaume Mesquida
- Parc Taulí Hospital Universitari, Critical Care Department, Sabadell, Spain
| | - Rickson C. Mesquita
- University of Campinas, Institute of Physics, Campinas, São Paulo, Brazil
- Brazilian Institute of Neuroscience and Neurotechnology, Campinas, São Paulo, Brazil
| | - Noman Naseer
- Air University, Department of Mechatronics and Biomedical Engineering, Islamabad, Pakistan
| | - Sergio L. Novi
- University of Campinas, Institute of Physics, Campinas, São Paulo, Brazil
- Western University, Department of Physiology and Pharmacology, London, Ontario, Canada
| | | | - Thomas D. O’Sullivan
- University of Notre Dame, Department of Electrical Engineering, Notre Dame, Indiana, United States
| | - Darcy S. Peterka
- Columbia University, Zuckerman Mind Brain Behaviour Institute, New York, United States
| | | | - Luca Pollonini
- University of Houston, Department of Engineering Technology, Houston, Texas, United States
| | - Angelo Sassaroli
- Tufts University, Department of Biomedical Engineering, Medford, Massachusetts, United States
| | - João Ricardo Sato
- Federal University of ABC, Center of Mathematics, Computing and Cognition, São Bernardo do Campo, São Paulo, Brazil
| | - Felix Scholkmann
- University of Bern, Institute of Complementary and Integrative Medicine, Bern, Switzerland
- University of Zurich, University Hospital Zurich, Department of Neonatology, Biomedical Optics Research Laboratory, Zürich, Switzerland
| | - Lorenzo Spinelli
- National Research Council (CNR), IFN – Institute for Photonics and Nanotechnologies, Milan, Italy
| | - Vivek J. Srinivasan
- University of California Davis, Department of Biomedical Engineering, Davis, California, United States
- NYU Langone Health, Department of Ophthalmology, New York, New York, United States
- NYU Langone Health, Department of Radiology, New York, New York, United States
| | - Keith St. Lawrence
- Lawson Health Research Institute, Imaging Program, London, Ontario, Canada
- Western University, Department of Medical Biophysics, London, Ontario, Canada
| | - Ilias Tachtsidis
- University College London, Department of Medical Physics and Biomedical Engineering, London, United Kingdom
| | - Yunjie Tong
- Purdue University, Weldon School of Biomedical Engineering, West Lafayette, Indiana, United States
| | - Alessandro Torricelli
- Politecnico di Milano, Dipartimento di Fisica, Milan, Italy
- National Research Council (CNR), IFN – Institute for Photonics and Nanotechnologies, Milan, Italy
| | - Tara Urner
- Georgia Institute of Technology, Wallace H. Coulter Department of Biomedical Engineering, Atlanta, Georgia, United States
| | - Heidrun Wabnitz
- Physikalisch-Technische Bundesanstalt (PTB), Berlin, Germany
| | - Martin Wolf
- University of Zurich, University Hospital Zurich, Department of Neonatology, Biomedical Optics Research Laboratory, Zürich, Switzerland
| | - Ursula Wolf
- University of Bern, Institute of Complementary and Integrative Medicine, Bern, Switzerland
| | - Shiqi Xu
- Duke University, Department of Biomedical Engineering, Durham, North Carolina, United States
| | - Changhuei Yang
- California Institute of Technology, Department of Electrical Engineering, Pasadena, California, United States
| | - Arjun G. Yodh
- University of Pennsylvania, Department of Physics and Astronomy, Philadelphia, Pennsylvania, United States
| | - Meryem A. Yücel
- Boston University Neurophotonics Center, Boston, Massachusetts, United States
- Boston University, College of Engineering, Department of Biomedical Engineering, Boston, Massachusetts, United States
| | - Wenjun Zhou
- University of California Davis, Department of Biomedical Engineering, Davis, California, United States
- China Jiliang University, College of Optical and Electronic Technology, Hangzhou, Zhejiang, China
| |
Collapse
|
33
|
Crum J, Zhang X, Noah A, Hamilton A, Tachtsidis I, Burgess PW, Hirsch J. An Approach to Neuroimaging Interpersonal Interactions in Mental Health Interventions. BIOLOGICAL PSYCHIATRY. COGNITIVE NEUROSCIENCE AND NEUROIMAGING 2022; 7:669-679. [PMID: 35144035 PMCID: PMC9271588 DOI: 10.1016/j.bpsc.2022.01.008] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/12/2021] [Revised: 12/31/2021] [Accepted: 01/25/2022] [Indexed: 11/20/2022]
Abstract
BACKGROUND Conventional paradigms in clinical neuroscience tend to be constrained in terms of ecological validity, raising several challenges to studying the mechanisms mediating treatments and outcomes in clinical settings. Addressing these issues requires real-world neuroimaging techniques that are capable of continuously collecting data during free-flowing interpersonal interactions and that allow for experimental designs that are representative of the clinical situations in which they occur. METHODS In this work, we developed a paradigm that fractionates the major components of human-to-human verbal interactions occurring in clinical situations and used functional near-infrared spectroscopy to assess the brain systems underlying clinician-client discourse (N = 30). RESULTS Cross-brain neural coupling between people was significantly greater during clinical interactions compared with everyday life verbal communication, particularly between the prefrontal cortex (e.g., inferior frontal gyrus) and inferior parietal lobule (e.g., supramarginal gyrus). The clinical tasks revealed extensive increases in activity across the prefrontal cortex, especially in the rostral prefrontal cortex (area 10), during periods in which participants were required to silently reason about the dysfunctional cognitions of the other person. CONCLUSIONS This work demonstrates a novel experimental approach to investigating the neural underpinnings of interpersonal interactions that typically occur in clinical settings, and its findings support the idea that particular prefrontal systems might be critical to cultivating mental health.
Collapse
Affiliation(s)
- James Crum
- Institute of Cognitive Neuroscience, University College London, London, United Kingdom.
| | - Xian Zhang
- Brain Function Laboratory, Department of Psychiatry, Yale School of Medicine, New Haven, Connecticut
| | - Adam Noah
- Brain Function Laboratory, Department of Psychiatry, Yale School of Medicine, New Haven, Connecticut
| | - Antonia Hamilton
- Institute of Cognitive Neuroscience, University College London, London, United Kingdom
| | - Ilias Tachtsidis
- Department of Medical Physics and Biomedical Engineering, University College London, London, United Kingdom
| | - Paul W Burgess
- Institute of Cognitive Neuroscience, University College London, London, United Kingdom
| | - Joy Hirsch
- Department of Medical Physics and Biomedical Engineering, University College London, London, United Kingdom; Brain Function Laboratory, Department of Psychiatry, Yale School of Medicine, New Haven, Connecticut; Department of Neuroscience, Yale School of Medicine, New Haven, Connecticut; Department of Comparative Medicine, Yale School of Medicine, New Haven, Connecticut
| |
Collapse
|
34
|
Social signalling as a framework for second-person neuroscience. Psychon Bull Rev 2022; 29:2083-2095. [PMID: 35650463 DOI: 10.3758/s13423-022-02103-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 04/07/2022] [Indexed: 11/08/2022]
Abstract
Despite the recent increase in second-person neuroscience research, it is still hard to understand which neurocognitive mechanisms underlie real-time social behaviours. Here, we propose that social signalling can help us understand social interactions both at the single- and two-brain level in terms of social signal exchanges between senders and receivers. First, we show how subtle manipulations of being watched provide an important tool to dissect meaningful social signals. We then focus on how social signalling can help us build testable hypotheses for second-person neuroscience with the example of imitation and gaze behaviour. Finally, we suggest that linking neural activity to specific social signals will be key to fully understand the neurocognitive systems engaged during face-to-face interactions.
Collapse
|
35
|
Kaiser N, Henry K, Eyjólfsdóttir H. Eye Contact in Video Communication: Experiences of Co-creating Relationships. Front Psychol 2022; 13:852692. [PMID: 35572344 PMCID: PMC9094362 DOI: 10.3389/fpsyg.2022.852692] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/11/2022] [Accepted: 03/11/2022] [Indexed: 11/30/2022] Open
Abstract
As a result of the COVID-19 pandemic, increased number of persons have been forced to limit their interactions with friends and families to contact via video, which excludes eye-contact. The aim of this study was to examine individuals’ experiences of the difference between forced skewed visuality and the ability for eye-contact in conversations. Two custom-made units allowed 15 participants interacting in dyads to alternate between being able to make eye contact and having that ability removed through skewed visuality. Participants reported their experiences in semi-structured interviews. Data analyzed with qualitative content analysis resulted in three themes: Shared eye contact allows us to create our relationship together; With eye contact, we adjust to each other to feel more connected and less intimidated; and We get more self-conscious when the visuality is skewed or shifting. The results imply that skewed visuality as forced lack of eye-contact in video conversations effects embodied non-verbal processes related to sense of connectedness and participatory sensemaking, creating a sense of both emotional and physical distance, as well as heightening self-awareness about the need of actively regulating the other. We argue that this is one of the ways to understand the impact of moving interactions to online communication.
Collapse
Affiliation(s)
- Niclas Kaiser
- Department of Psychology, Umeå University, Umeå, Sweden
| | | | | |
Collapse
|
36
|
Asymmetric Prefrontal Cortex Activation Associated with Mutual Gaze of Mothers and Children during Shared Play. Symmetry (Basel) 2022. [DOI: 10.3390/sym14050998] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/01/2023] Open
Abstract
Mother–child shared play provides rich opportunities for mutual symmetrical interactions that serve to foster bond formation in dyads. Mutual gaze, a symmetrical behaviour that occurs during direct eye contact between two partners, conveys important cues of social engagement, affect and attention. However, it is not known whether the prefrontal cortical areas responsible for higher-order social cognition of mothers and children likewise exhibit neural symmetry; that is, similarity in direction of neural activation in mothers and children. This study used functional Near-infrared Spectroscopy (fNIRS) hyperscanning on 22 pairs of mothers and their preschool-aged children as they engaged in a 10-min free-play session together. The play interaction was video recorded and instances of mutual gaze were coded for after the experiment. Multivariate linear regression analyses revealed that neural asymmetry occurred during mother–child mutual gaze, where mothers showed a deactivation of prefrontal activity whereas children showed an activation instead. Findings suggest that mothers and children may employ divergent prefrontal mechanisms when engaged in symmetrical behaviours such as mutual gaze. Future studies could ascertain whether the asymmetric nature of a parent–child relationship, or potential neurodevelopmental differences in social processing between adults and children, significantly contribute to this observation.
Collapse
|
37
|
Gunther KE, Anaya B, Pérez‐Edgar K. Reducing measurement error with ecologically valid testing methods. INFANT AND CHILD DEVELOPMENT 2022. [DOI: 10.1002/icd.2338] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
|
38
|
Luft CDB, Zioga I, Giannopoulos A, Di Bona G, Binetti N, Civilini A, Latora V, Mareschal I. Social synchronization of brain activity increases during eye-contact. Commun Biol 2022; 5:412. [PMID: 35508588 PMCID: PMC9068716 DOI: 10.1038/s42003-022-03352-6] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/16/2021] [Accepted: 04/11/2022] [Indexed: 11/23/2022] Open
Abstract
Humans make eye-contact to extract information about other people’s mental states, recruiting dedicated brain networks that process information about the self and others. Recent studies show that eye-contact increases the synchronization between two brains but do not consider its effects on activity within single brains. Here we investigate how eye-contact affects the frequency and direction of the synchronization within and between two brains and the corresponding network characteristics. We also evaluate the functional relevance of eye-contact networks by comparing inter- and intra-brain networks of friends vs. strangers and the direction of synchronization between leaders and followers. We show that eye-contact increases higher inter- and intra-brain synchronization in the gamma frequency band. Network analysis reveals that some brain areas serve as hubs linking within- and between-brain networks. During eye-contact, friends show higher inter-brain synchronization than strangers. Dyads with clear leader/follower roles demonstrate higher synchronization from leader to follower in the alpha frequency band. Importantly, eye-contact affects synchronization between brains more than within brains, demonstrating that eye-contact is an inherently social signal. Future work should elucidate the causal mechanisms behind eye-contact induced synchronization. Friends making eye-contact have higher inter-brain synchronization than strangers. Eye-contact affects neural synchronization between brains more than within a brain, highlighting that eye-contact is an inherently social signal.
Collapse
Affiliation(s)
- Caroline Di Bernardi Luft
- School of Biological and Behavioural Sciences, Queen Mary, University of London, London, E1 4NS, United Kingdom.
| | - Ioanna Zioga
- School of Biological and Behavioural Sciences, Queen Mary, University of London, London, E1 4NS, United Kingdom.,Donders Institute for Brain, Cognition and Behaviour, Radboud University, Nijmegen, The Netherlands
| | - Anastasios Giannopoulos
- School of Electrical and Computer Engineering, National Technical University of Athens (NTUA), Athens, Greece
| | - Gabriele Di Bona
- School of Mathematical Sciences, Queen Mary University of London, London, E1 4NS, United Kingdom
| | - Nicola Binetti
- School of Biological and Behavioural Sciences, Queen Mary, University of London, London, E1 4NS, United Kingdom
| | - Andrea Civilini
- School of Mathematical Sciences, Queen Mary University of London, London, E1 4NS, United Kingdom
| | - Vito Latora
- School of Mathematical Sciences, Queen Mary University of London, London, E1 4NS, United Kingdom.,Dipartimento di Fisica ed Astronomia, Università di Catania and INFN, I-95123, Catania, Italy.,The Alan Turing Institute, The British Library, London, NW1 2DB, United Kingdom.,Complexity Science Hub, Josefstäadter Strasse 39, A 1080, Vienna, Austria
| | - Isabelle Mareschal
- School of Biological and Behavioural Sciences, Queen Mary, University of London, London, E1 4NS, United Kingdom
| |
Collapse
|
39
|
Guglielmini S, Bopp G, Marcar VL, Scholkmann F, Wolf M. Systemic physiology augmented functional near-infrared spectroscopy hyperscanning: a first evaluation investigating entrainment of spontaneous activity of brain and body physiology between subjects. NEUROPHOTONICS 2022; 9:026601. [PMID: 35449706 PMCID: PMC9016073 DOI: 10.1117/1.nph.9.2.026601] [Citation(s) in RCA: 8] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/05/2021] [Accepted: 03/18/2022] [Indexed: 05/27/2023]
Abstract
Significance: Functional near-infrared spectroscopy (fNIRS) enables measuring the brain activity of two subjects while they interact, i.e., the hyperscanning approach. Aim: In our exploratory study, we extended classical fNIRS hyperscanning by adding systemic physiological measures to obtain systemic physiology augmented fNIRS (SPA-fNIRS) hyperscanning while blocking and not blocking the visual communication between the subjects. This approach enables access brain-to-brain, brain-to-body, and body-to-body coupling between the subjects simultaneously. Approach: Twenty-four pairs of subjects participated in the experiment. The paradigm consisted of two subjects that sat in front of each other and had their eyes closed for 10 min, followed by a phase of 10 min where they made eye contact. Brain and body activity was measured continuously by SPA-fNIRS. Results: Our study shows that making eye contact for a prolonged time causes significant changes in brain-to-brain, brain-to-body, and body-to-body coupling, indicating that eye contact is followed by entrainment of the physiology between subjects. Subjects that knew each other generally showed a larger trend to change between the two conditions. Conclusions: The main point of this study is to introduce a new framework to investigate brain-to-brain, body-to-body, and brain-to-body coupling through a simple social experimental paradigm. The study revealed that eye contact leads to significant synchronization of spontaneous activity of the brain and body physiology. Our study is the first that employed the SPA-fNIRS approach and showed its usefulness to investigate complex interpersonal physiological changes.
Collapse
Affiliation(s)
- Sabino Guglielmini
- University of Zurich, University Hospital Zurich, Department of Neonatology, Biomedical Optics Research Laboratory, Zurich, Switzerland
| | - Gino Bopp
- University of Zurich, University Hospital Zurich, Department of Neonatology, Biomedical Optics Research Laboratory, Zurich, Switzerland
| | - Valentine L. Marcar
- University of Zurich, University Hospital Zurich, Department of Neonatology, Biomedical Optics Research Laboratory, Zurich, Switzerland
- University Hospital Zürich, Comprehensive Cancer Center Zürich, Zürich, Switzerland
| | - Felix Scholkmann
- University of Zurich, University Hospital Zurich, Department of Neonatology, Biomedical Optics Research Laboratory, Zurich, Switzerland
- University of Bern, Institute of Complementary and Integrative Medicine, Bern, Switzerland
| | - Martin Wolf
- University of Zurich, University Hospital Zurich, Department of Neonatology, Biomedical Optics Research Laboratory, Zurich, Switzerland
| |
Collapse
|
40
|
Hakim U, Pinti P, Noah AJ, Zhang X, Burgess P, Hamilton A, Hirsch J, Tachtsidis I. Investigation of functional near-infrared spectroscopy signal quality and development of the hemodynamic phase correlation signal. NEUROPHOTONICS 2022; 9:025001. [PMID: 35599691 PMCID: PMC9116886 DOI: 10.1117/1.nph.9.2.025001] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 09/16/2021] [Accepted: 04/13/2022] [Indexed: 06/15/2023]
Abstract
Significance: There is a longstanding recommendation within the field of fNIRS to use oxygenated (HbO 2 ) and deoxygenated (HHb) hemoglobin when analyzing and interpreting results. Despite this, many fNIRS studies do focus onHbO 2 only. Previous work has shown thatHbO 2 on its own is susceptible to systemic interference and results may mostly reflect that rather than functional activation. Studies using bothHbO 2 and HHb to draw their conclusions do so with varying methods and can lead to discrepancies between studies. The combination ofHbO 2 and HHb has been recommended as a method to utilize both signals in analysis. Aim: We present the development of the hemodynamic phase correlation (HPC) signal to combineHbO 2 and HHb as recommended to utilize both signals in the analysis. We use synthetic and experimental data to evaluate how the HPC and current signals used for fNIRS analysis compare. Approach: About 18 synthetic datasets were formed using resting-state fNIRS data acquired from 16 channels over the frontal lobe. To simulate fNIRS data for a block-design task, we superimposed a synthetic task-related hemodynamic response to the resting state data. This data was used to develop an HPC-general linear model (GLM) framework. Experiments were conducted to investigate the performance of each signal at different SNR and to investigate the effect of false positives on the data. Performance was based on each signal's mean T -value across channels. Experimental data recorded from 128 participants across 134 channels during a finger-tapping task were used to investigate the performance of multiple signals [HbO 2 , HHb, HbT, HbD, correlation-based signal improvement (CBSI), and HPC] on real data. Signal performance was evaluated on its ability to localize activation to a specific region of interest. Results: Results from varying the SNR show that the HPC signal has the highest performance for high SNRs. The CBSI performed the best for medium-low SNR. The next analysis evaluated how false positives affect the signals. The analyses evaluating the effect of false positives showed that the HPC and CBSI signals reflect the effect of false positives onHbO 2 and HHb. The analysis of real experimental data revealed that the HPC and HHb signals provide localization to the primary motor cortex with the highest accuracy. Conclusions: We developed a new hemodynamic signal (HPC) with the potential to overcome the current limitations of usingHbO 2 and HHb separately. Our results suggest that the HPC signal provides comparable accuracy to HHb to localize functional activation while at the same time being more robust against false positives.
Collapse
Affiliation(s)
- Uzair Hakim
- University College London, Department of Medical Physics and Biomedical Engineering, London, United Kingdom
| | - Paola Pinti
- University College London, Department of Medical Physics and Biomedical Engineering, London, United Kingdom
- University of London, Birkbeck College, Centre for Brain and Cognitive Development, London, United Kingdom
| | - Adam J. Noah
- Yale University, Department of Neuroscience and Comparative Medicine, Yale School of Medicine, United States
| | - Xian Zhang
- Yale University, Department of Neuroscience and Comparative Medicine, Yale School of Medicine, United States
| | - Paul Burgess
- University College London, Institute of Cognitive Neuroscience, London, United Kingdom
| | - Antonia Hamilton
- University College London, Institute of Cognitive Neuroscience, London, United Kingdom
| | - Joy Hirsch
- University College London, Department of Medical Physics and Biomedical Engineering, London, United Kingdom
- Yale University, Department of Neuroscience and Comparative Medicine, Yale School of Medicine, United States
| | - Ilias Tachtsidis
- University College London, Department of Medical Physics and Biomedical Engineering, London, United Kingdom
| |
Collapse
|
41
|
Marriott Haresign I, Phillips E, Whitehorn M, Goupil L, Noreika V, Leong V, Wass S. Measuring the temporal dynamics of inter-personal neural entrainment in continuous child-adult EEG hyperscanning data. Dev Cogn Neurosci 2022; 54:101093. [PMID: 35248820 PMCID: PMC8899232 DOI: 10.1016/j.dcn.2022.101093] [Citation(s) in RCA: 10] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/15/2021] [Revised: 10/18/2021] [Accepted: 02/24/2022] [Indexed: 01/08/2023] Open
Abstract
Current approaches to analysing EEG hyperscanning data in the developmental literature typically consider interpersonal entrainment between interacting physiological systems as a time-invariant property. This approach obscures crucial information about how entrainment between interacting systems is established and maintained over time. Here, we describe methods, and present computational algorithms, that will allow researchers to address this gap in the literature. We focus on how two different approaches to measuring entrainment, namely concurrent (e.g., power correlations, phase locking) and sequential (e.g., Granger causality) measures, can be applied to three aspects of the brain signal: amplitude, power, and phase. We guide the reader through worked examples using simulated data on how to leverage these methods to measure changes in interbrain entrainment. For each, we aim to provide a detailed explanation of the interpretation and application of these analyses when studying neural entrainment during early social interactions.
Collapse
|
42
|
Mundy P, Bullen J. The Bidirectional Social-Cognitive Mechanisms of the Social-Attention Symptoms of Autism. Front Psychiatry 2022; 12:752274. [PMID: 35173636 PMCID: PMC8841840 DOI: 10.3389/fpsyt.2021.752274] [Citation(s) in RCA: 10] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/02/2021] [Accepted: 12/20/2021] [Indexed: 11/13/2022] Open
Abstract
Differences in social attention development begin to be apparent in the 6th to 12th month of development in children with Autism Spectrum Disorder (ASD) and theoretically reflect important elements of its neurodevelopmental endophenotype. This paper examines alternative conceptual views of these early social attention symptoms and hypotheses about the mechanisms involved in their development. One model emphasizes mechanism involved in the spontaneous allocation of attention to faces, or social orienting. Alternatively, another model emphasizes mechanisms involved in the coordination of attention with other people, or joint attention, and the socially bi-directional nature of its development. This model raises the possibility that atypical responses of children to the attention or the gaze of a social partner directed toward themselves may be as important in the development of social attention symptoms as differences in the development of social orienting. Another model holds that symptoms of social attention may be important to early development, but may not impact older individuals with ASD. The alterative model is that the social attention symptoms in infancy (social orienting and joint attention), and social cognitive symptoms in childhood and adulthood share common neurodevelopmental substrates. Therefore, differences in early social attention and later social cognition constitute a developmentally continuous axis of symptom presentation in ASD. However, symptoms in older individuals may be best measured with in vivo measures of efficiency of social attention and social cognition in social interactions rather than the accuracy of response on analog tests used in measures with younger children. Finally, a third model suggests that the social attention symptoms may not truly be a symptom of ASD. Rather, they may be best conceptualized as stemming from differences domain general attention and motivation mechanisms. The alternative argued for here that infant social attention symptoms meet all the criteria of a unique dimension of the phenotype of ASD and the bi-directional phenomena involved in social attention cannot be fully explained in terms of domain general aspects of attention development.
Collapse
Affiliation(s)
- Peter Mundy
- Department of Learning and Mind Sciences, School of Education, University of California, Davis, Davis, CA, United States
- Department of Psychiatry and Behavioral Science and The MIND Institute, UC Davis School of Medicine, Sacramento, CA, United States
| | - Jenifer Bullen
- Department of Human Development, School of Human Ecology, University of California, Davis, Davis, CA, United States
| |
Collapse
|
43
|
Is the creativity of lovers better? A behavioral and functional near-infrared spectroscopy hyperscanning study. CURRENT PSYCHOLOGY 2022. [DOI: 10.1007/s12144-020-01093-5] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/23/2022]
|
44
|
Endevelt-Shapira Y, Djalovski A, Dumas G, Feldman R. Maternal chemosignals enhance infant-adult brain-to-brain synchrony. SCIENCE ADVANCES 2021; 7:eabg6867. [PMID: 34890230 PMCID: PMC8664266 DOI: 10.1126/sciadv.abg6867] [Citation(s) in RCA: 22] [Impact Index Per Article: 7.3] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/21/2021] [Accepted: 10/26/2021] [Indexed: 05/25/2023]
Abstract
Maternal body odors serve as important safety-promoting and social recognition signals, but their role in human brain maturation is largely unknown. Utilizing ecological paradigms and dual- electroencephalography recording, we examined the effects of maternal chemosignals on brain-to-brain synchrony during infant-mother and infant-stranger interactions with and without the presence of maternal body odors. Neural connectivity of right-to-right brain theta synchrony emerged across conditions, sensitizing key nodes of the infant’s social brain during its maturational period. Infant-mother interaction elicited greater brain-to-brain synchrony; however, maternal chemosignals attenuated this difference. Infants exhibited more social attention, positive arousal, and safety/approach behaviors in the maternal chemosignals condition, which augmented infant-stranger neural synchrony. Human mothers use interbrain mechanisms to tune the infant’s social brain, and chemosignals may sustain the transfer of infant sociality from the mother-infant bond to life within social groups.
Collapse
Affiliation(s)
- Yaara Endevelt-Shapira
- Center for Developmental Social Neuroscience, The Interdisciplinary Center, Herzliya, Israel
| | - Amir Djalovski
- Center for Developmental Social Neuroscience, The Interdisciplinary Center, Herzliya, Israel
| | - Guillaume Dumas
- Precision Psychiatry and Social Physiology Laboratory, CHU Sainte-Justine Research Center, Department of Psychiatry, Université de Montréal, Montreal, QC, Canada
- Human Brain and Behavior Laboratory, Center for Complex Systems and Brain Sciences, Florida Atlantic University, Boca Raton, FL, USA
| | - Ruth Feldman
- Center for Developmental Social Neuroscience, The Interdisciplinary Center, Herzliya, Israel
- Yale University, Child Study Center, New Haven, CT 06519, USA
| |
Collapse
|
45
|
Janssen TW, Grammer JK, Bleichner MG, Bulgarelli C, Davidesco I, Dikker S, Jasińska KK, Siugzdaite R, Vassena E, Vatakis A, Zion‐Golumbic E, van Atteveldt N. Opportunities and Limitations of Mobile Neuroimaging Technologies in Educational Neuroscience. MIND, BRAIN AND EDUCATION : THE OFFICIAL JOURNAL OF THE INTERNATIONAL MIND, BRAIN, AND EDUCATION SOCIETY 2021; 15:354-370. [PMID: 35875415 PMCID: PMC9292610 DOI: 10.1111/mbe.12302] [Citation(s) in RCA: 14] [Impact Index Per Article: 4.7] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/11/2020] [Revised: 06/18/2021] [Accepted: 09/01/2021] [Indexed: 05/20/2023]
Abstract
As the field of educational neuroscience continues to grow, questions have emerged regarding the ecological validity and applicability of this research to educational practice. Recent advances in mobile neuroimaging technologies have made it possible to conduct neuroscientific studies directly in naturalistic learning environments. We propose that embedding mobile neuroimaging research in a cycle (Matusz, Dikker, Huth, & Perrodin, 2019), involving lab-based, seminaturalistic, and fully naturalistic experiments, is well suited for addressing educational questions. With this review, we take a cautious approach, by discussing the valuable insights that can be gained from mobile neuroimaging technology, including electroencephalography and functional near-infrared spectroscopy, as well as the challenges posed by bringing neuroscientific methods into the classroom. Research paradigms used alongside mobile neuroimaging technology vary considerably. To illustrate this point, studies are discussed with increasingly naturalistic designs. We conclude with several ethical considerations that should be taken into account in this unique area of research.
Collapse
Affiliation(s)
- Tieme W.P. Janssen
- Department of Clinical, Neuro‐ & Developmental Psychology, Vrije Universiteit
| | - Jennie K. Grammer
- Graduate School of Education and Information Studies, University of California Los Angeles
| | | | - Chiara Bulgarelli
- Centre for Brain and Cognitive Development, Birkbeck University of London
| | - Ido Davidesco
- Department of Educational Psychology, University of Connecticut
| | | | - Kaja K. Jasińska
- Department of Applied Psychology and Human Development, University of Toronto
| | | | - Eliana Vassena
- Donders Institute for Brain, Cognition and Behaviour, Radboud University
| | | | | | | |
Collapse
|
46
|
Li Y, Chen M, Zhang R, Xianchun L. Experiencing Happiness Together Facilitates Dyadic Coordination through the Enhanced Interpersonal Neural Synchronization. Soc Cogn Affect Neurosci 2021; 17:447-460. [PMID: 34669963 PMCID: PMC9071490 DOI: 10.1093/scan/nsab114] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/19/2021] [Revised: 08/25/2021] [Accepted: 04/19/2022] [Indexed: 11/13/2022] Open
Abstract
Experiencing positive emotions together facilitates interpersonal understanding and promotes subsequent social interaction among individuals. However, the neural underpinnings of such emotional-social effect remain to be discovered. Current study employed the fNIRS-based hyperscanning to investigate the above mentioned relationship. After participants in dyad watching movie clips with happily or neutral emotion, they were asked to perform the interpersonal cooperative task, with their neural activation of prefrontal cortex (PFC) being recorded simultaneously via functional near infrared spectroscopy. Results suggested that compared with the neutral movie watching together, a higher interpersonal neural synchronization (INS) in left inferior frontal gyrus during participant dyads watching happiness movie together. Subsequently, dyads in happiness showed more effective coordination interaction during performed the interpersonal cooperation task compared to those in the neutral condition, and such facilitated effect was associated with increased cooperation-related INS at left middle frontal cortex. A mediation analysis showed that the coordination interaction fully mediated the relationship between the emotion-induced INS during the happiness movie-viewing and the cooperation-related INS in interpersonal cooperation. Taken together, our findings suggest that the faciliatory effect experiencing happiness together has on interpersonal cooperation can be reliably reflected by the INS magnitude at the brain level.
Collapse
Affiliation(s)
- Yangzhuo Li
- School of Psychology and Cognitive Science, East China Normal University, Shanghai, 200062, China
| | - Mei Chen
- School of Psychology and Cognitive Science, East China Normal University, Shanghai, 200062, China
| | - Ruqian Zhang
- School of Psychology and Cognitive Science, East China Normal University, Shanghai, 200062, China
| | - Li Xianchun
- School of Psychology and Cognitive Science, East China Normal University, Shanghai, 200062, China.,Shanghai Key Laboratory of Mental Health and Psychological Crisis Intervention, Affiliated Mental Health Center (ECNU), School of Psychology and Cognitive Science, East China Normal University, Shanghai, 200062, China
| |
Collapse
|
47
|
Pan Y, Novembre G, Olsson A. The Interpersonal Neuroscience of Social Learning. PERSPECTIVES ON PSYCHOLOGICAL SCIENCE 2021; 17:680-695. [PMID: 34637374 DOI: 10.1177/17456916211008429] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Abstract
The study of the brain mechanisms underpinning social behavior is currently undergoing a paradigm shift, moving its focus from single individuals to the real-time interaction among groups of individuals. Although this development opens unprecedented opportunities to study how interpersonal brain activity shapes behaviors through learning, there have been few direct connections to the rich field of learning science. Our article examines how the rapidly developing field of interpersonal neuroscience is (and could be) contributing to our understanding of social learning. To this end, we first review recent research extracting indices of brain-to-brain coupling (BtBC) in the context of social behaviors and, in particular, social learning. We then discuss how studying communicative behaviors during learning can aid the interpretation of BtBC and how studying BtBC can inform our understanding of such behaviors. We then discuss how BtBC and communicative behaviors collectively can predict learning outcomes, and we suggest several causative and mechanistic models. Finally, we highlight key methodological and interpretational challenges as well as exciting opportunities for integrating research in interpersonal neuroscience with social learning, and we propose a multiperson framework for understanding how interpersonal transmission of information between individual brains shapes social learning.
Collapse
Affiliation(s)
- Yafeng Pan
- Department of Clinical Neuroscience, Karolinska Institutet
| | - Giacomo Novembre
- Neuroscience of Perception and Action Lab, Italian Institute of Technology
| | - Andreas Olsson
- Department of Clinical Neuroscience, Karolinska Institutet
| |
Collapse
|
48
|
Eye contact marks the rise and fall of shared attention in conversation. Proc Natl Acad Sci U S A 2021; 118:2106645118. [PMID: 34504001 DOI: 10.1073/pnas.2106645118] [Citation(s) in RCA: 31] [Impact Index Per Article: 10.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 07/27/2021] [Indexed: 12/24/2022] Open
Abstract
Conversation is the platform where minds meet: the venue where information is shared, ideas cocreated, cultural norms shaped, and social bonds forged. Its frequency and ease belie its complexity. Every conversation weaves a unique shared narrative from the contributions of independent minds, requiring partners to flexibly move into and out of alignment as needed for conversation to both cohere and evolve. How two minds achieve this coordination is poorly understood. Here we test whether eye contact, a common feature of conversation, predicts this coordination by measuring dyadic pupillary synchrony (a corollary of shared attention) during natural conversation. We find that eye contact is positively correlated with synchrony as well as ratings of engagement by conversation partners. However, rather than elicit synchrony, eye contact commences as synchrony peaks and predicts its immediate and subsequent decline until eye contact breaks. This relationship suggests that eye contact signals when shared attention is high. Furthermore, we speculate that eye contact may play a corrective role in disrupting shared attention (reducing synchrony) as needed to facilitate independent contributions to conversation.
Collapse
|
49
|
Bieńkiewicz MMN, Smykovskyi AP, Olugbade T, Janaqi S, Camurri A, Bianchi-Berthouze N, Björkman M, Bardy BG. Bridging the gap between emotion and joint action. Neurosci Biobehav Rev 2021; 131:806-833. [PMID: 34418437 DOI: 10.1016/j.neubiorev.2021.08.014] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/16/2021] [Revised: 08/08/2021] [Accepted: 08/13/2021] [Indexed: 11/17/2022]
Abstract
Our daily human life is filled with a myriad of joint action moments, be it children playing, adults working together (i.e., team sports), or strangers navigating through a crowd. Joint action brings individuals (and embodiment of their emotions) together, in space and in time. Yet little is known about how individual emotions propagate through embodied presence in a group, and how joint action changes individual emotion. In fact, the multi-agent component is largely missing from neuroscience-based approaches to emotion, and reversely joint action research has not found a way yet to include emotion as one of the key parameters to model socio-motor interaction. In this review, we first identify the gap and then stockpile evidence showing strong entanglement between emotion and acting together from various branches of sciences. We propose an integrative approach to bridge the gap, highlight five research avenues to do so in behavioral neuroscience and digital sciences, and address some of the key challenges in the area faced by modern societies.
Collapse
Affiliation(s)
- Marta M N Bieńkiewicz
- EuroMov Digital Health in Motion, Univ. Montpellier IMT Mines Ales, Montpellier, France.
| | - Andrii P Smykovskyi
- EuroMov Digital Health in Motion, Univ. Montpellier IMT Mines Ales, Montpellier, France
| | | | - Stefan Janaqi
- EuroMov Digital Health in Motion, Univ. Montpellier IMT Mines Ales, Montpellier, France
| | | | | | | | - Benoît G Bardy
- EuroMov Digital Health in Motion, Univ. Montpellier IMT Mines Ales, Montpellier, France.
| |
Collapse
|
50
|
Chen L, Xu Q, Shen L, Yuan T, Wang Y, Zhou W, Jiang Y. Distinct Contributions of Genes and Environment to Visual Size Illusion and the Underlying Neural Mechanism. Cereb Cortex 2021; 32:1014-1023. [PMID: 34379728 PMCID: PMC8889949 DOI: 10.1093/cercor/bhab262] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/01/2021] [Revised: 06/29/2021] [Accepted: 06/30/2021] [Indexed: 11/12/2022] Open
Abstract
As exemplified by the Ebbinghaus illusion, the perceived size of an object can be significantly biased by its surrounding context. The phenomenon is experienced by humans as well as other species, hence likely evolutionarily adaptive. Here, we examined the heritability of the Ebbinghaus illusion using a combination of the classic twin method and multichannel functional near-infrared spectroscopy. Results show that genes account for over 50% of the variance in the strength of the experienced illusion. Interestingly, activations evoked by the Ebbinghaus stimuli in the early visual cortex are explained by genetic factors whereas those in the posterior temporal cortex are explained by environmental factors. In parallel, the feedforward functional connectivity between the occipital cortex and the temporal cortex is modulated by genetic effects whereas the feedback functional connectivity is entirely shaped by environment, despite both being significantly correlated with the strength of the experienced illusion. These findings demonstrate that genetic and environmental factors work in tandem to shape the context-dependent visual size illusion, and shed new light on the links among genes, environment, brain, and subjective experience.
Collapse
Affiliation(s)
- Lihong Chen
- Research Center of Brain and Cognitive Neuroscience, Liaoning Normal University, Dalian 116029, P.R. China.,Key Laboratory of Brain and Cognitive Neuroscience, Liaoning Province, Dalian 116029, P.R. China.,State Key Laboratory of Brain and Cognitive Science, CAS Center for Excellence in Brain Science and Intelligence Technology, Institute of Psychology, Chinese Academy of Sciences, Beijing 100101, P.R. China
| | - Qian Xu
- State Key Laboratory of Brain and Cognitive Science, CAS Center for Excellence in Brain Science and Intelligence Technology, Institute of Psychology, Chinese Academy of Sciences, Beijing 100101, P.R. China.,Department of Psychology, University of Chinese Academy of Sciences, Beijing 100049, P.R. China.,Chinese Institute for Brain Research, Beijing 102206, P.R. China
| | - Li Shen
- State Key Laboratory of Brain and Cognitive Science, CAS Center for Excellence in Brain Science and Intelligence Technology, Institute of Psychology, Chinese Academy of Sciences, Beijing 100101, P.R. China.,Department of Psychology, University of Chinese Academy of Sciences, Beijing 100049, P.R. China.,Chinese Institute for Brain Research, Beijing 102206, P.R. China
| | - Tian Yuan
- State Key Laboratory of Brain and Cognitive Science, CAS Center for Excellence in Brain Science and Intelligence Technology, Institute of Psychology, Chinese Academy of Sciences, Beijing 100101, P.R. China.,Department of Psychology, University of Chinese Academy of Sciences, Beijing 100049, P.R. China.,Chinese Institute for Brain Research, Beijing 102206, P.R. China
| | - Ying Wang
- State Key Laboratory of Brain and Cognitive Science, CAS Center for Excellence in Brain Science and Intelligence Technology, Institute of Psychology, Chinese Academy of Sciences, Beijing 100101, P.R. China.,Department of Psychology, University of Chinese Academy of Sciences, Beijing 100049, P.R. China.,Chinese Institute for Brain Research, Beijing 102206, P.R. China
| | - Wen Zhou
- State Key Laboratory of Brain and Cognitive Science, CAS Center for Excellence in Brain Science and Intelligence Technology, Institute of Psychology, Chinese Academy of Sciences, Beijing 100101, P.R. China.,Department of Psychology, University of Chinese Academy of Sciences, Beijing 100049, P.R. China.,Chinese Institute for Brain Research, Beijing 102206, P.R. China
| | - Yi Jiang
- State Key Laboratory of Brain and Cognitive Science, CAS Center for Excellence in Brain Science and Intelligence Technology, Institute of Psychology, Chinese Academy of Sciences, Beijing 100101, P.R. China.,Department of Psychology, University of Chinese Academy of Sciences, Beijing 100049, P.R. China.,Chinese Institute for Brain Research, Beijing 102206, P.R. China.,Institute of Artificial Intelligence, Hefei Comprehensive National Science Center, Hefei 230088, P.R. China
| |
Collapse
|