1
|
Kujala T, Partanen E, Virtala P, Winkler I. Prerequisites of language acquisition in the newborn brain. Trends Neurosci 2023; 46:726-737. [PMID: 37344237 DOI: 10.1016/j.tins.2023.05.011] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/12/2023] [Revised: 04/13/2023] [Accepted: 05/24/2023] [Indexed: 06/23/2023]
Abstract
Learning to decode and produce speech is one of the most demanding tasks faced by infants. Nevertheless, infants typically utter their first words within a year, and phrases soon follow. Here we review cognitive abilities of newborn infants that promote language acquisition, focusing primarily on studies tapping neural activity. The results of these studies indicate that infants possess core adult auditory abilities already at birth, including statistical learning and rule extraction from variable speech input. Thus, the neonatal brain is ready to categorize sounds, detect word boundaries, learn words, and separate speech streams: in short, to acquire language quickly and efficiently from everyday linguistic input.
Collapse
Affiliation(s)
- Teija Kujala
- Cognitive Brain Research Unit, Centre of Excellence in Music, Mind, Body and Brain, Department of Psychology and Logopedics, Faculty of Medicine, University of Helsinki, Finland.
| | - Eino Partanen
- Cognitive Brain Research Unit, Centre of Excellence in Music, Mind, Body and Brain, Department of Psychology and Logopedics, Faculty of Medicine, University of Helsinki, Finland
| | - Paula Virtala
- Cognitive Brain Research Unit, Centre of Excellence in Music, Mind, Body and Brain, Department of Psychology and Logopedics, Faculty of Medicine, University of Helsinki, Finland
| | - István Winkler
- Institute of Cognitive Neuroscience and Psychology, Research Centre for Natural Sciences, Budapest, Hungary
| |
Collapse
|
2
|
Yukhnovich EA, Alter K, Sedley W. Nuances in intensity deviant asymmetric responses as a biomarker for tinnitus. PLoS One 2023; 18:e0289062. [PMID: 37549154 PMCID: PMC10406247 DOI: 10.1371/journal.pone.0289062] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/20/2023] [Accepted: 07/11/2023] [Indexed: 08/09/2023] Open
Abstract
We attempted to replicate a potential tinnitus biomarker in humans based on the Sensory Precision Integrative Model of Tinnitus called the Intensity Mismatch Asymmetry. A few advances on the design were also included, including tighter matching of participants for gender, and a control stimulus frequency of 1 kHz to investigate whether any differences between control and tinnitus groups are specific to the tinnitus frequency or domain-general. The expectation was that there would be asymmetry in the MMN responses between tinnitus and control groups at the tinnitus frequency, but not at the control frequency, where the tinnitus group would have larger, more negative responses to upward deviants than downward deviants, and the control group would have the opposite pattern or lack of a deviant direction effect. However, no significant group differences were found. There was a striking difference in response amplitude to control frequency stimuli compared to tinnitus frequency stimuli, which could be an intrinsic quality of responses to these frequencies or could reflect high frequency hearing loss in the sample. Additionally, the upward deviants elicited stronger MMN responses in both groups at tinnitus frequency, but not at the control frequency. Factors contributing to these discrepant results at the tinnitus frequency could include hyperacusis, attention, and wider contextual effects of other frequencies used in the experiment (i.e. the control frequency in other blocks).
Collapse
Affiliation(s)
- Ekaterina A. Yukhnovich
- Translational and Clinical Research Institute, Newcastle University Medical School, Newcastle University, Newcastle upon Tyne, United Kingdom
| | - Kai Alter
- Translational and Clinical Research Institute, Newcastle University Medical School, Newcastle University, Newcastle upon Tyne, United Kingdom
- Faculty of Modern and Medieval Languages and Linguistics and the Languages Sciences Interdisciplinary Research Centre, University of Cambridge, Cambridge, United Kingdom
| | - William Sedley
- Translational and Clinical Research Institute, Newcastle University Medical School, Newcastle University, Newcastle upon Tyne, United Kingdom
| |
Collapse
|
3
|
Merchie A, Gomot M. Habituation, Adaptation and Prediction Processes in Neurodevelopmental Disorders: A Comprehensive Review. Brain Sci 2023; 13:1110. [PMID: 37509040 PMCID: PMC10377027 DOI: 10.3390/brainsci13071110] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/13/2023] [Revised: 07/12/2023] [Accepted: 07/20/2023] [Indexed: 07/30/2023] Open
Abstract
Habituation, the simplest form of learning preserved across species and evolution, is characterized by a response decrease as a stimulus is repeated. This adaptive function has been shown to be altered in some psychiatric and neurodevelopmental disorders such as autism spectrum disorder (ASD), attention-deficit/hyperactivity disorder (ADHD) or schizophrenia. At the brain level, habituation is characterized by a decrease in neural activity as a stimulation is repeated, referred to as neural adaptation. This phenomenon influences the ability to make predictions and to detect change, two processes altered in some neurodevelopmental and psychiatric disorders. In this comprehensive review, the objectives are to characterize habituation, neural adaptation, and prediction throughout typical development and in neurodevelopmental disorders; and to evaluate their implication in symptomatology, specifically in sensitivity to change or need for sameness. A summary of the different approaches to investigate adaptation will be proposed, in which we report the contribution of animal studies as well as electrophysiological studies in humans to understanding of underlying neuronal mechanisms.
Collapse
Affiliation(s)
| | - Marie Gomot
- UMR 1253 iBrain, Université de Tours, INSERM, 37000 Tours, France
| |
Collapse
|
4
|
Weise A, Grimm S, Maria Rimmele J, Schröger E. Auditory representations for long lasting sounds: Insights from event-related brain potentials and neural oscillations. BRAIN AND LANGUAGE 2023; 237:105221. [PMID: 36623340 DOI: 10.1016/j.bandl.2022.105221] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/23/2021] [Revised: 12/26/2022] [Accepted: 12/27/2022] [Indexed: 06/17/2023]
Abstract
The basic features of short sounds, such as frequency and intensity including their temporal dynamics, are integrated in a unitary representation. Knowledge on how our brain processes long lasting sounds is scarce. We review research utilizing the Mismatch Negativity event-related potential and neural oscillatory activity for studying representations for long lasting simple versus complex sounds such as sinusoidal tones versus speech. There is evidence for a temporal constraint in the formation of auditory representations: Auditory edges like sound onsets within long lasting sounds open a temporal window of about 350 ms in which the sounds' dynamics are integrated into a representation, while information beyond that window contributes less to that representation. This integration window segments the auditory input into short chunks. We argue that the representations established in adjacent integration windows can be concatenated into an auditory representation of a long sound, thus, overcoming the temporal constraint.
Collapse
Affiliation(s)
- Annekathrin Weise
- Department of Psychology, Ludwig-Maximilians-University Munich, Germany; Wilhelm Wundt Institute for Psychology, Leipzig University, Germany.
| | - Sabine Grimm
- Wilhelm Wundt Institute for Psychology, Leipzig University, Germany.
| | - Johanna Maria Rimmele
- Department of Neuroscience, Max-Planck-Institute for Empirical Aesthetics, Germany; Center for Language, Music and Emotion, New York University, Max Planck Institute, Department of Psychology, 6 Washington Place, New York, NY 10003, United States.
| | - Erich Schröger
- Wilhelm Wundt Institute for Psychology, Leipzig University, Germany.
| |
Collapse
|
5
|
Prete DA, Heikoop D, McGillivray JE, Reilly JP, Trainor LJ. The sound of silence: Predictive error responses to unexpected sound omission in adults. Eur J Neurosci 2022; 55:1972-1985. [PMID: 35357048 DOI: 10.1111/ejn.15660] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/05/2021] [Revised: 09/09/2021] [Accepted: 03/22/2022] [Indexed: 11/28/2022]
Abstract
The human auditory system excels at detecting patterns needed for processing speech and music. According to predictive coding, the brain predicts incoming sounds, compares predictions to sensory input, and generates a prediction error whenever a mismatch between the prediction and sensory input occurs. Predictive coding can be indexed in EEG with the mismatch negativity (MMN) and P3a components, two ERP components that are elicited by infrequent deviant sounds (e.g., differing in pitch, duration, loudness) in a stream of frequent sounds. If these components reflect prediction error, they should also be elicited by omitting an expected sound, but few studies have examined this. We compared ERPs elicited by infrequent randomly occurring omissions (unexpected silences) in tone sequences presented at 2 tones/sec to ERPs elicited by frequent, regularly occurring omissions (expected silences) within a sequence of tones and resting state EEG (a constant silence). We found that unexpected silences elicited significant MMN and P3a, although the magnitude of these components was quite small and variable. These results provide evidence for hierarchical predictive coding, indicating that the brain predicts silences as well as sounds.
Collapse
Affiliation(s)
- David A Prete
- Department of Psychology, Neuroscience and Behaviour, McMaster University, Hamilton, ON, Canada
| | - David Heikoop
- Department of Psychology, Neuroscience and Behaviour, McMaster University, Hamilton, ON, Canada
| | | | - James P Reilly
- Electrical and Computer Engineering, McMaster University, Hamilton, Canada.,ARiEAL Research Centre, McMaster University, Hamilton, Canada.,School of Biomedical Engineering, McMaster University, Hamilton, Canada.,Vector Institute, MaRS Centre, Toronto, Canada
| | - Laurel J Trainor
- Department of Psychology, Neuroscience and Behaviour, McMaster University, Hamilton, ON, Canada.,McMaster Institute for Music and the Mind, McMaster University, Hamilton, ON, Canada.,Rotman Research Institute, Baycrest Hospital, Toronto, ON, Canada
| |
Collapse
|
6
|
Jalewa J, Todd J, Michie PT, Hodgson DM, Harms L. Do rat auditory event related potentials exhibit human mismatch negativity attributes related to predictive coding? Hear Res 2020; 399:107992. [PMID: 32571607 DOI: 10.1016/j.heares.2020.107992] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/12/2019] [Revised: 04/29/2020] [Accepted: 05/04/2020] [Indexed: 01/11/2023]
Abstract
Rodent models play a significant role in understanding disease mechanisms and the screening of new treatments. With regard to psychiatric disorders such as schizophrenia, however, it is difficult to replicate the human symptoms in rodents because these symptoms are often either 'uniquely human' or are only conveyed via self-report. There is a growing interest in rodent mismatch responses (MMRs) as a translatable 'biomarker' for disorders such as schizophrenia. In this review, we will summarize the attributes of human MMN, and discuss the scope of exploring the attributes of human MMN in rodents. Here, we examine how reliably MMRs that are measured in rats mimic human attributes, and present original data examining whether manipulations of stimulus conditions known to modulate human MMN, do the same for rat MMRs. Using surgically-implanted epidural electroencephalographic electrodes and wireless telemetry in freely-moving rats, we observed human-like modulations of MMRs, namely that larger MMRs were elicited to unexpected (deviant) stimuli that a) had a larger change in pitch compared to the expected (standard) stimulus, b) were less frequently presented (lower probability), and c) had no jitter (stable stimulus onset asynchrony) compared to high jitter. Overall, these findings contribute to the mounting evidence for rat MMRs as a good analogue of human MMN, bolstering the development of a novel approach in future to validate the preclinical models based on a translatable biomarker, MMN.
Collapse
Affiliation(s)
- Jaishree Jalewa
- School of Psychology, University of Newcastle, Callaghan, New South Wales, Australia
| | - Juanita Todd
- School of Psychology, University of Newcastle, Callaghan, New South Wales, Australia; Priority Research Centre for Brain and Mental Health Research, University of Newcastle, Callaghan, New South Wales, Australia; Hunter Medical Research Institute, New Lambton Heights, New South Wales, Australia
| | - Patricia T Michie
- School of Psychology, University of Newcastle, Callaghan, New South Wales, Australia; Priority Research Centre for Brain and Mental Health Research, University of Newcastle, Callaghan, New South Wales, Australia; Hunter Medical Research Institute, New Lambton Heights, New South Wales, Australia
| | - Deborah M Hodgson
- School of Psychology, University of Newcastle, Callaghan, New South Wales, Australia; Priority Research Centre for Brain and Mental Health Research, University of Newcastle, Callaghan, New South Wales, Australia; Hunter Medical Research Institute, New Lambton Heights, New South Wales, Australia
| | - Lauren Harms
- Priority Research Centre for Brain and Mental Health Research, University of Newcastle, Callaghan, New South Wales, Australia; Hunter Medical Research Institute, New Lambton Heights, New South Wales, Australia; School of Biomedical Sciences and Pharmacy, University of Newcastle, Callaghan, New South Wales, Australia.
| |
Collapse
|
7
|
Abstract
Evoked potentials provide valuable insight into brain processes that are integral to our ability to interact effectively and efficiently in the world. The mismatch negativity (MMN) component of the evoked potential has proven highly informative on the ways in which sensitivity to regularity contributes to perception and cognition. This review offers a compendium of research on MMN with a view to scaffolding an appreciation for its use as a tool to explore the way regularities contribute to predictions about the sensory environment over many timescales. In compiling this work, interest in MMN as an index of sensory encoding and memory are addressed, as well as attention. Perspectives on the possible underlying computational processes are reviewed as well as recent observations that invite consideration of how MMN relates to how we learn, what we learn, and why.
Collapse
Affiliation(s)
- Kaitlin Fitzgerald
- School of Psychology, University of Newcastle, Callaghan, NSW, Australia
| | - Juanita Todd
- School of Psychology, University of Newcastle, Callaghan, NSW, Australia
| |
Collapse
|
8
|
Oxner M, Rosentreter ET, Hayward WG, Corballis PM. Prediction errors in surface segmentation are reflected in the visual mismatch negativity, independently of task and surface features. J Vis 2019; 19:9. [PMID: 31185097 DOI: 10.1167/19.6.9] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
Abstract
The visual system quickly registers perceptual regularities in the environment and responds to violations in these patterns. Errors of perceptual prediction are associated with electrocortical modulation, including the visual mismatch negativity (vMMN) and P2 event-related potential. One relatively unexplored question is whether these prediction error signals can encode higher-level properties such as surface segmentation, or whether they are limited to lower-level perceptual features. Using a roving standard paradigm, a triangle surface appeared either behind (featuring amodal contours) or in front of (featuring real contours) a second surface with hole-like windows. A surface layout appeared for two to five repetitions before switching to the other "deviant" layout; lighting and orientation of stimuli varied across presentations while remaining isoluminant. Observers responded when they detected a rare "pinched" triangle, which occasionally appeared. Cortical activity-reflected in mismatch responses affecting the P2-N2 and P300 amplitudes-was sensitive to a change in stimulus layout, when surfaces shifted position in depth, following several repetitions. Specifically, layout deviants led to a more negative P2-N2 complex at posterior electrodes, and greater P300 positivity at central sites. Independently of these signals of a deviant surface layout, further modulations of the P2 encoded differences between layouts and detection of the rare target stimulus. Comparison of the effect of preceding layout repetitions on this prediction error signal suggests that it is all or none and not graded with respect to the number of previous repetitions. We show that within the visual domain, unnoticed and task-irrelevant changes in visual surface segmentation leads to observable electrophysiological signals of prediction error that are dissociable from stimulus-specific encoding and lower-level perceptual processing.
Collapse
Affiliation(s)
- Matt Oxner
- School of Psychology, University of Auckland, Auckland, New Zealand
| | | | - William G Hayward
- Department of Psychology and ARC Centre of Excellence in Cognition and Its Disorders, The University of Hong Kong, Pok Fu Lam, Hong Kong.,School of Psychology, University of Auckland, Auckland, New Zealand
| | - Paul M Corballis
- School of Psychology, University of Auckland, Auckland, New Zealand
| |
Collapse
|
9
|
|
10
|
Ungan P, Karsilar H, Yagcioglu S. Pre-attentive Mismatch Response and Involuntary Attention Switching to a Deviance in an Earlier-Than-Usual Auditory Stimulus: An ERP Study. Front Hum Neurosci 2019; 13:58. [PMID: 30894807 PMCID: PMC6414453 DOI: 10.3389/fnhum.2019.00058] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/30/2018] [Accepted: 02/01/2019] [Indexed: 02/02/2023] Open
Abstract
An acoustic stimulus elicits an electroencephalographic response called auditory event-related potential (ERP). When some members of a stream of standard auditory stimuli are replaced randomly by a deviant stimulus and this stream is presented to a subject who ignores the stimuli, two different ERPs to deviant and standard stimuli are recorded. If the ERP to standard stimuli is subtracted from the ERP to deviant stimuli, the difference potential (DP) waveform typically exhibits a series of negative-positive-negative deflections called mismatch negativity (MMN), P3a, and reorienting negativity (RON), which are associated with pre-attentive change detection, involuntary attention switching, and reorienting of attention, respectively. The aim of the present study was to investigate how these pre-attentive processes are affected if the change occurs earlier than its usual timing implied by isochronous standard stimuli. In the MMN paradigm employed, 15% of the standards were randomly replaced by deviant stimuli which differed either in their pitch, their earlier onset time, or in both. Event-related responses to these three deviants [timely pitch change (RTP), earlier onset (REO), earlier pitch change (REP)] and to standards (RS) were recorded from 10 reading subjects. To maintain identical stimulation histories for the responses subtracted from each other, "deviant-standard" difference potentials (DP) for "timely" and "early" pitch deviances were derived as follows: DPTP = RTP - RS and DPEP = REP - REO. Interestingly, the MMN components of the DPs to timely and early pitch deviances had similar amplitudes, indicating that regularity of stimulus timing does not provide any benefit for the pre-attentive auditory change detection mechanism. However, different scalp current density (SCD) dynamics of the MMN/P3a complexes, elicited by timely and early pitch deviances, suggested that an auditory change in a stimulus occurring earlier-than-usual initiates a faster and more effective call-for-attention and causes stronger attention switching than a timely change. SCD results also indicated that the temporal, frontal, and parietal MMN components are simultaneously present rather than emerging sequentially in time, supporting the MMN models based on parallel deviance processing in the respective cortices. Similarity of the RONs to timely and early pitch deviances indicated that reorienting of attention is of the same strength in two cases.
Collapse
Affiliation(s)
- Pekcan Ungan
- Department of Biophysics, School of Medicine, Koc University, Istanbul, Turkey
| | - Hakan Karsilar
- Department of Psychology, Özyegin University, Istanbul, Turkey
| | - Suha Yagcioglu
- Department of Biophysics, Faculty of Medicine, Hacettepe University, Ankara, Turkey
| |
Collapse
|
11
|
Kim S, Jeon H, Jang KI, Kim YW, Im CH, Lee SH. Mismatch Negativity and Cortical Thickness in Patients With Schizophrenia and Bipolar Disorder. Schizophr Bull 2019; 45:425-435. [PMID: 29684224 PMCID: PMC6403065 DOI: 10.1093/schbul/sby041] [Citation(s) in RCA: 16] [Impact Index Per Article: 3.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/20/2022]
Abstract
INTRODUCTION Mismatch negativity (MMN) is a measure of automatic neurophysiological brain processes for detecting unexpected sensory stimuli. This study investigated MMN reduction in patients with schizophrenia and bipolar disorder and examined whether cortical thickness is associated with MMN, for exploratory purposes. METHODS Electroencephalograms were recorded in 38 patients with schizophrenia, 37 patients with bipolar disorder, and 32 healthy controls (HCs) performing a passive auditory oddball paradigm. All participants underwent T1 structural magnetic resonance imaging scanning to investigate the cortical thickness of MMN-generating regions. Average MMN amplitudes from the frontocentral electrodes were analyzed. RESULTS Patients with schizophrenia and bipolar disorder exhibited significantly reduced MMN amplitude compared with HCs. In bipolar disorder, we found intermediate MMN amplitude among the groups. Average MMN and cortical thickness of the right superior temporal gyrus (STG) were significantly negatively correlated in patients with schizophrenia. In patients with bipolar disorder, average MMN was significantly correlated with cortical thickness of the left anterior cingulate cortex and the right STG. MMN showed negative correlations with social and occupational functioning in schizophrenia, and with the Korean auditory verbal learning test for delayed recall in bipolar disorder. CONCLUSIONS MMN reduction was associated with cortical thinning in frontal and temporal areas in patients, particularly with an auditory verbal hallucination-related region in schizophrenia and emotion-related regions in bipolar disorder. MMN was associated with functional outcomes in schizophrenia, whereas it was associated with neurocognition in bipolar disorder.
Collapse
Affiliation(s)
- Sungkean Kim
- Clinical Emotion and Cognition Research Laboratory, Inje University, Goyang, Republic of Korea,Department of Biomedical Engineering, Hanyang University, Seoul, Republic of Korea
| | - Hyeonjin Jeon
- Clinical Emotion and Cognition Research Laboratory, Inje University, Goyang, Republic of Korea
| | - Kuk-In Jang
- Clinical Emotion and Cognition Research Laboratory, Inje University, Goyang, Republic of Korea,Department of Biomedicine & Health Sciences, The Catholic University of Korea, College of Medicine, Seoul, Republic of Korea
| | - Yong-Wook Kim
- Clinical Emotion and Cognition Research Laboratory, Inje University, Goyang, Republic of Korea,Department of Biomedical Engineering, Hanyang University, Seoul, Republic of Korea
| | - Chang-Hwan Im
- Department of Biomedical Engineering, Hanyang University, Seoul, Republic of Korea
| | - Seung-Hwan Lee
- Clinical Emotion and Cognition Research Laboratory, Inje University, Goyang, Republic of Korea,Department of Psychiatry, Inje University, Ilsan-Paik Hospital, Goyang, Republic of Korea,To whom correspondence should be addressed; Department of Psychiatry, Ilsan Paik Hospital, Inje University College of Medicine, Juhwa-ro 170, Ilsanseo-Gu, Goyang 411-706, Republic of Korea; tel: +82-31-910-7260, fax: +82-31-910-7268, e-mail:
| |
Collapse
|
12
|
Yu YH, Shafer VL, Sussman ES. Neurophysiological and Behavioral Responses of Mandarin Lexical Tone Processing. Front Neurosci 2017; 11:95. [PMID: 28321179 PMCID: PMC5338334 DOI: 10.3389/fnins.2017.00095] [Citation(s) in RCA: 19] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/21/2016] [Accepted: 02/13/2017] [Indexed: 11/22/2022] Open
Abstract
Language experience enhances discrimination of speech contrasts at a behavioral- perceptual level, as well as at a pre-attentive level, as indexed by event-related potential (ERP) mismatch negativity (MMN) responses. The enhanced sensitivity could be the result of changes in acoustic resolution and/or long-term memory representations of the relevant information in the auditory cortex. To examine these possibilities, we used a short (ca. 600 ms) vs. long (ca. 2,600 ms) interstimulus interval (ISI) in a passive, oddball discrimination task while obtaining ERPs. These ISI differences were used to test whether cross-linguistic differences in processing Mandarin lexical tone are a function of differences in acoustic resolution and/or differences in long-term memory representations. Bisyllabic nonword tokens that differed in lexical tone categories were presented using a passive listening multiple oddball paradigm. Behavioral discrimination and identification data were also collected. The ERP results revealed robust MMNs to both easy and difficult lexical tone differences for both groups at short ISIs. At long ISIs, there was either no change or an enhanced MMN amplitude for the Mandarin group, but reduced MMN amplitude for the English group. In addition, the Mandarin listeners showed a larger late negativity (LN) discriminative response than the English listeners for lexical tone contrasts in the long ISI condition. Mandarin speakers outperformed English speakers in the behavioral tasks, especially under the long ISI conditions with the more similar lexical tone pair. These results suggest that the acoustic correlates of lexical tone are fairly robust and easily discriminated at short ISIs, when the auditory sensory memory trace is strong. At longer ISIs beyond 2.5 s language-specific experience is necessary for robust discrimination.
Collapse
Affiliation(s)
- Yan H. Yu
- Department of Communication Sciences and Disorders, St. John's UniversityQueens, NY, USA
| | - Valerie L. Shafer
- Ph.D. Program of Speech-Language-Hearing Science, The Graduate Center, City University of New YorkNew York, NY, USA
| | - Elyse S. Sussman
- Dominick P. Purpura Department of Neuroscience, Rose F. Kennedy Center, Albert Einstein College of MedicineNew York, NY, USA
| |
Collapse
|
13
|
Abstract
This work takes a historical approach to discussing Brown's (1958) paper, "Some Tests of the Decay Theory of Immediate Memory". This work was and continues to be extremely influential in the field of forgetting over the short term. Its primary importance is in establishing a theoretical basis to consider a process of fundamental importance: memory decay. Brown (1958) established that time-based explanations of forgetting can account for both memory capacity and forgetting of information over short periods of time. We discuss this view both in the context of the intellectual climate at the time of the paper's publication and in the context of the modern intellectual climate. The overarching theme we observe is that decay is as controversial now as it was in the 1950s and 1960s.
Collapse
Affiliation(s)
- Timothy J Ricker
- a Department of Psychological Sciences , University of Missouri , Columbia , MO , USA
| | - Evie Vergauwe
- a Department of Psychological Sciences , University of Missouri , Columbia , MO , USA
| | - Nelson Cowan
- a Department of Psychological Sciences , University of Missouri , Columbia , MO , USA
| |
Collapse
|
14
|
Mullens D, Winkler I, Damaso K, Heathcote A, Whitson L, Provost A, Todd J. Biased relevance filtering in the auditory system: A test of confidence-weighted first-impressions. Biol Psychol 2016; 115:101-11. [DOI: 10.1016/j.biopsycho.2016.01.018] [Citation(s) in RCA: 14] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/19/2015] [Revised: 01/12/2016] [Accepted: 01/29/2016] [Indexed: 10/22/2022]
|
15
|
Winkler I, Schröger E. Auditory perceptual objects as generative models: Setting the stage for communication by sound. BRAIN AND LANGUAGE 2015; 148:1-22. [PMID: 26184883 DOI: 10.1016/j.bandl.2015.05.003] [Citation(s) in RCA: 47] [Impact Index Per Article: 5.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/20/2014] [Revised: 03/03/2015] [Accepted: 05/03/2015] [Indexed: 06/04/2023]
Abstract
Communication by sounds requires that the communication channels (i.e. speech/speakers and other sound sources) had been established. This allows to separate concurrently active sound sources, to track their identity, to assess the type of message arriving from them, and to decide whether and when to react (e.g., reply to the message). We propose that these functions rely on a common generative model of the auditory environment. This model predicts upcoming sounds on the basis of representations describing temporal/sequential regularities. Predictions help to identify the continuation of the previously discovered sound sources to detect the emergence of new sources as well as changes in the behavior of the known ones. It produces auditory event representations which provide a full sensory description of the sounds, including their relation to the auditory context and the current goals of the organism. Event representations can be consciously perceived and serve as objects in various cognitive operations.
Collapse
Affiliation(s)
- István Winkler
- Institute of Cognitive Neuroscience and Psychology, Research Centre for Natural Sciences, Hungarian Academy of Sciences, Hungary; Institute of Psychology, University of Szeged, Hungary.
| | - Erich Schröger
- Institute for Psychology, University of Leipzig, Germany.
| |
Collapse
|
16
|
Bartha-Doering L, Deuster D, Giordano V, am Zehnhoff-Dinnesen A, Dobel C. A systematic review of the mismatch negativity as an index for auditory sensory memory: From basic research to clinical and developmental perspectives. Psychophysiology 2015; 52:1115-30. [DOI: 10.1111/psyp.12459] [Citation(s) in RCA: 54] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/03/2014] [Accepted: 05/05/2015] [Indexed: 11/28/2022]
Affiliation(s)
- Lisa Bartha-Doering
- Department of Pediatrics and Adolescent Medicine; Medical University Vienna; Vienna Austria
| | - Dirk Deuster
- Department of Phoniatry and Pedaudiology; University Hospital of Muenster; Muenster Germany
| | - Vito Giordano
- Department of Pediatrics and Adolescent Medicine; Medical University Vienna; Vienna Austria
| | | | - Christian Dobel
- Institute for Biomagnetism and Biosignalanalysis, University of Muenster; Muenster Germany
- Department of Otolaryngology and the Institute of Phoniatry and Pedaudiology; Friedrich-Schiller University Jena; Jena Germany
| |
Collapse
|
17
|
Háden GP, Németh R, Török M, Winkler I. Predictive processing of pitch trends in newborn infants. Brain Res 2015; 1626:14-20. [PMID: 25749483 DOI: 10.1016/j.brainres.2015.02.048] [Citation(s) in RCA: 21] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/29/2014] [Revised: 02/20/2015] [Accepted: 02/21/2015] [Indexed: 11/17/2022]
Abstract
The notion of predictive sound processing suggests that the auditory system prepares for upcoming sounds once it has detected regular features within a sequence. Here we investigated whether predictive processes are operating at birth in the human auditory system. Event-related potentials (ERP) were recorded from healthy newborns to occasional ascending pitch steps occurring in the 2nd or the 5th position within trains of tones with otherwise monotonously descending pitch. If the trains were processed in a predictive manner only deviant pitch steps occurring in the later train position would elicit the discriminative mismatch response (MMR). Deviants delivered in the 5th but not in the 2nd position of the tone trains elicited a significant MMR response. These results suggest that newborns represent pitch trends within sound sequences and they process them in a predictive manner. This article is part of a Special Issue entitled SI: Prediction and Attention.
Collapse
Affiliation(s)
- Gábor P Háden
- Institute of Cognitive Neuroscience and Psychology, Research Centre for Natural Sciences, Hungarian Academy of Sciences, Magyar Tudósok krt. 2, H-1117 Budapest, Hungary.
| | - Renáta Németh
- Institute of Cognitive Neuroscience and Psychology, Research Centre for Natural Sciences, Hungarian Academy of Sciences, Magyar Tudósok krt. 2, H-1117 Budapest, Hungary; Department of Cognitive Science, Central European University, Frankel Leó út 30-34, H-1023 Budapest, Hungary.
| | - Miklós Török
- Military Hospital, Department of Obstetrics-Gynaecology and Perinatal Intensive Care Unit, Podmaniczky u. 111, H-1062 Budapest, Hungary.
| | - István Winkler
- Institute of Cognitive Neuroscience and Psychology, Research Centre for Natural Sciences, Hungarian Academy of Sciences, Magyar Tudósok krt. 2, H-1117 Budapest, Hungary; Institute of Psychology, University of Szeged, Egyetem u. 2, H-6722 Szeged, Hungary.
| |
Collapse
|
18
|
Nie Y, Zhang Y, Nelson PB. Auditory stream segregation using bandpass noises: evidence from event-related potentials. Front Neurosci 2014; 8:277. [PMID: 25309306 PMCID: PMC4162371 DOI: 10.3389/fnins.2014.00277] [Citation(s) in RCA: 14] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/15/2014] [Accepted: 08/18/2014] [Indexed: 11/13/2022] Open
Abstract
The current study measured neural responses to investigate auditory stream segregation of noise stimuli with or without clear spectral contrast. Sequences of alternating A and B noise bursts were presented to elicit stream segregation in normal-hearing listeners. The successive B bursts in each sequence maintained an equal amount of temporal separation with manipulations introduced on the last stimulus. The last B burst was either delayed for 50% of the sequences or not delayed for the other 50%. The A bursts were jittered in between every two adjacent B bursts. To study the effects of spectral separation on streaming, the A and B bursts were further manipulated by using either bandpass-filtered noises widely spaced in center frequency or broadband noises. Event-related potentials (ERPs) to the last B bursts were analyzed to compare the neural responses to the delay vs. no-delay trials in both passive and attentive listening conditions. In the passive listening condition, a trend for a possible late mismatch negativity (MMN) or late discriminative negativity (LDN) response was observed only when the A and B bursts were spectrally separate, suggesting that spectral separation in the A and B burst sequences could be conducive to stream segregation at the pre-attentive level. In the attentive condition, a P300 response was consistently elicited regardless of whether there was spectral separation between the A and B bursts, indicating the facilitative role of voluntary attention in stream segregation. The results suggest that reliable ERP measures can be used as indirect indicators for auditory stream segregation in conditions of weak spectral contrast. These findings have important implications for cochlear implant (CI) studies-as spectral information available through a CI device or simulation is substantially degraded, it may require more attention to achieve stream segregation.
Collapse
Affiliation(s)
- Yingjiu Nie
- Department of Communication Sciences and Disorders, James Madison UniversityHarrisonburg, VA, USA
| | - Yang Zhang
- Department of Speech-Language-Hearing Sciences, University of MinnesotaTwin-Cities, MN, USA
- Center for Neurobehavioral Development, University of MinnesotaTwin-Cities, MN, USA
| | - Peggy B. Nelson
- Department of Speech-Language-Hearing Sciences, University of MinnesotaTwin-Cities, MN, USA
| |
Collapse
|
19
|
Ricker TJ, Spiegel LR, Cowan N. Time-based loss in visual short-term memory is from trace decay, not temporal distinctiveness. J Exp Psychol Learn Mem Cogn 2014; 40:1510-23. [PMID: 24884646 DOI: 10.1037/xlm0000018] [Citation(s) in RCA: 21] [Impact Index Per Article: 2.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
There is no consensus as to why forgetting occurs in short-term memory tasks. In past work, we have shown that forgetting occurs with the passage of time, but there are 2 classes of theories that can explain this effect. In the present work, we investigate the reason for time-based forgetting by contrasting the predictions of temporal distinctiveness and trace decay in the procedure in which we have observed such loss, involving memory for arrays of characters or letters across several seconds. The 1st theory, temporal distinctiveness, predicts that increasing the amount of time between trials will lead to less proactive interference, resulting in less forgetting across a retention interval. In the 2nd theory, trace decay, temporal distinctiveness between trials is irrelevant to the loss over a retention interval. Using visual array change detection tasks in 4 experiments, we find small proactive interference effects on performance under some specific conditions, but no concomitant change in the effect of a retention interval. We conclude that trace decay is the more suitable class of explanations of the time-based forgetting in short-term memory that we have observed, and we suggest the need for further clarity in what the exact basis of that decay may be.
Collapse
Affiliation(s)
| | | | - Nelson Cowan
- Department of Psychological Sciences, University of Missouri
| |
Collapse
|
20
|
Merkel C, Stoppel CM, Hillyard SA, Heinze HJ, Hopf JM, Schoenfeld MA. Spatio-temporal Patterns of Brain Activity Distinguish Strategies of Multiple-object Tracking. J Cogn Neurosci 2014; 26:28-40. [DOI: 10.1162/jocn_a_00455] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022]
Abstract
Abstract
Human observers can readily track up to four independently moving items simultaneously, even in the presence of moving distractors. Here we combined EEG and magnetoencephalography recordings to investigate the neural processes underlying this remarkable capability. Participants were instructed to track four of eight independently moving items for 3 sec. When the movement ceased a probe stimulus consisting of four items with a higher luminance was presented. The location of the probe items could correspond fully, partly, or not at all with the tracked items. Participants reported whether the probe items fully matched the tracked items or not. About half of the participants showed slower RTs and higher error rates with increasing correspondence between tracked items and the probe. The other half, however, showed faster RTs and lower error rates when the probe fully matched the tracked items. This latter behavioral pattern was associated with enhanced probe-evoked neural activity that was localized to the lateral occipital cortex in the time range 170–210 msec. This enhanced response in the object-selective lateral occipital cortex suggested that these participants performed the tracking task by visualizing the overall shape configuration defined by the vertices of the tracked items, thereby producing a behavioral advantage on full-match trials. In a later time range (270–310 msec) probe-evoked neural activity increased monotonically as a function of decreasing target–probe correspondence in all participants. This later modulation, localized to superior parietal cortex, was proposed to reflect the degree of mismatch between the probe and the automatically formed visual STM representation of the tracked items.
Collapse
Affiliation(s)
| | | | - Steven A. Hillyard
- 2Leibniz Institute for Neurobiology, Magdeburg
- 3University California, San Diego
| | - Hans-Jochen Heinze
- 1Otto-von-Guericke University, Magdeburg
- 2Leibniz Institute for Neurobiology, Magdeburg
| | - Jens-Max Hopf
- 1Otto-von-Guericke University, Magdeburg
- 2Leibniz Institute for Neurobiology, Magdeburg
| | - Mircea Ariel Schoenfeld
- 1Otto-von-Guericke University, Magdeburg
- 2Leibniz Institute for Neurobiology, Magdeburg
- 4Kliniken Schmieder, Allensbach
| |
Collapse
|
21
|
Mahmoudian S, Farhadi M, Najafi-Koopaie M, Darestani-Farahani E, Mohebbi M, Dengler R, Esser KH, Sadjedi H, Salamat B, Danesh AA, Lenarz T. Central auditory processing during chronic tinnitus as indexed by topographical maps of the mismatch negativity obtained with the multi-feature paradigm. Brain Res 2013; 1527:161-73. [DOI: 10.1016/j.brainres.2013.06.019] [Citation(s) in RCA: 25] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/22/2012] [Revised: 06/09/2013] [Accepted: 06/14/2013] [Indexed: 11/16/2022]
|
22
|
Loss and persistence of implicit memory for sound: Evidence from auditory stream segregation context effects. Atten Percept Psychophys 2013; 75:1059-74. [DOI: 10.3758/s13414-013-0460-y] [Citation(s) in RCA: 9] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
|
23
|
Cléry H, Andersson F, Fonlupt P, Gomot M. Brain correlates of automatic visual change detection. Neuroimage 2013; 75:117-122. [PMID: 23501051 DOI: 10.1016/j.neuroimage.2013.02.050] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/21/2012] [Revised: 01/29/2013] [Accepted: 02/25/2013] [Indexed: 10/27/2022] Open
Abstract
A number of studies support the presence of visual automatic detection of change, but little is known about the brain generators involved in such processing and about the modulation of brain activity according to the salience of the stimulus. The study presented here was designed to locate the brain activity elicited by unattended visual deviant and novel stimuli using fMRI. Seventeen adult participants were presented with a passive visual oddball sequence while performing a concurrent visual task. Variations in BOLD signal were observed in the modality-specific sensory cortex, but also in non-specific areas involved in preattentional processing of changing events. A degree-of-deviance effect was observed, since novel stimuli elicited more activity in the sensory occipital regions and at the medial frontal site than small changes. These findings could be compared to those obtained in the auditory modality and might suggest a "general" change detection process operating in several sensory modalities.
Collapse
Affiliation(s)
- H Cléry
- UMR-S930, INSERM, Université François-Rabelais de Tours, Tours, France
| | - F Andersson
- UMR-S930, INSERM, Université François-Rabelais de Tours, Tours, France
| | - P Fonlupt
- INSERM U1028, CNRS UMR5292, Lyon Neuroscience Research Centre, Brain Dynamics and Cognition Team, Université Lyon 1, Lyon, France
| | - M Gomot
- UMR-S930, INSERM, Université François-Rabelais de Tours, Tours, France.
| |
Collapse
|
24
|
Sanabria D, Correa Á. Electrophysiological evidence of temporal preparation driven by rhythms in audition. Biol Psychol 2013. [DOI: 10.1016/j.biopsycho.2012.11.012] [Citation(s) in RCA: 19] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/27/2022]
|
25
|
Sulykos I, Kecskés-Kovács K, Czigler I. Mismatch Negativity Does Not Show Evidence of Memory Reactivation in the Visual Modality. J PSYCHOPHYSIOL 2013. [DOI: 10.1027/0269-8803/a000085] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/23/2022]
Abstract
The possibility of reactivation of the memory representation underlying visual mismatch negativity (vMMN) was investigated in a modified passive roving-standard paradigm. Stimuli (arrays of Gábor patches) were presented in sequences with blank interval between the sequences. The first member of each sequence was identical to the standard of the previous sequence, while the second stimulus had different orientation therefore the second stimulus was considered as deviant. In a control condition the stimuli of the previous sequence had random orientations. Event-related potentials (ERPs) in response to the deviants were compared to ERPs in response to the (physically identical) second stimulus of the control sequences. The comparison showed emergence of a positive component at an early (98–132 ms) latency range elicited by deviants. This component is interpreted as an index of increased sensitivity to rare changes in sequences dominated by identical stimuli rather than a component specific to violation of sequential regularity. Consequently, contrary to the findings in the auditory modality, the first stimulus of the sequence did not reactivate the memory representation underlying the vMMN, since subsequent deviant elicited no vMMN.
Collapse
Affiliation(s)
- István Sulykos
- Institute of Cognitive Neuroscience and Psychology, RCNS, Hungarian Academy of Sciences, Budapest, Hungary
- Eötvös Loránd University, Budapest, Hungary
| | - Krisztina Kecskés-Kovács
- Institute of Cognitive Neuroscience and Psychology, RCNS, Hungarian Academy of Sciences, Budapest, Hungary
- University of Debrecen, Hungary
| | - István Czigler
- Institute of Cognitive Neuroscience and Psychology, RCNS, Hungarian Academy of Sciences, Budapest, Hungary
- Eötvös Loránd University, Budapest, Hungary
| |
Collapse
|
26
|
Fast parametric evaluation of central speech-sound processing with mismatch negativity (MMN). Int J Psychophysiol 2013. [DOI: 10.1016/j.ijpsycho.2012.11.010] [Citation(s) in RCA: 16] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/21/2022]
|
27
|
Peter V, Mcarthur G, Thompson WF. Discrimination of stress in speech and music: A mismatch negativity (MMN) study. Psychophysiology 2012; 49:1590-600. [DOI: 10.1111/j.1469-8986.2012.01472.x] [Citation(s) in RCA: 21] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/02/2012] [Accepted: 09/04/2012] [Indexed: 11/30/2022]
Affiliation(s)
- Varghese Peter
- ARC Centre of Excellence in Cognition and its Disorders; Department of Cognitive Science; Macquarie University; Sydney; Australia
| | - Genevieve Mcarthur
- ARC Centre of Excellence in Cognition and its Disorders; Department of Cognitive Science; Macquarie University; Sydney; Australia
| | | |
Collapse
|
28
|
Ruzzoli M, Pirulli C, Brignani D, Maioli C, Miniussi C. Sensory memory during physiological aging indexed by mismatch negativity (MMN). Neurobiol Aging 2012; 33:625.e21-30. [DOI: 10.1016/j.neurobiolaging.2011.03.021] [Citation(s) in RCA: 39] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/20/2010] [Revised: 03/07/2011] [Accepted: 03/22/2011] [Indexed: 11/15/2022]
|
29
|
Kimura M. Visual mismatch negativity and unintentional temporal-context-based prediction in vision. Int J Psychophysiol 2012; 83:144-55. [PMID: 22137965 DOI: 10.1016/j.ijpsycho.2011.11.010] [Citation(s) in RCA: 99] [Impact Index Per Article: 8.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/09/2011] [Revised: 11/15/2011] [Accepted: 11/16/2011] [Indexed: 11/25/2022]
|
30
|
Salisbury DF. Finding the missing stimulus mismatch negativity (MMN): emitted MMN to violations of an auditory gestalt. Psychophysiology 2012; 49:544-8. [PMID: 22221004 DOI: 10.1111/j.1469-8986.2011.01336.x] [Citation(s) in RCA: 38] [Impact Index Per Article: 3.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/10/2011] [Accepted: 10/26/2011] [Indexed: 11/30/2022]
Abstract
Deviations from repetitive auditory stimuli evoke a mismatch negativity (MMN). Counterintuitively, omissions of repetitive stimuli do not. Violations of patterns reflecting complex rules also evoke MMN. To detect a MMN to missing stimuli, we developed an auditory gestalt task using one stimulus. Groups of six pips (50 ms duration, 330 ms stimulus onset asynchrony [SOA], 400 trials), were presented with an intertrial interval (ITI) of 750 ms while subjects (n=16) watched a silent video. Occasional deviant groups had missing 4th or 6th tones (50 trials each). Missing stimuli evoked a MMN (p<.05). The missing 4th (-0.8 µV, p<.01) and the missing 6th stimuli (-1.1 µV, p<.05) were more negative than standard 6th stimuli (0.3 µV). MMN can be elicited by a missing stimulus at long SOAs by violation of a gestalt grouping rule. Patterned stimuli appear more sensitive to omissions and ITI than homogenous streams.
Collapse
Affiliation(s)
- Dean F Salisbury
- Cognitive Neuroscience Laboratory, McLean Hospital, Belmont, Massachusetts 02478, USA.
| |
Collapse
|
31
|
Todd J, Michie PT, Schall U, Ward PB, Catts SV. Mismatch negativity (MMN) reduction in schizophrenia-impaired prediction--error generation, estimation or salience? Int J Psychophysiol 2011; 83:222-31. [PMID: 22020271 DOI: 10.1016/j.ijpsycho.2011.10.003] [Citation(s) in RCA: 78] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/02/2011] [Revised: 08/29/2011] [Accepted: 10/06/2011] [Indexed: 01/30/2023]
Abstract
The model of mismatch negativity (MMN) as a simple index of change detection has been superseded by a richer understanding of how this event-related potential (ERP) reflects the representation of the sound environment in the brain. Our conceptualization of why the MMN is altered in certain groups must also evolve along with a better understanding of the activities reflected by this component. The detection of change incorporates processes enabling an automatic registration of "sameness", a memory for such regularities and the application of this recent acoustic context to interpreting the present and future state of the environment. It also includes "weighting" the importance of this change to an organism's behaviour. In this light, the MMN has been considered a prediction error signal that occurs when the brain detects that the present state of the world violates a context-driven expectation about the environment. In this paper we revisit the consistent observation of reduced MMN amplitude in patients with schizophrenia. We review existing data to address whether the apparent deficit might reflect problems in prediction error generation, estimation or salience. Possible interpretations of MMN studies in schizophrenia are linked to dominant theories about the neurobiology of the illness.
Collapse
Affiliation(s)
- Juanita Todd
- School of Psychology, University of Newcastle, University Drive, Callaghan, NSW 2308, Australia.
| | | | | | | | | |
Collapse
|
32
|
Ricker TJ, Cowan N. Loss of visual working memory within seconds: the combined use of refreshable and non-refreshable features. J Exp Psychol Learn Mem Cogn 2010; 36:1355-68. [PMID: 20804281 PMCID: PMC2970679 DOI: 10.1037/a0020356] [Citation(s) in RCA: 65] [Impact Index Per Article: 4.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
We reexamine the role of time in the loss of information from working memory, the limited information accessible for cognitive tasks. The controversial issue of whether working memory deteriorates over time was investigated using arrays of unconventional visual characters. Each array was followed by a postperceptual mask, a variable retention interval (RI), and a recognition probe character. Dramatic forgetting across an unfilled RI of up to 6 s was observed. Adding a distracting task during the RI (repetition, subtraction, or parity judgment using spoken digits) lowered the level of recall but not increasingly so across RIs. Also, arrays of English letters were not forgotten during the RI unless distracting stimuli were included, in contrast to the finding for unconventional characters. The results suggest that unconventional visual items include some features inevitably lost over time. Attention-related processing, however, assists in the retention of other features and of English letters. We identify important constraints for working memory theories and propose that an equilibrium between forgetting and reactivation holds but only for elements that are not inevitably lost over time.
Collapse
Affiliation(s)
- Timothy J Ricker
- Department of Psychological Sciences, University of Missouri, 217 McAlester Hall, Columbia, MO 65211, USA.
| | | |
Collapse
|
33
|
Automatic auditory intelligence: An expression of the sensory–cognitive core of cognitive processes. ACTA ACUST UNITED AC 2010; 64:123-36. [DOI: 10.1016/j.brainresrev.2010.03.001] [Citation(s) in RCA: 115] [Impact Index Per Article: 8.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/09/2009] [Revised: 03/08/2010] [Accepted: 03/09/2010] [Indexed: 11/24/2022]
|
34
|
Todd J, Robinson J. The use of conditional inference to reduce prediction error—A mismatch negativity (MMN) study. Neuropsychologia 2010; 48:3009-18. [DOI: 10.1016/j.neuropsychologia.2010.06.009] [Citation(s) in RCA: 14] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/14/2010] [Revised: 05/11/2010] [Accepted: 06/05/2010] [Indexed: 11/30/2022]
|
35
|
Inui K, Urakawa T, Yamashiro K, Otsuru N, Nishihara M, Takeshima Y, Keceli S, Kakigi R. Non-linear laws of echoic memory and auditory change detection in humans. BMC Neurosci 2010; 11:80. [PMID: 20598152 PMCID: PMC2904354 DOI: 10.1186/1471-2202-11-80] [Citation(s) in RCA: 41] [Impact Index Per Article: 2.9] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/09/2009] [Accepted: 07/03/2010] [Indexed: 11/29/2022] Open
Abstract
BACKGROUND The detection of any abrupt change in the environment is important to survival. Since memory of preceding sensory conditions is necessary for detecting changes, such a change-detection system relates closely to the memory system. Here we used an auditory change-related N1 subcomponent (change-N1) of event-related brain potentials to investigate cortical mechanisms underlying change detection and echoic memory. RESULTS Change-N1 was elicited by a simple paradigm with two tones, a standard followed by a deviant, while subjects watched a silent movie. The amplitude of change-N1 elicited by a fixed sound pressure deviance (70 dB vs. 75 dB) was negatively correlated with the logarithm of the interval between the standard sound and deviant sound (1, 10, 100, or 1000 ms), while positively correlated with the logarithm of the duration of the standard sound (25, 100, 500, or 1000 ms). The amplitude of change-N1 elicited by a deviance in sound pressure, sound frequency, and sound location was correlated with the logarithm of the magnitude of physical differences between the standard and deviant sounds. CONCLUSIONS The present findings suggest that temporal representation of echoic memory is non-linear and Weber-Fechner law holds for the automatic cortical response to sound changes within a suprathreshold range. Since the present results show that the behavior of echoic memory can be understood through change-N1, change-N1 would be a useful tool to investigate memory systems.
Collapse
Affiliation(s)
- Koji Inui
- Department of Integrative Physiology, National Institute for Physiological Sciences, Myodaiji, Okazaki 444-8585, Japan
| | - Tomokazu Urakawa
- Department of Integrative Physiology, National Institute for Physiological Sciences, Myodaiji, Okazaki 444-8585, Japan
| | - Koya Yamashiro
- Department of Integrative Physiology, National Institute for Physiological Sciences, Myodaiji, Okazaki 444-8585, Japan
| | - Naofumi Otsuru
- Department of Integrative Physiology, National Institute for Physiological Sciences, Myodaiji, Okazaki 444-8585, Japan
| | - Makoto Nishihara
- Multidisciplinary Pain Center, Aichi Medical University, Aichi 480-1195, Japan
| | - Yasuyuki Takeshima
- Department of Integrative Physiology, National Institute for Physiological Sciences, Myodaiji, Okazaki 444-8585, Japan
| | - Sumru Keceli
- Department of Integrative Physiology, National Institute for Physiological Sciences, Myodaiji, Okazaki 444-8585, Japan
| | - Ryusuke Kakigi
- Department of Integrative Physiology, National Institute for Physiological Sciences, Myodaiji, Okazaki 444-8585, Japan
| |
Collapse
|
36
|
Ylinen S, Uther M, Latvala A, Vepsäläinen S, Iverson P, Akahane-Yamada R, Näätänen R. Training the Brain to Weight Speech Cues Differently: A Study of Finnish Second-language Users of English. J Cogn Neurosci 2010; 22:1319-32. [DOI: 10.1162/jocn.2009.21272] [Citation(s) in RCA: 65] [Impact Index Per Article: 4.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022]
Abstract
Abstract
Foreign-language learning is a prime example of a task that entails perceptual learning. The correct comprehension of foreign-language speech requires the correct recognition of speech sounds. The most difficult speech–sound contrasts for foreign-language learners often are the ones that have multiple phonetic cues, especially if the cues are weighted differently in the foreign and native languages. The present study aimed to determine whether non-native-like cue weighting could be changed by using phonetic training. Before the training, we compared the use of spectral and duration cues of English /i/ and /I/ vowels (e.g., beat vs. bit) between native Finnish and English speakers. In Finnish, duration is used phonologically to separate short and long phonemes, and therefore Finns were expected to weight duration cues more than native English speakers. The cross-linguistic differences and training effects were investigated with behavioral and electrophysiological methods, in particular by measuring the MMN brain response that has been used to probe long-term memory representations for speech sounds. The behavioral results suggested that before the training, the Finns indeed relied more on duration in vowel recognition than the native English speakers did. After the training, however, the Finns were able to use the spectral cues of the vowels more reliably than before. Accordingly, the MMN brain responses revealed that the training had enhanced the Finns' ability to preattentively process the spectral cues of the English vowels. This suggests that as a result of training, plastic changes had occurred in the weighting of phonetic cues at early processing stages in the cortex.
Collapse
|
37
|
Cowan N. Multiple concurrent thoughts: The meaning and developmental neuropsychology of working memory. Dev Neuropsychol 2010; 35:447-74. [PMID: 20721769 PMCID: PMC2925295 DOI: 10.1080/87565641.2010.494985] [Citation(s) in RCA: 37] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/19/2022]
Abstract
Working memory can be described as the small amount of information held in a readily accessible state, available to help in the completion of cognitive tasks. There has been considerable confusion among researchers regarding the definition of working memory, which can be attributed to the difficulty of reconciling descriptions from working memory researchers with very different theoretical orientations. Here I review theories of working memory and some of the main issues in the field, discuss current behavioral and neuropsychological research that can address these issues, and consider the implications for cognitive development.
Collapse
Affiliation(s)
- Nelson Cowan
- Department of Psychological Sciences, University of Missouri, Columbia, Missouri 65211, USA.
| |
Collapse
|
38
|
May PJC, Tiitinen H. Mismatch negativity (MMN), the deviance-elicited auditory deflection, explained. Psychophysiology 2010; 47:66-122. [DOI: 10.1111/j.1469-8986.2009.00856.x] [Citation(s) in RCA: 374] [Impact Index Per Article: 26.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/29/2022]
|
39
|
Neural substrate of sound duration discrimination during an auditory sequence in the guinea pig primary auditory cortex. Hear Res 2010; 259:107-16. [DOI: 10.1016/j.heares.2009.10.011] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/03/2009] [Revised: 10/19/2009] [Accepted: 10/21/2009] [Indexed: 11/21/2022]
|
40
|
Mismatch Negativity: The Contribution of Differences in the Refractoriness of Stimulus-Specific Neuron Populations. ACTA ACUST UNITED AC 2009; 39:833-40. [DOI: 10.1007/s11055-009-9211-x] [Citation(s) in RCA: 14] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/30/2008] [Indexed: 11/27/2022]
|
41
|
Ylinen S, Strelnikov K, Huotilainen M, Näätänen R. Effects of prosodic familiarity on the automatic processing of words in the human brain. Int J Psychophysiol 2009; 73:362-8. [DOI: 10.1016/j.ijpsycho.2009.05.013] [Citation(s) in RCA: 28] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/17/2008] [Revised: 05/22/2009] [Accepted: 05/25/2009] [Indexed: 11/28/2022]
|
42
|
Abstract
General Douglas MacArthur remarked that "old soldiers never die; they just fade away." For decades, researchers have concluded that visual working memories, like old soldiers, fade away gradually, becoming progressively less precise as they are retained for longer periods of time. However, these conclusions were based on threshold-estimation procedures in which the complete termination of a memory could artifactually produce the appearance of lower precision. Here, we use a recall-based visual working memory paradigm that provides separate measures of the probability that a memory is available and the precision of the memory when it is available. Using this paradigm, we demonstrate that visual working memory representations may be retained for several seconds with little or no loss of precision, but that they may terminate suddenly and completely during this period.
Collapse
Affiliation(s)
- Weiwei Zhang
- Center for Mind & Brain,, University of California, Davis, CA 95618, USA.
| | | |
Collapse
|
43
|
Rahne T, Sussman E. Neural representations of auditory input accommodate to the context in a dynamically changing acoustic environment. Eur J Neurosci 2008; 29:205-11. [PMID: 19087164 DOI: 10.1111/j.1460-9568.2008.06561.x] [Citation(s) in RCA: 19] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/28/2022]
Abstract
The auditory scene is dynamic, changing from 1 min to the next as sound sources enter and leave our space. How does the brain resolve the problem of maintaining neural representations of the distinct yet changing sound sources? We used an auditory streaming paradigm to test the dynamics of multiple sound source representation, when switching between integrated and segregated sound streams. The mismatch negativity (MMN) component of event-related potentials was used as index of change detection to observe stimulus-driven modulation of the ongoing sound organization. Probe tones were presented randomly within ambiguously organized sound sequences to reveal whether the neurophysiological representation of the sounds was integrated (no MMN) or segregated (MMN). The pattern of results demonstrated context-dependent responses to a single tone that was modulated in dynamic fashion as the auditory environment rapidly changed from integrated to segregated sounds. This suggests a rapid form of auditory plasticity in which the longer-term sound context influences the current state of neural activity when it is ambiguous. These results demonstrate stimulus-driven modulation of neural activity that accommodates to the dynamically changing acoustic environment.
Collapse
Affiliation(s)
- Torsten Rahne
- Department of Experimental Audiology and Medical Physics, Otto-von-Guericke-University, Magdeburg, Germany.
| | | |
Collapse
|
44
|
Glass E, Sachse S, von Suchodoletz W. Development of auditory sensory memory from 2 to 6 years: an MMN study. J Neural Transm (Vienna) 2008; 115:1221-9. [DOI: 10.1007/s00702-008-0088-6] [Citation(s) in RCA: 22] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/11/2008] [Accepted: 06/15/2008] [Indexed: 11/28/2022]
|
45
|
Bendixen A, Schröger E. Memory trace formation for abstract auditory features and its consequences in different attentional contexts. Biol Psychol 2008; 78:231-41. [DOI: 10.1016/j.biopsycho.2008.03.005] [Citation(s) in RCA: 45] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/04/2007] [Revised: 01/11/2008] [Accepted: 03/09/2008] [Indexed: 10/22/2022]
|
46
|
De Sanctis P, Ritter W, Molholm S, Kelly SP, Foxe JJ. Auditory scene analysis: the interaction of stimulation rate and frequency separation on pre-attentive grouping. Eur J Neurosci 2008; 27:1271-6. [PMID: 18364041 DOI: 10.1111/j.1460-9568.2008.06080.x] [Citation(s) in RCA: 16] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/01/2022]
Abstract
Segregation of auditory inputs into meaningful acoustic groups is a key element of auditory scene analysis. Previously, we showed that two interwoven sets of tones differing widely along multiple feature dimensions (duration, pitch and location) were pre-attentively separated into different groups, and that tones separated in this manner did not elicit the mismatch negativity component with respect to each other. Grouping was studied with human subjects using a stimulus rate too slow to induce streaming. Here, we varied the separation of tone sequences along a single feature dimension, i.e. frequency. Frequency differences were either 24 Hz (small) or 1054 Hz (large). Two relatively slow stimulus rates were used (2.7 or 1 tone/s) to explicitly investigate grouping outside the so-called 'streaming effect', which requires rates of about 4 tones/s or faster. Two tones were presented in a quasi-random manner with embedded trains of one to four identical tones in a row. Deviants were defined as frequency switches after trains of four identical tones. Mismatch negativity was only elicited for small frequency switches at the slower stimulation rate. The data indicate that pre-attentive grouping of tones occurred when the frequency difference that separated them was large, regardless of stimulation rate. For small frequency differences, inputs were only grouped separately when the stimulation rate was relatively fast.
Collapse
Affiliation(s)
- Pierfilippo De Sanctis
- The Cognitive Neurophysiology Laboratory, Nathan S. Kline Institute for Psychiatric Research, Program in Cognitive Neuroscience and Schizophrenia, 140 Old Orangeburg Road, Orangeburg, NY 10962, USA
| | | | | | | | | |
Collapse
|
47
|
|
48
|
Barry JG, Hardiman MJ, Line E, White KB, Yasin I, Bishop DVM. Duration of auditory sensory memory in parents of children with SLI: a mismatch negativity study. BRAIN AND LANGUAGE 2008; 104:75-88. [PMID: 17412410 DOI: 10.1016/j.bandl.2007.02.006] [Citation(s) in RCA: 13] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/02/2006] [Revised: 02/04/2007] [Accepted: 02/12/2007] [Indexed: 05/14/2023]
Abstract
In a previous behavioral study, we showed that parents of children with SLI had a subclinical deficit in phonological short-term memory. Here, we tested the hypothesis that they also have a deficit in nonverbal auditory sensory memory. We measured auditory sensory memory using a paradigm involving an electrophysiological component called the mismatch negativity (MMN). The MMN is a measure of the brain's ability to detect a difference between a frequent standard stimulus (1000 Hz tone) and a rare deviant one (1200 Hz tone). Memory effects were assessed by varying the inter-stimulus interval (ISI) between the standard and deviant. We predicted that parents of children with SLI would have a smaller MMN than parents of typically developing children at a long ISI (3000 ms), but not at a short one (800 ms). This was broadly confirmed. However, individual differences in MMN amplitude did not correlate with measures of phonological short-term memory. Attenuation of MMN amplitude at the longer ISI thus did not provide unambiguous support for the hypothesis of a reduced auditory sensory memory in parents of affected children. We conclude by reviewing possible explanations for the observed group effects.
Collapse
Affiliation(s)
- Johanna G Barry
- Department of Experimental Psychology, University of Oxford, UK.
| | | | | | | | | | | |
Collapse
|
49
|
De Diego Balaguer R, Toro JM, Rodriguez-Fornells A, Bachoud-Lévi AC. Different neurophysiological mechanisms underlying word and rule extraction from speech. PLoS One 2007; 2:e1175. [PMID: 18000546 PMCID: PMC2063512 DOI: 10.1371/journal.pone.0001175] [Citation(s) in RCA: 91] [Impact Index Per Article: 5.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/25/2007] [Accepted: 10/22/2007] [Indexed: 11/18/2022] Open
Abstract
The initial process of identifying words from spoken language and the detection of more subtle regularities underlying their structure are mandatory processes for language acquisition. Little is known about the cognitive mechanisms that allow us to extract these two types of information and their specific time-course of acquisition following initial contact with a new language. We report time-related electrophysiological changes that occurred while participants learned an artificial language. These changes strongly correlated with the discovery of the structural rules embedded in the words. These changes were clearly different from those related to word learning and occurred during the first minutes of exposition. There is a functional distinction in the nature of the electrophysiological signals during acquisition: an increase in negativity (N400) in the central electrodes is related to word-learning and development of a frontal positivity (P2) is related to rule-learning. In addition, the results of an online implicit and a post-learning test indicate that, once the rules of the language have been acquired, new words following the rule are processed as words of the language. By contrast, new words violating the rule induce syntax-related electrophysiological responses when inserted online in the stream (an early frontal negativity followed by a late posterior positivity) and clear lexical effects when presented in isolation (N400 modulation). The present study provides direct evidence suggesting that the mechanisms to extract words and structural dependencies from continuous speech are functionally segregated. When these mechanisms are engaged, the electrophysiological marker associated with rule-learning appears very quickly, during the earliest phases of exposition to a new language.
Collapse
Affiliation(s)
- Ruth De Diego Balaguer
- INSERM U841 - Equipe 1 Neuropsychologie Interventionnelle, IM3-Paris XII, Créteil, France
| | | | | | | |
Collapse
|
50
|
The mismatch negativity (MMN) in basic research of central auditory processing: a review. Clin Neurophysiol 2007; 118:2544-90. [PMID: 17931964 DOI: 10.1016/j.clinph.2007.04.026] [Citation(s) in RCA: 1673] [Impact Index Per Article: 98.4] [Reference Citation Analysis] [Abstract] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/24/2006] [Revised: 04/18/2007] [Accepted: 04/28/2007] [Indexed: 11/22/2022]
Abstract
In the present article, the basic research using the mismatch negativity (MMN) and analogous results obtained by using the magnetoencephalography (MEG) and other brain-imaging technologies is reviewed. This response is elicited by any discriminable change in auditory stimulation but recent studies extended the notion of the MMN even to higher-order cognitive processes such as those involving grammar and semantic meaning. Moreover, MMN data also show the presence of automatic intelligent processes such as stimulus anticipation at the level of auditory cortex. In addition, the MMN enables one to establish the brain processes underlying the initiation of attention switch to, conscious perception of, sound change in an unattended stimulus stream.
Collapse
|