Beneficial effects of word final stress in segmenting a new language: evidence from ERPs

Auditory representations for long lasting sounds: Insights from event-related brain potentials and neural oscillations

The basic features of short sounds, such as frequency and intensity including their temporal dynamics, are integrated in a unitary representation. Knowledge on how our brain processes long lasting sounds is scarce. We review research utilizing the Mismatch Negativity event-related potential and neural oscillatory activity for studying representations for long lasting simple versus complex sounds such as sinusoidal tones versus speech. There is evidence for a temporal constraint in the formation of auditory representations: Auditory edges like sound onsets within long lasting sounds open a temporal window of about 350 ms in which the sounds' dynamics are integrated into a representation, while information beyond that window contributes less to that representation. This integration window segments the auditory input into short chunks. We argue that the representations established in adjacent integration windows can be concatenated into an auditory representation of a long sound, thus, overcoming the temporal constraint.

Assessing the Sensitivity of EEG-Based Frequency-Tagging as a Metric for Statistical Learning

Statistical learning (SL) is hypothesized to play an important role in language development. However, the measures typically used to assess SL, particularly at the level of individual participants, are largely indirect and have low sensitivity. Recently, a neural metric based on frequency-tagging has been proposed as an alternative measure for studying SL. We tested the sensitivity of frequency-tagging measures for studying SL in individual participants in an artificial language paradigm, using non-invasive electroencephalograph (EEG) recordings of neural activity in humans. Importantly, we used carefully constructed controls to address potential acoustic confounds of the frequency-tagging approach, and compared the sensitivity of EEG-based metrics to both explicit and implicit behavioral tests of SL. Group-level results confirm that frequency-tagging can provide a robust indication of SL for an artificial language, above and beyond potential acoustic confounds. However, this metric had very low sensitivity at the level of individual participants, with significant effects found only in 30% of participants. Comparison of the neural metric to previously established behavioral measures for assessing SL showed a significant yet weak correspondence with performance on an implicit task, which was above-chance in 70% of participants, but no correspondence with the more common explicit 2-alternative forced-choice task, where performance did not exceed chance-level. Given the proposed ubiquitous nature of SL, our results highlight some of the operational and methodological challenges of obtaining robust metrics for assessing SL, as well as the potential confounds that should be taken into account when using the frequency-tagging approach in EEG studies.

Exploring the neural correlates of lexical stress perception in english among Chinese-English bilingual children with autism spectrum disorder: An ERP study

Previous studies found that individuals with autism spectrum disorder (ASD) were less sensitive to the variations of lexical stress in their native language than typically developing controls. However, no study has been conducted to explore the perception of lexical stress in the second language among individuals with ASD. Using ERPs (event-related potentials) measurement with an oddball paradigm, the current study examined and compared the neural responses by Chinese-English bilingual children with ASD and typically developing controls in the processing of English lexical stress. The results showed that when compared with typically developing controls, children with ASD manifested reduced MMN (mismatch negativity) amplitude at the left temporal-parietal and parietal sites, indicating that they were less sensitive to lexical stress. However, a more negative MMN response was found for ASD group than for typically developing group at the right central-parietal, temporal-parietal, and temporal sites. In addition, the right hemisphere was more activated than the left hemisphere for ASD group, which might be derived from the reversed asymmetry of brain activation for individuals with ASD when processing language-related stimuli.

Performance monitoring in lung cancer patients pre- and post-chemotherapy using fine-grained electrophysiological measures

No previous event-related potentials (ERPs) study has explored the error-related negativity (ERN) - an ERP component indexing performance monitoring - associated to cancer and chemotherapy-induced cognitive impairment in a lung cancer population. The aim of this study was to examine differences in performance monitoring in a small-cell lung cancer group (SCLC, C +) 1-month following chemotherapy and two control groups: a non-small cell lung cancer patient group (NSCLC, C −) prior to chemotherapy and a healthy control group (HC).

Seventeen SCLC (C +) underwent a neuropsychological assessment and an ERP study using a flanker and a stop-signal paradigm. This group was compared to fifteen age-, gender- and education-matched NSCLC (C −) and eighteen HC.

Between 20 and 30% of patients in both lung cancer groups (C + and C −) met criteria for cognitive impairment. Concerning ERPs, lung cancer patients showed lower overall hit rate and a severe ERN amplitude reduction compared to HC.

Lung cancer patients exhibited an abnormal pattern of performance monitoring thus suggesting that chemotherapy and especially cancer itself, may contribute to cognitive deterioration. ERN appeared as an objective laboratory tool sensitive to cognitive dysfunction in cancer population.

•

This is the first study to explore error-related negativity in lung cancer patients.

•

Lung cancer patients showed a severe ERN amplitude reduction.

•

ERN resulted a potential biomarker of cognitive impairment in lung cancer population.

Neurophysiological evidence for enhanced tactile acuity in early blindness in some but not all haptic tasks

Previous research assessing the presence of enhanced tactile skills in early-blind (EB) population obtained conflicting results. Most of the studies relied on behavioral measures with which different mechanisms leading to the same outcome go unnoticed. Moreover, the scarce electrophysiological research that has been conducted focused exclusively on the processing of microgeometric properties. To clarify the extent of superior tactile abilities in EBs using high-density multichannel electrophysiological recordings, the present study compared the electrophysiological correlates of EBs and sighted controls (CON) in two tactile discrimination tasks that targeted microgeometric (texture) and macrogeometric (shape) properties. After a restricted exploration (haptic glance), participants judged whether a touched stimulus corresponded to an expected stimulus whose name had been previously presented aurally. In the texture discrimination task, differences between groups emerged at ∼75 ms (early perceptual processing stages) whereas we found no between-group differences during shape discrimination. Furthermore, for the first time, we were able to determine the latency at which EBs started to discriminate micro- (EB: 170 ms; CON: 230 ms) and macrogeometric (EB: 250 ms; CON: 270 ms) properties. Altogether, the results suggest different electrophysiological signatures during texture (but not shape) discrimination in EBs, possibly due to cortical reorganization in occipital areas and their increased connectivity with S1.

Infant Directed Speech Enhances Statistical Learning in Newborn Infants: An ERP Study

Statistical learning and the social contexts of language addressed to infants are hypothesized to play important roles in early language development. Previous behavioral work has found that the exaggerated prosodic contours of infant-directed speech (IDS) facilitate statistical learning in 8-month-old infants. Here we examined the neural processes involved in on-line statistical learning and investigated whether the use of IDS facilitates statistical learning in sleeping newborns. Event-related potentials (ERPs) were recorded while newborns were exposed to12 pseudo-words, six spoken with exaggerated pitch contours of IDS and six spoken without exaggerated pitch contours (ADS) in ten alternating blocks. We examined whether ERP amplitudes for syllable position within a pseudo-word (word-initial vs. word-medial vs. word-final, indicating statistical word learning) and speech register (ADS vs. IDS) would interact. The ADS and IDS registers elicited similar ERP patterns for syllable position in an early 0-100 ms component but elicited different ERP effects in both the polarity and topographical distribution at 200-400 ms and 450-650 ms. These results provide the first evidence that the exaggerated pitch contours of IDS result in differences in brain activity linked to on-line statistical learning in sleeping newborns.

Cortical encoding and neurophysiological tracking of intensity and pitch cues signaling English stress patterns in native and nonnative speakers

We examined cross-language differences in neural encoding and tracking of intensity and pitch cues signaling English stress patterns. Auditory mismatch negativities (MMNs) were recorded in English and Mandarin listeners in response to contrastive English pseudowords whose primary stress occurred either on the first or second syllable (i.e., "nocTICity" vs. "NOCticity"). The contrastive syllable stress elicited two consecutive MMNs in both language groups, but English speakers demonstrated larger responses to stress patterns than Mandarin speakers. Correlations between the amplitude of ERPs and continuous changes in the running intensity and pitch of speech assessed how well each language group's brain activity tracked these salient acoustic features of lexical stress. We found that English speakers' neural responses tracked intensity changes in speech more closely than Mandarin speakers (higher brain-acoustic correlation). Findings demonstrate more robust and precise processing of English stress (intensity) patterns in early auditory cortical responses of native relative to nonnative speakers.

Prosodic cues enhance rule learning by changing speech segmentation mechanisms

Prosody has been claimed to have a critical role in the acquisition of grammatical information from speech. The exact mechanisms by which prosodic cues enhance learning are fully unknown. Rules from language often require the extraction of non-adjacent dependencies (e.g., he plays, he sings, he speaks). It has been proposed that pauses enhance learning because they allow computing non-adjacent relations helping word segmentation by removing the need to compute adjacent computations. So far only indirect evidence from behavioral and electrophysiological measures comparing learning effects after exposure to speech with and without pauses support this claim. By recording event-related potentials during the acquisition process of artificial languages with and without pauses between words with embedded non-adjacent rules we provide direct evidence on how the presence of pauses modifies the way speech is processed during learning to enhance segmentation and rule generalization. The electrophysiological results indicate that pauses as short as 25 ms attenuated the N1 component irrespective of whether learning was possible or not. In addition, a P2 enhancement was present only when learning of non-adjacent dependencies was possible. The overall results support the claim that the simple presence of subtle pauses changed the segmentation mechanism used reflected in an exogenously driven N1 component attenuation and improving segmentation at the behavioral level. This effect can be dissociated from the endogenous P2 enhancement that is observed irrespective of the presence of pauses whenever non-adjacent dependencies are learned.

The speed of object recognition from a haptic glance: event-related potential evidence

Recognition of an object usually involves a wide range of sensory inputs. Accumulating evidence shows that first brain responses associated with the visual discrimination of objects emerge around 150 ms, but fewer studies have been devoted to measure the first neural signature of haptic recognition. To investigate the speed of haptic processing, we recorded event-related potentials (ERPs) during a shape discrimination task without visual information. After a restricted exploratory procedure, participants (n = 27) were instructed to judge whether the touched object corresponded to an expected object whose name had been previously presented in a screen. We encountered that any incongruence between the presented word and the shape of the object evoked a frontocentral negativity starting at ∼175 ms. With the use of source analysis and L2 minimum-norm estimation, the neural sources of this differential activity were located in higher level somatosensory areas and prefrontal regions involved in error monitoring and cognitive control. Our findings reveal that the somatosensory system is able to complete an amount of haptic processing substantial enough to trigger conflict-related responses in medial and prefrontal cortices in <200 ms. The present results show that our haptic system is a fast recognition device closely interlinked with error- and conflict-monitoring processes.

Auditory evoked potentials reveal early perceptual effects of distal prosody on speech segmentation

Prosodic context several syllables prior (i.e., distal) to an ambiguous word boundary influences speech segmentation. To assess whether distal prosody influences early perceptual processing or later lexical competition, EEG was recorded while subjects listened to eight-syllable sequences with ambiguous word boundaries for the last four syllables (e.g., tie murder bee vs. timer derby). Pitch and duration of the first 5 syllables were manipulated to induce sequence segmentation with either a monosyllabic or disyllabic final word. Behavioral results confirmed a successful manipulation. Moreover, penultimate syllables (e.g., der) elicited a larger anterior positivity 200-500 ms after onset for prosodic contexts predicted to induce word-initial perception of these syllables. Final syllables (e.g. bee) elicited a similar anterior positivity in the context predicted to induce word-initial perception of these syllables. Additionally, these final syllables elicited a larger positive-to-negative deflection (P1-N1) 60-120 ms after onset, and a larger N400. The finding that prosodic characteristics of speech several syllables prior to ambiguous word boundaries modulate both early and late ERPs elicited by subsequent syllable onsets provides evidence that distal prosody influences early perceptual processing, and later lexical competition.

Learning across senses: cross-modal effects in multisensory statistical learning

It is currently unknown whether statistical learning is supported by modality-general or modality-specific mechanisms. One issue within this debate concerns the independence of learning in one modality from learning in other modalities. In the present study, the authors examined the extent to which statistical learning across modalities is independent by simultaneously presenting learners with auditory and visual streams. After establishing baseline rates of learning for each stream independently, they systematically varied the amount of audiovisual correspondence across 3 experiments. They found that learners were able to segment both streams successfully only when the boundaries of the audio and visual triplets were in alignment. This pattern of results suggests that learners are able to extract multiple statistical regularities across modalities provided that there is some degree of cross-modal coherence. They discuss the implications of their results in light of recent claims that multisensory statistical learning is guided by modality-independent mechanisms.

Musical expertise and statistical learning of musical and linguistic structures

Adults and infants can use the statistical properties of syllable sequences to extract words from continuous speech. Here we present a review of a series of electrophysiological studies investigating (1) Speech segmentation resulting from exposure to spoken and sung sequences (2) The extraction of linguistic versus musical information from a sung sequence (3) Differences between musicians and non-musicians in both linguistic and musical dimensions. The results show that segmentation is better after exposure to sung compared to spoken material and moreover, that linguistic structure is better learned than the musical structure when using sung material. In addition, musical expertise facilitates the learning of both linguistic and musical structures. Finally, an electrophysiological approach, which directly measures brain activity, appears to be more sensitive than a behavioral one.

Neurophysiological mechanisms involved in language learning in adults

Little is known about the brain mechanisms involved in word learning during infancy and in second language acquisition and about the way these new words become stable representations that sustain language processing. In several studies we have adopted the human simulation perspective, studying the effects of brain-lesions and combining different neuroimaging techniques such as event-related potentials and functional magnetic resonance imaging in order to examine the language learning (LL) process. In the present article, we review this evidence focusing on how different brain signatures relate to (i) the extraction of words from speech, (ii) the discovery of their embedded grammatical structure, and (iii) how meaning derived from verbal contexts can inform us about the cognitive mechanisms underlying the learning process. We compile these findings and frame them into an integrative neurophysiological model that tries to delineate the major neural networks that might be involved in the initial stages of LL. Finally, we propose that LL simulations can help us to understand natural language processing and how the recovery from language disorders in infants and adults can be accomplished.

Time course and functional neuroanatomy of speech segmentation in adults

The present investigation was devoted to unraveling the time-course and brain regions involved in speech segmentation, which is one of the first processes necessary for learning a new language in adults and infants. A specific brain electrical pattern resembling the N400 language component was identified as an indicator of speech segmentation of candidate words. This N400 trace was clearly elicited after a short exposure to the words of the new language and showed a decrease in amplitude with longer exposure. Two brain regions were observed to be active during this process: the posterior superior temporal gyrus and the superior part of the ventral premotor cortex. We interpret these findings as evidence for the existence of an auditory-motor interface that is responsible for isolating possible candidate words when learning a new language in adults.

Speech segmentation is facilitated by visual cues

Evidence from infant studies indicates that language learning can be facilitated by multimodal cues. We extended this observation to adult language learning by studying the effects of simultaneous visual cues (nonassociated object images) on speech segmentation performance. Our results indicate that segmentation of new words from a continuous speech stream is facilitated by simultaneous visual input that it is presented at or near syllables that exhibit the low transitional probability indicative of word boundaries. This indicates that temporal audio-visual contiguity helps in directing attention to word boundaries at the earliest stages of language learning. Off-boundary or arrhythmic picture sequences did not affect segmentation performance, suggesting that the language learning system can effectively disregard noninformative visual information. Detection of temporal contiguity between multimodal stimuli may be useful in both infants and second-language learners not only for facilitating speech segmentation, but also for detecting word-object relationships in natural environments.