Age-appropriate adaptation of creativity tasks for infants aged 12-24 months

Creativity is an important skill that relates to innovation, problem-solving and artistic achievement. However, relatively little is known about the early development of creative potential in very young children, in part due to a paucity of tasks suitable for use during infancy. Current measures of creativity in early childhood include the Unusual Box Test, Torrance's Thinking Creatively in Action and Movement (TCAM) task and the Toca Kitchen Monsters task. These tasks are designed for children aged above 12, 36 and 18 months respectively, but very few measures of creativity can be used for infants aged below 2. Accordingly, here we report age-appropriate adaptations of TCAM and Toca Kitchen Monsters tasks for infants as young as 12 to 24 months. Considerations taken into account include (1) infants' cognitive capacities (i.e., attention span, language comprehension skills, motor skills, and approach to play), and (2) practicality of the stimuli, including suitability for use amid the COVID-19 pandemic. The modified creativity battery for infants includes three tasks: Music Play, Object Play and Exploratory Play tasks. The task protocols elaborated in this paper are intended to facilitate studies on the early development of creativity in infants aged between 12 and 24 months. Primary highlights include:•Age-appropriate adaptation of creativity tasks for use with infants aged between 12 and 24 months.•Consideration of infants' cognitive capacities and stimulus practicality.•Innovative use of movement as expression of infants' creative behaviour.

Revealing the spatiotemporal brain dynamics of covert speech compared with overt speech: A simultaneous EEG-fMRI study

Covert speech (CS) refers to speaking internally to oneself without producing any sound or movement. CS is involved in multiple cognitive functions and disorders. Reconstructing CS content by brain-computer interface (BCI) is also an emerging technique. However, it is still controversial whether CS is a truncated neural process of overt speech (OS) or involves independent patterns. Here, we performed a word-speaking experiment with simultaneous EEG-fMRI. It involved 32 participants, who generated words both overtly and covertly. By integrating spatial constraints from fMRI into EEG source localization, we precisely estimated the spatiotemporal dynamics of neural activity. During CS, EEG source activity was localized in three regions: the left precentral gyrus, the left supplementary motor area, and the left putamen. Although OS involved more brain regions with stronger activations, CS was characterized by an earlier event-locked activation in the left putamen (peak at 262 ms versus 1170 ms). The left putamen was also identified as the only hub node within the functional connectivity (FC) networks of both OS and CS, while showing weaker FC strength towards speech-related regions in the dominant hemisphere during CS. Path analysis revealed significant multivariate associations, indicating an indirect association between the earlier activation in the left putamen and CS, which was mediated by reduced FC towards speech-related regions. These findings revealed the specific spatiotemporal dynamics of CS, offering insights into CS mechanisms that are potentially relevant for future treatment of self-regulation deficits, speech disorders, and development of BCI speech applications.

A protocol for social interactive assessment of infant attention set-shifting between 12-24 months of age

This protocol describes an adaptation of a classic sequential touching object categorisation task to assess infant attention set-shifting, suitable for ages 12-24 months. The task is conducted in a social interactive context with a parent, who scaffolds their infants' attention shift from high-salience to low-salience dimensional properties of objects (e.g., shape vs material). This task is adapted from Ellis and Oakes (2006), where 14 month-old infants were able to flexibly attend to both shape and material. In this paper, we present a methodological innovation which permits the direct measurement of the effect of parent-child interactions on an early developing executive function skill. This novel social interactive protocol permits direct assessment of the effect of parent-child interaction on an early executive function skill, attention set-shifting.•The parental role is to scaffold a shift in their child's attention from a high salient (e.g. shape) to a low-salient (e.g. material) dimension of the stimulus set.•The protocol is suitable for infants aged between 12 and 24 months.

Potential cognitive and neural benefits of a computerised cognitive training programme based on Structure Learning in healthy adults: study protocol for a randomised controlled trial

BACKGROUND

Cognitive flexibility refers to the capacity to shift between conceptual representations particularly in response to changes in instruction and feedback. It enables individuals to swiftly adapt to changes in their environment and has significant implications for learning. The present study focuses on investigating changes in cognitive flexibility following an intervention programme-Structure Learning training.

METHODS

Participants are pseudo-randomised to either the Training or Control group, while matched on age, sex, intelligence and cognitive flexibility performance. In the Training group, participants undergo around 2 weeks of training (at least 13 sessions) on Structure Learning. In the Control group, participants do not have to undergo any training and are never exposed to the Structure Learning task. The effects of Structure Learning training are investigated at both the behavioural and neural level. We measured covariates that can influence an individual's training performance before the training phase and outcome measures that can potentially show training benefits after the training phase. At the behavioural level, we investigated outcomes in both cognitive and social aspects with a primary focus on executive functions. At the neural level, we employed a multimodality approach and investigated potential changes to functional connectivity patterns, neurometabolite concentration in the frontal brain regions, and brain microstructure and myelination.

DISCUSSION

We reported the development of a novel training programme based on Structure Learning that aims to hone a general learning ability to potentially achieve extensive transfer benefits across various cognitive constructs. Potential transfer benefits can be exhibited through better performance in outcome measures between Training and Control participants, and positive associations between training performance and outcomes after the training in Training participants. Moreover, we attempt to substantiate behavioural findings with evidence of neural changes across different imaging modalities by the Structure Learning training.

TRIAL REGISTRATION

National Institutes of Health U.S. National Library of Medicine ClinicalTrials.gov NCT05611788. Registered on 7 November 2022.

PROTOCOL VERSION

11 May 2023.

Study protocol: How does cognitive flexibility relate to other executive functions and learning in healthy young adults?

BACKGROUND

Cognitive flexibility (CF) enables individuals to readily shift from one concept or mode of practice/thoughts to another in response to changes in the environment and feedback, making CF vital to optimise success in obtaining goals. However, how CF relates to other executive functions (e.g., working memory, response inhibition), mental abilities (e.g., creativity, literacy, numeracy, intelligence, structure learning), and social factors (e.g., multilingualism, tolerance of uncertainty, perceived social support, social decision-making) is less well understood. The current study aims to (1) establish the construct validity of CF in relation to other executive function skills and intelligence, and (2) elucidate specific relationships between CF, structure learning, creativity, career decision making and planning, and other life skills.

METHODS

This study will recruit up to 400 healthy Singaporean young adults (age 18-30) to complete a wide range of cognitive tasks and social questionnaires/tasks. The richness of the task/questionnaire battery and within-participant administration enables us to use computational modelling and structural equation modelling to examine connections between the latent constructs of interest.

SIGNIFICANCE AND IMPACT

The current study is the first systematic investigation into the construct validity of CF and its interrelationship with other important cognitive skills such as learning and creativity, within an Asian context. The study will further explore the concept of CF as a non-unitary construct, a novel theoretical proposition in the field. The inclusion of a structure learning paradigm is intended to inform future development of a novel intervention paradigm to enhance CF. Finally, the results of the study will be useful for informing classroom pedagogy and the design of lifelong learning policies and curricula, as part of the wider remit of the Cambridge-NTU Centre for Lifelong Learning and Individualised Cognition (CLIC).

Learning at your brain's rhythm: individualized entrainment boosts learning for perceptual decisions

Training is known to improve our ability to make decisions when interacting in complex environments. However, individuals vary in their ability to learn new tasks and acquire new skills in different settings. Here, we test whether this variability in learning ability relates to individual brain oscillatory states. We use a visual flicker paradigm to entrain individuals at their own brain rhythm (i.e. peak alpha frequency) as measured by resting-state electroencephalography (EEG). We demonstrate that this individual frequency-matched brain entrainment results in faster learning in a visual identification task (i.e. detecting targets embedded in background clutter) compared to entrainment that does not match an individual's alpha frequency. Further, we show that learning is specific to the phase relationship between the entraining flicker and the visual target stimulus. EEG during entrainment showed that individualized alpha entrainment boosts alpha power, induces phase alignment in the pre-stimulus period, and results in shorter latency of early visual evoked potentials, suggesting that brain entrainment facilitates early visual processing to support improved perceptual decisions. These findings suggest that individualized brain entrainment may boost perceptual learning by altering gain control mechanisms in the visual cortex, indicating a key role for individual neural oscillatory states in learning and brain plasticity.

Parent-infant affect synchrony during social and solo play

While mother-infant affect synchrony has been proposed to facilitate the early development of social understanding, most investigations into affect synchrony have concentrated more on negative than positive affect. We analysed affect sharing during parent-infant object play, comparing positive and negative affect, to examine how it is modulated by shared playful activity. Mother-infant dyads (N = 20, average infant age 10.7 months) played together (social) or separately (solo) using an object. Both participants increased positive affect during social play as compared with solo play. Positive affect synchrony also increased during social play compared with solo play, whereas negative affect synchrony did not differ. Closer examination of the temporal dynamics of affect changes showed that infants' shifts to positive affect tended to occur contingently in response to their mothers', whereas mothers' shifts to negative affect followed their infants'. Further, during social play, positive affect displays were more long-lived while negative more short-lived. While our sample was small and from a homogeneous population (e.g. white, highly educated parents), limiting the implications of the findings, these results demonstrate that maternal active engagement in playful interaction with her infant affords, increases, and extends infant positive affect and parent-infant positive affect synchrony, providing insights into how the social context modulates infants' affective experiences. This article is part of a discussion meeting issue 'Face2face: advancing the science of social interaction'.

The Design and Development of Instrumented Toys for the Assessment of Infant Cognitive Flexibility

The first years of an infant's life represent a sensitive period for neurodevelopment where one can see the emergence of nascent forms of executive function (EF), which are required to support complex cognition. Few tests exist for measuring EF during infancy, and the available tests require painstaking manual coding of infant behaviour. In modern clinical and research practice, human coders collect data on EF performance by manually labelling video recordings of infant behaviour during toy or social interaction. Besides being extremely time-consuming, video annotation is known to be rater-dependent and subjective. To address these issues, starting from existing cognitive flexibility research protocols, we developed a set of instrumented toys to serve as a new type of task instrumentation and data collection tool suitable for infant use. A commercially available device comprising a barometer and an inertial measurement unit (IMU) embedded in a 3D-printed lattice structure was used to detect when and how the infant interacts with the toy. The data collected using the instrumented toys provided a rich dataset that described the sequence of toy interaction and individual toy interaction patterns, from which EF-relevant aspects of infant cognition can be inferred. Such a tool could provide an objective, reliable, and scalable method of collecting early developmental data in socially interactive contexts.

Synchrony in parent-offspring social interactions across development: A cross-species review of rodents and humans

In humans, parent-child neural synchrony has been shown to support early communication, social attunement and learning. Further, some animal species (including rodents and bats) are now known to share neural synchrony during certain forms of social behaviour. However, very little is known about the developmental origins and sequelae of neural synchrony, and whether this neural mechanism might play a causal role in the control of social and communicative behaviour across species. Rodent models are optimal for exploring such questions of causality, with a plethora of tools available for both disruption/induction (optogenetics) and even mechanistic dissection of synchrony-induction pathways (in vivo electrical or optical recording of neural activity). However, before the benefits of rodent models for advancing research on parent-infant synchrony can be realised, it is first important to address a gap in understanding the forms of parent-pup synchrony that occur during rodent development, and how these social relationships evolve over time. Accordingly, this review seeks to identify parent-pup social behaviours that could potentially drive or facilitate synchrony and to discuss key differences or limitations when comparing mouse to human models of parent-infant synchrony. Uniquely, our review will focus on parent-pup dyadic social behaviours that have particular analogies to the human context, including instrumental, social interactive and vocal communicative behaviours. This review is intended to serve as a primer on the study of neurobehavioral synchrony across human and rodent dyadic developmental models.

Multimodal hyperscanning reveals that synchrony of body and mind are distinct in mother-child dyads

Hyperscanning studies have begun to unravel the brain mechanisms underlying social interaction, indicating a functional role for interpersonal neural synchronization (INS), yet the mechanisms that drive INS are poorly understood. The current study, thus, addresses whether INS is functionally-distinct from synchrony in other systems - specifically the autonomic nervous system and motor behavior. To test this, we used concurrent functional near-infrared spectroscopy - electrocardiography recordings, while N = 34 mother-child and stranger-child dyads engaged in cooperative and competitive tasks. Only in the neural domain was a higher synchrony for mother-child compared to stranger-child dyads observed. Further, autonomic nervous system and neural synchrony were positively related during competition but not during cooperation. These results suggest that synchrony in different behavioral and biological systems may reflect distinct processes. Furthermore, they show that increased mother-child INS is unlikely to be explained solely by shared arousal and behavioral similarities, supporting recent theories that postulate that INS is higher in close relationships.

Measuring the temporal dynamics of inter-personal neural entrainment in continuous child-adult EEG hyperscanning data

Current approaches to analysing EEG hyperscanning data in the developmental literature typically consider interpersonal entrainment between interacting physiological systems as a time-invariant property. This approach obscures crucial information about how entrainment between interacting systems is established and maintained over time. Here, we describe methods, and present computational algorithms, that will allow researchers to address this gap in the literature. We focus on how two different approaches to measuring entrainment, namely concurrent (e.g., power correlations, phase locking) and sequential (e.g., Granger causality) measures, can be applied to three aspects of the brain signal: amplitude, power, and phase. We guide the reader through worked examples using simulated data on how to leverage these methods to measure changes in interbrain entrainment. For each, we aim to provide a detailed explanation of the interpretation and application of these analyses when studying neural entrainment during early social interactions.

A New Remote Guided Method for Supervised Web-Based Cognitive Testing to Ensure High-Quality Data: Development and Usability Study

Background

The global COVID-19 pandemic has triggered a fundamental reexamination of how human psychological research can be conducted safely and robustly in a new era of digital working and physical distancing. Online web-based testing has risen to the forefront as a promising solution for the rapid mass collection of cognitive data without requiring human contact. However, a long-standing debate exists over the data quality and validity of web-based studies. This study examines the opportunities and challenges afforded by the societal shift toward web-based testing and highlights an urgent need to establish a standard data quality assurance framework for online studies.

Objective

This study aims to develop and validate a new supervised online testing methodology, remote guided testing (RGT).

Methods

A total of 85 healthy young adults were tested on 10 cognitive tasks assessing executive functioning (flexibility, memory, and inhibition) and learning. Tasks were administered either face-to-face in the laboratory (n=41) or online using remote guided testing (n=44) and delivered using identical web-based platforms (Cambridge Neuropsychological Test Automated Battery, Inquisit, and i-ABC). Data quality was assessed using detailed trial-level measures (missed trials, outlying and excluded responses, and response times) and overall task performance measures.

Results

The results indicated that, across all data quality and performance measures, RGT data was statistically-equivalent to in-person data collected in the lab (P>.40 for all comparisons). Moreover, RGT participants out-performed the lab group on measured verbal intelligence (P<.001), which could reflect test environment differences, including possible effects of mask-wearing on communication.

Conclusions

These data suggest that the RGT methodology could help ameliorate concerns regarding online data quality—particularly for studies involving high-risk or rare cohorts—and offer an alternative for collecting high-quality human cognitive data without requiring in-person physical attendance.

Automatic classification of ICA components from infant EEG using MARA

Automated systems for identifying and removing non-neural ICA components are growing in popularity among EEG researchers of adult populations. Infant EEG data differs in many ways from adult EEG data, but there exists almost no specific system for automated classification of source components from paediatric populations. Here, we adapt one of the most popular systems for adult ICA component classification for use with infant EEG data. Our adapted classifier significantly outperformed the original adult classifier on samples of naturalistic free play EEG data recorded from 10 to 12-month-old infants, achieving agreement rates with the manual classification of over 75% across two validation studies (n = 44, n = 25). Additionally, we examined both classifiers’ ability to remove stereotyped ocular artifact from a basic visual processing ERP dataset compared to manual ICA data cleaning. Here, the new classifier performed on level with expert manual cleaning and was again significantly better than the adult classifier at removing artifact whilst retaining a greater amount of genuine neural signal operationalised through comparing ERP activations in time and space. Our new system (iMARA) offers developmental EEG researchers a flexible tool for automatic identification and removal of artifactual ICA components.

•

Currently, few tools are available for ICA based data correction that are designed around infant EEG.

•

ICA correction is necessary for naturalistic paradigms when movement artifacts covary with cognitive processes.

•

We present a system for automated ICA classification designed around infant EEG data.

•

This system offers increased performance compared to systems of automatic ICA classification designed around adult EEG.

The Role of Affectionate Caregiver Touch in Early Neurodevelopment and Parent-Infant Interactional Synchrony

Though rarely included in studies of parent–infant interactions, affectionate touch plays a unique and vital role in infant development. Previous studies in human and rodent models have established that early and consistent affectionate touch from a caregiver confers wide-ranging and holistic benefits for infant psychosocial and neurophysiological development. We begin with an introduction to the neurophysiological pathways for the positive effects of touch. Then, we provide a brief review of how affectionate touch tunes the development of infant somatosensory, autonomic (stress regulation), and immune systems. Affective touch also plays a foundational role in the establishment of social affiliative bonds and early psychosocial behavior. These touch-related bonding effects are known to be mediated primarily by the oxytocin system, but touch also activates mesocorticolimbic dopamine and endogenous opioid systems which aid the development of social cognitive processes such as social learning and reward processing. We conclude by proposing a unique role for affectionate touch as an essential pathway to establishing and maintaining parent-infant interactional synchrony at behavioral and neural levels. The limitations of the current understanding of affectionate touch in infant development point to fruitful avenues for future research.

Toward the Understanding of Topographical and Spectral Signatures of Infant Movement Artifacts in Naturalistic EEG

Electroencephalography (EEG) is perhaps the most widely used brain-imaging technique for pediatric populations. However, EEG signals are prone to distortion by motion. Compared to adults, infants' motion is both more frequent and less stereotypical yet motion effects on the infant EEG signal are largely undocumented. Here, we present a systematic assessment of naturalistic motion effects on the infant EEG signal. EEG recordings were performed with 14 infants (12 analyzed) who passively watched movies whilst spontaneously producing periods of bodily movement and rest. Each infant produced an average of 38.3 s (SD = 14.7 s) of rest and 18.8 s (SD = 17.9 s) of single motion segments for the final analysis. Five types of infant motions were analyzed: Jaw movements, and Limb movements of the Hand, Arm, Foot, and Leg. Significant movement-related distortions of the EEG signal were detected using cluster-based permutation analysis. This analysis revealed that, relative to resting state, infants' Jaw and Arm movements produced significant increases in beta (∼15 Hz) power, particularly over peripheral sites. Jaw movements produced more anteriorly located effects than Arm movements, which were most pronounced over posterior parietal and occipital sites. The cluster analysis also revealed trends toward decreased power in the theta and alpha bands observed over central topographies for all motion types. However, given the very limited quantity of infant data in this study, caution is recommended in interpreting these findings before subsequent replications are conducted. Nonetheless, this work is an important first step to inform future development of methods for addressing EEG motion-related artifacts. This work also supports wider use of naturalistic paradigms in social and developmental neuroscience.

Do Helpful Mothers Help? Effects of Maternal Scaffolding and Infant Engagement on Cognitive Performance

Infants are highly social and much early learning takes place in a social context during interactions with caregivers. Previous research shows that social scaffolding - responsive parenting and joint attention - can confer benefits for infants' long-term development and learning. However, little previous research has examined whether dynamic (moment-to-moment) adaptations in adults' social scaffolding are able to produce immediate effects on infants' performance. Here we ask whether infants' success on an object search task is more strongly influenced by maternal behavior, including dynamic changes in response behavior, or by fluctuations in infants' own engagement levels. Thirty-five mother-infant dyads (infants aged 10.8 months, on average) participated in an object search task that was delivered in a naturalistic manner by the child's mother. Measures of maternal responsiveness (teaching duration; sensitivity) and infant engagement (engagement score; visual attention) were assessed. Mothers varied their task delivery trial by trial, but neither measure of maternal responsiveness significantly predicted infants' success in performing the search task. Rather, infants' own level of engagement was the sole significant predictor of accuracy. These results indicate that while parental scaffolding is offered spontaneously (and is undoubtedly crucial for development), in this context children's endogenous engagement proved to be a more powerful determinant of task success. Future work should explore this interplay between parental and child-internal factors in other learning and social contexts.

The promise of two-person neuroscience for developmental psychiatry: using interaction-based sociometrics to identify disorders of social interaction

Social interactions are fundamental for human development, and disordered social interactions are pervasive in many psychiatric disorders. Recent advances in 'two-person neuroscience' have provided new tools for characterising social interactions. Accordingly, interaction-based 'sociometrics' hold great promise for developmental psychology and psychiatry, particularly in the early identification of social disorders.

DECLARATION OF INTEREST

None.

Toward a Neuroscientific Understanding of Play: A Dimensional Coding Framework for Analyzing Infant-Adult Play Patterns

Play during early life is a ubiquitous activity, and an individual’s propensity for play is positively related to cognitive development and emotional well-being. Play behavior (which may be solitary or shared with a social partner) is diverse and multi-faceted. A challenge for current research is to converge on a common definition and measurement system for play – whether examined at a behavioral, cognitive or neurological level. Combining these different approaches in a multimodal analysis could yield significant advances in understanding the neurocognitive mechanisms of play, and provide the basis for developing biologically grounded play models. However, there is currently no integrated framework for conducting a multimodal analysis of play that spans brain, cognition and behavior. The proposed coding framework uses grounded and observable behaviors along three dimensions (sensorimotor, cognitive and socio-emotional), to compute inferences about playful behavior in a social context, and related social interactional states. Here, we illustrate the sensitivity and utility of the proposed coding framework using two contrasting dyadic corpora (N = 5) of mother-infant object-oriented interactions during experimental conditions that were either non-conducive (Condition 1) or conducive (Condition 2) to the emergence of playful behavior. We find that the framework accurately identifies the modal form of social interaction as being either non-playful (Condition 1) or playful (Condition 2), and further provides useful insights about differences in the quality of social interaction and temporal synchronicity within the dyad. It is intended that this fine-grained coding of play behavior will be easily assimilated with, and inform, future analysis of neural data that is also collected during adult–infant play. In conclusion, here, we present a novel framework for analyzing the continuous time-evolution of adult–infant play patterns, underpinned by biologically informed state coding along sensorimotor, cognitive and socio-emotional dimensions. We expect that the proposed framework will have wide utility amongst researchers wishing to employ an integrated, multimodal approach to the study of play, and lead toward a greater understanding of the neuroscientific basis of play. It may also yield insights into a new biologically grounded taxonomy of play interactions.

Speaker gaze increases information coupling between infant and adult brains

When infants and adults communicate, they exchange social signals of availability and communicative intention such as eye gaze. Previous research indicates that when communication is successful, close temporal dependencies arise between adult speakers' and listeners' neural activity. However, it is not known whether similar neural contingencies exist within adult-infant dyads. Here, we used dual-electroencephalography to assess whether direct gaze increases neural coupling between adults and infants during screen-based and live interactions. In experiment 1 (n = 17), infants viewed videos of an adult who was singing nursery rhymes with (i) direct gaze (looking forward), (ii) indirect gaze (head and eyes averted by 20°), or (iii) direct-oblique gaze (head averted but eyes orientated forward). In experiment 2 (n = 19), infants viewed the same adult in a live context, singing with direct or indirect gaze. Gaze-related changes in adult-infant neural network connectivity were measured using partial directed coherence. Across both experiments, the adult had a significant (Granger) causal influence on infants' neural activity, which was stronger during direct and direct-oblique gaze relative to indirect gaze. During live interactions, infants also influenced the adult more during direct than indirect gaze. Further, infants vocalized more frequently during live direct gaze, and individual infants who vocalized longer also elicited stronger synchronization from the adult. These results demonstrate that direct gaze strengthens bidirectional adult-infant neural connectivity during communication. Thus, ostensive social signals could act to bring brains into mutual temporal alignment, creating a joint-networked state that is structured to facilitate information transfer during early communication and learning.

The Temporal Modulation Structure of Infant-Directed Speech

The temporal modulation structure of adult-directed speech (ADS) is thought to be encoded by neuronal oscillations in the auditory cortex that fluctuate at different temporal rates. Oscillatory activity is thought to phase-align to amplitude modulations in speech at corresponding rates, thereby supporting parsing of the signal into linguistically relevant units. The temporal modulation structure of infant-directed speech (IDS) is unexplored. Here we compare the amplitude modulation (AM) structure of IDS recorded from mothers speaking, over three occasions, to their 7-, 9-, and 11-month-old infants, and the same mothers speaking ADS. Analysis of the modulation spectrum in each case revealed that modulation energy in the theta band was significantly greater in ADS than in IDS, whereas in the delta band, modulation energy was significantly greater for IDS than ADS. Furthermore, phase alignment between delta- and theta-band AMs was stronger in IDS compared to ADS. This remained the case when IDS and ADS were rate-normalized to control for differences in speech rate. These data indicate stronger rhythmic synchronization and acoustic temporal regularity in IDS compared to ADS, structural acoustic differences that may be important for early language learning.

Prosodic Similarity Effects in Short-Term Memory in Developmental Dyslexia

Children with developmental dyslexia are characterized by phonological difficulties across languages. Classically, this 'phonological deficit' in dyslexia has been investigated with tasks using single-syllable words. Recently, however, several studies have demonstrated difficulties in prosodic awareness in dyslexia. Potential prosodic effects in short-term memory have not yet been investigated. Here we create a new instrument based on three-syllable words that vary in stress patterns, to investigate whether prosodic similarity (the same prosodic pattern of stressed and unstressed syllables) exerts systematic effects on short-term memory. We study participants with dyslexia and age-matched and younger reading-level-matched typically developing controls. We find that all participants, including dyslexic participants, show prosodic similarity effects in short-term memory. All participants exhibited better retention of words that differed in prosodic structure, although participants with dyslexia recalled fewer words accurately overall compared to age-matched controls. Individual differences in prosodic memory were predicted by earlier vocabulary abilities, by earlier sensitivity to syllable stress and by earlier phonological awareness. To our knowledge, this is the first demonstration of prosodic similarity effects in short-term memory. The implications of a prosodic similarity effect for theories of lexical representation and of dyslexia are discussed. © 2016 The Authors. Dyslexia published by John Wiley & Sons Ltd.

Difficulties in auditory organization as a cause of reading backwardness? An auditory neuroscience perspective

Over 30 years ago, it was suggested that difficulties in the 'auditory organization' of word forms in the mental lexicon might cause reading difficulties. It was proposed that children used parameters such as rhyme and alliteration to organize word forms in the mental lexicon by acoustic similarity, and that such organization was impaired in developmental dyslexia. This literature was based on an 'oddity' measure of children's sensitivity to rhyme (e.g. wood, book, good) and alliteration (e.g. sun, sock, rag). The 'oddity' task revealed that children with dyslexia were significantly poorer at identifying the 'odd word out' than younger children without reading difficulties. Here we apply a novel modelling approach drawn from auditory neuroscience to study the possible sensory basis of the auditory organization of rhyming and non-rhyming words by children. We utilize a novel Spectral-Amplitude Modulation Phase Hierarchy (S-AMPH) approach to analysing the spectro-temporal structure of rhyming and non-rhyming words, aiming to illuminate the potential acoustic cues used by children as a basis for phonological organization. The S-AMPH model assumes that speech encoding depends on neuronal oscillatory entrainment to the amplitude modulation (AM) hierarchy in speech. Our results suggest that phonological similarity between rhyming words in the oddity task depends crucially on slow (delta band) modulations in the speech envelope. Contrary to linguistic assumptions, therefore, auditory organization by children may not depend on phonemic information for this task. Linguistically, it is assumed that 'book' does not rhyme with 'wood' and 'good' because the final phoneme differs. However, our auditory analysis suggests that the acoustic cues to this phonological dissimilarity depend primarily on the slower amplitude modulations in the speech envelope, thought to carry prosodic information. Therefore, the oddity task may help in detecting reading difficulties because phonological similarity judgements about rhyme reflect sensitivity to slow amplitude modulation patterns. Slower amplitude modulations are known to be detected less efficiently by children with dyslexia.

Awareness of Rhythm Patterns in Speech and Music in Children with Specific Language Impairments

Children with specific language impairments (SLIs) show impaired perception and production of language, and also show impairments in perceiving auditory cues to rhythm [amplitude rise time (ART) and sound duration] and in tapping to a rhythmic beat. Here we explore potential links between language development and rhythm perception in 45 children with SLI and 50 age-matched controls. We administered three rhythmic tasks, a musical beat detection task, a tapping-to-music task, and a novel music/speech task, which varied rhythm and pitch cues independently or together in both speech and music. Via low-pass filtering, the music sounded as though it was played from a low-quality radio and the speech sounded as though it was muffled (heard "behind the door"). We report data for all of the SLI children (N = 45, IQ varying), as well as for two independent subgroupings with intact IQ. One subgroup, "Pure SLI," had intact phonology and reading (N = 16), the other, "SLI PPR" (N = 15), had impaired phonology and reading. When IQ varied (all SLI children), we found significant group differences in all the rhythmic tasks. For the Pure SLI group, there were rhythmic impairments in the tapping task only. For children with SLI and poor phonology (SLI PPR), group differences were found in all of the filtered speech/music AXB tasks. We conclude that difficulties with rhythmic cues in both speech and music are present in children with SLIs, but that some rhythmic measures are more sensitive than others. The data are interpreted within a "prosodic phrasing" hypothesis, and we discuss the potential utility of rhythmic and musical interventions in remediating speech and language difficulties in children.

Acoustic-Emergent Phonology in the Amplitude Envelope of Child-Directed Speech

When acquiring language, young children may use acoustic spectro-temporal patterns in speech to derive phonological units in spoken language (e.g., prosodic stress patterns, syllables, phonemes). Children appear to learn acoustic-phonological mappings rapidly, without direct instruction, yet the underlying developmental mechanisms remain unclear. Across different languages, a relationship between amplitude envelope sensitivity and phonological development has been found, suggesting that children may make use of amplitude modulation (AM) patterns within the envelope to develop a phonological system. Here we present the Spectral Amplitude Modulation Phase Hierarchy (S-AMPH) model, a set of algorithms for deriving the dominant AM patterns in child-directed speech (CDS). Using Principal Components Analysis, we show that rhythmic CDS contains an AM hierarchy comprising 3 core modulation timescales. These timescales correspond to key phonological units: prosodic stress (Stress AM, ~2 Hz), syllables (Syllable AM, ~5 Hz) and onset-rime units (Phoneme AM, ~20 Hz). We argue that these AM patterns could in principle be used by naïve listeners to compute acoustic-phonological mappings without lexical knowledge. We then demonstrate that the modulation statistics within this AM hierarchy indeed parse the speech signal into a primitive hierarchically-organised phonological system comprising stress feet (proto-words), syllables and onset-rime units. We apply the S-AMPH model to two other CDS corpora, one spontaneous and one deliberately-timed. The model accurately identified 72-82% (freely-read CDS) and 90-98% (rhythmically-regular CDS) stress patterns, syllables and onset-rime units. This in-principle demonstration that primitive phonology can be extracted from speech AMs is termed Acoustic-Emergent Phonology (AEP) theory. AEP theory provides a set of methods for examining how early phonological development is shaped by the temporal modulation structure of speech across languages. The S-AMPH model reveals a crucial developmental role for stress feet (AMs ~2 Hz). Stress feet underpin different linguistic rhythm typologies, and speech rhythm underpins language acquisition by infants in all languages.

A role for amplitude modulation phase relationships in speech rhythm perception

Prosodic rhythm in speech [the alternation of "Strong" (S) and "weak" (w) syllables] is cued, among others, by slow rates of amplitude modulation (AM) within the speech envelope. However, it is unclear exactly which envelope modulation rates and statistics are the most important for the rhythm percept. Here, the hypothesis that the phase relationship between "Stress" rate (∼2 Hz) and "Syllable" rate (∼4 Hz) AMs provides a perceptual cue for speech rhythm is tested. In a rhythm judgment task, adult listeners identified AM tone-vocoded nursery rhyme sentences that carried either trochaic (S-w) or iambic patterning (w-S). Manipulation of listeners' rhythm perception was attempted by parametrically phase-shifting the Stress AM and Syllable AM in the vocoder. It was expected that a 1π radian phase-shift (half a cycle) would reverse the perceived rhythm pattern (i.e., trochaic → iambic) whereas a 2π radian shift (full cycle) would retain the perceived rhythm pattern (i.e., trochaic → trochaic). The results confirmed these predictions. Listeners judgments of rhythm systematically followed Stress-Syllable AM phase-shifts, but were unaffected by phase-shifts between the Syllable AM and the Sub-beat AM (∼14 Hz) in a control condition. It is concluded that the Stress-Syllable AM phase relationship is an envelope-based modulation statistic that supports speech rhythm perception.

Impaired extraction of speech rhythm from temporal modulation patterns in speech in developmental dyslexia

Dyslexia is associated with impaired neural representation of the sound structure of words (phonology). The “phonological deficit” in dyslexia may arise in part from impaired speech rhythm perception, thought to depend on neural oscillatory phase-locking to slow amplitude modulation (AM) patterns in the speech envelope. Speech contains AM patterns at multiple temporal rates, and these different AM rates are associated with phonological units of different grain sizes, e.g., related to stress, syllables or phonemes. Here, we assess the ability of adults with dyslexia to use speech AMs to identify rhythm patterns (RPs). We study 3 important temporal rates: “Stress” (~2 Hz), “Syllable” (~4 Hz) and “Sub-beat” (reduced syllables, ~14 Hz). 21 dyslexics and 21 controls listened to nursery rhyme sentences that had been tone-vocoded using either single AM rates from the speech envelope (Stress only, Syllable only, Sub-beat only) or pairs of AM rates (Stress + Syllable, Syllable + Sub-beat). They were asked to use the acoustic rhythm of the stimulus to identity the original nursery rhyme sentence. The data showed that dyslexics were significantly poorer at detecting rhythm compared to controls when they had to utilize multi-rate temporal information from pairs of AMs (Stress + Syllable or Syllable + Sub-beat). These data suggest that dyslexia is associated with a reduced ability to utilize AMs <20 Hz for rhythm recognition. This perceptual deficit in utilizing AM patterns in speech could be underpinned by less efficient neuronal phase alignment and cross-frequency neuronal oscillatory synchronization in dyslexia. Dyslexics' perceptual difficulties in capturing the full spectro-temporal complexity of speech over multiple timescales could contribute to the development of impaired phonological representations for words, the cognitive hallmark of dyslexia across languages.

Assessment of rhythmic entrainment at multiple timescales in dyslexia: evidence for disruption to syllable timing

Developmental dyslexia is associated with rhythmic difficulties, including impaired perception of beat patterns in music and prosodic stress patterns in speech. Spoken prosodic rhythm is cued by slow (<10 Hz) fluctuations in speech signal amplitude. Impaired neural oscillatory tracking of these slow amplitude modulation (AM) patterns is one plausible source of impaired rhythm tracking in dyslexia. Here, we characterise the temporal profile of the dyslexic rhythm deficit by examining rhythmic entrainment at multiple speech timescales. Adult dyslexic participants completed two experiments aimed at testing the perception and production of speech rhythm. In the perception task, participants tapped along to the beat of 4 metrically-regular nursery rhyme sentences. In the production task, participants produced the same 4 sentences in time to a metronome beat. Rhythmic entrainment was assessed using both traditional rhythmic indices and a novel AM-based measure, which utilised 3 dominant AM timescales in the speech signal each associated with a different phonological grain-sized unit (0.9-2.5 Hz, prosodic stress; 2.5-12 Hz, syllables; 12-40 Hz, phonemes). The AM-based measure revealed atypical rhythmic entrainment by dyslexic participants to syllable patterns in speech, in perception and production. In the perception task, both groups showed equally strong phase-locking to Syllable AM patterns, but dyslexic responses were entrained to a significantly earlier oscillatory phase angle than controls. In the production task, dyslexic utterances showed shorter syllable intervals, and differences in Syllable:Phoneme AM cross-frequency synchronisation. Our data support the view that rhythmic entrainment at slow (∼5 Hz, Syllable) rates is atypical in dyslexia, suggesting that neural mechanisms for syllable perception and production may also be atypical. These syllable timing deficits could contribute to the atypical development of phonological representations for spoken words, the central cognitive characteristic of developmental dyslexia across languages.

Differential entrainment of neuroelectric delta oscillations in developmental dyslexia

Oscillatory entrainment to the speech signal is important for language processing, but has not yet been studied in developmental disorders of language. Developmental dyslexia, a difficulty in acquiring efficient reading skills linked to difficulties with phonology (the sound structure of language), has been associated with behavioural entrainment deficits. It has been proposed that the phonological ‘deficit’ that characterises dyslexia across languages is related to impaired auditory entrainment to speech at lower frequencies via neuroelectric oscillations (<10 Hz, ‘temporal sampling theory’). Impaired entrainment to temporal modulations at lower frequencies would affect the recovery of the prosodic and syllabic structure of speech. Here we investigated event-related oscillatory EEG activity and contingent negative variation (CNV) to auditory rhythmic tone streams delivered at frequencies within the delta band (2 Hz, 1.5 Hz), relevant to sampling stressed syllables in speech. Given prior behavioural entrainment findings at these rates, we predicted functionally atypical entrainment of delta oscillations in dyslexia. Participants performed a rhythmic expectancy task, detecting occasional white noise targets interspersed with tones occurring regularly at rates of 2 Hz or 1.5 Hz. Both groups showed significant entrainment of delta oscillations to the rhythmic stimulus stream, however the strength of inter-trial delta phase coherence (ITC, ‘phase locking’) and the CNV were both significantly weaker in dyslexics, suggestive of weaker entrainment and less preparatory brain activity. Both ITC strength and CNV amplitude were significantly related to individual differences in language processing and reading. Additionally, the instantaneous phase of prestimulus delta oscillation predicted behavioural responding (response time) for control participants only.

ICP22 and the UL13 protein kinase are both required for herpes simplex virus-induced modification of the large subunit of RNA polymerase II

Herpes simplex virus type 1 (HSV-1) infection alters the phosphorylation of the large subunit of RNA polymerase II (RNAP II), resulting in the depletion of the hypophosphorylated and hyperphosphorylated forms of this polypeptide (known as IIa and IIo, respectively) and induction of a novel, alternatively phosphorylated form (designated IIi). We previously showed that the HSV-1 immediate-early protein ICP22 is involved in this phenomenon, since induction of IIi and depletion of IIa are deficient in cells infected with 22/n199, an HSV-1 ICP22 nonsense mutant (S. A. Rice, M. C. Long, V. Lam, P. A. Schaffer, and C. A. Spencer, J. Virol. 69:5550-5559, 1995). However, depletion of IIo still occurs in 22/n199-infected cells. This suggests either that another viral gene product affects the RNAP II large subunit or that the truncated ICP22 polypeptide encoded by 22/n199 retains residual activity which leads to IIo depletion. To distinguish between these possibilities, we engineered an HSV-1 ICP22 null mutant, d22-lacZ, and compared it to 22/n199. The two mutants are indistinguishable in their effects on the RNAP II large subunit, suggesting that an additional viral gene product is involved in altering RNAP II. Two candidates are UL13, a protein kinase which has been implicated in ICP22 phosphorylation, and the virion host shutoff (Vhs) factor, the expression of which is positively regulated by ICP22 and UL13. To test whether UL13 is involved, a UL13-deficient viral mutant, d13-lacZ, was engineered. This mutant was defective in IIi induction and IIa depletion, displaying a phenotype very similar to that of d22-lacZ. In contrast, a Vhs mutant had effects that were indistinguishable from wild-type HSV-1. Therefore, UL13 but not the Vhs function plays a role in modifying the RNAP II large subunit. To study the potential role of UL13 in viral transcription, we carried out nuclear run-on transcription analyses in infected human embryonic lung cells. Infections with either UL13 or ICP22 mutants led to significantly reduced amounts of viral genome transcription at late times after infection. Together, our results suggest that ICP22 and UL13 are involved in a common pathway that alters RNAP II phosphorylation and that in some cell lines this change promotes viral late transcription.