Collecting big data with small screens: Group tests of children's cognition with touchscreen tablets are reliable and valid

Some (but not all) Pragmatic Inferences are Difficult for Autistic Children

Autism is classically associated with difficulties in pragmatic inferences, resulting in an over-literal interpretation of language. This has mostly been observed with figurative language (e.g., metaphors). In contrast, more recent investigations of another type of inference, scalar implicatures, have mostly failed to spot any difference between autistic and neurotypical individuals, raising concerns about any general claim of pragmatic difficulties in autism. However, both lines of research face issues: language demands rather than pragmatic competence might actually explain group differences on metaphor tasks, and scalar implicatures have mostly been assessed with truth judgment tasks, which might bias their results. This work aims to assess whether this contrast between metaphors and scalars can be observed within a single group of autistic children. A group of autistic children (N = 23) was compared to a larger sample of neurotypical children (N = 237), using innovative scalar implicatures and metaphors tablet tasks that address the methodological concerns raised in the literature. The autistic group showed a reverse contrast from what was expected, with poorer scalar implicature but similar metaphor comprehension, consistently at accuracy and response times levels. We discuss the possibility that, complementary to previous accounts, a dimension opposing guided to spontaneous pragmatic processes might explain this result and the challenges faced by autistic individuals in daily situations.

Uncovering the roles of automatic attitudes and controlled processes in the regulation of physical activity behavior in children

Despite substantial research efforts to increase engagement in physical activity (PA), children are not sufficiently active. Dual-process theories suggest that PA behavior regulation occurs through both controlled (i.e., reflective, conscious) and automatic (i.e., non-reflective, less conscious) processes. Automatic processes depend on affective valuations and attitudes towards PA and have been shown to predict PA behavior. However, their role in PA behavior regulation in children remains unclear. Therefore, the current study investigated the unique association of automatic attitudes towards PA on self-reported seven-day PA recall, after accounting for the effects of known controlled precursors of PA (i.e., explicit attitudes, PA self-efficacy, and PA intentions). In a cross-sectional design, 69 children (age = 10.8 ± 0.6 years) completed the Single-Category Implicit Association Task (SC-IAT) and self-reported measures of PA and controlled precursors of PA. In a hierarchical regression analysis, controlled processes accounted for 28.3 % of the variance in PA behavior. Although the bivariate association between automatic attitudes and PA was not significant, the association between them became significant but negative in the fully adjusted model (b = -1.70; p = 0.025). The fully adjusted model accounted for 35.0 % of the variance in PA. In summary, the findings indicated that both controlled and automatic processes predicted PA in children, although the association with automatic attitudes was not in the expected direction in the adjusted model. Future studies are warranted to further understand the role of automatic processes in the regulation of PA behavior in children.

PsySuite: An android application designed to perform multimodal psychophysical testing

In behavioral sciences, there is growing concern about the inflation of false-positive rates due to the amount of under-powered studies that have been shared in the past years. While problematic, having the possibility to recruit (lots of) participants (for a lot of time) is realistically not achievable for many research facilities. Factors that hinder the reaching of optimal sample sizes are, to name but a few, research costs, participants' availability and commitment, and logistics. We challenge these issues by introducing PsySuite, an Android app designed to foster a remote approach to multimodal behavioral testing. To validate PsySuite, we first evaluated its ability to generate stimuli appropriate to rigorous psychophysical testing, measuring both the app's accuracy (i.e., stimuli's onset, offset, and multimodal simultaneity) and precision (i.e., the stability of a given pattern across trials), using two different smartphone models. We then evaluated PsySuite's ability to replicate perceptual performances obtained using a classic psychophysical paradigm, comparing sample data collected with the app against those measured via a PC-based setup. Our results showed that PsySuite could accurately reproduce stimuli with a minimum duration of 7 ms, 17 ms, and 30 ms for the auditory, visual, and tactile modalities, respectively, and that perceptual performances obtained with PsySuite were consistent with the perceptual behavior observed using the classical setup. Combined with the high accessibility inherently supported by PsySuite, here we ought to share the app to further boost psychophysical research, aiming at setting it to a cheap, user-friendly, and portable level.

A jsPsych touchscreen extension for behavioral research on touch-enabled interfaces

Online experiments are increasingly gaining traction in the behavioral sciences. Despite this, behavioral researchers have largely continued to use keyboards as the primary input devices for such online studies, overlooking the ubiquity of touchscreens in everyday use. This paper presents an open-source touchscreen extension for jsPsych, a JavaScript framework designed for conducting online experiments. We additionally evaluated the touchscreen extension assessing whether typical behavioral findings from two distinct perceptual decision-making tasks - the random-dot kinematogram and the Stroop task - can similarly be observed when administered via touchscreen devices compared to keyboard devices. Our findings indicate similar performance metrics for each paradigm between the touchscreen and keyboard versions of the experiments. Specifically, we observe similar psychometric curves in the random-dot kinematogram across the touchscreen and keyboard versions. Similarly, in the Stroop task, we detect significant task, congruency, and sequential congruency effects in both experiment versions. We conclude that our open-source touchscreen extension serves as a promising tool for data collection in online behavioral experiments on forced-choice tasks.

Interindividual Differences in Cognitive Variability Are Ubiquitous and Distinct From Mean Performance in a Battery of Eleven Tasks

Our performance on cognitive tasks fluctuates: the same individual completing the same task will differ in their response's moment-to-moment. For decades cognitive fluctuations have been implicitly ignored - treated as measurement error - with a focus instead on aggregates such as mean performance. Leveraging dense trial-by-trial data and novel time-series methods we explored variability as an intrinsically important phenotype. Across eleven cognitive tasks with over 7 million trials, we found highly reliable interindividual differences in cognitive variability in every task we examined. These differences are both qualitatively and quantitatively distinct from mean performance. Moreover, we found that a single dimension for variability across tasks was inadequate, demonstrating that previously posited global mechanisms for cognitive variability are at least partially incomplete. Our findings indicate that variability is a fundamental part of cognition - with the potential to offer novel insights into developmental processes.

Assessing Theory of Mind in Children: A Tablet-Based Adaptation of a Classic Picture Sequencing Task

Correctly assessing children's theory of mind (TOM) is essential to clinical practice. Yet, most tasks heavily rely on language, which is an obstacle for several populations. Langdon and Coltheart's (Cognition 71(1):43-71, 1999) Picture Sequencing Task (PST), developed for research purposes, avoids this limitation through a minimally-verbal procedure. We thus developed a tablet adaptation of this task for individual application, engaging children's motivation and allowing response times collection. To assess this tablet-PST, we first tested a large sample of neurotypical children (6-11 years-old, N = 248), whose results confirmed the task's structural and content validity, and permitted the construction of three standardized clinical indices. In a second experiment, we applied those to previously diagnosed autistic children (N = 23), who were expected to show atypical TOM performance. Children's outcomes were consistent with what was hypothesized and confirmed the task's external validity and moderate clinical sensitivity. The tablet-PST thus appears as a suitable tool, providing detailed profiles to inform clinical decisions.

Cognitive segmentation and fluid reasoning in childhood

The ability to solve novel complex problems predicts success in a wide range of areas. Recent research suggests that the ability to cognitively segment complex problems into smaller parts constrains nonverbal reasoning in adults. This study aimed to test whether cognitively segmenting problems improves nonverbal reasoning performance for children as it does for adults. A total of 115 children aged 6-10 years completed two versions of a modified traditional matrix reasoning task in which demands on working memory, integration, and processing speed were minimised, such that the only significant requirement was to break each problem into its constituent parts. In one version of the task, participants were presented with a traditional 2×2 Matrix and asked to draw the missing matrix item into a response box below. In a second version, the problem was broken down into its component features across three separate cells, reducing the need for participants to segment the problem. As with adults, performance was better in the condition in which the problems were separated into component parts. Children with lower fluid intelligence did not benefit more in the separated condition than children with higher fluid intelligence, and there was no evidence that segmenting problems was more beneficial for younger than older children. This study demonstrates that cognitive segmentation is a critical component of complex problem-solving for children, as it is for adults. By forcing children to focus their attention on separate parts of a complex visual problem, their performance can be dramatically improved.

A novel tablet-based motor coordination test performs on par with the Beery VMI subtest and offers superior temporal metrics: findings from children with pediatric acute-onset neuropsychiatric syndrome

Neuropsychiatric and neurodevelopmental disorders are often associated with coordination problems. Pediatric Acute-onset Neuropsychiatric Syndrome (PANS) constitutes a specific example of acute and complex symptomatology that includes difficulties with motor control. The present proof-of-concept study aimed at testing a new, bespoke tablet-based motor coordination test named SpaceSwipe, providing fine-grained measures that could be used to follow-up on symptoms evolution in PANS. This test enables computationally precise and objective metrics of motor coordination, taking into account both directional and spatial features continuously. We used SpaceSwipe to assess motor coordination in a group of children with PANS (n = 12, assessed on in total of 40 occasions) and compared it against the motor coordination subtest from the Beery-Buktenica Developmental Test of Visual-Motor Integration (Beery VMI) 6th edition, traditionally used to follow-up symptomatology. Using a bivariate linear regression, we found that 33 s of the directional offset from tracking a moving target in SpaceSwipe could predict the Beery VMI motor coordination (VMI MC) raw scores (mean absolute error: 1.75 points). Positive correlations between the predicted scores and the VMI MC scores were found for initial testing (r_adj = 0.87) and for repeated testing (r_adj = 0.79). With its short administration time and its close prediction to Beery VMI scores, this proof-of-concept study demonstrates the potential for SpaceSwipe as a patient-friendly tool for precise, objective assessment of motor coordination in children with neurodevelopmental or neuropsychiatric disorders.

Evaluation of Predictive Motor Control With Two Touchscreen Tablet-Based Tests: Reliability and Validity in School-Aged Children

As predictive motor control is an important index of neuromotor development and maturation, we developed two touchscreen tablet-based tests of this function. Our aim was to investigate the reliability and validity of both a rapid manual interception test and a pursuit tracking test, using a sample of 124 children (62 boys and 62 girls) from two age groups (7-8-year-oldss and 9-10-year-olds). Participants performed both tablet tests with a stylus (sample rate 100 Hz) with both a visible and a temporarily invisible moving target. Confirmatory factor analyses and omega coefficients showed that both tests were univariate methods that provided a reliable assessment of the latent factor related to predictive visuomotor control. As would be expected, compared to younger children, older children performed better on both manual interception and pursuit tracking. The correlations between the latent factors of the two tests at 95% confidence intervals (-.276, -.608) suggested shared variance. Thus, the touchscreen-tablet based tests of rapid manual interception and manual pursuit tracking appear psychometrically suitable for assessing the neuromotor ability of predictive control in 7-10-year-old children.

Usability and Effects of a Combined Physical and Cognitive Intervention Based on Active Video Games for Preschool Children

Executive functions (EFs) are essential for early childhood development, and effective programs to improve EFs in preschool education are becoming increasingly crucial. There is rising evidence that combined physical-cognitive intervention training utilizing active video games (exergames) could be a viable strategy to improve EFs. However, there is a shortage of empirical evidence on the application of this approach in preschool education. The effectiveness of exergame intervention training in preschools must be evaluated. This study conducted a randomized controlled trial to assess the effects of exergames intervention training on preschool children's EFs. A total of 48 participants aged 4-5 years were enrolled; 24 were randomly allocated to receive exergames physical activity training, and the remaining 24 received conventional physical activity training. After a four-week intervention, the children who received the exergames intervention training exhibited considerably greater gains in all three EFs tasks than children who received the conventional physical activity program. Follow-up interviews revealed that the children accepted the exergames well. The results demonstrate the viability of incorporating exergames into preschool education to improve children's EFs, supporting prior findings and offering more empirical evidence from early childhood research.

Testing the specificity of environmental risk factors for developmental outcomes

Developmental theories often assume that specific environmental risks affect specific outcomes. Canonical Correlation Analysis was used to test whether 28 developmental outcomes (measured at 11-15 years) share the same early environmental risk factors (measured at 0-3 years), or whether specific outcomes are associated with specific risks. We used data from the UK Millennium Cohort Study (N = 10,376, 51% Female, 84% White) collected between 2001 and 2016. A single environment component was mostly sufficient for explaining cognition and parent-rated behavior outcomes. In contrast, adolescents' alcohol and tobacco use were specifically associated with their parents', and child-rated mental health was weakly associated with all risks. These findings suggest that with some exceptions, many different developmental outcomes share the same early environmental risk factors.

Measuring Orthographic Knowledge of L2 Chinese Learners in Vietnam Using a Handwriting Task - A Preliminary Report

In the current study, the orthographic knowledge required for writing Chinese characters was assessed among participants with L1 Vietnamese background who learn Chinese as a foreign language. A total of 42 undergraduates were recruited. They were invited to participate in a delayed Chinese character copying task consisting of 32 characters. Their Chinese character reading abilities were also obtained using a character naming task. All the tests were conducted online during the pandemic in 2021. Results indicated that the participants' accuracy in the copying task was affected by the familiarity of the characters and the number of strokes of the characters. These effects minimized as reading performance increased. In the inter-stroke interval (ISI) analysis, results indicated a significant boundary effect where ISIs between orthographic units were longer than ISIs within orthographic units, showing the participants' tendency to chunk Chinese characters into functional units when they write. Only high achievers in the reading task demonstrated the use of both large and small grain-size units in writing (i.e., radical-boundary ISI > logographeme-boundary ISI > non-boundary ISI), while the low achievers only used small grain-size units in their writing. We suggest that the delayed copying task incorporated with handwriting measures is an effective method to assess orthographic knowledge of L2 Chinese learners.

UCancellation: A new mobile measure of selective attention and concentration

Measuring selective attention in a speeded task can provide valuable insight into the concentration ability of an individual, and can inform neuropsychological assessment of attention in aging, traumatic brain injury, and in various psychiatric disorders. There are only a few tools to measure selective attention that are freely available, psychometrically validated, and can be used flexibly both for in-person and remote assessment. To address this gap, we developed a self-administrable, mobile-based test called “UCancellation” (University of California Cancellation), which was designed to assess selective attention and concentration and has two stimulus sets: Letters and Pictures. UCancellation takes less than 7 minutes to complete, is automatically scored, has multiple forms to allow repeated testing, and is compatible with a variety of iOS and Android devices. Here we report the results of a study that examined parallel-test reliability and convergent validity of UCancellation in a sample of 104 college students. UCancellation Letters and Pictures showed adequate parallel test reliability (r = .71–.83, p < 0.01) and internal consistency (ɑ = .73–.91). It also showed convergent validity with another widely used cancellation task, d2 Test of Attention (r = .43–.59, p < 0.01), and predicted performance on a cognitive control composite (r = .34–.41, p < 0.05). These results suggest that UCancellation is a valid test of selective attention and inhibitory control, which warrants further data collection to establish norms.

Direct and indirect links between children's socio-economic status and education: pathways via mental health, attitude, and cognition

A child's socio-economic environment can profoundly affect their development. While existing literature focusses on simplified metrics and pair-wise relations between few variables, we aimed to capture complex interrelationships between several relevant domains using a broad assessment of 519 children aged 7-9 years. Our analyses comprised three multivariate techniques that complimented each other, and worked at different levels of granularity. First, an exploratory factor analysis (principal component analysis followed by varimax rotation) revealed that our sample varied along continuous dimensions of cognition, attitude and mental health (from parallel analysis); with potentially emerging dimensions speed and socio-economic status (passed Kaiser's criterion). Second, k-means cluster analysis showed that children did not group into discrete phenotypes. Third, a network analysis on the basis of bootstrapped partial correlations (confirmed by both cross-validated LASSO and multiple comparisons correction of binarised connection probabilities) uncovered how our developmental measures interconnected: educational outcomes (reading and maths fluency) were directly related to cognition (short-term memory, number sense, processing speed, inhibition). By contrast, mental health (anxiety and depression symptoms) and attitudes (conscientiousness, grit, growth mindset) showed indirect relationships with educational outcomes via cognition. Finally, socio-economic factors (neighbourhood deprivation, family affluence) related directly to educational outcomes, cognition, mental health, and even grit. In sum, cognition is a central cog through which mental health and attitude relate to educational outcomes. However, through direct relations with all components of developmental outcomes, socio-economic status acts as a great 'unequaliser'.

Supplementary Information

The online version contains supplementary material available at 10.1007/s12144-021-02232-2.

Longitudinal increases in childhood depression symptoms during the COVID-19 lockdown

OBJECTIVE

There has been widespread concern that so-called lockdown measures, including social distancing and school closures, could negatively impact children's mental health. However, there has been little direct evidence of any association due to the paucity of longitudinal studies reporting mental health before and during the lockdown. This present study provides the first longitudinal examination of changes in childhood mental health, a key component of an urgently needed evidence base that can inform policy and practice surrounding the continuing response to the COVID-19 pandemic.

METHODS

Mental health assessments on 168 children (aged 7.6-11.6 years) were taken before and during the UK lockdown (April-June 2020). Assessments included self-reports, caregiver reports, and teacher reports. Mean mental health scores before and during the UK lockdown were compared using mixed linear models.

RESULTS

A significant increase in depression symptoms during the UK lockdown was observed, as measured by the Revised Child Anxiety and Depression Scale (RCADS) short form. CIs suggest a medium-to-large effect size. There were no significant changes in the RCADS anxiety subscale and Strengths and Difficulties Questionnaire emotional problems subscale.

CONCLUSIONS

During the UK lockdown, children's depression symptoms have increased substantially, relative to before lockdown. The scale of this effect has direct relevance for the continuation of different elements of lockdown policy, such as complete or partial school closures. This early evidence for the direct impact of lockdown must now be combined with larger scale epidemiological studies that establish which children are most at risk and tracks their future recovery.