1
|
Judd N, Aristodemou M, Klingberg T, Kievit R. Interindividual Differences in Cognitive Variability Are Ubiquitous and Distinct From Mean Performance in a Battery of Eleven Tasks. J Cogn 2024; 7:45. [PMID: 38799081 PMCID: PMC11122693 DOI: 10.5334/joc.371] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/16/2024] [Accepted: 05/06/2024] [Indexed: 05/29/2024] Open
Abstract
Our performance on cognitive tasks fluctuates: the same individual completing the same task will differ in their response's moment-to-moment. For decades cognitive fluctuations have been implicitly ignored - treated as measurement error - with a focus instead on aggregates such as mean performance. Leveraging dense trial-by-trial data and novel time-series methods we explored variability as an intrinsically important phenotype. Across eleven cognitive tasks with over 7 million trials, we found highly reliable interindividual differences in cognitive variability in every task we examined. These differences are both qualitatively and quantitatively distinct from mean performance. Moreover, we found that a single dimension for variability across tasks was inadequate, demonstrating that previously posited global mechanisms for cognitive variability are at least partially incomplete. Our findings indicate that variability is a fundamental part of cognition - with the potential to offer novel insights into developmental processes.
Collapse
Affiliation(s)
- Nicholas Judd
- Cognitive Neuroscience Department, Donders Institute for Brain, Cognition, and Behavior, Radboud University Medical Center, Nijmegen, The Netherlands
| | - Michael Aristodemou
- Cognitive Neuroscience Department, Donders Institute for Brain, Cognition, and Behavior, Radboud University Medical Center, Nijmegen, The Netherlands
| | - Torkel Klingberg
- Department of Neuroscience, Karolinska Institute, Stockholm, Sweden
| | - Rogier Kievit
- Cognitive Neuroscience Department, Donders Institute for Brain, Cognition, and Behavior, Radboud University Medical Center, Nijmegen, The Netherlands
| |
Collapse
|
2
|
Gonthier C. Should Intelligence Tests Be Speeded or Unspeeded? A Brief Review of the Effects of Time Pressure on Response Processes and an Experimental Study with Raven's Matrices. J Intell 2023; 11:120. [PMID: 37367521 DOI: 10.3390/jintelligence11060120] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/04/2023] [Revised: 05/15/2023] [Accepted: 06/06/2023] [Indexed: 06/28/2023] Open
Abstract
Intelligence tests are often performed under time constraints for practical reasons, but the effects of time pressure on reasoning performance are poorly understood. The first part of this work provides a brief review of major expected effects of time pressure, which includes forcing participants to skip items, convoking a mental speed factor, constraining response times, qualitatively altering cognitive processing, affecting anxiety and motivation, and interacting with individual differences. The second part presents data collected with Raven's matrices under three conditions of speededness to provide further insight into the complex effects of time pressure, with three major findings. First, even mild time pressure (with enough time available for all participants to complete the task at a leisurely pace) induced speeding throughout the whole task, starting with the very first item, and participants sped up more than was actually required. Second, time pressure came with lower confidence and poorer strategy use and a substantial decrease of accuracy (d = 0.35), even when controlling for response time at the item level-indicating a detrimental effect on cognitive processing beyond speeding. Third, time pressure disproportionately reduced response times for difficult items and participants with high ability, working memory capacity, or need for cognition, although this did not differentially affect ability estimates. Overall, both the review and empirical sections show that the effects of time pressure go well beyond forcing participants to speed or skip the last few items and make even mild time constraints inadvisable when attempting to measure maximal performance, especially for high-performing samples.
Collapse
Affiliation(s)
- Corentin Gonthier
- Nantes Université, Laboratoire de Psychologie des Pays de la Loire (LPPL UR 4638), Chemin de la Censive du Tertre, 44312 Nantes, France
| |
Collapse
|
3
|
Niebaum J, Munakata Y. The Development of Relational Reasoning: An Eyetracking Analysis of Strategy Use and Adaptation in Children and Adults Performing Matrix Completion. Open Mind (Camb) 2023; 7:197-220. [PMID: 37416068 PMCID: PMC10320822 DOI: 10.1162/opmi_a_00078] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/24/2022] [Accepted: 04/24/2023] [Indexed: 07/08/2023] Open
Abstract
Relational reasoning is a key component of fluid intelligence and an important predictor of academic achievement. Relational reasoning is commonly assessed using matrix completion tasks, in which participants see an incomplete matrix of items that vary on different dimensions and select a response that best completes the matrix based on the relations among items. Performance on such assessments increases dramatically across childhood into adulthood. However, despite widespread use, little is known about the strategies associated with good or poor matrix completion performance in childhood. This study examined the strategies children and adults use to solve matrix completion problems, how those strategies change with age, and whether children and adults adapt strategies to difficulty. We used eyetracking to infer matrix completion strategy use in 6- and 9-year-old children and adults. Across ages, scanning across matrix rows and columns predicted good overall performance, and quicker and higher rates of consulting potential answers predicted poor performance, indicating that optimal matrix completion strategies are similar across development. Indices of good strategy use increased across childhood. As problems increased in difficulty, children and adults increased their scanning of matrix rows and columns, and adults and 9-year-olds also shifted strategies to rely more on consulting potential answers. Adapting strategies to matrix difficulty, particularly increased scanning of rows and columns, was associated with good overall performance in both children and adults. These findings underscore the importance of both spontaneous and adaptive strategy use in individual differences in relational reasoning and its development.
Collapse
Affiliation(s)
- Jesse Niebaum
- Center for Mind and Brain, University of California, Davis, Davis, CA
| | - Yuko Munakata
- Department of Psychology, University of California, Davis, Davis, CA
| |
Collapse
|
4
|
Cognitive strategies in matrix-reasoning tasks: State of the art. Psychon Bull Rev 2023; 30:147-159. [PMID: 35931904 DOI: 10.3758/s13423-022-02160-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 07/25/2022] [Indexed: 11/08/2022]
Abstract
Cognitive strategies in matrix-reasoning tasks have been investigated for the last decade and a half. Several steps were made since the first paper in the field, but the advances have been sparse and with little connection. Here we present a review of the state of the art in this subject. We introduce how this topic was born and how to measure these strategies, covering the diverse methods and measures that are presented in the literature to progress on this subject and the applications that were developed, as well as the knowledge that resulted from these applications. Furthermore, the future directions are discussed with the intention to engage new researchers in this topic, as well as to bring awareness to limitations that were found given the available scientific literature.
Collapse
|
5
|
Wang L, Xie T, Ma H, Xu M, Xie X. Subject-performed task effect on working memory performance in children with autism spectrum disorder. Autism Res 2022; 15:1698-1709. [PMID: 35298088 DOI: 10.1002/aur.2710] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/13/2021] [Revised: 02/25/2022] [Accepted: 03/08/2022] [Indexed: 12/27/2022]
Abstract
A previous study found that children with autism spectrum disorder (ASD) have better recall when they perform instructions (subject-performed task [SPT]) than when they passively hear instructions (verbal task [VT]) in a working memory task for instructions, an effect that is called the SPT effect. This study explored whether the SPT effect exhibited by ASD children is caused by the movement component or by processing materials twice. More importantly, this study explored whether intelligence influences the SPT effect exhibited by ASD children. ASD children with three levels of intelligence (N = 56) and a control group, children with intellectual disability (ID) who had low intelligence but did not have ASD (N = 21), were asked to perform working memory tasks for instructions under VT, SPT and repeated (hearing the instruction twice) conditions. No significant difference in performance was observed between the VT and repeated conditions, regardless of the child's level of intelligence. ASD children with lower-middle intelligence exhibited a smaller SPT effect than ASD children with upper-middle intelligence. Critically, while ASD children with low intelligence did not exhibit the SPT effect, an ID group with equivalent low intelligence did show this effect. Therefore, these results show that the SPT effect for ASD children is caused by the movement component and is uniquely associated with a certain level of intelligence, namely, lower middle and higher levels of intelligence. LAY SUMMARY: In ASD children, the benefit of physically performing instructions for working memory performance is uniquely associated with a certain level of intelligence. Only ASD children with lower-middle intelligence (and higher) benefit from physically performing instructions, and higher intelligence increases this benefit; ASD children with low intelligence do not show this benefit. This benefit in ASD children is attributed to the additional motoric code generated by physical performance.
Collapse
Affiliation(s)
- Lijuan Wang
- School of Psychology, Northeast Normal University, Changchun, China
| | - Tingting Xie
- School of Psychology, Northeast Normal University, Changchun, China
| | - Huan Ma
- School of Psychology, Northeast Normal University, Changchun, China
| | - Miao Xu
- No. 6 Hospital of Changchun, Changchun, China
| | - Xiaochun Xie
- School of Psychology, Northeast Normal University, Changchun, China
| |
Collapse
|
6
|
Raden MJ, Jarosz AF. Strategy Transfer on Fluid Reasoning Tasks. INTELLIGENCE 2022. [DOI: 10.1016/j.intell.2021.101618] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/26/2022]
|
7
|
Strategy use moderates the relation between working memory capacity and fluid intelligence: A combined approach. INTELLIGENCE 2022. [DOI: 10.1016/j.intell.2022.101627] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022]
|
8
|
Segabinazi JD, Pawlowski J, Zanini AM, Wagner GP, Sbicigo JB, Trentini CM, Hutz CS, de Salles JF, Bandeira DR. Age, Education and Intellectual Quotient Influences: Structural Equation Modeling on the study of Benton Visual Retention Test (BVRT). THE SPANISH JOURNAL OF PSYCHOLOGY 2020; 23:e27. [PMID: 32677605 DOI: 10.1017/sjp.2020.30] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/11/2023]
Abstract
This study searched for sociodemographic influences on visual memory and visuoconstructive ability in healthy and clinical samples evaluated with Benton Visual Retention Test (BVRT) in two studies. In Study 1, we searched for changes related to age in children, adolescents, adults and elderly on the performance of the BVRT. In Study 2, we investigated the relations among age, years of education and intellectual quotient (IQ) on the performance of the BVRT using Structural Equation Modeling (SEM). Participants were 624 individuals aged between six and 89 years old (M = 25.40; SD = 22.34) from the normatization and evidence validity studies at Brazil. We used a sociodemographic questionnaire, BVRT and IQ measure was estimated. Study 1 has shown a performance similar to the developmental graphics with a U-inverted pattern in relation to age: An increase of the visual memory ability in the children and adolescent groups as age increases, a tendency of a decrease in the performance in the adult group that intensifies in the elderly group. Study 2 found that the model for the BVRT performance tested by SEM denoted satisfactory goodness-of-fit indexes, χ2/gl = 2.67, p < .001; CFI = .92; TLI = .93; RMSEA = .004, 90% CI = [.03, .05];WLSMV = 1.79, and corroborated the theoretical assumption. The SEM model confirmed in this study highlight the strong role of years of education in the prediction of BVRT scores.
Collapse
Affiliation(s)
- Joice Dickel Segabinazi
- Universidade Federal do Rio Grande do Sul (Brazil)
- Pontifícia Universidade Católica do Rio Grande do Sul (Brazil)
| | - Josiane Pawlowski
- Universidade Federal do Rio de Janeiro (Brazil)
- Universidad de Iberoamérica (Costa Rica)
| | | | | | | | | | | | | | | |
Collapse
|
9
|
Drążyk D, Kumka M, Zarzycka K, Zguda P, Chuderski A. No indication that the ego depletion manipulation can affect insight: a comment on DeCaro and Van Stockum (2018). THINKING & REASONING 2020. [DOI: 10.1080/13546783.2019.1649191] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/26/2022]
Affiliation(s)
- Dominika Drążyk
- Institute of Philosophy, Jagiellonian University, Krakow, Poland
| | - Martyna Kumka
- Institute of Philosophy, Jagiellonian University, Krakow, Poland
| | | | - Paulina Zguda
- Institute of Philosophy, Jagiellonian University, Krakow, Poland
| | - Adam Chuderski
- Institute of Philosophy, Jagiellonian University, Krakow, Poland
| |
Collapse
|
10
|
|
11
|
Forthmann B, Jendryczko D, Scharfen J, Kleinkorres R, Benedek M, Holling H. Creative ideation, broad retrieval ability, and processing speed: A confirmatory study of nested cognitive abilities. INTELLIGENCE 2019. [DOI: 10.1016/j.intell.2019.04.006] [Citation(s) in RCA: 30] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/29/2022]
|
12
|
Schmitz F, Rotter D, Wilhelm O. Scoring Alternatives for Mental Speed Tests: Measurement Issues and Validity for Working Memory Capacity and the Attentional Blink Effect. J Intell 2018; 6:E47. [PMID: 31162474 PMCID: PMC6480757 DOI: 10.3390/jintelligence6040047] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/11/2018] [Revised: 10/06/2018] [Accepted: 10/11/2018] [Indexed: 11/25/2022] Open
Abstract
Research suggests that the relation of mental speed with working memory capacity (WMC) depends on complexity and scoring methods of speed tasks and the type of task used to assess capacity limits in working memory. In the present study, we included conventional binding/updating measures of WMC as well as rapid serial visual presentation paradigms. The latter allowed for a computation of the attentional blink (AB) effect that was argued to measure capacity limitations at the encoding stage of working memory. Mental speed was assessed with a set of tasks and scored by diverse methods, including response time (RT) based scores, as well as ex-Gaussian and diffusion model parameterization. Relations of latent factors were investigated using structure equation modeling techniques. RT-based scores of mental speed yielded substantial correlations with WMC but only weak relations with the AB effect, while WMC and the AB magnitude were independent. The strength of the speed-WMC relation was shown to depend on task type. Additionally, the increase in predictive validity across RT quantiles changed across task types, suggesting that the worst performance rule (WPR) depends on task characteristics. In contrast to the latter, relations of speed with the AB effect did not change across RT quantiles. Relations of the model parameters were consistently found for the ex-Gaussian tau parameter and the diffusion model drift rate. However, depending on task type, other parameters showed plausible relations as well. The finding that characteristics of mental speed tasks determined the overall strength of relations with WMC, the occurrence of a WPR effect, and the specific pattern of relations of model parameters, implies that mental speed tasks are not exchangeable measurement tools. In spite of reflecting a general factor of mental speed, different speed tasks possess different requirements, supporting the notion of mental speed as a hierarchical construct.
Collapse
Affiliation(s)
- Florian Schmitz
- Institute of Psychology, Ulm University, Albert-Einstein Allee 47, 89081 Ulm, Germany.
| | - Dominik Rotter
- Institute of Psychology, Ulm University, Albert-Einstein Allee 47, 89081 Ulm, Germany.
| | - Oliver Wilhelm
- Institute of Psychology, Ulm University, Albert-Einstein Allee 47, 89081 Ulm, Germany.
| |
Collapse
|