1
|
Werchan DM, Thomason ME, Brito NH. OWLET: An automated, open-source method for infant gaze tracking using smartphone and webcam recordings. Behav Res Methods 2023; 55:3149-3163. [PMID: 36070130 PMCID: PMC9450825 DOI: 10.3758/s13428-022-01962-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 08/20/2022] [Indexed: 01/16/2023]
Abstract
Groundbreaking insights into the origins of the human mind have been garnered through the study of eye movements in preverbal subjects who are unable to explain their thought processes. Developmental research has largely relied on in-lab testing with trained experimenters. This constraint provides a narrow window into infant cognition and impedes large-scale data collection in families from diverse socioeconomic, geographic, and cultural backgrounds. Here we introduce a new open-source methodology for automatically analyzing infant eye-tracking data collected on personal devices in the home. Using algorithms from computer vision, machine learning, and ecological psychology, we develop an online webcam-linked eye tracker (OWLET) that provides robust estimation of infants' point of gaze from smartphone and webcam recordings of infant assessments in the home. We validate OWLET in a large sample of 7-month-old infants (N = 127) tested remotely, using an established visual attention task. We show that this new method reliably estimates infants' point-of-gaze across a variety of contexts, including testing on both computers and mobile devices, and exhibits excellent external validity with parental-report measures of attention. Our platform fills a significant gap in current tools available for rapid online data collection and large-scale assessments of cognitive processes in infants. Remote assessment addresses the need for greater diversity and accessibility in human studies and may support the ecological validity of behavioral experiments. This constitutes a critical and timely advance in a core domain of developmental research and in psychological science more broadly.
Collapse
Affiliation(s)
- Denise M Werchan
- Department of Population Health, New York University School of Medicine, 227 E 30th St, 7th Fl, New York, NY, 10016, USA.
- Department of Child & Adolescent Psychiatry, New York University School of Medicine, New York, NY, 10016, USA.
| | - Moriah E Thomason
- Department of Population Health, New York University School of Medicine, 227 E 30th St, 7th Fl, New York, NY, 10016, USA
- Department of Child & Adolescent Psychiatry, New York University School of Medicine, New York, NY, 10016, USA
| | - Natalie H Brito
- Department of Applied Psychology, New York University, New York, NY, 10003, USA
| |
Collapse
|
2
|
Van der Cruyssen I, Ben-Shakhar G, Pertzov Y, Guy N, Cabooter Q, Gunschera LJ, Verschuere B. The validation of online webcam-based eye-tracking: The replication of the cascade effect, the novelty preference, and the visual world paradigm. Behav Res Methods 2023:10.3758/s13428-023-02221-2. [PMID: 37648844 DOI: 10.3758/s13428-023-02221-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 08/10/2023] [Indexed: 09/01/2023]
Abstract
The many benefits of online research and the recent emergence of open-source eye-tracking libraries have sparked an interest in transferring time-consuming and expensive eye-tracking studies from the lab to the web. In the current study, we validate online webcam-based eye-tracking by conceptually replicating three robust eye-tracking studies (the cascade effect, n = 134, the novelty preference, n = 45, and the visual world paradigm, n = 32) online using the participant's webcam as eye-tracker with the WebGazer.js library. We successfully replicated all three effects, although the effect sizes of all three studies shrank by 20-27%. The visual world paradigm was conducted both online and in the lab, using the same participants and a standard laboratory eye-tracker. The results showed that replication per se could not fully account for the effect size shrinkage, but that the shrinkage was also due to the use of online webcam-based eye-tracking, which is noisier. In conclusion, we argue that eye-tracking studies with relatively large effects that do not require extremely high precision (e.g., studies with four or fewer large regions of interest) can be done online using the participant's webcam. We also make recommendations for how the quality of online webcam-based eye-tracking could be improved.
Collapse
Affiliation(s)
- Ine Van der Cruyssen
- Department of Clinical Psychology, University of Amsterdam, Nieuwe Achtergracht 129B, 1018, VZ, Amsterdam, The Netherlands.
- Hebrew University of Jerusalem, Mount Scopus, 91905, Jerusalem, Israel.
| | | | - Yoni Pertzov
- Hebrew University of Jerusalem, Mount Scopus, 91905, Jerusalem, Israel
| | - Nitzan Guy
- Hebrew University of Jerusalem, Mount Scopus, 91905, Jerusalem, Israel
| | - Quinn Cabooter
- Department of Clinical Psychology, University of Amsterdam, Nieuwe Achtergracht 129B, 1018, VZ, Amsterdam, The Netherlands
- Ghent University, Henri Dunantlaan 2, 9000, Ghent, Belgium
| | - Lukas J Gunschera
- Department of Clinical Psychology, University of Amsterdam, Nieuwe Achtergracht 129B, 1018, VZ, Amsterdam, The Netherlands
| | - Bruno Verschuere
- Department of Clinical Psychology, University of Amsterdam, Nieuwe Achtergracht 129B, 1018, VZ, Amsterdam, The Netherlands
| |
Collapse
|
3
|
Lo CH, Hermes J, Kartushina N, Mayor J, Mani N. e-Babylab: An open-source browser-based tool for unmoderated online developmental studies. Behav Res Methods 2023:10.3758/s13428-023-02200-7. [PMID: 37620744 DOI: 10.3758/s13428-023-02200-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 07/12/2023] [Indexed: 08/26/2023]
Abstract
The COVID-19 pandemic massively changed the context and feasibility of developmental research. This new reality, as well as considerations about sample diversity and naturalistic settings for developmental research, highlights the need for solutions for online studies. In this article, we present e-Babylab, an open-source browser-based tool for unmoderated online studies targeted for young children and babies. e-Babylab offers an intuitive graphical user interface for study creation and management of studies, users, participant data, and stimulus material, with no programming skills required. Various kinds of audiovisual media can be presented as stimuli, and possible measures include webcam recordings, audio recordings, key presses, mouse-click/touch coordinates, and reaction times. An additional feature of e-Babylab is the possibility to administer short adaptive versions of MacArthur-Bates Communicative Development Inventories (Chai et al. Journal of Speech, Language, and Hearing Research, 63, 3488-3500, 2020). Information pages, consent forms, and participant forms are customizable. e-Babylab has been used with a variety of measures and paradigms in over 12 studies with children aged 12 months to 8 years (n = 1516). We briefly summarize some results of these studies to demonstrate that data quality, participant engagement, and overall results are comparable between laboratory and online settings. Finally, we discuss helpful tips for using e-Babylab and present plans for upgrades.
Collapse
Affiliation(s)
- Chang Huan Lo
- School of Psychology, University of Nottingham Malaysia, Semenyih, Malaysia
| | - Jonas Hermes
- Department of Developmental Psychology, Institute of Psychology, University of Göttingen, Waldweg 26, D-37073, Göttingen, Germany
| | - Natalia Kartushina
- Center for Multilingualism in Society across the Lifespan (Multiling), University of Oslo, Oslo, Norway
- Department of Psychology, University of Oslo, Oslo, Norway
| | - Julien Mayor
- Department of Psychology, University of Oslo, Oslo, Norway
| | - Nivedita Mani
- Leibniz ScienceCampus Primate Cognition, Kellnerweg 4, D-37077, Göttingen, Germany.
- Department of Psychology of Language, Institute of Psychology, University of Göttingen, Goßlerstr. 14, D-37073, Göttingen, Germany.
| |
Collapse
|
4
|
Messing A, Apthorp D. Autistic traits are associated with individual differences in finger tapping: an online study. PeerJ 2023; 11:e15406. [PMID: 37214091 PMCID: PMC10198151 DOI: 10.7717/peerj.15406] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/16/2022] [Accepted: 04/21/2023] [Indexed: 05/24/2023] Open
Abstract
In a novel online study, we explored whether finger tapping differences are evident in people with autistic traits in the general population. We hypothesised that those with higher autistic traits would show more impairment in finger tapping, and that age would moderate tapping output. The study included a non-diagnosed population of 159 participants aged 18-78 who completed an online measure of autistic traits (the AQ-10) and a measure of finger tapping (the FTT). Results showed those with higher AQ-10 scores recorded lower tapping scores in both hands. Moderation analysis showed younger participants with more autistic traits recorded lower tapping scores for the dominant hand. This suggests motor differences seen in autism studies are evident in the general population.
Collapse
Affiliation(s)
- Alycia Messing
- School of Psychology, University of New England, Armidale, New South Wales, Australia
| | - Deborah Apthorp
- School of Psychology, University of New England, Armidale, New South Wales, Australia
- School of Computing, Australian National University, Canberra, New South Wales, Australia
| |
Collapse
|
5
|
Pfeifer LS, Heyers K, Ocklenburg S, Wolf OT. Stress research during the COVID-19 pandemic and beyond. Neurosci Biobehav Rev 2021; 131:581-596. [PMID: 34599918 PMCID: PMC8480136 DOI: 10.1016/j.neubiorev.2021.09.045] [Citation(s) in RCA: 19] [Impact Index Per Article: 6.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/05/2021] [Revised: 09/22/2021] [Accepted: 09/24/2021] [Indexed: 12/27/2022]
Abstract
The COVID-19 pandemic confronts stress researchers in psychology and neuroscience with unique challenges. Widely used experimental paradigms such as the Trier Social Stress Test feature physical social encounters to induce stress by means of social-evaluative threat. As lockdowns and contact restrictions currently prevent in-person meetings, established stress induction paradigms are often difficult to use. Despite these challenges, stress research is of pivotal importance as the pandemic will likely increase the prevalence of stress-related mental disorders. Therefore, we review recent research trends like virtual reality, pre-recordings and online adaptations regarding their usefulness for established stress induction paradigms. Such approaches are not only crucial for stress research during COVID-19 but will likely stimulate the field far beyond the pandemic. They may facilitate research in new contexts and in homebound or movement-restricted participant groups. Moreover, they allow for new experimental variations that may advance procedures as well as the conceptualization of stress itself. While posing challenges for stress researchers undeniably, the COVID-19 pandemic may evolve into a driving force for progress eventually.
Collapse
Affiliation(s)
- Lena Sophie Pfeifer
- Cognitive Psychology, Institute of Cognitive Neuroscience, Faculty of Psychology, Ruhr University Bochum, Bochum, Germany,Corresponding author at: Lena Sophie Pfeifer (Cognitive Psychology, Ruhr University Bochum, Universitätsstraße 150, Room: IB 6/77, 44780, Bochum, Germany)
| | - Katrin Heyers
- Biopsychology, Institute of Cognitive Neuroscience, Faculty of Psychology, Ruhr University Bochum, Bochum, Germany,General Psychology II and Biological Psychology, Institute of Psychology, School of Human Sciences, Osnabrück University, Osnabrück, Germany
| | - Sebastian Ocklenburg
- Biopsychology, Institute of Cognitive Neuroscience, Faculty of Psychology, Ruhr University Bochum, Bochum, Germany
| | - Oliver T. Wolf
- Cognitive Psychology, Institute of Cognitive Neuroscience, Faculty of Psychology, Ruhr University Bochum, Bochum, Germany
| |
Collapse
|
6
|
Abstract
Anonymous data collection systems are often necessary when assessing sensitive behaviors but can pose challenges to researchers seeking to link participants over time. To assist researchers in anonymously linking participants, we outlined and tested a novel security question linking (security question linking; SEEK) method. The SEEK method includes four steps: (1) data management and standardization, (2) many-to-many matching, (3) fuzzy matching, and (4) rematching and verification. The method is demonstrated in SAS with two samples from a longitudinal study of adolescent dating violence. After an initial assessment during a laboratory visit, participants were asked to complete an online assessment either (a) once, 3 months later (Sample 1, n = 60), or (b) three times at 1-month intervals (Sample 2, n = 140). Demographics, eye color, and responses to nine security questions were used as key variables to link responses from the laboratory and online follow-up assessments. The rates of matched cases were 100% in Sample 1 and from 94.3 to 98.3% in Sample 2. To quantify the confidence in the data quality of successfully matched pairs, we reported the means and standard deviations of the number of matched security questions. In addition, we reported the rank order and counts of the mismatched components in key variables. Results indicate that the SEEK method provides a feasible and reliable solution to link responses in longitudinal studies with sensitive questions.
Collapse
|
7
|
Hartshorne JK, de Leeuw JR, Goodman ND, Jennings M, O'Donnell TJ. A thousand studies for the price of one: Accelerating psychological science with Pushkin. Behav Res Methods 2019; 51:1782-803. [PMID: 30746644 DOI: 10.3758/s13428-018-1155-z] [Citation(s) in RCA: 17] [Impact Index Per Article: 3.4] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/04/2023]
Abstract
Half of the world's population has internet access. In principle, researchers are no longer limited to subjects they can recruit into the laboratory. Any study that can be run on a computer or mobile device can be run with nearly any demographic anywhere in the world, and in large numbers. This has allowed scientists to effectively run hundreds of experiments at once. Despite their transformative power, such studies remain rare for practical reasons: the need for sophisticated software, the difficulty of recruiting so many subjects, and a lack of research paradigms that make effective use of their large amounts of data, due to such realities as that they require sophisticated software in order to run effectively. We present Pushkin: an open-source platform for designing and conducting massive experiments over the internet. Pushkin allows for a wide range of behavioral paradigms, through integration with the intuitive and flexible jsPsych experiment engine. It also addresses the basic technical challenges associated with massive, worldwide studies, including auto-scaling, extensibility, machine-assisted experimental design, multisession studies, and data security.
Collapse
|