1
|
Fu X, Franchak JM, MacNeill LA, Gunther KE, Borjon JI, Yurkovic-Harding J, Harding S, Bradshaw J, Pérez-Edgar KE. Implementing mobile eye tracking in psychological research: A practical guide. Behav Res Methods 2024; 56:8269-8288. [PMID: 39147949 PMCID: PMC11525247 DOI: 10.3758/s13428-024-02473-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 06/20/2024] [Indexed: 08/17/2024]
Abstract
Eye tracking provides direct, temporally and spatially sensitive measures of eye gaze. It can capture visual attention patterns from infancy through adulthood. However, commonly used screen-based eye tracking (SET) paradigms are limited in their depiction of how individuals process information as they interact with the environment in "real life". Mobile eye tracking (MET) records participant-perspective gaze in the context of active behavior. Recent technological developments in MET hardware enable researchers to capture egocentric vision as early as infancy and across the lifespan. However, challenges remain in MET data collection, processing, and analysis. The present paper aims to provide an introduction and practical guide to starting researchers in the field to facilitate the use of MET in psychological research with a wide range of age groups. First, we provide a general introduction to MET. Next, we briefly review MET studies in adults and children that provide new insights into attention and its roles in cognitive and socioemotional functioning. We then discuss technical issues relating to MET data collection and provide guidelines for data quality inspection, gaze annotations, data visualization, and statistical analyses. Lastly, we conclude by discussing the future directions of MET implementation. Open-source programs for MET data quality inspection, data visualization, and analysis are shared publicly.
Collapse
Affiliation(s)
- Xiaoxue Fu
- Department of Psychology, University of South Carolina, Columbia, SC, USA.
| | - John M Franchak
- Department of Psychology, University of California Riverside, Riverside, CA, USA
| | - Leigha A MacNeill
- Department of Medical Social Sciences, Northwestern University, Feinberg School of Medicine, Northwestern University, Chicago, IL, USA
- Institute for Innovations in Developmental Sciences, Northwestern University, Evanston, IL, USA
| | - Kelley E Gunther
- Neuroscience and Cognitive Science Program, University of Maryland, College Park, MD, USA
| | - Jeremy I Borjon
- Department of Psychology, University of Houston, Houston, TX, USA
- Texas Institute for Measurement, Evaluation, and Statistics, University of Houston, Houston, TX, USA
- Texas Center for Learning Disorders, University of Houston, Houston, TX, USA
| | | | - Samuel Harding
- Department of Psychology, University of South Carolina, Columbia, SC, USA
| | - Jessica Bradshaw
- Department of Psychology, University of South Carolina, Columbia, SC, USA
| | - Koraly E Pérez-Edgar
- Department of Psychology, The Pennsylvania State University, University Park, PA, USA
| |
Collapse
|
2
|
Franchak JM, Adolph KE. An update of the development of motor behavior. WILEY INTERDISCIPLINARY REVIEWS. COGNITIVE SCIENCE 2024; 15:e1682. [PMID: 38831670 PMCID: PMC11534565 DOI: 10.1002/wcs.1682] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/03/2023] [Revised: 03/31/2024] [Accepted: 04/22/2024] [Indexed: 06/05/2024]
Abstract
This primer describes research on the development of motor behavior. We focus on infancy when basic action systems are acquired-posture, locomotion, manual actions, and facial actions-and we adopt a developmental systems perspective to understand the causes and consequences of developmental change. Experience facilitates improvements in motor behavior and infants accumulate immense amounts of varied everyday experience with all the basic action systems. At every point in development, perception guides behavior by providing feedback about the results of just prior movements and information about what to do next. Across development, new motor behaviors provide new inputs for perception. Thus, motor development opens up new opportunities for acquiring knowledge and acting on the world, instigating cascades of developmental changes in perceptual, cognitive, and social domains. This article is categorized under: Cognitive Biology > Cognitive Development Psychology > Motor Skill and Performance Neuroscience > Development.
Collapse
Affiliation(s)
- John M Franchak
- Department of Psychology, University of California, Riverside, California, USA
| | - Karen E Adolph
- Department of Psychology, Center for Neural Science, New York University, New York, USA
| |
Collapse
|
3
|
Bradshaw J, Fu X, Richards JE. Infant sustained attention differs by context and social content in the first 2 years of life. Dev Sci 2024; 27:e13500. [PMID: 38499474 PMCID: PMC11608077 DOI: 10.1111/desc.13500] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/17/2023] [Revised: 02/09/2024] [Accepted: 02/11/2024] [Indexed: 03/20/2024]
Abstract
Sustained attention (SA) is an endogenous form of attention that emerges in infancy and reflects cognitive engagement and processing. SA is critical for learning and has been measured using different methods during screen-based and interactive contexts involving social and nonsocial stimuli. How SA differs by measurement method, context, and stimuli across development in infancy is not fully understood. This 2-year longitudinal study examines attention using one measure of overall looking behavior and three measures of SA-mean look duration, percent time in heart rate-defined SA, and heart rate change during SA-in N = 53 infants from 1 to 24 months across four unique task conditions: social videos, nonsocial videos, social interactions (face-to-face play), and nonsocial interactions (toy engagement). Results suggest that developmental changes in attention differ by measurement method, task context (screen or interaction), and task stimulus (social or nonsocial). During social interactions, overall looking and look durations declined after age 3-4 months, whereas heart rate-defined attention measures remained stable. All SA measures were greater for videos than for live interaction conditions throughout the first 6 months, but SA to social and nonsocial stimuli within each task context were equivalent. In the second year of life, SA measured with look durations was greater for social videos compared to other conditions, heart rate-defined SA was greater for social videos compared to nonsocial interactions, and heart rate change during SA was similar across conditions. Together, these results suggest that different measures of attention to social and nonsocial stimuli may reflect unique developmental processes and are important to compare and consider together, particularly when using infant attention as a marker of typical or atypical development. RESEARCH HIGHLIGHTS: Attention measure, context, and social content uniquely differentiate developmental trajectories of attention in the first 2 years of life. Overall looking to caregivers during dyadic social interactions declines significantly from 4 to 6 months of age while sustained attention (SA) to caregivers remains stable. Heart rate-defined SA generally differentiates stimulus context where infants show greater SA while watching videos than while engaging with toys.
Collapse
Affiliation(s)
- Jessica Bradshaw
- Department of Psychology, University of South Carolina, Columbia, South Carolina, USA
- Institute for Mind and Brain, University of South Carolina, Columbia, South Carolina, USA
- Carolina Autism and Neurodevelopment Research Center, University of South Carolina, Columbia, South Carolina, USA
| | - Xiaoxue Fu
- Department of Psychology, University of South Carolina, Columbia, South Carolina, USA
- Institute for Mind and Brain, University of South Carolina, Columbia, South Carolina, USA
| | - John E. Richards
- Department of Psychology, University of South Carolina, Columbia, South Carolina, USA
- Institute for Mind and Brain, University of South Carolina, Columbia, South Carolina, USA
| |
Collapse
|
4
|
Aneja P, Kinna T, Newman J, Sami S, Cassidy J, McCarthy J, Tiwari M, Kumar A, Spencer JP. Leveraging technological advances to assess dyadic visual cognition during infancy in high- and low-resource settings. Front Psychol 2024; 15:1376552. [PMID: 38873529 PMCID: PMC11169819 DOI: 10.3389/fpsyg.2024.1376552] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/25/2024] [Accepted: 05/08/2024] [Indexed: 06/15/2024] Open
Abstract
Caregiver-infant interactions shape infants' early visual experience; however, there is limited work from low-and middle-income countries (LMIC) in characterizing the visual cognitive dynamics of these interactions. Here, we present an innovative dyadic visual cognition pipeline using machine learning methods which captures, processes, and analyses the visual dynamics of caregiver-infant interactions across cultures. We undertake two studies to examine its application in both low (rural India) and high (urban UK) resource settings. Study 1 develops and validates the pipeline to process caregiver-infant interaction data captured using head-mounted cameras and eye-trackers. We use face detection and object recognition networks and validate these tools using 12 caregiver-infant dyads (4 dyads from a 6-month-old UK cohort, 4 dyads from a 6-month-old India cohort, and 4 dyads from a 9-month-old India cohort). Results show robust and accurate face and toy detection, as well as a high percent agreement between processed and manually coded dyadic interactions. Study 2 applied the pipeline to a larger data set (25 6-month-olds from the UK, 31 6-month-olds from India, and 37 9-month-olds from India) with the aim of comparing the visual dynamics of caregiver-infant interaction across the two cultural settings. Results show remarkable correspondence between key measures of visual exploration across cultures, including longer mean look durations during infant-led joint attention episodes. In addition, we found several differences across cultures. Most notably, infants in the UK had a higher proportion of infant-led joint attention episodes consistent with a child-centered view of parenting common in western middle-class families. In summary, the pipeline we report provides an objective assessment tool to quantify the visual dynamics of caregiver-infant interaction across high- and low-resource settings.
Collapse
Affiliation(s)
- Prerna Aneja
- School of Psychology, University of East Anglia, Norwich, United Kingdom
| | - Thomas Kinna
- School of Medicine, University of East Anglia, Norwich, United Kingdom
- School of Pharmacy, University of East Anglia, Norwich, United Kingdom
| | - Jacob Newman
- IT and Computing, University of East Anglia, Norwich, United Kingdom
| | - Saber Sami
- School of Medicine, University of East Anglia, Norwich, United Kingdom
| | - Joe Cassidy
- School of Psychology, University of East Anglia, Norwich, United Kingdom
| | - Jordan McCarthy
- School of Psychology, University of East Anglia, Norwich, United Kingdom
| | | | | | - John P. Spencer
- School of Psychology, University of East Anglia, Norwich, United Kingdom
| |
Collapse
|
5
|
Long B, Goodin S, Kachergis G, Marchman VA, Radwan SF, Sparks RZ, Xiang V, Zhuang C, Hsu O, Newman B, Yamins DLK, Frank MC. The BabyView camera: Designing a new head-mounted camera to capture children's early social and visual environments. Behav Res Methods 2024; 56:3523-3534. [PMID: 37656342 DOI: 10.3758/s13428-023-02206-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 07/24/2023] [Indexed: 09/02/2023]
Abstract
Head-mounted cameras have been used in developmental psychology research for more than a decade to provide a rich and comprehensive view of what infants see during their everyday experiences. However, variation between these devices has limited the field's ability to compare results across studies and across labs. Further, the video data captured by these cameras to date has been relatively low-resolution, limiting how well machine learning algorithms can operate over these rich video data. Here, we provide a well-tested and easily constructed design for a head-mounted camera assembly-the BabyView-developed in collaboration with Daylight Design, LLC., a professional product design firm. The BabyView collects high-resolution video, accelerometer, and gyroscope data from children approximately 6-30 months of age via a GoPro camera custom mounted on a soft child-safety helmet. The BabyView also captures a large, portrait-oriented vertical field-of-view that encompasses both children's interactions with objects and with their social partners. We detail our protocols for video data management and for handling sensitive data from home environments. We also provide customizable materials for onboarding families with the BabyView. We hope that these materials will encourage the wide adoption of the BabyView, allowing the field to collect high-resolution data that can link children's everyday environments with their learning outcomes.
Collapse
Affiliation(s)
- Bria Long
- Department of Psychology, Stanford University, Stanford, CA, USA.
| | | | - George Kachergis
- Department of Psychology, Stanford University, Stanford, CA, USA
| | | | - Samaher F Radwan
- Department of Psychology, Stanford University, Stanford, CA, USA
- Graduate School of Education, Stanford University, Stanford, CA, USA
| | - Robert Z Sparks
- Department of Psychology, Stanford University, Stanford, CA, USA
| | - Violet Xiang
- Department of Psychology, Stanford University, Stanford, CA, USA
| | - Chengxu Zhuang
- Department of Psychology, Stanford University, Stanford, CA, USA
| | - Oliver Hsu
- Daylight Design, LLC, San Francisco, CA, USA
| | | | - Daniel L K Yamins
- Department of Psychology, Stanford University, Stanford, CA, USA
- Department of Computer Science, Stanford University, Stanford, CA, USA
| | - Michael C Frank
- Department of Psychology, Stanford University, Stanford, CA, USA
| |
Collapse
|
6
|
Toyama N. Imitation among infants in a day-care center and the development of locomotion. Infant Behav Dev 2023; 72:101870. [PMID: 37544196 DOI: 10.1016/j.infbeh.2023.101870] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/12/2023] [Revised: 07/30/2023] [Accepted: 07/30/2023] [Indexed: 08/08/2023]
Abstract
To examine the relationship between imitation and locomotor development among peers during infancy, we observed free play in a class of infants in a day-care center over a one-year period. The analysis included 16 infants (mean age was 8.3 months (SD=2.3) at the beginning of the observation) and 5 caregivers. The longitudinal data were divided into the crawling, cruising, and walking periods, and the imitation of object manipulation that took place among the infants during each period was analyzed. With the development of locomotion, peer-to-peer imitation became frequent. Infants who had acquired the ability to walk demonstrated imitation more frequently in triadic interactions than in dyadic interactions. Imitation took place between infants, but it was often mediated by caregivers rather than directly between infants. The results suggest that the acquisition of locomotor skills is a link in a developmental cascade from motor development to infant peer interaction. However, it is reasonable to interpret the results as indicating that the development of locomotion does not directly affect infant interactions in isolation, but rather that walking increases both the sharing and manipulation of objects with caregivers and proximity to peers, and their combined effects form a cascade.
Collapse
|
7
|
Kretch KS, Marcinowski EC, Lin-Ya H, Koziol NA, Harbourne RT, Lobo MA, Dusing SC. Opportunities for learning and social interaction in infant sitting: Effects of sitting support, sitting skill, and gross motor delay. Dev Sci 2023; 26:e13318. [PMID: 36047385 PMCID: PMC10544757 DOI: 10.1111/desc.13318] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/09/2022] [Revised: 07/21/2022] [Accepted: 08/15/2022] [Indexed: 12/15/2022]
Abstract
The development of independent sitting changes everyday opportunities for learning and has cascading effects on cognitive and language development. Prior to independent sitting, infants experience the sitting position with physical support from caregivers. Why does supported sitting not provide the same input for learning that is experienced in independent sitting? This question is especially relevant for infants with gross motor delay, who require support in sitting for many months after typically developing infants sit independently. We observed infants with typical development (n = 34, ages 4-7 months) and infants with gross motor delay (n = 128, ages 7-16 months) in early stages of sitting development, and their caregivers, in a dyadic play observation. We predicted that infants who required caregiver support for sitting would spend more time facing away from the caregiver and less time contacting objects than infants who could sit independently. We also predicted that caregivers of supported sitters would spend less time contacting objects because their hands would be full supporting their infants. Our first two hypotheses were confirmed; however, caregivers spent surprisingly little time using both hands to provide support, and caregivers of supported sitters spent more time contacting objects than caregivers of independent sitters. Similar patterns were seen in the group of typically developing infants and the infants with motor delay. Our findings suggest that independent sitting and supported sitting provide qualitatively distinct experiences with different implications for social interaction and learning opportunities. HIGHLIGHTS: During seated free play, supported sitters spent more time facing away from their caregivers and less time handling objects than independent sitters. Caregivers who spent more time supporting infants with both hands spent less time handling objects; however, caregivers mostly supported infants with one or no hands. A continuous measure of sitting skill did not uniquely contribute to these behaviors beyond the effect of binary sitting support (supported vs. independent sitter). The pattern of results was similar for typically developing infants and infants with gross motor delay, despite differences in age.
Collapse
Affiliation(s)
- Kari S. Kretch
- Division of Biokinesiology and Physical Therapy, University of Southern California
| | | | - Hsu Lin-Ya
- Division of Physical Therapy, University of Washington
| | - Natalie A. Koziol
- Nebraska Center for Research on Children, Youth, Families and Schools, University of Nebraska-Lincoln
| | - Regina T. Harbourne
- Physical Therapy Department, Rangos School of Health Sciences, Duquesne University
| | | | - Stacey C. Dusing
- Division of Biokinesiology and Physical Therapy, University of Southern California
| |
Collapse
|
8
|
Schneider JL, Roemer EJ, Northrup JB, Iverson JM. Dynamics of the dyad: How mothers and infants co-construct interaction spaces during object play. Dev Sci 2023; 26:e13281. [PMID: 35584243 PMCID: PMC9840819 DOI: 10.1111/desc.13281] [Citation(s) in RCA: 9] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/19/2021] [Revised: 05/09/2022] [Accepted: 05/10/2022] [Indexed: 01/17/2023]
Abstract
Studies of dyadic interaction often examine infants' social exchanges with their caregivers in settings that constrain their physical properties (e.g., infant posture, fixed seating location for infants and adults). Methodological decisions about the physical arrangements of interaction, however, may limit our ability to understand how posture and position shape them. Here we focused on these embodied properties of dyadic interaction in the context of object play. We followed 30 mother-infant dyads across the first year of life (at 3, 6, 9, and 12 months) and observed them during 5 min of play with a standard set of toys. Using an interval-based coding system, we measured developmental change in infant posture, how mothers and infants positioned themselves relative to one another, and how they populated interaction spaces with objects. Results showed that mother-infant dyads co-constructed interaction spaces and that the contributions of each partner changed across development. Dyads progressively adopted a broader spatial co-orientation during play (e.g., positioned at right angles) across the first year. Moreover, advances in infants' postural skills, particularly increases in the use of independent sitting in real time, uniquely predicted change in dyadic co-orientation and infants' actions with objects, independent of age. Taken together, we show that the embodied properties of dyadic object play help determine how interactions are physically organized and unfold, both in real time and across the first year of life.
Collapse
Affiliation(s)
| | - Emily J Roemer
- Department of Psychology, University of Pittsburgh, Pittsburgh, PA, USA
| | - Jessie B Northrup
- Department of Psychiatry, University of Pittsburgh, Pittsburgh, PA, USA
| | - Jana M Iverson
- Department of Psychology, University of Pittsburgh, Pittsburgh, PA, USA
| |
Collapse
|