1
|
Bierlich AM, Plank IS, Scheel NT, Keeser D, Falter-Wagner CM. Neural processing of social reciprocity in autism. Neuroimage Clin 2025; 46:103793. [PMID: 40315681 DOI: 10.1016/j.nicl.2025.103793] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/02/2024] [Revised: 07/26/2024] [Accepted: 04/25/2025] [Indexed: 05/04/2025]
Abstract
Social reciprocity and interpersonal synchrony implicitly mediate social interactions to facilitate natural exchanges. These processes are altered in autism, but it is unclear how such alterations manifest at the neural level during social interaction processing. Using task-based fMRI, we investigated the neural correlates of interpersonal synchrony during basic reciprocal interactions in a preregistered study. Participants communicated with a virtual partner by sending visual signals. Analyses showed comparable activation patterns and experienced synchrony ratings between autistic and non-autistic participants, as well as between interactions with virtual partners who had high or low synchronous responses. An exploratory whole brain analysis for the effect of task revealed significant activation of the inferior frontal gyrus, insular cortex, and anterior inferior parietal lobe; areas associated with cognitive control, rhythmic temporal coordination, and action observation. This activation was independent of the virtual partner's response synchrony and was similar for autistic and non-autistic participants. These results provide an initial look into the neural basis of processing social reciprocity in autism, particularly when individuals are part of an interaction, and hint that the neural processing of social reciprocity may be spared in autism when their partners' behavior is predictable.
Collapse
Affiliation(s)
- Afton M Bierlich
- Department of Psychiatry and Psychotherapy, LMU University Hospital, LMU Munich Nussbaumstrasse 7, 80336 Munich, Germany.
| | - Irene Sophia Plank
- Department of Psychiatry and Psychotherapy, LMU University Hospital, LMU Munich Nussbaumstrasse 7, 80336 Munich, Germany
| | - Nanja T Scheel
- Department of Psychiatry and Psychotherapy, LMU University Hospital, LMU Munich Nussbaumstrasse 7, 80336 Munich, Germany
| | - Daniel Keeser
- Department of Psychiatry and Psychotherapy, LMU University Hospital, LMU Munich Nussbaumstrasse 7, 80336 Munich, Germany; NeuroImaging Core Unit Munich (NICUM), LMU University Hospital, LMU Munich Nussbaumstrasse 7, 80336 Munich, Germany
| | - Christine M Falter-Wagner
- Department of Psychiatry and Psychotherapy, LMU University Hospital, LMU Munich Nussbaumstrasse 7, 80336 Munich, Germany.
| |
Collapse
|
2
|
Boorom O, Liu T. A scoping review of interaction dynamics in minimally verbal autistic individuals. Front Psychol 2024; 15:1497800. [PMID: 39606190 PMCID: PMC11598442 DOI: 10.3389/fpsyg.2024.1497800] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/17/2024] [Accepted: 10/22/2024] [Indexed: 11/29/2024] Open
Abstract
Interaction dynamics provide information about how social interactions unfold over time and have implications for communication development. Characterizing social interaction in autistic people who are minimally verbal (MV) has the potential to illuminate mechanisms of change in communication development and intervention. The purpose of this scoping review was to investigate the current evidence characterizing interaction dynamics in MV autistic individuals, methods used to measure interaction dynamics in this population, and opportunities for future research. Articles were included if participants were diagnosed with autism, considered MV, if interaction occurred with a human communication partner during live in-person interaction, and if variables were derived by measuring the relationship between behaviors in both partners. The seven articles included in this review demonstrate that limited research describes interaction dynamics in this population, and that behavioral coding measures can be leveraged to assess constructs such as turn-taking, social contingency, and balance in social interactions. While there is some evidence describing how MV autistic individuals and their communication partners construct reciprocal interaction, there is variability in how interaction dynamics are measured and limited evidence describing individual differences. Recommendations for future research are discussed.
Collapse
Affiliation(s)
- Olivia Boorom
- Speech-Language-Hearing: Sciences and Disorders, University of Kansas, Lawrence, KS, United States
| | - Talia Liu
- Department of Speech, Language, and Hearing Sciences, Boston University, Boston, MA, United States
| |
Collapse
|
3
|
Bennewith C, Bellali J, Watkins L, Tromans S, Bhui K, Shankar R. Sublime and extended reality experiences to enhance emotional wellbeing for autistic people: A state of the art review and narrative synthesis. Int J Soc Psychiatry 2024; 70:1202-1210. [PMID: 39049584 PMCID: PMC11523544 DOI: 10.1177/00207640241261172] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 07/27/2024]
Abstract
BACKGROUND Sublime is a centuries old concept of emergent experience arising from immense and threatening awareness provoked by overwhelming fear and dread when faced with an incomprehensible situation as is common to autistic people. Extended Reality (XR) technologies have been used since the mid-1990s, in regulating emotions, behaviour and supporting social skill development for autistic people. AIMS To understand utility of XR technologies in creating immersive experiences for autistic people to alleviate anxiety and the relationship to the sublime. METHOD A State of the Art literature review and narrative synthesis was conducted. PubMed, CINAHL, EMBASE, Cochrane Library, Scopus, Web of Science were searched with terms Autism AND Technology. In addition, fields of digital technologies and wellbeing, digital art and mental health, generative arts and the sublime were explored through web searches of grey literature, conversations with digital designers and explorations of extended reality platforms. No time limits were placed. Searches were done in English. Papers were screened and shortlisted using the inclusion criteria applied by two reviewers. RESULTS Fifty-eight papers/articles met the preliminary inclusion criteria for in-depth review of which 31 were found suitable for the narrative synthesis related to XR technologies and sublime experiences as related to autistic people. Narrative synthesis lent itself to four themes that is current utility of XR Technologies in autism, the impact of immersive experiences on Behavioural, phenomenological and biological markers of autistic people, the Benefits of increased sensory stimulation using XR on autism and an inquiry into the potential of the sublime for autism. CONCLUSIONS Mixed reality environments that experiment with a broad range of XR technologies including incorporating notions of the sublime, might be beneficial in reducing emotional dysregulation and improving social development in autistic people especially if co-designed with them.
Collapse
Affiliation(s)
- Chris Bennewith
- Faculty of Arts, Humanities and Business University of Plymouth, UK
| | - Johara Bellali
- Faculty of Arts, Humanities and Business University of Plymouth, UK
| | - Lance Watkins
- University of South Wales, Pontypridd, UK
- Swansea Bay University Health Board, Port Talbot, UK
- Cornwall Intellectual Disability Equitable Research, University of Plymouth Peninsula School of Medicine, Truro, UK
| | - Samuel Tromans
- Department of Population Health Sciences, University of Leicester, UK
- Leicestershire Partnership NHS Trust, UK
| | | | - Rohit Shankar
- Cornwall Intellectual Disability Equitable Research, University of Plymouth Peninsula School of Medicine, Truro, UK
- Cornwall Intellectual Disability Equitable Research, Cornwall Partnership NHS Foundation Trust, UK
| |
Collapse
|
4
|
Koehler JC, Dong MS, Song DY, Bong G, Koutsouleris N, Yoo H, Falter-Wagner CM. Classifying autism in a clinical population based on motion synchrony: a proof-of-concept study using real-life diagnostic interviews. Sci Rep 2024; 14:5663. [PMID: 38453972 PMCID: PMC10920641 DOI: 10.1038/s41598-024-56098-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/20/2023] [Accepted: 03/01/2024] [Indexed: 03/09/2024] Open
Abstract
Predictive modeling strategies are increasingly studied as a means to overcome clinical bottlenecks in the diagnostic classification of autism spectrum disorder. However, while some findings are promising in the light of diagnostic marker research, many of these approaches lack the scalability for adequate and effective translation to everyday clinical practice. In this study, our aim was to explore the use of objective computer vision video analysis of real-world autism diagnostic interviews in a clinical sample of children and young individuals in the transition to adulthood to predict diagnosis. Specifically, we trained a support vector machine learning model on interpersonal synchrony data recorded in Autism Diagnostic Observation Schedule (ADOS-2) interviews of patient-clinician dyads. Our model was able to classify dyads involving an autistic patient (n = 56) with a balanced accuracy of 63.4% against dyads including a patient with other psychiatric diagnoses (n = 38). Further analyses revealed no significant associations between our classification metrics with clinical ratings. We argue that, given the above-chance performance of our classifier in a highly heterogeneous sample both in age and diagnosis, with few adjustments this highly scalable approach presents a viable route for future diagnostic marker research in autism.
Collapse
Affiliation(s)
- Jana Christina Koehler
- Department of Psychiatry and Psychotherapy, University Hospital, LMU Munich, Munich, Germany.
| | - Mark Sen Dong
- Department of Psychiatry and Psychotherapy, University Hospital, LMU Munich, Munich, Germany
- Max Planck Institute of Psychiatry, Munich, Germany
| | - Da-Yea Song
- Department of Psychiatry, Seoul National University Bundang Hospital, Seongnam, South Korea
- Department of Psychiatry, Seoul National University College of Medicine, Seoul, Korea
| | - Guiyoung Bong
- Department of Psychiatry, Seoul National University Bundang Hospital, Seongnam, South Korea
| | - Nikolaos Koutsouleris
- Department of Psychiatry and Psychotherapy, University Hospital, LMU Munich, Munich, Germany
- Max Planck Institute of Psychiatry, Munich, Germany
- Institute of Psychiatry, Psychology and Neuroscience, King's College, London, UK
| | - Heejeong Yoo
- Department of Psychiatry, Seoul National University Bundang Hospital, Seongnam, South Korea
- Department of Psychiatry, Seoul National University College of Medicine, Seoul, Korea
| | | |
Collapse
|
5
|
Gómez-Espinosa A, Moreno JC, Pérez-de la Cruz S. Assisted Robots in Therapies for Children with Autism in Early Childhood. SENSORS (BASEL, SWITZERLAND) 2024; 24:1503. [PMID: 38475039 PMCID: PMC10934187 DOI: 10.3390/s24051503] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/31/2023] [Revised: 02/22/2024] [Accepted: 02/24/2024] [Indexed: 03/14/2024]
Abstract
Children with autism spectrum disorder (ASD) have deficits that affect their social relationships, communication, and flexibility in reasoning. There are different types of treatment (pharmacological, educational, psychological, and rehabilitative). Currently, one way to address this problem is by using robotic systems to address the abilities that are altered in these children. The aim of this review will be to analyse the effectiveness of the incorporation of the different robotic systems currently existing in the treatment of children up to 10 years of age diagnosed with autism. A systematic review has been carried out in the PubMed, Scopus, Web of Science, and Dialnet databases, with the following descriptors: child, autism, and robot. The search yielded 578 papers, and nine were selected after the application of the PRISMA guideline. The quality of the studies was analysed with the PEDRo scale, and only those with a score between four and six were selected. From this study, the conclusion is that the use of robots, in general, improves children's behaviour in the short term, but longer-term experiences are necessary to achieve more conclusive results.
Collapse
Affiliation(s)
- Ana Gómez-Espinosa
- Department of Informatics, University of Almería, ceiA3, CIESOL, 04120 Almería, Spain;
| | - José Carlos Moreno
- Department of Informatics, University of Almería, ceiA3, CIESOL, 04120 Almería, Spain;
| | | |
Collapse
|
6
|
Koehler JC, Dong MS, Bierlich AM, Fischer S, Späth J, Plank IS, Koutsouleris N, Falter-Wagner CM. Machine learning classification of autism spectrum disorder based on reciprocity in naturalistic social interactions. Transl Psychiatry 2024; 14:76. [PMID: 38310111 PMCID: PMC10838326 DOI: 10.1038/s41398-024-02802-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/13/2023] [Revised: 01/19/2024] [Accepted: 01/23/2024] [Indexed: 02/05/2024] Open
Abstract
Autism spectrum disorder is characterized by impaired social communication and interaction. As a neurodevelopmental disorder typically diagnosed during childhood, diagnosis in adulthood is preceded by a resource-heavy clinical assessment period. The ongoing developments in digital phenotyping give rise to novel opportunities within the screening and diagnostic process. Our aim was to quantify multiple non-verbal social interaction characteristics in autism and build diagnostic classification models independent of clinical ratings. We analyzed videos of naturalistic social interactions in a sample including 28 autistic and 60 non-autistic adults paired in dyads and engaging in two conversational tasks. We used existing open-source computer vision algorithms for objective annotation to extract information based on the synchrony of movement and facial expression. These were subsequently used as features in a support vector machine learning model to predict whether an individual was part of an autistic or non-autistic interaction dyad. The two prediction models based on reciprocal adaptation in facial movements, as well as individual amounts of head and body motion and facial expressiveness showed the highest precision (balanced accuracies: 79.5% and 68.8%, respectively), followed by models based on reciprocal coordination of head (balanced accuracy: 62.1%) and body (balanced accuracy: 56.7%) motion, as well as intrapersonal coordination processes (balanced accuracy: 44.2%). Combinations of these models did not increase overall predictive performance. Our work highlights the distinctive nature of non-verbal behavior in autism and its utility for digital phenotyping-based classification. Future research needs to both explore the performance of different prediction algorithms to reveal underlying mechanisms and interactions, as well as investigate the prospective generalizability and robustness of these algorithms in routine clinical care.
Collapse
Affiliation(s)
| | - Mark Sen Dong
- Department of Psychiatry and Psychotherapy, Medical Faculty, LMU, Munich, Germany
| | - Afton M Bierlich
- Department of Psychiatry and Psychotherapy, Medical Faculty, LMU, Munich, Germany
| | - Stefanie Fischer
- Department of Psychiatry and Psychotherapy, Medical Faculty, LMU, Munich, Germany
- Goethe University Frankfurt, University Hospital, Department of Psychiatry, Psychosomatic Medicine and Psychotherapy, Frankfurt am Main, Germany
| | - Johanna Späth
- Department of Psychiatry and Psychotherapy, Medical Faculty, LMU, Munich, Germany
| | - Irene Sophia Plank
- Department of Psychiatry and Psychotherapy, Medical Faculty, LMU, Munich, Germany
| | - Nikolaos Koutsouleris
- Department of Psychiatry and Psychotherapy, Medical Faculty, LMU, Munich, Germany
- Max Planck Institute of Psychiatry, Munich, Germany
- Institute of Psychiatry, Psychology and Neuroscience, King's College, London, UK
| | | |
Collapse
|
7
|
Plank IS, Koehler JC, Nelson AM, Koutsouleris N, Falter-Wagner CM. Automated extraction of speech and turn-taking parameters in autism allows for diagnostic classification using a multivariable prediction model. Front Psychiatry 2023; 14:1257569. [PMID: 38025455 PMCID: PMC10658003 DOI: 10.3389/fpsyt.2023.1257569] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/21/2023] [Accepted: 10/20/2023] [Indexed: 12/01/2023] Open
Abstract
Autism spectrum disorder (ASD) is diagnosed on the basis of speech and communication differences, amongst other symptoms. Since conversations are essential for building connections with others, it is important to understand the exact nature of differences between autistic and non-autistic verbal behaviour and evaluate the potential of these differences for diagnostics. In this study, we recorded dyadic conversations and used automated extraction of speech and interactional turn-taking features of 54 non-autistic and 26 autistic participants. The extracted speech and turn-taking parameters showed high potential as a diagnostic marker. A linear support vector machine was able to predict the dyad type with 76.2% balanced accuracy (sensitivity: 73.8%, specificity: 78.6%), suggesting that digitally assisted diagnostics could significantly enhance the current clinical diagnostic process due to their objectivity and scalability. In group comparisons on the individual and dyadic level, we found that autistic interaction partners talked slower and in a more monotonous manner than non-autistic interaction partners and that mixed dyads consisting of an autistic and a non-autistic participant had increased periods of silence, and the intensity, i.e. loudness, of their speech was more synchronous.
Collapse
Affiliation(s)
- I. S. Plank
- Department of Psychiatry and Psychotherapy, LMU University Hospital, LMU Munich, Munich, Germany
| | - J. C. Koehler
- Department of Psychiatry and Psychotherapy, LMU University Hospital, LMU Munich, Munich, Germany
| | - A. M. Nelson
- Department of Psychiatry and Psychotherapy, LMU University Hospital, LMU Munich, Munich, Germany
| | - N. Koutsouleris
- Department of Psychiatry and Psychotherapy, LMU University Hospital, LMU Munich, Munich, Germany
- Max Planck Institute of Psychiatry, Munich, Germany
- Institute of Psychiatry, Psychology and Neuroscience, King’s College, London, United Kingdom
| | - C. M. Falter-Wagner
- Department of Psychiatry and Psychotherapy, LMU University Hospital, LMU Munich, Munich, Germany
| |
Collapse
|
8
|
Yozevitch R, Dahan A, Seada T, Appel D, Gvirts H. Classifying interpersonal synchronization states using a data-driven approach: implications for social interaction understanding. Sci Rep 2023; 13:11150. [PMID: 37429957 PMCID: PMC10333224 DOI: 10.1038/s41598-023-37316-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/11/2022] [Accepted: 06/20/2023] [Indexed: 07/12/2023] Open
Abstract
This study presents a data-driven approach to identifying interpersonal motor synchrony states by analyzing hand movements captured from a 3D depth camera. Utilizing a single frame from the experiment, an XGBoost machine learning model was employed to differentiate between spontaneous and intentional synchrony modes with nearly [Formula: see text] accuracy. Our findings demonstrate a consistent pattern across subjects, revealing that movement velocity tends to be slower in synchrony modes. These insights support the notion that the relationship between velocity and synchrony is influenced by the cognitive load required for the task, with slower movements leading to higher synchrony in tasks demanding higher cognitive load. This work not only contributes to the limited literature on algorithms for identifying interpersonal synchrony but also has potential implications for developing new metrics to assess real-time human social interactions, understanding social interaction, and diagnosing and developing treatment strategies for social deficits associated with conditions such as Autism Spectrum Disorder.
Collapse
Affiliation(s)
- Roi Yozevitch
- Department of Computer Science, Ariel University, Ariel, 40700, Israel.
| | - Anat Dahan
- Department of Software Engineering, Braude College of Engineering, Karmiel, 216100, Israel
| | - Talia Seada
- Department of Computer Science, Ariel University, Ariel, 40700, Israel
| | - Daniel Appel
- Department of Computer Science, Ariel University, Ariel, 40700, Israel
| | - Hila Gvirts
- Department of Behavioral Sciences, Ariel University, Ariel, 40700, Israel
| |
Collapse
|
9
|
McDonald DQ, DeJardin E, Sariyanidi E, Herrington JD, Tunç B, Zampella CJ, Schultz RT. Predicting Autism from Head Movement Patterns during Naturalistic Social Interactions. PROCEEDINGS OF THE 2023 7TH INTERNATIONAL CONFERENCE ON MEDICAL AND HEALTH INFORMATICS (ICMHI 2023) : MAY 12-14, 2023, KYOTO, JAPAN. INTERNATIONAL CONFERENCE ON MEDICAL AND HEALTH INFORMATICS (7TH : 2023 : KYOTO, JAPAN) 2023; 2023:55-60. [PMID: 38699395 PMCID: PMC11064057 DOI: 10.1145/3608298.3608309] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/05/2024]
Abstract
Autism spectrum disorder (ASD) is a neurodevelopmental condition characterized in part by difficulties in verbal and nonverbal social communication. Evidence indicates that autistic people, compared to neurotypical peers, exhibit differences in head movements, a key form of nonverbal communication. Despite the crucial role of head movements in social communication, research on this nonverbal cue is relatively scarce compared to other forms of nonverbal communication, such as facial expressions and gestures. There is a need for scalable, reliable, and accurate instruments for measuring head movements directly within the context of social interactions. In this study, we used computer vision and machine learning to examine the head movement patterns of neurotypical and autistic individuals during naturalistic, face-to-face conversations, at both the individual (monadic) and interpersonal (dyadic) levels. Our model predicts diagnostic status using dyadic head movement data with an accuracy of 80%, highlighting the value of head movement as a marker of social communication. The monadic data pipeline had lower accuracy (69.2%) compared to the dyadic approach, emphasizing the importance of studying back-and-forth social communication cues within a true social context. The proposed classifier is not intended for diagnostic purposes, and future research should replicate our findings in larger, more representative samples.
Collapse
Affiliation(s)
| | - Ellis DeJardin
- Children's Hospital of Philadelphia Philadelphia, PA, USA
| | | | - John D Herrington
- Children's Hospital of Philadelphia Philadelphia, PA, USA
- University of Pennsylvania Philadelphia, PA, USA
| | - Birkan Tunç
- Children's Hospital of Philadelphia Philadelphia, PA, USA
- University of Pennsylvania Philadelphia, PA, USA
| | | | - Robert T Schultz
- Children's Hospital of Philadelphia Philadelphia, PA, USA
- University of Pennsylvania Philadelphia, PA, USA
| |
Collapse
|
10
|
Koehler JC, Falter-Wagner CM. Digitally assisted diagnostics of autism spectrum disorder. Front Psychiatry 2023; 14:1066284. [PMID: 36816410 PMCID: PMC9928948 DOI: 10.3389/fpsyt.2023.1066284] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/10/2022] [Accepted: 01/11/2023] [Indexed: 02/04/2023] Open
Abstract
Digital technologies have the potential to support psychiatric diagnostics and, in particular, differential diagnostics of autism spectrum disorder in the near future, making clinical decisions more objective, reliable and evidence-based while reducing clinical resources. Multimodal automatized measurement of symptoms at cognitive, behavioral, and neuronal levels combined with artificial intelligence applications offer promising strides toward personalized prognostics and treatment strategies. In addition, these new technologies could enable systematic and continuous assessment of longitudinal symptom development, beyond the usual scope of clinical practice. Early recognition of exacerbation and simplified, as well as detailed, progression control would become possible. Ultimately, digitally assisted diagnostics will advance early recognition. Nonetheless, digital technologies cannot and should not substitute clinical decision making that takes the comprehensive complexity of individual longitudinal and cross-section presentation of autism spectrum disorder into account. Yet, they might aid the clinician by objectifying decision processes and provide a welcome relief to resources in the clinical setting.
Collapse
Affiliation(s)
- Jana Christina Koehler
- Department of Psychiatry and Psychotherapy, Medical Faculty, LMU Munich, Munich, Germany
| | | |
Collapse
|
11
|
Machine Learning-Based Blood RNA Signature for Diagnosis of Autism Spectrum Disorder. Int J Mol Sci 2023; 24:ijms24032082. [PMID: 36768401 PMCID: PMC9916487 DOI: 10.3390/ijms24032082] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/15/2022] [Revised: 01/15/2023] [Accepted: 01/17/2023] [Indexed: 01/21/2023] Open
Abstract
Early diagnosis of autism spectrum disorder (ASD) is crucial for providing appropriate treatments and parental guidance from an early age. Yet, ASD diagnosis is a lengthy process, in part due to the lack of reliable biomarkers. We recently applied RNA-sequencing of peripheral blood samples from 73 American and Israeli children with ASD and 26 neurotypically developing (NT) children to identify 10 genes with dysregulated blood expression levels in children with ASD. Machine learning (ML) analyzes data by computerized analytical model building and may be applied to building diagnostic tools based on the optimization of large datasets. Here, we present several ML-generated models, based on RNA expression datasets collected during our recently published RNA-seq study, as tentative tools for ASD diagnosis. Using the random forest classifier, two of our proposed models yield an accuracy of 82% in distinguishing children with ASD and NT children. Our proof-of-concept study requires refinement and independent validation by studies with far larger cohorts of children with ASD and NT children and should thus be perceived as starting point for building more accurate ML-based tools. Eventually, such tools may potentially provide an unbiased means to support the early diagnosis of ASD.
Collapse
|
12
|
Thabtah F, Spencer R, Abdelhamid N, Kamalov F, Wentzel C, Ye Y, Dayara T. Autism screening: an unsupervised machine learning approach. Health Inf Sci Syst 2022; 10:26. [PMID: 36092454 PMCID: PMC9458819 DOI: 10.1007/s13755-022-00191-x] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/11/2022] [Accepted: 08/08/2022] [Indexed: 11/26/2022] Open
Abstract
Early screening of autism spectrum disorders (ASD) is a key area of research in healthcare. Currently artificial intelligence (AI)-driven approaches are used to improve the process of autism diagnosis using computer-aided diagnosis (CAD) systems. One of the issues related to autism diagnosis and screening data is the reliance of the predictions primarily on scores provided by medical screening methods which can be biased depending on how the scores are calculated. We attempt to reduce this bias by assessing the performance of the predictions related to the screening process using a new model that consists of a Self-Organizing Map (SOM) with classification algorithms. The SOM is employed prior to the diagnostic process to derive a new class label using clusters learnt from the independent features; these clusters are related to communication, repetitive traits, and social traits in the input dataset. Then, the new clusters are compared with existing class labels in the dataset to refine and eliminate any inconsistencies. Lastly, the refined dataset is utilised to derive classification systems for autism diagnosis. The new model was evaluated against a real-life autism screening dataset that consists of over 2000 instances of cases and controls. The results based on the refined dataset show that the proposed method achieves significantly higher accuracy, precision, and recall for the classification models derived when compared to models derived from the original dataset.
Collapse
Affiliation(s)
| | - Robinson Spencer
- Digital Technologies, Manukau Institute of Technology, Auckland, New Zealand
| | | | | | - Carl Wentzel
- Digital Technologies, Manukau Institute of Technology, Auckland, New Zealand
| | - Yongsheng Ye
- Digital Technologies, Manukau Institute of Technology, Auckland, New Zealand
| | - Thanu Dayara
- Digital Technologies, Manukau Institute of Technology, Auckland, New Zealand
| |
Collapse
|
13
|
McDonald DQ, Zampella CJ, Sariyanidi E, Manakiwala A, DeJardin E, Herrington JD, Schultz RT, Tunç B. Head Movement Patterns during Face-to-Face Conversations Vary with Age. ICMI'22 COMPANION : COMPANION PUBLICATION OF THE 2022 INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION : NOVEMBER 7-11, 2022, BANGALORE, INDIA. ICMI (CONFERENCE) (2022 : BANGALORE, INDIA) 2022; 2022:185-195. [PMID: 37975062 PMCID: PMC10652276 DOI: 10.1145/3536220.3563366] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/19/2023]
Abstract
Advances in computational behavior analysis have the potential to increase our understanding of behavioral patterns and developmental trajectories in neurotypical individuals, as well as in individuals with mental health conditions marked by motor, social, and emotional difficulties. This study focuses on investigating how head movement patterns during face-to-face conversations vary with age from childhood through adulthood. We rely on computer vision techniques due to their suitability for analysis of social behaviors in naturalistic settings, since video data capture can be unobtrusively embedded within conversations between two social partners. The methods in this work include unsupervised learning for movement pattern clustering, and supervised classification and regression as a function of age. The results demonstrate that 3-minute video recordings of head movements during conversations show patterns that distinguish between participants that are younger vs. older than 12 years with 78% accuracy. Additionally, we extract relevant patterns of head movement upon which the age distinction was determined by our models.
Collapse
Affiliation(s)
| | | | | | - Aashvi Manakiwala
- University of Pennsylvania, Philadelphia, PA, USA
- Children's Hospital of Philadelphia, Philadelphia, PA, USA
| | - Ellis DeJardin
- Children's Hospital of Philadelphia, Philadelphia, PA, USA
| | - John D Herrington
- Children's Hospital of Philadelphia, Philadelphia, PA, USA
- University of Pennsylvania, Philadelphia, PA, USA
| | - Robert T Schultz
- Children's Hospital of Philadelphia, Philadelphia, PA, USA
- University of Pennsylvania, Philadelphia, PA, USA
| | - Birkan Tunç
- Children's Hospital of Philadelphia, Philadelphia, PA, USA
- University of Pennsylvania, Philadelphia, PA, USA
| |
Collapse
|
14
|
Jacob S, Anagnostou E, Hollander E, Jou R, McNamara N, Sikich L, Tobe R, Murphy D, McCracken J, Ashford E, Chatham C, Clinch S, Smith J, Sanders K, Murtagh L, Noeldeke J, Veenstra-VanderWeele J. Large multicenter randomized trials in autism: key insights gained from the balovaptan clinical development program. Mol Autism 2022; 13:25. [PMID: 35690870 PMCID: PMC9188723 DOI: 10.1186/s13229-022-00505-6] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/08/2022] [Accepted: 05/31/2022] [Indexed: 12/02/2022] Open
Abstract
BACKGROUND Autism spectrum disorder (ASD) is a common and heterogeneous neurodevelopmental condition that is characterized by the core symptoms of social communication difficulties and restricted and repetitive behaviors. At present, there is an unmet medical need for therapies to ameliorate these core symptoms in order to improve quality of life of autistic individuals. However, several challenges are currently faced by the ASD community relating to the development of pharmacotherapies, namely in the conduct of clinical trials. Balovaptan is a V1a receptor antagonist that has been investigated to improve social communication difficulties in individuals with ASD. In this viewpoint, we draw upon our recent first-hand experiences of the balovaptan clinical development program to describe current challenges of ASD trials. DISCUSSION POINTS The balovaptan trials were conducted in a wide age range of individuals with ASD with the added complexities associated with international trials. When summarizing all three randomized trials of balovaptan, a placebo response was observed across several outcome measures. Placebo response was predicted by greater baseline symptom severity, online recruitment of participants, and less experienced or non-academic trial sites. We also highlight challenges relating to selection of outcome measures in ASD, the impact of baseline characteristics, and the role of expectation bias in influencing trial results. CONCLUSION Taken together, the balovaptan clinical development program has advanced our understanding of the key challenges facing ASD treatment research. The insights gained can be used to inform and improve the design of future clinical trials with the collective aim of developing efficacious therapies to support individuals with ASD.
Collapse
Affiliation(s)
- Suma Jacob
- Department of Psychiatry and Behavioral Sciences, University of Minnesota, Minneapolis, MN, USA.
| | - Evdokia Anagnostou
- Holland Bloorview Kids Rehabilitation Hospital, University of Toronto, Toronto, ON, Canada
| | - Eric Hollander
- Department of Psychiatry and Behavioral Sciences, Albert Einstein College of Medicine, New York, NY, USA
| | - Roger Jou
- Child Study Center, Yale School of Medicine, New Haven, CT, USA
| | - Nora McNamara
- Department of Psychiatry, University Hospitals, Cleveland, OH, USA
| | - Linmarie Sikich
- Department of Psychiatry and Behavioral Sciences, Duke Clinical Research Institute, Duke University School of Medicine, Durham, NC, USA
| | - Russell Tobe
- Nathan Kline Institute for Psychiatric Research, Orangeburg, NY, USA
| | | | - James McCracken
- David Geffen School of Medicine at UCLA, Los Angeles, CA, USA
| | | | | | | | - Janice Smith
- F. Hoffmann-La Roche Ltd, Welwyn Garden City, UK
| | - Kevin Sanders
- F. Hoffmann-La Roche Ltd, Genentech, South San Francisco, CA, USA
| | | | | | | |
Collapse
|
15
|
Alateyat H, Cruz S, Cernadas E, Tubío-Fungueiriño M, Sampaio A, González-Villar A, Carracedo A, Fernández-Delgado M, Fernández-Prieto M. A Machine Learning Approach in Autism Spectrum Disorders: From Sensory Processing to Behavior Problems. Front Mol Neurosci 2022; 15:889641. [PMID: 35615066 PMCID: PMC9126208 DOI: 10.3389/fnmol.2022.889641] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/04/2022] [Accepted: 04/06/2022] [Indexed: 12/01/2022] Open
Abstract
Atypical sensory processing described in autism spectrum disorders (ASDs) frequently cascade into behavioral alterations: isolation, aggression, indifference, anxious/depressed states, or attention problems. Predictive machine learning models might refine the statistical explorations of the associations between them by finding out how these dimensions are related. This study investigates whether behavior problems can be predicted using sensory processing abilities. Participants were 72 children and adolescents (21 females) diagnosed with ASD, aged between 6 and 14 years (M = 7.83 years; SD = 2.80 years). Parents of the participants were invited to answer the Sensory Profile 2 (SP2) and the Child Behavior Checklist (CBCL) questionnaires. A collection of 26 supervised machine learning regression models of different families was developed to predict the CBCL outcomes using the SP2 scores. The most reliable predictions were for the following outcomes: total problems (using the items in the SP2 touch scale as inputs), anxiety/depression (using avoiding quadrant), social problems (registration), and externalizing scales, revealing interesting relations between CBCL outcomes and SP2 scales. The prediction reliability on the remaining outcomes was “moderate to good” except somatic complaints and rule-breaking, where it was “bad to moderate.” Linear and ridge regression achieved the best prediction for a single outcome and globally, respectively, and gradient boosting machine achieved the best prediction in three outcomes. Results highlight the utility of several machine learning models in studying the predictive value of sensory processing impairments (with an early onset) on specific behavior alterations, providing evidences of relationship between sensory processing impairments and behavior problems in ASD.
Collapse
Affiliation(s)
- Heba Alateyat
- Centro Singular de Investigación en Tecnoloxías Intelixentes da USC (CiTIUS), Universidade de Santiago de Compostela (USC), Santiago de Compostela, Spain
| | - Sara Cruz
- The Psychology for Positive Development Research Center, Lusíada University—North, Porto, Portugal
| | - Eva Cernadas
- Centro Singular de Investigación en Tecnoloxías Intelixentes da USC (CiTIUS), Universidade de Santiago de Compostela (USC), Santiago de Compostela, Spain
| | - María Tubío-Fungueiriño
- Genomics and Bioinformatics Group, Centre for Research in Molecular Medicine and Chronic Diseases (CiMUS), Universidade de Santiago de Compostela (USC), Santiago de Compostela, Spain
- Grupo de Medicina Xenómica, Universidade de Santiago de Compostela (USC), Santiago de Compostela, Spain
- Fundación Instituto de Investigación Sanitaria de Santiago de Compostela (FIDIS), Santiago de Compostela, Spain
| | - Adriana Sampaio
- Psychological Neuroscience Lab, Centro de Investigação em Psicologia, School of Psychology, University of Minho, Campus de Gualtar, Braga, Portugal
| | - Alberto González-Villar
- Psychological Neuroscience Lab, Centro de Investigação em Psicologia, School of Psychology, University of Minho, Campus de Gualtar, Braga, Portugal
| | - Angel Carracedo
- Genomics and Bioinformatics Group, Centre for Research in Molecular Medicine and Chronic Diseases (CiMUS), Universidade de Santiago de Compostela (USC), Santiago de Compostela, Spain
- Fundación Pública Galega de Medicina Xenómica, Servicio Galego de Saúde (SERGAS), Santiago de Compostela, Spain
- Grupo de Medicina Xenómica, U-711, Centro de Investigación en Red de Enfermedades Raras (CIBERER), Universidade de Santiago de Compostela (USC), Santiago de Compostela, Spain
- Grupo de Genética, Instituto de Investigación Sanitaria de Santiago (IDIS), Santiago de Compostela, Spain
| | - Manuel Fernández-Delgado
- Centro Singular de Investigación en Tecnoloxías Intelixentes da USC (CiTIUS), Universidade de Santiago de Compostela (USC), Santiago de Compostela, Spain
- *Correspondence: Manuel Fernández-Delgado
| | - Montse Fernández-Prieto
- Genomics and Bioinformatics Group, Centre for Research in Molecular Medicine and Chronic Diseases (CiMUS), Universidade de Santiago de Compostela (USC), Santiago de Compostela, Spain
- Fundación Instituto de Investigación Sanitaria de Santiago de Compostela (FIDIS), Santiago de Compostela, Spain
- Grupo de Medicina Xenómica, U-711, Centro de Investigación en Red de Enfermedades Raras (CIBERER), Universidade de Santiago de Compostela (USC), Santiago de Compostela, Spain
- Grupo de Genética, Instituto de Investigación Sanitaria de Santiago (IDIS), Santiago de Compostela, Spain
| |
Collapse
|
16
|
Robles M, Namdarian N, Otto J, Wassiljew E, Navab N, Falter-Wagner C, Roth D. A Virtual Reality Based System for the Screening and Classification of Autism. IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS 2022; 28:2168-2178. [PMID: 35171773 DOI: 10.1109/tvcg.2022.3150489] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/14/2023]
Abstract
Autism - also known as Autism Spectrum Disorders or Autism Spectrum Conditions - is a neurodevelopmental condition characterized by repetitive behaviours and differences in communication and social interaction. As a consequence, many autistic individuals may struggle in everyday life, which sometimes manifests in depression, unemployment, or addiction. One crucial problem in patient support and treatment is the long waiting time to diagnosis, which was approximated to thirteen months on average. Yet, the earlier an intervention can take place the better the patient can be supported, which was identified as a crucial factor. We propose a system to support the screening of Autism Spectrum Disorders based on a virtual reality social interaction, namely a shopping experience, with an embodied agent. During this everyday interaction, behavioral responses are tracked and recorded. We analyze this behavior with machine learning approaches to classify participants from an autistic participant sample in comparison to a typically developed individuals control sample with high accuracy, demonstrating the feasibility of the approach. We believe that such tools can strongly impact the way mental disorders are assessed and may help to further find objective criteria and categorization.
Collapse
|
17
|
Salhi I, Qbadou M, Gouraguine S, Mansouri K, Lytridis C, Kaburlasos V. Towards Robot-Assisted Therapy for Children With Autism—The Ontological Knowledge Models and Reinforcement Learning-Based Algorithms. Front Robot AI 2022; 9:713964. [PMID: 35462779 PMCID: PMC9020227 DOI: 10.3389/frobt.2022.713964] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/24/2021] [Accepted: 03/17/2022] [Indexed: 11/16/2022] Open
Abstract
Robots are more and more present in our lives, particularly in the health sector. In therapeutic centers, some therapists are beginning to explore various tools like video games, Internet exchanges, and robot-assisted therapy. These tools will be at the disposal of these professionals as additional resources that can support them to assist their patients intuitively and remotely. The humanoid robot can capture young children’s attention and then attract the attention of researchers. It can be considered as a play partner and can directly interact with children or without a third party’s presence. It can equally perform repetitive tasks that humans cannot achieve in the same way. Moreover, humanoid robots can assist a therapist by allowing him to teleoperated and interact from a distance. In this context, our research focuses on robot-assisted therapy and introduces a humanoid social robot in a pediatric hospital care unit. That will be performed by analyzing many aspects of the child’s behavior, such as verbal interactions, gestures and facial expressions, etc. Consequently, the robot can reproduce consistent experiences and actions for children with communication capacity restrictions. This work is done by applying a novel approach based on deep learning and reinforcement learning algorithms supported by an ontological knowledge base that contains relevant information and knowledge about patients, screening tests, and therapies. In this study, we realized a humanoid robot that will assist a therapist by equipping the robot NAO: 1) to detect whether a child is autistic or not using a convolutional neural network, 2) to recommend a set of therapies based on a selection algorithm using a correspondence matrix between screening test and therapies, and 2) to assist and monitor autistic children by executing tasks that require those therapies.
Collapse
Affiliation(s)
- Intissar Salhi
- SSDIA, ENSET, Department of Mathematics & Computer Science, Hassan II University of Casablanca, Mohammedia, Morocco
| | - Mohammed Qbadou
- SSDIA, ENSET, Department of Mathematics & Computer Science, Hassan II University of Casablanca, Mohammedia, Morocco
- *Correspondence: Mohammed Qbadou,
| | - Soukaina Gouraguine
- SSDIA, ENSET, Department of Mathematics & Computer Science, Hassan II University of Casablanca, Mohammedia, Morocco
| | - Khalifa Mansouri
- SSDIA, ENSET, Department of Mathematics & Computer Science, Hassan II University of Casablanca, Mohammedia, Morocco
| | - Chris Lytridis
- HUman-MAchines INteraction (HUMAIN) Lab, Department of Computer Science, International Hellenic University (IHU), Kavala, Greece
| | - Vassilis Kaburlasos
- HUman-MAchines INteraction (HUMAIN) Lab, Department of Computer Science, International Hellenic University (IHU), Kavala, Greece
| |
Collapse
|
18
|
Dwyer D, Koutsouleris N. Annual Research Review: Translational machine learning for child and adolescent psychiatry. J Child Psychol Psychiatry 2022; 63:421-443. [PMID: 35040130 DOI: 10.1111/jcpp.13545] [Citation(s) in RCA: 14] [Impact Index Per Article: 4.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Accepted: 09/06/2021] [Indexed: 12/14/2022]
Abstract
Children and adolescents could benefit from the use of predictive tools that facilitate personalized diagnoses, prognoses, and treatment selection. Such tools have not yet been deployed using traditional statistical methods, potentially due to the limitations of the paradigm and the need to leverage large amounts of digital data. This review will suggest that a machine learning approach could address these challenges and is designed to introduce new readers to the background, methods, and results in the field. A rationale is first introduced followed by an outline of fundamental elements of machine learning approaches. To provide an overview of the use of the techniques in child and adolescent literature, a scoping review of broad trends is then presented. Selected studies are also highlighted in order to draw attention to research areas that are closest to translation and studies that exhibit a high degree of experimental innovation. Limitations to the research, and machine learning approaches generally, are outlined in the penultimate section highlighting issues related to sample sizes, validation, clinical utility, and ethical challenges. Finally, future directions are discussed that could enhance the possibility of clinical implementation and address specific questions relevant to the child and adolescent psychiatry. The review gives a broad overview of the machine learning paradigm in order to highlight the benefits of a shift in perspective towards practically oriented statistical solutions that aim to improve clinical care of children and adolescents.
Collapse
Affiliation(s)
- Dominic Dwyer
- Department of Psychiatry and Psychotherapy, Ludwig-Maximilian-University, Munich, Germany.,Orygen, The National Centre of Excellence in Youth Mental Health, Melbourne, Australia.,Centre for Youth Mental Health, University of Melbourne, Melbourne, Australia
| | - Nikolaos Koutsouleris
- Department of Psychiatry and Psychotherapy, Ludwig-Maximilian-University, Munich, Germany.,Max-Planck Institute of Psychiatry, Munich, Germany.,Institute of Psychiatry, Psychology and Neuroscience, King's College London, London, United Kingdom
| |
Collapse
|
19
|
Alvari G, Coviello L, Furlanello C. EYE-C: Eye-Contact Robust Detection and Analysis during Unconstrained Child-Therapist Interactions in the Clinical Setting of Autism Spectrum Disorders. Brain Sci 2021; 11:1555. [PMID: 34942856 PMCID: PMC8699076 DOI: 10.3390/brainsci11121555] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/25/2021] [Revised: 11/04/2021] [Accepted: 11/19/2021] [Indexed: 12/26/2022] Open
Abstract
The high level of heterogeneity in Autism Spectrum Disorder (ASD) and the lack of systematic measurements complicate predicting outcomes of early intervention and the identification of better-tailored treatment programs. Computational phenotyping may assist therapists in monitoring child behavior through quantitative measures and personalizing the intervention based on individual characteristics; still, real-world behavioral analysis is an ongoing challenge. For this purpose, we designed EYE-C, a system based on OpenPose and Gaze360 for fine-grained analysis of eye-contact episodes in unconstrained therapist-child interactions via a single video camera. The model was validated on video data varying in resolution and setting, achieving promising performance. We further tested EYE-C on a clinical sample of 62 preschoolers with ASD for spectrum stratification based on eye-contact features and age. By unsupervised clustering, three distinct sub-groups were identified, differentiated by eye-contact dynamics and a specific clinical phenotype. Overall, this study highlights the potential of Artificial Intelligence in categorizing atypical behavior and providing translational solutions that might assist clinical practice.
Collapse
Affiliation(s)
- Gianpaolo Alvari
- Department of Psychology and Cognitive Sciences, University of Trento, Corso Bettini 84, 38068 Rovereto, Italy
- DSH Research Unit, Bruno Kessler Foundation, Via Sommarive 8, 38123 Trento, Italy
| | - Luca Coviello
- University of Trento, 38122 Trento, Italy;
- Enogis, Via al Maso Visintainer 8, 38122 Trento, Italy
| | - Cesare Furlanello
- HK3 Lab, Piazza Manifatture 1, 38068 Rovereto, Italy;
- Orobix Life, Via Camozzi 145, 24121 Bergamo, Italy
| |
Collapse
|
20
|
Brief Report: Specificity of Interpersonal Synchrony Deficits to Autism Spectrum Disorder and Its Potential for Digitally Assisted Diagnostics. J Autism Dev Disord 2021; 52:3718-3726. [PMID: 34331629 PMCID: PMC9296396 DOI: 10.1007/s10803-021-05194-3] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 07/08/2021] [Indexed: 11/18/2022]
Abstract
Reliably diagnosing autism spectrum disorders (ASD) in adulthood poses a challenge to clinicians due to the absence of specific diagnostic markers. This study investigated the potential of interpersonal synchrony (IPS), which has been found to be reduced in ASD, to augment the diagnostic process. IPS was objectively assessed in videos of diagnostic interviews in a representative referral population from two specialized autism outpatient clinics. In contrast to the current screening tools that could not reliably differentiate, we found a significant reduction of IPS in interactions with individuals later diagnosed with ASD (n = 16) as opposed to those not receiving a diagnosis (n = 23). While these findings need to be validated in larger samples, they nevertheless underline the potential of digitally-enhanced diagnostic processes for ASD.
Collapse
|
21
|
Erden YJ, Hummerstone H, Rainey S. Automating autism assessment: What AI can bring to the diagnostic process. J Eval Clin Pract 2021; 27:485-490. [PMID: 33331145 PMCID: PMC8246862 DOI: 10.1111/jep.13527] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/18/2020] [Revised: 11/03/2020] [Accepted: 11/13/2020] [Indexed: 01/03/2023]
Abstract
This paper examines the use of artificial intelligence (AI) for the diagnosis of autism spectrum disorder (ASD, hereafter autism). In so doing we examine some problems in existing diagnostic processes and criteria, including issues of bias and interpretation, and on concepts like the 'double empathy problem'. We then consider how novel applications of AI might contribute to these contexts. We're focussed specifically on adult diagnostic procedures as childhood diagnosis is already well covered in the literature.
Collapse
Affiliation(s)
- Yasemin J Erden
- Department of Philosophy, University of Twente, Enschede, The Netherlands
| | | | | |
Collapse
|
22
|
Zhang S, Chen D, Tang Y, Zhang L. Children ASD Evaluation Through Joint Analysis of EEG and Eye-Tracking Recordings With Graph Convolution Network. Front Hum Neurosci 2021; 15:651349. [PMID: 34113244 PMCID: PMC8185139 DOI: 10.3389/fnhum.2021.651349] [Citation(s) in RCA: 14] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/09/2021] [Accepted: 03/19/2021] [Indexed: 11/13/2022] Open
Abstract
Recent advances in neuroscience indicate that analysis of bio-signals such as rest state electroencephalogram (EEG) and eye-tracking data can provide more reliable evaluation of children autism spectrum disorder (ASD) than traditional methods of behavior measurement relying on scales do. However, the effectiveness of the new approaches still lags behind the increasing requirement in clinical or educational practices as the “bio-marker” information carried by the bio-signal of a single-modality is likely insufficient or distorted. This study proposes an approach to joint analysis of EEG and eye-tracking for children ASD evaluation. The approach focuses on deep fusion of the features in two modalities as no explicit correlations between the original bio-signals are available, which also limits the performance of existing methods along this direction. First, the synchronization measures, information entropy, and time-frequency features of the multi-channel EEG are derived. Then a random forest applies to the eye-tracking recordings of the same subjects to single out the most significant features. A graph convolutional network (GCN) model then naturally fuses the two group of features to differentiate the children with ASD from the typically developed (TD) subjects. Experiments have been carried out on the two types of the bio-signals collected from 42 children (21 ASD and 21 TD subjects, 3–6 years old). The results indicate that (1) the proposed approach can achieve an accuracy of 95% in ASD detection, and (2) strong correlations exist between the two bio-signals collected even asynchronously, in particular the EEG synchronization against the face related/joint attentions in terms of covariance.
Collapse
Affiliation(s)
- Shasha Zhang
- School of Computer Science, Wuhan University, Wuhan, China
| | - Dan Chen
- School of Computer Science, Wuhan University, Wuhan, China
| | - Yunbo Tang
- School of Computer Science, Wuhan University, Wuhan, China
| | - Lei Zhang
- School of Computer Science, Wuhan University, Wuhan, China
| |
Collapse
|
23
|
|
24
|
Bloch C, Vogeley K, Georgescu AL, Falter-Wagner CM. INTRApersonal Synchrony as Constituent of INTERpersonal Synchrony and Its Relevance for Autism Spectrum Disorder. Front Robot AI 2019; 6:73. [PMID: 33501088 PMCID: PMC7805712 DOI: 10.3389/frobt.2019.00073] [Citation(s) in RCA: 20] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/22/2019] [Accepted: 07/30/2019] [Indexed: 11/13/2022] Open
Abstract
INTERpersonal synchrony leads to increased empathy, rapport and understanding, enabling successful human-human interactions and reciprocal bonding. Research shows that individuals with Autism Spectrum Disorder (ASD) exhibit difficulties to INTERpersonally synchronize but underlying causes are yet unknown. In order to successfully synchronize with others, INTRApersonal synchronization of communicative signals appears to be a necessary prerequisite. We understand INTRApersonal synchrony as an implicit factor of INTERpersonal synchrony and therefore hypothesize that atypicalities of INTRApersonal synchrony may add to INTERpersonal synchrony problems in ASD and their interaction partners. In this perspective article, we first review evidence for INTERpersonal dissynchrony in ASD, with respect to different approaches and assessment methods. Second, we draft a theoretical conceptualization of INTRApersonal dissynchrony in ASD based on a temporal model of human interaction. We will outline literature indicating INTRApersonal dissynchrony in ASD, therefore highlighting findings of atypical timing functions and findings from clinical and behavioral studies that indicate peculiar motion patterns and communicative signal production in ASD. Third, we hypothesize that findings from these domains suggest an assessment and investigation of temporal parameters of social behavior in individuals with ASD. We will further propose specific goals of empirical approaches on INTRApersonal dissynchrony. Finally we present implications of research on INTRApersonal timing in ASD for diagnostic and therapeutic purposes, what in our opinion warrants the increase of research efforts in this domain.
Collapse
Affiliation(s)
- Carola Bloch
- Department of Psychiatry and Psychotherapy, Medical Faculty, University of Cologne, Cologne, Germany
- Department of Psychiatry and Psychotherapy, Medical Faculty, Ludwig-Maximilians-University, Munich, Germany
| | - Kai Vogeley
- Department of Psychiatry and Psychotherapy, Medical Faculty, University of Cologne, Cologne, Germany
- Institute of Neuroscience and Medicine (INM3), Research Center Jülich, Jülich, Germany
| | - Alexandra L. Georgescu
- Department of Psychology, Institute of Psychiatry, Psychology and Neuroscience, King's College London, London, United Kingdom
| | - Christine M. Falter-Wagner
- Department of Psychiatry and Psychotherapy, Medical Faculty, Ludwig-Maximilians-University, Munich, Germany
- Department of Psychology, Faculty of Human Science, University of Cologne, Cologne, Germany
| |
Collapse
|