1
|
Idris S, Ten Hoeve FHF, Ratto AB, White SW, van Haren N, Greaves-Lord K. Psychometric Properties of the Dutch Contextual Assessment of Social Skills (CASS): An Independent Observational Outcome Measure of Social Skills in Autistic Adolescents. J Autism Dev Disord 2024; 54:4596-4609. [PMID: 37950775 PMCID: PMC11549137 DOI: 10.1007/s10803-023-06156-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 10/05/2023] [Indexed: 11/13/2023]
Abstract
The goal of this study was to translate and adapt the original 9-item of the Contextual Assessment of Social Skills (CASS) to a Dutch version and assess its psychometric qualities. Autistic adolescents aged 12 to 18 years (n = 99) took part in a randomized controlled trial. In this study, pre-intervention data were utilized. The original CASS was adapted to ensure cultural relevance and the content validity was assessed. Data was used to assess reliability and structural validity, using confirmatory factor analysis. 4-item were added to the CASS during the adaptation to better align with the objectives of the experimental intervention. The original 9-item had inter-item correlations between .01 and .70. The Cronbach's alpha for the original 4-item total score was moderate (α = .69), while for a 7-item total score, it was high (α = .86). This 7-item total score had a sufficient model fit (Comparative Fit Index = .90). This total score had a significant correlation with the Assertion subscale of the Social Skills Improvement System-Adolescent (SSIS-A) (r = 0.26, p < .01), and the Social Responsiveness Scale-2 (SRS-2) total score (r = - .21, p = .04) indicating sufficient convergent validity. The CASS total score was not correlated with the Repetitive and Restricted Behavior scale of the SRS-2 (r = - .08, p = .43), indicating sufficient divergent validity. The Dutch CASS can be considered a conceptually sound and reliable observational instrument for assessing social conversational skills in Dutch autistic youth. Further evaluation of its feasibility when implemented in practice, outside of clinical research, is needed.Trial registration: Dutch trail register NTR6255 (NL6117) 08/02/2017 https://www.trialregister.nl/trial/6117.
Collapse
Affiliation(s)
- Sakinah Idris
- Department of Child and Adolescent Psychiatry/Psychology, Erasmus MC-Sophia, Wytemaweg 8, 3015 CN, Rotterdam, The Netherlands
- Department of Psychiatry, Faculty of Medicine, Universiti Teknologi MARA, Jalan Hospital, 47000, Sungai Buloh, Selangor, Malaysia
| | - Femke H F Ten Hoeve
- Yulius Organization for Mental Health, Burg. De Raadtsingel 93c, 3311 JG, Dordrecht, The Netherlands
| | - Allison B Ratto
- Division of Pediatric Neuropsychology, Center for Autism Spectrum Disorders, Children's National Hospital, 15245 Shady Grove Road, Rockville, MD, USA
| | - Susan W White
- Department of Psychology, The University of Alabama, Tuscaloosa, AL, 35487, USA
| | - Neeltje van Haren
- Department of Child and Adolescent Psychiatry/Psychology, Erasmus MC-Sophia, Wytemaweg 8, 3015 CN, Rotterdam, The Netherlands
| | - Kirstin Greaves-Lord
- Department of Child and Adolescent Psychiatry/Psychology, Erasmus MC-Sophia, Wytemaweg 8, 3015 CN, Rotterdam, The Netherlands.
- Department of Psychology, Clinical Psychology and Experimental Psychopathology Unit, University of Groningen, Groningen, The Netherlands.
- Autism Team Northern-Netherlands, Jonx, Department of (Youth) Mental Health and Autism of Lentis Psychiatric Institute Groningen, Groningen, The Netherlands.
- Yulius Organization for Mental Health, Burg. De Raadtsingel 93c, 3311 JG, Dordrecht, The Netherlands.
| |
Collapse
|
2
|
Liu MH, Chiang FM, Chen CT, Yang HC, Chen KL. Development and Psychometric Examination of a New Social Competence Outcome Measure for Children with Autism Spectrum Disorder: The Observational Social Competence Assessment. J Autism Dev Disord 2024:10.1007/s10803-024-06472-6. [PMID: 39066969 DOI: 10.1007/s10803-024-06472-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 07/05/2024] [Indexed: 07/30/2024]
Abstract
Current assessments of social competence for children with autism spectrum disorder (ASD) are mostly designed for screening or diagnosis, not for measuring outcomes. This study aimed to develop a professional-administrated outcome measure, the Observational Social Competence Assessment (OSCA), and examine its psychometric properties. The OSCA was constructed based on a multidimensional view of social competence (i.e., social skill elements, social reciprocity, and social adjustment). For psychometric evaluation, 89 children with ASD between 3 and 12 years (mean = 70.69 months, SD = 15.31) were assessed with the OSCA and with assessments of ASD symptoms, verbal comprehension ability, and adaptive function. The results show that the OSCA has good internal consistency (Cronbach's α = 0.820-0.954), test-retest reliability (intraclass correlation coefficients [ICC] = 0.917-0.960), and inter-rater reliability (ICC = 0.905-0.974). The OSCA also has good convergent (r = 0.508-0.703, p < 0.01) and divergent validity (r = 0.105, p = 0.496), as well as good responsiveness to changes in the social adjustment dimension (Cohen's d = 1.26 and standardized response mean [SRM] = 1.92). Conclusively, these results show that the OSCA is sufficiently reliable, valid and responsive to be applied as an outcome measure of social competence in children with ASD.
Collapse
Affiliation(s)
- Ming-Hsuan Liu
- Department of Occupational Therapy, College of Medicine, National Cheng Kung University, Tainan City, Taiwan
- Department of Physical Medicine and Rehabilitation, Ton-Yen General Hospital, Hsinchu, Taiwan
| | - Fu-Mei Chiang
- Department of Physical Medicine and Rehabilitation, National Taiwan University Hospital, National Taiwan University College of Medicine, Taipei, Taiwan
| | - Cheng-Te Chen
- Department of Educational Psychology and Counseling, Center for Teacher Education, National Tsing Hua University, Hsinchu, Taiwan
| | - Hsiu-Ching Yang
- Department of Occupational Therapy, College of Medicine, National Cheng Kung University, Tainan City, Taiwan
- Department of Physical Medicine and Rehabilitation, College of Medicine, National Cheng Kung University Hospital, National Cheng Kung University, Tainan, Taiwan
| | - Kuan-Lin Chen
- Department of Occupational Therapy, College of Medicine, National Cheng Kung University, Tainan City, Taiwan.
- Department of Physical Medicine and Rehabilitation, College of Medicine, National Cheng Kung University Hospital, National Cheng Kung University, Tainan, Taiwan.
- Institute of Allied Health Sciences, National Cheng Kung University, Tainan, Taiwan.
| |
Collapse
|
3
|
Byrne K, Sterrett K, Holbrook A, Kim SH, Grzadzinski R, Lord C. Extending the Usefulness of the Brief Observation of Social Communication Change (BOSCC): Validating the Phrase Speech and Young Fluent Version. J Autism Dev Disord 2024; 54:1009-1023. [PMID: 36547793 PMCID: PMC9772597 DOI: 10.1007/s10803-022-05877-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 12/13/2022] [Indexed: 12/24/2022]
Abstract
The current study investigated the utility of the Brief Observation of Social Communication Change-Phrase Speech Young Fluent (BOSCC-PSYF) as an outcome measure of treatment response by analyzing the measure's psychometric properties and initial validity. The BOSCC coding scheme was applied to 345 administrations from 160 participants diagnosed with autism. Participants included individuals of any age with phrase speech, or individuals under the age of 8 years with complex sentences. All were receiving behavioral intervention throughout the study. Test-retest and inter-rater reliability were good for the Early Communication and Social Reciprocity/Language domains, and fair for the Restricted and Repetitive Behavior domain. Significant changes occurred over time in the Early Communication and Social Reciprocity/Language domains, and Core Total scores. The BOSCC-PSYF may provide a low-cost, flexible, and user-friendly outcome measure that reliably measures changes in broad social communicative behaviors in a short period of time.
Collapse
Affiliation(s)
| | - Kyle Sterrett
- University of California, Los Angeles, California, USA
| | | | | | | | | |
Collapse
|
4
|
Uzonyi TE, Crais ER, Watson LR, Nowell SW, Baranek GT, Turner-Brown LM. Measuring Transactional Engagement Among Young Children with Elevated Likelihood for Later Autism Spectrum Disorder Diagnosis. J Autism Dev Disord 2023; 53:759-775. [PMID: 34117956 DOI: 10.1007/s10803-021-05124-3] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 06/01/2021] [Indexed: 10/21/2022]
Abstract
This analytical study documented the presence of transactions in parent-child engagement within a sample of young children at an elevated likelihood for an eventual diagnosis of autism spectrum disorder (ASD). Specifically, the study examined the establishment of transactional engagement through reciprocal behaviors between parents and their young children at-risk for ASD. In the study sample, established transactional engagement occurred at a higher rate than other levels of engagement. Additionally, transactional engagement had a higher likelihood of being established when parents initiated. Post-hoc analyses revealed possible early markers of ASD within a certain behavior displayed in transactions. This study signifies the initial efforts in identifying transactions within parent-child engagement, and foremost, how transactional engagement is established.
Collapse
Affiliation(s)
- Thelma E Uzonyi
- Department of Audiology and Speech Pathology, University of Tennessee Health Science Center, 578 South Stadium Hall, Knoxville, TN, 37996, USA.
| | - Elizabeth R Crais
- Department of Allied Health Sciences, Division of Speech and Hearing Sciences, The University of North Carolina At Chapel Hill, Chapel Hill, NC, USA
| | - Linda R Watson
- Department of Allied Health Sciences, Division of Speech and Hearing Sciences, The University of North Carolina At Chapel Hill, Chapel Hill, NC, USA
| | - Sallie W Nowell
- Frank Porter Graham Child Development Institute, The University of North Carolina At Chapel Hill, Chapel Hill, NC, USA
| | - Grace T Baranek
- Mrs. T.H. Chan Division of Occupational Science and Occupational Therapy, University of Southern California, Los Angeles, CA, USA
| | - Lauren M Turner-Brown
- TEACCH Autism Program, The University of North Carolina At Chapel Hill, Chapel Hill, NC, USA
| |
Collapse
|
5
|
Brain-Computer Interface Training of mu EEG Rhythms in Intellectually Impaired Children with Autism: A Feasibility Case Series. Appl Psychophysiol Biofeedback 2023; 48:229-245. [PMID: 36607454 DOI: 10.1007/s10484-022-09576-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 12/08/2022] [Indexed: 01/07/2023]
Abstract
Prior studies show that neurofeedback training (NFT) of mu rhythms improves behavior and EEG mu rhythm suppression during action observation in children with autism spectrum disorder (ASD). However, intellectually impaired persons were excluded because of their behavioral challenges. We aimed to determine if intellectually impaired children with ASD, who were behaviorally prepared to take part in a mu-NFT study using conditioned auditory reinforcers, would show improvements in symptoms and mu suppression following mu-NFT. Seven children with ASD (ages 6-8; mean IQ 70.6 ± 7.5) successfully took part in mu-NFT. Four cases demonstrated positive learning trends (hit rates) during mu-NFT (learners), and three cases did not (non-learners). Artifact-creating behaviors were present during tests of mu suppression for all cases, but were more frequent in non-learners. Following NFT, learners showed behavioral improvements and were more likely to show evidence of a short-term increase in mu suppression relative to non-learners who showed little to no EEG or behavior improvements. Results support mu-NFT's application in some children who otherwise may not have been able to take part without enhanced behavioral preparations. Children who have more limitations in demonstrating learning during NFT, or in providing data with relatively low artifact during task-dependent EEG tests, may have less chance of benefiting from mu-NFT. Improving the identification of ideal mu-NFT candidates, mu-NFT learning rates, source analyses, EEG outcome task performance, population-specific artifact-rejection methods, and the theoretical bases of NFT protocols, could aid future BCI-based, neurorehabilitation efforts.
Collapse
|
6
|
Shaffer R, Thurman AJ, Ronco L, Cadavid D, Raines S, Kim SH. Social communication in fragile X syndrome: pilot examination of the Brief Observation of Social Communication Change (BOSCC). J Neurodev Disord 2022; 14:4. [PMID: 35034602 PMCID: PMC8903546 DOI: 10.1186/s11689-021-09411-z] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/05/2021] [Accepted: 12/08/2021] [Indexed: 12/17/2022] Open
Abstract
Background Social communication is a key area of difficulty in fragile X syndrome (FXS) and there are not yet adequate outcome measurement tools. Appropriate outcome measures for FXS have been identified as a key area of research interest in order to evaluate future therapeutic trials. The Brief Observation of Social Communication Change-Minimally Verbal (BOSCC-MV), an outcome measure with strong psychometrics developed for autism spectrum disorder, has promise as an outcome measure to assess social communication change with FXS participants. Methods We examined the BOSCC-MV via central coders in this multi-site-trial to assess its appropriateness for FXS. Eighteen minimally verbal males ages 3–12 years were enrolled and assessed on two consecutive days and 7 participants completed a third visit 6 months later. We examined test-retest reliability, inter-rater reliability, and both convergent and divergent validity with standard clinical measures including the Autism Diagnostic and Observation Schedule-2, Vineland 3, Social Responsiveness Scale, and the Aberrant Behavior Checklist. Results The BOSCC-MV in FXS demonstrated strong inter-rater and test-retest reliability, comparable to previous trials in idiopathic ASD. Strong convergent validity was found with Autism Diagnostic Observation Schedule-2 and Vineland-3. Divergent validity was demonstrated between BOSCC-MV and unrelated measures. Conclusions The BOSCC-MV shows promise as a FXS social communication outcome measure, warranting further large-scale evaluation.
Collapse
Affiliation(s)
- Rebecca Shaffer
- Department of Pediatrics, Cincinnati Children's Hospital Medical Center, University of Cincinnati School of Medicine, 3333 Burnet Avenue, MLC 4002, Cincinnati, OH, 45229, USA.
| | - Angela John Thurman
- Department of Psychiatry and Behavioral Sciences, University of California Davis Health, MIND Institute, University of California Davis Health, Sacramento, CA, USA
| | - Lucienne Ronco
- Fulcrum Therapeutics, Cambridge, MA, USA.,Deep Genomics Therapeutics, Toronto, ON, Canada
| | - Diego Cadavid
- Fulcrum Therapeutics, Cambridge, MA, USA.,University of Massachusetts Medical School, Worcester, MA, USA
| | | | - So Hyun Kim
- Department of Psychiatry, Weill Cornell Medicine, New York, NY, USA
| |
Collapse
|
7
|
Jurek L, Baltazar M, Gulati S, Novakovic N, Núñez M, Oakley J, O’Hagan A. Response (minimum clinically relevant change) in ASD symptoms after an intervention according to CARS-2: consensus from an expert elicitation procedure. Eur Child Adolesc Psychiatry 2022; 31:1-10. [PMID: 33825947 PMCID: PMC8024930 DOI: 10.1007/s00787-021-01772-z] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/13/2020] [Accepted: 03/29/2021] [Indexed: 11/27/2022]
Abstract
The lack of consensual measures to monitor core change in Autism Spectrum Disorder (ASD) or response to interventions leads to difficulty to prove intervention efficacy on ASD core symptoms. There are no universally accepted outcome measures developed for measuring changes in core symptoms. However, the CARS (Childhood Autism Rating Scale) is one of the outcomes recommended in the EMA Guideline on the clinical development of medicinal products for the treatment of ASD. Unfortunately, there is currently no consensus on the response definition for CARS among individuals with ASD. The aim of this elicitation process was to determine an appropriate definition of a response on the CARS2 scale for interventions in patients with Autism Spectrum Disorder (ASD). An elicitation process was conducted following the Sheffield Elicitation Framework (SHELF). Five experts in the field of ASD and two experts in expert knowledge elicitation participated in an 1-day elicitation workshop. Experts in ASD were previously trained in the SHELF elicitation process and received a dossier of scientific evidence concerning the topic. The response definition was set as the mean clinically relevant improvement averaged over all patients, levels of functioning, age groups and clinicians. Based on the scientific evidence and expert judgment, a normal probability distribution was agreed to represent the state of knowledge of this response with expected value 4.03 and standard deviation 0.664. Considering the remaining uncertainty of the estimation and the available literature, a CARS-2 improvement of 4.5 points has been defined as a threshold to conclude to a response after an intervention. A CARS-2 improvement of 4.5 points could be used to evaluate interventions' meaningfulness in indivudals. This initial finding represents an important new benchmark and may aid decision makers in evaluating the efficacy of interventions in ASD.
Collapse
Affiliation(s)
- Lucie Jurek
- Child and Adolescent Psychiatry Department, Center for Assessment and Diagnostic of Autism, Le Vinatier Hospital, Bron, France.
| | - Matias Baltazar
- Child and Adolescent Psychiatry Department, Center for Assessment and Diagnostic of Autism, Le Vinatier Hospital, Bron, France
| | - Sheffali Gulati
- Centre of Excellence and Advanced Research on Childhood Neurodevelopmental Disorders, Child Neurology Division, Department of Pediatrics, All India Institute of Medical Sciences, New Delhi, India
| | - Neda Novakovic
- Day Care Centre for Children and Adolescents with Developmental Disabilities, Belgade, Serbia
| | - María Núñez
- Faculty of Psychology, Universidad Autónoma de Madrid, Campus de Cantoblanco, Madrid, Spain
| | - Jeremy Oakley
- School of Mathematics and Statistics, The University of Sheffield, Hounsfield Road, Sheffield, UK
| | - Anthony O’Hagan
- School of Mathematics and Statistics, The University of Sheffield, Hounsfield Road, Sheffield, UK
| |
Collapse
|
8
|
Bauminger-Zviely N, Shefer A. Naturalistic evaluation of preschoolers' spontaneous interactions: The Autism Peer Interaction Observation Scale. AUTISM : THE INTERNATIONAL JOURNAL OF RESEARCH AND PRACTICE 2021; 25:1520-1535. [PMID: 33626914 PMCID: PMC8323330 DOI: 10.1177/1362361321989919] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/02/2022]
Abstract
LAY ABSTRACT Peer interaction can be challenging in autism spectrum disorder, but naturalistic peer-observation scales for preschoolers are limited. This study examined the newly developed Autism Peer Interaction Observation Scale, with 17 subcategories, which evaluate naturalistic peer interaction processes in preschoolers with autism spectrum disorder and typical development. We tested the Autism Peer Interaction Observation Scale to (a) characterize peer interactions of preschoolers with autism spectrum disorder who were cognitively able versus typical age-mates, (b) explore each group's hierarchical pattern of peer interaction behaviors, and (c) identify Autism Peer Interaction Observation Scale's links with standard reports for assessing social-communication functioning (Vineland Behavior Scales, 2nd ed.), social impairment (Social Responsiveness Scale, 2nd ed.), autism severity (Autism Diagnostic Observation Schedule, 2nd ed.), and intelligence quotient (Mullen) in the cognitively able preschoolers with autism spectrum disorder group. Participants comprised 85 preschoolers (50 cognitively able preschoolers with autism spectrum disorder, intelligence quotient > 75; 35 typical). Groups were matched according to age, intelligence quotient, and maternal education. Significant group differences emerged on all Autism Peer Interaction Observation Scale categories, with the typical group showing better social-communication functioning as compared to the cognitively able preschoolers with autism spectrum disorder group. Also, in cognitively able preschoolers with autism spectrum disorder that observed as demonstrating more typical peer relations on the Autism Peer Interaction Observation Scale showed better adaptive and socialization skills on the Vineland (Vineland Behavior Scales, 2nd ed.) and fewer social atypicalities on the Social Responsiveness Scale, 2nd ed. Higher intelligence quotient scores were linked with better observed social-communication functioning (on Autism Peer Interaction Observation Scale). Few Autism Peer Interaction Observation Scale social-communicative categories significantly correlated with the Autism Diagnostic Observation Schedule, 2nd ed. Findings highlight the Autism Peer Interaction Observation Scale as differentiating the two preschooler groups and providing additional knowledge about socially communicative peer interaction in natural settings. This new tool can help personalize social-communication programs and evaluations of early intervention outcomes, thereby leading to a fuller picture of these young children's functioning.
Collapse
|
9
|
West R, Silverman MJ. Social Skills Instruments for Children with Autism Spectrum Disorder: A Critical Interpretive Synthesis. J Music Ther 2021; 58:121-154. [PMID: 33245342 DOI: 10.1093/jmt/thaa017] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/14/2022]
Abstract
Identifying and critically analyzing the most frequently used social skills psychometric instruments (SSPI) for children with autism spectrum disorder (ASD) can inform future music therapy research and clinical practice. Therefore, the initial purpose of this critical interpretive synthesis was to identify the SSPI most frequently used as dependent measures in the Journal of Autism and Developmental Disorders (JADD) for children with ASD from 2012 to 2018. Results indicated that the Social Responsiveness Scale (n = 35), Autism Diagnostic Observation Schedule (n = 19), and Vineland Adaptive Behavior Scales (n = 15) were the most frequently used instruments. Congruent with critical interpretive synthesis methodology, we then identified the psychometric properties and advantages and disadvantages of the 9 most commonly used instruments. To compare these results with the existing music therapy literature, we also identified nonmusical SSPI used as dependent measures in music therapy research for children with ASD in studies published between 2012 and 2018. In comparing the data sets, music therapy researchers used 5 of the 9 SSPI we identified from our JADD review. Understanding frequently used SSPI has applications for consultation and communication with other professionals as well as how future music therapy research is conducted. Implications for clinical practice, limitations of the study, and suggestions for future research are provided.
Collapse
|
10
|
Carruthers S, Charman T, El Hawi N, Kim YA, Randle R, Lord C, Pickles A. Utility of the Autism Diagnostic Observation Schedule and the Brief Observation of Social and Communication Change for Measuring Outcomes for a Parent-Mediated Early Autism Intervention. Autism Res 2020; 14:411-425. [PMID: 33274842 PMCID: PMC7898818 DOI: 10.1002/aur.2449] [Citation(s) in RCA: 13] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/02/2020] [Revised: 11/03/2020] [Accepted: 11/21/2020] [Indexed: 12/14/2022]
Abstract
Measuring outcomes for autistic children following social communication interventions is an ongoing challenge given the heterogeneous changes, which can be subtle. We tested and compared the overall and item-level intervention effects of the Brief Observation of Social Communication Change (BOSCC), Autism Diagnostic Observation Schedule (ADOS-2) algorithm, and ADOS-2 Calibrated Severity Scores (CSS) with autistic children aged 2-5 years from the Preschool Autism Communication Trial (PACT). The BOSCC was applied to Module 1 ADOS assessments (ADOS-BOSCC). Among the 117 children using single or no words (Module 1), the ADOS-BOSCC, ADOS algorithm, and ADOS CSS each detected small non-significant intervention effects. However, on the ADOS algorithm, there was a medium significant intervention effect for children with "few to no words" at baseline, while children with "some words" showed little intervention effect. For the full PACT sample (including ADOS Module 2, total n=152), ADOS metrics evidenced significant small (CSS) and medium (algorithm) overall intervention effects. None of the Module 1 item-level intervention effects reached significance, with largest changes observed for Gesture (ADOS-BOSCC and ADOS), Facial Expressions (ADOS), and Intonation (ADOS). Significant ADOS Module 2 item-level effects were observed for Mannerisms and Repetitive Interests and Stereotyped Behaviors. Despite strong psychometric properties, the ADOS-BOSCC was not more sensitive to behavioral changes than the ADOS among Module 1 children. Our results suggest the ADOS can be a sensitive outcome measure. Item-level intervention effect plots have the potential to indicate intervention "signatures of change," a concept that may be useful in future trials and systematic reviews. LAY SUMMARY: This study compares two outcome measures in a parent-mediated therapy. Neither was clearly better or worse than the other; however, the Autism Diagnostic Observation Schedule produced somewhat clearer evidence than the Brief Observation of Social Communication Change of improvement among children who had use of "few to no" words at the start. We explore which particular behaviors are associated with greater improvement. These findings can inform researchers when they consider how best to explore the impact of their intervention.
Collapse
Affiliation(s)
- Sophie Carruthers
- Department of Psychology, Institute of Psychology, Psychiatry and Neuroscience, King's College London, London, UK
| | - Tony Charman
- Department of Psychology, Institute of Psychology, Psychiatry and Neuroscience, King's College London, London, UK.,National & Specialist Services, Child & Adolescent Mental Health Services Directorate, South London and Maudsley NHS Foundation Trust, London, UK
| | - Nicole El Hawi
- Department of Psychology, Institute of Psychology, Psychiatry and Neuroscience, King's College London, London, UK
| | - Young Ah Kim
- Department of Psychology, Institute of Psychology, Psychiatry and Neuroscience, King's College London, London, UK
| | - Rachel Randle
- Department of Psychology, Institute of Psychology, Psychiatry and Neuroscience, King's College London, London, UK
| | - Catherine Lord
- Department of Psychiatry, University of California, Los Angeles, California, USA
| | - Andrew Pickles
- Department of Biostatistics and Health Informatics, Institute of Psychology, Psychiatry and Neuroscience, King's College London, London, UK
| | | |
Collapse
|
11
|
Abstract
The Autism Impact Measure (AIM) was designed to track incremental change in frequency and impact of core ASD symptoms. The current study examined the structural and convergent validity of the AIM in a large sample of children with ASD. The results of a series of exploratory and confirmatory factor analyses yielded a final model with five theoretically and empirically meaningful subdomains: Repetitive Behavior, Atypical Behavior, Communication, Social Reciprocity, and Peer Interaction. The final model showed very good fit both overall and for each of the five factors, indicating excellent structural validity. AIM subdomain scores were significantly correlated with measures of similar constructs across all five domains. The results provide further support for the psychometric properties of the AIM.
Collapse
|
12
|
Grzadzinski R, Janvier D, Kim SH. Recent Developments in Treatment Outcome Measures for Young Children With Autism Spectrum Disorder (ASD). Semin Pediatr Neurol 2020; 34:100806. [PMID: 32446440 PMCID: PMC7248125 DOI: 10.1016/j.spen.2020.100806] [Citation(s) in RCA: 20] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/09/2023]
Abstract
Significant advancements have been made in early intervention programs for children with Autism spectrum disorder (ASD). However, measuring treatment response for children with ASD is difficult due to the heterogeneity of changes in symptoms, which can be subtle, especially over a short period of time. Here we outline the challenge of evaluating treatment response with currently available measures as well as newly developed or refined measures that may be useful in clinical trials for young children with ASD. Continued development of treatment outcome measures will help the field identify and compare efficacious interventions and tailor treatments for children with ASD.
Collapse
Affiliation(s)
- Rebecca Grzadzinski
- University of North Carolina, Carolina Institute for Developmental Disabilities, Chapel Hill, NC.
| | - Denisse Janvier
- Center for Autism and the Developing Brain, Weill Cornell Medical College, New York-Presbyterian Hospital, White Plains, NY
| | - So Hyun Kim
- Center for Autism and the Developing Brain, Weill Cornell Medical College, New York-Presbyterian Hospital, White Plains, NY
| |
Collapse
|
13
|
Kim SH, Grzadzinski R, Martinez K, Lord C. Measuring treatment response in children with autism spectrum disorder: Applications of the Brief Observation of Social Communication Change to the Autism Diagnostic Observation Schedule. AUTISM : THE INTERNATIONAL JOURNAL OF RESEARCH AND PRACTICE 2019; 23:1176-1185. [PMID: 30303398 PMCID: PMC6522321 DOI: 10.1177/1362361318793253] [Citation(s) in RCA: 23] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/22/2023]
Abstract
This study aims to determine the validity and reliability of applying the coding strategy from the Brief Observation of Social Communication Change, a newly validated treatment outcome measure, to videotaped segments of the Autism Diagnostic Observation Schedule. Results indicate strong reliability and validity of the Brief Observation of Social Communication Change ratings using the Autism Diagnostic Observation Schedule segments in detecting changes in social communication over the course of treatment in young, minimally verbal children with autism spectrum disorder. Results also suggest that the Brief Observation of Social Communication Change, when applied to Autism Diagnostic Observation Schedule segments, may be more sensitive in detecting subtle changes in social communication compared to the Autism Diagnostic Observation Schedule Calibrated Severity Scores. These results may support the application of the Brief Observation of Social Communication Change to pre-existing datasets of Autism Diagnostic Observation Schedule videos to examine treatment responses.
Collapse
Affiliation(s)
- So Hyun Kim
- 1 Weill Cornell Medicine, White Plains, NY, USA
| | - Rebecca Grzadzinski
- 2 Teachers College, Columbia University, New York, NY, USA
- 3 Carolina Institute for Developmental Disabilities, University of North Carolina at Chapel Hill, NC, USA
| | | | | |
Collapse
|
14
|
The Scientific Study of Parents and Caregivers of Children with ASD: A Flourishing Field but Still Work to be Done. J Autism Dev Disord 2019; 48:976-979. [PMID: 29502150 DOI: 10.1007/s10803-018-3526-9] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/17/2022]
Abstract
There is a long history of research on parents and caregivers of individuals within autism. Parents and other primary caregivers typically play the most important part in the lives of persons with ASD although the need for support as the child becomes of age varies widely. This special issue includes 30 articles on central areas related to parenting and caregiving for people with ASD. Some of the key themes include intervention and training, mental health issues related to parent and family stress, measurement and assessment, and parent-child transactional processes. Other articles in this issue consider different but equally important topics such as sibling as potential future caregivers and parent support of preschool peer relationships.
Collapse
|
15
|
Bradshaw J, Shic F, Holden AN, Horowitz EJ, Barrett AC, German TC, Vernon TW. The Use of Eye Tracking as a Biomarker of Treatment Outcome in a Pilot Randomized Clinical Trial for Young Children with Autism. Autism Res 2019; 12:779-793. [PMID: 30891960 DOI: 10.1002/aur.2093] [Citation(s) in RCA: 37] [Impact Index Per Article: 6.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/17/2018] [Revised: 02/07/2019] [Accepted: 02/22/2019] [Indexed: 11/06/2022]
Abstract
There is a pressing need for objective, quantifiable outcome measures in intervention trials for children with autism spectrum disorder (ASD). The current study investigated the use of eye tracking as a biomarker of treatment response in the context of a pilot randomized clinical trial of treatment for young children with ASD. Participants included 28 children with ASD, aged 18-48 months, who were randomized to one of two conditions: Pivotal Response Intervention for Social Motivation (PRISM) or community treatment as usual (TAU). Eye-tracking and behavioral assessment of developmental functioning were administered at Time 1 (prior to randomization) and at Time 2 (after 6 months of intervention). Two well-established eye-tracking paradigms were used to measure social attention: social preference and face scanning. As a context for understanding relationships between social attention and developmental ability, we first examined how scanning patterns at Time 1 were associated with concurrent developmental functioning and compared to those of 23 age-matched typically developing (TD) children. Changes in scanning patterns from Time 1 to Time 2 were then compared between PRISM and TAU groups and associated with behavioral change over time. Results showed that the social preference paradigm differentiated children with ASD from TD children. In addition, attention during face scanning was associated with language and adaptive communication skills at Time 1 and change in language skills from Time 1 to Time 2. These findings highlight the importance of examining targeted biomarkers that measure unique aspects of child functioning and that are well-matched to proposed mechanisms of change. Autism Research 2019, 12: 779-793. © 2019 International Society for Autism Research, Wiley Periodicals, Inc. LAY SUMMARY: Biomarkers have the potential to provide important information about how and why early interventions effect positive change for young children with ASD. The current study suggests that eye-tracking measures of social attention can be used to track change in specific areas of development, such as language, and points to the need for targeted eye-tracking paradigms designed to measure specific behavioral changes. Such biomarkers could inform the development of optimal, individualized, and adaptive interventions for young children with ASD.
Collapse
Affiliation(s)
- Jessica Bradshaw
- Department of Psychology, University of South Carolina, Columbia, South Carolina
| | - Frederick Shic
- Center for Child Health, Behavior and Development, Seattle Children's Research Institute, Seattle, Washington.,Department of Pediatrics, University of Washington, Seattle, Washington
| | - Anahita N Holden
- Department of Counseling, Clinical, and School Psychology, University of California Santa Barbara, Santa Barbara, California
| | - Erin J Horowitz
- Department of Psychological and Brain Sciences, University of California Santa Barbara, Santa Barbara, California
| | - Amy C Barrett
- Department of Counseling, Clinical, and School Psychology, University of California Santa Barbara, Santa Barbara, California
| | - Tamsin C German
- Department of Psychological and Brain Sciences, University of California Santa Barbara, Santa Barbara, California
| | - Ty W Vernon
- Department of Counseling, Clinical, and School Psychology, University of California Santa Barbara, Santa Barbara, California
| |
Collapse
|
16
|
Ko JA, Miller AR, Vernon TW. Social conversation skill improvements associated with the Social Tools And Rules for Teens program for adolescents with autism spectrum disorder: Results of a randomized controlled trial. AUTISM : THE INTERNATIONAL JOURNAL OF RESEARCH AND PRACTICE 2018; 23:1224-1235. [DOI: 10.1177/1362361318808781] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Affiliation(s)
- Jordan A Ko
- University of California, Santa Barbara, USA
| | | | - Ty W Vernon
- University of California, Santa Barbara, USA
| |
Collapse
|
17
|
Rabin SJ, Israel-Yaacov S, Laugeson EA, Mor-Snir I, Golan O. A randomized controlled trial evaluating the Hebrew adaptation of the PEERS®
intervention: Behavioral and questionnaire-based outcomes. Autism Res 2018; 11:1187-1200. [DOI: 10.1002/aur.1974] [Citation(s) in RCA: 25] [Impact Index Per Article: 3.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/28/2017] [Revised: 04/05/2018] [Accepted: 05/03/2018] [Indexed: 11/10/2022]
Affiliation(s)
- Shai Joseph Rabin
- Department of Psychology, Faculty of Social Sciences; Bar-Ilan University; Ramat Gan, 5290002 Israel
| | - Sandra Israel-Yaacov
- Department of Psychology, Faculty of Social Sciences; Bar-Ilan University; Ramat Gan, 5290002 Israel
- Association for Children at Risk. 13 Gush Etzion st; Givat-Shmuel Israel
| | - Elizabeth A. Laugeson
- Semel Institute for Neuroscience and Human Behavior; University of California Los Angeles; Los Angeles, CA 90024
| | - Irit Mor-Snir
- Association for Children at Risk. 13 Gush Etzion st; Givat-Shmuel Israel
| | - Ofer Golan
- Department of Psychology, Faculty of Social Sciences; Bar-Ilan University; Ramat Gan, 5290002 Israel
- Association for Children at Risk. 13 Gush Etzion st; Givat-Shmuel Israel
| |
Collapse
|
18
|
Grzadzinski R, Carr T, Colombi C, McGuire K, Dufek S, Pickles A, Lord C. Measuring Changes in Social Communication Behaviors: Preliminary Development of the Brief Observation of Social Communication Change (BOSCC). J Autism Dev Disord 2017; 46:2464-79. [PMID: 27062034 DOI: 10.1007/s10803-016-2782-9] [Citation(s) in RCA: 127] [Impact Index Per Article: 15.9] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/17/2022]
Abstract
Psychometric properties and initial validity of the Brief Observation of Social Communication Change (BOSCC), a measure of treatment-response for social-communication behaviors, are described. The BOSCC coding scheme is applied to 177 video observations of 56 young children with ASD and minimal language abilities. The BOSCC has high to excellent inter-rater and test-retest reliability and shows convergent validity with measures of language and communication skills. The BOSCC Core total demonstrates statistically significant amounts of change over time compared to a no change alternative while the ADOS CSS over the same period of time did not. This work is a first step in the development of a novel outcome measure for social-communication behaviors with applications to clinical trials and longitudinal studies.
Collapse
Affiliation(s)
- Rebecca Grzadzinski
- Center for Autism and the Developing Brain, Weill Cornell Medical College, New York-Presbyterian Hospital, 21 Bloomingdale Road, Rogers Building, White Plains, NY, 10605, USA
- Teachers College, Columbia University, New York, NY, USA
| | - Themba Carr
- Center for Autism Research and Treatment, Semel Institute for Neuroscience and Human Behavior, University of California, Los Angeles, CA, USA
| | | | - Kelly McGuire
- Center for Autism and Developmental Disorders, Maine Behavioral Health Care, South Portland, ME, USA
- New York Presbyterian Hospital, Columbia University Medical Center and New York State Psychiatric Institute, New York, NY, USA
| | - Sarah Dufek
- Center for Autism and the Developing Brain, Weill Cornell Medical College, New York-Presbyterian Hospital, 21 Bloomingdale Road, Rogers Building, White Plains, NY, 10605, USA
| | - Andrew Pickles
- Institute of Psychiatry, Psychology and Neuroscience, Kings College London, London, UK
| | - Catherine Lord
- Center for Autism and the Developing Brain, Weill Cornell Medical College, New York-Presbyterian Hospital, 21 Bloomingdale Road, Rogers Building, White Plains, NY, 10605, USA.
| |
Collapse
|
19
|
Pijl MKJ, Rommelse NNJ, Hendriks M, De Korte MWP, Buitelaar JK, Oosterling IJ. Does the Brief Observation of Social Communication Change help moving forward in measuring change in early autism intervention studies? AUTISM : THE INTERNATIONAL JOURNAL OF RESEARCH AND PRACTICE 2016; 22:216-226. [DOI: 10.1177/1362361316669235] [Citation(s) in RCA: 12] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/30/2022]
Abstract
The field of early autism research is in dire need of outcome measures that adequately reflect subtle changes in core autistic behaviors. This article compares the ability of a newly developed measure, the Brief Observation of Social Communication Change (BOSCC), and the Autism Diagnostic Observation Schedule (ADOS) to detect changes in core symptoms of autism in 44 toddlers. The results provide encouraging evidence for the Brief Observation of Social Communication Change as a candidate outcome measure, as reflected in sufficient inter- and intra-rater reliability, independency from other child characteristics, and sensitivity to capture change. Although the Brief Observation of Social Communication Change did not evidently outperform the Autism Diagnostic Observation Schedule on any of these quality criteria, the instrument may be better able to capture subtle, individual changes in core autistic symptoms. The promising findings warrant further study of this new instrument.
Collapse
Affiliation(s)
- Mirjam KJ Pijl
- Karakter Child and Adolescent Psychiatry University Centre, Nijmegen, The Netherlands
- Radboud University Medical Centre, Nijmegen, The Netherlands
| | - Nanda NJ Rommelse
- Karakter Child and Adolescent Psychiatry University Centre, Nijmegen, The Netherlands
- Radboud University Medical Centre, Nijmegen, The Netherlands
| | - Monica Hendriks
- Karakter Child and Adolescent Psychiatry University Centre, Nijmegen, The Netherlands
- Radboud University Medical Centre, Nijmegen, The Netherlands
| | - Manon WP De Korte
- Karakter Child and Adolescent Psychiatry University Centre, Nijmegen, The Netherlands
- Radboud University Medical Centre, Nijmegen, The Netherlands
| | - Jan K Buitelaar
- Karakter Child and Adolescent Psychiatry University Centre, Nijmegen, The Netherlands
- Radboud University Medical Centre, Nijmegen, The Netherlands
| | - Iris J Oosterling
- Karakter Child and Adolescent Psychiatry University Centre, Nijmegen, The Netherlands
- Radboud University Medical Centre, Nijmegen, The Netherlands
| |
Collapse
|
20
|
Santhanam SP, Hewitt LE. Evidence-based assessment and autism spectrum disorders: A scoping review. ACTA ACUST UNITED AC 2016. [DOI: 10.1080/17489539.2016.1153814] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/22/2022]
|
21
|
Parent- and Self-Reported Social Skills Importance in Autism Spectrum Disorder. J Autism Dev Disord 2015; 46:273-286. [DOI: 10.1007/s10803-015-2574-7] [Citation(s) in RCA: 9] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/23/2022]
|
22
|
Ngounou Wetie AG, Wormwood KL, Charette L, Ryan JP, Woods AG, Darie CC. Comparative two-dimensional polyacrylamide gel electrophoresis of the salivary proteome of children with autism spectrum disorder. J Cell Mol Med 2015; 19:2664-78. [PMID: 26290361 PMCID: PMC4627571 DOI: 10.1111/jcmm.12658] [Citation(s) in RCA: 29] [Impact Index Per Article: 2.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/09/2015] [Accepted: 06/23/2015] [Indexed: 01/03/2023] Open
Abstract
In the last decades, prevalence of autism spectrum disorder (ASD) has been on the rise. However, clear aetiology is still elusive and improvements in early diagnosis are needed. To uncover possible biomarkers present in ASD, we used two-dimensional polyacrylamide gel electrophoresis and nanoliquid chromatography-tandem mass spectrometry (nanoLC-MS/MS), to compare salivary proteome profiling of children with ASD and controls. A total of 889 spots were compared and only those spots with a fold change ≥1.7 and a P-value <0.05 or a fold change of ≥3.0 between ASD cases and controls were analysed by nanoLC-MS/MS. Alpha-amylase, CREB-binding protein, p532, Transferrin, Zn alpha2 glycoprotein, Zymogen granule protein 16, cystatin D and plasminogen were down-regulated in ASD. Increased expression of proto-oncogene Frequently rearranged in advanced T-cell lymphomas 1 (FRAT1), Kinesin family member 14, Integrin alpha6 subunit, growth hormone regulated TBC protein 1, parotid secretory protein, Prolactin-inducible protein precursor, Mucin-16, Ca binding protein migration inhibitory factor-related protein 14 (MRP14) was observed in individuals with ASD. Many of the identified proteins have previously been linked to ASD or were proposed as risk factors of ASD at the genetic level. Some others are involved in pathological pathways implicated in ASD causality such as oxidative stress, lipid and cholesterol metabolism, immune system disturbances and inflammation. These data could contribute to protein signatures for ASD presence, risk and subtypes, and advance understanding of ASD cause as well as provide novel treatment targets for ASD.
Collapse
Affiliation(s)
- Armand G Ngounou Wetie
- Biochemistry & Proteomics Group, Department of Chemistry & Biomolecular Science, Clarkson University, Potsdam, NY, USA
| | - Kelly L Wormwood
- Biochemistry & Proteomics Group, Department of Chemistry & Biomolecular Science, Clarkson University, Potsdam, NY, USA
| | - Laci Charette
- SUNY Plattsburgh Neuropsychology Clinic and Psychoeducation Services, Plattsburgh, NY, USA.,Department of Psychology, SUNY Plattsburgh, Plattsburgh, NY, USA
| | - Jeanne P Ryan
- Department of Psychology, SUNY Plattsburgh, Plattsburgh, NY, USA
| | - Alisa G Woods
- Biochemistry & Proteomics Group, Department of Chemistry & Biomolecular Science, Clarkson University, Potsdam, NY, USA.,SUNY Plattsburgh Neuropsychology Clinic and Psychoeducation Services, Plattsburgh, NY, USA
| | - Costel C Darie
- Biochemistry & Proteomics Group, Department of Chemistry & Biomolecular Science, Clarkson University, Potsdam, NY, USA
| |
Collapse
|
23
|
McConachie H, Parr JR, Glod M, Hanratty J, Livingstone N, Oono IP, Robalino S, Baird G, Beresford B, Charman T, Garland D, Green J, Gringras P, Jones G, Law J, Le Couteur AS, Macdonald G, McColl EM, Morris C, Rodgers J, Simonoff E, Terwee CB, Williams K. Systematic review of tools to measure outcomes for young children with autism spectrum disorder. Health Technol Assess 2015; 19:1-506. [PMID: 26065374 PMCID: PMC4781156 DOI: 10.3310/hta19410] [Citation(s) in RCA: 169] [Impact Index Per Article: 16.9] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/18/2022] Open
Abstract
BACKGROUND The needs of children with autism spectrum disorder (ASD) are complex and this is reflected in the number and diversity of outcomes assessed and measurement tools used to collect evidence about children's progress. Relevant outcomes include improvement in core ASD impairments, such as communication, social awareness, sensory sensitivities and repetitiveness; skills such as social functioning and play; participation outcomes such as social inclusion; and parent and family impact. OBJECTIVES To examine the measurement properties of tools used to measure progress and outcomes in children with ASD up to the age of 6 years. To identify outcome areas regarded as important by people with ASD and parents. METHODS The MeASURe (Measurement in Autism Spectrum disorder Under Review) research collaboration included ASD experts and review methodologists. We undertook systematic review of tools used in ASD early intervention and observational studies from 1992 to 2013; systematic review, using the COSMIN checklist (Consensus-based Standards for the selection of health Measurement Instruments) of papers addressing the measurement properties of identified tools in children with ASD; and synthesis of evidence and gaps. The review design and process was informed throughout by consultation with stakeholders including parents, young people with ASD, clinicians and researchers. RESULTS The conceptual framework developed for the review was drawn from the International Classification of Functioning, Disability and Health, including the domains 'Impairments', 'Activity Level Indicators', 'Participation', and 'Family Measures'. In review 1, 10,154 papers were sifted - 3091 by full text - and data extracted from 184; in total, 131 tools were identified, excluding observational coding, study-specific measures and those not in English. In review 2, 2665 papers were sifted and data concerning measurement properties of 57 (43%) tools were extracted from 128 papers. Evidence for the measurement properties of the reviewed tools was combined with information about their accessibility and presentation. Twelve tools were identified as having the strongest supporting evidence, the majority measuring autism characteristics and problem behaviour. The patchy evidence and limited scope of outcomes measured mean these tools do not constitute a 'recommended battery' for use. In particular, there is little evidence that the identified tools would be good at detecting change in intervention studies. The obvious gaps in available outcome measurement include well-being and participation outcomes for children, and family quality-of-life outcomes, domains particularly valued by our informants (young people with ASD and parents). CONCLUSIONS This is the first systematic review of the quality and appropriateness of tools designed to monitor progress and outcomes of young children with ASD. Although it was not possible to recommend fully robust tools at this stage, the review consolidates what is known about the field and will act as a benchmark for future developments. With input from parents and other stakeholders, recommendations are made about priority targets for research. FUTURE WORK Priorities include development of a tool to measure child quality of life in ASD, and validation of a potential primary outcome tool for trials of early social communication intervention. STUDY REGISTRATION This study is registered as PROSPERO CRD42012002223. FUNDING The National Institute for Health Research Health Technology Assessment programme.
Collapse
Affiliation(s)
- Helen McConachie
- Institute of Health and Society, Newcastle University, Newcastle upon Tyne, UK
| | - Jeremy R Parr
- Institute of Neuroscience, Newcastle University, Newcastle upon Tyne, UK
| | - Magdalena Glod
- Institute of Health and Society, Newcastle University, Newcastle upon Tyne, UK
| | - Jennifer Hanratty
- School of Sociology, Social Policy and Social Work, Queen's University Belfast, Belfast, Northern Ireland, UK
| | - Nuala Livingstone
- School of Sociology, Social Policy and Social Work, Queen's University Belfast, Belfast, Northern Ireland, UK
| | - Inalegwu P Oono
- Institute of Health and Society, Newcastle University, Newcastle upon Tyne, UK
| | - Shannon Robalino
- Institute of Health and Society, Newcastle University, Newcastle upon Tyne, UK
| | - Gillian Baird
- Guy's and St Thomas' NHS Foundation Trust, London, UK
| | | | - Tony Charman
- Institute of Psychiatry, Psychology & Neuroscience, King's College London, London, UK
| | - Deborah Garland
- National Autistic Society North East Autism Resource Centre, Newcastle upon Tyne, UK
| | - Jonathan Green
- Institute of Brain, Behaviour and Mental Health, University of Manchester, Manchester, UK
| | - Paul Gringras
- Guy's and St Thomas' NHS Foundation Trust, London, UK
| | - Glenys Jones
- School of Education, University of Birmingham, Birmingham, UK
| | - James Law
- Institute of Health and Society, Newcastle University, Newcastle upon Tyne, UK
| | - Ann S Le Couteur
- Institute of Health and Society, Newcastle University, Newcastle upon Tyne, UK
| | - Geraldine Macdonald
- School of Sociology, Social Policy and Social Work, Queen's University Belfast, Belfast, Northern Ireland, UK
| | - Elaine M McColl
- Institute of Health and Society, Newcastle University, Newcastle upon Tyne, UK
| | - Christopher Morris
- PenCRU, Child Health Group, University of Exeter Medical School, University of Exeter, Exeter, UK
| | - Jacqueline Rodgers
- Institute of Neuroscience, Newcastle University, Newcastle upon Tyne, UK
| | - Emily Simonoff
- Institute of Psychiatry, Psychology & Neuroscience, King's College London, London, UK
| | - Caroline B Terwee
- Department of Epidemiology and Biostatistics, VU University Medical Center, Amsterdam, The Netherlands
| | - Katrina Williams
- University of Melbourne, Royal Children's Hospital and Murdoch Childrens Research Institute, Melbourne, Australia
| |
Collapse
|
24
|
Larkin F, Guerin S, Hobson JA, Gutstein SE. The relationship development assessment - research version: preliminary validation of a clinical tool and coding schemes to measure parent-child interaction in autism. Clin Child Psychol Psychiatry 2015; 20:239-60. [PMID: 24366957 DOI: 10.1177/1359104513514065] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
The aim of this project was to replicate and extend findings from two recent studies on parent-child relatedness in autism (Beurkens, Hobson, & Hobson, 2013; Hobson, Tarver, Beurkens, & Hobson, 2013, under review) by adapting an observational assessment and coding schemes of parent-child relatedness for the clinical context and examining their validity and reliability. The coding schemes focussed on three aspects of relatedness: joint attentional focus (Adamson, Bakeman, & Deckner, 2004), the capacity to co-regulate an interaction and the capacity to share emotional experiences. The participants were 40 children (20 with autism, 20 without autism) aged 6-14, and their parents. Parent-child dyads took part in the observational assessment and were coded on these schemes. Comparisons were made with standardised measures of autism severity (Autism Diagnostic Observation Schedule, ADOS: Lord, Rutter, DiLavore, & Risi, 2001; Social Responsiveness Scale, SRS: Constantino & Gruber, 2005), relationship quality (Parent Child Relationship Inventory, PCRI: Gerard, 1994) and quality of parent-child interaction (Dyadic Coding Scales, DCS: Humber & Moss, 2005). Inter-rater reliability was very good and, as predicted, codes both diverged from the measure of parent-child relationship and converged with a separate measure of parent-child interaction quality. A detailed profile review revealed nuanced areas of group and individual differences which may be specific to verbally-able school-age children. The results support the utility of the Relationship Development Assessment - Research Version for clinical practice.
Collapse
Affiliation(s)
- Fionnuala Larkin
- School of Psychology, College of Human Sciences, University College Dublin, Ireland
| | - Suzanne Guerin
- School of Psychology, College of Human Sciences, University College Dublin, Ireland
| | - Jessica A Hobson
- Institute of Child Health, University College London, UK; Sonoma State University, USA
| | | |
Collapse
|
25
|
A COMPARISON OF MOMENTARY TIME SAMPLING AND PARTIAL-INTERVAL RECORDING FOR ASSESSMENT OF EFFECTS OF SOCIAL SKILLS TRAINING. PSYCHOLOGY IN THE SCHOOLS 2015. [DOI: 10.1002/pits.21829] [Citation(s) in RCA: 14] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
|
26
|
A review of evidence-based early intervention for behavioural problems in children with autism spectrum disorder: the core components of effective programs, child-focused interventions and comprehensive treatment models. Curr Opin Psychiatry 2014; 27:158-65. [PMID: 24452070 DOI: 10.1097/yco.0000000000000043] [Citation(s) in RCA: 40] [Impact Index Per Article: 3.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/25/2022]
Abstract
PURPOSE OF REVIEW This article reviews recent evidence and other earlier relevant articles regarding early intervention studies for children with autism spectrum disorder (ASD). RECENT FINDINGS There is a well-established body of empirical evidence for the effectiveness of Early Intensive Behavioural Intervention (EIBI) with young children with ASD. The importance of parent skills training, education and positive behaviour support is also a key factor in influencing outcomes. Drug treatment is of short-term benefit for disruptive behaviour but long-term outcome and metabolic side-effects have not been studied. SUMMARY Few studies have measured the long-term value and effectiveness of early intervention treatments, and currently there are no articles published on effects into adulthood of such treatments. Such research would indicate whether early intervention results in reduced reliance on health services into adulthood.
Collapse
|
27
|
Bonete S, Calero MD, Fernández-Parra A. Group training in interpersonal problem-solving skills for workplace adaptation of adolescents and adults with Asperger syndrome: A preliminary study. AUTISM : THE INTERNATIONAL JOURNAL OF RESEARCH AND PRACTICE 2014; 19:409-20. [DOI: 10.1177/1362361314522354] [Citation(s) in RCA: 29] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
Adults with Asperger syndrome show persistent difficulties in social situations which psychosocial treatments may address. Despite the multiple studies focusing on social skills interventions, only some have focused specifically on problem-solving skills and have not targeted workplace adaptation training in the adult population. This study describes preliminary data from a group format manual-based intervention, the Interpersonal Problem-Solving for Workplace Adaptation Programme, aimed at improving the cognitive and metacognitive process of social problem-solving skills focusing on typical social situations in the workplace based on mediation as the main strategy. A total of 50 adults with Asperger syndrome received the programme and were compared with a control group of typical development. The feasibility and effectiveness of the treatment were explored. Participants were assessed at pre-treatment and post-treatment on a task of social problem-solving skills and two secondary measures of socialisation and work profile using self- and caregiver-report. Using a variety of methods, the results showed that scores were significantly higher at post-treatment in the social problem-solving task and socialisation skills based on reports by parents. Differences in comparison to the control group had decreased after treatment. The treatment was acceptable to families and subject adherence was high. The Interpersonal Problem-Solving for Workplace Adaptation Programme appears to be a feasible training programme.
Collapse
Affiliation(s)
- Saray Bonete
- University of Granada, Spain
- Universidad Francisco de Vitoria, Spain
| | | | | |
Collapse
|
28
|
Oono IP, Honey EJ, McConachie H. Parent-mediated early intervention for young children with autism spectrum disorders (ASD). ACTA ACUST UNITED AC 2013. [DOI: 10.1002/ebch.1952] [Citation(s) in RCA: 134] [Impact Index Per Article: 11.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/11/2022]
|
29
|
Locke J, Rotheram-Fuller E, Xie M, Harker C, Mandell D. Correlation of cognitive and social outcomes among children with autism spectrum disorder in a randomized trial of behavioral intervention. AUTISM : THE INTERNATIONAL JOURNAL OF RESEARCH AND PRACTICE 2013; 18:370-5. [PMID: 24104511 DOI: 10.1177/1362361313479181] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/09/2023]
Abstract
Although social impairments are considered the hallmark deficit of autism, many behavioral intervention studies rely on cognitive functioning as a primary outcome. Fewer studies have examined whether changes in cognition are associated with changes in social functioning. This study examined whether cognitive gains among 192 students from 47 kindergarten-through-second-grade autism support classrooms participating in a year-long behavioral intervention study were associated with gains in social functioning. Children's gains in cognitive ability were modestly associated with independent assessors' and teachers' evaluations of social functioning but were not associated with changes in parent ratings. Observed social gains were not commensurate with gains in cognition, suggesting the need both for interventions that directly target social functioning and relevant field measures of social functioning.
Collapse
|
30
|
Hus V, Lord C. Effects of child characteristics on the Autism Diagnostic Interview-Revised: implications for use of scores as a measure of ASD severity. J Autism Dev Disord 2013; 43:371-81. [PMID: 22729382 DOI: 10.1007/s10803-012-1576-y] [Citation(s) in RCA: 38] [Impact Index Per Article: 3.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/28/2022]
Abstract
The Autism Diagnostic Interview-Revised (ADI-R) is commonly used to inform diagnoses of autism spectrum disorders (ASD). Considering the time dedicated to using the ADI-R, it is of interest to expand the ways in which information obtained from this interview is used. The current study examines how algorithm totals reflecting past (ADI-Diagnostic) and current (ADI-Current) behaviors are influenced by child characteristics, such as demographics, behavioral problems and developmental level. Children with less language at the time of the interview had higher ADI-Diagnostic and ADI-Current. ADI-Diagnostic totals were also associated with age; parents of older children reported more severe past behaviors. Recommendations are provided regarding the use of the ADI-R as a measure of ASD severity, taking language and age into account.
Collapse
Affiliation(s)
- Vanessa Hus
- Department of Psychology, University of Michigan, 530 Church Street, Ann Arbor, MI 48109, USA.
| | | |
Collapse
|
31
|
McCary LM, Machlin L, Roberts JE. The Development of Adaptive Behavior in Toddlers and Preschoolers with Fragile X versus Autism. INTERNATIONAL JOURNAL OF DEVELOPMENTAL DISABILITIES 2013; 59:67-79. [PMID: 25191537 PMCID: PMC4151851 DOI: 10.1179/2047387713y.0000000016] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/29/2023]
Abstract
Although there is extensive research in the early detection of autism, no study has compared the adaptive behavior of young children with fragile X syndrome (FXS) and children with autism across ages. We investigated the cross-sectional development of adaptive behavior in children with FXS and children with autism between 18 and 83 months of age. Analyses revealed a significant relationship between age and adaptive behavior standard scores for children with FXS, with decreased performance across ages. Analyses also revealed that children with FXS had a relatively flat performance across domains while children with autism are typically more variable with lower scores in the communication domain relative to other domains. Delays in adaptive behavior were evident for children with FXS and children with autism at 24 months of age as reported in previous literature. Implications and future directions are discussed.
Collapse
|
32
|
Abstract
Few evidence-based social interventions exist for young adults with high-functioning autism, many of whom encounter significant challenges during the transition into adulthood. The current study investigated the feasibility of an engaging Virtual Reality Social Cognition Training intervention focused on enhancing social skills, social cognition, and social functioning. Eight young adults diagnosed with high-functioning autism completed 10 sessions across 5 weeks. Significant increases on social cognitive measures of theory of mind and emotion recognition, as well as in real life social and occupational functioning were found post-training. These findings suggest that the virtual reality platform is a promising tool for improving social skills, cognition, and functioning in autism.
Collapse
|
33
|
Oono IP, Honey EJ, McConachie H. Parent-mediated early intervention for young children with autism spectrum disorders (ASD). Cochrane Database Syst Rev 2013; 2013:CD009774. [PMID: 23633377 PMCID: PMC11831248 DOI: 10.1002/14651858.cd009774.pub2] [Citation(s) in RCA: 125] [Impact Index Per Article: 10.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
Abstract
BACKGROUND Young children with autism spectrum disorders (ASD) have impairments in the areas of communication and social interaction and often display repetitive or non-compliant behaviour. This early pattern of difficulties is a challenge for parents. Therefore, approaches that help parents develop strategies for interaction and management of behaviour are an obvious route for early intervention in ASD. This review updates a Cochrane review first published in 2002 but is based on a new protocol. OBJECTIVES To assess the effectiveness of parent-mediated early interventions in terms of the benefits for both children with ASD and their parents and to explore some potential moderators of treatment effect. SEARCH METHODS We searched a range of psychological, educational and biomedical databases including CENTRAL, MEDLINE, Embase, PsycINFO and ERIC in August 2012. As this is an update of a previous review, we limited the search to the period following the original searches in 2002. Bibliographies and reference lists of key articles were searched, field experts were contacted and key journals were handsearched. SELECTION CRITERIA We included only randomised controlled trials of early intervention for children with ASD. The interventions in the experimental condition were mediated by parents; the control conditions included no treatment, treatment as usual, waiting list, alternative child-centred intervention not mediated by parents, or alternative parent-mediated intervention of hypothesised lesser effect than the experimental condition. DATA COLLECTION AND ANALYSIS Two review authors (HM and IPO) independently screened articles identified in the search and decided which articles should be retrieved in full. For each included study, two review authors (IPO and EH) extracted and recorded data, using a piloted data collection form. Two review authors (IPO and HM) assessed the risk of bias in each study. We performed data synthesis and analysis using The Cochrane Collaboration's Review Manager 5.1 software. MAIN RESULTS The review includes 17 studies from six countries (USA, UK, Australia, Canada, Thailand and China), which recruited 919 children with ASD. Not all 17 studies could be compared directly or combined in meta-analyses due to differences in the theoretical basis underpinning interventions, the duration and intensity of interventions, and the outcome measurement tools used. Data from subsets of 10 studies that evaluated interventions to enhance parent interaction style and thereby facilitate children's communication were included in meta-analyses. The largest meta-analysis combined data from 316 participants in six studies and the smallest combined data from 55 participants in two studies. Findings from the remaining seven studies were reported narratively.High risk of bias was evident in the studies in relation to allocation concealment and incomplete outcome data; blinding of participants was not possible.Overall, we did not find statistical evidence of gains from parent-mediated approaches in most of the primary outcomes assessed (most aspects of language and communication - whether directly assessed or reported; frequency of child initiations in observed parent-child interaction; child adaptive behaviour; parents' stress), with findings largely inconclusive and inconsistent across studies. However, the evidence for positive change in patterns of parent-child interaction was strong and statistically significant (shared attention: standardised mean difference (SMD) 0.41; 95% confidence interval (CI) 0.14 to 0.68, P value < 0.05; parent synchrony: SMD 0.90; 95% CI 0.56 to 1.23, P value < 0.05). Furthermore, there is some evidence suggestive of improvement in child language comprehension, reported by parents (vocabulary comprehension: mean difference (MD 36.26; 95% CI 1.31 to 71.20, P value < 0.05). In addition, there was evidence suggesting a reduction in the severity of children's autism characteristics (SMD -0.30, 95% CI -0.52 to -0.08, P value < 0.05). However, this evidence of change in children's skills and difficulties as a consequence of parent-mediated intervention is uncertain, with small effect sizes and wide CIs, and the conclusions are likely to change with future publication of high-quality RCTs. AUTHORS' CONCLUSIONS The review finds some evidence for the effectiveness of parent-mediated interventions, most particularly in proximal indicators within parent-child interaction, but also in more distal indicators of child language comprehension and reduction in autism severity. Evidence of whether such interventions may reduce parent stress is inconclusive. The review reinforces the need for attention to be given to early intervention service models that enable parents to contribute skilfully to the treatment of their child with autism. However, practitioners supporting parent-mediated intervention require to monitor levels of parent stress. The ability to draw conclusions from studies would be improved by researchers adopting a common set of outcome measures as the quality of the current evidence is low.
Collapse
Affiliation(s)
- Inalegwu P Oono
- Newcastle UniversityInstitute of Health and SocietySir James Spence InstituteVictoria RoadNewcastle upon TyneUKNE1 4LP
| | - Emma J Honey
- Northumberland, Tyne and Wear NHS Foundation TrustComplex Neurodevelopmental Disorders ServicesWalkergate ParkNewcastle upon TyneUKNE6 4QD
| | - Helen McConachie
- Newcastle UniversityInstitute of Health and SocietySir James Spence InstituteVictoria RoadNewcastle upon TyneUKNE1 4LP
| | | |
Collapse
|