1
|
Haem E, Karlsson MO, Ueckert S. Comparison of the power and type 1 error of total score models for drug effect detection in clinical trials. J Pharmacokinet Pharmacodyn 2024; 52:4. [PMID: 39656313 PMCID: PMC11632077 DOI: 10.1007/s10928-024-09949-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/22/2024] [Accepted: 10/31/2024] [Indexed: 12/13/2024]
Abstract
Composite scale data consists of numerous categorical questions/items that are often summed as a total score and are commonly utilized as primary endpoints in clinical trials. These endpoints are conceptually discrete and constrained by nature. Item response theory (IRT) is a powerful approach for detecting drug effects in composite scale data from clinical trials, but estimating all parameters requires a large sample size and all item information, which may not be available. Therefore, total score models are often utilized. The most popular total score models are continuous variable (CV) models, but this strategy establishes assumptions that go against the integer nature, and typically also the bounded nature, of data. Bounded integer (BI) and Coarsened grid (CG) models respect the nature of the data. However, their power to detect drug effects has not been as thoroughly studied in clinical trials. When an IRT model is accessible, IRT-informed models (I-BI and I-CV) are promising methods in which the mean and variability of the total score at any position are extracted from the existing IRT model. In this study, total score data were simulated from the MDS-UPDRS motor subscale. Then, the power, type 1 error, and treatment effect bias of six total score models for detecting drug effects in clinical trials were explored. Further, it was investigated how the power, type 1 of error, and treatment effect bias for the I-BI and I-CV models were affected by mis-specified item information from the IRT model. The I-BI model demonstrated the highest statistical power, maintained an acceptable Type I error rate, and exhibited minimal bias, approaching zero. Following that, the I-CV, BI, and CG with Czado transformation (CG_Czado) models provided the maximum power. However, the CG_Czado model had inflated type 1 error under low sample size scenarios in each arm of clinical trials. The CG model among total score models displayed the lowest power and the most inflated type 1 error. Therefore, the results favor the I-BI model when an IRT model is available; otherwise, the BI model.
Collapse
Affiliation(s)
- Elham Haem
- Department of Biostatistics, School of Medicine, Shiraz University of Medical Sciences, Shiraz, Iran.
- Pharmacometrics Research Group, Department of Pharmacy, Uppsala University, Uppsala, Sweden.
| | - Mats O Karlsson
- Pharmacometrics Research Group, Department of Pharmacy, Uppsala University, Uppsala, Sweden
| | - Sebastian Ueckert
- Pharmacometrics Research Group, Department of Pharmacy, Uppsala University, Uppsala, Sweden
| |
Collapse
|
2
|
Huang MX, Yu Q, Li YY. [A prospective randomized controlled study of neurofeedback combined with learning style profile intervention training in children with high-functioning autism]. ZHONGGUO DANG DAI ER KE ZA ZHI = CHINESE JOURNAL OF CONTEMPORARY PEDIATRICS 2024; 26:1066-1071. [PMID: 39467676 PMCID: PMC11527408 DOI: 10.7499/j.issn.1008-8830.2405054] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Subscribe] [Scholar Register] [Received: 05/14/2024] [Accepted: 08/27/2024] [Indexed: 10/30/2024]
Abstract
OBJECTIVES To explore the application of neurofeedback (NFB) combined with learning style profile (LSP) intervention training in children with high-functioning autism (HFA). METHODS A prospective study was conducted to select 86 children with HFA admitted to the hospital from February 2022 to February 2024. They were divided into two groups according to the random number table method, with 43 cases in each group. In this double-blind study, the control group was given LSP intervention training, and the observation group was given NFB intervention on the basis of the treatment used in the control group. Both groups were treated for 6 months. The scores of Autism Behavior Checklist (ABC), Autism Treatment Evaluation Checklist (ATEC), Social Responsiveness Scale (SRS), and Pediatric Quality of Life (PedsQL) were compared between the two groups before intervention and at 6 months after intervention. The relationship of PedsQL score with ABC, ATEC, and SRS scores was analyzed in children with HFA. RESULTS After 6 months of intervention, the scores of ABC, ATEC, and SRS in the observation group were significantly lower than those in the control group, while the PedsQL score in the observation group was significantly higher than that in the control group (P<0.05). The PedsQL score was negatively correlated with the ABC, ATEC, and SRS scores in children with HFA (r=-0.238, -0.381, -0.219 respectively; P<0.001). CONCLUSIONS NFB combined with LSP can effectively improve the clinical symptoms and social ability, control the development of the disease, and improve the quality of life in children with HFA.
Collapse
Affiliation(s)
- Ming-Xin Huang
- Department of Psychology, Tianjing Children's Hospital/Children's Hospital, Tianjin University, Tianjing 300134, China
| | - Qing Yu
- Department of Psychology, Tianjing Children's Hospital/Children's Hospital, Tianjin University, Tianjing 300134, China
| | - Yuan-Yuan Li
- Department of Psychology, Tianjing Children's Hospital/Children's Hospital, Tianjin University, Tianjing 300134, China
| |
Collapse
|
3
|
Hamdan A, Hooker AC, Chen X, Traschütz A, Schüle R, ARCA Study Group, EVIDENCE‐RND consortium, Synofzik M, Karlsson MO. Item performance of the scale for the assessment and rating of ataxia in rare and ultra-rare genetic ataxias. CPT Pharmacometrics Syst Pharmacol 2024; 13:1327-1340. [PMID: 38769902 PMCID: PMC11330187 DOI: 10.1002/psp4.13162] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/27/2023] [Revised: 03/28/2024] [Accepted: 05/02/2024] [Indexed: 05/22/2024] Open
Abstract
The Scale for the Assessment and Rating of Ataxia (SARA) is widely used for assessing the severity and progression of genetic cerebellar ataxias. SARA is now considered a primary end point in several ataxia treatment trials, but its underlying composite item measurement model has not yet been tested. This work aimed to evaluate the composite properties of SARA and its items using item response theory (IRT) and to demonstrate its applicability across even ultra-rare genetic ataxias. Leveraging SARA subscores data from 1932 visits from 990 patients of the Autosomal Recessive Cerebellar Ataxias (ARCA) registry, we assessed the performance of SARA using IRT methodology. The item characteristics were evaluated over the ataxia severity range of the entire ataxia population as well as the assessment validity across 115 genetic ARCA subpopulations. A unidimensional IRT model was able to describe SARA item data, indicating that SARA captures one single latent variable. All items had high discrimination values (1.5-2.9) indicating the effectiveness of the SARA in differentiating between subjects with different disease statuses. Each item contributed between 7% and 28% of the total assessment informativeness. There was no evidence for differences between the 115 genetic ARCA subpopulations in SARA applicability. These results show the good discrimination ability of SARA with all of its items adding informational value. The IRT framework provides a thorough description of SARA on the item level, and facilitates its utilization as a clinical outcome assessment in upcoming longitudinal natural history or treatment trials, across a large number of ataxias, including ultra-rare ones.
Collapse
Affiliation(s)
- Alzahra Hamdan
- Pharmacometrics Research Group, Department of PharmacyUppsala UniversityUppsalaSweden
| | - Andrew C. Hooker
- Pharmacometrics Research Group, Department of PharmacyUppsala UniversityUppsalaSweden
| | - Xiaomei Chen
- Pharmacometrics Research Group, Department of PharmacyUppsala UniversityUppsalaSweden
| | - Andreas Traschütz
- Department of Neurodegenerative DiseasesCenter for Neurology and Hertie Institute for Clinical Brain Research, University of TübingenTübingenGermany
- German Center for Neurodegenerative Diseases (DZNE) TübingenTübingenGermany
| | - Rebecca Schüle
- Department of Neurodegenerative DiseasesCenter for Neurology and Hertie Institute for Clinical Brain Research, University of TübingenTübingenGermany
- Division of Neurodegenerative Diseases, Department of NeurologyHeidelberg University HospitalHeidelbergGermany
| | | | | | - Matthis Synofzik
- Department of Neurodegenerative DiseasesCenter for Neurology and Hertie Institute for Clinical Brain Research, University of TübingenTübingenGermany
- German Center for Neurodegenerative Diseases (DZNE) TübingenTübingenGermany
| | - Mats O. Karlsson
- Pharmacometrics Research Group, Department of PharmacyUppsala UniversityUppsalaSweden
| |
Collapse
|
4
|
Wu R, Li X, Meng Z, Li P, He Z, Liang L. Phenotypic and genetic analysis of children with unexplained neurodevelopmental delay and neurodevelopmental comorbidities in a Chinese cohort using trio-based whole-exome sequencing. Orphanet J Rare Dis 2024; 19:205. [PMID: 38764027 PMCID: PMC11103872 DOI: 10.1186/s13023-024-03214-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/20/2023] [Accepted: 05/10/2024] [Indexed: 05/21/2024] Open
Abstract
BACKGROUND Trio-based whole-exome sequencing (trio-WES) enables identification of pathogenic variants, including copy-number variants (CNVs), in children with unexplained neurodevelopmental delay (NDD) and neurodevelopmental comorbidities (NDCs), including autism spectrum disorder (ASD), epilepsy, and attention deficit hyperactivity disorder. Further phenotypic and genetic analysis on trio-WES-tested NDD-NDCs cases may help to identify key phenotypic factors related to higher diagnostic yield of using trio-WES and novel risk genes associated with NDCs in clinical settings. METHODS In this study, we retrospectively performed phenotypic analysis on 163 trio-WES-tested NDD-NDCs children to determine the phenotypic differences between genetically diagnosed and non-genetically diagnosed groups. Additionally, we conducted genetic analysis of ASD genes with the help of Simons Foundation for Autism Research Institute (SFARI) Gene database to identify novel possible ASD-risk genes underlying genetic NDD conditions. RESULTS Among these 163 patients, pathogenic variants were identified in 82 cases (82/163, 50.3%), including 20 cases with CNVs. By comparing phenotypic variables between genetically diagnosed group (82 cases) and non-genetically diagnosed group (81 cases) with multivariate binary logistic regression analysis, we revealed that NDD-NDCs cases presenting with severe-profound NDD [53/82 vs 17/81, adjusted-OR (95%CI): 4.865 (2.213 - 10.694), adjusted-P < 0.001] or having multiple NDCs [26/82 vs 8/81, adjusted-OR (95%CI): 3.731 (1.399 - 9.950), adjusted-P = 0.009] or accompanying ASD [64/82 vs 35/81, adjusted-OR (95%CI): 3.256 (1.479 - 7.168), adjusted-P = 0.003] and head circumference abnormality [33/82 vs 11/81, adjusted-OR (95%CI): 2.788 (1.148 - 6.774), adjusted-P = 0.024] were more likely to have a genetic diagnosis using trio-WES. Moreover, 37 genes with monogenetic variants were identified in 48 patients genetically diagnosed with NDD-ASD, and 15 dosage-sensitive genes were identified in 16 individuals with NDD-ASD carrying CNVs. Most of those genes had been proven to be ASD-related genes. However, some of them (9 genes) were not proven sufficiently to correlate with ASD. By literature review and constructing protein-protein interaction networks among these 9 candidate ASD-risk genes and 102 established ASD genes obtained from the SFARI Gene database, we identified CUL4B, KCNH1, and PLA2G6 as novel possible ASD-risk genes underlying genetic NDD conditions. CONCLUSIONS Trio-WES testing is recommended for patients with unexplained NDD-NDCs that have severe-profound NDD or multiple NDCs, particularly those with accompanying ASD and head circumference abnormality, as these independent factors may increase the likelihood of genetic diagnosis using trio-WES. Moreover, NDD patients with pathogenic variants in CUL4B, KCNH1 and PLA2G6 should be aware of potential risks of developing ASD during their disease courses.
Collapse
Affiliation(s)
- Ruohao Wu
- Department of Children's Neuro-endocrinology, Sun Yat-sen Memorial Hospital, Sun Yat-sen University, Guangzhou, 510120, Guangdong, China
- Children's Medical Center, Sun Yat-sen Memorial Hospital, Sun Yat-sen University, Guangzhou Guangdong, 510120, China
| | - Xiaojuan Li
- Department of Research and Molecular Diagnostics, Sun Yat-sen Memorial Hospital, Sun Yat-sen University, Guangzhou, 510120, Guangdong, China
| | - Zhe Meng
- Department of Children's Neuro-endocrinology, Sun Yat-sen Memorial Hospital, Sun Yat-sen University, Guangzhou, 510120, Guangdong, China
- Children's Medical Center, Sun Yat-sen Memorial Hospital, Sun Yat-sen University, Guangzhou Guangdong, 510120, China
| | - Pinggan Li
- Department of Children's Neuro-endocrinology, Sun Yat-sen Memorial Hospital, Sun Yat-sen University, Guangzhou, 510120, Guangdong, China
- Children's Medical Center, Sun Yat-sen Memorial Hospital, Sun Yat-sen University, Guangzhou Guangdong, 510120, China
| | - Zhanwen He
- Department of Children's Neuro-endocrinology, Sun Yat-sen Memorial Hospital, Sun Yat-sen University, Guangzhou, 510120, Guangdong, China.
- Children's Medical Center, Sun Yat-sen Memorial Hospital, Sun Yat-sen University, Guangzhou Guangdong, 510120, China.
| | - Liyang Liang
- Department of Children's Neuro-endocrinology, Sun Yat-sen Memorial Hospital, Sun Yat-sen University, Guangzhou, 510120, Guangdong, China.
- Children's Medical Center, Sun Yat-sen Memorial Hospital, Sun Yat-sen University, Guangzhou Guangdong, 510120, China.
| |
Collapse
|
5
|
Frazier TW, Khaliq I, Scullin K, Uljarevic M, Shih A, Karpur A. Development and Psychometric Evaluation of the Open-Source Challenging Behavior Scale (OS-CBS). J Autism Dev Disord 2023; 53:4655-4670. [PMID: 36112303 DOI: 10.1007/s10803-022-05750-5] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 09/06/2022] [Indexed: 12/28/2022]
Abstract
At present, there are no brief, freely-available, informant-report measures that evaluate key challenging behaviors relevant to youth with autism spectrum disorder (ASD) or other developmental disabilities (DD). This paper describes the development, refinement, and initial psychometric evaluation of a new 18-item measure, the Open-Source Challenging Behavior Scale (OS-CBS). In a large sample (n = 2004, 169 with ASD, ages 2-17), results of psychometric analyses indicated a clear factor structure (property destruction, aggression, elopement, conduct problems, and self-injury and a general factor with high loadings from all items) based on exploratory structural equation modeling, good scale reliability (α = .66-.83 for subscales, α = .91 total scale), measurement invariance across demographics, and good construct validity. The OS-CBS is a psychometrically-sound instrument for screening and monitoring intervention progress.
Collapse
Affiliation(s)
- Thomas W Frazier
- Department of Psychology, John Carroll University, 1 John Carroll Boulevard, University Heights, OH, 44118, USA.
| | - Izma Khaliq
- Department of Psychology, John Carroll University, 1 John Carroll Boulevard, University Heights, OH, 44118, USA
| | - Keeley Scullin
- Department of Psychology, John Carroll University, 1 John Carroll Boulevard, University Heights, OH, 44118, USA
| | | | | | | |
Collapse
|
6
|
Liu A, Gong C, Wang B, Sun J, Jiang Z. Non-invasive brain stimulation for patient with autism: a systematic review and meta-analysis. Front Psychiatry 2023; 14:1147327. [PMID: 37457781 PMCID: PMC10338880 DOI: 10.3389/fpsyt.2023.1147327] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/18/2023] [Accepted: 06/08/2023] [Indexed: 07/18/2023] Open
Abstract
Objective To comprehensively evaluate the efficacy of non-invasive brain stimulation (NIBS) in patients with autism spectrum disorder (ASD) in randomized controlled trials (RCT), providing a reference for future research on the same topic. Methods Five databases were searched (Pubmed, Web of Science, Medline, Embase, and Cochrane library) and tracked relevant references, Meta-analysis was performed using RevMan 5.3 software. Results Twenty-two references (829 participants) were included. The results of the meta-analysis showed that NIBS had positive effects on repetitive and stereotypical behaviors, cognitive function, and executive function in autistic patients. Most of the included studies had a moderate to high risk of bias, Mainly because of the lack of blinding of subjects and assessors to treatment assignment, as well as the lack of continuous observation of treatment effects. Conclusion Available evidence supports an improvement in some aspects of NIBS in patients with ASD. However, due to the quality of the original studies and significant publication bias, this evidence must be treated with caution. Further large multicenter randomized double-blind controlled trials and appropriate follow-up observations are needed to further evaluate the specific efficacy of NIBS in patients with ASD.
Collapse
Affiliation(s)
- Annan Liu
- Jiamusi University Affiliated No.3 Hospital, Jiamusi, China
| | - Chao Gong
- Jiamusi Medical College, Jiamusi, Heilongjiang, China
| | - Bobo Wang
- Jiamusi Medical College, Jiamusi, Heilongjiang, China
| | - Jiaxing Sun
- Jiamusi Medical College, Jiamusi, Heilongjiang, China
| | - Zhimei Jiang
- Jiamusi University College of Rehabilitation Medicine, Jiamusi, Heilongjiang, China
| |
Collapse
|
7
|
Doostfatemeh M, Haem E, Sarbaraninan M, Ajdari Tafti M. Multidimensional item Response theory to assess the psychometric properties of persian version of dutch eating behavior questionnaire (DEBQ) in university students. CURRENT PSYCHOLOGY 2022. [DOI: 10.1007/s12144-021-02608-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/03/2022]
|
8
|
Novel treatments for autism spectrum disorder based on genomics and systems biology. Pharmacol Ther 2021; 230:107939. [PMID: 34174273 DOI: 10.1016/j.pharmthera.2021.107939] [Citation(s) in RCA: 14] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/05/2021] [Accepted: 06/03/2021] [Indexed: 12/14/2022]
Abstract
BACKGROUND Autism spectrum disorder (ASD) is a highly heterogeneous neurodevelopmental disorder with a complex underlying genetic architecture. There are currently no known pharmacologic treatments for the core ASD symptoms of social deficits and restricted/ repetitive behavior. However, there are dozens of clinical trials currently underway that are testing the impact of novel and existing agents on core and associated symptoms in ASD. METHODS We present a narrative synthesis of the historical and contemporary challenges to drug discovery in ASD. We then provide an overview of novel treatments currently under investigation from a genomics and systems biology perspective. RESULTS Data driven network and cluster analyses suggest alterations in transcriptional regulation, chromatin remodelling, synaptic transmission, neuropeptide signalling, and/or immunological mechanisms may contribute to or underlie the development of ASD. Agents and upcoming trials targeting each of the above listed systems are reviewed. CONCLUSION Identifying effective pharmacologic treatments for the core and associated symptom domains in ASD will require further collaboration and innovation in the areas of outcome measurement, biomarker research, and genomics, as well as systematic efforts to identify and treat subgroups of individuals with ASD who may be differentially responsive to specific treatments.
Collapse
|
9
|
Doostfatemeh M, Ayatollahi SMT, Jafari P. Assessing the effect of child's gender on their father-mother perception of the PedsQL™ 4.0 questionnaire: an iterative hybrid ordinal logistic regression/item response theory approach with Monte Carlo simulation. Health Qual Life Outcomes 2020; 18:348. [PMID: 33087112 PMCID: PMC7579799 DOI: 10.1186/s12955-020-01601-y] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/01/2020] [Accepted: 10/13/2020] [Indexed: 12/27/2022] Open
Abstract
Background This study aimed at investigating the possible confounding effect of children’s gender on the parents’ dyads perception of their child HRQoL at both item and scale levels of PedsQLTM4.0 questionnaire. Methods The PedsQL™ 4.0 Generic Core Scales were completed by 573 children and their father-and-mother dyads. An iterative hybrid ordinal logistic regression/item response theory model with Monte Carlo simulation was used to detect differential item functioning (DIF) invariance across mothers/fathers and daughter/sons. Results Assessing DIF across mother–daughter, father–daughter, mother–son, and father–son dyads revealed that although parents and their children perceived the meaning of some items of PedsQLTM4.0 instrument differently, the pattern of fathers’ and mothers’ report does not vary much across daughters and sons. Conclusion In the Persian version of PedsQLTM4.0, the child’s gender is not a confounding factor in the mothers’ and fathers’ report with respect to their daughters’ and sons’ HRQoL. Hence, paternal proxy-reports can be included in studies, along with maternal proxy-reports, and the reports can be combined short of concerning children gender, when looking at parent–child agreement.
Collapse
Affiliation(s)
| | | | - Peyman Jafari
- Department of Biostatistics, Shiraz University of Medical Sciences, Shiraz, Iran
| |
Collapse
|