2
|
Anderson DS, Hanna RS, Azar ARP, Collier V, Hankins P, Loudon B, Olson TS, Grupp SA, Phillips CA, Kadauke S. Automation of Hematopoietic Cell Transplantation Outcomes Reporting Leads to Dramatic Reduction in Errors Reported to Real-World Data Registry. Transplant Cell Ther 2023; 29:207.e1-207.e5. [PMID: 36610491 DOI: 10.1016/j.jtct.2022.12.026] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/18/2022] [Revised: 12/19/2022] [Accepted: 12/29/2022] [Indexed: 01/06/2023]
Abstract
Institutions that perform hematopoietic cell transplantation (HCT) are required by law to report standardized, structured data on transplantation outcomes. A key post-transplantation outcome is engraftment, the time between HCT infusion and reemergence of circulating neutrophils and platelets. At our center, we found that manual chart abstraction for engraftment data was highly error-prone. We developed a custom R/Shiny application that automatically calculates engraftment dates and displays them in an intuitive format to augment the manual chart review. Our hypothesis was that use of the application to assist with calculating and reporting engraftment dates would be associated with a decreased error rate. The study was conducted at a single tertiary care institution. The application was developed in a collaborative, multidisciplinary fashion by members of an embedded cellular therapy informatics team. Retrospective validation of the application's accuracy was conducted on all malignant HCTs from February 2016 to December 2020 (n = 198). Real-world use of the application was evaluated prospectively from April 2021 through April 2022 (n = 53). The Welch 2-sample t test was used to compare error rates preimplementation and postimplementation. Data were visualized using p charts, and standard special cause variation rules were applied. The accuracy of reported data postdeployment increased dramatically; the engraftment error rate decreased from 15% to 3.8% for neutrophils (P = .003) and from 28% to 1.9% for platelets (P < .001). This study demonstrates the effective deployment of a custom R/Shiny application that was associated with significantly reduced error rates in HCT engraftment reporting for operational, research, and regulatory purposes. Users reported subjective satisfaction with the application and that it addressed difficulties with the legacy manual process. Identifying and correcting erroneous data in engraftment reporting could lead to a more efficient and accurate nationwide assessment of transplantation success. Furthermore, we show that it is possible and practical for academic medical centers to create and support embedded informatics teams that can quickly build applications for clinical operations in a manner compliant with regulatory requirements.
Collapse
Affiliation(s)
- David S Anderson
- Division of Oncology, Children's Hospital of Philadelphia, Philadelphia, Pennsylvania; Department of Pediatrics, Perelman School of Medicine at the University of Pennsylvania, Philadelphia, Pennsylvania; Department of Biomedical and Health Informatics, Children's Hospital of Philadelphia, Philadelphia, Pennsylvania.
| | - Richard S Hanna
- Division of Oncology, Children's Hospital of Philadelphia, Philadelphia, Pennsylvania
| | | | - Victoria Collier
- Division of Oncology, Children's Hospital of Philadelphia, Philadelphia, Pennsylvania
| | - Patricia Hankins
- Division of Oncology, Children's Hospital of Philadelphia, Philadelphia, Pennsylvania
| | - Brandon Loudon
- Division of Oncology, Children's Hospital of Philadelphia, Philadelphia, Pennsylvania
| | - Timothy S Olson
- Division of Oncology, Children's Hospital of Philadelphia, Philadelphia, Pennsylvania; Department of Pediatrics, Perelman School of Medicine at the University of Pennsylvania, Philadelphia, Pennsylvania
| | - Stephan A Grupp
- Division of Oncology, Children's Hospital of Philadelphia, Philadelphia, Pennsylvania; Department of Pediatrics, Perelman School of Medicine at the University of Pennsylvania, Philadelphia, Pennsylvania
| | - Charles A Phillips
- Division of Oncology, Children's Hospital of Philadelphia, Philadelphia, Pennsylvania; Department of Pediatrics, Perelman School of Medicine at the University of Pennsylvania, Philadelphia, Pennsylvania; Department of Biomedical and Health Informatics, Children's Hospital of Philadelphia, Philadelphia, Pennsylvania
| | - Stephan Kadauke
- Department of Biomedical and Health Informatics, Children's Hospital of Philadelphia, Philadelphia, Pennsylvania; Department of Pathology and Laboratory Medicine, Perelman School of Medicine at the University of Pennsylvania, Philadelphia, Pennsylvania; Division of Transfusion Medicine, Children's Hospital of Philadelphia, Pennsylvania; Division of Pathology Informatics, Children's Hospital of Philadelphia, Pennsylvania
| |
Collapse
|
3
|
Walsh KS, Wolters PL, Widemann BC, Del Castillo A, Sady MD, Inker T, Roderick MC, Martin S, Toledo-Tamula MA, Struemph K, Paltin I, Collier V, Mullin K, Fisher MJ, Packer RJ. Impact of MEK Inhibitor Therapy on Neurocognitive Functioning in NF1. Neurol Genet 2021; 7:e616. [PMID: 34377779 PMCID: PMC8351286 DOI: 10.1212/nxg.0000000000000616] [Citation(s) in RCA: 12] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/17/2021] [Accepted: 07/06/2021] [Indexed: 11/21/2022]
Abstract
Background and Objectives Neurofibromatosis type 1 (NF1)-associated cognitive impairments carry significant lifelong morbidity. The lack of targeted biologic treatments remains a significant unmet need. We examine changes in cognition in patients with NF1 in the first 48 weeks of mitogen-activated protein kinase inhibitor (MEKi) treatment. Methods Fifty-nine patients with NF1 aged 5–27 years on an MEKi clinical trial treating plexiform neurofibroma underwent pretreatment and follow-up cognitive assessments over 48 weeks of treatment. Performance tasks (Cogstate) and observer-reported functioning (BRIEF) were the primary outcomes. Group-level (paired t tests) and individual-level analyses (Reliable Change Index, RCI) were used. Results Analysis showed statistically significant improvements on BRIEF compared with baseline (24-week Behavioral Regulation Index: t(58) = 3.03, p = 0.004, d = 0.24; 48-week Metacognition Index: t(39) = 2.70, p = 0.01, d = 0.27). RCI indicated that more patients had clinically significant improvement at 48 weeks than expected by chance (χ2 = 11.95, p = 0.001, odds ratio [OR] = 6.3). Group-level analyses indicated stable performance on Cogstate (p > 0.05). RCI statistics showed high proportions of improved working memory (24-week χ2 = 8.36, p = 0.004, OR = 4.6, and 48-week χ2 = 9.34, p = 0.004, OR = 5.3) but not visual learning/memory. Patients with baseline impairments on BRIEF were more likely to show significant improvement than nonimpaired patients (24 weeks 46% vs 8%; χ2 = 9.54, p = 0.008, OR = 9.22; 48 weeks 63% vs 16%; χ2 = 7.50, p = 0.02, OR = 9.0). Discussion Our data show no evidence of neurotoxicity in 48 weeks of treatment with an MEKi and a potential clinical signal supporting future research of MEKi as a cognitive intervention.
Collapse
Affiliation(s)
- Karin S Walsh
- Children's National Medical Center (K.S.W., A.C., M.D.S., T.I., R.J.P.), Washington, DC; National Cancer Institute (P.L.W., B.C.W., M.C.R., S.M., K.S.), Bethesda, MD; Clinical Research Directorate (M.A.T.-T.), Frederick National Library for Cancer Research, MD; and Children's Hospital of Philadelphia (I.P., V.C., K.M., M.J.F.), Philadelphia
| | - Pamela L Wolters
- Children's National Medical Center (K.S.W., A.C., M.D.S., T.I., R.J.P.), Washington, DC; National Cancer Institute (P.L.W., B.C.W., M.C.R., S.M., K.S.), Bethesda, MD; Clinical Research Directorate (M.A.T.-T.), Frederick National Library for Cancer Research, MD; and Children's Hospital of Philadelphia (I.P., V.C., K.M., M.J.F.), Philadelphia
| | - Brigitte C Widemann
- Children's National Medical Center (K.S.W., A.C., M.D.S., T.I., R.J.P.), Washington, DC; National Cancer Institute (P.L.W., B.C.W., M.C.R., S.M., K.S.), Bethesda, MD; Clinical Research Directorate (M.A.T.-T.), Frederick National Library for Cancer Research, MD; and Children's Hospital of Philadelphia (I.P., V.C., K.M., M.J.F.), Philadelphia
| | - Allison Del Castillo
- Children's National Medical Center (K.S.W., A.C., M.D.S., T.I., R.J.P.), Washington, DC; National Cancer Institute (P.L.W., B.C.W., M.C.R., S.M., K.S.), Bethesda, MD; Clinical Research Directorate (M.A.T.-T.), Frederick National Library for Cancer Research, MD; and Children's Hospital of Philadelphia (I.P., V.C., K.M., M.J.F.), Philadelphia
| | - Maegan D Sady
- Children's National Medical Center (K.S.W., A.C., M.D.S., T.I., R.J.P.), Washington, DC; National Cancer Institute (P.L.W., B.C.W., M.C.R., S.M., K.S.), Bethesda, MD; Clinical Research Directorate (M.A.T.-T.), Frederick National Library for Cancer Research, MD; and Children's Hospital of Philadelphia (I.P., V.C., K.M., M.J.F.), Philadelphia
| | - Tess Inker
- Children's National Medical Center (K.S.W., A.C., M.D.S., T.I., R.J.P.), Washington, DC; National Cancer Institute (P.L.W., B.C.W., M.C.R., S.M., K.S.), Bethesda, MD; Clinical Research Directorate (M.A.T.-T.), Frederick National Library for Cancer Research, MD; and Children's Hospital of Philadelphia (I.P., V.C., K.M., M.J.F.), Philadelphia
| | - Marie Claire Roderick
- Children's National Medical Center (K.S.W., A.C., M.D.S., T.I., R.J.P.), Washington, DC; National Cancer Institute (P.L.W., B.C.W., M.C.R., S.M., K.S.), Bethesda, MD; Clinical Research Directorate (M.A.T.-T.), Frederick National Library for Cancer Research, MD; and Children's Hospital of Philadelphia (I.P., V.C., K.M., M.J.F.), Philadelphia
| | - Staci Martin
- Children's National Medical Center (K.S.W., A.C., M.D.S., T.I., R.J.P.), Washington, DC; National Cancer Institute (P.L.W., B.C.W., M.C.R., S.M., K.S.), Bethesda, MD; Clinical Research Directorate (M.A.T.-T.), Frederick National Library for Cancer Research, MD; and Children's Hospital of Philadelphia (I.P., V.C., K.M., M.J.F.), Philadelphia
| | - Mary Anne Toledo-Tamula
- Children's National Medical Center (K.S.W., A.C., M.D.S., T.I., R.J.P.), Washington, DC; National Cancer Institute (P.L.W., B.C.W., M.C.R., S.M., K.S.), Bethesda, MD; Clinical Research Directorate (M.A.T.-T.), Frederick National Library for Cancer Research, MD; and Children's Hospital of Philadelphia (I.P., V.C., K.M., M.J.F.), Philadelphia
| | - Kari Struemph
- Children's National Medical Center (K.S.W., A.C., M.D.S., T.I., R.J.P.), Washington, DC; National Cancer Institute (P.L.W., B.C.W., M.C.R., S.M., K.S.), Bethesda, MD; Clinical Research Directorate (M.A.T.-T.), Frederick National Library for Cancer Research, MD; and Children's Hospital of Philadelphia (I.P., V.C., K.M., M.J.F.), Philadelphia
| | - Iris Paltin
- Children's National Medical Center (K.S.W., A.C., M.D.S., T.I., R.J.P.), Washington, DC; National Cancer Institute (P.L.W., B.C.W., M.C.R., S.M., K.S.), Bethesda, MD; Clinical Research Directorate (M.A.T.-T.), Frederick National Library for Cancer Research, MD; and Children's Hospital of Philadelphia (I.P., V.C., K.M., M.J.F.), Philadelphia
| | - Victoria Collier
- Children's National Medical Center (K.S.W., A.C., M.D.S., T.I., R.J.P.), Washington, DC; National Cancer Institute (P.L.W., B.C.W., M.C.R., S.M., K.S.), Bethesda, MD; Clinical Research Directorate (M.A.T.-T.), Frederick National Library for Cancer Research, MD; and Children's Hospital of Philadelphia (I.P., V.C., K.M., M.J.F.), Philadelphia
| | - Kathy Mullin
- Children's National Medical Center (K.S.W., A.C., M.D.S., T.I., R.J.P.), Washington, DC; National Cancer Institute (P.L.W., B.C.W., M.C.R., S.M., K.S.), Bethesda, MD; Clinical Research Directorate (M.A.T.-T.), Frederick National Library for Cancer Research, MD; and Children's Hospital of Philadelphia (I.P., V.C., K.M., M.J.F.), Philadelphia
| | - Michael J Fisher
- Children's National Medical Center (K.S.W., A.C., M.D.S., T.I., R.J.P.), Washington, DC; National Cancer Institute (P.L.W., B.C.W., M.C.R., S.M., K.S.), Bethesda, MD; Clinical Research Directorate (M.A.T.-T.), Frederick National Library for Cancer Research, MD; and Children's Hospital of Philadelphia (I.P., V.C., K.M., M.J.F.), Philadelphia
| | - Roger J Packer
- Children's National Medical Center (K.S.W., A.C., M.D.S., T.I., R.J.P.), Washington, DC; National Cancer Institute (P.L.W., B.C.W., M.C.R., S.M., K.S.), Bethesda, MD; Clinical Research Directorate (M.A.T.-T.), Frederick National Library for Cancer Research, MD; and Children's Hospital of Philadelphia (I.P., V.C., K.M., M.J.F.), Philadelphia
| |
Collapse
|