1
|
Iverson R, Taljaard M, Geraghty MT, Pugliese M, Tingley K, Coyle D, Kronick JB, Wilson K, Austin V, Brunel-Guitton C, Buhas D, Butcher NJ, Chan AKJ, Dyack S, Goobie S, Greenberg CR, Jain-Ghai S, Inbar-Feigenberg M, Karp N, Kozenko M, Langley E, Lines M, Little J, MacKenzie J, Maranda B, Mercimek-Andrews S, Mhanni A, Mitchell JJ, Nagy L, Offringa M, Pender A, Potter M, Prasad C, Ratko S, Salvarinova R, Schulze A, Siriwardena K, Sondheimer N, Sparkes R, Stockler-Ipsiroglu S, Tapscott K, Trakadis Y, Turner L, Van Karnebeek C, Vandersteen A, Walia JS, Wilson BJ, Yu AC, Potter BK, Chakraborty P. Assessing the quality and value of metabolic chart data for capturing core outcomes for pediatric medium-chain acyl-CoA dehydrogenase (MCAD) deficiency. BMC Pediatr 2024; 24:37. [PMID: 38216926 PMCID: PMC10787451 DOI: 10.1186/s12887-023-04393-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/19/2023] [Accepted: 10/27/2023] [Indexed: 01/14/2024] Open
Abstract
BACKGROUND Generating rigorous evidence to inform care for rare diseases requires reliable, sustainable, and longitudinal measurement of priority outcomes. Having developed a core outcome set for pediatric medium-chain acyl-CoA dehydrogenase (MCAD) deficiency, we aimed to assess the feasibility of prospective measurement of these core outcomes during routine metabolic clinic visits. METHODS We used existing cohort data abstracted from charts of 124 children diagnosed with MCAD deficiency who participated in a Canadian study which collected data from birth to a maximum of 11 years of age to investigate the frequency of clinic visits and quality of metabolic chart data for selected outcomes. We recorded all opportunities to collect outcomes from the medical chart as a function of visit rate to the metabolic clinic, by treatment centre and by child age. We applied a data quality framework to evaluate data based on completeness, conformance, and plausibility for four core MCAD outcomes: emergency department use, fasting time, metabolic decompensation, and death. RESULTS The frequency of metabolic clinic visits decreased with increasing age, from a rate of 2.8 visits per child per year (95% confidence interval, 2.3-3.3) among infants 2 to 6 months, to 1.0 visit per child per year (95% confidence interval, 0.9-1.2) among those ≥ 5 years of age. Rates of emergency department visits followed anticipated trends by child age. Supplemental findings suggested that some emergency visits occur outside of the metabolic care treatment centre but are not captured. Recommended fasting times were updated relatively infrequently in patients' metabolic charts. Episodes of metabolic decompensation were identifiable but required an operational definition based on acute manifestations most commonly recorded in the metabolic chart. Deaths occurred rarely in these patients and quality of mortality data was not evaluated. CONCLUSIONS Opportunities to record core outcomes at the metabolic clinic occur at least annually for children with MCAD deficiency. Methods to comprehensively capture emergency care received at outside institutions are needed. To reduce substantial heterogeneous recording of core outcome across treatment centres, improved documentation standards are required for recording of recommended fasting times and a consensus definition for metabolic decompensations needs to be developed and implemented.
Collapse
Affiliation(s)
- Ryan Iverson
- School of Epidemiology and Public Health, University of Ottawa, Ottawa, Canada
| | - Monica Taljaard
- School of Epidemiology and Public Health, University of Ottawa, Ottawa, Canada
- Clinical Epidemiology Program, Ottawa Hospital Research Institute, Ottawa, Canada
| | - Michael T Geraghty
- Department of Pediatrics, Children's Hospital of Eastern Ontario and University of Ottawa, 401 Smyth Road, Ottawa, ON, K1H 8L1, Canada
| | - Michael Pugliese
- School of Epidemiology and Public Health, University of Ottawa, Ottawa, Canada
| | - Kylie Tingley
- School of Epidemiology and Public Health, University of Ottawa, Ottawa, Canada
| | - Doug Coyle
- School of Epidemiology and Public Health, University of Ottawa, Ottawa, Canada
| | | | - Kumanan Wilson
- School of Epidemiology and Public Health, University of Ottawa, Ottawa, Canada
- Clinical Epidemiology Program, Ottawa Hospital Research Institute, Ottawa, Canada
- Bruyère Research Institute, Ottawa, Canada
- Department of Medicine, University of Ottawa, Ottawa, Canada
| | - Valerie Austin
- The Hospital for Sick Children/University of Toronto, Toronto, Canada
| | | | | | - Nancy J Butcher
- The Hospital for Sick Children Research Institute/University of Toronto, Toronto, Canada
| | - Alicia K J Chan
- Department of Medical Genetics, University of Alberta/Stollery Children's Hospital, Edmonton, Canada
| | - Sarah Dyack
- IWK Health Centre/Dalhousie University, Halifax, Canada
| | - Sharan Goobie
- IWK Health Centre/Dalhousie University, Halifax, Canada
| | - Cheryl R Greenberg
- Health Sciences Centre Winnipeg/University of Manitoba, Winnipeg, Canada
| | - Shailly Jain-Ghai
- Department of Medical Genetics, University of Alberta/Stollery Children's Hospital, Edmonton, Canada
| | | | - Natalya Karp
- London Health Sciences Centre/Western University, London, Canada
| | | | - Erica Langley
- Department of Pediatrics, Children's Hospital of Eastern Ontario and University of Ottawa, 401 Smyth Road, Ottawa, ON, K1H 8L1, Canada
| | - Matthew Lines
- Hamilton Health Sciences Centre/McMaster University, Hamilton, Canada
| | - Julian Little
- School of Epidemiology and Public Health, University of Ottawa, Ottawa, Canada
| | - Jennifer MacKenzie
- McMaster Children's Hospital, Hamilton, Canada
- Janeway Children's Hospital/Memorial University, St John's, Canada
| | - Bruno Maranda
- CIUSSSE-CHUS, Université de Sherbrooke, Sherbrooke, Canada, Sherbrooke, Canada
| | | | - Aizeddin Mhanni
- Health Sciences Centre Winnipeg/University of Manitoba, Winnipeg, Canada
| | | | - Laura Nagy
- The Hospital for Sick Children/University of Toronto, Toronto, Canada
| | - Martin Offringa
- The Hospital for Sick Children Research Institute/University of Toronto, Toronto, Canada
| | - Amy Pender
- McMaster Children's Hospital, Hamilton, Canada
| | | | - Chitra Prasad
- London Health Sciences Centre/Western University, London, Canada
| | - Suzanne Ratko
- London Health Sciences Centre/Western University, London, Canada
| | - Ramona Salvarinova
- BC Children's Hospital/University of British Columbia, Vancouver, Canada
| | - Andreas Schulze
- The Hospital for Sick Children/University of Toronto, Toronto, Canada
| | - Komudi Siriwardena
- Department of Medical Genetics, University of Alberta/Stollery Children's Hospital, Edmonton, Canada
| | - Neal Sondheimer
- The Hospital for Sick Children/University of Toronto, Toronto, Canada
| | - Rebecca Sparkes
- Alberta Children's Hospital/University of Calgary, Calgary, Canada
| | | | - Kendra Tapscott
- BC Children's Hospital/University of British Columbia, Vancouver, Canada
| | | | - Lesley Turner
- Janeway Children's Hospital/Memorial University, St John's, Canada
| | - Clara Van Karnebeek
- BC Children's Hospital/University of British Columbia, Vancouver, Canada
- Emma Center for Personalized Medicine, Amsterdam University Medical Centers, Amsterdam, The Netherlands
| | | | - Jagdeep S Walia
- Kingston Health Sciences/Queen's University, Kingston, Canada
| | - Brenda J Wilson
- Janeway Children's Hospital/Memorial University, St John's, Canada
| | - Andrea C Yu
- Department of Pediatrics, Children's Hospital of Eastern Ontario and University of Ottawa, 401 Smyth Road, Ottawa, ON, K1H 8L1, Canada
| | - Beth K Potter
- School of Epidemiology and Public Health, University of Ottawa, Ottawa, Canada
| | - Pranesh Chakraborty
- Department of Pediatrics, Children's Hospital of Eastern Ontario and University of Ottawa, 401 Smyth Road, Ottawa, ON, K1H 8L1, Canada.
- Newborn Screening Ontario, Ottawa, Canada.
| |
Collapse
|
2
|
Tingley K, Lamoureux M, Pugliese M, Geraghty MT, Kronick JB, Potter BK, Coyle D, Wilson K, Kowalski M, Austin V, Brunel-Guitton C, Buhas D, Chan AKJ, Dyack S, Feigenbaum A, Giezen A, Goobie S, Greenberg CR, Ghai SJ, Inbar-Feigenberg M, Karp N, Kozenko M, Langley E, Lines M, Little J, MacKenzie J, Maranda B, Mercimek-Andrews S, Mohan C, Mhanni A, Mitchell G, Mitchell JJ, Nagy L, Napier M, Pender A, Potter M, Prasad C, Ratko S, Salvarinova R, Schulze A, Siriwardena K, Sondheimer N, Sparkes R, Stockler-Ipsiroglu S, Trakadis Y, Turner L, Van Karnebeek C, Vallance H, Vandersteen A, Walia J, Wilson A, Wilson BJ, Yu AC, Yuskiv N, Chakraborty P. Evaluation of the quality of clinical data collection for a pan-Canadian cohort of children affected by inherited metabolic diseases: lessons learned from the Canadian Inherited Metabolic Diseases Research Network. Orphanet J Rare Dis 2020; 15:89. [PMID: 32276663 PMCID: PMC7149838 DOI: 10.1186/s13023-020-01358-z] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/09/2019] [Accepted: 03/17/2020] [Indexed: 01/12/2023] Open
Abstract
BACKGROUND The Canadian Inherited Metabolic Diseases Research Network (CIMDRN) is a pan-Canadian practice-based research network of 14 Hereditary Metabolic Disease Treatment Centres and over 50 investigators. CIMDRN aims to develop evidence to improve health outcomes for children with inherited metabolic diseases (IMD). We describe the development of our clinical data collection platform, discuss our data quality management plan, and present the findings to date from our data quality assessment, highlighting key lessons that can serve as a resource for future clinical research initiatives relating to rare diseases. METHODS At participating centres, children born from 2006 to 2015 who were diagnosed with one of 31 targeted IMD were eligible to participate in CIMDRN's clinical research stream. For all participants, we collected a minimum data set that includes information about demographics and diagnosis. For children with five prioritized IMD, we collected longitudinal data including interventions, clinical outcomes, and indicators of disease management. The data quality management plan included: design of user-friendly and intuitive clinical data collection forms; validation measures at point of data entry, designed to minimize data entry errors; regular communications with each CIMDRN site; and routine review of aggregate data. RESULTS As of June 2019, CIMDRN has enrolled 798 participants of whom 764 (96%) have complete minimum data set information. Results from our data quality assessment revealed that potential data quality issues were related to interpretation of definitions of some variables, participants who transferred care across institutions, and the organization of information within the patient charts (e.g., neuropsychological test results). Little information was missing regarding disease ascertainment and diagnosis (e.g., ascertainment method - 0% missing). DISCUSSION Using several data quality management strategies, we have established a comprehensive clinical database that provides information about care and outcomes for Canadian children affected by IMD. We describe quality issues and lessons for consideration in future clinical research initiatives for rare diseases, including accurately accommodating different clinic workflows and balancing comprehensiveness of data collection with available resources. Integrating data collection within clinical care, leveraging electronic medical records, and implementing core outcome sets will be essential for achieving sustainability.
Collapse
Affiliation(s)
| | - Monica Lamoureux
- Newborn Screening Ontario, Children's Hospital of Eastern Ontario, 401 Smyth Road, Ottawa, Ontario, K1H 8L1, Canada
| | | | - Michael T Geraghty
- University of Ottawa, Ottawa, Ontario, Canada
- Newborn Screening Ontario, Children's Hospital of Eastern Ontario, 401 Smyth Road, Ottawa, Ontario, K1H 8L1, Canada
| | - Jonathan B Kronick
- The Hospital for Sick Children, University of Toronto, Toronto, Ontario, Canada
| | | | - Doug Coyle
- University of Ottawa, Ottawa, Ontario, Canada
| | - Kumanan Wilson
- University of Ottawa, Ottawa, Ontario, Canada
- Bruyère Research Institute, Ottawa, ON, Canada
- Department of Medicine, Ottawa Hospital Research Institute, Ottawa, ON, Canada
| | - Michael Kowalski
- Newborn Screening Ontario, Children's Hospital of Eastern Ontario, 401 Smyth Road, Ottawa, Ontario, K1H 8L1, Canada
| | - Valerie Austin
- The Hospital for Sick Children, University of Toronto, Toronto, Ontario, Canada
| | | | - Daniela Buhas
- Montreal Children's Hospital, McGill University, Montreal, Quebec, Canada
| | - Alicia K J Chan
- Stollery Children's Hospital, University of Alberta, Edmonton, Alberta, Canada
| | - Sarah Dyack
- IWK Health Centre, Dalhousie University, Halifax, Nova Scotia, Canada
| | - Annette Feigenbaum
- The Hospital for Sick Children, University of Toronto, Toronto, Ontario, Canada
| | - Alette Giezen
- BC Children's Hospital, University of British Columbia, Vancouver, British Columbia, Canada
| | - Sharan Goobie
- IWK Health Centre, Dalhousie University, Halifax, Nova Scotia, Canada
| | - Cheryl R Greenberg
- Health Sciences Centre Winnipeg, University of Manitoba, Winnipeg, Manitoba, Canada
| | - Shailly Jain Ghai
- Stollery Children's Hospital, University of Alberta, Edmonton, Alberta, Canada
| | | | - Natalya Karp
- London Health Sciences Centre, Western University, London, Ontario, Canada
| | - Mariya Kozenko
- Hamilton Health Sciences Centre, McMaster University, Hamilton, Ontario, Canada
| | - Erica Langley
- Newborn Screening Ontario, Children's Hospital of Eastern Ontario, 401 Smyth Road, Ottawa, Ontario, K1H 8L1, Canada
| | - Matthew Lines
- Newborn Screening Ontario, Children's Hospital of Eastern Ontario, 401 Smyth Road, Ottawa, Ontario, K1H 8L1, Canada
| | | | - Jennifer MacKenzie
- Hamilton Health Sciences Centre, McMaster University, Hamilton, Ontario, Canada
| | - Bruno Maranda
- Le centre hospitalier universitaire Sherbrooke, Sherbrooke, Quebec, Canada
| | | | - Connie Mohan
- Alberta Children's Hospital, University of Calgary, Calgary, Alberta, Canada
| | - Aizeddin Mhanni
- Health Sciences Centre Winnipeg, University of Manitoba, Winnipeg, Manitoba, Canada
| | - Grant Mitchell
- Le centre hospitalier universitaire Ste-Justine, Montreal, Quebec, Canada
| | - John J Mitchell
- Montreal Children's Hospital, McGill University, Montreal, Quebec, Canada
| | - Laura Nagy
- The Hospital for Sick Children, University of Toronto, Toronto, Ontario, Canada
| | - Melanie Napier
- London Health Sciences Centre, Western University, London, Ontario, Canada
| | - Amy Pender
- Hamilton Health Sciences Centre, McMaster University, Hamilton, Ontario, Canada
| | - Murray Potter
- Hamilton Health Sciences Centre, McMaster University, Hamilton, Ontario, Canada
| | - Chitra Prasad
- London Health Sciences Centre, Western University, London, Ontario, Canada
| | - Suzanne Ratko
- London Health Sciences Centre, Western University, London, Ontario, Canada
| | - Ramona Salvarinova
- BC Children's Hospital, University of British Columbia, Vancouver, British Columbia, Canada
| | - Andreas Schulze
- The Hospital for Sick Children, University of Toronto, Toronto, Ontario, Canada
| | - Komudi Siriwardena
- Stollery Children's Hospital, University of Alberta, Edmonton, Alberta, Canada
| | - Neal Sondheimer
- The Hospital for Sick Children, University of Toronto, Toronto, Ontario, Canada
| | - Rebecca Sparkes
- Alberta Children's Hospital, University of Calgary, Calgary, Alberta, Canada
| | | | - Yannis Trakadis
- Montreal Children's Hospital, McGill University, Montreal, Quebec, Canada
| | - Lesley Turner
- Janeway Children's Hospital, Memorial University, St John's, NL, Canada
| | - Clara Van Karnebeek
- BC Children's Hospital, University of British Columbia, Vancouver, British Columbia, Canada
| | - Hilary Vallance
- BC Children's Hospital, University of British Columbia, Vancouver, British Columbia, Canada
| | | | - Jagdeep Walia
- Kingston General Hospital, Queen's University, Kingston, Ontario, Canada
| | - Ashley Wilson
- The Hospital for Sick Children, University of Toronto, Toronto, Ontario, Canada
| | - Brenda J Wilson
- Janeway Children's Hospital, Memorial University, St John's, NL, Canada
| | - Andrea C Yu
- London Health Sciences Centre, Western University, London, Ontario, Canada
| | - Nataliya Yuskiv
- BC Children's Hospital, University of British Columbia, Vancouver, British Columbia, Canada
| | - Pranesh Chakraborty
- University of Ottawa, Ottawa, Ontario, Canada.
- Newborn Screening Ontario, Children's Hospital of Eastern Ontario, 401 Smyth Road, Ottawa, Ontario, K1H 8L1, Canada.
| |
Collapse
|