The pediatric heart network: meeting the challenges to multicenter studies in pediatric heart disease

Tips and tricks for successfully conducting a multicenter study

Multicenter studies play a crucial role in medical research and advancement, facilitating the application of new knowledge to clinical practice. These studies are associated with multiple benefits but are more complex than those involving a single center. With the philosophy that most of the qualities required to lead a multicenter study depend on attitude and can be learned, developed, and improved, in this manuscript, we share with the reader a series of recommendations that we consider important for successfully conducting such studies. The tips and tricks that will be discussed in detail are as follows: effectively leading the project; clearly defining viable and relevant objectives; designing a clear and detailed protocol; carefully selecting centers and collaborating investigators; meticulously designing the case report form; centrally managing the project efficiently; maintaining fluent communication with investigators; and, finally, designing a clear authorship policy and ensuring the appropriate publication of the study results. We hope that these suggestions encourage potential researchers to conduct multicenter studies, thereby collectively enhancing the quality of research and its application to clinical practice.

Evaluating registry-based trial economics: Results from the STRESS clinical trial

Background

Registry-based trials have the potential to reduce randomized clinical trial (RCT) costs. However, observed cost differences also may be achieved through pragmatic trial designs. A systematic comparison of trial costs across different designs has not been previously performed.

Methods

We conducted a study to compare the current Steroids to Reduce Systemic inflammation after infant heart surgery (STRESS) registry-based RCT vs. two established designs: pragmatic RCT and explanatory RCT. The primary outcome was total RCT design costs. Secondary outcomes included: RCT duration and personnel hours. Costs were estimated using the Duke Clinical Research Institute's pricing model.

Results

The Registry-Based RCT estimated duration was 31.9 weeks greater than the other designs (259.5 vs. 227.6 weeks). This delay was caused by the Registry-Based design's periodic data harvesting that delayed site closing and statistical reporting. Total personnel hours were greatest for the Explanatory design followed by the Pragmatic design and the Registry-Based design (52,488 vs 29,763 vs. 24,480 h, respectively). Total costs were greatest for the Explanatory design followed by the Pragmatic design and the Registry-Based design ($10,140,263 vs. $4,164,863 vs. $3,268,504, respectively). Thus, Registry-Based total costs were 32 % of the Explanatory and 78 % of the Pragmatic design.

Conclusion

Total costs for the STRESS RCT with a registry-based design were less than those for a pragmatic design and much less than an explanatory design. Cost savings reflect design elements and leveraging of registry resources to improve cost efficiency, but delays to trial completion should be considered.

A Scoping Review on Learning Health Networks Available in Pediatric Surgical Specialties

BACKGROUND

Learning health networks (LHN) are consortia of institutions that collaborate and embrace the elements of the learning health system (LHS), including quality improvement, education, research, and stakeholder involvement. Their ultimate goal is rapid information dissemination in clinical care. Pediatric surgical specialties perform unique yet high-impact procedures that could benefit from LHN, thereby improving surgical outcomes and care through LHS approaches. Consequently, health system leaders should be aware of LHN and their importance in enhancing surgical care and improving outcomes. This scoping review aims to map and characterize the existing LHN applied in pediatric surgical specialties.

METHODS

A systematic literature search was performed on Medline, EMBASE, and Scopus up to June 2022, with an update search conducted in May 2023. Additionally, Google Scholar, ProQuest and inquiry from topic experts were used for cross-referencing relevant review articles to identify grey literature. This scoping review was conducted and reported according to the PRISMA-scoping review extension.

RESULTS

A total of 56 publications for 19 LHN were identified and included in this scoping review. Out of 19 identified LHN in pediatric surgical specialties, 18 were organized in North America. Eight of the networks are related to pediatric general surgery and another eight were related to pediatric transplantation. The 16 out of 19 LHN were initiated after 2001. To date, only eight of the LHNs generated reports of comparative improved outcomes.

CONCLUSION

This scoping review provides an overview of the available LHNs in pediatric surgical specialties. Over the past decade, several pediatric surgical specialties have embraced the principles of learning health systems, forming inter-institutional collaborations that utilize information technology to generate big data on patient-level clinical information, engage in quality improvement cycles, adopt evidence-based practices, and actively involve patients and stakeholders.

LEVEL OF EVIDENCE

IV.

The paucity of high-level evidence for therapy in pediatric cardiology

Introduction

Clinical practice should be based on the highest quality of evidence available. Therefore, we aimed to classify publications in the field of pediatric cardiology in the year 2021 based on the level of scientific evidence.

Materials and Methods

A PubMed search was performed to identify pediatric cardiology articles published in the calendar year 2021. The abstract or manuscript of each study was reviewed. Each study was categorized as high, medium, or low level of evidence based on the study design. Disease investigated, treatment studied, and country of publication were recorded. Randomized control trials (RCTs) in similar fields of neonatology and adult cardiology were identified for comparison. Descriptive statistics were performed on the level of evidence, type of disease, country of publication, and therapeutic intervention.

Results

In 2021, 731 studies were identified. A decrease in prevalence for the level of evidence as a function of low, medium, and high was found (50.1%, 44.2%, and 5.8%, respectively). A low level of evidence studies was the majority for all types of cardiac disease identified, including acquired heart disease, arrhythmias, congenital heart disease, and heart failure, and for treatment modalities, including circulatory support, defibrillator, percutaneous intervention, medicine, and surgery. In a subgroup analysis, most high-level evidence studies were from the USA (31%), followed by China (26.2%) and India (14.3%). Comparing RCTs, 21 RCTs were identified in pediatric cardiology compared to 178 in neonatology and 413 in adult ischemic heart disease.

Conclusions

There is a great need for the conduct of studies that offer a high level of evidence in the discipline of pediatric cardiology.

Multicenter Clinical Research in Congenital Heart Disease: Leveraging Research Networks to Investigate Important Unanswered Questions

Congenital heart disease (CHD) is the most common birth defect in the United States. Neonates with CHD are often cared for by neonatologists in addition to cardiologists. However, there is a paucity of rigorous evidence and limited clinical trials regarding the management of neonates with CHD. In this review, we will describe some of the challenges of research in this field. The Pediatric Heart Network serves as an example of how a research network can effectively overcome barriers to conduct and execute well-designed multicenter studies.

Visualization and Quantification of the Unrepaired Complete Atrioventricular Canal Valve Using Open-Source Software

BACKGROUND

Repair of complete atrioventricular canal (CAVC) is often complicated by residual left atrioventricular valve regurgitation. The structure of the mitral and tricuspid valves in biventricular hearts has previously been shown to be associated with valve dysfunction. However, the three-dimensional (3D) structure of the entire unrepaired CAVC valve has not been quantified. Understanding the 3D structure of the CAVC may inform optimized repair.

METHODS

Novel open-source work flows were created in SlicerHeart for the modeling and quantification of CAVC valves on the basis of 3D echocardiographic images. These methods were applied to model the annulus, leaflets, and papillary muscle (PM) structure of 35 patients (29 with trisomy 21) with CAVC using transthoracic 3D echocardiography. The mean leaflet and annular shapes were calculated and visualized using shape analysis. Metrics of the complete native CAVC valve structure were compared with those of normal mitral valves using the Mann-Whitney U test. Associations between CAVC structure and atrioventricular valve regurgitation were analyzed.

RESULTS

CAVC leaflet metrics varied throughout systole. Compared with normal mitral valves, the left CAVC PMs were more acutely angled in relation to the annular plane (P < .001). In addition, the anterolateral PM was laterally and inferiorly rotated in CAVC, while the posteromedial PM was more superiorly and laterally rotated, relative to normal mitral valves (P < .001). Lower native CAVC atrioventricular valve annular height and annular height-to-valve width ratio before repair were both associated with moderate or greater left atrioventricular valve regurgitation after repair (P < .01).

CONCLUSIONS

It is feasible to model and quantify 3D CAVC structure using 3D echocardiographic images. The results demonstrate significant variation in CAVC structure across the cohort and differences in annular, leaflet, and PM structure compared with the mitral valve. These tools may be used in future studies to catalyze future research intended to identify structural associations of valve dysfunction and to optimize repair in this vulnerable and complex population.

Unique Challenges of Randomised Controlled Trials in Pediatric Cardiology

Pediatric cardiology has evolved over time with reductions in childhood mortality due to congenital heart disease. Surgical innovation drove early changes in care. Increasingly, the need for more robust evidence provided by randomised controlled trials (RCTs) has been recognised. Although the number of RCTs has increased, there remains a relative paucity of truly impactful trials in the field. However, those trials that have changed practice have demonstrated the potential and importance of this work. Examples include the PRIMACORP trial, which established the safety and efficacy of milrinone after cardiac surgery, and the Single Ventricle Reconstruction trial, which was the first multicentre pediatric cardiac surgical RCT. The successful conduct and important findings emanating from these trials serve as beacons as clinicians strive to improve the evidence base in this field. The establishment of national and international networks such as the Pediatric Heart Network and the Canadian Pediatric Cardiology Research Network provide a strong foundation for future collaborative work. Despite this progress, there remain important challenges to designing and executing RCTs in pediatric cardiology. These include issues of greater disease and patient heterogeneity and increased costs. The use of innovative study designs and analytic methods and the establishment of core outcome measures have the potential to overcome some of the issues related to the smaller patient numbers compared with adult disciplines. As pediatric cardiologists look to the future, it is imperative that we work together to derive the maximum benefit from the considerable efforts directed toward conducting impactful clinical trials in pediatric cardiology.

Recruitment, retention, and adherence in a clinical trial: The Pediatric Heart Network's Marfan Trial experience

BACKGROUND/AIMS

The Pediatric Heart Network Marfan Trial was a randomized trial comparing atenolol versus losartan on aortic root dilation in 608 children and young adults with Marfan syndrome. Barriers to enrollment included a limited pool of eligible participants, restrictive entry criteria, and a diverse age range that required pediatric and adult expertise. Retention was complicated by a 3-year commitment to a complex study and medication regimen. The Network partnered with the Marfan Foundation, bridging the community with the research. The aims of this study are to report protocol and medication adherence and associated predictive factors, and to describe recruitment and retention strategies.

METHODS

Recruitment, retention, and adherence to protocol activities related to the primary outcome were measured. Retention was measured by percentage of enrolled participants with 3-year outcome data. Protocol adherence was calculated by completion rates of study visits, ambulatory electrocardiography (Holter monitoring), and quarterly calls. Medication adherence was assessed by the number of tablets or the amount of liquid in bottles returned. Centers were ranked according to adherence (high, medium, and low tertiles). Recruitment, retention, and adherence questionnaires were completed by sites. Descriptive statistics summarized recruitment, retention, and adherence, as well as questionnaire results. Regression modeling assessed predictors of adherence.

RESULTS

Completion rates for visits, Holter monitors, and quarterly calls were 99%, 94%, and 96%, respectively. Primary outcome data at 3 years were obtained for 88% of participants. The mean percentage of medication taken was estimated at 89%. Site and age were associated with all measures of adherence. Young adult and African American participants had lower levels of adherence. Higher adherence sites employed more strategies; had more staffing resources, less key staff turnover, and more collaboration with referring providers; utilized the Foundation's resources; and used a greater number of strategies to recruit, retain, and promote protocol and medication adherence.

CONCLUSION

Overall adherence was excellent for this trial conducted within a National Institutes of Health-funded clinical trial network. Strategies specifically targeted to young adults and African Americans may have been beneficial. Many strategies employed by higher adherence sites are ones that any site could easily use, such as greeting families at non-study hospital visits, asking for family feedback, providing calendars for tracking schedules, and recommending apps for medication reminders. Additional key learnings include adherence differences by age, race, and site, the value of collaborative learning, and the importance of partnerships with patient advocacy groups. These lessons could shape recruitment, retention, and adherence to improve the quality of future complex trials involving rare conditions.

National Heart, Lung, and Blood Institute cardiovascular clinical trial perspective

The National Heart, Lung, and Blood Institute (NHLBI) has played an important role in funding the clinical science that supports many contemporary cardiology practice guidelines and in shaping the conduct of cardiovascular clinical trials. This Perspective outlines contemporary funding options as well as select important NHLBI policies, philosophy, and priorities.

Self-management Needs of Adults With Congenital Heart Disease

BACKGROUND

Adults with congenital heart disease (CHD) are an emerging adult heart disease subset, now outnumbering the pediatric population with CHD.

OBJECTIVE

We aimed to gain understanding and knowledge of what adults with CHD perceive as important for self-management and describe these needs across demographic factors, developmental characteristics, lesion severity, and quality of life.

METHODS

We used a descriptive mixed-methods online survey merging 4 instruments: Adult CHD Self-management Experience Questionnaire; Adult CHD Demographic Questionnaire; Adaptive Behavior Assessment System, Third Edition; and Stanford Quality of Life Visual Numeric. Participants with CHD 18 to 30 years of age with initial defect repair before 12 months of age were recruited through support from the Adult Congenital Heart Association, clinic adult CHD support groups, and newspaper advertising. Thematic analysis for short-answer questions, descriptive analysis for demographic data and the visual numeric, and intrument-specific scoring assistant software for the Adaptive Behavior Assessment System were used.

RESULTS

We received 22 responses from 13 women and 9 men. These individuals represented 15 different heart defect diagnoses, mostly of moderate or complex lesion severity. Most had postsecondary education and were employed. Four prominent themes emerged related to self-management: desire for connectivity-psychological support; a plan for the future-education about health and life expectations; coping needs-skills for mental stress; and access to care-navigation of healthcare systems.

CONCLUSIONS

Future longitudinal research and replication studies with larger samples are needed. Educational materials and targeted interventions that promote self-management benefit the aging adult with CHD population.

The Pediatric Heart Network Scholar Award programme: a unique mentored award embedded within a multicentre network

BACKGROUND

The Pediatric Heart Network designed a career development award to train the next generation of clinician scientists in paediatric-cardiology-related research, a historically underfunded area. We sought to identify the strengths/weaknesses of the programme and describe the scholars' academic achievements and the network's return on investment.

METHODS

Survey questions designed to evaluate the programme were sent to applicants - 13 funded and 19 unfunded applicants - and 20 mentors and/or principal investigators. Response distributions were calculated. χ2 tests of association assessed differences in ratings of the application/selection processes among funded scholars, unfunded applicants, and mentors/principal investigators. Scholars reported post-funding academic achievements.

RESULTS

Survey response rates were 88% for applicants and 100% for mentor/principal investigators. Clarity and fairness of the review were rated as "clear/fair" or "very clear/very fair" by 98% of respondents, but the responses varied among funded scholars, unfunded applicants, and mentors/principal investigators (clarity χ2=10.85, p=0.03; fairness χ2=16.97, p=0.002). Nearly half of the unfunded applicants rated feedback as "not useful" (47%). "Expanding their collaborative network" and "increasing publication potential" were the highest-rated benefits for scholars. Mentors/principal investigators found the programme "very" valuable for the scholars (100%) and the network (75%). The 13 scholars were first/senior authors for 97 abstracts and 109 manuscripts, served on 22 Pediatric Heart Network committees, and were awarded $9,673,660 in subsequent extramural funding for a return of ~$10 for every scholar dollar spent.

CONCLUSIONS

Overall, patient satisfaction with the Scholar Award was high and scholars met many academic markers of success. Despite this, programme challenges were identified and improvement strategies were developed.