Development of an Electronic Algorithm to Target Outpatient Antimicrobial Stewardship Efforts for Acute Bronchitis and Pharyngitis

Background

A major challenge for antibiotic stewardship programs is the lack of accurate and accessible electronic data to target interventions. We developed and validated separate electronic algorithms to identify inappropriate antibiotic use for adult outpatients with bronchitis and pharyngitis.

Methods

We used International Classification of Diseases, 10th Revision, diagnostic codes to identify patient encounters for acute bronchitis and pharyngitis at outpatient practices between 3/15/17 and 3/14/18. Exclusion criteria included immunocompromising conditions, complex chronic conditions, and concurrent infections. We randomly selected 300 eligible subjects each with bronchitis and pharyngitis. Inappropriate antibiotic use based on chart review served as the gold standard for assessment of the electronic algorithm, which was constructed using only data in the electronic data warehouse. Criteria for appropriate prescribing, choice of antibiotic, and duration were based on established guidelines.

Results

Of 300 subjects with bronchitis, 167 (55.7%) received an antibiotic inappropriately based on chart review. The electronic algorithm demonstrated 100% sensitivity and 95.3% specificity for detection of inappropriate prescribing. Of 300 subjects with pharyngitis, 94 (31.3%) had an incorrect prescribing decision. Among 29 subjects with a positive rapid streptococcal antigen test, 27 (93.1%) received an appropriate antibiotic and 29 (100%) received the correct duration. The electronic algorithm demonstrated very high sensitivity and specificity for all outcomes.

Conclusions

Inappropriate antibiotic prescribing for bronchitis and pharyngitis is common. Electronic algorithms for identifying inappropriate prescribing, antibiotic choice, and duration showed excellent test characteristics. These algorithms could be used to efficiently assess prescribing among practices and individual clinicians. Interventions based on these algorithms should be tested in future work.

COVID-19 and Antibiotic Prescribing in Pediatric Primary Care

BACKGROUND AND OBJECTIVES

With the onset of the coronavirus disease 2019 (COVID-19) pandemic, pediatric ambulatory encounter volume and antibiotic prescribing both decreased; however, the durability of these reductions in pediatric primary care in the United States has not been assessed.

METHODS

We conducted a retrospective observational study to assess the impact of the COVID-19 pandemic and associated public health measures on antibiotic prescribing in 27 pediatric primary care practices. Encounters from January 1, 2018, through June 30, 2021, were included. The primary outcome was monthly antibiotic prescriptions per 1000 patients. Interrupted time series analysis was performed.

RESULTS

There were 69 327 total antibiotic prescriptions from April through December in 2019 and 18 935 antibiotic prescriptions during the same months in 2020, a 72.7% reduction. The reduction in prescriptions at visits for respiratory tract infection (RTI) accounted for 87.3% of this decrease. Using interrupted time series analysis, overall antibiotic prescriptions decreased from 31.6 to 6.4 prescriptions per 1000 patients in April 2020 (difference of -25.2 prescriptions per 1000 patients; 95% CI: -32.9 to -17.5). This was followed by a nonsignificant monthly increase in antibiotic prescriptions, with prescribing beginning to rebound from April to June 2021. Encounter volume also immediately decreased, and while overall encounter volume quickly started to recover, RTI encounter volume returned more slowly.

CONCLUSIONS

Reductions in antibiotic prescribing in pediatric primary care during the COVID-19 pandemic were sustained, only beginning to rise in 2021, primarily driven by reductions in RTI encounters. Reductions in viral RTI transmission likely played a substantial role in reduced RTI visits and antibiotic prescriptions.

162. The Impact of the COVID-19 Pandemic on Antibiotic Prescribing in Pediatric Primary Care

Background

With the onset of the coronavirus disease 2019 (COVID-19) pandemic, pediatric primary care delivery changed rapidly. Prior studies have demonstrated a reduction in ambulatory encounters and antibiotic prescriptions with the pandemic onset; however, the durability of these reductions in pediatric primary care in the United States has not been assessed.

Methods

We conducted a retrospective cohort study to assess the impact of the COVID-19 pandemic and associated public health measures (e.g. social distancing, masking, school closures, and increased availability of telemedicine) on antibiotic prescribing and encounter volume in 27 pediatric primary care practices, and the duration of these changes. Patients under age 19 with an encounter from January 1, 2018 through December 31, 2020 were included. The primary outcome was monthly antibiotic prescriptions per 1000 patients, in the overall population and a subset of encounters with infectious diagnoses, including respiratory tract infections (RTIs). Interrupted time series (ITS) analysis was performed.

Results

There were 60,562 total antibiotic prescriptions from April to December in 2019 and 14,605 antibiotic prescriptions during the same months in 2020, a 76% reduction. The reduction in RTI encounter prescriptions accounted for 91.5% of the overall reduction in prescriptions from 2019 to 2020. Using ITS analysis, there was an immediate decrease from 31.6 to 7.4 prescriptions/1000 patients (predicted means) in April 2020 (-24.2 prescriptions/1000 patients; 95% CI: -31.9, -16.4) (Figures 1 and 2). This was followed by a stable rate of antibiotic prescriptions that remained flat through December 2020. For RTI encounters, a similar pattern was seen, with a decrease by 21.8 prescriptions/1000 patients; 95% CI: -29.5, -14.2) (Figures 1 and 2). Encounter volume also decreased immediately, and while overall encounter volume began returning to a pre-pandemic baseline volume toward the end of the study period, RTI encounter volume remained persistently lower through December 2020 (Figure 3).

Figure 1. Antibiotic prescriptions per 1000 patients prescribed by month from January 2018 to December 2020, overall and for disease-specific subgroups

Conclusion

Dramatic reductions in antibiotic prescribing in pediatric primary care during the COVID-19 pandemic were sustained through 2020, primarily driven by reductions in RTI encounters.

Disclosures

All Authors: No reported disclosures

Improving Care Management in Attention-Deficit/Hyperactivity Disorder: An RCT

OBJECTIVES

To compare the effectiveness of care management combined with a patient portal versus a portal alone for communication among children with attention-deficit/hyperactivity disorder (ADHD).

METHODS

Randomized controlled trial conducted at 11 primary care practices. Children aged 5 to 12 years old with ADHD were randomly assigned to care management + portal or portal alone. The portal included parent-reported treatment preferences and goals, medication side effects, and parent- and teacher-reported ADHD symptom scales. Care managers provided education to families; communicated quarterly with parents, teachers, and clinicians; and coordinated care. The main outcome, changes in the Vanderbilt Parent Rating Scale (VPRS) score as a measure of ADHD symptoms, was assessed using intention-to-treat analysis.

RESULTS

A total of 303 eligible children (69% male; 46% Black) were randomly assigned, and 273 (90%) completed the study. During the 9-month study, parents in the care management + portal arm communicated inconsistently with care managers (mean 2.2; range 0-6) but similarly used the portal (mean 2.3 vs 2.2) as parents in the portal alone arm. In multivariate models, VPRS scores decreased over time (Adjusted β = -.015; 95% confidence interval -0.023 to -0.07) in both groups, but there were no intervention-by-time effects (Adjusted β = .000; 95% confidence interval -0.011 to 0.012) between groups. Children who received ≥2 care management sessions had greater reductions in VPRS scores than those with fewer sessions.

CONCLUSIONS

Results did not provide evidence that care management combined with a patient portal was different from portal use alone among children with ADHD. Both groups demonstrated similar reductions in ADHD symptoms. Those families with greater care management engagement demonstrated greater reductions than those with less engagement.

Why Is the Electronic Health Record So Challenging for Research and Clinical Care?

BACKGROUND

 The electronic health record (EHR) has become increasingly ubiquitous. At the same time, health professionals have been turning to this resource for access to data that is needed for the delivery of health care and for clinical research. There is little doubt that the EHR has made both of these functions easier than earlier days when we relied on paper-based clinical records. Coupled with modern database and data warehouse systems, high-speed networks, and the ability to share clinical data with others are large number of challenges that arguably limit the optimal use of the EHR OBJECTIVES:  Our goal was to provide an exhaustive reference for those who use the EHR in clinical and research contexts, but also for health information systems professionals as they design, implement, and maintain EHR systems.

METHODS

 This study includes a panel of 24 biomedical informatics researchers, information technology professionals, and clinicians, all of whom have extensive experience in design, implementation, and maintenance of EHR systems, or in using the EHR as clinicians or researchers. All members of the panel are affiliated with Penn Medicine at the University of Pennsylvania and have experience with a variety of different EHR platforms and systems and how they have evolved over time.

RESULTS

 Each of the authors has shared their knowledge and experience in using the EHR in a suite of 20 short essays, each representing a specific challenge and classified according to a functional hierarchy of interlocking facets such as usability and usefulness, data quality, standards, governance, data integration, clinical care, and clinical research.

CONCLUSION

 We provide here a set of perspectives on the challenges posed by the EHR to clinical and research users.

89. Construction of an Electronic Algorithm to Efficiently Target Antimicrobial Stewardship Efforts for Adults Hospitalized with Community-acquired Pneumonia

Background

Although antibiotic stewardship programs (ASPs) have had success in curtailing inappropriate antibiotic use, they remain time- and labor-intensive. To expand the reach of ASPs, approaches to more efficiently target ASP efforts are urgently needed. We developed and validated an electronic algorithm to identify inappropriate antibiotic use in patients hospitalized with community-acquired pneumonia (CAP).

Methods

Within the Hospital of the University of Pennsylvania (HUP) and Penn Presbyterian Medical Center (PPMC), we used ICD-10 diagnostic codes to identify inpatient patient encounters for pneumonia between 3/15/17 – 3/14/18 for which patients received a systemic antibiotic in the first 48 hours of hospitalization. Exclusion criteria included transfer from another facility, intensive care unit admission or death in first 48 hours, immunocompromising condition, or specific comorbidities. We randomly selected 300 subjects (150-HUP, 150-PPMC). Inappropriateness of antibiotic use based on chart review served as the basis for assessment of the electronic algorithm which was constructed using only data in the electronic health record (EHR). Criteria for appropriate prescribing, choice of antibiotic, and duration of therapy were based on established hospital and IDSA guidelines.

Results

Of 300 subjects, median age was 60, 53% were female, and median hospital stay was 4.25 days. Of the 300 subjects, 237 (79%) were admitted to general medicine, hospitalist, family medicine, or geriatrics services. On chart review, 295 (98%) subjects were correctly diagnosed with CAP. Of these subjects, the choice of initial antibiotic(s) was appropriate in 263 (89%). Of these 263 subjects, 222 (84%) had an appropriate duration of therapy. Test characteristics of the EHR algorithm (compared to chart review) are noted in the Table.

Conclusion

An electronic algorithm for identifying inappropriate prescribing, antibiotic choice, and duration is highly accurate for patients hospitalized for CAP. This algorithm could be used to efficiently target ASP initiatives. The impact of interventions based on this algorithm should be tested in future studies.

Test Characteristics of Electronic Algorithm for Inappropriate Prescribing, Agent, and Duration

Disclosures

All Authors: No reported disclosures

154. Development of an Electronic Algorithm to Target Outpatient Antimicrobial Stewardship Efforts for Adults with Acute Pharyngitis

Background

Although most antibiotic use occurs in outpatients, antibiotic stewardship programs (ASPs) have primarily focused on inpatients. A major challenge for outpatient ASPs is lack of accurate and accessible electronic data to target interventions. We developed and validated an electronic algorithm to identify inappropriate antibiotic use for adult outpatients with acute pharyngitis.

Methods

In the University of Pennsylvania Health System, we used ICD-10 diagnostic codes to identify patient encounters for acute pharyngitis at outpatient practices between 3/15/17 – 3/14/18. Exclusion criteria included immunocompromising conditions, comorbidities, and concurrent infections that might require antibiotic use. We randomly selected 300 eligible subjects. Inappropriate antibiotic use based on chart review served as the basis for assessment of the electronic algorithm which was constructed using only data in the electronic health record (EHR). Criteria for appropriate prescribing, choice of antibiotic, and duration included positive streptococcal testing, use of penicillin/amoxicillin (absent b-lactam allergy), and 10 days maximum duration of therapy.

Results

Of 300 subjects, median age was 42, 75% were female, 64% were seen by internal medicine (vs. family medicine), and 69% were seen by a physician (vs. advanced practice provider). On chart review, 127 (42%) subjects received an antibiotic, of which 29 had a positive streptococcal test and 4 had another appropriate indication. Thus, 74% (94/127) of patients received antibiotics inappropriately. Of the 29 patients who received appropriate prescribing, 27 (93%) received an appropriate antibiotic. Finally, of the 29 patients who were appropriately treated, 29 (100%) received the correct duration. Test characteristics of the EHR algorithm (compared to chart review) are noted in the Table.

Conclusion

Inappropriate antibiotic prescribing for acute pharyngitis is common. An electronic algorithm for identifying inappropriate prescribing, antibiotic choice, and duration is highly accurate. This algorithm could be used to efficiently assess prescribing among practices and individual clinicians. The impact of interventions based on this algorithm should be tested in future work.

Test Characteristics of Electronic Algorithm for Inappropriate Prescribing, Agent, and Duration

Disclosures

All Authors: No reported disclosures

91. Development of an Electronic Algorithm to Identify Inappropriate Antibiotic Prescribing for Pediatric Otitis Media

Background

Antibiotic stewardship (AS) interventions have primarily focused on acute care settings. The majority of antibiotic use, however, occurs in outpatients. The electronic health record (EHR) might provide an effective and efficient tool for outpatient AS. We aimed to develop and validate an electronic algorithm to identify inappropriate antibiotic use for pediatric outpatients with acute otitis media (AOM).

Methods

Within the Children’s Hospital of Philadelphia (CHOP) Care Network, we used ICD-10 diagnostic codes to identify patient encounters for AOM at any CHOP practice between 3/15/17 – 3/14/18. Exclusion criteria included underlying immunocompromising condition, comorbidities, and concurrent infections that might influence antibiotic use. We randomly selected 450 eligible subjects (150 each from academic practices, non-academic practices, and urgent care). Inappropriate antibiotic use based on CHOP and professional society guidelines were assessed via chart review and served as the basis for assessment of the electronic algorithm which was constructed using only data in the electronic health record (EHR). Criteria for appropriateness focused on the decision to prescribe, the choice of antibiotic, and duration of therapy.

Results

Of 450 subjects, median age was 2, 46% were female, and 88% were evaluated by a physician (vs. advanced practice provider). On chart review, the prescribing decision was correct in 438 (97%), of which 25 appropriately received no antibiotics. Of the 413 subjects who were appropriately prescribed an antibiotic, the choice of antibiotic was appropriate in 37 (9%). Finally, of the 413 patients who were appropriately treated, 412 (99.7%) received the correct duration. Test characteristics of the EHR algorithm (compared to chart review) are noted in the Table.

Conclusion

For children with AOM, an electronic algorithm for identification of inappropriate antibiotic prescribing is highly accurate. This algorithm can also highlight for which elements of prescribing the impact of an intervention might be greatest (i.e., choice of agent). Future work should validate this approach in other health systems and geographic regions and evaluate the impact of an audit and feedback intervention based on this tool.

Table. Test Characteristics of Electronic Algorithm for Inappropriate Prescribing, Agent, and Duration

Disclosures

All Authors: No reported disclosures

151. An Electronic Algorithm to Better Target Antimicrobial Stewardship Program (ASP) Efforts for Children Hospitalized with Community-Acquired Pneumonia (CAP)

Background

Pediatric antibiotic stewardship programs (ASPs) have been successful in decreasing inappropriate antibiotic use. However, they require considerable time and effort. Approaches to increase ASP efficiency are urgently needed. We developed and validated an electronic algorithm to identify inappropriate antibiotic use in children hospitalized with community-acquired pneumonia (CAP).

Methods

At Children’s Hospital of Philadelphia (CHOP), we used ICD-10 diagnostic codes to identify inpatient patient encounters for pneumonia between 3/15/17 – 3/14/18 for which patients received a systemic antibiotic in the first 48 hours of hospitalization. Exclusion criteria included transfer from another facility, intensive care unit admission or death in first 48 hours, immunocompromising condition, or specific comorbidities. We randomly selected 150 subjects. Inappropriate antibiotic use based on chart review served as the basis for assessment of the electronic algorithm which was constructed using only data in the electronic health record (EHR). Criteria for appropriate prescribing, choice of antibiotic, and duration of therapy were based on established CHOP and IDSA/PIDS guidelines.

Results

Of 148 eligible subjects, median age was 3.8, 48% were female, and 129 (86%) were admitted to a general pediatrics service. On chart review, 147 (99%) subjects were correctly diagnosed with CAP. Of these subjects, the choice of initial antibiotic(s) was appropriate in 133 (90%). Of the 147 subjects, 137 (93%) had an appropriate duration of therapy. Test characteristics of the EHR algorithm (compared to chart review) are noted in the Table.

Conclusion

In pediatric patients hospitalized with CAP, the electronic algorithm for identifying inappropriate prescribing, antibiotic choice, and duration was highly accurate. This algorithm could have considerable utility in targeting ASP initiatives. The impact of interventions based on this algorithm should be tested in the future

Test Characteristics of Electronic Algorithm for Inappropriate Prescribing, Agent, and Duration

Disclosures

All Authors: No reported disclosures

Performance of Pediatric Systemic Inflammatory Response Syndrome and Organ Dysfunction Criteria in Late-Onset Sepsis in a Quaternary Neonatal Intensive Care Unit: A Case-Control Study

OBJECTIVES

To evaluate accuracy of systemic inflammatory response syndrome (SIRS) criteria in identifying culture-proven late-onset neonatal sepsis and to assess prevalence of organ dysfunction and its relationship with SIRS criteria.

STUDY DESIGN

This was a retrospective case-control study of patients in the Children's Hospital of Philadelphia level IV neonatal intensive care unit undergoing sepsis evaluations (concurrent blood culture and antibiotics). During calendar years 2016-2017, 77 case and 77 control sepsis evaluations were identified. Cases included infants who had sepsis evaluations with positive blood cultures and antibiotic duration ≥7 days. Controls were matched by gestational and postmenstrual age, and had sepsis evaluations with negative blood cultures and antibiotic duration ≤48 hours. SIRS criteria were determined at time of sepsis evaluation, and organ dysfunction evaluated in the 72 hours following sepsis evaluation. Statistical analysis included descriptive statistics, Mann-Whitney tests, and χ² (Fisher exact) tests.

RESULTS

At time of sepsis evaluation, 42% of cases and 26% of controls met SIRS criteria. Among infants of ≤37 weeks postmenstrual age, SIRS criteria were met in only 17% of sepsis evaluations (4 of 23 in both cases and controls). Test characteristics for SIRS at diagnosis of culture-proven sepsis included sensitivity 42% and specificity 74%. Cases had higher rates of new organ dysfunction within 72 hours (40% vs 21%); however, 58% of cases developing organ dysfunction did not meet SIRS criteria at time of sepsis evaluation. Of 6 deaths (all cases with organ dysfunction), 2 did not meet SIRS criteria at sepsis evaluation.

CONCLUSIONS

SIRS criteria did not accurately identify culture-proven late-onset sepsis, with poorest accuracy in preterm infants. SIRS criteria did not predict later organ dysfunction or mortality.

Incidence of Healthcare-Associated Influenza-Like Illness After a Primary Care Encounter Among Young Children

BACKGROUND

Despite potential respiratory virus transmission in pediatric clinics, little is known about the risk of healthcare-associated viral infections attributable to outpatient encounters. We evaluated whether exposure to a pediatric clinic visit was associated with subsequent influenza-like illness (ILI).

METHODS

Using electronic health record data, we conducted a retrospective cohort study of all children aged <6 years who presented to a provider in a 29-clinic pediatric primary care network for a non-ILI-related encounter over 2 respiratory virus seasons (September 1, 2012, to April 30, 2014). We defined a risk period for potential healthcare-associated (HA) ILI of 1 to 8 days after a non-ILI clinic visit and identified all cases of ILI to compare the incidences of ILI visits 1 to 8 days after a non-ILI encounter and those of visits >8 days after a non-ILI encounter.

RESULTS

Among 149987 children <6 years of age (mean age, 2.5 years) with ≥1 non-ILI visit during the study period, 531928 total encounters and 13951 (2.9%) ILI encounters were identified; 1941 (13.9%) occurred within the HA-ILI risk window. The incidence rate ratios (IRRs) for ILI 1 to 8 days after compared with ILI >8 days after a non-ILI visit during season 1 were 1.36 (95% confidence interval, 1.22-1.52) among children ≥2 years of age and 1.01 (95% confidence interval, 0.93-1.09) among children <2 years of age. Estimates remained consistent during season 2 and with a risk window of 3, 4, or 9 days.

CONCLUSIONS

Pediatric clinic visits during a respiratory virus season were significantly associated with an increased incidence of subsequent ILI among children aged 2 to 6 years but not among those aged <2 years. These findings support the hypothesis that respiratory virus transmission in a pediatric clinic can result in HA ILI in young children.

Identifying Electronic Health Record Usability And Safety Challenges In Pediatric Settings

Pediatric populations are uniquely vulnerable to the usability and safety challenges of electronic health records (EHRs), particularly those related to medication, yet little is known about the specific issues contributing to hazards. To understand specific usability issues and medication errors in the care of children, we analyzed 9,000 patient safety reports, made in the period 2012-17, from three different health care institutions that were likely related to EHR use. Of the 9,000 reports, 3,243 (36 percent) had a usability issue that contributed to the medication event, and 609 (18.8 percent) of the 3,243 might have resulted in patient harm. The general pattern of usability challenges and medication errors were the same across the three sites. The most common usability challenges were associated with system feedback and the visual display. The most common medication error was improper dosing.

Creation of a Multicenter Pediatric Inpatient Data Repository Derived from Electronic Health Records

BACKGROUND

Integration of electronic health records (EHRs) data across sites and access to that data remain limited.

OBJECTIVE

We developed an EHR-based pediatric inpatient repository using nine U.S. centers from the National Institute of Child Health and Human Development Pediatric Trials Network.

METHODS

A data model encompassing 147 mandatory and 99 optional elements was developed to provide an EHR data extract of all inpatient encounters from patients <17 years of age discharged between January 6, 2013 and June 30, 2017. Sites received instructions on extractions, transformation, testing, and transmission to the coordinating center.

RESULTS

We generated 177 staging reports to process all nine sites' 147 mandatory and 99 optional data elements to the repository. Based on 520 prespecified criteria, all sites achieved 0% errors and <2% warnings. The repository includes 386,159 inpatient encounters from 264,709 children to support study design and conduct of future trials in children.

CONCLUSION

Our EHR-based data repository of pediatric inpatient encounters utilized a customized data model heavily influenced by the PCORnet format, site-based data mapping, a comprehensive set of data testing rules, and an iterative process of data submission. The common data model, site-based extraction, and technical expertise were key to our success. Data from this repository will be used in support of Pediatric Trials Network studies and the labeling of drugs and devices for children.

2132. Infections After Pediatric Ambulatory Surgery: Incidence and Risk Factors

Background

Approximately 3 million pediatric ambulatory surgical procedures are performed each year in the United States; however, little is known about the incidence of and risk factors for surgical site infections (SSI) after pediatric surgical procedures performed in these settings. Therefore, we aimed to describe the epidemiology of SSI in children after ambulatory surgery.

Methods

We conducted a prospective, observational study in a single healthcare network with three ambulatory surgical facilities (ASF) and one hospital-based facility. We enrolled children <18 years who had an ambulatory surgical procedure between June 2012 and December 2015. Data on follow-up care were collected via a structured telephone interview (30–45 days post-surgery) and review of the electronic health record (EHR) 60 days post-surgery. We identified SSIs 30 days after surgery by applying 2010 National Healthcare Safety Network (NHSN) definitions. We also developed a broader definition of possible infectious events associated with surgery up to 60 days after surgery.

Results

We enrolled 8,502 surgical encounters; 64% occurred at the hospital-based facility. Three procedure categories (soft tissue excision, hernia, scrotal/testicular) accounted for 56% of encounters at ASFs. We identified 21 NHSN defined SSIs (2.5 SSIs per 1,000 surgical encounters). In adjusted analysis, there was no difference between hospital-based facility and ASF SSI rates (OR 0.7; 95% CI 0.2–2.3). Using the broader definition, we identified 404 surgical encounters with strong or some evidence of possible infection (48 per 1,000 surgical encounters). There was poor agreement of possible infections identified via parent interview vs. EHR. In multivariable analysis using the broader definition, older age and black race were associated with a reduced risk.

Conclusion

Using a rigorous surveillance definition, the incidence of surgical site infections was low after pediatric ambulatory surgery although our data suggest there may be additional infectious complications that are not captured by the NHSN definition. Given the annual rate of pediatric ambulatory surgery, even a low rate of infection may result in a significant medical burden.

Disclosures

All authors: No reported disclosures.

Improving allergy office scheduling increases patient follow up and reduces asthma readmission after pediatric asthma hospitalization

BACKGROUND

Pediatric asthma is a major contributor to emergency room utilization and hospital readmission rates.

OBJECTIVE

To develop an allergy department‒based intervention to improve follow-up appointment scheduling processes for pediatric asthma patients after discharge for asthma exacerbation.

METHODS

This quality improvement study was conducted in the allergy clinic of an urban, tertiary children's hospital. Children receiving subspecialty allergy care for asthma were included into the intervention group during the intervention period. The quality improvement intervention consisted of 3 attempts by telephone to reach the family to schedule the follow-up appointment. If this was unsuccessful or if the appointment was not kept, then a reminder letter was sent to the family. The primary outcome of interest in this study was the percent of postdischarge follow-up appointments scheduled within 30 days of discharge. Secondary outcomes measured were the percent of allergy appointments attended within 30 days of discharge and the 30-day hospital readmission rate.

RESULTS

Demographics did not differ significantly between the intervention and baseline preintervention year. The initial baseline scheduled allergy follow-up visit rate was 48.8 ± 13.3% of patients discharged per month. This increased to an overall rate of 75.7 ± 20.1% patients scheduling allergy follow-up within 30 days of discharge during the intervention year. We also observed a significant increase in attended allergy visits 30 days postdischarge from 35.5 ± 15.6% in year 1 to 53.9 ± 25.5% during the intervention year and a significant decrease in the 30-day readmission rate on the allergy service.

CONCLUSION

These data suggests that minor changes in allergy practice organization can significantly affect posthospitalization follow-up rates and decrease asthma readmission rates.

Rapid Adjustment of Clinical Decision Support in Response to Updated Recommendations for Palivizumab Eligibility

Background: Palivizumab is effective at reducing hospitalizations due to respiratory syncytial virus among high-risk children, but is indicated for a small population. Identification of patients eligible to receive palivizumab is labor-intensive and error-prone. To support patient identification we developed Clinical Decision Support (CDS) based on published recommendations in 2012. This CDS was developed using a systematic process, which directly linked computer code to a recommendation’s narrative text. In 2014, updated recommendations were published, which changed several key criteria used to determine eligible patients.

Objective: Assess the effort required to update CDS in response to new palivizumab recommendations and identify factors that impacted these efforts.

Methods: We reviewed the updated American Academy of Pediatrics (AAP) policy statement from Aug 2014 and identified areas of divergence from the prior publication. We modified the CDS to account for each difference. We recorded time spent on each activity to approximate the total effort required to update the CDS.

Results: Of the 15 recommendations in the initial policy statement, 7 required updating. The CDS update was completed in 11 person-hours. Comparison of old and new recommendations was facilitated by the AAP policy statement structure and required 3 hours. Validation of the revised logic required 2 hours by a clinical domain expert. An informaticist required 3 hours to update and test the CDS. This included adding 24 lines and deleting 37 lines of code. Updating relevant data queries took an additional 3 hours and involved 10 edits.

Conclusion: We quickly adapted CDS in response to changes in recommendations for palivizumab administration. The consistent AAP policy statement structure and the link we developed between these statements and the CDS rules facilitated our efforts. We recommend that CDS implementers establish linkages between published narrative recommendations and their executable rules to facilitate maintenance efforts.

Citation: Michel J, Utidjian LH, Karavite D, Hogan A, Ramos MJ, Miller J, Shiffman RN, Grundmeier RW. Rapid adjustment of clinical decision support in response to updated recommendations for palivizumab eligibility. Appl Clin Inform 2017; 8: 581–592 https://doi.org/10.4338/ACI-2016-10-RA-0173

Using electronic medical record data to report laboratory adverse events

Despite the importance of adverse event (AE) reporting, AEs are under-reported on clinical trials. We hypothesized that electronic medical record (EMR) data can ascertain laboratory-based AEs more accurately than those ascertained manually. EMR data on 12 AEs for patients enrolled on two Children's Oncology Group (COG) trials at one institution were extracted, processed and graded. When compared to gold standard chart data, COG AE report sensitivity and positive predictive values (PPV) were 0-21·1% and 20-100%, respectively. EMR sensitivity and PPV were >98·2% for all AEs. These results demonstrate that EMR-based AE ascertainment and grading substantially improves laboratory AE reporting accuracy.

Examination of genetic variants influencing lipid traits in pediatric populations

Previous large-scale genome-wide association studies in adult populations have implicated ∽100 loci in determining high-density lipoprotein cholesterol (HDL-C), low-density lipoprotein cholesterol, or triglyceride levels. However, whether these loci also contribute to variations of lipid traits in pediatric populations remain unknown. Here we assayed a population of Philadelphia children by high-density single nucleotide polymorphism arrays, and performed association analysis on lipid traits ascertained from lipid measurements stored in electronic medical records. We examined previously reported lipid trait associations, and found that most of them show identical direction of association in our pediatric cohorts, including genome-wide significant association on cholesteryl ester transfer protein with HDL-C levels (rs3764261, P = 2.1 × 10(-8)) and other significant associations on oxysterol-binding protein-like protein 7, low-density lipoprotein receptor-related protein 4 and low-density lipoprotein receptor-related protein 1. Additionally, we identified suggestive association on low-density lipoprotein receptor-related protein 1B with HDL-C levels (rs17736712, P = 2.1 × 10(-7)), but this signal is not supported by previous meta-analysis on adult cohorts. Finally, we examined rare copy number variants and identified deletions encompassing tetratricopeptide repeat domain 39B in two children with extreme lipid measures. Our results highlight the commonalities and differences of genetic components in determining lipid traits in pediatric versus adult populations. Furthermore, our study demonstrates the unique utility of automated information retrieval from electronic medical records in facilitating the identification of genotype-phenotype associations.

Medically underserved girls receive less evaluation for short stature

OBJECTIVE

To determine if gender is associated with diagnostic evaluation by primary care pediatricians caring for children with growth-faltering.

PATIENTS AND METHODS

This was a retrospective study of children who were attending 4 urban pediatric primary care practices affiliated with a tertiary pediatric hospital. Growth-faltering was defined as height at the <5th percentile or a z-score decrease of ≥ 1.5 SDs before 18 months of age or ≥ 1 SD thereafter. For each child, height z score, age, gender, race, insurance, diagnostic tests, and subspecialist appointments were examined.

RESULTS

Of 33 476 children, 3007 had growth-faltering (mean height: -1.5 ± 1.0 vs 0.3 ± 0.9 SDs in those without growth-faltering). Boys comprised 53% of the growth-faltering group (vs 51% of the nonfaltering group; P < .01). Among children with growth-faltering, 2.8% had endocrinology appointments (vs 0.8% of others; P < .0001) and 6% had gastroenterology appointments (vs 1.5% of others; P < .0001). Subspecialty care was not associated with gender. Pediatricians ordered diagnostic tests for a significantly greater proportion of children with growth-faltering than others. In multivariate analysis of height z score among children with growth-faltering, tests for chromosomes (1.4% of short girls vs 0.4% of short boys; P < .005) and growth hormone/insulin-like growth factor axis (0.9% of short girls vs 1.8% of short boys; P < .05) were associated with gender. Thirty-five percent of the girls for whom chromosome testing was performed were 12 years old or older.

CONCLUSIONS

Patterns in diagnostic testing of children with growth-faltering by their pediatricians may lead to underdiagnosis of Turner syndrome and growth hormone deficiency among girls.

Electronic health record-based decision support to improve asthma care: a cluster-randomized trial

OBJECTIVE

Asthma continues to be 1 of the most common chronic diseases of childhood and affects approximately 6 million US children. Although National Asthma Education Prevention Program guidelines exist and are widely accepted, previous studies have demonstrated poor clinician adherence across a variety of populations. We sought to determine if clinical decision support (CDS) embedded in an electronic health record (EHR) would improve clinician adherence to national asthma guidelines in the primary care setting.

METHODS

We conducted a prospective cluster-randomized trial in 12 primary care sites over a 1-year period. Practices were stratified for analysis according to whether the site was urban or suburban. Children aged 0 to 18 years with persistent asthma were identified by International Classification of Diseases, Ninth Revision codes for asthma. The 6 intervention-practice sites had CDS alerts imbedded in the EHR. Outcomes of interest were the proportion of children with at least 1 prescription for controller medication, an up-to-date asthma care plan, and the performance of office-based spirometry.

RESULTS

Increases in the number of prescriptions for controller medications, over time, was 6% greater (P = .006) and 3% greater for spirometry (P = .04) in the intervention urban practices. Filing an up-to-date asthma care plan improved 14% (P = .03) and spirometry improved 6% (P = .003) in the suburban practices with the intervention.

CONCLUSION

In our study, using a cluster-randomized trial design, CDS in the EHR, at the point of care, improved clinician compliance with National Asthma Education Prevention Program guidelines.

Variants of DENND1B associated with asthma in children

BACKGROUND

Asthma is a complex disease that has genetic and environmental causes. The genetic factors associated with susceptibility to asthma remain largely unknown.

METHODS

We carried out a genomewide association study involving children with asthma. The sample included 793 North American children of European ancestry with persistent asthma who required daily inhaled glucocorticoid therapy and 1988 matched controls (the discovery set). We also tested for genomewide association in an independent cohort of 917 persons of European ancestry who had asthma and 1546 matched controls (the replication set). Finally, we tested for an association between 20 single-nucleotide polymorphisms (SNPs) at chromosome 1q31 and asthma in 1667 North American children of African ancestry who had asthma and 2045 ancestrally matched controls.

RESULTS

In our meta-analysis of all samples from persons of European ancestry, we observed an association, with genomewide significance, between asthma and SNPs at the previously reported locus on 17q21 and an additional eight SNPs at a novel locus on 1q31. The SNP most strongly associated with asthma was rs2786098 (P=8.55x10(-9)). We observed replication of the association of asthma with SNP rs2786098 in the independent series of persons of European ancestry (combined P=9.3x10(-11)). The alternative allele of each of the eight SNPs on chromosome 1q31 was strongly associated with asthma in the children of African ancestry (P=1.6x10(-13) for the comparison across all samples). The 1q31 locus contains the 1q31 locus contains DENND1B, a gene expressed by natural killer cells and dendritic cells. DENND1B protein is predicted to interact with the tumor necrosis factor α receptor [corrected].

CONCLUSIONS

We have identified a locus containing DENND1B on chromosome 1q31.3 that is associated with susceptibility to asthma.

Common variants at five new loci associated with early-onset inflammatory bowel disease

The inflammatory bowel diseases (IBD) Crohn's disease and ulcerative colitis are common causes of morbidity in children and young adults in the western world. Here we report the results of a genome-wide association study in early-onset IBD involving 3,426 affected individuals and 11,963 genetically matched controls recruited through international collaborations in Europe and North America, thereby extending the results from a previous study of 1,011 individuals with early-onset IBD. We have identified five new regions associated with early-onset IBD susceptibility, including 16p11 near the cytokine gene IL27 (rs8049439, P = 2.41 x 10(-9)), 22q12 (rs2412973, P = 1.55 x 10(-9)), 10q22 (rs1250550, P = 5.63 x 10(-9)), 2q37 (rs4676410, P = 3.64 x 10(-8)) and 19q13.11 (rs10500264, P = 4.26 x 10(-10)). Our scan also detected associations at 23 of 32 loci previously implicated in adult-onset Crohn's disease and at 8 of 17 loci implicated in adult-onset ulcerative colitis, highlighting the close pathogenetic relationship between early- and adult-onset IBD.

Practice variation in screening for sexually transmitted infections with nucleic acid amplification tests during prepubertal sexual abuse evaluations

BACKGROUND

Although recent recommendations for children after suspected sexual abuse incorporate nucleic acid amplification tests (NAATs) in algorithms that detect sexually transmitted infections (STIs), screening practices in the community remain uncertain.

STUDY OBJECTIVE

We examined screening practices over time and across a variety of pediatric settings for the evaluation of STIs in sexually abused children.

METHODS

A consecutive cohort of prepubertal children younger than 11 years of age who were suspected to have been sexually abused were identified between May 2002 and April 2005 at a large tertiary children's hospital and its supporting primary care network. Detailed histories and examinations based on chart abstraction were linked to hospital laboratory records to identify those who were screened for Chlamydia trachomatis and Neisseria gonorrhoeae by means of cultures, NAATs, or both. Chi-square and logistic regression analyses identified factors associated with screening, including the effects of screening location and year of study on the likelihood that particular tests were obtained.

RESULTS

Among the initial visits of 1068 children, 32% occurred in the specialty child abuse clinic (CARE Clinic), 62% in the emergency department, and 6% in the primary care setting. Follow-up visits occurred in only 7% of children. The performance of at least one screening test increased each year, from 12% in year 1 to 18% in year 3 (P = 0.01). Among the 162 children in whom tests were obtained, there was a significant decrease in the use of culture techniques over time, from 100% in year 1 to 75% in year 3 (P < 0.001). At the same time, there was a steady increase in the use of NAATs in total (from 2% in year 1 to 41% in year 3, P < 0.001), and in the absence of culture techniques (from 0% in year 1 to 26% in year 3, P < 0.001). This growth in the use of NAATs alone was particularly seen in the emergency department setting, where 33% of children were screened only by NAAT by year 3 (P = 0.001).

CONCLUSIONS

Screening rates for STIs increased over time, a trend that is explained primarily by the use of NAATs in the absence of other tests. The increasing use of NAATs will have to be addressed more fully in creating future guidelines for this population.

High-resolution mapping and analysis of copy number variations in the human genome: a data resource for clinical and research applications

We present a database of copy number variations (CNVs) detected in 2026 disease-free individuals, using high-density, SNP-based oligonucleotide microarrays. This large cohort, comprised mainly of Caucasians (65.2%) and African-Americans (34.2%), was analyzed for CNVs in a single study using a uniform array platform and computational process. We have catalogued and characterized 54,462 individual CNVs, 77.8% of which were identified in multiple unrelated individuals. These nonunique CNVs mapped to 3272 distinct regions of genomic variation spanning 5.9% of the genome; 51.5% of these were previously unreported, and >85% are rare. Our annotation and analysis confirmed and extended previously reported correlations between CNVs and several genomic features such as repetitive DNA elements, segmental duplications, and genes. We demonstrate the utility of this data set in distinguishing CNVs with pathologic significance from normal variants. Together, this analysis and annotation provides a useful resource to assist with the assessment of CNVs in the contexts of human variation, disease susceptibility, and clinical molecular diagnostics.

Sex-based prevalence of growth faltering in an urban pediatric population

OBJECTIVE

To determine the sex-based prevalence of growth faltering in a pediatric primary care setting.

STUDY DESIGN

A total of 33 476 children attending 4 urban pediatric primary care practices affiliated with a tertiary pediatric hospital between July 2002 and June 2005 were studied. Growth faltering was defined as height <5th percentile or a drop in height z-score by >or= 1.5 standard deviations (SD) before age 18 months or by >or= 1 SD thereafter. The growth-faltering and nonfaltering groups were compared in terms of sex, race, age, number of clinic visits, and insurance, and by US census tract, socioeconomic status and parental education. Similar comparisons were made for children with height z-scores below -2.25 SD.

RESULTS

Growth faltering was present in 3007 of the children studied (9%). Univariate and multivariate logistic regression analyses identified significant associations between growth faltering and younger age (P< .0001), Caucasian race (P< .0001), fewer clinic visits (P< .0001), and Medicaid insurance (P< .005), but not with sex nor by residential census tract, median income or proportion with less than high school education. Height below -2.25 SD was associated with male sex (P< .01), Medicaid insurance (P< .01), and more primary care visits (P< .0005).

CONCLUSIONS

The sex disparity in subspecialty growth center referrals (2:1 male:female) is not due to male predominance in growth faltering among children in the urban primary care setting.

Housestaff attitudes toward computer-based clinical decision support

OBJECTIVE

To measure housestaff attitudes towards computer-based decision support and their threshold for having CDSS messages displayed.

DESIGN

770 self-administered surveys were distributed to housestaff physicians.

RESULTS

209 surveys were returned. 63% of respondents agreed or strongly agreed that CDSS would improve quality of care, while 52% agreed or strongly agreed that it would decrease adverse drug events. Respondents were neutral regarding the impact of CDSS on productivity and on their autonomy. Sixty percent approved of a reminder to consider surgical consultation in a patient with abdominal pain, while 88% approved of alerts about hypokalemia. Respondents felt both reminders should be triggered when their PPV exceeded 67%. Attitudes toward POE correlated positively with attitudes toward CDSS (Pearson's rho 0.56; p < 0.0001). Respondents who were dissatisfied with POE had a higher threshold PPV for seeing reminders.

CONCLUSION

The majority of housestaff favor the implementation of a CDSS. Housestaff with favorable POE experiences were more likely to endorse CDSS, and those with negative POE experience were more likely to oppose it. The results suggest that a carefully designed CDSS with rules constructed to exceed a threshold PPV would be accepted by housestaff.

A pre-search estimation algorithm for MEDLINE strategies with qualifiers

Inexperienced users of online medical databases often have difficulty formulating their queries. Systems designed to assist them usually do not estimate how effective the initial search strategy will be before performing an actual search. Consequently, the search may find an overwhelming number of citations, or retrieve nothing at all. We have developed an estimation algorithm to predict the outcome of a MEDLINE search. The portion of the algorithm described here estimates retrieval for strategies containing qualifiers. In test searches, the estimate reduced the trial-and-error of strategy formulation. However, the accuracy of the estimate fell short of expectations. Our results show that pre-search estimation for strategies with qualifiers cannot be performed effectively with only the occurrence data that is presently available. They further imply that automated search intermediaries can benefit from medical knowledge which expresses the relationships that exist between terms.

Q & A: a query formulation assistant

Inexperienced users of online medical databases often do not know how to formulate their queries for effective searches. Previous attempts to help them have provided some standard procedures for query formulation, but depend on the user to enter the concepts of a query properly so that the correct search strategy will be formed. Intelligent assistance specific to a particular query often is not given. Several systems do refine the initial strategy based on relevance feedback, but usually do not make an effort to determine how well-formed a query is before actually performing the search. As part of the Interactive Query Workstation (IQW), we have developed an expert system, Questions and Answers (Q&A), that assists in formulating an initial strategy given concepts entered by the user and that determines if the strategy is well-formed, refining it when necessary.

Interactive query workstation: a demonstration of the practical use of UMLS knowledge sources

The Interactive Query Workstation (IQW) has been developed to provide clinicians with a uniform program interface for retrieving medical-related information from various computer-based information resources. These resources can vary in content (bibliographic databases, drug information, general medical text databases), function (article retrieval, differential diagnosis, drug interaction detection, or drug dosage and administration information), and media formats (local hard disk, CD-ROM, local area network, or distant telecommunication link). IQW allows modular addition of new resources as well as extension of previously installed resources. The National Library of Medicine's three Unified Medical Language System (UMLS) Knowledge Sources, the Metathesaurus (Meta), the Semantic Network, and the Information Sources Map (ISM) have been incorporated into many aspects of IQW. Meta provides information about medical terminology and aids IQW in isolating the basic concepts from a clinician's question. The Semantic Network provides information about the categorization of concepts and possible relations between concepts. It also assists IQW in determining which queries are appropriate for a set of concepts contained in the clinician's question. The ISM provides information about the content available from a computer-based resources and aids IQW in selecting an appropriate resource from which to collect information. The computer-based resource selection is performed without user intervention. This interactive demonstration shows an environment which increases the accessibility of medical information to clinicians by utilizing the three UMLS Knowledge Sources.