Pediatric Respiratory Illness Measurement System (PRIMES) Scores and Outcomes

Pediatric Respiratory Illnesses: An Update on Achievable Benchmarks of Care

BACKGROUND AND OBJECTIVES

Pediatric respiratory illnesses (PRI): asthma, bronchiolitis, pneumonia, croup, and influenza are leading causes of pediatric hospitalizations, and emergency department (ED) visits in the United States. There is a lack of standardized measures to assess the quality of hospital care delivered for these conditions. We aimed to develop a measure set for automated data extraction from administrative data sets and evaluate its performance including updated achievable benchmarks of care (ABC).

METHODS

A multidisciplinary subject-matter experts team selected quality measures from multiple sources. The measure set was applied to the Public Health Information System database (Children's Hospital Association, Lenexa, KS) to cohorts of ED visits and hospitalizations from 2017 to 2019. ABC for pertinent measures and performance gaps of mean values from the ABC were estimated. ABC were compared with previous reports.

RESULTS

The measure set: PRI report includes a total of 94 quality measures. The study cohort included 984 337 episodes of care, and 82.3% were discharged from the ED. Measures with low performance included bronchodilators (19.7%) and chest x-rays (14.4%) for bronchiolitis in the ED. These indicators were (34.6%) and (29.5%) in the hospitalized cohort. In pneumonia, there was a 57.3% use of narrow spectrum antibiotics. In general, compared with previous reports, there was improvement toward optimal performance for the ABCs.

CONCLUSIONS

The PRI report provides performance data including ABC and identifies performance gaps in the quality of care for common respiratory illnesses. Future directions include examining health inequities, and understanding and addressing the effects of the coronavirus disease 2019 pandemic on care quality.

Hospital's observed specific standard practice: A novel measure of variation in care for common inpatient pediatric conditions

BACKGROUND

Previously few means existed to broadly examine variability across conditions/practices within or between hospitals for common pediatric conditions.

OBJECTIVE

Our objective was to develop a novel empiric measure of variation in care and test its association with patient-centered outcomes.

DESIGNS

We conducted a retrospective cohort study of children hospitalized from January 2016 to December 2018 using the Pediatric Hospital Information Systems database.

SETTINGS AND PARTICIPANTS

We included children ages 0-18 years hospitalized with asthma, bronchiolitis, or gastroenteritis.

INTERVENTION

We developed a hospital-specific measure of variation in care, the hospital's observed specific standard practice (HOSSP), the most common combination of laboratory studies, imaging, and medications used at each hospital.

MAIN OUTCOME AND MEASURES

The outcomes were standardized costs, length of stay (LOS), and 7-day all-cause readmissions.

RESULTS

Among 133,392 hospitalizations from 41 hospitals (asthma = 50,382, bronchiolitis = 54,745, and gastroenteritis = 28,265), there was significant variation in overall HOSSP adherence across hospitals for these conditions (asthma: 3.5%-47.4% [p < .001], bronchiolitis: 2.5%-19.8% [p < .001], gastroenteritis: 1.6%-11.6% [p < .001]). The majority of HOSSP variation was driven by differences in medication prescribing for asthma and bronchiolitis and laboratory ordering for gastroenteritis. For all three conditions, greater HOSSP adherence was associated with significantly lower hospital costs (asthma: p = .04, bronchiolitis: p < .001, acute gastroenteritis: p = .01), without increases in LOS or 7-day all cause readmissions.

CONCLUSION

We found substantial variation in the components and adherence to HOSSP. Hospitals with greater HOSSP adherence had lower costs for these conditions. This suggests hospitals can use data around laboratory, imaging, and medication prescribing practices to drive standardization of care, reduce unnecessary testing and treatment, determine best practices, and reduce costs.

Variation in Dexamethasone Dosing and Use Outcomes for Inpatient Croup

OBJECTIVES

Evaluate the association between dexamethasone dosing and outcomes for children hospitalized with croup.

METHODS

This study was nested within a multisite prospective cohort study of children aged 6 months to 6 years admitted to 1 of 5 US children's hospitals between July 2014 and June /2016. Multivariable linear and logistic mixed-effects regression models were used to examine the association between the number of dexamethasone doses (1 vs >1) and outcomes (length of stay [LOS], cost, and 30-day same-cause reuse). All multivariable analyses included a site-specific random effect to account for clustering within hospital and were adjusted for age, sex, race and ethnicity, presenting severity, medical complexity, insurance, caregiver education, and hospital. In cost analyses, we controlled for LOS.

RESULTS

Among 234 children hospitalized with croup, patient characteristics did not differ by number of doses. The proportion receiving >1 dose varied by hospital (range 27.9%-57.1%). In adjusted analyses, >1 dose was not associated with same-cause reuse (odds ratio 0.87 [95% confidence interval (CI): 0.26 to 2.95]) but was associated with 45% longer LOS (relative risk = 1.45 [95% CI: 1.30 to 1.62]). When we controlled for LOS, >1 dose was not associated with differential cost ($-31.2 [95% CI $-424.4 to $362.0]). Eighty-two (35%) children received dexamethasone before presentation.

CONCLUSIONS

We found significant interhospital variation in dexamethasone dosing and LOS. When we controlled for severity on presentation, >1 dexamethasone dose was associated with longer LOS but not reuse. Although incomplete adjustment for severity is one possible explanation, some providers may routinely keep children hospitalized to administer multiple dexamethasone doses.

Development and Use of a Calculator to Measure Pediatric Low-Value Care Delivered in US Children's Hospitals

IMPORTANCE

The scope of low-value care in children's hospitals is poorly understood.

OBJECTIVE

To develop and apply a calculator of hospital-based pediatric low-value care to estimate prevalence and cost of low-value services.

DESIGN, SETTING, AND PARTICIPANTS

This cross-sectional study developed and applied a calculator of hospital-based pediatric low-value care to estimate the prevalence and cost of low-value services among 1 011 950 encounters reported in 49 US children's hospitals contributing to the Pediatric Health Information System (PHIS) database. To develop the calculator, a multidisciplinary stakeholder group searched existing pediatric low-value care measures and used an iterative process to identify and operationalize relevant hospital-based measures in the PHIS database. Children with an eligible encounter in 2019 were included in the calculator-applied analysis. Two cohorts were analyzed: an emergency department cohort (with encounters resulting in emergency department discharge) and a hospitalized cohort.

EXPOSURES

Eligible condition-specific hospital encounters.

MAIN OUTCOMES AND MEASURES

The proportion and volume of encounters in which low-value services were delivered and their associated standardized costs. Measures were ranked by those outcomes.

RESULTS

There were 1 011 950 encounters eligible for 1 or more of 30 calculator-included measures in 2019; encounters were incurred by 816 098 unique patients with a median age of 3 years (IQR, 1-8 years). In the emergency department cohort, low-value services delivered in the greatest percentage of encounters were Group A streptococcal testing among children younger than 3 years with pharyngitis (3679 of 9785 [37.6%]), computed tomography scan for minor head injury (7541 of 42 602 [17.7%]), and bronchodilators for treatment of bronchiolitis (8899 of 55 616 [16.0%]). In the hospitalized cohort, low-value care was most prevalent for broad-spectrum antibiotics in the treatment of community-acquired pneumonia (3406 of 5658 [60.2%]), acid suppression therapy for infants with esophageal reflux (3814 of 7507 of [50.8%]), and blood cultures for uncomplicated community-acquired pneumonia (2277 of 5823 [39.1%]). Measured low-value services generated nearly $17 million in total standardized cost. The costliest services in the emergency department cohort were computed tomography scan for abdominal pain (approximately $1.8 million) and minor head injury (approximately $1.5 million) and chest radiography for asthma (approximately $1.1 million). The costliest services in the hospitalized cohort were receipt of 2 or more concurrent antipsychotics (approximately $2.4 million), and chest radiography for bronchiolitis ($801 680) and asthma ($625 866).

CONCLUSIONS AND RELEVANCE

This cross-sectional analysis found that low-value care for some pediatric services was prevalent and costly. Measuring receipt of low-value services across conditions informs prioritization of deimplementation efforts. Continued use of this calculator may establish trends in low-value care delivery.

EHR-Integrated Monitor Data to Measure Pulse Oximetry Use in Bronchiolitis

BACKGROUND AND OBJECTIVES

Continuous pulse oximetry (oxygen saturation [Spo₂]) monitoring in hospitalized children with bronchiolitis not requiring supplemental oxygen is discouraged by national guidelines, but determining monitoring status accurately requires in-person observation. Our objective was to determine if electronic health record (EHR) data can accurately estimate the extent of actual Spo₂ monitoring use in bronchiolitis.

METHODS

This repeated cross-sectional study included infants aged 8 weeks through 23 months hospitalized with bronchiolitis. In the validation phase at 3 children's hospitals, we calculated the test characteristics of the Spo₂ monitor data streamed into the EHR each minute when monitoring was active compared with in-person observation of Spo₂ monitoring use. In the application phase at 1 children's hospital, we identified periods when supplemental oxygen was administered using EHR flowsheet documentation and calculated the duration of Spo₂ monitoring that occurred in the absence of supplemental oxygen.

RESULTS

Among 668 infants at 3 hospitals (validation phase), EHR-integrated Spo₂ data from the same minute as in-person observation had a sensitivity of 90%, specificity of 98%, positive predictive value of 88%, and negative predictive value of 98% for actual Spo₂ monitoring use. Using EHR-integrated data in a sample of 317 infants at 1 hospital (application phase), infants were monitored in the absence of oxygen supplementation for a median 4.1 hours (interquartile range 1.4-9.4 hours). Those who received supplemental oxygen experienced a median 5.6 hours (interquartile range 3.0-10.6 hours) of monitoring after oxygen was stopped.

CONCLUSIONS

EHR-integrated monitor data are a valid measure of actual Spo₂ monitoring use that may help hospitals more efficiently identify opportunities to deimplement guideline-inconsistent use.

Obesity and Health-Related Quality of Life in Children Hospitalized for Acute Respiratory Illness

OBJECTIVES

Obesity has rapidly become a major problem for children that has adverse effects on respiratory health. We sought to assess the impact of obesity on health-related quality of life (HRQOL) and hospital outcomes for children hospitalized with asthma or pneumonia.

METHODS

In this multicenter prospective cohort study, we evaluated children (aged 2-16 years) hospitalized with an acute asthma exacerbation or pneumonia between July 1, 2014, and June 30, 2016. Subjects or their family completed surveys for child HRQOL (PedsQL Physical Functioning and Psychosocial Functioning Scales, with scores ranging from 0 to 100) on hospital presentation and 2-6 weeks after discharge. BMI categories were defined as normal weight, overweight, and obesity on the basis of BMI percentiles for age and sex per national guidelines. Multivariable regression models were used to examine associations between BMI category and HRQOL, length of stay, and 30-day reuse.

RESULTS

Among 716 children, 82 (11.4%) were classified as having overweight and 138 (19.3%) as having obesity. For children hospitalized with asthma or pneumonia, obesity was not associated with worse HRQOL at presentation or 2-6 weeks after discharge, hospital length of stay, or 30-day reuse.

CONCLUSIONS

Nearly 1 in 3 children seen in the hospital for an acute asthma exacerbation or pneumonia had overweight or obesity; however, among the population of children in our study, obesity alone does not appear to be associated with worse HRQOL or hospital outcomes.

Performance of Pediatric Readmission Measures

BACKGROUND

Readmission rates are frequently used as a hospital quality metric; yet multiple measures exist to evaluate pediatric readmission rates. We sought to assess how four different measures of pediatric readmission compare with assessment of both preventable and unplanned readmission.

METHODS

Clinicians on hospital medicine, cardiology, neonatology, and neurology teams reviewed medical records for 30-day readmissions using an abstraction tool with high interrater reliability for preventability assessment. Readmissions between July 2014 and June 2016 were classified separately as preventable or not preventable and planned or unplanned. We compared the classifications to four existing readmission metrics: all-cause readmission, unplanned readmission/time flag classification, the pediatric all-condition readmission, and potentially preventable readmission. We calculated sensitivity and specificity for all readmission metrics.

RESULTS

Among 30-day readmissions considered, 1,643 were eligible for medical record review; 1,125 reviews were completed by the clinical teams (68%). On medical record review, the majority of readmissions were determined not preventable (85%). Only 15% were classified as unplanned and preventable. None of the four readmission measures had appropriate sensitivity or specificity for identifying preventable readmission. The unplanned readmission/time flag classification had the highest sensitivity (95%) and specificity (90%) in identifying unplanned readmissions.

CONCLUSION

None of the existing pediatric readmission measures can reliably determine preventability. The unplanned readmission/time flag measure performed best in identifying unplanned readmissions.

Associations Between Quality Measures and Outcomes for Children Hospitalized With Bronchiolitis

OBJECTIVES

To use adherence to the Pediatric Respiratory Illness Measurement System (PRIMES) indicators to evaluate the strength of associations for individual indicators with length of stay (LOS) and cost for bronchiolitis.

METHODS

We prospectively enrolled children with bronchiolitis at 5 children's hospitals between July 1, 2014, and June 30, 2016. We examined associations between adherence to each individual PRIMES indicator for bronchiolitis and LOS and cost. Sixteen indicators were included, 9 "overuse" indicators for care that should not occur and 7 "underuse" indicators for care that should occur. We performed mixed effects linear regression to examine the association between adherence to each individual indicator and LOS (hours) and cost (dollars). All models controlled for patient demographics, patient complexity, and hospital.

RESULTS

We enrolled 699 participants. The mean age was 8 months; 56% were male, 38% were white, and 63% had public insurance. Three indicators were significantly associated with shorter LOS and lower cost. All 3 indicators were overuse indicators and related to laboratory testing: no blood cultures (adjusted mean difference in LOS: -24.3 hours; adjusted mean cost difference: -$731, P < .001), no complete blood cell counts (LOS: -17.8 hours; cost: -$399, P < .05), and no respiratory syncytial virus testing (LOS: -16.6 hours; cost: -$272, P < .05). Two underuse indicators were associated with higher cost: documentation of oral intake at discharge ($671, P < .01) and documentation of hospital follow-up ($538, P < .05).

CONCLUSIONS

A subset of PRIMES quality indicators for bronchiolitis are strongly associated with improved outcomes and can serve as important measures for future quality improvement efforts.

Comparison of As-Needed and Scheduled Posthospitalization Follow-up for Children Hospitalized for Bronchiolitis: The Bronchiolitis Follow-up Intervention Trial (BeneFIT) Randomized Clinical Trial

IMPORTANCE

Posthospitalization follow-up visits are prescribed frequently for children with bronchiolitis. The rationale for this practice is unclear, but prior work has indicated that families value these visits for the reassurance provided. The overall risks and benefits of scheduled visits have not been evaluated.

OBJECTIVE

To assess whether an as-needed posthospitalization follow-up visit is noninferior to a scheduled posthospitalization follow-up visit with respect to reducing anxiety among parents of children hospitalized for bronchiolitis.

DESIGN, SETTING, AND PARTICIPANTS

This open-label, noninferiority randomized clinical trial, performed between January 1, 2018, and April 31, 2019, assessed children younger than 24 months of age hospitalized for bronchiolitis at 2 children's hospitals (Primary Children's Hospital, Salt Lake City, Utah, and Lucile Packard Children's Hospital, Palo Alto, California) and 2 community hospitals (Intermountain Riverton Hospital, Riverton, Utah, and Packard El Camino Hospital, Mountain View, California). Data analysis was performed in an intention-to-treat manner.

INTERVENTIONS

Randomization (1:1) to a scheduled (n = 151) vs an as-needed (n = 153) posthospitalization follow-up visit.

MAIN OUTCOME AND MEASURES

The primary outcome was parental anxiety 7 days after hospital discharge, measured using the anxiety portion of the Hospital Anxiety and Depression Scale, which ranged from 0 to 28 points, with higher scores indicating greater anxiety. Fourteen prespecified secondary outcomes were assessed.

RESULTS

Among 304 children randomized (median age, 8 months; interquartile range, 3-14 months; 179 [59%] male), the primary outcome was available for 269 patients (88%). A total of 106 children (81%) in the scheduled follow-up group attended a scheduled posthospitalization visit compared with 26 children (19%) in the as-needed group (absolute difference, 62%; 95% CI, 53%-71%). The mean (SD) 7-day parental anxiety score was 3.9 (3.5) among the as-needed posthospitalization follow-up group and 4.2 (3.5) among the scheduled group (absolute difference, -0.3 points; 95% CI, -1.0 to 0.4 points), with the upper bound of the 95% CI within the prespecified noninferiority margin of 1.1 points. Aside from a decreased mean number of clinic visits (absolute difference, -0.6 visits per patient; 95% CI, -0.4 to -0.8 visits per patient) among the as-needed group, there were no significant between-group differences in secondary outcomes, including readmissions (any hospital readmission before symptom resolution: absolute difference, -1.6%; 95% CI, -5.7% to 2.5%) and symptom duration (time from discharge to cough resolution: absolute difference, -0.6 days; 95% CI, -2.4 to 1.2 days; time from discharge to child reported "back to normal": absolute difference, -0.8 days; 95% CI, -2.7 to 1.0 days; and time from discharge to symptom resolution: absolute difference, -0.6 days; 95% CI, -2.5 to 1.3 days).

CONCLUSIONS AND RELEVANCE

Among parents of children hospitalized for bronchiolitis, an as-needed posthospitalization follow-up visit is noninferior to a scheduled posthospitalization follow-up visit with respect to reducing parental anxiety. These findings support as-needed follow-up as an effective posthospitalization follow-up strategy.

TRIAL REGISTRATION

ClinicalTrials.gov Identifier: NCT03354325.

Social Disadvantage, Access to Care, and Disparities in Physical Functioning Among Children Hospitalized with Respiratory Illness

BACKGROUND AND OBJECTIVES

Understanding disparities in child health-related quality of life (HRQoL) may reveal opportunities for targeted improvement. This study examined associations between social disadvantage, access to care, and child physical functioning before and after hospitalization for acute respiratory illness.

METHODS

From July 1, 2014, to June 30, 2016, children ages 8-16 years and/or caregivers of children 2 weeks to 16 years admitted to five tertiary care children's hospitals for three common respiratory illnesses completed a survey on admission and within 2 to 8 weeks after discharge. Survey items assessed social disadvantage (minority race/ ethnicity, limited English proficiency, low education, and low income), difficulty/delays accessing care, and baseline and follow-up HRQoL physical functioning using the Pediatric Quality of Life Inventory (PedsQL, range 0-100). We examined associations between these three variables at baseline and follow-up using multivariable, mixed-effects linear regression models with multiple imputation sensitivity analyses for missing data.

RESULTS

A total of 1,325 patients and/or their caregivers completed both PedsQL assessments. Adjusted mean baseline PedsQL scores were significantly lower for patients with social disadvantage markers, compared with those of patients with none (78.7 for >3 markers versus 85.5 for no markers, difference -6.1 points (95% CI: -8.7, -3.5). The number of social disadvantage markers was not associated with mean follow-up PedsQL scores. Difficulty/delays accessing care were associated with lower PedsQL scores at both time points, but it was not a significant effect modifier between social disadvantage and PedsQL scores.

CONCLUSIONS

Having social disadvantage markers or difficulty/delays accessing care was associated with lower baseline physical functioning; however, differences were reduced after hospital discharge.

Vaccination Status and Adherence to Quality Measures for Acute Respiratory Tract Illnesses

OBJECTIVES

To assess the relationship between vaccination status and clinician adherence to quality measures for children with acute respiratory tract illnesses.

METHODS

We conducted a multicenter prospective cohort study of children aged 0 to 16 years who presented with 1 of 4 acute respiratory tract illness diagnoses (community-acquired pneumonia, croup, asthma, and bronchiolitis) between July 2014 and June 2016. The predictor variable was provider-documented up-to-date (UTD) vaccination status. Our primary outcome was clinician adherence to quality measures by using the validated Pediatric Respiratory Illness Measurement System (PRIMES). Across all conditions, we examined overall PRIMES composite scores and overuse (including indicators for care that should not be provided, eg, C-reactive protein testing in community-acquired pneumonia) and underuse (including indicators for care that should be provided, eg, dexamethasone in croup) composite subscores. We examined differences in length of stay, costs, and readmissions by vaccination status using adjusted linear and logistic regression models.

RESULTS

Of the 2302 participants included in the analysis, 92% were documented as UTD. The adjusted mean difference in overall PRIMES scores by UTD status was not significant (adjusted mean difference -0.3; 95% confidence interval: -1.9 to 1.3), whereas the adjusted mean difference was significant for both overuse (-4.6; 95% confidence interval: -7.5 to -1.6) and underuse (2.8; 95% confidence interval: 0.9 to 4.8) composite subscores. There were no significant adjusted differences in mean length of stay, cost, and readmissions by vaccination status.

CONCLUSIONS

We identified lower adherence to overuse quality indicators and higher adherence to underuse quality indicators for children not UTD, which suggests that clinicians "do more" for hospitalized children who are not UTD.