Developing measures for pediatric quality: methods and experiences of the CHIPRA pediatric quality measures program grantees

Enhancing Learning Systems in Using Patient Experience Data: An Exploratory Mixed-Method Study in Two Italian Regions

In the quest for healthcare systems enhancement, the improvement of patient experience plays a central role. The challenge lies in converting patient-reported experience data into actionable knowledge for quality improvement. This study aims to investigate the use of patient-reported data as knowledge base for actions and to identify and map actions derived from the use of patient-experience data within two Italian regional healthcare systems. Patient Experience Data are systematically collected in both systems, providing real-time updates accessible by professionals and managers through web-based reporting systems and including a collaborative network among practitioners. A sequential exploratory mixed-method study was carried out in several qualitative and quantitative phases. In the first phase, a qualitative method was conducted to discuss the actionability of patient-reported data and to design a tool for collecting the improvement actions based on these data. In the second phase, a quali-quantitative survey was performed to explore the professionals' use of patient-reported information and the types of actions implemented. Finally, a workshop was held to discuss, interpret and validate the results. The initial workshop identified key dimensions for improvement initiatives. After design and distribution of survey, a total of 189 responses was collected, respectively 96 from Region A and 93 from Region B. Both regions ensured widespread use of patient-reported data (89%). The establishment of a collaborative network seemed to reduce the learning curve in using patient-reported data and fostered a culture of using patient feedback effectively. The results reveal a difference between the two regions, with a more extensive patient-reported data use in Region A, attributed to its systematic joining the PREMs Observatory, prior experiences with patient-feedback collection and use, and patient-experience indicators integrated into the performance evaluation system. Regarding practices of data use, four themes emerged, namely, internal actions addressed to hospital staff (35.9%), external actions addressed to users (18.6%), comfort and hospitality aspects (34.7%) and review of processes and procedures (10.8%). The study highlights the importance of effectively using patient-reported data to achieve organisational goals, by combining different managerial strategies. It demonstrates how professionals use such data for improvement actions and underscores the significance of various forms of knowledge dissemination and sharing. It advocates for fostering a culture of continuous learning and improvement within and across healthcare organisations.

[Development of an indicator set for the evaluation of the quality of routine ambulatory health care for common disorders in children and adolescents]

BACKGROUND

In Germany, no consented quality indicator set (QI set) exists to date that can be used to assess the quality of pediatric care. Therefore, the aim of the project "Assessment of the quality of routine ambulatory health care for common disorders in children and adolescents" (QualiPäd) funded by the Innovation Committee of the Federal Joint Committee (grant no.: 01VSF19035) was to develop a QI set for the diseases asthma, atopic eczema, otitis media, tonsillitis, attention-deficit hyperactivity disorder (ADHD), depression and conduct disorder.

METHODS

For the observation period 2018/2019, quality indicators (QIs) were searched in indicator databases, guidelines and literature databases and complemented in part by newly formulated QIs (e.g., derived from guideline recommendations). The QIs were then assigned to content categories and dimensions according to Donabedian and OECD and reduced by removing duplicates. Finally, a panel of experts consulted the QIs using the modified RAND-UCLA Appropriateness Method (RAM).

RESULTS

The search resulted in a preliminary QI set of 2324 QIs. After the reduction steps and the evaluation of the experts, 282 QIs were included in the QI set (asthma: 72 QIs, atopic eczema: 25 QIs, otitis media: 31 QIs, tonsillitis: 12 QIs, ADHD: 53 QIs, depression: 43 QIs, conduct disorder: 46 QIs). The QIs are distributed among the following different categories: Therapy (138 QIs), Diagnostics (95 QIs), Patient-reported outcome measures/Patient-reported experience measures (PROM/PREM) (45 QIs), Practice management (31 QIs), and Health reporting (4 QIs). In the Donabedian model, 89% of the QIs capture process quality, 9% outcome quality, and 2% structural quality; according to the OECD classification, 61% measure effectiveness, 23% patient-centeredness, and 16% safety of care.

CONCLUSION

The consented QI set is currently being tested and can subsequently be used (possibly modified) to measure the quality of routine outpatient care for children and adolescents in Germany, in order to indicate the status quo and potential areas for improvement in outpatient care.

Improving the Quality of Written Discharge Instructions: A Multisite Collaborative Project

BACKGROUND AND OBJECTIVES

Written discharge instructions help to bridge hospital-to-home transitions for patients and families, though substantial variation in discharge instruction quality exists. We aimed to assess the association between participation in an Institute for Healthcare Improvement Virtual Breakthrough Series collaborative and the quality of pediatric written discharge instructions across 8 US hospitals.

METHODS

We conducted a multicenter, interrupted time-series analysis of a medical records-based quality measure focused on written discharge instruction content (0-100 scale, higher scores reflect better quality). Data were from random samples of pediatric patients (N = 5739) discharged from participating hospitals between September 2015 and August 2016, and between December 2017 and January 2020. These periods consisted of 3 phases: 1. a 14-month precollaborative phase; 2. a 12-month quality improvement collaborative phase when hospitals implemented multiple rapid cycle tests of change and shared improvement strategies; and 3. a 12-month postcollaborative phase. Interrupted time-series models assessed the association between study phase and measure performance over time, stratified by baseline hospital performance, adjusting for seasonality and hospital fixed effects.

RESULTS

Among hospitals with high baseline performance, measure scores increased during the quality improvement collaborative phase beyond the expected precollaborative trend (+0.7 points/month; 95% confidence interval, 0.4-1.0; P < .001). Among hospitals with low baseline performance, measure scores increased but at a lower rate than the expected precollaborative trend (-0.5 points/month; 95% confidence interval, -0.8 to -0.2; P < .01).

CONCLUSIONS

Participation in this 8-hospital Institute for Healthcare Improvement Virtual Breakthrough Series collaborative was associated with improvement in the quality of written discharge instructions beyond precollaborative trends only for hospitals with high baseline performance.

Developing a quality measure to assess use of antibiotic medications for respiratory conditions

Objective

Antibiotics are essential medications for treating life-threatening infections. However, incorrect prescribing can lead to adverse events and contribute to antibiotic resistance. We sought to develop a utilization quality measure that could be used by health insurance plans to track overall prescribing for respiratory conditions.

Design

A consensus-based process that included evidence review, testing, and stakeholder input was used to develop a measure and assess its usefulness for the Healthcare Effectiveness Data and Information Set (HEDIS), a national quality measurement tool.

Methods

Guidelines and literature were reviewed to establish the rationale for the measure. The measure was tested in claims data for commercial, Medicaid and Medicare Advantage enrollees to assess feasibility of collecting and reporting needed information. The measure was vetted with multistakeholder advisory panels and posted for public comment to solicit wide input on relevance and usability.

Results

Respiratory conditions are frequent reasons for outpatient care in the data assessed. On average, across all lines of business, the measure revealed that approximately one-third of outpatient visits for respiratory conditions are followed by antibiotics. Stakeholders supported the measure as a tool for monitoring antibiotic prescribing across health plans alongside existing measures that assess inappropriate prescribing for specific conditions. The final measure assesses the number of antibiotic prescriptions dispensed across all outpatient respiratory-related encounters at a health-plan level.

Conclusions

The measure on antibiotic prescribing for respiratory conditions was relevant, feasible, and useful. Stakeholders strongly supported the newly developed measure and recommended its integration into HEDIS.

Patient and healthcare provider perceptions on using patient-reported experience measures (PREMs) in routine clinical care: a systematic review of qualitative studies

BACKGROUND

Patient-reported experience measures (PREMs) assess quality-of-care from patients' perspectives. PREMs can be used to enhance patient-centered care and facilitate patient engagement in care. With increasing quality improvement studies in clinical practice, the use of PREMs has surged. As a result, knowledge about stakeholder experiences of using PREMs to assess quality of care across diverse clinical settings is needed to inform PREM implementation efforts. To address this, this review examines the qualitative literature on patient and healthcare provider experiences of using PREMs in clinical practice.

METHODS

Medline, Embase and PsycInfo were systematically searched from inception to May 2021. Additional searching of reference lists for all included articles and relevant review articles were performed. Retrieved articles were screened for eligibility by one reviewer and 25% cross-checked by a second reviewer across all stages of the review. Full texts meeting eligibility criteria were appraised against the COREQ checklist for quality assessment and thematic analysis was used to analyze textual data extracted from the results.

RESULTS

Electronic searches identified 2683 records, of which 20 studies met eligibility criteria. Extracted data were synthesized into six themes: facilitators to PREM implementation; barriers to PREM implementation; healthcare providers' perspectives towards using PREMs; patients' perspectives towards using PREMs; advantages of using PREMs in clinical practice; limitations and practical considerations to reduce resistance of PREM usage. The primary factors facilitating and impeding the use of PREMs include organizational-, staff- and patient-related factors.

CONCLUSION

Results can be used to guide the usage and implementation of PREMs in clinical settings by addressing the identified barriers and building on the perceived benefits to encourage adoption of PREMs. Results around facilitators to PREM implementation and practical considerations could also promote appropriate use of PREMs by healthcare providers, helping to improve practice and the quality of care based on patient feedback.

Characteristics and outcomes associated with two asthma quality of care measures

OBJECTIVE

We investigated asthma quality measures to understand patient characteristics associated with non-attainment of quality care and measure the association with asthma-related emergency department (ED) visits or inpatient hospitalizations (IPs).

METHODS

Using administrative data from ALL Kids, Alabama's Children's Health Insurance Program, from 2013 to 2019 we calculated non-attainment of the Medication Management for Asthma (MMA) and Asthma Medication Ratio (AMR) quality measures. Patient characteristics and asthma-related ED visits and IPs associated with non-attainment of the MMA and AMR measures were assessed using logit regression models and Marginal effects at the mean.

RESULTS

Among 2528 children with asthma, 53.2% failed to attain the MMA measure and 8.5% the AMR measure. Prior asthma-related ED visits or IP stays increased likelihood of non-attainment by 14.8 percentage points (95% CI 8.6-20.9) for MMA and 7.3 percentage points (95% CI 2.8-11.8) for AMR. Among 868 children (34.3%) with three years of continuous enrollment, AMR non-attainment was associated with a 6.1 percentage point increase in ED or IP utilization (95% CI 1.3-10.9), however MMA non-attainment was not associated with either outcome. Prior ED visit/IP stay was associated with a 17.2 percentage point (95% CI 8.3-26.1) increase in the likelihood of a subsequent ED visit/IP stay among those with non-attainment MMA and a 15.5 percentage point increase (95% CI 6.9-24.2) for non-attainment AMR.

CONCLUSIONS

Patient characteristics associated with non-attainment of asthma quality measures presents actionable evidence to guide improvement efforts as non-attainment AMR increases the risk of subsequent ED visits and IP stays.

Harnessing electronic clinical data to report adult and prenatal immunization quality measures

Objective

To explore the use of health plan quality measures specified for electronic clinical data to monitor immunizations.

Materials and Methods

We analyzed 2018 data submitted by health plans reporting 2 new Healthcare Effectiveness Data and Information Set measures assessing receipt of clinically recommended vaccines among pregnant women and adults. We analyzed the number of plans reporting a valid performance rate and electronic data source used. We consulted expert panels and reviewed coverage rates from other sources to understand the results.

Results

We received 136 data submissions across commercial, Medicaid and Medicare plans and 87 submissions across commercial and Medicaid plans for the adult and prenatal immunization measures, respectively. These submissions represent approximately 15% of possible submissions. Plans used claims, registries and electronic health records. Mean performance rates for adult immunizations were 21.2 (commercial), 14.0 (Medicaid) and 19.5% (Medicare). Mean rates for prenatal immunizations were 33.1 (commercial) and 16.7% (Medicaid).

Discussion

Results from the first year of reporting 2 electronic clinical data measures suggest health plans can feasibly report these measures and are seeking electronic data to supplement claims. Comparison of rates to other national results showed lower than expected rates for the adult immunization measure. However, prenatal immunization rates were on par with those from a national survey, suggesting this measure is closer to use for quality improvement.

Conclusion

Quality measure reporting that encourages connection to electronic data sources is a step forward in performance monitoring and improvement. The use of electronic sources may advance health information exchange for patient care.

A best-worst scaling experiment to identify patient-centered claims-based outcomes for evaluation of pediatric antipsychotic monitoring programs

Objective

This article employs a best‐worst scaling (BWS) experiment to identify the claims‐based outcomes that matter most to patients and other relevant parties when evaluating pediatric antipsychotic monitoring programs in the United States.

Data Sources

Patients and relevant parties, with pediatric antipsychotic oversight and treatment experience, completed a BWS experiment, including policymakers (n = 31), foster care alumni (n = 28), caseworkers (n = 23), prescribing clinicians (n = 32), and caregivers (n = 18).

Study Design

Respondents received surveys with a scenario on antipsychotic monitoring programs and ranked 11 candidate claims‐based outcomes as most and least important for program evaluation.

Data Analysis

Stratified by respondent group, best‐worst scores were calculated to identify the relative importance of the claims‐based outcomes. A conditional logit examined whether candidate outcomes for safety, quality, and unintended consequences were preferred over reduction in antipsychotic treatment, the outcome used most often to evaluate antipsychotic monitoring programs.

Principal Findings

Safety indicators (eg, antipsychotic co‐pharmacy, cross‐class polypharmacy, higher than recommended doses) ranked among the top three candidate outcomes across respondent groups and were an important complement to antipsychotic treatment reduction. Foster care alumni prioritized “antipsychotic treatment reduction” and “increased psychosocial treatment.” Caseworkers, prescribers, and caregivers prioritized “increased follow‐up after treatment initiation.” Potential unintended consequences of an antipsychotic monitoring program ranked lowest, including increased use of other psychotropic medication classes (as a substitute), increased psychiatric hospital stays, and increased emergency room utilization. Results of the conditional logit model found only caregivers significantly preferred other indicators over antipsychotic treatment reduction, preferring improvements in follow‐up care (5.78) and psychosocial treatment (4.53) and reduction in prescriptions of higher than recommended doses (3.64).

Conclusions

The BWS experiment supported rank ordering of candidate claims‐based outcomes demonstrating the opportunity for future studies to align outcomes used in antipsychotic monitoring program evaluations with community preferences, specifically by diversifying metrics to include safety and quality indicators.

A systematic review and meta-synthesis of policy intervention characteristics that influence the implementation of government-directed policy in the hospital setting: implications for infection prevention and control

Background

Government-directed policy plays an important role in the regulation and supervision of healthcare quality. Effective implementation of these policies has the potential to significantly improve clinical practice and patient outcomes, including the prevention of healthcare-associated infections. A systematic review of research describing the implementation of government-directed policy in the hospital setting was performed with the aim to identify policy intervention characteristics that influence implementation.

Methods

A systematic search of four electronic databases was undertaken to identify eligible articles published between 2007 and 2017. Studies were included if published in the English language and described the implementation of government-directed policy in a high-income country hospital setting. Data on policy and implementation were extracted for each article and interpretive syntheses performed.

Results

A total of 925 articles were retrieved and titles and abstracts reviewed, with 69 articles included after review of abstract and full text. Qualitative synthesis of implementation data showed three overarching themes related to intervention characteristics associated with implementation: clarity; infrastructure; and alignment.

Conclusion

Better understanding and consideration of policy intervention characteristics during development and planning will facilitate more effective implementation although research describing implementation of government-directed policy in the hospital setting is limited and of variable quality. The findings of this study provide guidance to staff tasked with the development or implementation of government-directed policy in the hospital setting, infection prevention and control professionals seeking to maximise the impact of policy on practice and improve patient outcomes.

Systematic Review of Self-Report Measures of General Mental Health and Wellbeing in Adolescent Mental Health

The assessment of general mental health and wellbeing is important within child and adolescent mental health services (CAMHS) for both clinicians and policy makers. Measurement tools are routinely relied upon to aid assessment and to monitor and evaluate treatment and service effectiveness. We conducted a systematic review using the COSMIN checklist to identify measures of general mental health and wellbeing for an adolescent mental health population. A systematic database search was performed using PsychINFO, MEDLINE, EMBASE, and CINAHL in accordance with PRISMA guidelines. Database searching produced 9587 records, with 27 papers meeting eligibility criteria and 16 measures identified and critically appraised. The Y-QOL-R and the Y-QOL.30.1 had the most robust psychometric properties. When considering the clinical utility of measures alongside psychometric properties of measures, the GHQ-12, ORS and YP CORE had the greatest clinical utility. The psychometric quality of measures reviewed overall, however, were generally poor in quality. Measuring outcomes in CAMHS and ensuring appropriate treatment pathways for young people is important. This review highlights the need for more robust testing of the psychometric properties of adolescent measures. When selecting measurement tools, clinicians should not only consider the purpose of the measure, (i.e., discriminative, predictive, and evaluative) and characteristics of the instrument (e.g., intended population, measure length), but should also the quality of the psychometric properties of the instrument.

A Primer on Understanding Pediatric Health Care Quality Measurement

Advanced practice registered nurses implement evidence-based care guidelines and assess the quality of care delivered to pediatric and adolescent populations to ensure that the highest standards of care are provided to the patients and their families. Standardized health care quality measures allow for assessment of clinical competence, monitoring of equitable health care distribution, improvement of provider/institutional accountability, development of standards for accreditation and certification, informing of quality improvement efforts, and creation of criteria for provider incentive payments. The purpose of this article is to explain why health care quality measures are established, what agencies oversee the development of meaningful pediatric quality measures, and how these measures inform and improve the care provided by pediatric-focused advanced practice registered nurses.

Process Metrics and Outcomes to Inform Quality Improvement in Pediatric Hospital Medicine

This article provides an overview of the selection, development, and use of process and outcome measures for pediatric hospital medicine quality improvement initiatives. It reviews commonly used categories of process and outcome measures and provides a list of common sources and repositories of previously validated measures. It also provides a blueprint for the development of novel measures. The relative merits of various data collection methods are discussed (eg, medical record abstraction, administrative, surveys), along with guiding principles for disseminating the results of quality improvement evaluations on a local and national level.

A Learning Loop Model of Collaborative Decision-Making in Chronic Illness

Shared decision-making is a core attribute of quality health care that has proved challenging to implement and assess in pediatric practice. Current models of shared decision-making are limited, including their capacity to incorporate multiple stakeholders; to integrate downstream effects of subacute or minor decisions; and to account for the context(s) in which such decisions are being made and enacted. Based on a review of literature from organizational psychology, cognitive sciences, business, and medicine, we propose an iterative decision-making model of care planning and identify targets at several levels of influence warranting measurement in future studies. Our learning loop model posits the relationship between pediatric patients, their parents, and their clinicians as central to the collaborative decision-making process in the setting of chronic illness. The model incorporates the evolution of both context and developmental capacity over time. It suggests that "meta-learning" from the experience of and outcomes from iterative decision is a key factor that may influence relationships and thus continued engagement in collaboration by patients, their parents, and their clinicians. We consider the model in light of the needs of children with special health care needs, for whom understanding the ongoing iterative effects of decision making and clinician-parent-child dynamics are likely to be particularly important in influencing outcomes.

Pediatricians' Participation in Quality Improvement at the Time of Enrollment in MOC

BACKGROUND AND OBJECTIVES

Although national bodies have proclaimed the importance of incorporating quality improvement (QI) into the daily fabric of clinical care, the actual proportion of practicing pediatricians who participate in QI activities on an annual basis is unknown. Correspondingly little is known about pediatrician motivations for, attitudes about, and support received for QI participation.

METHODS

Pediatric diplomates enrolling in the American Board of Pediatrics' Maintenance of Certification program during calendar year 2016 were provided with the opportunity to complete a brief survey. A portion of the survey was focused on issues related to participation in QI programs.

RESULTS

Survey responses were received from 8714 of the 11 890 diplomates who enrolled in Maintenance of Certification in 2016 (response rate: 73.3%). Overall, 86.6% of respondents reported participation in at least 1 QI project in the previous year. There was variation in previous-year participation in a QI project by practice affiliation categories, ranging from 79.9% for nonacademic generalists to 92.4% for academic specialists. The extrinsic requirement for QI to maintain board certification was the dominant motivator among all respondents (50.7%), followed by 2 intrinsic factors: identify gaps in practice and implement change (40.3%) and opportunity to collaborate with others (36.9%).

CONCLUSIONS

Although the results are encouraging, despite almost 2 decades of national attention to the quality of health care and efforts to embed continual QI in health care delivery activities, ∼1 in 5 nonacademic pediatricians and 1 in 10 academic pediatricians did not report participating in any QI activities in the previous year.

Differences in Medicaid Antipsychotic Medication Measures Among Children with SSI, Foster Care, and Income-Based Aid

BACKGROUND

Concerns about antipsychotic prescribing for children, particularly those enrolled in Medicaid and with Supplemental Security Income (SSI), continue despite recent calls for selective use within established guidelines.

OBJECTIVES

To (a) examine the application of 6 quality measures for antipsychotic medication prescribing in children and adolescents receiving Medicaid and (b) understand distinctive patterns across eligibility categories in order to inform ongoing quality management efforts to support judicious antipsychotic use.

METHODS

Using data for 10 states from the 2008 Medicaid Analytic Extract (MAX), a cross-sectional assessment of 144,200 Medicaid beneficiaries aged < 21 years who received antipsychotics was conducted to calculate the prevalence of 6 quality measures for antipsychotic medication management, which were developed in 2012-2014 by the National Collaborative for Innovation in Quality Measurement. These measures addressed antipsychotic polypharmacy, higher-than-recommended doses of antipsychotics, use of psychosocial services before antipsychotic initiation, follow-up after initiation, baseline metabolic screening, and ongoing metabolic monitoring.

RESULTS

Compared with children eligble for income-based Medicaid, children receiving SSI and in foster care were twice as likely to receive higher-than-recommended doses of antipsychotics (adjusted odds ratio [AOR] = 2.4, 95% CI = 2.3-2.6; AOR = 2.5, 95% CI = 2.4-2.6, respectively) and multiple concurrent antipsychotic medications (AOR = 2.2, 95% CI = 2.0-2.4; AOR = 2.2, 95% CI = 2.0-2.4, respectively). However, children receiving SSI and in foster care were more likely to have appropriate management, including psychosocial visits before initiating antipsychotic treatment and ongoing metabolic monitoring. While children in foster care were more likely to experience baseline metabolic screening, SSI children were no more likely than children eligible for income-based aid to receive baseline screening.

CONCLUSIONS

While indicators of overuse were more common in SSI and foster care groups, access to follow-up, metabolic monitoring, and psychosocial services was somewhat better for these children. However, substantial quality shortfalls existed for all groups, particularly metabolic screening and monitoring. Renewed efforts are needed to improve antipsychotic medication management for all children.

DISCLOSURES

This project was supported by grant number U18HS020503 from the Agency for Healthcare Research and Quality (AHRQ) and Centers for Medicare & Medicaid Services (CMS). Additional support for Rutgers-based participants was provided from AHRQ grants R18 HS019937 and U19HS021112, as well as the New York State Office of Mental Health. The content of this study is solely the responsibility of the authors and does not necessarily represent the official views of AHRQ, CMS, or the New York State Office of Mental Health. Finnerty has been the principle investigator on research grants/contracts from Bristol Myers Squibb and Sunovion, but her time on these projects is fully supported by the New York State Office of Mental Health. Scholle, Byron, and Morden work for the National Committee for Quality Assurance, a not-for-profit organization that develops and maintains quality measures. Neese-Todd was at Rutgers University at the time of this study and is now employed by the National Committee for Quality Assurance. The other authors have no financial relationships relevant to this article to disclose. Study concept and design were contributed by Finnerty, Neese-Todd, and Crystal, assisted by Scholle, Leckman-Westin, Horowitz, and Hoagwood. Scholle, Byron, Morden, and Hoagwood collected the data, and data interpretation was performed by Pritam, Bilder, Leckman-Westin, and Finnerty, with assistance from Scholle, Byron, Crystal, Kealey, and Neese-Todd. The manuscript was written by Leckman-Westin, Kealey, and Horowitz and revised by Layman, Crystal, Leckman-Westin, Finnerty, Scholle, Neese-Todd, and Horowitz, along with the other authors.

Hospital-Based Quality Measures for Pediatric Mental Health Care

BACKGROUND AND OBJECTIVES

Patients with a primary mental health condition account for nearly 10% of pediatric hospitalizations nationally, but little is known about the quality of care provided for them in hospital settings. Our objective was to develop and test medical record-based measures used to assess quality of pediatric mental health care in the emergency department (ED) and inpatient settings.

METHODS

We drafted an evidence-based set of pediatric mental health care quality measures for the ED and inpatient settings. We used the modified Delphi method to prioritize measures; 2 ED and 6 inpatient measures were operationalized and field-tested in 2 community and 3 children's hospitals. Eligible patients were 5 to 19 years old and diagnosed with psychosis, suicidality, or substance use from January 2012 to December 2013. We used bivariate and multivariate models to examine measure performance by patient characteristics and by hospital.

RESULTS

Eight hundred and seventeen records were abstracted with primary diagnoses of suicidality (n = 446), psychosis (n = 321), and substance use (n = 50). Performance varied across measures. Among patients with suicidality, male patients (adjusted odds ratio: 0.27, P < .001) and African American patients (adjusted odds ratio: 0.31, P = .02) were less likely to have documentation of caregiver counseling on lethal means restriction. Among admitted suicidal patients, 27% had documentation of communication with an outside provider, with variation across hospitals (0%-38%; P < .001). There was low overall performance on screening for comorbid substance abuse in ED patients with psychosis (mean: 30.3).

CONCLUSIONS

These new pediatric mental health care quality measures were used to identify sex and race disparities and substantial hospital variation. These measures may be useful for assessing and improving hospital-based pediatric mental health care quality.

Measuring and improving the quality of mental health care: a global perspective

Mental disorders are common worldwide, yet the quality of care for these disorders has not increased to the same extent as that for physical conditions. In this paper, we present a framework for promoting quality measurement as a tool for improving quality of mental health care. We identify key barriers to this effort, including lack of standardized information technology-based data sources, limited scientific evidence for mental health quality measures, lack of provider training and support, and cultural barriers to integrating mental health care within general health environments. We describe several innovations that are underway worldwide which can mitigate these barriers. Based on these experiences, we offer several recommendations for improving quality of mental health care. Health care payers and providers will need a portfolio of validated measures of patient-centered outcomes across a spectrum of conditions. Common data elements will have to be developed and embedded within existing electronic health records and other information technology tools. Mental health outcomes will need to be assessed more routinely, and measurement-based care should become part of the overall culture of the mental health care system. Health care systems will need a valid way to stratify quality measures, in order to address potential gaps among subpopulations and identify groups in most need of quality improvement. Much more attention should be devoted to workforce training in and capacity for quality improvement. The field of mental health quality improvement is a team sport, requiring coordination across different providers, involvement of consumer advocates, and leveraging of resources and incentives from health care payers and systems.

A New Era in Quality Measurement: The Development and Application of Quality Measures

Quality measures are used for a variety of purposes in health care, including clinical care improvement, regulation, accreditation, public reporting, surveillance, and maintenance of certification. Most quality measures are 1 of 3 types: structure, process, or outcome. Health care quality measures should address the domains of quality across the continuum of care and reflect patient and family experience. Measure development for pediatric health care has a number of important challenges, including gaps in the evidence base; the fact that measures for most conditions must be age-specific; the long, resource-intensive development process; and the national focus on measure development for adult conditions. Numerous national organizations focus on the development and application of quality measures, including the Pediatric Quality Measures Program, which is focused solely on the development and implementation of pediatric-specific measures. Once a quality measure is developed for use in national measurement programs, the organization that develops and/or "stewards" the measure may submit the measure or set of measures for endorsement, which is recognition of the scientific soundness, usability, and relevance of the measure. Quality measures must then be disseminated and applied to improve care. Although pediatric health care providers and child health care institutions alike must continually balance time and resources needed to address multiple reporting requirements, quality measurement is an important tool for advancing high-quality and safe health care for children. This policy statement provides an overview of quality measurement and describes the opportunities for pediatric health care providers to apply quality measures to improve clinical quality and performance in the delivery of pediatric health care services.

Systematic review of approaches to using patient experience data for quality improvement in healthcare settings

OBJECTIVES

Explore how patient-reported experience measures (PREMs) are collected, communicated and used to inform quality improvement (QI) across healthcare settings.

DESIGN

Systematic review.

SETTING

Various primary and secondary care settings, including general practice, and acute and chronic care hospitals.

PARTICIPANTS

A full range of patient populations from (children through to the elderly) and staff (from healthcare practitioners to senior managers).

METHODS

Scientific databases were searched (CINAHL, PsycINFO, MEDLINE and Cochrane Libraries) as was grey literature. Qualitative and quantitative studies describing collection of PREM data and subsequent QI actions in any healthcare setting were included. Risk of bias was assessed using established criteria. Of 5312 initial hits, 32 full texts were screened, and 11 were included.

RESULTS

Patient experience data were most commonly collected through surveys and used to identify small areas of incremental change to services that do not require a change to clinician behaviour (eg, changes to admission processes and producing educational materials). While staff in most studies reported having made effective improvements, authors struggled to identify what those changes were or the impact they had.

CONCLUSIONS

Findings suggest there is no single best way to collect or use PREM data for QI, but they do suggest some key points to consider when planning such an approach. For instance, formal training is recommended, as a lack of expertise in QI and confidence in interpreting patient experience data effectively may continue to be a barrier to a successful shift towards a more patient-centred healthcare service. In the context of QI, more attention is required on how patient experience data will be used to inform changes to practice and, in turn, measure any impact these changes may have on patient experience.

Quality Measures to Assess Care Transitions for Hospitalized Children

BACKGROUND

Transitions between sites of care are inherent to all hospitalizations, yet we lack pediatric-specific transitions-of-care quality measures. We describe the development and validation of new transitions-of-care quality measures obtained from medical record data.

METHODS

After an evidence review, a multistakeholder panel prioritized quality measures by using the RAND/University of California, Los Angeles modified Delphi method. Three measures were endorsed, operationalized, and field-tested at 3 children's hospitals and 2 community hospitals: quality of hospital-to-home transition record content, timeliness of discharge communication between inpatient and outpatient providers, and ICU-to-floor transition note quality. Summary scores were calculated on a scale from 0 to 100; higher scores indicated better quality. We examined between-hospital variation in scores, associations of hospital-to-home transition quality scores with readmission and emergency department return visit rates, and associations of ICU-to-floor transition quality scores with ICU readmission and length of stay.

RESULTS

A total of 927 charts from 5 hospitals were reviewed. Mean quality scores were 65.5 (SD 18.1) for the hospital-to-home transition record measure, 33.3 (SD 47.1) for the discharge communication measure, and 64.9 (SD 47.1) for the ICU-to-floor transition measure. The mean adjusted hospital-to-home transition summary score was 61.2 (SD 17.1), with significant variation in scores between hospitals (P < .001). Hospital-to-home transition quality scores were not associated with readmissions or emergency department return visits. ICU-to-floor transition note quality scores were not associated with ICU readmissions or hospital length of stay.

CONCLUSIONS

These quality measures were feasible to implement in diverse settings and varied across hospitals. The development of these measures is an important step toward standardized evaluation of the quality of pediatric transitional care.

Development of the Children With Disabilities Algorithm

BACKGROUND

A major impediment to understanding quality of care for children with disabilities (CWD) is the lack of a method for identifying this group in claims databases. We developed the CWD algorithm (CWDA), which uses International Classification of Diseases, Ninth Revision, Clinical Modification (ICD-9-CM) codes to identify CWD.

METHODS

We conducted a cross-sectional study that (1) ensured each of the 14,567 codes within the 2012 ICD-9-CM codebook was independently classified by 3 to 9 pediatricians based on the code's likelihood of indicating CWD and (2) triangulated the resulting CWDA against parent and physician assessment of children's disability status by using survey and chart abstraction, respectively. Eight fellowship-trained general pediatricians and 42 subspecialists from across the United States participated in the code classification. Parents of 128 children from a large, free-standing children's hospital participated in the parent survey; charts of 336 children from the same hospital were included in the abstraction study.

RESULTS

CWDA contains 669 ICD-9-CM codes classified as having a ≥75% likelihood of indicating CWD. Examples include 318.2 Profound intellectual disabilities and 780.72 Functional quadriplegia. CWDA sensitivity was 0.75 (95% confidence interval 0.63-0.84) compared with parent report and 0.98 (0.95-0.99) compared with physician assessment; its specificity was 0.86 (0.72-0.95) and 0.50 (0.41-0.59), respectively.

CONCLUSIONS

ICD-9-CM codes can be classified by their likelihood of indicating CWD. CWDA triangulates well with parent report and physician assessment of child disability status. CWDA is a new tool that can be used to assess care quality for CWD.

The effectiveness of family-centered transition processes from hospital settings to home: a review of the literature

BACKGROUND AND OBJECTIVES

The quality of care transitions is of growing concern because of a high incidence of postdischarge adverse events, poor communication with patients, and inadequate information transfer between providers. The objective of this study was to conduct a targeted literature review of studies examining the effectiveness of family-centered transition processes from hospital- and emergency department (ED)-to-home for improving patient health outcomes and health care utilization.

METHODS

We conducted an electronic search (2001-2012) of PubMed, CINAHL, Cochrane, PsycInfo, Embase, and Web of Science databases. Included were experimental studies of hospital and ED-to-home transition interventions in pediatric and adult populations meeting the following inclusion criteria: studies evaluating hospital or ED-to-home transition interventions, study interventions involving patients/families, studies measuring outcomes≤30 days after discharge, and US studies. Transition processes, principal outcome measures (patient health outcomes and health care utilization), and assessment time-frames were extracted for each study.

RESULTS

The search yielded 3458 articles, and 16 clinical trials met final inclusion criteria. Four studies evaluated pediatric ED-to-home transitions and indicated family-tailored discharge education was associated with better patient health outcomes. Remaining trials evaluating adult hospital-to-home transitions indicated a transition needs assessment or provision of an individualized transition record was associated with better patient health outcomes and reductions in health care utilization. The effectiveness of postdischarge telephone follow-up and/or home visits on health care utilization showed mixed results.

CONCLUSIONS

Patient-tailored discharge education is associated with improved patient health outcomes in pediatric ED patients. Effective transition processes identified in the adult literature may inform future quality improvement research regarding pediatric hospital-to-home transitions.

Advancing children's health care and outcomes through the pediatric quality measures program

In 2009 Congress passed the Children's Health Insurance Program Reauthorization Act (CHIPRA), which presented an unprecedented opportunity to measure and improve health care quality and outcomes for children. The Agency for Healthcare Research and Quality, in partnership with the Centers for Medicare & Medicaid Services, has worked to fulfill a number of quality measurement provisions under CHIPRA, including establishing the Pediatric Quality Measures Program (PQMP). The PQMP was charged with establishing a publicly available portfolio of new and enhanced evidence-based pediatric quality measures for use by Medicaid/Children's Health Insurance Program and other public and private programs and to also provide opportunities to improve and strengthen the Child Core Set of quality measures. This article focuses on the PQMP and provides an overview of the program's goals and related activities, lessons learned, and future opportunities.

Quality concerns in antipsychotic prescribing for youth: a review of treatment guidelines

BACKGROUND

Antipsychotic prescribing for youth has increased rapidly, is linked with serious health concerns, and lacks clear measures of quality for pediatric care. We reviewed treatment guidelines relevant to 7 quality concepts for appropriate use and management of youth on antipsychotics: 1) use in very young children, 2) multiple concurrent antipsychotics, 3) higher-than-recommended doses, 4) use without a primary indication, 5) access to psychosocial interventions, 6) metabolic screening, and 7) follow-up visits with a prescriber.

METHODS

We searched for clinical practice guidelines meeting the following criteria: developed or endorsed by a national body, published after 2000, and specific treatment recommendations made related to 1 or more of the 7 quality concepts. Sources included electronic databases, the American Academy of Child and Adolescent Psychiatry Web site, and stakeholder and expert advisory committee recommendations. Two raters reviewed the 11 guidelines identified, extracting treatment recommendations, including details that could support measure definitions, and ratings of strength of recommendation and evidence.

RESULTS

All 7 quality concepts were strongly endorsed by 1 or more guidelines, and 2 or more guidelines assigned their highest strength of recommendation ratings to 6 of the 7 concepts. Two guidelines rated evidence, providing high strength of evidence for 2 quality concepts: psychosocial interventions and metabolic monitoring.

CONCLUSIONS

Guidelines provide support for 7 quality concepts addressing antipsychotic prescribing for youth. However, guideline support is often based on strong clinical consensus rather than a robust evidence base.