Advancing children's health care and outcomes through the pediatric quality measures program

Missed Opportunities in Guideline-Based Fatty Liver Screening Among 3.5 Million Children

OBJECTIVE

Determine screening rates and examine socio-demographic characteristics of metabolic dysfunction-associated steatotic liver disease (MAFLD) screening in a large population of obese children.

METHODS

We used Explorys (IBM) which contains aggregated population-level electronic health record data from approximately 360 hospitals and 317,000 providers across the United States to determine MAFLD screening rates. In children 10 to 14 years, obesity was determined based on body mass index ≥ 95%, or encounter with an international classification of disease obesity code. We determined screening rates by calculating the percentage of children with obesity who had an alanine aminotransferase tested, further analyzed by gender, race, and insurance.

RESULTS

Of 3,558,420 children, 513,170 (14.4%) were obese. Of obese children, only 9.3% were screened for MAFLD. Females were more likely screened than males (odds ratio (OR) 1.09 (95% confidence intervals (CI): 1.07-1.12)); White children were more likely screened than non-White children (OR 1.21 (95% CI: 1.18-1.23)), and children with Medicaid more likely screened than children with non-Medicaid insurance (OR 1.34 (95% CI: 1.32-1.37)).

CONCLUSIONS

The percentage of obese children receiving screening for MAFLD was low. Female gender, White race, and Medicaid insurance were associated with increased screening rates. These findings highlight the need to increase adherence to MAFLD screening. Reporting screening as a health quality measure may reduce implementation gaps in MAFLD screening.

Improving health equity through health care systems research

OBJECTIVE

To describe health equity research priorities for health care delivery systems and delineate a research and action agenda that generates evidence-based solutions to persistent racial and ethnic inequities in health outcomes.

DATA SOURCES AND STUDY SETTING

This project was conducted as a component of the Agency for Healthcare Research and Quality's (AHRQ) stakeholder engaged process to develop an Equity Agenda and Action Plan to guide priority setting to advance health equity. Recommendations were developed and refined based on expert input, evidence review, and stakeholder engagement. Participating stakeholders included experts from academia, health care organizations, industry, and government.

STUDY DESIGN

Expert group consensus, informed by stakeholder engagement and targeted evidence review.

DATA COLLECTION/EXTRACTION METHODS

Priority themes were derived iteratively through (1) brainstorming and idea reduction, (2) targeted evidence review of candidate themes, (3) determination of preliminary themes; (4) input on preliminary themes from stakeholders attending AHRQ's 2022 Health Equity Summit; and (5) and refinement of themes based on that input. The final set of research and action recommendations was determined by authors' consensus.

PRINCIPAL FINDINGS

Health care delivery systems have contributed to racial and ethnic disparities in health care. High quality research is needed to inform health care delivery systems approaches to undo systemic barriers and inequities. We identified six priority themes for research; (1) institutional leadership, culture, and workforce; (2) data-driven, culturally tailored care; (3) health equity targeted performance incentives; (4) health equity-informed approaches to health system consolidation and access; (5) whole person care; (6) and whole community investment. We also suggest cross-cutting themes regarding research workforce and research timelines.

CONCLUSIONS

As the nation's primary health services research agency, AHRQ can advance equitable delivery of health care by funding research and disseminating evidence to help transform the organization and delivery of health care.

Annual Variation in 30-Day Risk-Adjusted Readmission Rates in U.S. Children's Hospitals

OBJECTIVE

Reducing pediatric readmissions has become a national priority; however, the use of readmission rates as a quality metric remains controversial. The goal of this study was to examine short-term stability and long-term changes in hospital readmission rates.

METHODS

Data from the Pediatric Health Information System were used to compare annual 30-day risk-adjusted readmission rates (RARRs) in 47 US children's hospitals from 2016 to 2017 (short-term) and 2016 to 2019 (long-term). Pearson correlation coefficients and weighted Cohen's Kappa statistics were used to measure correlation and agreement across years for hospital-level RARRs and performance quartiles.

RESULTS

Median (IQR) 30-day RARRs remained stable from 7.7% (7.0-8.3) in 2016 to 7.6% (7.0-8.1) in 2019. Individual hospital RARRs in 2016 were strongly correlated with the same hospital's 2017 rate (R2 = 0.89 [95% confidence interval (CI) 0.80-0.94]) and moderately correlated with those in 2019 (R2 = 0.49 [95%CI 0.23-0.68]). Short-term RARRs (2016 vs 2017) were more highly correlated for medical conditions than surgical conditions, but correlations between long-term medical and surgical RARRs (2016 vs 2019) were similar. Agreement between RARRs was higher when comparing short-term changes (0.73 [95%CI 0.59-0.86]) than long-term changes (0.45 [95%CI 0.27-0.63]). From 2016 to 2019, RARRs increased by ≥1% in 7 (15%) hospitals and decreased by ≥1% in 6 (13%) hospitals. Only 7 (15%) hospitals experienced reductions in RARRs over the short and long-term.

CONCLUSIONS

Hospital-level performance on RARRs remained stable with high agreement over the short-term suggesting stability of readmission measures. There was little evidence of sustained improvement in hospital-level performance over multiple years.

Weekend Versus Weekday Asthma-Related Emergency Department Utilization

OBJECTIVE

To assess variation in asthma-related emergency department (ED) use between weekends and weekdays.

METHODS

Cross-sectional administrative claims-based analysis using California 2016 Medicaid data and Vermont 2016 and Massachusetts 2015 all-payer claims databases. We defined ED use as the rate of asthma-related ED visits per 100 child-years. A weekend visit was a visit on Saturday or Sunday, based on date of ED visit claim. We used negative binomial regression and robust standard errors to assess variation between weekend and weekday rates, overall and by age group.

RESULTS

We evaluated data from 398,537 patients with asthma. The asthma-related ED visit rate was slightly lower on weekends (weekend: 18.7 [95% confidence interval (CI): 18.3-19.0], weekday: 19.6 [95% CI, 19.3-19.8], P < .001). When stratifying by age group, 3- to 5-year-olds had higher rates of asthma-related ED visits on weekends than weekdays (weekend: 33.7 [95% CI, 32.6-34.7], weekday: 29.8 [95% CI, 29.1-30.5], P < .001) and 12- to 17-year-olds had lower rates of ED visits on weekends than weekdays (weekend: 13.0 [95% CI: 12.5-13.4], weekday: 16.3 [95% CI: 15.9-16.7], P < .001). In the other age groups (6-11, 18-21 years) there were not statistically significant differences between weekend and weekday rates (P > .05).

CONCLUSIONS

In this multistate analysis of children with asthma, we found limited overall variation in pediatric asthma-related ED utilization on weekends versus weekdays. These findings suggest that increasing access options during the weekend may not necessarily decrease asthma-related ED use.

Enhancing Quality Measurement With Clinical Information: A Use Case of Body Mass Index Change Among Children Taking Second Generation Antipsychotics

OBJECTIVE

We sought to examine the extent to which body mass index (BMI) was available in electronic health records for Florida Medicaid recipients aged 5 to 18 years taking Second-Generation Antipsychotics (SGAP). We also sought to illustrate how clinical data can be used to identify children most at-risk for SGAP-induced weight gain, which cannot be done using process-focused measures.

METHODS

Electronic health record (EHR) data and Medicaid claims were linked from 2013 to 2019. We quantified sociodemographic differences between children with and without pre- and post-BMI values. We developed a linear regression model of post-BMI to examine pre-post changes in BMI among 4 groups: 1) BH/SGAP+ children had behavioral health conditions and were taking SGAP; 2) BH/SGAP- children had behavioral health conditions without taking SGAP; 3) children with asthma; and 4) healthy children.

RESULTS

Of 363,360 EHR-Medicaid linked children, 18,726 were BH/SGAP+. Roughly 4% of linked children and 8% of BH/SGAP+ children had both pre and post values of BMI required to assess quality of SGAP monitoring. The percentage varied with gender and race-ethnicity. The R2 for the regression model with all predictors was 0.865. Pre-post change in BMI differed significantly (P < .0001) among the groups, with more BMI gain among those taking SGAP, particularly those with higher baseline BMI.

CONCLUSION

Meeting the 2030 Centers for Medicare and Medicaid Services goal of digital monitoring of quality of care will require continuing expansion of clinical encounter data capture to provide the data needed for digital quality monitoring. Using linked EHR and claims data allows identifying children at higher risk for SGAP-induced weight gain.

Florida Medicaid Children's Receipt of First-Line Psychosocial Care Prior to Antipsychotic Initiation

BACKGROUND AND OBJECTIVE

First-line, nonpharmacological therapy is recommended for many pediatric mental health (MH) conditions prior to initiating antipsychotic prescription therapies. Many children do not receive these recommended services, despite the known association between antipsychotic medications and metabolic dysfunction. The main objective of this study was to quantify the association among children's MH diagnosis categories, sociodemographic characteristics and receipt of first-line psychosocial care among children in Florida Medicaid METHODS: Florida Medicaid enrollment, healthcare and pharmacy claims were used for this multivariate analysis. Children were assigned to condition clusters wherein related diagnoses were grouped into clinically relevant categories. A total of 7704 children were included in the final analysis.

RESULTS

Twenty-four percent of children in Florida Medicaid do not receive first-line, nonpharmacological psychosocial care. Age was significantly associated with not receiving psychosocial services, with older children less likely to receive. Non-Hispanic White children as well as those living in rural areas had lower odds of receiving behavioral intervention prior to initiating antipsychotics. Children with mood-disorders, behavior problems, anxiety and stress related disorders were more likely to receive first-line psychosocial care.

CONCLUSIONS

This study provides an important understanding of the variability in receipt of first-line psychosocial care before antipsychotic medication initiation among children in Medicaid based on sociodemographic and MH health characteristics. These analyses can be used to develop quality improvement initiatives targeted toward children that are most vulnerable for not receiving recommended care.

Follow-Up After Asthma Emergency Department Visits and Its Relationship With Subsequent Asthma-Related Utilization

OBJECTIVE

To assess the association between follow-up after an asthma-related emergency department (ED) visit and the likelihood of subsequent asthma-related ED utilization.

METHODS

Using data from California Medicaid (2014-2016), and Vermont (2014-2016) and Massachusetts (2013-2015) all-payer claims databases, we identified asthma-related ED visits for patients ages 3 to 21. Follow-up was defined as a visit within 14 days with a primary care provider or an asthma specialist.

OUTCOME

asthma-related ED revisit after the initial ED visit. Models included logistic regression to assess the relationship between 14-day follow-up and the outcome at 60 and 365 days, and mixed-effects negative binomial regression to assess the relationship between 14-day follow-up and repeated outcome events (# ED revisits/100 child-years). All models accounted for zip-code level clustering.

RESULTS

There were 90,267 ED visits, of which 22.6% had 14-day follow-up. Patients with follow-up were younger and more likely to have commercial insurance, complex chronic conditions, and evidence of prior asthma. 14-day follow-up was associated with decreased subsequent asthma-related ED revisits at 60 days (5.7% versus 6.4%, P < .001) and at 365 days (25.0% versus 28.3%, P < 0.001). Similarly, 14-day follow-up was associated with a decrease in the rate of repeated subsequent ED revisits (66.7 versus 77.3 revisits/100 child-years; P < 0.001).

CONCLUSIONS

We found a protective association between outpatient 14-day follow-up and asthma-related ED revisits. This may reflect improved asthma control as providers follow the NHLBI guideline stepwise approach. Our findings highlight an opportunity for improvement, with only 22.6% of those with asthma-related ED visits having 14-day follow-up.

Towards a harmonised framework for developing quality of care indicators for global health: a scoping review of existing conceptual and methodological practices

OBJECTIVES

Despite significant advances in the science of quality of care measurement over the last decade, approaches to developing quality of care indicators for global health priorities are not clearly defined. We conducted a scoping review of concepts and methods used to develop quality of healthcare indicators to better inform ongoing efforts towards a more harmonised approach to quality of care indicator development in global health.

METHODS

We conducted a systematic search of electronic databases, grey literature and references for articles on developing quality of care indicators for routine monitoring in all healthcare settings and populations, published in English between 2010 and 2020. We used well-established methods for article screening and selection, data extraction and management. Results were summarised using a descriptive analysis and a narrative synthesis.

RESULTS

The 221 selected articles were largely from high-income settings (89%), particularly the USA (46%), Canada (9%), UK (9%) and Europe (17%). Quality of care indicators were developed mainly for healthcare providers (56%), for benchmarking or quality assurance (37%) and quality improvement (29%), in hospitals (32%) and primary care (26%), across many diseases. The terms 'quality indicator' and 'quality measure' were the most frequently encountered terms (50% and 21%, respectively). Systematic approaches for quality of care indicator development emerged within national quality of care systems or through cross-country collaborations in high-income settings. Maternal, neonatal and child health (33%), mental health (26%) and primary care (57%) studies applied most components of systematic approaches, but not consistently or rigorously.

DISCUSSION

The current evidence shows variations in concepts and approaches to developing quality of care indicators, with development and application mainly in high-income countries.

CONCLUSION

Additional efforts are needed to propose 'best-practice' conceptual frameworks and methods for developing quality of care indicators to improve their utility in global health measurement.

A best-worst scaling experiment to identify patient-centered claims-based outcomes for evaluation of pediatric antipsychotic monitoring programs

Objective

This article employs a best‐worst scaling (BWS) experiment to identify the claims‐based outcomes that matter most to patients and other relevant parties when evaluating pediatric antipsychotic monitoring programs in the United States.

Data Sources

Patients and relevant parties, with pediatric antipsychotic oversight and treatment experience, completed a BWS experiment, including policymakers (n = 31), foster care alumni (n = 28), caseworkers (n = 23), prescribing clinicians (n = 32), and caregivers (n = 18).

Study Design

Respondents received surveys with a scenario on antipsychotic monitoring programs and ranked 11 candidate claims‐based outcomes as most and least important for program evaluation.

Data Analysis

Stratified by respondent group, best‐worst scores were calculated to identify the relative importance of the claims‐based outcomes. A conditional logit examined whether candidate outcomes for safety, quality, and unintended consequences were preferred over reduction in antipsychotic treatment, the outcome used most often to evaluate antipsychotic monitoring programs.

Principal Findings

Safety indicators (eg, antipsychotic co‐pharmacy, cross‐class polypharmacy, higher than recommended doses) ranked among the top three candidate outcomes across respondent groups and were an important complement to antipsychotic treatment reduction. Foster care alumni prioritized “antipsychotic treatment reduction” and “increased psychosocial treatment.” Caseworkers, prescribers, and caregivers prioritized “increased follow‐up after treatment initiation.” Potential unintended consequences of an antipsychotic monitoring program ranked lowest, including increased use of other psychotropic medication classes (as a substitute), increased psychiatric hospital stays, and increased emergency room utilization. Results of the conditional logit model found only caregivers significantly preferred other indicators over antipsychotic treatment reduction, preferring improvements in follow‐up care (5.78) and psychosocial treatment (4.53) and reduction in prescriptions of higher than recommended doses (3.64).

Conclusions

The BWS experiment supported rank ordering of candidate claims‐based outcomes demonstrating the opportunity for future studies to align outcomes used in antipsychotic monitoring program evaluations with community preferences, specifically by diversifying metrics to include safety and quality indicators.

Nurse-Sensitive Quality Metrics to Benchmark in Pediatric Cardiovascular Care

BACKGROUND

Associations between the quality of nursing care and patient outcomes have been demonstrated globally. However, translation and application of this evidence to robust measurement in pediatric specialty nursing care has been limited.

OBJECTIVES

To test the feasibility and performance of nurse-sensitive measures in pediatric cardiovascular programs.

METHODS

Ten nurse-sensitive measures targeting nursing workforce, care process, and patient outcomes were implemented, and measurement data were collected for 6 months across 9 children's hospitals in the Consortium of Congenital Cardiac Care-Measurement of Nursing Practice (C4-MNP). Participating sites evaluated the feasibility of collecting data and the usability of the data.

RESULTS

Variations in nursing workforce characteristics were reported across sites, including proportion of registered nurses with 0 to 2 years of experience, nursing education, and nursing certification. Clinical measurement data on weight gain in infants who have undergone cardiac surgery, unplanned transfer to the cardiac intensive care unit, and pain management highlighted opportunities for improvement in care processes. Overall, each measure received a score of 75% or greater in feasibility and usability.

CONCLUSIONS

Collaborative evaluation of measurement performance, feasibility, and usability provided important information for continued refinement of the measures, development of systems to support data collection, and selection of benchmarks across C4-MNP. Results supported the development of target benchmarks for C4-MNP sites to compare performance, share best practices for improving the quality of pediatric cardiovascular nursing care, and inform nurse staffing models.

A Primer on Understanding Pediatric Health Care Quality Measurement

Advanced practice registered nurses implement evidence-based care guidelines and assess the quality of care delivered to pediatric and adolescent populations to ensure that the highest standards of care are provided to the patients and their families. Standardized health care quality measures allow for assessment of clinical competence, monitoring of equitable health care distribution, improvement of provider/institutional accountability, development of standards for accreditation and certification, informing of quality improvement efforts, and creation of criteria for provider incentive payments. The purpose of this article is to explain why health care quality measures are established, what agencies oversee the development of meaningful pediatric quality measures, and how these measures inform and improve the care provided by pediatric-focused advanced practice registered nurses.

Annual Report on Health Care for Children and Youth in the United States: Focus on 30-Day Unplanned Inpatient Readmissions, 2009 to 2014

OBJECTIVE

To describe trends in unplanned 30-day all-condition hospital readmissions for children aged 1 to 17 years between 2009 and 2014.

METHODS

Analysis was conducted with the 2009-14 Nationwide Readmissions Database from the Agency for Healthcare Research and Quality's Healthcare Cost and Utilization Project. Annual hospital readmission rates, resource use, and the most common reasons for readmission were calculated for the 2009-14 period.

RESULTS

The rate of readmission for children aged 1 to 17 years was essentially stable between 2009 and 2014 (5.5% in 2009 and 5.9% in 2014). In 2009, the most common reason (principal diagnosis) for readmission was sickle cell anemia, whereas in 2014 the most common reason was epilepsy. Pneumonia fell from the second to the sixth most common reason for readmission over this period (from 3832 to 2418 stays). Other respiratory infections were among the top 10 principal readmission diagnoses in 2009, but not in 2014. Septicemia was among the 10 most common reasons for readmission in 2014, but not in 2009. Although the average cost of index (ie, initial) stays with a subsequent readmission were similar in 2009 and 2014, the average cost of index stays without a readmission and cost of readmission stays increased by approximately 23%. In both 2009 and 2014, the average cost of the index stays with a subsequent readmission was 73% to 89% higher than that of the index stays of children who were not readmitted within 30 days. The average cost of index stays preceding a readmission was 33% to 45% higher than average costs for readmitted stays. In 2014, the aggregate cost of index stays plus readmissions was $1.58 billion, with 42.9% of the costs attributable to readmissions. Regarding the average costs and lengths of stay for the 10 most common readmission diagnoses, in 2009 the average cost per stay for complications of devices, implants, or grafts was nearly 5 times greater than that of asthma ($21,200 vs $4500, respectively). In 2014, average cost per stay ranged from $5500 for asthma to $39,500 for septicemia. In 2009, the average length of stay (LOS) for complications of devices, implants, or grafts was more than 3 three times higher than that for asthma (7.8 days vs 2.5 days, respectively), and in 2014, the average LOS for septicemia was nearly 4 times higher than that for asthma (10.4 days vs. 2.6 days).

CONCLUSIONS

This study provides a baseline assessment for examining trends in 30-day unplanned pediatric readmissions, an important quality metric as the provisions of the Children's Health Insurance Program Reauthorization Act and the Affordable Care Act are changed and implemented in the future. More than 50,000 pediatric hospital stays in 2014 occurred within 30 days of a previous hospitalization, with an average cost of $13,800. This report is timely, as the health care system works to become more patient-centered and public and private payers grapple with how to pay for quality care for children. The report provides baseline information that can be used to further explore ways to reduce unplanned readmissions.

Implicit Review Instrument to Evaluate Quality of Care Delivered by Physicians to Children in Emergency Departments

OBJECTIVE

To evaluate the consistency, reliability, and validity of an implicit review instrument that measures the quality of care provided to children in the emergency department (ED).

DATA SOURCES/STUDY SETTING

Medical records of randomly selected children from 12 EDs in the Pediatric Emergency Care Applied Research Network (PECARN).

STUDY DESIGN

Eight pediatric emergency medicine physicians applied the instrument to 620 medical records.

DATA COLLECTION/EXTRACTION METHODS

We determined internal consistency using Cronbach's alpha and inter-rater reliability using the intraclass correlation coefficient (ICC). We evaluated the validity of the instrument by correlating scores with four condition-specific explicit review instruments.

PRINCIPAL FINDINGS

Individual reviewers' Cronbach's alpha had a mean of 0.85 with a range of 0.76-0.97; overall Cronbach's alpha was 0.90. The ICC was 0.49 for the summary score with a range from 0.40 to 0.46. Correlations between the quality of care score and the four condition-specific explicit review scores ranged from 0.24 to 0.38.

CONCLUSIONS

The quality of care instrument demonstrated good internal consistency, moderate inter-rater reliability, high inter-rater agreement, and evidence supporting validity. The instrument could be useful for systems' assessment and research in evaluating the care delivered to children in the ED.

Pediatrician Maintenance of Certification Using American Board of Pediatrics' Performance Improvement Modules

BACKGROUND

From 2010 to 2014, pediatricians completed Part 4 Maintenance of Certification (MOC) through practice- or organization-developed quality improvement (QI) activities approved by the American Board of Pediatrics (ABP). Organization-developed activities were online modules, such as the ABP's Performance Improvement Modules (PIMs), through which pediatricians implemented QI strategies in practice and reported quality measures.

OBJECTIVES

Aim 1 was to assess the proportion of pediatricians who completed practice- vs organization-developed QI activities for Part 4 MOC and to test the relationship between activities and pediatrician demographics. Aim 2 was to assess the relationship between PIM completion and improvement in care processes and outcomes as determined by PIM quality measures.

METHODS

For aim 1, using deidentified demographic data from the ABP, we summarized QI activity completion and performed bivariate testing by pediatrician demographics. For aim 2, using deidentified parent and pediatrician-reported quality measures from the Attention-Deficit/Hyperactivity Disorder (ADHD), Asthma, Hand Hygiene, and Influenza PIMs, we used 2-sample tests of proportions to calculate pre-post changes in quality measures.

RESULTS

For aim 1, of 50,433 pediatricians who completed Part 4 MOC from 2010 to 2014, 22% completed practice-developed and 78% organization-developed activities. More pediatricians completed organization-developed activities, regardless of age, gender, or subspecialty status. The majority (73%) of pediatricians who completed organization-developed activities completed ABP PIMs. For aim 2, PIM completion was associated with improvement on nearly all pediatrician- and parent-reported quality measures.

CONCLUSIONS

At the outset of the Part 4 MOC system, pediatricians most commonly completed online, organization-developed activities. Pediatricians and parents reported improvements in care processes and outcomes associated with PIMs, suggesting PIMs can be an effective means of facilitating practice improvement.

Maintenance of Certification and the Challenge of Professionalism

Board certification has been part of the social contract in which physicians commit to maintaining up-to-date scientific knowledge and improving the quality of patient care. However, the maintenance of certification program has been controversial. This review summarizes the philosophical underpinnings, published literature, recent improvements, and future directions of the American Board of Pediatrics maintenance of certification program.

A New Era in Quality Measurement: The Development and Application of Quality Measures

Quality measures are used for a variety of purposes in health care, including clinical care improvement, regulation, accreditation, public reporting, surveillance, and maintenance of certification. Most quality measures are 1 of 3 types: structure, process, or outcome. Health care quality measures should address the domains of quality across the continuum of care and reflect patient and family experience. Measure development for pediatric health care has a number of important challenges, including gaps in the evidence base; the fact that measures for most conditions must be age-specific; the long, resource-intensive development process; and the national focus on measure development for adult conditions. Numerous national organizations focus on the development and application of quality measures, including the Pediatric Quality Measures Program, which is focused solely on the development and implementation of pediatric-specific measures. Once a quality measure is developed for use in national measurement programs, the organization that develops and/or "stewards" the measure may submit the measure or set of measures for endorsement, which is recognition of the scientific soundness, usability, and relevance of the measure. Quality measures must then be disseminated and applied to improve care. Although pediatric health care providers and child health care institutions alike must continually balance time and resources needed to address multiple reporting requirements, quality measurement is an important tool for advancing high-quality and safe health care for children. This policy statement provides an overview of quality measurement and describes the opportunities for pediatric health care providers to apply quality measures to improve clinical quality and performance in the delivery of pediatric health care services.

Primary Care Physicians' Experiences With and Attitudes Toward Pediatric Quality Reporting

OBJECTIVE

To assess primary care providers' experiences with and attitudes toward pediatric-focused quality reports and identify key associated physician/practice characteristics.

METHODS

We performed a cross-sectional survey of pediatricians and family physicians providing primary care to publicly insured children in 3 states (North Carolina, Ohio, Pennsylvania). The survey included questions about receipt of pediatric quality reports, use of reports for quality improvement (QI), and beliefs about the effectiveness of reports for QI. We used multivariable analyses to assess associations between responses and physician/practice characteristics, including exposure to federally funded demonstration projects aimed at increasing quality reporting to physicians serving publicly insured children. We supplemented these analyses with a thematic investigation of data from 46 interviews with physicians, practice staff, and state demonstration staff.

RESULTS

Seven hundred twenty-seven physicians responded to the survey (overall response rate: 45.2%). Most physicians were receiving quality reports related to pediatric care (79.8%; 95% confidence interval [CI], 77.2%-82.4%) and believed that quality reports can be effective in helping guide QI (70.5%; 95% CI, 67.5%-73.5%). Fewer used quality reports to guide QI efforts (32.5%; 95% CI, 29.5%-35.6%). There were no significant associations between demonstration exposure and experiences or attitudes. Interview data suggested that physicians were receptive to quality reporting, but significant barriers remain to using such reports for QI, such as limited staff time or training in QI.

CONCLUSIONS

Although pediatric quality reporting is considered a promising strategy, in this study, state efforts appeared insufficient to overcome the barriers to using reports to guide practice-based QI.

Family Perspectives on High-Quality Pediatric Subspecialty Referrals

OBJECTIVE

Although children are frequently referred to subspecialist physicians, many inadequacies in referral processes have been identified from physician and system perspectives. Little is known, however, about how to comprehensively measure or improve the quality of the referral systems from a family-centered perspective. To foster family-centered improvements to pediatric subspecialty referrals, we sought to develop a framework for high-quality, patient-centered referrals from the perspectives of patients and their families.

METHODS

We used stakeholder-informed qualitative analysis of parent, caregiver, and patient interviews to identify outcomes, processes, and structures of high-quality pediatric subspecialty referrals as perceived by patients and their family members.

RESULTS

We interviewed 21 informants. Informants identified 5 desired outcomes of subspecialty referrals: improved functional status or symptoms; improved long-term outcomes; improved knowledge of their disease; informed expectations; and reduced anxiety about the child's health status. Processes that informants identified as supporting these outcomes centered around 6 key steps in subspecialty referrals, including the referral decision, previsit information transfer, appointment scheduling, subspecialist visit, postvisit information transfer, and ongoing care integration and communication. Health care delivery structures identified by informants as supporting these processes included physical infrastructure, human resources, and information technology systems.

CONCLUSIONS

We identified family-centered outcomes, processes, and structures of high-quality pediatric subspecialty referrals. These domains can be used not only to improve measurement of the quality of existing referral systems but also to inform future interventions to improve patient-centered outcomes for children in need of specialty care.

The interRAI Pediatric Home Care (PEDS HC) Assessment: Evaluating the Long-term Community-Based Service and Support Needs of Children Facing Special Healthcare Challenges

The vast majority of assessment instruments developed to assess children facing special healthcare challenges were constructed to assess children within a limited age range or children who face specific conditions or impairments. In contrast, the interRAI Pediatric Home Care (PEDS HC) Assessment Form was specifically designed to assess the long-term community-based service and support needs of children and youth aged from four to 20 years who face a wide range of chronic physical or behavioral health challenges. Initial research indicates that PEDS HC items exhibit good predictive validity—explaining significant proportions of the variance in parents’ perceptions of needs, case managers’ service authorizations, and Medicaid program expenditures for long-term community-based services and supports. In addition, PEDS HC items have been used to construct scales that summarize the strengths and needs of children facing special healthcare challenges. Versions of the PEDS HC are now being used in Medicaid programs in three states in the United States.

Development and Validation of the Adolescent Assessment of Preparation for Transition: A Novel Patient Experience Measure

PURPOSE

Significant gaps exist in health care transition (HCT) preparation that can impact care and outcomes in young adults with chronic illness. No quality measure exists to directly assess adolescent experiences of HCT preparation. Our objective was to develop an adolescent-reported measure of the quality of HCT preparation received from pediatric health care providers.

METHODS

The Adolescent Assessment of Preparation for Transition (ADAPT) is a 26-item mailed survey designed for completion by 16- and 17-year-old adolescents with a chronic health condition. Adolescents from three samples (two large Medicaid insurance plans [n = 3,000 each] and one large tertiary care pediatric hospital [n = 623]) were mailed the survey. An iterative developmental process included focus groups and cognitive interviews, and validity was assessed using confirmatory factor analysis and ordinal reliability coefficients.

RESULTS

Reliability and validity was evaluated for the following three prespecified composite measures: (1) counseling on transition self-management; (2) counseling on prescription medication; and (3) transfer planning. Across the three samples, all but one measure had good internal consistency (ordinal reliability coefficient ≥ .7). Confirmatory factor analysis using tetrachoric correlation coefficients was stable across samples and supported the construct validity of the first two composite measures.

CONCLUSIONS

ADAPT is a reliable, validated instrument measuring the quality of HCT preparation experiences reported by adolescents with chronic disease. ADAPT will enable clinical programs and health care delivery systems to assess the quality of HCT preparation and provide targets for improvement in adolescent counseling related to transition.

Developing measures for pediatric quality: methods and experiences of the CHIPRA pediatric quality measures program grantees

BACKGROUND

Monitoring quality is an important way of understanding how the health care system is serving children and families. The Children's Health Insurance Program Reauthorization Act of 2009 (CHIPRA) Pediatric Quality Measures Program (PQMP) funded efforts to develop and enhance measures to assess care for children and adolescents. We describe the processes used by the PQMP grantees to develop measures to assess the health care of children and adolescents in Medicaid and the Children's Health Insurance Program.

METHODS

Key steps in the measures development process include identifying concepts, reviewing and synthesizing evidence, prioritizing concepts, defining how measures should be calculated, and measure testing. Stakeholder engagement throughout the process is critical. Case studies illustrate how PQMP grantees adapted the process to respond to the nature of measures they were charged to develop and overcome challenges encountered.

RESULTS

PQMP grantees used varied approaches to measures development but faced common challenges, some specific to the field of pediatrics and some general to all quality measures. Major challenges included the limited evidence base, data systems difficult or unsuited for measures reporting, and conflicting stakeholder priorities.

CONCLUSIONS

As part of the PQMP, grantees were able to explore innovative methods to overcome measurement challenges, including new approaches to building the evidence base and stakeholder consensus, integration of alternative data sources, and implementation of new testing methods. As a result, the PQMP has developed new quality measures for pediatric care while also building an infrastructure, expertise, and enhanced methods for measures development that promise to provide more relevant and meaningful tools for improving the quality of children's health care.

Systematic evidence-based quality measurement life-cycle approach to measure retirement in CHIPRA

OBJECTIVE

In 2009, Centers for Medicare and Medicaid Services (CMS) publicly released an initial child core set (CCS) of health care quality measures for voluntary reporting by state Medicaid and Children's Health Insurance Program (CHIP) programs. CMS is responsible for implementing the reporting program and for updating the CCS annually. We assessed selected CCS measures for potential retirement.

METHODS

We identified a 23-member external advisory group to provide relevant expertise. We worked with the group to identify 4 major criteria with multiple subcomponents for assessing the measures. We provided information corresponding to each criterion and subcriterion, using a variety of sources such as the 2009 Medicaid Analytic eXtract (MAX), state-level Medicaid and CHIP data submitted to the CMS, and summaries of published literature on clinical and quality improvement effectiveness related to the CCS topics. Using this information, the group: 1) used a modified Delphi process to score the measures in 2 anonymous scoring rounds (on a scale of 1 to 9 in each round); 2) voted on whether each measure should be retired; and 3) provided narrative explanations of their choices (which formed the basis of our qualitative findings). Recommendations were reviewed by CMS before promulgation to state programs.

RESULTS

The Subcommittee of the National Advisory Council on Healthcare Research and Quality (SNAC) recommended that the 4 major criteria be importance, scientific acceptability, feasibility, and usability. The SNAC recommended 3 measures for retirement: access to primary care; testing for strep before recommending antibiotics for pharyngitis; and annual HbA1c testing of children with diabetes. Explanations for suggesting retirement of the measures included: views that the well-visit measures were a better measure of access than the primary care measure; a likely ceiling effect (pharyngitis); and the paucity of clinical evidence and low prevalence (both for HbA1c). CMS recommended that state Medicaid and CHIP programs retire 2 of the recommended measures from the CCS, but retained the access to primary care measure.

CONCLUSIONS

Periodic reassessment of the value of health care quality measures can reduce reporting burden and allow measure users to focus on measures with higher likelihood of leading to improvements in quality of care and child health outcomes.