The Prevention Index: using technology to improve quality assessment

Timely Prenatal and Infant Pertussis Vaccine Uptake in an Integrated Health System

BACKGROUND

Hispanic infants bear the burden of pertussis infection. We examined pertussis protection from vaccination in infants with US-born and foreign-born Hispanic mothers.

METHODS

Retrospective cohort study of infants up to 1 year of age. Secondary data of mothers with continuous membership since the 27th week of pregnancy with infants born 1/1/2012-12/31/2017 in an integrated health care delivery organization, which broadly represent the Southern California population.

RESULTS

Foreign-born Hispanic mothers had higher prenatal tetanus, diphtheria, acellular pertussis (Tdap) uptake compared to US-born white mothers [adjusted risk ratio (aRR): 1.04, 95% confidence interval (CI): 1.03, 1.05]. Infants with mothers on Medicaid insurance disproportionately did not enroll in the health plan by the time they were eligible for their first dose of the DTaP vaccine (68.4%). Once initiating the infant vaccine series, foreign-born Hispanic mothers more likely adhered than US-born white mothers (aRR: 1.05, CI: 1.02, 1.08).

DISCUSSION

In an integrated health system, disparities in vaccine uptake can be minimized. Infants who are born to mothers with Medicaid insurance and are not enrolled in the health plan after birth may be under-protected from pertussis.

Sexually Transmitted Infection Screening in Key Populations of Persons Living with HIV

Annual screening for bacterial sexually transmitted infections (STI), including gonorrhea/chlamydia (GC/CT) and syphilis, is recommended for persons with HIV (PWH). We used the prevention index to quantify the extent to which STI screening was completed at guideline-recommended frequency in African American and Latinx persons, women, persons with alcohol (AUD) and substance (SUD) use disorders. Data from PWH at Kaiser Permanente Northern California were collected from electronic health records. We defined receipt of GC/CT and syphilis screening consistent with recommendations as a prevention index score ≥ 75%. Among 9655 PWH (17.7% Latinx; 16.2% African American; 9.6% female; 12.4% AUD; 22.1% SUD), prevention index scores for GC/CT and syphilis increased from 2015 to 2019. African American PWH had lower odds of receiving an annual syphilis screen (aOR 0.87 [95% CI 0.79-0.97]). Female sex was associated with lower odds of GC/CT (aOR 0.30 [95% CI 0.27-0.34]) and syphilis (aOR 0.27 [95% CI 0.24-0.310) screening. AUD and SUD were not associated with differences in annual GC/CT or syphilis screening. Key PWH subgroups experience ongoing challenges to annual STI screening despite comparable healthcare access.

Patient-level factors associated with receipt of preventive care in the safety net

Prevention is critical to optimizing health, yet most people do not receive all recommended preventive services. As the complexity of preventive recommendations increases, there is a need for new measurements to capture the degree to which a person is up to date, and identify individual-level barriers and facilitators to receiving needed preventive care. We used electronic health record data from a national network of community health centers (CHCs) in the United States (US) during 2014-2017 to measure patient-level up-to-date status with preventive ratios (measuring up-to-date person-time denoted as a percent) for 12 preventive services and an aggregate preventive index. We use negative binomial regression to identify factors associated with up-to-date preventive care. We assessed 267,767 patients across 165 primary care clinics. Mean preventive ratios ranged from 8.7% for Hepatitis C screening to 83.3% for blood pressure screening. The mean aggregate preventive index was 43%. Lack of health insurance, smoking, and homelessness were associated with lower preventive ratios for most cancer and cardiovascular screenings (p < 0.05). Having more ambulatory visits, better continuity of care, and enrollment in the patient portal were positively associated with the aggregate preventive index (p < 0.05) and higher preventive ratios for all services (p < 0.05) except chlamydia and HIV screening. Overall, receipt of preventive services was low. CHC patients experience many barriers to receiving needed preventive care, but certain healthcare behaviors - regular visits, usual provider continuity, and patient portal enrollment - were consistently associated with more up-to-date preventive care. These associations should inform future efforts to improve preventive care delivery.

Effectiveness of an insurance enrollment support tool on insurance rates and cancer prevention in community health centers: a quasi-experimental study

Background

Following the ACA, millions of people gained Medicaid insurance. Most electronic health record (EHR) tools to date provide clinical-decision support and tracking of clinical biomarkers, we developed an EHR tool to support community health center (CHC) staff in assisting patients with health insurance enrollment documents and tracking insurance application steps. The objective of this study was to test the effectiveness of the health insurance support tool in (1) assisting uninsured patients gaining insurance coverage, (2) ensuring insurance continuity for patients with Medicaid insurance (preventing coverage gaps between visits); and (3) improving receipt of cancer preventive care.

Methods

In this quasi-experimental study, twenty-three clinics received the intervention (EHR-based insurance support tool) and were matched to 23 comparison clinics. CHCs were recruited from the OCHIN network. EHR data were linked to Medicaid enrollment data. The primary outcomes were rates of uninsured and Medicaid visits. The secondary outcomes were receipt of recommended breast, cervical, and colorectal cancer screenings. A comparative interrupted time-series using Poisson generalized estimated equation (GEE) modeling was performed to evaluate the effectiveness of the EHR-based tool on the primary and secondary outcomes.

Results

Immediately following implementation of the enrollment tool, the uninsured visit rate decreased by 21.0% (Adjusted Rate Ratio [RR] = 0.790, 95% CI = 0.621–1.005, p = .055) while Medicaid-insured visits increased by 4.5% (ARR = 1.045, 95% CI = 1.013–1.079) in the intervention group relative to comparison group. Cervical cancer preventive ratio increased 5.0% (ARR = 1.050, 95% CI = 1.009–1.093) immediately following implementation of the enrollment tool in the intervention group relative to comparison group. Among patients with a tool use, 81% were enrolled in Medicaid 12 months after tool use. For the 19% who were never enrolled in Medicaid following tool use, most were uninsured (44%) at the time of tool use.

Conclusions

A health insurance support tool embedded within the EHR can effectively support clinic staff in assisting patients in maintaining their Medicaid coverage. Such tools may also have an indirect impact on evidence-based practice interventions, such as cancer screening.

Trial registration

This study was retrospectively registered on February 4th, 2015 with Clinicaltrials.gov (#NCT02355262). The registry record can be found at https://www.clinicaltrials.gov/ct2/show/NCT02355262.

Preventive health service use among survivors of adolescent and young adult cancer

Preventive health screenings are essential for survivors of adolescent and young adult (AYA) cancer survivors, who are at greater risk for non-cancer related death compared to individuals without a history of cancer. However, little research exists examining their use of screening services. In order to identify potential areas for targeted improvements in AYA survivorship care, we examined adherence to United States Preventive Services Task Force (USPSTF) screening recommendations among members of Kaiser Permanente Southern California. The study population included individuals diagnosed with cancer between ages 15-39 from 2000 to 2012 who survived at least two years post-diagnosis (n = 6779) and a matched cohort of non-cancer comparisons (n = 25640). To assess adherence to screening services, we calculated a Prevention Index (PI, proportion of person-time covered by receipt of recommended clinical preventive services relative to the time eligible) for every individual and the distributions for each service. We also evaluated predictors for adherence using logistic regression. Adherence was significantly (p-value < 0.05) higher among survivors than non-cancer subjects for screenings for dyslipidemia (71.16% and 65.94, respectively), hypertension (97.43% and 89.11%), cervical cancer (87.36% and 84.45%), colorectal cancer (83.23% and 58.27%), and influenza vaccination (36.79% and 33.21%). The logistic regression showed that survivors were significantly more likely to adhere to guidelines compared to non-cancer peers for all screenings except breast cancer, with the greatest difference found for colorectal cancer (odds ratio: 5.04, p-value: <0.01). While AYA survivors appear to use preventive screenings more than comparisons, there is room for improvement for certain services, most notably for influenza vaccination.

Adherence to cardiomyopathy screening guidelines among adolescent and young adult cancer survivors exposed to chest radiation and/or anthracyclines

PURPOSE

Cancer survivors are at risk for late effects from therapeutic exposures, including cardiovascular complications. To improve outcomes among adolescents and young adults (AYA) with cancer, the National Comprehensive Cancer Network (NCCN) released guidelines for screening services (based on the Children's Oncology Group Long-Term Follow-Up [LTFU] guidelines) for survivors of AYA cancer. To better understand survivorship care gaps, we conducted a baseline evaluation of cardiomyopathy screening among survivors of AYA cancers.

METHODS

Members of Kaiser Permanente Southern California diagnosed with cancer between ages 15 and 39 from 2000 to 2010 with at least 5-year survival after diagnosis who were exposed to chest radiation and/or anthracyclines were included. We calculated the Prevention Index ([PI], proportion of person-time covered by receipt of preventive services relative to the total person-time eligible) to evaluate adherence to recommended cardiomyopathy screenings based on the LTFU through 2016. Predictors for screening were evaluated in multivariable logistic regression.

RESULTS

Among 479 survivors recommended for cardiomyopathy screening, 28 received at least one screening, and the mean PI was 2.38% (SD = 13.05%, median = 0.00%). Compared to stage I, survivors of stage II (odds ratio [OR] = 5.56 [1.05-29.46]) and stage III/IV cancer (OR = 6.08 [1.10-33.54]) were more likely to receive cardiomyopathy screening.

CONCLUSIONS

Cardiomyopathy screening among survivors was low around the time when NCCN AYA oncology guidelines were released.

IMPLICATIONS FOR CANCER SURVIVORS

Our study highlights significant room for improvement for adherence to cardiomyopathy screening recommendations among survivors of AYA cancer. Attention is needed to ensure that recommended cardiomyopathy screenings are met for better management of cardiomyopathy late effects.

Uptake of Preventive Services Among Patients With and Without Multimorbidity

INTRODUCTION

Patients with multiple chronic conditions (multimorbidity) are seen commonly in primary care practices and often have suboptimal uptake of preventive care owing to competing treatment demands. The complexity of multimorbidity patterns and their impact on receiving preventive services is not fully understood. This study identifies multimorbidity combinations associated with low receipt of preventive services.

METHODS

This was a retrospective cohort study of U.S. community health center patients aged ≥19 years. Electronic health record data from 209 community health centers for the January 1, 2014-December 31, 2017 study period were analyzed in 2018-2019. Multimorbidity patterns included physical only, mental health only, and physical and mental health multimorbidity patterns, with no multimorbidity as a reference category. Electronic health record-based preventive ratios (number of months services were up-to-date/total months the patient was eligible for services) were calculated for the 14 preventive services. Negative binomial regression models assessed the relationship between multimorbidity physical and/or mental health patterns and the preventive ratio for each service.

RESULTS

There was a variation in receipt of preventive care between multimorbidity groups: individuals with mental health only multimorbidity were less likely to be up-to-date with cardiometabolic and cancer screenings than the no multimorbidity group or groups with physical health conditions, and the physical only multimorbidity group had low rates of depression screening.

CONCLUSIONS

This study provided critical insights into receipt of preventive service among adults with multimorbidity using a more precise method for measuring up-to-date preventive care delivery. Findings would be useful to identify target populations for future intervention programs to improve preventive care.

Methodologic Considerations in Calculating and Analyzing Proportion of Time Covered as a Measure of Longitudinal Cancer Screening Adherence

BACKGROUND

Proportion of time covered (PTC, or "covered time") is a longitudinal measure of adherence to preventive health services, the use of which has increased in recent years. This measure is helpful for evaluating the success of delivering screening interventions over time. However, there are challenges and nuances in computing and interpreting PTC.

METHODS

In this manuscript, we describe some desired properties of PTC measures, challenges in achieving those, and potential solutions using hypothetical examples.

RESULTS

We propose a modified PTC measure (mPTC) to complement the standard, existing PTC measure. The mPTC measure focuses on screening completion rather than initiation when a screening modality requires more than one step; is affected less by loss to follow-up, death, or cancer during covered time than the standard PTC measure; and is not sensitive to screening episode results. We propose weighting strategies to ensure that the average PTC and mPTC are more heavily influenced by individuals who were observed for longer and are thus more informative. We further describe how PTC and mPTC measures can incorporate test indication to focus specifically on screening.

CONCLUSIONS

We recommend that studies of covered time present ample descriptive information, calculate both PTC and mPTC, describe how symptoms and indication are handled, and present multiple complementary measures, such as the proportion never screened and the proportion in need of screening.

IMPACT

Common approaches, terminology, and reporting practices for covered time measures have the potential to improve the study of longitudinal cancer screening adherence.

Use of a Preventive Index to Examine Clinic-Level Factors Associated With Delivery of Preventive Care

INTRODUCTION

There is an increasing need for the development of new methods to understand factors affecting delivery of preventive care. This study applies a new measurement approach and assesses clinic-level factors associated with preventive care delivery.

METHODS

This retrospective longitudinal cohort study of 94 community health centers used electronic health record data from the OCHIN community health information network, 2014-2015. Clinic-level preventive ratios (time covered by a preventive service/time eligible for a preventive service) were calculated in 2017 for 12 preventive services with A or B recommendations from the U.S. Preventive Services Task Force along with an aggregate preventive index for all services combined. For each service, multivariable negative binomial regression modeling and calculated rate ratios assessed the association between clinic-level variables and delivery of care.

RESULTS

Of ambulatory community health center visits, 59.8% were Medicaid-insured and 10.4% were uninsured. Ambulatory community health centers served 16.9% patients who were Hispanic, 13.1% who were nonwhite, and 68.7% who had household incomes <138% of the federal poverty line. Clinic-level preventive ratios ranged from 3% (hepatitis C screening) to 93% (blood pressure screening). The aggregate preventive index including all screening measures was 47% (IQR, 42%-50%). At the clinic level, having a higher percentage of uninsured visits was associated with lower preventive ratios for most (7 of 12) preventive services.

CONCLUSIONS

Approaches that use individual preventive ratios and aggregate prevention indices are promising for understanding and improving preventive service delivery over time. Health insurance remains strongly associated with access to needed preventive care, even for safety net clinic populations.

Human papillomavirus vaccination and subsequent cervical cancer screening in a large integrated healthcare system

BACKGROUND

Human papillomavirus vaccination may result in lowered intention to be screened for cervical cancer, potentially leading to gaps in screening coverage and avoidable cervical cancer diagnoses.

OBJECTIVE

The purpose of this study was to examine the association between human papillomavirus vaccination and subsequent cervical cancer screening initiation and adherence to recommended screening intervals to detect gaps in screening coverage and inform future prevention efforts.

STUDY DESIGN

A retrospective cohort study was conducted in 2 distinct cohorts of female members of Kaiser Permanente Southern California, which is a large integrated healthcare delivery system. Papanicolaou screening initiation was evaluated in women who reached 21 years from 2010-2013. Adherence to recommended screening intervals was evaluated in women who were 25-30 years old in 2010. All women were observed to the end of 2013 for the evaluation of their screening behaviors. History of human papillomavirus vaccination and Papanicolaou screening were obtained from electronic medical records. Adherence to recommended screening intervals was measured as ≥85% vs <85% of the observed "screening up-to-date" person-time. Multivariable Cox and logistic regression models were used to examine associations between vaccination history and screening initiation and interval adherence. Demographic characteristics, gynecologic health history, healthcare use, and characteristics of women's primary care providers were included as potential confounders in the analyses.

RESULTS

There were 27,352 and 41,328 women included in the screening initiation and screening interval adherence analyses, respectively. In comparison with unvaccinated women, adjusted hazard ratios (95% confidence intervals [CIs]) for screening initiation among women who had been vaccinated against human papillomavirus were 1.19 (95% CI, 1.11-1.28), 1.44 (95% CI, 1.34-1.53), and 1.57 (95% CI, 1.50-1.65) for 1, 2, and ≥3 doses, respectively. Adjusted odds ratios for screening interval adherence were 0.93 (95% CI, 0.83-1.04), 1.73 (95% CI, 1.52-1.97), and 2.29 (95% CI, 2.05-2.56), for 1, 2, and ≥3 doses, respectively.

CONCLUSION

Women who had been vaccinated against human papillomavirus in this community-based, integrated healthcare setting were more likely to be screened for cervical cancer than were unvaccinated women. Our findings underscore the need for targeted interventions among unvaccinated women who may be disproportionally affected by cervical cancer, despite the presence of population-based screening programs.

OBAYA (obesity and adverse health outcomes in young adults): feasibility of a population-based multiethnic cohort study using electronic medical records

Background

Although obesity is a risk factor for many chronic diseases, we have only limited knowledge of the magnitude of these associations in young adults. A multiethnic cohort of young adults was established to close current knowledge gaps; cohort demographics, cohort retention, and the potential influence of migration bias were investigated.

Methods

For this population-based cross-sectional study, demographics, and measured weight and height were extracted from electronic medical records of 1,929,470 patients aged 20 to 39 years enrolled in two integrated health plans in California from 2007 to 2009.

Results

The cohort included about 84.4% of Kaiser Permanente California members in this age group who had a medical encounter during the study period and represented about 18.2% of the underlying population in the same age group in California. The age distribution of the cohort was relatively comparable to the underlying population in California Census 2010 population, but the proportion of women and ethnic/racial minorities was slightly higher. The three-year retention rate was 68.4%.

Conclusion

These data suggest the feasibility of our study for medium-term follow-up based on sufficient membership retention rates. While nationwide 6% of young adults are extremely obese, we know little to adequately quantify the health burden attributable to obesity, especially extreme obesity, in this age group. This cohort of young adults provides a unique opportunity to investigate associations of obesity-related factors and risk of cancer in a large multiethnic population.

Developing a natural language processing application for measuring the quality of colonoscopy procedures

OBJECTIVE

The quality of colonoscopy procedures for colorectal cancer screening is often inadequate and varies widely among physicians. Routine measurement of quality is limited by the costs of manual review of free-text patient charts. Our goal was to develop a natural language processing (NLP) application to measure colonoscopy quality.

MATERIALS AND METHODS

Using a set of quality measures published by physician specialty societies, we implemented an NLP engine that extracts 21 variables for 19 quality measures from free-text colonoscopy and pathology reports. We evaluated the performance of the NLP engine on a test set of 453 colonoscopy reports and 226 pathology reports, considering accuracy in extracting the values of the target variables from text, and the reliability of the outcomes of the quality measures as computed from the NLP-extracted information.

RESULTS

The average accuracy of the NLP engine over all variables was 0.89 (range: 0.62-1.0) and the average F measure over all variables was 0.74 (range: 0.49-0.89). The average agreement score, measured as Cohen's κ, between the manually established and NLP-derived outcomes of the quality measures was 0.62 (range: 0.09-0.86).

DISCUSSION

For nine of the 19 colonoscopy quality measures, the agreement score was 0.70 or above, which we consider a sufficient score for the NLP-derived outcomes of these measures to be practically useful for quality measurement.

CONCLUSION

The use of NLP for information extraction from free-text colonoscopy and pathology reports creates opportunities for large scale, routine quality measurement, which can support quality improvement in colonoscopy care.

Acupuncture and chiropractic care for chronic pain in an integrated health plan: a mixed methods study

BACKGROUND

Substantial recent research examines the efficacy of many types of complementary and alternative (CAM) therapies. However, outcomes associated with the "real-world" use of CAM has been largely overlooked, despite calls for CAM therapies to be studied in the manner in which they are practiced. Americans seek CAM treatments far more often for chronic musculoskeletal pain (CMP) than for any other condition. Among CAM treatments for CMP, acupuncture and chiropractic (A/C) care are among those with the highest acceptance by physician groups and the best evidence to support their use. Further, recent alarming increases in delivery of opioid treatment and surgical interventions for chronic pain--despite their high costs, potential adverse effects, and modest efficacy--suggests the need to evaluate real world outcomes associated with promising non-pharmacological/non-surgical CAM treatments for CMP, which are often well accepted by patients and increasingly used in the community.

METHODS/DESIGN

This multi-phase, mixed methods study will: (1) conduct a retrospective study using information from electronic medical records (EMRs) of a large HMO to identify unique clusters of patients with CMP (e.g., those with differing demographics, histories of pain condition, use of allopathic and CAM health services, and comorbidity profiles) that may be associated with different propensities for A/C utilization and/or differential outcomes associated with such care; (2) use qualitative interviews to explore allopathic providers' recommendations for A/C and patients' decisions to pursue and retain CAM care; and (3) prospectively evaluate health services/costs and broader clinical and functional outcomes associated with the receipt of A/C relative to carefully matched comparison participants receiving traditional CMP services. Sensitivity analyses will compare methods relying solely on EMR-derived data versus analyses supplementing EMR data with conventionally collected patient and clinician data.

DISCUSSION

Successful completion of these aggregate aims will provide an evaluation of outcomes associated with the real-world use of A/C services. The trio of retrospective, qualitative, and prospective study will also provide a clearer understanding of the decision-making processes behind the use of A/C for CMP and a transportable methodology that can be applied to other health care settings, CAM treatments, and clinical populations.

TRIAL REGISTRATION

ClinicalTrials.gov: NCT01345409.

Auditing the management of vaccine-preventable disease outbreaks: the need for a tool

Public health activities, especially infectious disease control, depend on effective teamwork. We present the results of a pilot audit questionnaire aimed at assessing the quality of public health services in the management of VPD outbreaks. Audit questionnaire with three main areas indicators (structure, process and results) was developed. Guidelines were set and each indicator was assessed by three auditors. Differences in indicator scores according to median size of outbreaks were determined by ANOVA (significance at p≤0.05). Of 154 outbreaks; eighteen indicators had a satisfactory mean score, indicator "updated guidelines" and "timely reporting" had a poor mean score (2.84±106 and 2.44±1.67, respectively). Statistically significant differences were found according to outbreak size, in the indicators "availability of guidelines/protocol updated less than 3 years ago" (p = 0.03) and "days needed for outbreak control" (p = 0.04). Improving availability of updated guidelines, enhancing timely reporting and adequate recording of control procedures taken is needed to allow for management assessment and improvement.

Developing a policy-relevant research agenda for the patient-centered medical home: a focus on outcomes

BACKGROUND

The Patient-Centered Medical Home (PCMH) is a widely endorsed model of delivery system reform that emphasizes primary care. Pilot demonstration projects are underway in many states, sponsored by Medicare, Medicaid, major health plans and multi-payer coalitions.

METHODS

In this paper we consider the development of a long-term policy-relevant research agenda on outcomes of the PCMH. We provide an overview of potential measures of PCMH impact, identify measurement challenges and recommend areas for further study. Although the PCMH should not be expected to solve every problem in the health care system, developing a research agenda for measuring outcomes of delivery system innovations such as the PCMH should be considered in the context of the larger effort to improve the US health care system, with the ultimate goal to improve population health.

RESULTS

As a framework for our discussion, we have chosen the Institute of Medicine's six specific aims for 21st century health care: (1) safe, (2) effective, (3) patient-centered, (4) timely, (5) efficient and (6) equitable. In addition, we include potential areas of PCMH outcomes that do not easily fall under this framework and consider unintended consequences.

CONCLUSION

Multi-stakeholder involvement will be essential in developing a long-term policy-relevant research agenda for outcomes of the PCMH.

Electronic medical records and prevention quality: the prevention index

BACKGROUND

The Prevention Index is a methodology for using electronic medical records to identify and evaluate practice variations in the delivery of preventive care.

METHODS

The Prevention Index was used to evaluate the provision of 10 recommended adult preventive services using electronic medical record data for the years 1999 through 2002 among the 450,000 members of a large Northwest integrated care system. The analyses were conducted in 2005. The Prevention Index determines the proportion of person-time that is covered using consensus guidelines as a standard of care. It is analyzed at the population level and produces quality measures at the individual, practice, clinic, and system levels. The Prevention Index also removes diagnostic services in evaluating preventive care.

RESULTS

Overall, about 47% of recommended person-time was actually covered by the services in 2002. For nine services with care guidelines, the percent of covered person-time ranged from 19% for chlamydia screening to 80% for blood pressure screening. The percent of recommended person-time covered by these preventive services varied widely across clinical practices. From 17% to 53% of preventive screening tests were delivered for non-screening purposes.

CONCLUSIONS

There are wide variations across clinical practices in the adherence to standard prevention guidelines, and also wide variations across different recommended clinical services. The Prevention Index methodology may allow the identification of the source of these variations, allowing system corrections and other remedial actions to be applied precisely and efficiently.

Can the quality of care in family practice be measured using administrative data?

OBJECTIVE

To explore the feasibility of using administrative data to develop process indicators for measuring quality in primary care.

DATA SOURCES/STUDY SETTING

The Population Health Research Data Repository (Repository) housed at the Manitoba Centre for Health Policy which includes physician claims, hospital discharge abstracts, pharmaceutical use (Drug Program Information Network (DPIN)), and the Manitoba Immunization Monitoring Program (MIMS) for all residents of Manitoba, Canada who used the health care system during the 2001/02 fiscal year. Family physicians were identified from the Physician Resource Database. Indicators were developed based on a literature review and focus group validation.

DATA COLLECTION/EXTRACTION METHODS

Data files were extracted from administrative data available in the Repository. We extracted data based on the ICD-9-CM codes and ATC-class drugs prescribed and then linked them to the Physician Resource Database. Physician practices were defined by allocating patients to their most responsible physician. Every family physician in Manitoba that met the inclusion criteria (having either 5 or 10 eligible patients depending on the indicator) was 'scored' on each indicator. Physicians were then grouped according to the proportion of the patients allocated to their practice who received the recommended care for the specific indicator.

PRINCIPAL FINDINGS

Using administrative health data we were able to develop and measure eight indicators of quality of care covering both preventive care services and chronic disease management. The number of eligible physicians and patients varied for each indicator as did the percent of patients with recommended care, per physician. For example, the childhood immunization indicator included 544 physicians who, on average, provided immunization for 65 percent of their patients.

CONCLUSIONS

Quality of care provided by family physicians can be measured using administrative data. Despite the limitations addressed in this paper, this work establishes a practical methodology to measure quality of care provided by family physicians that can be used for quality improvement initiatives.

Receipt of preventive services by elders based on composite measures, 1997-2004

BACKGROUND

The receipt of routine vaccinations and cancer screening is typically tracked separately. Monitoring trends in this way does not measure the overall protection conferred by these services on a target population.

DESIGN

Telephone surveys were conducted in 1997, 2002, and 2004 as part of the Behavioral Risk Factor Surveillance System.

SETTING/PARTICIPANTS

Randomly selected adults aged 65 and older from 49 states and Washington DC.

MAIN OUTCOME MEASURES

Statistically significant changes (p <0.05) in a composite measure of the prevalence of U.S. men aged 65 or older who were up to date with recommendations for colorectal cancer screening, influenza vaccination, pneumococcal vaccination; and for the prevalence of U.S. women aged 65 or older who were up to date for these measures as well as for Pap test and screening mammography.

RESULTS

The percentage of men who reported being up to date on all tests increased from 24.4% (1997) to 39.6% (2002) to 41.0% (2004), and the percentage of women increased from 18.6% (1997) to 32.4% (2002) to 32.5% (2004). For both groups, results varied by education, race/ethnicity, marital status, insurance status, and state, as well as whether they had a personal doctor.

CONCLUSIONS

Despite increases between 1997 and 2004 in the reported receipt of individual cancer screenings and vaccinations among U.S. adults aged 65 or older, approximately seven of ten women and six of ten men were not up to date on these routine preventive services in 2004.

A randomized trial of strategies to increase chlamydia screening in young women

OBJECTIVE

Despite the recommendations of numerous clinical practice guidelines, testing of at-risk women for Chlamydia trachomatis infection remains low. We evaluated an intervention to increase guideline-recommended chlamydia screening.

METHOD

In a two-by-two factorial design randomized trial conducted in 2001-2002, 23 primary care clinics at Group Health Cooperative in Washington State were randomized to either control (standard) or intervention (enhanced) guideline implementation arms. Clinic-level intervention strategies included use of clinic-based opinion leaders, individual measurement and feedback, and exam room reminders. A second patient-level intervention, a chart prompt to screen for chlamydia, was delivered in a random sample of 3509 women. The outcome measure was post-intervention chlamydia testing rates among sexually active women ages 14-25.

RESULTS

The clinic-level intervention did not significantly affect overall chlamydia testing (odds ratio (OR) = 1.08, 95% confidence interval (CI) 0.92-1.26, P = 0.31). However, testing rates increased significantly among women making preventive care visits (OR, Pap test visit = 1.23, 95% CI, 1.01-1.51, P = 0.04; OR, physical exam visit = 1.22, 95% CI 1.06-1.42, P = 0.009, intervention vs. control clinics). The chart prompt intervention had no significant effect (OR = 1.08, 95% CI 0.94-1.23, P = 0.27).

CONCLUSIONS

Interventions to improve guideline-recommended chlamydia testing increased testing among women making preventive care visits. Additional organizational change and/or patient activation strategies may improve plan-wide testing, particularly among asymptomatic women.

Mammography screening rates decline: a person-time approach to evaluation

OBJECTIVES

Early detection through mammography can reduce breast cancer mortality. This cohort study evaluated trends in mammography screening, demonstrating a person-time approach.

METHODS

Included were women HMO members aged 50-69 from 1999 to 2002 who had not had breast cancer, dysplasia, fibrocystic disease, or implant. The amount of person-time covered by mammography as a percent of the time eligible for mammography screening (the prevention index (PI)) was calculated using electronic data. The denominator was the time during which the guidelines recommended that each participant should have been covered by a mammogram (every 24 months), excluding times when breast mass, abnormal mammogram, galactorrhea, or other breast disorders were under evaluation. The numerator was the time during which she was covered by a mammogram.

RESULTS

The number of women who contributed person-time increased from 43,283 to 49,512 and the number of screening mammograms declined from 23,586 to 22,719. The overall PI for screening mammography declined from 67.0 (67% of eligible person-time was appropriately covered by a mammogram) to 62.5, and the proportion of women with no coverage during a given year increased 16%.

CONCLUSIONS

This study shows a declining pattern of mammography screening using a person-time approach, a decline greater than that shown by methods that include diagnostic mammograms. The study highlights opportunities for use of the PI and quality improvement initiatives to improve breast cancer outcomes.

Priorities among effective clinical preventive services: methods

Decision makers want to know which healthcare services matter the most, but there are no well-established, practical methods for providing evidence-based answers to such questions. Led by the National Commission on Prevention Priorities, the authors update the methods for determining the relative health impact and economic value of clinical preventive services. Using new studies, new preventive service recommendations, and improved methods, the authors present a new ranking of clinical preventive services in the companion article. The original ranking and methods were published in this journal in 2001. The current methods report focuses on evidence collection for a priority setting exercise, guidance for which is effectively lacking in the literature. The authors describe their own standards for searching, tracking, and abstracting literature for priority setting. The authors also summarize their methods for making valid comparisons across different services. This report should be useful to those who want to understand additional detail about how the ranking was developed or who want to adapt the methods for their own purposes.

Are older adults up-to-date with cancer screening and vaccinations?

INTRODUCTION

Public health organizations in the United States emphasize the importance of providing routine screening for breast cancer, cervical cancer, and colorectal cancer, as well as vaccinations against influenza and pneumococcal disease among older adults. We report a composite measure of adults aged 50 years and older who receive recommended cancer screening services and vaccinations.

METHODS

We analyzed state data from the 2002 Behavioral Risk Factor Surveillance System, which included 105,860 respondents aged 50 and older. We created a composite measure that included colonoscopy or sigmoidoscopy within 10 years or a fecal occult blood test in the past year, an influenza vaccination in the past year, a Papanicolaou test within 3 years for women with an intact cervix, a mammogram, and for adults aged 65 and older, a pneumonia vaccination during their lifetime. We performed separate analyses for four age and sex groups: men aged 50 to 64, women aged 50 to 64, men aged 65 and older, and women aged 65 and older.

RESULTS

The percentage of each age and sex group that was up-to-date according to our composite measure ranged from 21.1% of women aged 50 to 64 (four tests) to 39.6% of men aged 65 and older (three tests). For each group, results varied by income, education, race/ethnicity, insurance status, and whether the respondent had a personal physician.

CONCLUSION

These results suggest the need to improve the delivery of cancer screenings and vaccinations among adults aged 50 and older. We propose continued efforts to measure use of clinical preventive services.