Training the next generation of delivery science researchers: 10-year experience of a post-doctoral research fellowship program within an integrated care system

Introduction

Learning health systems require a workforce of researchers trained in the methods of identifying and overcoming barriers to effective, evidence-based care. Most existing postdoctoral training programs, such as NIH-funded postdoctoral T32 awards, support basic and epidemiological science with very limited focus on rigorous delivery science methods for improving care. In this report, we present the 10-year experience of developing and implementing a Delivery Science postdoctoral fellowship embedded within an integrated health care delivery system.

Methods

In 2012, the Kaiser Permanente Northern California Division of Research designed and implemented a 2-year postdoctoral Delivery Science Fellowship research training program to foster research expertise in identifying and addressing barriers to evidence-based care within health care delivery systems.

Results

Since 2014, 20 fellows have completed the program. Ten fellows had PhD-level scientific training, and 10 fellows had clinical doctorates (eg, MD, RN/PhD, PharmD). Fellowship alumni have graduated to faculty research positions at academic institutions (9), and research or clinical organizations (4). Seven alumni now hold positions in Kaiser Permanente's clinical operations or medical group (7).

Conclusions

This delivery science fellowship program has succeeded in training graduates to address delivery science problems from both research and operational perspectives. In the next 10 years, additional goals of the program will be to expand its reach (eg, by developing joint research training models in collaboration with clinical fellowships) and strengthen mechanisms to support transition from fellowship to the workforce, especially for researchers from underrepresented groups.

Changes in COVID-19 Vaccine Intent Among a Diverse Population of Older Adults, June 2021-February 2022

Introduction COVID-19 vaccination rates remain suboptimal in the United States. Clinicians and policymakers need to better understand how likely vaccine-hesitant individuals are to ultimately accept vaccination and what is associated with such changes. This study's aims were to 1) describe changes between vaccine intentions and actual uptake from June 2021 through February 2022, and 2) identify modifiable factors associated with vaccine uptake among those with initial hesitancy. Methods This cohort study included a stratified random sample of adults aged 65 years and older in an integrated health care system. The survey, conducted June through August 2021, elicited intent and perceptions regarding COVID-19 vaccination. Subsequent vaccine uptake through February 2022 was analyzed using electronic health records. Results Of 1195 individuals surveyed, 66% responded; 213 reported not yet having received a COVID-19 vaccine and were further analyzed. At baseline, most individuals said they would definitely not (42%) or probably not (5%) get the COVID-19 vaccine or were not sure (26%). During follow-up, 61 individuals (29%) were vaccinated, including 19% of those who initially said they would definitely not be vaccinated. Among vaccine-hesitant individuals, the rate of vaccination was highest for those who initially considered COVID-19 less dangerous than the vaccine (46%) or named short-term side effects (36%) as their most important concern. Conclusions COVID-19 vaccine intent among older adults was malleable during the pandemic's second year, even among those who initially said they would definitely not be vaccinated. Vaccine uptake could be enhanced by increasing awareness of COVID-19 risks and by addressing vaccine side effects.

Strategies Facilitating Video Visit Implementation by a Medical Group Serving a Diverse Population

IntroductionVideo visits have created new opportunities to enhance access to care, but limited information exists on strategies medical groups can employ to facilitate video visit use by higher-risk patients. Our objective was to identify generalizable strategies to facilitate successful delivery of video visits by systems serving highly diverse patient populations. MethodsThe authors conducted a qualitative study of physicians and staff members in a large group practice with 4.5 million patients with diverse race and ethnicity and socioeconomic status. Semi-structured interviews were conducted between January 2021 and April 2021, with key informants identified via purposive and snowball sampling. Video-recorded interviews were transcribed and analyzed using thematic analysis to identify major themes and subthemes. ResultsThe 42 key informants included regional and medical center leaders, primary care physicians, service managers, and medical assistants. Participants described clinical leadership in technology and multidisciplinary collaboration as crucial to sustained video care adoption. Strategies to facilitate real-time learning included local innovation, rapid communication channels, and psychological safety. The organization offered broad access to frequently updated data reports to help managers and practitioners understand processes, measure performance, and share best practices. Medical assistants and physicians developed new approaches to empathize, tailor interactions with patients, and overcome psychological and technical barriers to connecting via video. ConclusionsKey strategies for sustained video care adoption included clinical leadership articulating its purpose, multidisciplinary collaboration, local innovation, effective data use, empathy, and personalized care. These findings provide a model for how health care systems can foster robust adoption of technologies to serve diverse populations.

Effect of Electronic and Mail Outreach From Primary Care Physicians for COVID-19 Vaccination of Black and Latino Older Adults: A Randomized Clinical Trial

IMPORTANCE

COVID-19 morbidity is highest in Black and Latino older adults. These racial and ethnic groups initially had lower vaccination uptake than others, and rates in Black adults continue to lag.

OBJECTIVES

To evaluate the effect of outreach via electronic secure messages and mailings from primary care physicians (PCPs) on COVID-19 vaccination uptake among Black and Latino older adults and to compare the effects of culturally tailored and standard PCP messages.

DESIGN, SETTING, AND PARTICIPANTS

This randomized clinical trial was conducted from March 29 to May 20, 2021, with follow-up surveys through July 31, 2021. Latino and Black individuals aged 65 years and older from 4 Kaiser Permanente Northern California (KPNC) service areas were included. Data were analyzed from May 27, 2021, to September 28, 2021.

INTERVENTIONS

Individuals who had not received COVID-19 vaccination after previous outreach were randomized to electronic secure message and/or mail outreach from their PCP, similar outreach with additional culturally tailored content, or usual care. Outreach groups were sent a secure message or letter in their PCP's name, followed by a postcard to those still unvaccinated after 4 weeks.

MAIN OUTCOMES AND MEASURES

The primary outcome was time to receipt of COVID-19 vaccination during the 8 weeks after initial study outreach. KPNC data were supplemented with state data from external sources. Intervention effects were evaluated via proportional hazards regression.

RESULTS

Of 8287 included individuals (mean [SD] age, 72.6 [7.0] years; 4665 [56.3%] women), 2434 (29.4%) were Black, 3782 (45.6%) were Latino and preferred English-language communications, and 2071 (25.0%) were Latino and preferred Spanish-language communications; 2847 participants (34.4%) had a neighborhood deprivation index at the 75th percentile or higher. A total of 2767 participants were randomized to culturally tailored PCP outreach, 2747 participants were randomized to standard PCP outreach, and 2773 participants were randomized to usual care. Culturally tailored PCP outreach led to higher COVID-19 vaccination rates during follow-up compared with usual care (664 participants [24.0%] vs 603 participants [21.7%]; adjusted hazard ratio (aHR), 1.22; 95% CI, 1.09-1.37), as did standard PCP outreach (635 participants [23.1%]; aHR, 1.17; 95% CI, 1.04-1.31). Individuals who were Black (aHR, 1.19; 95% CI, 1.06-1.33), had high neighborhood deprivation (aHR, 1.17; 95% CI, 1.03-1.33), and had medium to high comorbidity scores (aHR, 1.19; 95% CI, 1.09-1.31) were more likely to be vaccinated during follow-up.

CONCLUSIONS AND RELEVANCE

This randomized clinical trial found that PCP outreach using electronic and mailed messages increased COVID-19 vaccination rates among Black and Latino older adults.

TRIAL REGISTRATION

ClinicalTrials.gov Identifier: NCT05096026.

Physicians' electronic inbox work patterns and factors associated with high inbox work duration

OBJECTIVES

Electronic health record systems are increasingly used to send messages to physicians, but research on physicians' inbox use patterns is limited. This study's aims were to (1) quantify the time primary care physicians (PCPs) spend managing inboxes; (2) describe daily patterns of inbox use; (3) investigate which types of messages consume the most time; and (4) identify factors associated with inbox work duration.

MATERIALS AND METHODS

We analyzed 1 month of electronic inbox data for 1275 PCPs in a large medical group and linked these data with physicians' demographic data.

RESULTS

PCPs spent an average of 52 minutes on inbox management on workdays, including 19 minutes (37%) outside work hours. Temporal patterns of electronic inbox use differed from other EHR functions such as charting. Patient-initiated messages (28%) and results (29%) accounted for the most inbox work time. PCPs with higher inbox work duration were more likely to be female (P < .001), have more patient encounters (P < .001), have older patients (P < .001), spend proportionally more time on patient messages (P < .001), and spend more time per message (P < .001). Compared with PCPs with the lowest duration of time on inbox work, PCPs with the highest duration had more message views per workday (200 vs 109; P < .001) and spent more time on the inbox outside work hours (30 minutes vs 9.7 minutes; P < .001).

CONCLUSIONS

Electronic inbox work by PCPs requires roughly an hour per workday, much of which occurs outside scheduled work hours. Interventions to assist PCPs in handling patient-initiated messages and results may help alleviate inbox workload.

Feasibility of Measuring Preferences for Chemotherapy Among Early-Stage Breast Cancer Survivors Using a Direct Rank Ordering Multicriteria Decision Analysis Versus a Time Trade-Off

OBJECTIVES

Chemotherapy is increasingly a preference-based choice among women diagnosed with early-stage breast cancer. Multicriteria decision analysis (MCDA) is a promising but underutilized method to facilitate shared decision making. We explored the feasibility of conducting an MCDA using direct rank ordering versus a time trade-off (TTO) to assess chemotherapy choice in a large population-based sample.

METHODS

We surveyed 904 early-stage breast cancer survivors who were within 5 years of diagnosis and reported to the Western Washington State Cancer System and Kaiser Permanente Northern California registries. Direct rank ordering of 11 criteria and TTO surveys were conducted from September 2015 to July 2016; clinical data were obtained from registries or medical records. Multivariable regressions estimated post hoc associations between the MCDA, TTO, and self-reported chemotherapy receipt, considering covariates.

RESULTS

Survivors ranged in age from 25 to 74 years and 73.9% had stage I tumors. The response rate for the rank ordering was 81.0%; TTO score was 94.2%. A one-standard deviation increase in the difference between the chemotherapy and no chemotherapy MCDA scores was associated with a 75.1% (95% confidence interval 43.9-109.7%; p < 0.001) increase in the adjusted odds of having received chemotherapy; no association was found between the TTO score and chemotherapy receipt.

CONCLUSIONS

A rank-order-based MCDA was feasible and was associated with chemotherapy choice. Future research should consider developing and testing this MCDA for use in clinical encounters. Additional research is required to develop a TTO-based model and test its properties against a pragmatic MCDA to inform future shared decision-making tools.

A prognostic information system for real-time personalized care: Lessons for embedded researchers

Embedded researchers could play a central role in developing tools to personalize care using electronic medical records (EMRs). However, few studies have described the steps involved in developing such tools, or evaluated the key factors in success and failure. This case study describes how we used an EMR-derived data warehouse to develop a prototype informatics tool to help oncologists counsel patients with pancreatic cancer about their prognosis. The tool generated real-time prognostic information based on tumor type and stage, age, comorbidity status and lab tests. Our multidisciplinary team included embedded researchers, application developers, user experience experts, and an oncologist leader.This prototype succeeded in establishing proof of principle, but did not reach adoption into actual practice. In pilot testing, oncologists succeeded in generating prognostic information in real time. A few found it helpful in patient encounters, but all identified critical areas for further development before implementation. Generalizable lessons included the need to (1) include a wide range of potential use cases and stakeholders when selecting use cases for such tools; (2) develop talking points for clinicians to explain results from predictive tools to patients; (3) develop ways to reduce lag time between events and data availability; and (4) keep the options presented in the user interface very simple. This case demonstrates that embedded researchers can lead collaborations using EMR-derived data to create systems for real-time personalized patient counseling, and highlights challenges that such teams can anticipate.

Physician Stress During Electronic Health Record Inbox Work: In Situ Measurement With Wearable Sensors

Background

Increased work through electronic health record (EHR) messaging is frequently cited as a factor of physician burnout. However, studies to date have relied on anecdotal or self-reported measures, which limit the ability to match EHR use patterns with continuous stress patterns throughout the day.

Objective

The aim of this study is to collect EHR use and physiologic stress data through unobtrusive means that provide objective and continuous measures, cluster distinct patterns of EHR inbox work, identify physicians’ daily physiologic stress patterns, and evaluate the association between EHR inbox work patterns and physician physiologic stress.

Methods

Physicians were recruited from 5 medical centers. Participants (N=47) were given wrist-worn devices (Garmin Vivosmart 3) with heart rate sensors to wear for 7 days. The devices measured physiological stress throughout the day based on heart rate variability (HRV). Perceived stress was also measured with self-reports through experience sampling and a one-time survey. From the EHR system logs, the time attributed to different activities was quantified. By using a clustering algorithm, distinct inbox work patterns were identified and their associated stress measures were compared. The effects of EHR use on physician stress were examined using a generalized linear mixed effects model.

Results

Physicians spent an average of 1.08 hours doing EHR inbox work out of an average total EHR time of 3.5 hours. Patient messages accounted for most of the inbox work time (mean 37%, SD 11%). A total of 3 patterns of inbox work emerged: inbox work mostly outside work hours, inbox work mostly during work hours, and inbox work extending after hours that were mostly contiguous to work hours. Across these 3 groups, physiologic stress patterns showed 3 periods in which stress increased: in the first hour of work, early in the afternoon, and in the evening. Physicians in group 1 had the longest average stress duration during work hours (80 out of 243 min of valid HRV data; P=.02), as measured by physiological sensors. Inbox work duration, the rate of EHR window switching (moving from one screen to another), the proportion of inbox work done outside of work hours, inbox work batching, and the day of the week were each independently associated with daily stress duration (marginal R²=15%). Individual-level random effects were significant and explained most of the variation in stress (conditional R²=98%).

Conclusions

This study is among the first to demonstrate associations between electronic inbox work and physiological stress. We identified 3 potentially modifiable factors associated with stress: EHR window switching, inbox work duration, and inbox work outside work hours. Organizations seeking to reduce physician stress may consider system-based changes to reduce EHR window switching or inbox work duration or the incorporation of inbox management time into work hours.

Evaluation of Attention Switching and Duration of Electronic Inbox Work Among Primary Care Physicians

IMPORTANCE

Primary care physicians (PCPs) report multitasking during workdays while processing electronic inbox messages, but scant systematic information exists on attention switching and its correlates in the health care setting.

OBJECTIVES

To describe PCPs' frequency of attention switching associated with electronic inbox work, identify potentially modifiable factors associated with attention switching and inbox work duration, and compare the relative association of attention switching and other factors with inbox work duration.

DESIGN, SETTING, AND PARTICIPANTS

This cross-sectional study of the work of 1275 PCPs in an integrated group serving 4.5 million patients used electronic health record (EHR) access logs from March 1 to 31, 2018, to evaluate PCPs' frequency of attention switching. Statistical analysis was performed from October 15, 2018, to August 28, 2020.

MAIN OUTCOMES AND MEASURES

Attention switching was defined as switching between the electronic inbox, other EHR work, and non-EHR periods. Inbox work duration included minutes spent on electronic inbox message views and related EHR tasks. Multivariable models controlled for the exposures.

RESULTS

The 1275 PCPs studied (721 women [56.5%]; mean [SD] age, 45.9 [8.5] years) had a mean (SD) of 9.0 (7.6) years of experience with the medical group and received a mean (SD) of 332.6 (148.3) (interquartile range, 252-418) new inbox messages weekly. On workdays, PCPs made a mean (SD) of 79.4 (21.8) attention switches associated with inbox work and did a mean (SD) 64.2 (18.7) minutes of inbox work over the course of 24 hours on workdays. In the model for attention switching, each additional patient secure message beyond the reference value was associated with 0.289 (95% CI, 0.217-0.362) additional switches, each additional results message was associated with 0.203 (95% CI, 0.127-0.278) additional switches, each additional request message was associated with 0.190 (95% CI, 0.124-0.257) additional switches, and each additional administrative message was associated with 0.262 (95% CI, 0.166-0.358) additional switches. Having a panel (a list of patients assigned to a primary care team) with more elderly patients (0.144 switches per percentage increase [95% CI, 0.009-0.278]) and higher inbox work duration (0.468 switches per additional minute of inbox work [95% CI, 0.411-0.524]) were also associated with higher attention switching involving the inbox. In the model for inbox work duration, each additional patient secure message beyond the reference value was associated with 0.151 (95% CI, 0.085-0.217) additional minutes, each additional results message was associated with 0.338 (95% CI, 0.272-0.404) additional minutes, each additional request message was associated with 0.101 (95% CI, 0.041-0.161) additional minutes, and each additional administrative message was associated with 0.179 (95% CI, 0.093-0.265) additional minutes. A higher percentage of the panel's patients initiating messages (0.386 minutes per percentage increase [95% CI, 0.026-0.745]) and attention switches (0.373 minutes per switch [95% CI, 0.328-0.419]) were also associated with higher inbox work duration. In addition, working at a medical center where all PCPs had high inbox work duration was independently associated with high or low inbox work duration.

CONCLUSIONS AND RELEVANCE

This study suggests that PCPs make frequent attention switches during workdays while processing electronic inbox messages. Message quantity was associated with both attention switching and inbox work duration. Physician and patient panel characteristics had less association with attention switching and inbox work duration. Assisting PCPs with message quantity might help modulate both attention switching and inbox work duration.

Rethinking ethical oversight in the era of the learning health system

Opportunities to advance science increasingly arise through investigations embedded within routine clinical practice in the form of learning health systems. Such activities challenge conventional approaches to research regulation that have not caught up with those opportunities, often imposing burdens generalized from riskier research. We analyze the rules and conventions in the US, demonstrating how even those rules are compatible with a much more flexible approach to participant risk, institutional oversight, participant consent, and disclosure for low-risk learning activities in all jurisdictions.

Primary Care Physicians' Experiences With and Strategies for Managing Electronic Messages

IMPORTANCE

The increasing use of electronic communications has enhanced access to physicians for patients and clinical staff. Primary care physicians (PCPs) have anecdotally identified electronic inbox management as a new source of work-related stress.

OBJECTIVES

To describe PCPs' experiences managing their electronic inboxes and to characterize the array of management strategies developed by individual physicians and practice groups.

DESIGN, SETTING, AND PARTICIPANTS

This qualitative study was conducted in 8 medical centers of a large group practice with more than 4 million patients in diverse settings and a mature electronic health record. The group encourages patients to use portal secure messaging to enhance access to their physicians and the care experience. Semistructured interviews were conducted with 24 internists and family medicine physicians identified via snowball sampling. Interviews were conducted July through November 2018. Data analysis was conducted between November 2018 and April 2019.

MAIN OUTCOMES AND MEASURES

Audio recorded interviews were transcribed and analyzed using thematic analysis to identify major themes and subthemes.

RESULTS

The 24 participants (12 women [50.0%]; mean [SD] age, 45.5 [6.5] years), including 9 department chiefs and 15 PCPs, had a mean (SD) of 16.8 (7.8) years since medical school graduation. Participants described substantial changes in medical practice due to electronic communication, including perceived patient expectations to receive rapid responses to portal secure messages. They described portal secure messaging as useful for building relationships with patients, but also reported that electronic message management has created new stressors, including erosion of work-life boundaries and anxiety associated with unlimited inbox volume. Individual PCPs used a diverse array of strategies, including multitasking during and outside work and delegating to medical assistants. Chiefs described group-level strategies, including reserving clinic time for inbox management, coverage systems for vacation and sick days, physician-to-physician training, and interdisciplinary teams to share messaging work.

CONCLUSIONS AND RELEVANCE

Individual physicians and local practice groups have developed a wide array of strategies for electronic inbox management. The volume of electronic messages and PCPs' perceptions that patients expect rapid responses have created new stressors in primary care practice. Medical groups and health systems can support PCPs by facilitating knowledge transfer among physicians about inbox management strategies and further developing team structures for inbox coverage.

Strategies for Building Delivery Science in an Integrated Health Care System

Health systems today have increasing opportunities and imperatives to conduct delivery science, which is applied research that evaluates clinical or organizational practices that systems can implement or encourage. Examples include research on eliminating racial/ethnic disparities in hypertension management and on identifying the types of patients who can successfully use video visits. Clinical leaders and researchers often face barriers to delivery science, including limited funding, insufficient leadership support, lack of engagement between operational and research leaders, limited pools of research expertise, and lack of pathways to identify and develop ideas. We describe five key strategies we employed to address these barriers and develop a portfolio of delivery science programs in Kaiser Permanente Northern California. This portfolio now includes small and medium-sized grant programs, training programs for postdoctoral research fellows and experienced physician researchers, and a dedicated team that partners with clinicians to develop high-priority ideas and conduct small projects. Most of our approaches are consistent with frameworks used to develop delivery science by other health systems; some are innovative. Most of these strategies are adaptable by other health systems prepared to make long-range organizational commitments to mechanisms that foster partnerships between clinical leaders and researchers.

The impact of gene expression profile testing on confidence in chemotherapy decisions and prognostic expectations

PURPOSE

Little is known about whether gene expression profile (GEP) testing and specific recurrence scores (e.g., medium risk) improve women's confidence in their chemotherapy decision or perceived recurrence risk. We evaluate the relationship between these outcomes and GEP testing.

METHODS

We surveyed women eligible for GEP testing (stage I or II, Gr1-2, ER+, HER2-) identified through the Surveillance, Epidemiology, and End Results (SEER) Registry of Washington or Kaiser Permanente Northern California from 2012 to 2016, approximately 0-4 years from diagnosis (N = 904, RR = 45.4%). Confidence in chemotherapy was measured as confident (Very, completely) versus Not Confident (Somewhat, A little, Not At All); perceived risk recurrence was recorded numerically (0-100%). Women reported their GEP test receipt (Yes, No, Unknown) and risk recurrence score (High, Intermediate, Low, Unknown). In our analytic sample (N = 833), we propensity score weighted the three test receipt cohorts and used propensity weighted multivariable regressions to examine associations between the outcomes and the three test receipt cohorts, with receipt stratified by score.

RESULTS

29.5% reported an unknown GEP test receipt; 86% being confident. Compared to no test receipt, an intermediate score (aOR 0.34; 95% CI 0.20-0.58), unknown score (aOR 0.09; 95% CI 0.05-0.18), and unknown test receipt (aOR 0.37; 95% CI 0.24-0.57) were less likely to report confidence. Most women greatly overestimated their recurrence risk regardless of their test receipt or score.

CONCLUSIONS

GEP testing was not associated with greater confidence in chemotherapy decisions. Better communication about GEP testing and the implications for recurrence risk may improve women's decisional confidence.

Cost Effectiveness of Gene Expression Profile Testing in Community Practice

Purpose Gene expression profile (GEP) testing can support chemotherapy decision making for patients with early-stage, estrogen receptor-positive, human epidermal growth factor 2-negative breast cancers. This study evaluated the cost effectiveness of one GEP test, Onco type DX (Genomic Health, Redwood City, CA), in community practice with test-eligible patients age 40 to 79 years. Methods A simulation model compared 25-year societal incremental costs and quality-adjusted life-years (QALYs) of community Onco type DX use from 2005 to 2012 versus usual care in the pretesting era (2000 to 2004). Inputs included Onco type DX and chemotherapy data from an integrated health care system and national and published data on Onco type DX accuracy, chemotherapy effectiveness, utilities, survival and recurrence, and Medicare and patient costs. Sensitivity analyses varied individual parameters; results were also estimated for ideal conditions (ie, 100% testing and adherence to test-suggested treatment, perfect test accuracy, considering test effects on reassurance or worry, and lowest costs). Results Twenty-four percent of test-eligible patients had Onco type DX testing. Testing was higher in younger patients and patients with stage I disease ( v stage IIA), and 75.3% and 10.2% of patients with high and low recurrence risk scores received chemotherapy, respectively. The cost-effectiveness ratio for testing ( v usual care) was $188,125 per QALY. Considering test effects on worry versus reassurance decreased the cost-effectiveness ratio to $58,431 per QALY. With perfect test accuracy, the cost-effectiveness ratio was $28,947 per QALY, and under ideal conditions, it was $39,496 per QALY. Conclusion GEP testing is likely to have a high cost-effectiveness ratio on the basis of community practice patterns. However, realistic variations in assumptions about key variables could result in GEP testing having cost-effectiveness ratios in the range of other accepted interventions. The differences in cost-effectiveness ratios on the basis of community versus ideal conditions underscore the importance of considering real-world implementation when assessing the new technology.

Racial disparities in family-provider interactions for pediatric asthma care

OBJECTIVE

Black and Latino children experience significantly worse asthma morbidity than their white peers for multifactorial reasons. This study investigated differences in family-provider interactions for pediatric asthma, based on race/ethnicity.

METHODS

This was a cross-sectional study of parent surveys of asthmatic children within the Population-Based Effectiveness in Asthma and Lung Diseases Network. Our study population comprised 647 parents with survey response data. Data on self-reported race/ethnicity of the child were collected from parents of the children with asthma. Outcomes studied were responses to the questions about family-provider interactions in the previous 12 months: (1) number of visits with asthma provider; (2) number of times provider reviewed asthma medications with patient/family; (3) review of a written asthma treatment plan with provider; and (4) preferences about making asthma decisions.

RESULTS

In multivariate adjusted analyses controlling for asthma control and other co-morbidities, black children had fewer visits in the previous 12 months for asthma than white children: OR 0.63 (95% CI 0.40, 0.99). Additionally, black children were less likely to have a written asthma treatment plan given/reviewed by a provider than their white peers, OR 0.44 (95% CI 0.26, 0.75). There were no significant differences by race in preferences about asthma decision-making nor in the frequency of asthma medication review.

CONCLUSION

Black children with asthma have fewer visits with their providers and are less likely to have a written asthma treatment plan than white children. Asthma providers could focus on improving these specific family-provider interactions in minority children.

Parents' Perspectives on How to Improve the Childhood Vaccination Process

Few national studies have asked parents how to improve the childhood vaccination process. We surveyed a nationally representative online panel of parents on how to improve this process, rationales for nonstandard approaches, and alternatives to the standard schedule. Twelve percent of the 1222 respondents reported using nonstandard approaches: 3.2% used a specific schedule, 6.0% had no specific schedule, and 2.5% declined all vaccinations. The most common rationales were that too many vaccines are given at once, and discomfort with vaccine ingredients. Regarding how to improve the process, parents using the standard schedule most often said nothing could be improved (51%), or better vaccine information (22%). Those using nonstandard approaches most often would have liked more choice (40%) or better vaccine information (26%). Parents' experiences with the vaccination process could be improved by offering information prior to visits, giving more information about side effects, and allowing more flexibility about vaccine scheduling.

Oncologist and organizational factors associated with variation in breast cancer multigene testing

PURPOSE

Multigene testing for breast cancer recurrence risk became available in 2007, yet many eligible patients remain untested. This study evaluated variation in testing rates, and oncologist and organizational factors associated with variation, in a setting without financial influences on testing.

METHODS

We conducted a retrospective cohort study using electronic data and oncologist surveys within Kaiser Permanente Northern California, a large integrated health care system. Analyses included all 2974 test eligible patients from 2013 to 2015, 113 oncologists, and 15 practice groups. Receipt of multigene testing was evaluated with generalized linear mixed models.

RESULTS

Overall, 39% of eligible patients had multigene testing, but rates varied widely among practice groups, ranging from 24 to 48% after case mix adjustment. This 24% difference among practices was greater than the variation associated with most patient characteristics, including comorbidities and race/ethnicity, and similar to that associated with tumor size. Practice group and oncologist factors were statistically significant contributors to the variation in testing after adjusting for patient factors. Patients were more likely to be tested if they had a female oncologist (aOR 1.60, 95% CI 1.21-2.12) or were in a practice whose chief had a high testing rate (aOR 1.20, 95% CI 1.12-1.29 per 10% increase in the percent tested).

CONCLUSIONS

Oncologist and leadership practices play a key role in the variation in genomic test use for cancer recurrence risk even in a healthcare system without financial barriers to testing and could be a leverage point for implementing desired practice changes for new genomic advances.

Evaluating Frameworks That Provide Value Measures for Health Care Interventions

The recent acceleration of scientific discovery has led to greater choices in health care. New technologies, diagnostic tests, and pharmaceuticals have widely varying impact on patients and populations in terms of benefits, toxicities, and costs, stimulating a resurgence of interest in the creation of frameworks intended to measure value in health. Many of these are offered by providers and/or advocacy organizations with expertise and interest in specific diseases (e.g., cancer and heart disease). To help assess the utility of and the potential biases embedded in these frameworks, we created an evaluation taxonomy with seven basic components: 1) define the purpose; 2) detail the conceptual approach, including perspectives, methods for obtaining preferences of decision makers (e.g., patients), and ability to incorporate multiple dimensions of value; 3) discuss inclusions and exclusions of elements included in the framework, and whether the framework assumes clinical intervention or offers alternatives such as palliative care or watchful waiting; 4) evaluate data sources and their scientific validity; 5) assess the intervention's effect on total costs of treating a defined population; 6) analyze how uncertainty is incorporated; and 7) illuminate possible conflicts of interest among those creating the framework. We apply the taxonomy to four representative value frameworks recently published by professional organizations focused on treatment of cancer and heart disease and on vaccine use. We conclude that each of these efforts has strengths and weaknesses when evaluated using our taxonomy, and suggest pathways to enhance the utility of value-assessing frameworks for policy and clinical decision making.

Parental weighting of seizure risks vs. fever risks in vaccination tradeoff decisions

As part of a survey of about vaccination beliefs, a nationally representative sample of parents of young children answered a series of tradeoff questions that asked them to choose between two vaccination approaches that differed in terms of risks of vaccine complications, number of injections, and/or vaccine effectiveness. Most parents were willing to have their children endure more injections, and many were willing to forgo disease protection, in order to reduce the rare chance of febrile seizures. Yet, most parents were unwilling to trade disease protection to reduce the risk of fever alone, even though this is correlated with the risk of febrile seizures. Vaccine risk communications need to address the heightened emotional weight that parents give to febrile seizure risk, even when the rarity of such events is explicit.

Impact of Copayment Changes on Children's Albuterol Inhaler Use and Costs after the Clean Air Act Chlorofluorocarbon Ban

OBJECTIVE

To examine changes in children's albuterol use and out-of-pocket (OOP) costs in response to increased copayments after the Food and Drug Administration banned inhalers with chlorofluorocarbon (CFC) propellants.

SETTING

Four health maintenance organizations (HMOs), two that increased copayments for albuterol inhalers that went from generic CFC-containing to branded CFC-free versions, and two that retained generic copayments for CFC-free inhalers (controls). We included children with asthma aged 4-17 years with commercial coverage from 2007 to 2010.

DESIGN

Interrupted time series with comparison series.

DATA

We obtained enrollee and plan characteristics from enrollment files, and utilization data from pharmacy and medical claims; OOP expenditures were extracted from pharmacy claims for two HMOs with cost data available.

FINDINGS

There were no significant differences in albuterol use between the group with increased cost-sharing and controls with respect to changes after the policy change. There was a postpolicy increase of $6.11 OOP per month per child using albuterol among those with increased cost-sharing versus $0.36 in controls; the difference between groups was significant (p < .01).

CONCLUSIONS

Increased copayments for brand-name CFC-free albuterol after the CFC ban did not lead to a decrease in children's albuterol use, but it led to a modest increase in OOP costs.

Mismatching Among Guidelines, Providers, and Parents on Controller Medication Use in Children with Asthma

BACKGROUND

Underuse of controller medicines among children with asthma remains widespread despite national guidelines.

OBJECTIVES

To (1) assess provider prescribing patterns for asthma controller medications; (2) assess how frequently parents' reports of their child's asthma controller medicine use were mismatched with their provider's recommendations; and (3) evaluate parent attitudes and demographic characteristics associated with these mismatches.

METHODS

In this cross-sectional study, we conducted linked surveys of parents and providers of children with probable persistent asthma in a Medicaid program and 4 commercial health plans in 2011. Probable persistent asthma was defined as a diagnosis of asthma and 1 or more controller medication dispensing.

RESULTS

This study included 740 children (mean age, 8.6 years). Providers for 50% of the children reported prescribing controller medications for daily year-round use, 41% for daily use during active asthma months, and 9% for intermittent use for relief. Among parents, 72% knew which class of controller medication the provider prescribed and 49% knew the administration frequency and the medication class. Parents were less likely to report the same controller medication type as the provider, irrespective of dose and frequency, if they were Latino (odds ratio [OR], 0.23; CI, 0.057-0.90), had a household smoker (OR, 2.87; CI, 0.42-19.6), or believed the controller medicine was not helping (OR, 0.15; CI, 0.048-0.45).

CONCLUSIONS

Mismatches between parent reports and providers intentions regarding how the child was supposed to use inhaled steroids occurred for half of the children. Efforts should focus on ways to reduce mismatches between parent and provider intentions regarding controller medication use.

Breast cancer multigene testing trends and impact on chemotherapy use

OBJECTIVES

A 21-gene test that predicts recurrence risk among women with hormone receptor positive (HR+), localized breast cancer was nationally recommended in 2007, but we know little about its subsequent impact. We evaluated: a) patient characteristics associated with test use, b) correlations between Recurrence Score (RS) and chemotherapy, and c) whether test introduction was associated with a reduction in chemotherapy use.

STUDY DESIGN

Retrospective cohort study.

METHODS

The Kaiser Permanente Northern California tumor registry and electronic health records from 2005 to 2012 were used to identify HR+, human epidermal growth factor receptor 2 negative, node-negative cancers. Analyses used logistic regression with propensity score matching and 2-level logistic regression.

RESULTS

Of the 7004 patients who met guidelines for testing, 22% were tested and 26% had chemotherapy. Test use was more likely in younger women (for ages 40-49 years vs 50-64 years: odds ratio [OR], 1.22; 95% CI, 1.04-1.44), in women with tumors sized 1.0 to 2.0 cm versus > 2 cm (OR, 1.20; 95% CI, 1.03-1.40), and in women from higher-income neighborhoods (for each $10,000 increase in area median income: OR, 1.05; 95% CI, 1.03-1.07). Among patients with low RS, 8% had chemotherapy versus 72% among patients with high RS (P < .01). In propensity score-matched analyses, testing was associated with an absolute reduction of 6.2% in the proportion of women receiving chemotherapy (95% CI, 2.9%-9.5%); the 2-level model showed a similar but nonsignificant (P = .14) association.

CONCLUSIONS

The 21-gene test is used in a minority of eligible patients in this integrated plan. Its use appears to be associated with a modest decrease in overall chemotherapy use.

Building Data Infrastructure to Evaluate and Improve Quality: PCORnet

The goal of PCORnet is to create a community of research that includes patients, clinicians, and health care delivery systems to improve the nation's ability to conduct comparative-effectiveness research.

A vaccine study design selection framework for the postlicensure rapid immunization safety monitoring program

The Postlicensure Rapid Immunization Safety Monitoring Program, the vaccination safety monitoring component of the US Food and Drug Administration's Mini-Sentinel project, is currently the largest cohort in the US general population for vaccine safety surveillance. We developed a study design selection framework to provide a roadmap and description of methods that may be utilized to evaluate potential associations between vaccines and health outcomes of interest in the Postlicensure Rapid Immunization Safety Monitoring Program and other systems using administrative data. The strengths and weaknesses of designs for vaccine safety monitoring, including the cohort design, the case-centered design, the risk interval design, the case-control design, the self-controlled risk interval design, the self-controlled case series method, and the case-crossover design, are described and summarized in tabular form. A structured decision table is provided to aid in planning of future vaccine safety monitoring activities, and the data components comprising the structured decision table are delineated. The study design selection framework provides a starting point for planning vaccine safety evaluations using claims-based data sources.

Parents' choices and rationales for alternative vaccination schedules: a qualitative study

BACKGROUND

A growing number of parents adopt alternative vaccination schedules for their children. A better understanding of parents' rationales for these choices is needed to guide vaccine decision making.

METHODS

We conducted 24 semistructured telephone interviews with parents of 12- to 36-month-olds and analyzed data using an inductive approach.

RESULTS

We identified 5 alternative vaccination approaches: "Dr Sears" schedule, shot-limiting approach, selective delay or decline, visit-by-visit decisions, and refusal of all vaccines. Parents who adopted alternative approaches expressed a desire for more control of exposure to vaccine ingredients; vaccine safety, immune system burden, and perceived disease risk were articulated as concerns.

CONCLUSIONS

Parents who adopt alternative vaccination schedules can be classified in defined subgroups based on their decision-making approaches, and many describe considered reasons to support their actions. Communications that acknowledge and address those reasons may be better able to engage parents and ultimately enhance the process of decision making about vaccines.

Geographic clusters in underimmunization and vaccine refusal

BACKGROUND AND OBJECTIVE

Parental refusal and delay of childhood vaccines has increased in recent years and is believed to cluster in some communities. Such clusters could pose public health risks and barriers to achieving immunization quality benchmarks. Our aims were to (1) describe geographic clusters of underimmunization and vaccine refusal, (2) compare clusters of underimmunization with different vaccines, and (3) evaluate whether vaccine refusal clusters may pose barriers to achieving high immunization rates.

METHODS

We analyzed electronic health records among children born between 2000 and 2011 with membership in Kaiser Permanente Northern California. The study population included 154,424 children in 13 counties with continuous membership from birth to 36 months of age. We used spatial scan statistics to identify clusters of underimmunization (having missed 1 or more vaccines by 36 months of age) and vaccine refusal (based on International Classification of Diseases, Ninth Revision, Clinical Modification codes).

RESULTS

We identified 5 statistically significant clusters of underimmunization among children who turned 36 months old during 2010-2012. The underimmunization rate within clusters ranged from 18% to 23%, and the rate outside them was 11%. Children in the most statistically significant cluster had 1.58 (P < .001) times the rate of underimmunization as others. Underimmunization with measles, mumps, rubella vaccine and varicella vaccines clustered in similar geographic areas. Vaccine refusal also clustered, with rates of 5.5% to 13.5% within clusters, compared with 2.6% outside them.

CONCLUSIONS

Underimmunization and vaccine refusal cluster geographically. Spatial scan statistics may be a useful tool to identify locations with challenges to achieving high immunization rates, which deserve focused intervention.

Post-licensure rapid immunization safety monitoring program (PRISM) data characterization

BACKGROUND

The Post-Licensure Rapid Immunization Safety Monitoring (PRISM) program is the immunization safety monitoring component of FDA's Mini-Sentinel project, a program to actively monitor the safety of medical products using electronic health information. FDA sought to assess the surveillance capabilities of this large claims-based distributed database for vaccine safety surveillance by characterizing the underlying data.

METHODS

We characterized data available on vaccine exposures in PRISM, estimated how much additional data was gained by matching with select state and local immunization registries, and compared vaccination coverage estimates based on PRISM data with other available data sources. We generated rates of computerized codes representing potential health outcomes relevant to vaccine safety monitoring. Standardized algorithms including ICD-9 codes, number of codes required, exclusion criteria and location of the encounter were used to obtain the background rates.

RESULTS

The majority of the vaccines routinely administered to infants, children, adolescents and adults were well captured by claims data. Immunization registry data in up to seven states comprised between 5% and 9% of data for all vaccine categories with the exception of 10% for hepatitis B and 3% and 4% for rotavirus and zoster respectively. Vaccination coverage estimates based on PRISM's computerized data were similar to but lower than coverage estimates from the National Immunization Survey and Healthcare Effectiveness Data and Information Set. For the 25 health outcomes of interest studied, the rates of potential outcomes based on ICD-9 codes were generally higher than rates described in the literature, which are typically clinically confirmed cases.

CONCLUSION

PRISM program's data on vaccine exposures and health outcomes appear complete enough to support robust safety monitoring.

Developing a data infrastructure for a learning health system: the PORTAL network

The Kaiser Permanente & Strategic Partners Patient Outcomes Research To Advance Learning (PORTAL) network engages four healthcare delivery systems (Kaiser Permanente, Group Health Cooperative, HealthPartners, and Denver Health) and their affiliated research centers to create a new national network infrastructure that builds on existing relationships among these institutions. PORTAL is enhancing its current capabilities by expanding the scope of the common data model, paying particular attention to incorporating patient-reported data more systematically, implementing new multi-site data governance procedures, and integrating the PCORnet PopMedNet platform across our research centers. PORTAL is partnering with clinical research and patient experts to create cohorts of patients with a common diagnosis (colorectal cancer), a rare diagnosis (adolescents and adults with severe congenital heart disease), and adults who are overweight or obese, including those with pre-diabetes or diabetes, to conduct large-scale observational comparative effectiveness research and pragmatic clinical trials across diverse clinical care settings.

Intussusception risk after rotavirus vaccination in U.S. infants

BACKGROUND

International postlicensure studies have identified an increased risk of intussusception after vaccination with the second-generation rotavirus vaccines RotaTeq (RV5, a pentavalent vaccine) and Rotarix (RV1, a monovalent vaccine). We studied this association among infants in the United States.

METHODS

The study included data from infants 5.0 to 36.9 weeks of age who were enrolled in three U.S. health plans that participate in the Mini-Sentinel program sponsored by the Food and Drug Administration. Potential cases of intussusception and vaccine exposures from 2004 through mid-2011 were identified through procedural and diagnostic codes. Medical records were reviewed to confirm the occurrence of intussusception and the status with respect to rotavirus vaccination. The primary analysis used a self-controlled risk-interval design that included only vaccinated children. The secondary analysis used a cohort design that included exposed and unexposed person-time.

RESULTS

The analyses included 507,874 first doses and 1,277,556 total doses of RV5 and 53,638 first doses and 103,098 total doses of RV1. The statistical power for the analysis of RV1 was lower than that for the analysis of RV5. The number of excess cases of intussusception per 100,000 recipients of the first dose of RV5 was significantly elevated, both in the primary analysis (attributable risk, 1.1 [95% confidence interval, 0.3 to 2.7] for the 7-day risk window and 1.5 [95% CI, 0.2 to 3.2] for the 21-day risk window) and in the secondary analysis (attributable risk, 1.2 [95% CI, 0.2 to 3.2] for the 21-day risk window). No significant increase in risk was seen after dose 2 or 3. The results with respect to the primary analysis of RV1 were not significant, but the secondary analysis showed a significant risk after dose 2.

CONCLUSIONS

RV5 was associated with approximately 1.5 (95% CI, 0.2 to 3.2) excess cases of intussusception per 100,000 recipients of the first dose. The secondary analysis of RV1 suggested a potential risk, although the study of RV1 was underpowered. These risks must be considered in light of the demonstrated benefits of rotavirus vaccination. (Funded by the Food and Drug Administration.).

Some families who purchased health coverage through the Massachusetts Connector wound up with high financial burdens

Health insurance exchanges created under the Affordable Care Act will offer coverage to people who lack employer-sponsored insurance or have incomes too high to qualify for Medicaid. However, plans offered through an exchange may include high levels of cost sharing. We surveyed families participating in unsubsidized plans offered in the Massachusetts Commonwealth Health Insurance Connector Authority, an exchange created prior to the 2010 national health reform law, and found high levels of financial burden and higher-than-expected costs among some enrollees. The financial burden and unexpected costs were even more pronounced for families with greater numbers of children and for families with incomes below 400 percent of the federal poverty level. We conclude that those with lower incomes, increased health care needs, and more children will be at particular risk after they obtain coverage through exchanges in 2014. Policy makers should develop strategies to further mitigate the financial burden for enrollees who are most susceptible to encountering higher-than-expected out-of-pocket costs, such as providing cost calculators or price transparency tools.

Delayed and forgone care for families with chronic conditions in high-deductible health plans

BACKGROUND

High-deductible health plans (HDHPs) are an increasingly common strategy to contain health care costs. Individuals with chronic conditions are at particular risk for increased out-of-pocket costs in HDHPs and resulting cost-related underuse of essential health care.

OBJECTIVE

To evaluate whether families with chronic conditions in HDHPs have higher rates of delayed or forgone care due to cost, compared with those in traditional health insurance plans.

DESIGN

This mail and phone survey used multiple logistic regression to compare family-level rates of reporting delayed/forgone care in HDHPs vs. traditional plans.

PARTICIPANTS

We selected families with children that had at least one member with a chronic condition. Families had employer-sponsored insurance in a Massachusetts health plan and >12 months of enrollment in an HDHP or a traditional plan.

MAIN MEASURES

The primary outcome was report of any delayed or forgone care due to cost (acute care, emergency department visits, chronic care, checkups, or tests) for adults or children during the prior 12 months.

RESULTS

Respondents included 208 families in HDHPs and 370 in traditional plans. Membership in an HDHP and lower income were each independently associated with higher probability of delayed/forgone care due to cost. For adult family members, the predicted probability of delayed/forgone care due to cost was higher in HDHPs than in traditional plans [40.0% vs 15.1% among families with incomes <400% of the federal poverty level (FPL) and 16.0% vs 4.8% among those with incomes ≥400% FPL]. Similar associations were observed for children.

CONCLUSIONS

Among families with chronic conditions, reporting of delayed/forgone care due to cost is higher for both adults and children in HDHPs than in traditional plans. Families with lower incomes are also at higher risk for delayed/forgone care.

Patterns in influenza antiviral medication use before and during the 2009 H1N1 pandemic, Vaccine Safety Datalink Project, 2000-2010

BACKGROUND

U.S. recommendations for using influenza antiviral medications changed in response to viral resistance (to reduce adamantane use) and during the 2009 H1N1 pandemic (to focus on protecting high-risk patients). Little information is available on clinician adherence to these recommendations. We characterized population-based outpatient antiviral medication usage, including diagnosis and testing practices, before and during the pandemic.

METHODS

Eight medical care organizations in the Vaccine Safety Datalink Project provided data on influenza antiviral medication dispensings from January 2000 through June 2010. Dispensing rates were explored in relation to changes in recommendations and influenza diagnosis and laboratory testing frequencies. Factors associated with oseltamivir dispensings in pandemic versus pre-pandemic periods were identified using multivariable logistic regression.

RESULTS

Antiviral use changed coincident with recommendations to avoid adamantanes in 2006, to use alternatives to oseltamivir in 2008, and to use oseltamivir during the pandemic. Of 38,019 oseltamivir dispensings during the pandemic, 31% were to patients not assigned an influenza diagnosis, and 97% were to patients not tested for influenza. Oseltamivir was more likely to be dispensed in pandemic versus pre-pandemic periods to patients <25 years old and to those with underlying conditions, including chronic pulmonary disease or pregnancy (P<0.0001 for each factor in multivariable analysis).

CONCLUSIONS

Antiviral medication usage patterns suggest that clinicians followed recommendations to change antiviral prescribing based on resistance and to focus on high-risk patients during the pandemic. Medications were commonly dispensed to patients without influenza diagnoses and tests, suggesting that antiviral dispensings may offer useful supplemental data for monitoring influenza incidence.

Risk of confirmed Guillain-Barre syndrome following receipt of monovalent inactivated influenza A (H1N1) and seasonal influenza vaccines in the Vaccine Safety Datalink Project, 2009-2010

An increased risk of Guillain-Barré syndrome (GBS) following administration of the 1976 swine influenza vaccine led to a heightened focus on GBS when monovalent vaccines against a novel influenza A (H1N1) virus of swine origin were introduced in 2009. GBS cases following receipt of monovalent inactivated (MIV) and seasonal trivalent inactivated (TIV) influenza vaccines in the Vaccine Safety Datalink Project in 2009-2010 were identified in electronic data and confirmed by medical record review. Within 1-42 days following vaccination, 9 cases were confirmed in MIV recipients (1.48 million doses), and 8 cases were confirmed in TIV-only recipients who did not also receive MIV during 2009-2010 (1.72 million doses). Five cases following MIV and 1 case following TIV-only had an antecedent respiratory infection, a known GBS risk factor; furthermore, unlike TIV, MIV administration was concurrent with heightened influenza activity. In a self-controlled risk interval analysis comparing GBS onset within 1-42 days following MIV with GBS onset 43-127 days following MIV, the risk difference was 5.0 cases per million doses (95% confidence interval: 0.5, 9.5). No statistically significant increased GBS risk was found within 1-42 days following TIV-only vaccination versus 43-84 days following vaccination (risk difference = 1.1 cases per million doses, 95% confidence interval: -3.1, 5.4). Further evaluation to assess GBS risk following both vaccination and respiratory infection is warranted.

Surveillance for adverse events following receipt of pandemic 2009 H1N1 vaccine in the Post-Licensure Rapid Immunization Safety Monitoring (PRISM) System, 2009-2010

The Post-Licensure Rapid Immunization Safety Monitoring (PRISM) system is a cohort-based active surveillance network initiated by the US Department of Health and Human Services to supplement preexisting and other vaccine safety monitoring systems in tracking the safety of monovalent pandemic 2009 H1N1 influenza vaccine in the United States during 2009-2010. PRISM investigators conducted retrospective analysis to determine whether 2009 H1N1 vaccination was associated with increased risk of any of 14 prespecified outcomes. Five health insurance and associated companies with 38 million members and 9 state/city immunization registries contributed records on more than 2.6 million doses of 2009 H1N1 vaccine. Data on outcomes came from insurance claims. Complementary designs (self-controlled risk interval, case-centered, and current-vs.-historical comparison) were used to optimize control for confounding and statistical power. The self-controlled risk interval analysis of chart-confirmed Guillain-Barré syndrome found an elevated but not statistically significant incidence rate ratio following receipt of inactivated 2009 H1N1 vaccine (incidence rate ratio = 2.50, 95% confidence interval: 0.42, 15.0) and no cases following live attenuated 2009 H1N1 vaccine. The study did not control for infection prior to Guillain-Barré syndrome, which may have been a confounder. The risks of other health outcomes of interest were generally not significantly elevated after 2009 H1N1 vaccination.

Health-related quality of life in adolescents with or at risk for type 2 diabetes mellitus

OBJECTIVE

To evaluate how adolescents with or at risk for type 2 diabetes mellitus (T2DM) and their parent/guardians (parents) perceive adolescents' health-related quality of life.

STUDY DESIGN

We interviewed overweight/obese, 12- to 18-year-old youth with T2DM, prediabetes, or insulin resistance and one parent from 5 US sites. Assessments included Pediatric Quality of Life Inventory (PedsQL), Health Utilities Index, family conflict, and diabetes burden.

RESULTS

In 108 adolescents, diagnoses included 40.7% with T2DM, 25.0% with prediabetes, and 34.3% with insulin resistance. PedsQL summary score (SS) was higher in adolescents than parents (P=.02). Parents rated physical functioning lower than adolescents (P<.0001), but there were no differences in psychosocial health. Adolescent PedsQL SS did not differ with diagnosis, but was inversely associated with adolescent body mass index z-score (P=.0004) and family conflict (P<.0001) and associated with race/ethnicity (P<.0001). Number of adolescent co-morbidities (P=.007) and burden of diabetes care (P<.05) were inversely associated with parent PedsQL SS. There were no differences in the Health Utilities Index-Mark 3 multi-attribute utility score.

CONCLUSIONS

Parents perceive their adolescents' physical functioning as more impaired than adolescents themselves. Contextual factors including severity of obesity, race/ethnicity, family conflict, and burden of diabetes care influence health-related quality of life. Family-based approaches to treatment and prevention of T2DM may benefit from increased attention to the biopsychosocial context.

Parental and societal values for the risks and benefits of childhood combination vaccines

BACKGROUND

New combination vaccines reduce the number of injections needed for immunization. However, possible drawbacks include higher prices, extra doses of vaccine antigens and increased minor adverse events. Our objective was to measure parental and societal values for attributes of childhood combination vaccines.

METHODS

We conducted a discrete choice experiment using an online survey of adults administered by Knowledge Networks. Values were measured for attributes of combination vaccines for a hypothetical child aged 6 months: (1) number of injections, (2) extra dose of hepatitis B vaccine, (3) 20% higher chance of fever, (4) community-level immunization coverage of 2-year-olds of 90% or 80%, and (5) cost per visit. Logistic regression with generalized estimating equations was used to analyze the value of different attributes and generate a marginal willingness-to-pay for a change in attribute level.

RESULTS

The response rate was 64% (N=558). Most respondents were parents (63%) and most respondents agreed that combination vaccines were safe (77%). Respondents were willing to pay $7.68 to avoid an injection (compared to $9.94 when looking at parents only). However, respondents were willing to pay $41.57 to avoid higher risk of fever after one set of immunizations (10% versus 30%) and $65.42 for higher immunization coverage rates. These results were very similar for parents only. There was no significant preference to avoid an extra dose of hepatitis B vaccine.

CONCLUSIONS

Respondents were willing to pay larger amounts to avoid increased risk of minor adverse events and to increase community-level immunization coverage than to avoid injections. These values should be taken into account when determining the risks and benefits of combination vaccines.

The risk of immune thrombocytopenic purpura after vaccination in children and adolescents

BACKGROUND

The risk of immune thrombocytopenic purpura (ITP) after childhood vaccines other than measles-mumps-rubella vaccine (MMR) is unknown.

METHODS

Using data from 5 managed care organizations for 2000 to 2009, we identified a cohort of 1.8 million children ages 6 weeks to 17 years. Potential ITP cases were identified by using diagnostic codes and platelet counts. All cases were verified by chart review. Incidence rate ratios were calculated comparing the risk of ITP in risk (1 to 42 days after vaccination) and control periods.

RESULTS

There were 197 chart-confirmed ITP cases out of 1.8 million children in the cohort. There was no elevated risk of ITP after any vaccine in early childhood other than MMR in the 12- to 19-month age group. There was a significantly elevated risk of ITP after hepatitis A vaccine at 7 to 17 years of age, and for varicella vaccine and tetanus-diphtheria-acellular pertussis vaccine at 11 to 17 years of age. For hepatitis A, varicella, and tetanus-diphtheria-acellular pertussis vaccines, elevated risks were based on one to two vaccine-exposed cases. Most cases were acute and mild with no long-term sequelae.

CONCLUSIONS

ITP is unlikely after early childhood vaccines other than MMR. Because of the small number of exposed cases and potential confounding, the possible association of ITP with hepatitis A, varicella, and tetanus-diphtheria-acellular pertussis vaccines in older children requires further investigation.

Preferences for type 2 diabetes health states among adolescents with or at risk of type 2 diabetes mellitus

OBJECTIVE

We evaluated how adolescents with or at risk of type 2 diabetes (T2DM) and their parent/guardians (parents) value health states associated with T2DM.

METHODS

We interviewed overweight/obese [Body Mass Index (BMI) ≥ 85th percentile], 12-18-yr old adolescents with T2DM, prediabetes, or insulin resistance (IR) and a parent. The standard gamble (SG) method elicited preferences (utilities) for seven hypothetical T2DM health states reported on a scale from 0 (dead) to 1 (perfect health). Adolescent's current health was evaluated with the SG and Health Utilities Index (HUI).

RESULTS

There were 70 adolescents and 69 parents. Adolescents were 67.1% female and 15.5 ± 2.2 yr old; 30% had T2DM, 30% prediabetes, and 40% IR. Almost half (48.6%) had a BMI > 99th percentile. Parents (83% mothers) were 45.1 ± 7.3 yr old and 75% had at least some college/technical school education. Adolescents and parents rated T2DM with no complications treated with diet as most desirable [median (IQR); adolescent 0.72 (0.54, 0.98); parent 1.0 (0.88, 1.0)] and end-stage renal disease as least desirable [adolescent 0.51 (0.31, 0.70); parent 0.80 (0.65, 0.94)]. However, adolescents' utilities were significantly lower (p ≤ 0.001) than parents for all health states assessed. Adolescents' assessments of their current health with the SG and HUI were not correlated.

CONCLUSIONS

Adolescents with or at risk of T2DM rated treatments and sequelae of diabetes as significantly worse than their parents. These adolescent utilities should be considered in the evaluation of treatment strategies for youth with T2DM. Family-based programs for T2DM must also be prepared to address conflicting preferences in order to promote shared decision-making.

Comparative effectiveness research in lung diseases and sleep disorders: recommendations from the National Heart, Lung, and Blood Institute workshop

The Division of Lung Diseases of the National Heart, Lung, and Blood Institute (NHLBI) held a workshop to develop recommendations on topics, methodologies, and resources for comparative effectiveness research (CER) that will guide clinical decision making about available treatment options for lung diseases and sleep disorders. A multidisciplinary group of experts with experience in efficacy, effectiveness, implementation, and economic research identified (a) what types of studies the domain of CER in lung diseases and sleep disorders should include, (b) the criteria and process for setting priorities, and (c) current resources for and barriers to CER in lung diseases. Key recommendations were to (1) increase efforts to engage stakeholders in developing CER questions and study designs; (2) invest in further development of databases and other infrastructure, including efficient methods for data sharing; (3) make full use of a broad range of study designs; (4) increase the appropriate use of observational designs and the support of methodologic research; (5) ensure that committees that review CER grant applications include persons with appropriate perspective and expertise; and (6) further develop the workforce for CER by supporting training opportunities that focus on the methodologic and practical skills needed.

Collaborations in population-based health research: the 17th annual HMO Research Network Conference, March 23-25, 2011, Boston, Massachusetts, USA

The HMO Research Network (HMORN) is a consortium of 16 health care systems with integrated research centers. Approximately 475 people participated in its 17(th) annual conference, hosted by the Department of Population Medicine, Harvard Pilgrim Health Care Institute and Harvard Medical School. The theme, "Collaborations in Population-Based Health Research," reflected the network's emphasis on collaborative studies both among its members and with external investigators. Plenary talks highlighted the initial phase of the HMORN's work to establish the NIH-HMO Collaboratory, opportunities for public health collaborations, the work of early career investigators, and the state of the network. Platform and poster presentations showcased a broad spectrum of innovative public domain research in areas including disease epidemiology and treatment, health economics, and information technology. Special interest group sessions and ancillary meetings provided venues for informal conversation and structured work among ongoing groups, including networks in cancer, cardiovascular diseases, lung diseases, medical product safety, and mental health.

Financing and systems barriers to seasonal influenza vaccine delivery in community settings

BACKGROUND

Recommendations for annual seasonal influenza vaccination have expanded to now include >300 million children and adults each year. Community settings have become increasingly important venues for influenza vaccination. We sought to identify barriers to and solutions for expanding influenza vaccination in community settings.

METHODS

Semi-structured telephone interviews were conducted from 01/09 to 06/10 with a range of stakeholders involved in influenza vaccination, including health plans, medical services firms, retail based clinics, pharmacies, schools, and state and local public health immunization programs. Participants (n=65) were asked about barriers and feasible solutions to influenza vaccine delivery to children and adults in community settings. Key themes were identified through iterative coding using a grounded theory approach.

RESULTS

Stakeholders identified specific financial barriers to influenza vaccine delivery in 3 major areas: purchase and distribution, delivery, and reimbursement. Limited purchasing power, the uncertain nature of public demand, and unpredictable timing of influenza vaccine supply were important barriers to enhance delivery in community settings. Barriers to delivery included complexities in running off-site clinics, especially in school settings, the need to manage publicly vs. privately purchased vaccines separately, and state-to-state variability in requirements for credentialing, physician oversight, and reporting. Reimbursement barriers included a protracted credentialing process, the need to determine insurance eligibility at point-of-service, and lack of a billing infrastructure in off-site clinics. Opportunities to mitigate financial barriers to influenza vaccine delivery in community settings focused on coordination across providers and the role of public health as a "trusted broker" to overcome existing challenges.

CONCLUSIONS

Financial and systems barriers hamper the optimal use of community settings to effectively deliver influenza vaccines. Public health partners at the federal, state, and local levels are well-positioned to facilitate the engagement of all stakeholders in this important and complex vaccine delivery system.