The Importance of Conducting Practice-oriented Research with Underserved Populations

There has been a growing emphasis on dissemination of empirically supported treatments. Dissemination, however, should not be restricted to treatment. It can and, in the spirit of the scientific-practitioner model, should also involve research. Because it focuses on the investigation of clinical routine as it takes place in local settings and because it can involve the collaboration of several stakeholders, practice-oriented research (POR) can be viewed as an optimal research method to be disseminated. POR has the potential of addressing particularly relevant gaps of knowledge and action when implemented in regions of the world that have limited resources for or experiences with empirical research, and/or in clinical settings that are serving clinical populations who are not typically receiving optimal mental care services - specifically, individuals in rural and inner cities that have limited economic and social resources. The establishment and maintenance of POR in such regions and/or settings, however, come with specific obstacles and challenges. Integrating the experiences acquired from research conducted in various continents (Africa, Europe, Latin America, and North America), the goal of this paper is to describe some of these challenges, strategies that have been implemented to address them, as well as new possible directions to facilitate the creation and growth of POR. It also describes how these challenges and ways to deal with them can provide helpful lessons for already existing POR infrastructures.

Considering the Environmental Impact of Practice-Based Research

INTRODUCTION

Practice-based research networks (PBRNs) improve primary care by addressing issues that matter to clinicians. Building trust between researchers and care teams is essential to this process, which often requires visiting practices to cultivate relationships and perform research activities. However, in a recent study using practice facilitation to improve the delivery of a preventive service, the COVID-19 pandemic prompted us to convert all planned facilitation from an in-person to virtual format. This eliminated the need to commute by automobile to and from practices across the state, greatly reducing the carbon footprint of the study.

METHODS

From practice facilitator field notes that detailed practice locations and number of sessions, we calculated the total number of driving miles averted by virtual facilitation. We then determined metric tons of carbon dioxide we avoided producing using the Environmental Protection Agency Greenhouse Gases Equivalencies Calculator. During post-intervention interviews, we assessed practices' perspectives and experiences with the virtual format.

RESULTS

Three practice facilitators provided an average of 3.4 sessions for 64 practices. Virtual facilitation averted 32,574.8 drive miles and prevented the release of 12.7 metric tons of carbon dioxide, an offset equivalent to growing 210 trees for 10 years. Practices reported that virtual facilitation fostered greater engagement and allowed more clinicians and staff to attend sessions.

DISCUSSION

Climate change poses a significant threat to the health of people and communities. Given their commitment to improving population health, it may be time for PBRNs to routinely assess their environmental impact and minimize preventable environmental costs.

Smoking Cessation Support in the Context of Other Social and Behavioral Needs in Community Health Centers

BACKGROUND

Cigarette smoking rates remain disproportionately high among low income populations with unmet social and behavioral health needs. To address this problem, we sought to develop and evaluate the feasibility, acceptability, and preliminary effectiveness of a novel smoking cessation program for community health centers that serve these populations.

METHODS

We implemented a randomized pilot trial of two smoking cessation programs in three county operated community health center (CHC) sites: (1) a systematic assessment of smoking habits and standard tools to assist with smoking cessation counseling ("Enhanced Standard Program" or ESP), and (2) another that added a structured assessment of social and behavioral barriers to smoking cessation, ("Connection to Health for Smokers" or CTHS). Clinical outcomes were evaluated between 10 to 16 weeks, supplemented with interviews of patient participants and health care team members.

RESULTS

141 adults were randomized and 123 completed the intervention (61 in ESP, 62 in CTHS). At follow-up, over half of participants reported ≥1 quit attempts (59.7% ESP and 56.5% CTHS; adjusted p = .66) while more in ESP (24.6% vs. 12.9%) were documented as not smoking in the last 7 days (adjusted p = 0.03). In addition to being in ESP, predictors of smoking cessation included higher baseline confidence in ability to quit (p = 0.02) and more quit attempts during the study (p = 0.04). Health care teams, however, generally preferred the more comprehensive approach of CTHS.

CONCLUSION

Lessons learned from this pilot study may inform the development of effective smoking cessation programs for CHCs that combine elements of both interventions.

Increased Organizational Stress in Primary Care: Understanding the Impact of the COVID-19 Pandemic, Medicaid Expansion, and Practice Ownership

BACKGROUND

Primary care is the foundation of health care, resulting in longer lives and improved equity. Primary care was the frontline of the COVID-19 pandemic public response and essential for access to care. Yet primary care faces substantial structural and systemic challenges. As part of a longitudinal analysis to track the capacity and health of primary care, we surveyed every primary care practice in Virginia in 2018 and again in 2022.

METHODS

Surveys were emailed or mailed up to 6 times and nonresponders received a phone call. Questions assessed organizational characteristics, scope of care, capacity, and organizational stress in the prior year. From respondents, 39 clinicians, nurses, staff, administrators, and practice managers were interviewed.

RESULTS

526 out of 2296 primary care practices (23% response rate) completed the survey, with broad representation across geography, ownership, and payer mix. Compared with 2018, in 2022 there were increases in practices owned by health systems (25% vs 43%, P < .0001) and average percent of patients with Medicaid per practice (12% vs 22%, P < .0001). The percent of practices reporting any major stressor increased from 34% to 53% (P < .0001). The main increased stress was losing a clinician, with 13% of practices in 2018 versus 42% in 2022 reporting losing a clinician (P < .0001).

CONCLUSIONS

Primary care practices are resilient and continue to serve their communities, including a broad scope of services and care for underserved people. However, the COVID-19 pandemic caused significant stress. With an increase in clinicians leaving clinical practice, we anticipate worsening access to primary care.

Evaluating a Web-Based Adult ADHD Toolkit for Primary Care Clinicians

INTRODUCTION

Approximately 5% of the US adult population has Attention Deficient Hyperactivity Disorder (ADHD) that can negatively impact quality of life. Health care professionals report a need to increase their knowledge of and confidence in treating adult ADHD. The American Academy of Family Physicians National Research Network (AAFP NRN) collaborated with a panel of experts to create a web-based AAFP Adult ADHD Toolkit composed of resources to aid in the diagnosis, management, and treatment of adults with ADHD.

OBJECTIVES

Assess the impact of using an AAFP Adult ADHD Toolkit in a practice setting.

METHODS

Ninety-seven primary and behavioral health care professionals from AAFP NRN practices (n=6) used the Toolkit for 17 weeks. Data on Toolkit use, usefulness, implementation, impact, and changes in knowledge and confidence were collected via pre-post and weekly surveys. Mixed methods, regression analyses, t-tests, and mixed ANOVA were used to assess change over time.

RESULTS

Use of the Toolkit improved health care providers' knowledge by midpoint relative to baseline in areas related to treatment effects, side effects, and outcomes (3.6 vs 3.0; P = .004); existing ADHD resources (3.3 vs 2.9; P = .03); and management of ADHD in patients with comorbid conditions (3.2 vs 2.7; P = .01). By the end of the study, Toolkit use was associated with increased confidence in mental health and life history interview techniques (3.5 vs 3.0; P = .03); treatment options for ADHD with comorbid mental health disorders (3.2 vs 2.3; P ≤ .001); and treatment options for ADHD with coexisting substance use disorders (3.0 vs 2.3; P = .003). By the end of the study, most participants (n=47, 87%) reported the Toolkit addressed most of their needs related to diagnosis, treatment, and management of adult ADHD.

CONCLUSION

Availability and adoption of the Toolkit into the routine care of adults with ADHD measurably increased health care professionals' knowledge especially in those providers who regularly see adult patients with ADHD.

Strategies for Developing and Sustaining Patient and Community Advisory Groups: Lessons from the State Networks of Colorado Ambulatory Practices and Partners (SNOCAP) Consortium of Practice-Based Research Networks

BACKGROUND

Patient and community engagement is essential to maintain the relevance of practice-based research. Empowered engagement requires going beyond the check box, with advisory groups involved in every aspect of a project. Here, 4 Colorado practice-based research networks (PBRNs) share their advisory group origins, as well as methods for continued engagement and the work that has resulted.

METHODS

PBRNs, like communities and practices, vary in form and function. In a 4-part case series, we describe commonalities and differences among advisory groups within the State Networks of Colorado Ambulatory Practices and Partners (SNOCAP), a consortium of PBRNs in Colorado. Three SNOCAP advisory groups are well established, while a fourth is under development.

RESULTS

Each case shares ways in which advisory groups have been structured within SNOCAP, including meeting frequency, compensation, and member activities to ensure the design, conduct, analysis, and dissemination of research are grounded in the needs of patients and communities. We share 6 lessons learned regarding membership, relationships, relevance, care and feeding, listening, and showing up.

CONCLUSIONS

SNOCAP believes advisory groups are the backbone and guidepost of PBRN work. Patient advisors are an essential and invaluable complement to traditional research when engaged beyond "basic" participation. Best structures for advisory groups depend upon stakeholder needs.

Patient-Centered Research Priorities: A Mixed-Methods Approach from the Colorado Children's Outcomes Network (COCONet)

BACKGROUND

Practice-based research networks (PBRNs) perform clinically relevant research designed for immediate translation to patient care. Research questions developed with patients and parents are more likely to be relevant to stakeholders. This case study developed priority areas for patient-centered outcomes research in pediatric health within the context of the Colorado Children's Outcomes Network, a statewide pediatric PBRN, and in collaboration with stakeholders.

METHODS

We undertook a mixed-methods, community-engaged process to understand and develop a research agenda for our pediatric PBRN. With a stakeholder-engaged research team, we conducted 52 stakeholder interviews and 1 focus group (n = 9) addressing topics including child health issues, personal health care experiences, community health, and the health care system. Transcripts were coded and analyzed by researchers and parent advisors. We conducted a Web-based survey of PBRN stakeholders (n = 75) to rate priority issues identified in qualitative findings. Finally, we facilitated a community-engaged mixed-methods interpretation and issue selection process with our Network Advisory Board to identify issues of highest importance for Colorado Children's Outcomes Network.

RESULTS

Six topic areas of importance to pediatric health stakeholders emerged from qualitative work. Participating stakeholders used rating surveys to rank these 6 topics. Pediatric mental health coordination and communication/integration with primary care was ranked as the most important and highest research priority. The Network Advisory Board additionally identified immunization uptake and transition from pediatric to adult health care as research priority areas.

CONCLUSIONS

This pediatric PBRN identified numerous research priorities in pediatric health and selected 3 for immediate research action. PBRNs can use community-engaged, mixed-methods research approaches to set research priorities and develop patient-centered pediatric research agendas.

Parent Perceptions of and Preferences for Participation in Child Health Research: Results from a Pediatric Practice-Based Research Network

BACKGROUND

Recruitment efforts for child health research are often based on assumptions, therefore improving knowledge about parents' perceptions and preferences could enhance engagement.

AIM/OBJECTIVE

1) To describe parents' perceptions about and preferences for participation in child health research within a pediatric practice-based research network (PBRN), and 2) to investigate any associations with the presence of on-site PBRN research staff, office location, and child age.

METHODS

We conducted a 2-phase study with a convenience sample of parents from diverse office settings. Phase 1 was a qualitative assessment using semistructured, in-person interviews. Phase 2 consisted of a quantitative self-administered survey assessing: 1) perceptions of importance, benefits/motivations, and risks/barriers of child health research, and 2) preferences for recruitment method and enrollment location.

RESULTS

Parents (n = 627) uniformly perceived child health research to be important in prevention (89%), diagnosis (89%), and treatment (92%). They were motivated to participate most commonly by altruism and rarely by compensation. Parents perceived side effects (60%), discomfort (52%), and time (45%) as the main risks of participation. Most parents preferred to learn about research opportunities at their pediatric office (70%), and if interested, to enroll their child in their pediatric office (57%) or in their home (52%). Parents were significantly more altruistic and interested in participation in offices with on-site PBRN research staff and greater proximity to the University.

CONCLUSIONS

Child health researchers could enhance participation by using recruitment resources and enrollment strategies that match parent preferences, including engagement by on-site PBRN staff.

Process for Setting Research Priorities: A Case Study from the State Networks of Colorado Ambulatory Practices and Partners (SNOCAP) Consortium

PURPOSE

It is important to share processes that practice-based research networks (PBRNs) can implement with PBRN members and partners to determine research topics of priority. Engaging partners at a preproject phase and continuing engagement throughout a project can help address topics of great need and increase meaningfulness at a local level.

METHODS

The State Networks of Colorado Ambulatory Practices and Partners (SNOCAP) practice-based research network has a 20-year history of research topic prioritization. Annually, PBRN members and partners come together to set new priorities for SNOCAP to put focus on in the coming years. Methods from these Colorado PBRNs are shared as a framework for other PBRN networks, community and patient partners, and stakeholders to use.

RESULTS

Engaging PBRN members and researchers in a bidirectional manner in preproject prioritization helps address current needs and gaps in care and identifies topics that are meaningful and important statewide. SNOCAP shares various approaches and lessons learned, provides guidance to PBRNs wanting to establish priorities, and helps guide groups that want to engage, or engage more deeply with, network members. Priority setting methods, a sample agenda, and resulting SNOCAP projects from the past 5 years of prioritization are shared.

CONCLUSIONS

Inquiry on a regular basis is an important step in practice- or community-based research. Getting to the local level to determine and fully address priority needs is not only "the right thing to do," rather, it is essential in true bidirectional work.

Practice-Based Research Networks: Strategic Opportunities to Advance Implementation Research for Health Equity

While the vast majority of people receive their medical care in community primary and specialty care clinics, most clinical research is performed in academic tertiary care hospitals and hospital clinics. Practice-based research networks are most commonly collections of primary care practices that work together to ask and answer health questions for their patients and communities and are an integral part of the translational pathway from discovery to practice to community health. Community primary care practices are at the front line of health equity issues; equity in clinical care, equity in community health, equity in social determinants of health, and equity in health outcomes. Practice-based research networks can gather and combine data from dozens of communities, hundreds of practices and thousands of patients to address health equity and disparities across the full spectrum of community and public health to clinical and primary care. This article will briefly outline the history of PBRNs, types of PBRNs, locations, topics, and patient outcomes over the past 25 years. Current PBRN efforts to address health disparities and improve health equity will be described. New PBRN opportunities to address health disparities and approaches to advance implementation research for health equity in the practice and community will be described. Readers will be challenged to consider ways to engage practice-based research networks in their health equity efforts.

Coronary Artery Calcium Progression Is Associated with Cardiovascular Events Among Asymptomatic Individuals: From the North Texas Primary Care Practice-based Research Network (NorTex-PBRN)

BACKGROUND

Although incidental coronary artery calcium (CAC) has been established as a surrogate measure for atherosclerotic plaque burden, little is known about its progression and the associated risks. This study looks at the association of select cardiovascular risk factors with the progression of CAC over a 2-year period and the relationship between CAC progression and experiencing a composite cardiovascular disease (CVD) event.

METHODS

Repeated CAC measurements were obtained for 311 asymptomatic participants aged >44 years, who were recruited from a collaborative network of primary care clinics.

RESULTS

An average of 24.4 months separated scans and CAC scores increased by a mean of 24.45 Agatston units. A total of 113 participants (30%) demonstrated CAC progression, whereas the rest showed no change or a decrease in CAC over 2 years. In adjusted regression models that controlled for age and sex, the following were associated with 2-year CAC progression: dyslipidemia, systolic blood pressure, fasting glucose, and non-high-density lipoprotein. Moreover, those with progressive CAC measures were >4 times more likely to experience a composite CVD event in 2 years, after controlling for known risk factors.

CONCLUSIONS

Overall, several baseline risk factors remained significant after adjusting for age and sex. CAC progression was independently associated with a composite CVD event.

Patient Willingness to Have Tests to Guide Antibiotic Use for Respiratory Tract Infections: From the WWAMI Region Practice and Research Network (WPRN)

INTRODUCTION

The majority of consultations for acute respiratory tract infections (RTIs) lead to prescriptions for antibiotics, which have limited clinical benefit. We explored patients' willingness to have blood tests as part of the diagnostic work-up for RTIs, and patient knowledge about antibiotics.

METHODS

Patients at 6 family medicine clinics were surveyed. Regression modeling was used to determine independent predictors of willingness to have venous and point-of-care (POC) blood tests, and knowledge of the value of antibiotics for RTIs.

RESULTS

Data were collected from 737 respondents (response rate 83.8%), of whom 65.7% were women, 60.1% were white, and 25.1% were current smokers; patients' mean age was 46.9 years. Sex (female), race (white), and a preference to avoid antibiotics were independent predictors of greater level of antibiotic knowledge. A total of 63.1% were willing to have a venous draw and 79% a POC blood test, to help guide antibiotic decision-making. Non-American Indian/Alaskan Native race, current smoking, and greater knowledge of antibiotics were independent predictors of willingness to have a POC test.

CONCLUSION

A large majority of patients seemed willing to have POC tests to facilitate antibiotic prescribing decisions for RTIs. Poor knowledge about antibiotics suggests better education regarding antibiotic use might influence patient attitudes towards use of antibiotics for RTIs.

New Method for Real Time Influenza Surveillance in Primary Care: A Wisconsin Research and Education Network (WREN) Supported Study

INTRODUCTION

The goal of public health infectious disease surveillance systems is to provide accurate laboratory results in near-real time. When it comes to influenza surveillance, most current systems are encumbered with inherent delays encountered in the real-life chaos of medical practice. To combat this, we implemented and tested near-real-time surveillance using a rapid influenza detection test (RIDT) coupled with immediate, wireless transmission of results to public health entities.

METHODS

A network of 19 primary care clinics across Wisconsin were recruited, including 4 sites already involved in ongoing influenza surveillance and 15 sites that were new to surveillance activities. Each site was provided with a Quidel Sofia Influenza A+B RIDT analyzer attached to a wireless router. Influenza test results, along with patient age, were transmitted immediately to a cloud-based server, automatically compiled, and forwarded to the surveillance team daily. Weekly counts of positive influenza A and B cases were compared with positive polymerase chain reaction (PCR) detections from an independent surveillance system within the state.

RESULTS

Following Institutional Review Board (IRB) and institutional approvals, we recruited 19 surveillance sites, installed equipment, and trained staff within 4 months. Of the 1119 cases tested between September 15, 2013 and June 28, 2014, 316 were positive for influenza. The system provided early detection of the influenza outbreak in Wisconsin. The influenza peak between January 12 and 25, 2014, as well as the epidemic curve, closely matched that derived from the established PCR laboratory network (r = 0.927; P < .001).

CONCLUSIONS

A network of influenza RIDTs with wireless transmission of results approximated the long-sought-after goal of real-time influenza surveillance. Results from the initial year strongly support this approach to highly accurate and timely influenza surveillance.

From Our Practices to Yours: Key Messages for the Journey to Integrated Behavioral Health

BACKGROUND

The historic, cultural separation of primary care and behavioral health has caused the spread of integrated care to lag behind other practice transformation efforts. The Advancing Care Together study was a 3-year evaluation of how practices implemented integrated care in their local contexts; at its culmination, practice leaders ("innovators") identified lessons learned to pass on to others.

METHODS

Individual feedback from innovators, key messages created by workgroups of innovators and the study team, and a synthesis of key messages from a facilitated discussion were analyzed for themes via immersion/crystallization.

RESULTS

Five key themes were captured: (1) frame integrated care as a necessary paradigm shift to patient-centered, whole-person health care; (2) initialize: define relationships and protocols up-front, understanding they will evolve; (3) build inclusive, empowered teams to provide the foundation for integration; (4) develop a change management strategy of continuous evaluation and course-correction; and (5) use targeted data collection pertinent to integrated care to drive improvement and impart accountability.

CONCLUSION

Innovators integrating primary care and behavioral health discerned key messages from their practical experience that they felt were worth sharing with others. Their messages present insight into the challenges unique to integrating care beyond other practice transformation efforts.

Primary Care Patients' Willingness to Participate in Comprehensive Weight Loss Programs: From the WWAMI Region Practice and Research Network

PURPOSE

In the United States, 69% of adults are overweight or obese, as defined by a body mass index (BMI) ≥25 kg/m(2). The US Preventive Services Task Force recommends screening all adult patients for obesity and referring obese patients to intensive, multicomponent behavioral weight loss programs comprising 12 to 26 yearly sessions. The objective of this study is to determine the degree to which overweight and obese primary care patients report willingness to participate in these intensive weight loss programs and to identify the patient factors associated with reported willingness to participate.

METHODS

This 2013 cross-sectional survey was offered to all adult patients seen for an office visit at 1 of 12 primary care clinics in the Washington, Wyoming, Alaska, Montana and Idaho (WWAMI) Region Practice and Research Network (WPRN). Patients self-reported both their health information and their willingness to participate in a comprehensive weight loss program. Respondents were characterized by descriptive statistics. We compared reported rates of willingness to participate by patient factors and assessed which patient factors were independently associated with reported willingness using bivariate analysis and logistic regression, respectively.

RESULTS

Of overweight and obese respondents, 63% reported willingness to participate in comprehensive weight loss programs. Age, sex, race/ethnicity, insurance status, BMI, and reason for wanting to lose weight were all significantly and independently associated with reported willingness to participate.

CONCLUSIONS

Reported willingness to participate in comprehensive weight loss programs suggests that additional resources are needed to understand strategies for disseminating and implementing effective comprehensive weight loss programs.

Local Learning Collaboratives to Improve Quality for Chronic Kidney Disease (CKD): From Four Regional Practice-based Research Networks (PBRNs)

BACKGROUND

Four practice-based research networks (PBRNs) participated in a project to increase the diffusion of evidence-based treatment guidelines for chronic kidney disease (CKD). A multicomponent organizational intervention engaged regionally proximal primary care practices in a series of facilitated meetings, referred to as local learning collaboratives (LLCs).

METHODS

The 2-wave strategy began with 8 practices in each PBRN receiving practice facilitation and subsequently joining an LLC. A sequential mixed-methods design addressed the conduct, content, and fidelity of the intervention; clinicians in 2 PBRNs participated in interviews, and PBRN coordinators reflected on implementation challenges.

RESULTS

LLCs were formed in 3 PBRNs, with 121 monthly meetings held across 20 LLCs. Slightly more than half of the participants were clinicians. Qualitative data suggest that clinicians increased the priority for CKD care, improved knowledge and skills, were satisfied with the project, and attempted to improve care. Implementation challenges were encountered and concerns about sustainability expressed.

CONCLUSION

While PBRNs can successfully leverage resources to diffuse treatment guidelines, and LLCs are well-accepted by clinical staff, the formation of LLCs was not feasible for 1 PBRN, and others struggled to meet regularly and have performance data available despite logistic support.

Implementation of Technology-based Patient Engagement Strategies within Practice-based Research Networks

BACKGROUND

Technology-based patient engagement strategies (such as patient portals) are increasingly available, yet little is known about current use and barriers within practice-based research networks (PBRNs). PBRN directors have unique opportunities to inform the implementation of patient-facing technology and to translate these findings into practice.

METHODS

PBRN directors were queried regarding technology-based patient engagement strategies as part of the 2015 CAFM Educational Research Alliance (CERA) survey of PBRN directors. A total of 102 PBRN directors were identified via the Agency for Healthcare Research and Quality's registry; 54 of 96 eligible PBRN directors completed the survey, for a response rate of 56%.

RESULTS

Use of technology-based patient engagement strategies within PBRNs was limited, with less than half of respondents reporting experience with the most frequently named tools (risk assessments/decision aids). Information technology (IT) support was the top barrier, followed by low rates of portal enrollment. For engaging participant practices, workload and practice leadership were cited as most important, with fewer respondents noting concerns about patient privacy.

DISCUSSION

Given limited use of patient-facing technologies, PBRNs have an opportunity to clarify the optimal use of these strategies. Providing IT support and addressing clinician concerns regarding workload may facilitate the inclusion of innovative technologies in PBRNs.

Use of Clinical Decision Support to Improve Primary Care Identification and Management of Chronic Kidney Disease (CKD)

BACKGROUND

Early detection of chronic kidney disease (CKD) can lead to interventions to prevent renal failure and reduce risk for cardiovascular disease, yet adherence to treatment goals is suboptimal in the primary care setting. The purpose of this study was to assess whether clinical decision support (CDS) can be used to improve the identification and management of CKD.

METHODS

This 2 year demonstration study was conducted in 11 primary care PPRNet practices. CDS included a risk assessment tool, health maintenance protocols, flow chart and a patient registry. Practices received performance reports and hosted annual half day on-site visits.

RESULTS

There were statistically significant increases in screening for albuminuria (median 24 month change 30%, p < 0.0005) and monitoring albuminuria (median 24 month change 25%, p < 0.0005). An absolute 23.5% improvement in appropriate use of ACE-inhibitor or angiotensin receptor blocker and an absolute 7.0% improvement in hemoglobin measurement were not statistically significant. There were no clinical or statistically significant differences in other CKD CQMs. Facilitators to CDS use included practices' prioritization of improving CKD and staff use of standing orders. Barriers included incorporating use into existing workflow and variable use among providers.

CONCLUSIONS

Use of CDS to improve CKD identification and management in primary care practices shows promise. However, other barriers must be addressed to effectively achieve improvements in CKD outcomes.

Decision-to-Implement Worksheet for Evidence-based Interventions: From the WWAMI Region Practice and Research Network

BACKGROUND

Health-related scientific discoveries are often not applied in clinical settings after publication, even when recommended by a trusted journal or professional association. This article describes an assessment tool we developed for use by primary care clinicians and practice administrators to evaluate whether to implement recommended evidence-based interventions in their practices.

METHODS

We used dissemination and implementation theory to develop a worksheet to guide decision making about whether interventions are suitable for implementation in primary care practice settings. We tested the tool by analyzing how members of a primary care practice-based research network rated 4 evidence-based interventions.

RESULTS

The median likelihood of implementation ranged from 2 to 3.5 on a scale of 1 (low) to 5 (high). Raters' level of agreement with statements about 3 intervention characteristics was associated (P < .05) with a higher likelihood of implementation using Spearman rank-order correlation: simple to implement, testable before fully implementing, and modifiable to meet the needs of the practice. Raters found the worksheet helpful in thinking through potential implementation, especially the prompts about modifiability and relevance to the practice's patients and priorities.

CONCLUSIONS

The Decision-to-Implement Worksheet provides a new resource for primary care practices that want to assess whether evidence-based interventions are suitable to adopt or adapt to meet their needs.

Practice-based Research Networks (PBRNs) Bridging the Gaps between Communities, Funders, and Policymakers

In this commentary, we propose that practice-based research networks (PBRNs) engage with funders and policymakers by applying the same engagement strategies they have successfully used to build relationships with community stakeholders. A community engagement approach to achieve new funding streams for PBRNs should include a strategy to engage key stakeholders from the communities of funders, thought leaders, and policymakers using collaborative principles and methods. PBRNs that implement this strategy would build a robust network of engaged partners at the community level, across networks, and would reach state and federal policymakers, academic family medicine departments, funding bodies, and national thought leaders in the redesign of health care delivery.

Patterns of Electronic Portal Use among Vulnerable Patients in a Nationwide Practice-based Research Network: From the OCHIN Practice-based Research Network (PBRN)

BACKGROUND

Underserved patient populations experience barriers to accessing and engaging within the complex health care system. Electronic patient portals have been proposed as a potential new way to improve access and engagement. We studied patient portal use for 12 consecutive months (365 days) among a large, nationally distributed, underserved patient population within the OCHIN (originally created as the Oregon Community Health Information Network and renamed OCHIN as other states joined) practice-based research network (PBRN).

METHODS

We retrospectively assessed adoption and use of Epic's MyChart patient portal in the first 12 months after MyChart was made available to the OCHIN PBRN. We examined electronic health record data from 36,549 patients aged ≥18 years who were offered a MyChart access code between May 1, 2012, and April 30, 2013, across the OCHIN PBRN in 13 states.

RESULTS

Overall, 29% of patients offered an access code logged into their MyChart account. Superusers (minimum of 2 logins per month over a 12-month period) accounted for 6% of users overall. Men, nonwhite patients, Hispanic patients, Spanish-speaking patients, and those with the lowest incomes were significantly less likely to activate. Publicly insured and uninsured patients were also less likely to log in to their MyChart account, but once activated they were more likely than privately insured patients to use MyChart functions.

CONCLUSIONS

Our findings suggest that, compared with others, certain patient groups may be less interested in using patient portals or may have experienced significant barriers that prevented use. Making portal access available is a first step. Additional studies need to specifically identify health system-, clinic-, and patient-level barriers and facilitators to portal adoption and use.

Stakeholder Engagement in a Patient-Reported Outcomes (PRO) Measure Implementation: A Report from the SAFTINet Practice-based Research Network (PBRN)

PURPOSE

Patient-reported outcome (PRO) measures offer value for clinicians and researchers, although priorities and value propositions can conflict. PRO implementation in clinical practice may benefit from stakeholder engagement methods to align research and clinical practice stakeholder perspectives. The objective is to demonstrate the use of stakeholder engagement in PRO implementation.

METHOD

Engaged stakeholders represented researchers and clinical practice representatives from the SAFTINet practice-based research network (PBRN). A stakeholder engagement process involving iterative analysis, deliberation, and decision making guided implementation of a medication adherence PRO measure (the Medication Adherence Survey [MAS]) for patients with hypertension and/or hyperlipidemia.

RESULTS

Over 9 months, 40 of 45 practices (89%) implemented the MAS, collecting 3,247 surveys (mean = 72, median = 30, range: 0 - 416). Facilitators included: an electronic health record (EHR) with readily modifiable templates; existing staff, tools and workflows in which the MAS could be integrated (e.g., health risk appraisals, hypertension-specific visits, care coordinators); and engaged leadership and quality improvement teams.

CONCLUSION

Stakeholder engagement appeared useful for promoting PRO measure implementation in clinical practice, in a way that met the needs of both researchers and clinical practice stakeholders. Limitations of this approach and opportunities for improving the PRO data collection infrastructure in PBRNs are discussed.

Patient Navigators Connecting Patients to Community Resources to Improve Diabetes Outcomes

BACKGROUND

Despite the recognized importance of lifestyle modification in reducing risk of developing type 2 diabetes and in diabetes management, the use of available community resources by both patients and their primary care providers (PCPs) remains low. The patient navigator model, widely used in cancer care, may have the potential to link PCPs and community resources for reduction of risk and control of type 2 diabetes. In this study we tested the feasibility and acceptability of telephone-based nonprofessional patient navigation to promote linkages between the PCP office and community programs for patients with or at risk for diabetes.

METHODS

This was a mixed-methods interventional prospective cohort study conducted between November 2012 and August 2013. We included adult patients with and at risk for type 2 diabetes from six primary care practices. Patient-level measures of glycemic control, diabetes care, and self-efficacy from medical records, and qualitative interview data on acceptability and feasibility, were used.

RESULTS

A total of 179 patients participated in the study. Two patient navigators provided services over the phone, using motivational interviewing techniques. Patient navigators provided regular feedback to PCPs and followed up with the patients through phone calls. The patient navigators made 1028 calls, with an average of 6 calls per patient. At follow-up, reduction in HbA1c (7.8 ± 1.9% vs 7.2 ± 1.3%; P = .001) and improvement in patient self-efficacy (3.1 ± 0.8 vs 3.6 ± 0.7; P < .001) were observed. Qualitative analysis revealed uniformly positive feedback from providers and patients.

CONCLUSIONS

The patient navigator model is a promising and acceptable strategy to link patient, PCP, and community resources for promoting lifestyle modification in people living with or at risk for type 2 diabetes.

Impact of Case Mix Severity on Quality Improvement in a Patient-centered Medical Home (PCMH) in the Maryland Multi-Payor Program

BACKGROUND

We present data on quality of care (QC) improvement in 35 of 45 National Quality Forum metrics reported annually by 52 primary care practices recognized as patient-centered medical homes (PCMHs) that participated in the Maryland Multi-Payor Program from 2011 to 2013.

METHODS

We assigned QC metrics to (1) chronic, (2) preventive, and (3) mental health care domains. The study used a panel data design with no control group. Using longitudinal fixed-effects regressions, we modeled QC and case mix severity in a PCMH.

RESULTS

Overall, 35 of 45 quality metrics reported by 52 PCMHs demonstrated improvement over 3 years, and case mix severity did not affect the achievement of quality improvement. From 2011 to 2012, QC increased by 0.14 (P < .01) for chronic, 0.15 (P < .01) for preventive, and 0.34 (P < .01) for mental health care domains; from 2012 to 2013 these domains increased by 0.03 (P = .06), 0.04 (P = .05), and 0.07 (P = .12), respectively. In univariate analyses, lower National Commission on Quality Assurance PCMH level was associated with higher QC for the mental health care domain, whereas case mix severity did not correlate with QC. In multivariate analyses, higher QC correlated with larger practices, greater proportion of older patients, and readmission visits. Rural practices had higher proportions of Medicaid patients, lower QC, and higher QC improvement in interaction analyses with time.

CONCLUSIONS

The gains in QC in the chronic disease domain, the preventive care domain, and, most significantly, the mental health care domain were observed over time regardless of patient case mix severity. QC improvement was generally not modified by practice characteristics, except for rurality.

Radon Testing: Community Engagement By a Rural Family Medicine Office

OBJECTIVE

Iowa has the highest average radon concentrations in the nation, with an estimated 400 radon-induced lung cancer deaths each year. Radon is the second leading cause of lung cancer death overall. The objectives of this study were (1) to educate the population attending a family medicine office about the dangers of radon, (2) to encourage homeowners to test for radon, (3) to work with the community to identify resources for mitigation, and (4) to assess the utility of working with a local family medicine office as a model that could be adopted for other communities with high home radon concentrations.

METHODS

Participants obtained a US Environmental Protection Agency-certified activated charcoal short-term radon kit through their primary care office or by attending a seminar held by their medical office. Participants completed a short investigator-developed questionnaire about their home, heating, and demographics.

RESULTS

Of 746 radon kits handed out, 378 valid results (51%) were received, of which 351 questionnaires could be matched to the kit results. The mean radon result was 10.0 pCi/L (standard deviation, 8.5 pCi/L). A radon result of 4 pCi/L or higher, the Environmental Protection Agency action level for mitigation, was found in 81% of homes (n = 285).

CONCLUSIONS

Four of 5 homes tested had elevated radon levels. This family medicine office/university collaborative educational model could be useful for educating patients about other environmental dangers.

Lessons from Initiating the First Veterans Health Administration (VA) Women's Health Practice-based Research Network (WH-PBRN) Study

BACKGROUND

The Veterans Health Administration (VA) Women's Health Practice-Based Research Network (WH-PBRN) was created to foster innovations for the health care of women veterans. The inaugural study by the WH-PBRN was designed to identify women veterans' own priorities and preferences for mental health services and to inform refinements to WH-PBRN operational procedures. Addressing the latter, this article reports lessons learned from the inaugural study.

METHODS

WH-PBRN site coordinators at the 4 participating sites convened weekly with the study coordinator and the WH-PBRN program manager to address logistical issues and identify lessons learned. Findings were categorized into a matrix of challenges and facilitators related to key study elements.

RESULTS

Challenges to the conduct of PBRN-based research included tracking of regulatory documents; cross-site variability in some regulatory processes; and troubleshooting logistics of clinic-based recruitment. Facilitators included a central institutional review board, strong relationships between WH-PBRN research teams and women's health clinic teams, and the perception that women want to help other women veterans.

CONCLUSION

Our experience with the inaugural WH-PBRN study demonstrated the feasibility of establishing productive relationships between local clinicians and researchers, and of recruiting a special population (women veterans) in diverse sites within an integrated health care system. This identified strengths of a PBRN approach.

Establishment of a Representative Practice-based Research Network (PBRN) for the Monitoring of Primary Care in Switzerland

Data are urgently needed to better understand processes of care in Swiss primary care (PC). A total of 2027 PC physicians, stratified by canton, were invited to participate in the Swiss Primary care Active Monitoring network, of whom 200 accepted to join. There were no significant differences between participants and a random sample drawn from the same physician databases based on sex, year of obtaining medical school diploma, or location. The Swiss Primary care Active Monitoring network represents the first large-scale, nationally representative practice-based research network in Switzerland and will provide a unique opportunity to better understand the functioning of Swiss PC.

Understanding Care Integration from the Ground Up: Five Organizing Constructs that Shape Integrated Practices

PURPOSE

To provide empirical evidence on key organizing constructs shaping practical, real-world integration of behavior health and primary care to comprehensively address patients' medical, emotional, and behavioral health needs.

METHODS

In a comparative case study using an immersion-crystallization approach, a multidisciplinary team analyzed data from observations of practice operations, interviews, and surveys of practice members, and implementation diaries. Practices were drawn from 2 studies of practices attempting to integrate behavioral health and primary care: Advancing Care Together, a demonstration project of 11 practices located in Colorado, and the Integration Workforce Study, a study of 8 practices across the United States.

RESULTS

We identified 5 key organizing constructs influencing integration of primary care and behavioral health: 1) Integration REACH (the extent to which the integration program was delivered to the identified target population), 2) establishment of continuum of care pathways addressing the location of care across the range of patient's severity of illness, 3) approach to patient transitions: referrals or warm handoffs, 4) location of the integration workforce, and 5) participants' mental model for integration. These constructs intertwine within an organization's historic and social context to produce locally adapted approaches to integrating care. Contextual factors, particularly practice type, influenced whether specialty mental health and substance use services were colocated within an organization.

CONCLUSION

Interaction among 5 organizing constructs and practice context produces diverse expressions of integrated care. These constructs provide a framework for understanding how primary care and behavioral health services can be integrated in routine practice.

Practice-based Research Networks (PBRNs) in the Era of Integrated Delivery Systems

Practice-based research networks (PBRNs) have been in existence for several decades, and they provide one mechanism to conduct research outside of academic research centers. Two transformative changes to the practice environment pose significant challenges to the manner in which PBRNs have functioned in the past and require changes to their current activities. The widespread introduction of electronic health records and the organization of practices into often hospital-dominated integrated delivery systems change the manner in which medicine is practiced, administered, and financed. Research funders are committed to extending research into communities, although we have yet to learn how to conduct these activities efficiently. We describe a number of operational challenges to this transformation, and we also propose ways to address these challenges and improve the quality and efficiency through which research is conducted. PBRNs can ensure their relevance in the research environment by adapting to this new era.

Success in the Achieving CARdiovascular Excellence in Colorado (A CARE) Home Blood Pressure Monitoring Program: A Report from the Shared Networks of Colorado Ambulatory Practices and Partners (SNOCAP)

BACKGROUND

Blood pressure (BP) control among primary care patients with hypertension is suboptimal. Home BP monitoring (HBPM) has been shown to be effective but is underused.

METHODS

This study was a quasi-experimental evaluation of the impact of the A CARE HBPM program on hypertension control. Nonpregnant adults with hypertension or cardiovascular disease risk factors were given validated home BP monitors and reported monthly average home BP readings by Internet or phone. Patients and providers received feedback. Change in average home and office BP and the percentage of patients achieving target BP were assessed based on patient HBPM reports and a chart audit of office BPs.

RESULTS

A total of 3578 patients were enrolled at 26 urban and rural primary care practices. Of these, 36% of participants submitted ≥2 HBPM reports. These active participants submitted a mean of 13.5 average HBPM reports, with a mean of 19.3 BP readings per report. The mean difference in home BP between initial and final HBPM reports for active participants was -6.5/-4.4 mmHg (P < .001) and -6.7/-4.7 mmHg (P < .001) for those with diabetes. The percentage of active participants at or below target BP increased from 34.5% to 53.3% (P < .001) and increased 24.6% to 40.0% (P < .001) for those with diabetes. The mean difference in office BP over 1 year between participants and nonparticipants was -5.4/-2.7 mmHg (P < .001 for systolic BP, P = .01 for diastolic BP) for all participants and -8.5/-1.5 mmHg (P = .014 for systolic BP, P = .405 for diastolic BP) for those with diabetes.

CONCLUSIONS

An HBPM program with patient and provider feedback can be successfully implemented in a range of primary care practices and can play a significant role in BP control and decreased cardiovascular disease risk in patients with hypertension.

Clinician and Staff Perspectives on Participating in Practice-based Research (PBR): A Report from the Wisconsin Research and Education Network (WREN)

BACKGROUND

The success of practice-based research (PBR) depends on the willingness of clinicians and staff to incorporate meaningful and useful research protocols into already demanding clinic schedules. The impact of participation on those who implement multiple projects and how to address the issues that arise during this complex process remain incompletely described. This article reports a qualitative evaluation of the experiences of primary care clinicians and clinic staff who participated in multiple PBR projects with the Wisconsin Research and Education Network (WREN). Also included are their suggestions to researchers and clinicians for future collaborations.

METHODS

For program evaluation purposes, WREN conducted 4 focus groups at its 2014 annual meeting. The main focus group question was, "How has participation in PBR affected you and your clinic?" A total of 27 project members from 13 clinics participated in 4 groups (physicians, nurses, managers, and other clinical staff). The 2-hour sessions were recorded, transcribed, and analyzed to identify recurring themes.

RESULTS

Five major focus group themes emerged: receptivity to research, outcomes as a result of participation, barriers to implementation, facilitators of success, and advice to researchers and colleagues. Focus group members find research valuable and enjoy participating in projects that are relevant to their practice, even though many barriers exist. They indicated that research participation produces clinical changes that they believe result in improved patient care. They offered ways to improve the research process, with particular emphasis on collaborative early planning, project development, and communication before, during, and after a project.

CONCLUSIONS

Clinics that participate in WREN projects remain willing to risk potential work constraints because of immediate or impending benefits to their clinical practice and/or patient population. Including a broader array of clinic personnel in the communication processes, especially in the development of relevant research ideas and planning for clinic implementation and ongoing participation in research projects, would address many of the barriers identified in implementing PBR. The themes and supporting quotes identified in this evaluation of WREN projects may inform researchers planning to collaborate with primary care clinics and clinicians and staff considering participating in research endeavors.

Pragmatic Cluster Randomized Trials Using Covariate Constrained Randomization: A Method for Practice-based Research Networks (PBRNs)

BACKGROUND

Cluster randomized trials (CRTs) are useful in practice-based research network translational research. However, simple or stratified randomization often yields study groups that differ on key baseline variables when the number of clusters is small. Unbalanced study arms constitute a potentially serious methodological problem for CRTs.

METHODS

Covariate constrained randomization with data on relevant variables before randomization was used to achieve balanced study arms in 2 pragmatic CRTs. In study 1, 16 counties in Colorado were randomized to practice-based or population-based reminder recall for vaccinating children ages 19 to 35 months. In study 2, 18 primary care practices were randomized to computer decision support plus practice facilitation versus computer decision support alone to improve care for patients with stage 3 and 4 chronic kidney disease. For each study, a set of optimal randomizations, which minimized differences of key variables between study arms, was identified from the set of all possible randomizations.

RESULTS

Differences between study arms were smaller in the optimal versus remaining randomizations. Even for the randomization in the optimal set with the largest difference between groups, study arms did not differ significantly on any variable for either study (P > .05).

CONCLUSIONS

Covariate constrained randomization, which restricts the full randomization set to a subset in which differences between study arms are minimized, is a useful tool for achieving balanced study arms in CRTs. Because of the increasing recognition of the risk of imbalance in CRTs and implications for interpreting study findings, procedures of this type should be considered in designing practice-based or community-based trials.

Launching a Laboratory Testing Process Quality Improvement Toolkit: From the Shared Networks of Colorado Ambulatory Practices and Partners (SNOCAP)

INTRODUCTION

Family medicine and internal medicine physicians order diagnostic laboratory tests for nearly one-third of patient encounters in an average week, yet among medical errors in primary care, an estimated 15% to 54% are attributed to laboratory testing processes. From a practice improvement perspective, we (1) describe the need for laboratory testing process quality improvements from the perspective of primary care practices, and (2) describe the approaches and resources needed to implement laboratory testing process quality improvements in practice.

METHODS

We applied practice observations, process mapping, and interviews with primary care practices in the Shared Networks of Colorado Ambulatory Practices and Partners (SNOCAP)-affiliated practice-based research networks that field-tested in 2013 a laboratory testing process improvement toolkit.

RESULTS

From the data collected in each of the 22 participating practices, common testing quality issues included, but were not limited to, 3 main testing process steps: laboratory test preparation, test tracking, and patient notification. Three overarching qualitative themes emerged: practices readily acknowledge multiple laboratory testing process problems; practices know that they need help addressing the issues; and practices face challenges with finding patient-centered solutions compatible with practice priorities and available resources.

CONCLUSION

While practices were able to get started with guidance and a toolkit to improve laboratory testing processes, most did not seem able to achieve their quality improvement aims unassisted. Providing specific guidance tools with practice facilitation or other rapid-cycle quality improvement support may be an effective approach to improve common laboratory testing issues in primary care.

Practice-based innovations: More relevant and transportable than NIH-funded studies

In 2003, the National Institutes of Health (NIH) created a translational science funding stream to foster widespread, practice-based dissemination of scientific evidence. A decade later, our study of a national cohort of innovative practices suggests that effective dissemination continues to be prevented by the limited biomedical focus of funded research, conventional research strategies, and failure to report contextual factors.

Community-engagement strategies of the developmental disabilities practice-based research network (DD-PBRN)

There is often a rich but untold history of events that occur and relationships that form before a practice-based research network (PBRN) is launched. This is particularly the case in PBRNs that are community based and comprise partnerships outside of the health care system. In this article we summarize an organizational "prenatal history" before the birth of a PBRN devoted to people with developmental disabilities. Using a case study approach, this article describes the historic events that preceded and fostered the evolution of this PBRN and contrasts how the processes leading to the creation of this multistakeholder, community-based PBRN differ from those of typical academic/clinical practice PBRNs. We propose potential advantages and complexities inherent to this newest iteration of PBRNs.

Use of mobile health (mHealth) tools by primary care patients in the WWAMI region Practice and Research Network (WPRN)

PURPOSE

The purpose of this study was to determine the prevalence of mobile health (mHealth) use among primary care patients and examine demographic and clinical correlates.

METHODS

Adult patients who presented to 1 of 6 primary care clinics in a practice-based research network in the northwest United States during a 2-week period received a survey that assessed smartphone ownership; mHealth use; sociodemographic characteristics (age, sex, race/ethnicity, health literacy); chronic conditions; and depressive symptoms (2-item Patient Health Questionnaire). Data analysis used descriptive statistics and mixed logistic regression.

RESULTS

Of 918 respondents (estimated response rate, 67.4%), 55% owned a smartphone, among whom 70% were mHealth users. In multivariate analyses, smartphone ownership and mHealth use were not associated with health literacy, chronic conditions, or depression but were less common among adults >45 years old (adjusted odds ratio, 0.07-0.39; P < .001). Only 10% of patients learned about mHealth tools from their physician, and few (31%) prioritized their provider's involvement.

CONCLUSIONS

Use of mHealth technologies is lower among older adults but otherwise is common among primary care patients, including those with limited health literacy and those with chronic conditions. Findings support the potential role of mHealth in improving disease management among certain groups in need; however, greater involvement of health care providers may be important for realizing this potential.

A systematic process for recruiting physician-patient dyads in practice-based research networks (PBRNs)

BACKGROUND

Recruiting physicians and patients for primary care research is difficult, and low participation can greatly affect the validity of research. While practice-based research networks (PBRNs) offer advantages of scale for recruitment, the barriers are perennial. We designed a systematic process for recruiting physician-patient dyads in PBRNs and tested it in EXACKTE2, a large, cross-sectional, dyadic study.

METHODS

Based on known barriers, we designed a systematic process for recruiting dyads of family physicians and their patients and implemented it in 2 primary care practice-based research networks in Canada: one in Ontario (11 practices) and one in Quebec (6 practices). Dyads (one physician with one patient) were recruited simultaneously to explore their mutual influence during consultations. A key element of the process was a research assistant assigned to each practice. This person closely accompanied the recruitment process, liaising with staff and taking charge of interviews, questionnaires, and follow-up.

RESULTS

In total, 276 physicians and patients were recruited in 17 primary care practices in 2 primary care networks in Ontario and Quebec, representing a participation rate of more than 72% of eligible physicians and more than 64% of eligible patients.

CONCLUSION

We established a systematic process to conduct successful dyadic recruitment of physicians and patients in PBRNs.

Guidance for researchers developing and conducting clinical trials in practice-based research networks (PBRNs)

BACKGROUND

There is increased interest nationally in multicenter clinical trials to answer questions about clinical effectiveness, comparative effectiveness, and safety in real-world community settings. Primary care practice-based research networks (PBRNs), comprising community- and/or academically affiliated practices committed to improving medical care for a range of health problems, offer ideal settings for these trials, especially pragmatic clinical trials. However, many researchers are not familiar with working with PBRNs.

METHODS

Experts in practice-based research identified solutions to challenges that researchers and PBRN personnel experience when collaborating on clinical trials in PBRNs. These were organized as frequently asked questions in a draft document presented at a 2013 Agency for Health care Research and Quality PBRN conference workshop, revised based on participant feedback, then shared with additional experts from the DARTNet Institute, Clinical Translational Science Award PBRN, and North American Primary Care Research Group PBRN workgroups for further input and modification.

RESULTS

The "Toolkit for Developing and Conducting Multi-site Clinical Trials in Practice-Based Research Networks" offers guidance in the areas of recruiting and engaging practices, budgeting, project management, and communication, as well as templates and examples of tools important in developing and conducting clinical trials.

CONCLUSION

Ensuring the successful development and conduct of clinical trials in PBRNs requires a highly collaborative approach between academic research and PBRN teams.

Using the Pragmatic-Explanatory Continuum Indicator Summary (PRECIS) model in clinical research: Application to refine a practice-based research network (PBRN) study

BACKGROUND

Pragmatic clinical trials (PCTs) are increasingly recommended to evaluate interventions in real-world conditions. Although PCTs share a common approach of evaluating variables from actual clinical practice, multiple characteristics can differ. These differences affect interpretation of the trial. The Pragmatic-Explanatory Continuum Indicator Summary (PRECIS) model was developed in 2009 by the CONSORT Work Group on Pragmatic Trials, published by Thorpe et al, to aid in trial design. PRECIS provides clarity about the generalizability and applicability of a trial by depicting multiple study characteristics. We recently completed a National Institutes of Health-sponsored pilot study examining health-related outcomes for 2 complementary therapies for chronic low back pain in patients referred by primary care providers in the Kentucky Ambulatory Network. In preparation for a larger study, we sought to characterize the pragmatic features of the study to aid in our design decisions. The purpose of this article is to introduce clinical researchers to the PRECIS model while demonstrating its application to refine a practice based research network study.

METHOD

We designed an exercise using an audience response system integrated with a Works in Progress presentation to experienced researchers at the University of Kentucky to examine our study methodologies of parameters suggested by the PRECIS model.

RESULTS

The exercise went smoothly and participants remained engaged throughout. The study received an overall summary score of 30.17 (scale of 0 to 48; a higher score indicates a more pragmatic approach), with component scores that differentiate design components of the study. A polar chart is presented to depict the pragmatism of the overall study methodology across each of these components.

CONCLUSIONS

The study was not as pragmatic as expected. The exercise results seem to be useful in identifying necessary refinements to the study methodology that may benefit future study design and increase generalizability. Readers can identify how the PRECIS model may be used to provide clarity and transparency for proposed or existing studies and may wish to replicate our exercise in planning their own studies.

Laboratory medicine handoff gaps experienced by primary care practices: A report from the shared networks of collaborative ambulatory practices and partners (SNOCAP)

BACKGROUND

The majority of errors in laboratory medicine testing are thought to occur in the pre- and postanalytic testing phases, and a large proportion of these errors are secondary to failed handoffs. Because most laboratory tests originate in ambulatory primary care, understanding the gaps in handoff processes within and between laboratories and practices is imperative for patient safety. Therefore, the purpose of this study was to understand, based on information from primary care practice personnel, the perceived gaps in laboratory processes as a precursor to initiating process improvement activities.

DESIGN

A survey was used to assess perceptions of clinicians, staff, and management personnel of gaps in handoffs between primary care practices and laboratories working in 21 Colorado primary care practices. Data were analyzed to determine statistically significant associations between categorical variables. In addition, qualitative analysis of responses to open-ended survey questions was conducted.

RESULTS

Primary care practices consistently reported challenges and a desire/need to improve their efforts to systematically track laboratory test status, confirm receipt of laboratory results, and report results to patients. Automated tracking systems existed in roughly 61% of practices, and all but one of those had electronic health record-based tracking systems in place. One fourth of these electronic health record-enabled practices expressed sufficient mistrust in these systems to warrant the concurrent operation of an article-based tracking system as backup. Practices also reported 12 different procedures used to notify patients of test results, varying by test result type.

CONCLUSION

The results highlight the lack of standardization and definition of roles in handoffs in primary care laboratory practices for test ordering, monitoring, and receiving and reporting test results. Results also identify high-priority gaps in processes and the perceptions by practice personnel that practice improvement in these areas is needed. Commonalities in these areas warrant the development and support of tools for use in primary care settings.

Practice-based research networks (PBRNs) are promising laboratories for conducting dissemination and implementation research

Dissemination and implementation science addresses the application of research findings in varied health care settings. Despite the potential benefit of dissemination and implementation work to primary care, ideal laboratories for this science have been elusive. Practice-based research networks (PBRNs) have a long history of conducting research in community clinical settings, demonstrating an approach that could be used to execute multiple research projects over time in broad and varied settings. PBRNs also are uniquely structured and increasingly involved in pragmatic trials, a research design central to dissemination and implementation science. We argue that PBRNs and dissemination and implementation scientists are ideally suited to work together and that the collaboration of these 2 groups will yield great value for the future of primary care and the delivery of evidence-based health care.

Achieving meaningful use of electronic health records (EHRs) in primary care: Proposed critical processes from the Kentucky Ambulatory Network (KAN)

OBJECTIVE

The Kentucky Ambulatory Network, a practice-based research network, conducted this study to propose critical processes for electronic health record (EHR) implementation.

METHODS

Periodic observation of the implementation process and assessment of meaningful use (MU) metrics within 10 small primary care practices working with a regional extension center.

RESULTS

Through focus groups and structured interviews, the strategies, processes, and procedures used by these practices to achieve MU of EHRs were determined. Implementation themes related to and critical processes associated with EHR adoption were proposed.

CONCLUSIONS

Five proposed critical processes for EHR adoption and achievement of MU were identified; these processes were supported by 70% (7 of 10) of the study practices meeting MU criteria.

Underinsurance before the implementation of the Affordable Care Act: From the Research Involving Outpatient Settings Network (RIOS Net)

BACKGROUND

As the Affordable Care Act (ACA) is implemented and many uninsured become insured, rates of underinsurance may persist or increase. This study was designed to estimate the rate of underinsurance in primary care safety net clinics serving low income, multiethnic populations in New Mexico.

METHODS

Data were collected from 2 primary care clinics in an urban setting during a 2-week period in 2011 and 2012. Voluntary, anonymous, self-administered surveys were distributed to adult patients waiting to be seen by their doctor. Surveys were available in English and Spanish.

RESULTS

Of those insured, 44% were underinsured. The underinsured comprised higher proportions of patients who were Hispanic, young, and poor; 39% reported fair or poor health, 23% reported that their health suffered from an inability to seek care because of cost, and 53% had either Medicaid or state coverage insurance. Patients with an income of ≤$25,000 were 8 times more likely to be underinsured.

CONCLUSION

A high level of underinsurance was found in these safety net clinics. Because millions of Americans gain health care insurance benefits, monitoring whether the current reform provides adequate health care coverage or whether those with new and existing health care insurance are underinsured is critical.

Use of community engagement strategies to increase research participation in practice-based research networks (PBRNs)

PURPOSE

Practice-based research networks (PBRNs) are increasingly encouraged to use community engagement approaches. The extent to which PBRNs engage clinic and community partners in strategies to recruit and retain participants from their local communities (specifically racial/ethnic communities) is the focus of this study.

METHODS

The design was a cross-sectional survey of PBRN directors in the United States. Survey respondents indicated whether their research network planned for, implemented, and has capacity for activities that engage clinic and community partners in 7 recommended strategies organized into study phases, called the cycle of trust. The objectives of the national survey were to (1) describe the extent to which PBRNs across the United States routinely implement the strategies recommended for recruiting diverse patient groups and (2) identify factors associated with implementing the recommended strategies.

RESULTS

The survey response rate was 63%. Activities that build trust often are used more with clinic partners than with community partners. PBRNs that adopt engagement strategies when working with clinic and community partners have less difficulty in recruiting diverse populations. Multivariate analysis showed that the targeting racial/ethnic communities for study recruitment, Clinical and Translational Science Award affiliation, and planning to use community engagement strategies were independent correlates of PBRN implementation of the recommended strategies.

CONCLUSION

PBRNs that successfully engage racial/ethnic communities as research partners use community engagement strategies. New commitments are needed to support PBRN researchers in developing relationships with the communities in which their patients live. Stable PBRN infrastructure funding that appreciates the value of maintaining community engagement between funded studies is critical to the research enterprise that values translating research findings into generalizable care models for patients in the community.

Using geographic information systems (GIS) to identify communities in need of health insurance outreach: An OCHIN practice-based research network (PBRN) report

BACKGROUND

Our practice-based research network (PBRN) is conducting an outreach intervention to increase health insurance coverage for patients seen in the network. To assist with outreach site selection, we sought an understandable way to use electronic health record (EHR) data to locate uninsured patients.

METHODS

Health insurance information was displayed within a web-based mapping platform to demonstrate the feasibility of using geographic information systems (GIS) to visualize EHR data. This study used EHR data from 52 clinics in the OCHIN PBRN. We included cross-sectional coverage data for patients aged 0 to 64 years with at least 1 visit to a study clinic during 2011 (n = 228,284).

RESULTS

Our PBRN was successful in using GIS to identify intervention sites. Through use of the maps, we found geographic variation in insurance rates of patients seeking care in OCHIN PBRN clinics. Insurance rates also varied by age: The percentage of adults without insurance ranged from 13.2% to 86.8%; rates of children lacking insurance ranged from 1.1% to 71.7%. GIS also showed some areas of households with median incomes that had low insurance rates.

DISCUSSION

EHR data can be imported into a web-based GIS mapping tool to visualize patient information. Using EHR data, we were able to observe smaller areas than could be seen using only publicly available data. Using this information, we identified appropriate OCHIN PBRN clinics for dissemination of an EHR-based insurance outreach intervention. GIS could also be used by clinics to visualize other patient-level characteristics to target clinic outreach efforts or interventions.

Depression screening and treatment in uninsured urban patients

BACKGROUND

Depression has been widely studied in primary care settings, yet studies of medically uninsured populations are lacking. We sought to determine whether depression screening and treatment improved depression scores of a medically uninsured, mostly African American primary care population.

METHODS

The study was a prospective repeated-measures design that recruited uninsured patients. Patients were screened for depression, and the rate of depression diagnosis was compared with baseline. Patients who were diagnosed and accepted treatment were randomized to 1 of 4 treatment arms: (1) usual care; (2) usual care and psychotherapy; (3) usual care and education and psychotherapy; and (4) usual care and education. Patients were then reevaluated at 8, 12, and 24 weeks.

RESULTS

A total of 674 patients participated. Depression prevalence was significantly higher among those screened (38%) than at baseline (16%). All treatment groups showed a significant reduction in depression scores over a 6-month period, from a mean score of 15 at baseline to 8.3 at 24 weeks (P < .005). All treatment interventions were equally effective.

CONCLUSION

Screening improves the rate of diagnosis of depression in an uninsured, primarily African American population, and subsequent treatment significantly reduces the burden of depression.

National Committee for Quality Assurance (NCQA) patient-centered medical home (PCMH) recognition is suboptimal even among innovative primary care practices

The National Committee for Quality Assurance (NCQA) has promoted patient-centered medical home (PCMH) recognition among primary care practices since 2008 as a standard indicator of which practices have transformed into medical homes. A 40% PCMH adoption rate among a large national cohort of identified practices with innovative staffing (n = 131) calls into question whether the NCQA recognition process is truly transformative and patient-centered or simply another certificate to hang on the wall.

A randomized controlled trial of two interventions to improve medication reconciliation

OBJECTIVE

Medication errors can be caused by lack of agreement between what physicians believe patients are taking and what patients actually take. There has been little systematic research to find the best way to reconcile medication lists in primary care. The objective of this study was to assess the impact of 2 interventions on agreement between electronic medical record medication lists and what patients report actually taking.

METHODS

This study was a factorial randomized trial that randomized 440 eligible patients (English-speaking, age 18 and older, taking at least 2 prescriptions) visiting 20 primary care physicians; 367 completed the study. Interventions included (1) providing patients a printed copy of their current medication list at check-in and (2) beginning the medication review with an open-ended question. Patients were randomized to receive no intervention, one or the other intervention, or both interventions. The outcome measure was agreement on all prescription and nonprescription medications, vitamins, and supplements between the list from the electronic medical record after the visit and a list based on patient report generated during a phone interview within a week of the office visit.

RESULTS

Agreement rates between medication lists and patient report for the 4 study groups were: 67.4% in the no intervention group, 66.7% in the printed list only group, 58.1% in the open-ended question only group, and 75.6% in the combined intervention group. Both a printed list and beginning a medication discussion with an open-ended question were required before any significant increase in agreement was observed.

CONCLUSIONS

While neither intervention alone improved medication list agreement, these interventions may have value in a multistep protocol to improve the agreement of medication lists in primary care offices. Baseline agreement was much higher than expected, possibly reflecting a Hawthorne effect.

Hand hygiene and face touching in family medicine offices: a Cincinnati Area Research and Improvement Group (CARInG) network study

BACKGROUND

Family medicine offices may play an important role in the transmission of common illnesses such as upper respiratory tract infections (URTIs). There has, however, been little study of whether physicians teach patients about URTI transmission and what their own actions are to prevent infection. The purpose of this study was to assess the quality of hand hygiene and the frequency with which family physicians and staff touch their eyes, nose, and mouth (the T-zone) as well as physician and staff self-reported behaviors and recommendations given to patients regarding URTI prevention.

METHODS

We observed family physicians and staff at 7 offices of the Cincinnati Area Research and Improvement Group (CARInG) practice-based research network for the quality of hand hygiene and number of T-zone touches. After observations, participants completed surveys about personal habits and recommendations given to patients to prevent URTIs.

RESULTS

A total of 31 clinicians and 48 staff participated. They touched their T-zones a mean of 19 times in 2 hours (range, 0-105 times); clinicians did so significantly less often than staff (P < .001). We observed 123 episodes of hand washing and 288 uses of alcohol-based cleanser. Only 11 hand washings (9%) met Centers for Disease Control and Prevention criteria for effective hand washing. Alcohol cleansers were used more appropriately, with 243 (84%) meeting ideal use. Participants who were observed using better hand hygiene and who touched their T-zone less report the same personal habits and recommendations to patients as those with poorer URTI prevention hygiene.

CONCLUSIONS

Clinicians and staff in family medicine offices frequently touch their T-zone and demonstrate mixed quality of hand cleansing. Participants' self-rated URTI prevention behaviors were not associated with how well they actually perform hand hygiene and how often they touch their T-zone. The relationship between self-reported and observed behaviors and URTIs in family medicine office settings needs further study.