Health care providers' perceptions of use and influence of clinical decision support reminders: qualitative study following a randomized trial to improve HPV vaccination rates

Clinician Prompts for Human Papillomavirus Vaccination: A Cluster Randomized Trial

OBJECTIVE

We assessed the impact of an online intervention using clinician prompts for human papillomavirus (HPV) vaccination with a cluster randomized controlled trial.

METHODS

The randomized trial occurred July 2021-January 2022 in 48 primary care pediatric practices (24 intervention, 24 control) across the US. We trained clinicians via two online learning modules, plus weekly ''quick tips'' delivered via text or email. The training taught practices to implement a staff prompt to the clinician (e.g., printed reminders placed on the keyboard) plus electronic health record (EHR) prompts (if not already done) at well and acute/chronic visits for initial and subsequent HPV vaccination. We assessed missed opportunities for HPV vaccination using logistic regression models accounting for clustering by practice on an intent to treat basis. Surveys assessed facilitators and barriers to using prompts.

RESULTS

During the 6-month intervention, missed opportunities for HPV vaccination increased (worsened) in both intervention and control groups. However, at well child care visits, missed opportunities for the initial HPV vaccine increased by 4.5 (95% CI: -9.0%, -0.1%) percentage points less in intervention versus control practices. Change in missed opportunities for subsequent doses at well child care and non-well child care visits did not differ between trial groups. An end-of trial survey found understaffing as a common challenge.

CONCLUSIONS

Clinician prompts reduced missed opportunities for HPV vaccination at well child care visits. Understaffing related to the COVID-19 pandemic may have led to worsening missed opportunities for both groups and likely impeded practices in fully implementing changes.

County-Level Factors Associated With Influenza and COVID-19 Vaccination in Indiana, 2020‒2022

Objectives. To assess COVID-19 and influenza vaccination rates across Indiana's 92 counties and identify county-level factors associated with vaccination. Methods. We analyzed county-level data on adult COVID-19 vaccination from the Indiana vaccine registry and 2021 adult influenza vaccination from the Centers for Disease Control and Prevention. We used multiple linear regression (MLR) to determine county-level predictors of vaccinations. Results. COVID-19 vaccination ranged from 31.2% to 87.6% (mean = 58.0%); influenza vaccination ranged from 33.7% to 53.1% (mean = 42.9%). In MLR, COVID-19 vaccination was significantly associated with primary care providers per capita (b = 0.04; 95% confidence interval [CI] = 0.02, 0.05), median household income (b = 0.23; 95% CI = 0.12, 0.34), percentage Medicare enrollees with a mammogram (b = 0.29; 95% CI = 0.08, 0.51), percentage uninsured (b = -1.22; 95% CI = -1.57, -0.87), percentage African American (b = 0.31; 95% CI = 0.19, 0.42), percentage female (b = -0.97; 95% CI = -1.79, ‒0.15), and percentage who smoke (b = -0.75; 95% CI = -1.26, -0.23). Influenza vaccination was significantly associated with percentage uninsured (b = 0.71; 95% CI = 0.22, 1.21), percentage African American (b = -0.07; 95% CI = -0.13, -0.01), percentage Hispanic (b = -0.28; 95% CI = -0.40, -0.17), percentage who smoke (b = -0.85; 95% CI = -1.06, -0.64), and percentage who completed high school (b = 0.54; 95% CI = 0.21, 0.87). The MLR models explained 86.7% (COVID-19) and 70.2% (influenza) of the variance. Conclusions. Factors associated with COVID-19 and influenza vaccinations varied. Variables reflecting access to care (e.g., insurance) and higher risk of severe disease (e.g., smoking) are notable. Programs to improve access and target high-risk populations may improve vaccination rates. (Am J Public Health. 2024;114(4):415-423. https://doi.org/10.2105/AJPH.2023.307553).

Adaptation and Formative Evaluation of Online Decision Support to Implement Evidence-Based Strategies to Increase HPV Vaccination Rates in Pediatric Clinics

Human papilloma virus (HPV) vaccination rates remain below national goals in the United States despite the availability of evidence-based strategies to increase rates. The Adolescent Vaccination Program (AVP) is a multi-component intervention demonstrated to increase HPV vaccination rates in pediatric clinics through the implementation of six evidence-based strategies. The purpose of this study, conducted in Houston, Texas, from 2019-2021, was to adapt the AVP into an online decision support implementation tool for standalone use and to evaluate its feasibility for use in community clinics. Phase 1 (Adaptation) comprised clinic interviews (n = 23), literature review, Adolescent Vaccination Program Implementation Tool (AVP-IT) design documentation, and AVP-IT development. Phase 2 (Evaluation) comprised usability testing with healthcare providers (HCPs) (n = 5) and feasibility testing in community-based clinics (n = 2). AVP-IT decision support provides an Action Plan with tailored guidance on implementing six evidence-based strategies (immunization champions, assessment and feedback, continuing education, provider prompts, parent reminders, and parent education). HCPs rated the AVP-IT as acceptable, credible, easy, helpful, impactful, and appealing (≥80% agreement). They rated AVP-IT supported implementation as easier and more effective compared to usual practice (p ≤ 0.05). The clinic-based AVP-IT uses facilitated strategy implementation by 3-month follow-up. The AVP-IT promises accessible, utilitarian, and scalable decision support on strategies to increase HPV vaccination rates in pediatric clinic settings. Further feasibility and efficacy testing is indicated.

Primary care clinicians' opinions before and after implementation of cancer screening and prevention clinical decision support in a clinic cluster-randomized control trial: a survey research study

BACKGROUND

Electronic health record (EHR)-linked clinical decision support (CDS) may impact primary care clinicians' (PCCs') clinical care opinions. As part of a clinic cluster-randomized control trial (RCT) testing a cancer prevention and screening CDS system with patient and PCC printouts (with or without shared decision-making tools [SDMT]) for patients due for breast, cervical, colorectal, and lung cancer screening and/or human papillomavirus (HPV) vaccination compared to usual care (UC), we surveyed PCCs at study clinics pre- and post-CDS implementation. Our primary aim was to learn if PCCs' opinions changed over time within study arms. Secondary aims including examining whether PCCs' opinions in study arms differed both pre- and post-implementation, and gauging PCCs' opinions on the CDS in the two intervention arms.

METHODS

This study was conducted within a healthcare system serving an upper Midwestern population. We administered pre-implementation (11/2/2017-1/24/2018) and post-implementation (2/2/2020-4/9/2020) cross-sectional electronic surveys to PCCs practicing within a RCT arm: UC; CDS; or CDS + SDMT. Bivariate analyses compared responses between study arms at both time periods and longitudinally within study arms.

RESULTS

Pre-implementation (53%, n = 166) and post-implementation (57%, n = 172) response rates were similar. No significant differences in PCC responses were seen between study arms on cancer prevention and screening questions pre-implementation, with few significant differences found between study arms post-implementation. However, significantly fewer intervention arm clinic PCCs reported being very comfortable with discussing breast cancer screening options with patients compared to UC post-implementation, as well as compared to the same intervention arms pre-implementation. Other significant differences were noted within arms longitudinally. For intervention arms, these differences related to CDS areas like EHR alerts, risk calculators, and ordering screening. Most intervention arm PCCs noted the CDS provided overdue screening alerts to which they were unaware. Few PCCs reported using the CDS, but most would recommend it to colleagues, expressed high CDS satisfaction rates, and thought patients liked the CDS's information and utility.

CONCLUSIONS

While appreciated by PCCs with high satisfaction rates, the CDS may lower PCCs' confidence regarding discussing patients' breast cancer screening options and may be used irregularly. Future research will evaluate the impact of the CDS on cancer prevention and screening rates.

TRIAL REGISTRATION

clinicaltrials.gov , NCT02986230, December 6, 2016.

Clinical Decision Support Systems

BACKGROUND

By combining up-to-date medical knowledge and steadily increasing patient data, a new level of medical care can emerge.

SUMMARY AND KEY MESSAGES

Clinical decision support systems (CDSSs) are an arising solution to handling rich data and providing them to health care providers in order to improve diagnosis and treatment. However, despite promising examples in many areas, substantial evidence for a thorough benefit of these support solutions is lacking. This may be due to a lack of general frameworks and diverse health systems around the globe. We therefore summarize the current status of CDSSs in medicine but also discuss potential limitations that need to be overcome in order to further foster future development and acceptance.

The appropriateness of clinical decision support systems alerts in supporting clinical workflows: A systematic review

A CDSS generates a high number of inappropriate alerts that interrupt the clinical workflow. As a result, clinicians silence, disable, or ignore alerts, thereby undermining patient safety. Therefore, the effectiveness and appropriateness of CDSS alerts need to be evaluated. A systematic review was carried out to identify the factors that affect CDSS alert appropriateness in supporting clinical workflow. Seven electronic databases (PubMed, Scopus, ACM, Science Direct, IEEE, Ovid Medline, and Ebscohost) were searched for English language articles published between 1997 and 2018. Seventy six papers met the inclusion criteria, of which 26, 24, 15, and 11 papers are retrospective cohort, qualitative, quantitative, and mixed-method studies, respectively. The review highlights various factors influencing the appropriateness and efficiencies of CDSS alerts. These factors are categorized into technology, human, organization, and process aspects using a combination of approaches, including socio-technical framework, five rights of CDSS, and Lean. Most CDSS alerts were not properly designed based on human factor methods and principles, explaining high alert overrides in clinical practices. The identified factors and recommendations from the review may offer valuable insights into how CDSS alerts can be designed appropriately to support clinical workflow.

Instant Gratification as a Method to Promote Physician Practice Guideline Adherence: A Systematic Review

Inadequate adherence to best practice guidelines may have a negative impact on the processes of critical care and patient outcomes. Instant gratification has been used to modify human behavior in industries such as gaming, lottery, and social media. We hypothesize that, if properly and purposefully utilized, IG can become a successful tool for encouraging best practice guideline adherence among critical care providers. Four major databases were searched with a medial librarian. Covidence application was used to identify studies pertaining to the instant gratification being used to improve provider adherence with best practice guidelines. A total of 712 studies were identified, and, through duplicates removal, title and abstract screening, and full-text screening, a total of 13 studies were included in the final review. The exclusion criteria used included the following: no provider gratification, wrong focus/intervention, wrong study design, patient-focused intervention, not generalizable, and no conclusion. There is a knowledge gap regarding instant gratification utilization to influence practice guideline adherence among providers. The intervention functions of the Behavior Change Wheel (BCW) were evident, especially 'persuasion' and 'incentivization', which are most pertinent to our field. The restorative process that promotes positive reinforcement can be a potential solution for alleviating inadequacies in guideline adherence. Examining interventions based on functions of the BCW has shown that an instant gratification process may have the potential in altering critical care providers' behavior and improving guideline adherence. This review is the first step towards creating smart algorithms to instantly alert providers for their actions compliant with best practices. Developing, testing, and validating the algorithms will be the next several steps.

Understanding the use of digital technology to promote human papillomavirus vaccination - A RE-AIM framework approach

The human papillomavirus virus (HPV) vaccine is effective at preventing various cancers, but coverage falls short of targets that are needed for community protection. Here, we use the RE-AIM implementation framework (Reach, Effectiveness, Adoption, Implementation, Maintenance) to understand how text, email, and electronic health record (EHR) reminders and social media campaigns can be used as part of policy and practice interventions to increase HPV vaccination. These technology-based interventions could be used together and mainstreamed into clinical and system-based practice to have the greatest impact. Of the interventions explored, text-based, email-based, and EHR reminders have the most evidence behind them to support their effectiveness. While there are several studies of promotion of the HPV vaccine on social media, more studies are needed to demonstrate their effects and better methods are needed to be able to attribute results to these interventions.

Physician clinical decision support system prompts and administration of subsequent doses of HPV vaccine: A randomized clinical trial

BACKGROUND

HPV vaccine is effective in preventing several cancers and anogenital warts, yet rates of HPV vaccination series completion in the United States are low. A primary reason identified by parents for vaccinating children against HPV is a health care provider's recommendation. Although most clinicians embrace vaccine recommendations, they are not always carried out evenly and subsequent HPV vaccines are missed.

METHODS

Using an electronic health records-based decision support system (CHICA) clinicians were randomized to either usual practice or to receive an automated reminder to recommend the 2nd or 3rd dose of HPV vaccine. The reminder was delivered to clinicians of all intervention group eligible adolescents who had already initiated the vaccine series. Logistic regression models with generalized estimating equations were used for data analysis.

RESULTS

A total of 1285 clinical encounters were observed across 29 randomized pediatric providers over a 13-month time frame (50.7% control group, 49.3% intervention group). Overall, patients were 44.9% female, 59.4% Black, 22.1% Hispanic, and 48.8% were ages 11-12 yrs. Within the control group, 421 (64.7%) received a subsequent HPV vaccine, compared to 481 (75.9%) (OR: 1.72, (95% CI 1.35-2.19)). Adjusted analysis showed no difference between the groups (aOR 1.52 (95% CI 0.88-2.62)) or when examined by age (11-12yrs aOR 1.66, (95% CI 0.79-3.48)) and 13-17yrs (aOR 1.19, (95% CI 0.76-1.85)) or gender female (aOR 1.39 (95% CI 0.71-2.72)) and males (aOR 1.67 (95% CI 0.95-2.92)). When results were stratified by both age and gender, there was similarly no statistically significant effect between the two groups.

CONCLUSIONS

Automated physician reminders for subsequent 2nd and 3rd doses of HPV vaccination were used. Despite increased rates of vaccination in the intervention group, the differences did not reach the level of statistical significance. Future studies with multifaceted approaches may be needed to examine the efficacy of computer-based reminders.

CLINICAL TRIAL REGISTRATION

NCT02558803, "HPV Vaccination: Evaluation of Reminder Prompts for Doses 2 & 3".

Comparisons of immunization records between a community pharmacy, a regional registry, and a health system

OBJECTIVES

To compare the completeness of immunization records for 6 vaccines between a community pharmacy database, a regional immunization information system (IIS), and a health system's electronic health record (EHR).

METHODS

In a community pharmacy immunization program, 2 pharmacists and a community pharmacy resident performed a needs assessment for 6 vaccines (tetanus-diphtheria-acellular pertussis vaccine for adults or diphtheria-tetanus-acellular pertussis vaccine for children and adolescents, zoster vaccine live, 13-valent pneumococcal conjugate vaccine, 23-valent pneumococcal polysaccharide vaccine, hepatitis B vaccine series, and human papillomavirus vaccine) for more than 2400 patients from August 2016 to March 2017. This was a retrospective study to review immunization records for 243 patients. Inclusion criteria included patients from the community pharmacy immunization program who also had at least 1 medication prescribed by an academic health system provider. Immunization records for 6 vaccines were collected from the community pharmacy database, the regional IIS, and the EHR.

RESULTS

A total of 186 of 243 patients (77%) had additional immunization records in the regional IIS or EHR that were not found in the community pharmacy database. Among those 186 patients, 108 (58%) had additional immunization records for 2 or more unique vaccines. In total, 378 additional immunization records were identified for the 6 vaccines. For all 6 vaccines, the regional IIS and EHR possessed more complete immunization records than the community pharmacy database (P < 0.05 for HPV and P < 0.001 for the remaining 5 vaccines).

CONCLUSION

Our study showed that immunization records were more complete in a regional IIS and health system EHR compared with a community pharmacy database. If all 3 sources were used by the pharmacist during the needs assessment, the community pharmacy team would have made fewer vaccine recommendations, which would have reduced the potential for duplicate or inappropriate vaccines.

Diseases diagnosis using fuzzy logic methods: A systematic and meta-analysis review

BACKGROUND AND OBJECTIVE

Diagnosis as the initial step of medical practice, is one of the most important parts of complicated clinical decision making which is usually accompanied with the degree of ambiguity and uncertainty. Since uncertainty is the inseparable nature of medicine, fuzzy logic methods have been used as one of the best methods to decrease this ambiguity. Recently, several kinds of literature have been published related to fuzzy logic methods in a wide range of medical aspects in terms of diagnosis. However, in this context there are a few review articles that have been published which belong to almost ten years ago. Hence, we conducted a systematic review to determine the contribution of utilizing fuzzy logic methods in disease diagnosis in different medical practices.

METHODS

Eight scientific databases are selected as an appropriate database and Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) method was employed as the basis method for conducting this systematic and meta-analysis review. Regarding the main objective of this research, some inclusion and exclusion criteria were considered to limit our investigation. To achieve a structured meta-analysis, all eligible articles were classified based on authors, publication year, journals or conferences, applied fuzzy methods, main objectives of the research, problems and research gaps, tools utilized to model the fuzzy system, medical disciplines, sample sizes, the inputs and outputs of the system, findings, results and finally the impact of applied fuzzy methods to improve diagnosis. Then, we analyzed the results obtained from these classifications to indicate the effect of fuzzy methods in decreasing the complexity of diagnosis.

RESULTS

Consequently, the result of this study approved the effectiveness of applying different fuzzy methods in diseases diagnosis process, presenting new insights for researchers about what kind of diseases which have been more focused. This will help to determine the diagnostic aspects of medical disciplines that are being neglected.

CONCLUSIONS

Overall, this systematic review provides an appropriate platform for further research by identifying the research needs in the domain of disease diagnosis.

Simple and Elaborated Clinician Reminder Prompts for Human Papillomavirus Vaccination: A Randomized Clinical Trial

OBJECTIVE

To evaluate the effects of simple and elaborated health care provider (HCP) reminder prompts on human papillomavirus (HPV) vaccine initiation rates.

METHODS

Twenty-nine pediatric HCPs serving 5 pediatric clinics were randomized to 1 of 3 arms: 1) usual practice control, 2) simple reminder prompt, and 3) elaborated reminder prompt, which included suggested language for recommending the early adolescent platform vaccines. Prompts were delivered via a computer-based clinical decision support system deployed in the 5 clinics. Eligible patients were ages 11 to 13 years, had not received HPV vaccine, and were due for meningococcal ACWY (MenACWY) vaccine and/or the tetanus, diphtheria, and pertussis booster (Tdap). Receipt of HPV vaccine was determined via automated queries sent to the Indiana immunization registry. Data were analyzed via logistic regression models, with generalized estimating equations used to account for the clustering of patients within HCPs.

RESULTS

Ten HCPs in the control group saw 301 patients, 8 HCPs in the simple prompt group saw 124, and 11 HCPs in the elaborated prompt group saw 223. The elaborated prompt arm had a higher rate of HPV vaccination (62%) than the control arm (45%): adjusted odds ratio, 2.76; 95% confidence interval, 1.07 to 7.14. The simple prompt arm did not differ significantly from the control arm with respect to HPV vaccine initiation, which might have been because of the small sample size for this arm. MenACWY and Tdap rates did not vary across the 3 arms.

CONCLUSIONS

Results suggest that an elaborated HCP-targeted reminder prompt, with suggested recommendation language, might improve rates of HPV vaccine initiation.

Comparison of Two Sources of Clinical Audit Data to Assess the Delivery of Diabetes Care in Aboriginal Communities

The objective of this study was to determine the concordance between data extracted from two Clinical Decision Support Systems regarding diabetes testing and monitoring at Aboriginal Community Controlled Health Services in Australia. De-identified PenCAT and Communicare Systems data were extracted from the services allocated to the intervention arm of a diabetes care trial, and intra-class correlations for each extracted item were derived at a service level. Strong to very strong correlations between the two data sources were found regarding the total number of patients with diabetes per service (Intra-class correlation [ICC] = 0.99), as well as the number (ICC = 0.98–0.99) and proportion (ICC = 0.96) of patients with diabetes by gender. The correlation was moderate for the number and proportion of Type 2 diabetes patients per service in the group aged 18–34 years (ICC = 0.65 and 0.8–0.82 respectively). Strong to very strong correlations were found for numbers and proportions of patients being tested for diabetes, and for appropriate monitoring of patients known to have diabetes (ICC = 0.998–1.00). This indicated a generally high degree of concordance between whole-service data extracted by the two Clinical Decision Support Systems. Therefore, the less expensive or less complex option (depending on the individual circumstances of the service) may be appropriate for monitoring diabetes testing and care. However, the extraction of data about subgroups of patients may not be interchangeable.