A nationwide covert observation study using a novel method for hand hygiene compliance in health care

An intervention study investigating the effectiveness of contextualizing multimodal strategy on improving hand hygiene at a tertiary hospital in Nigeria

BACKGROUND

Hand hygiene (HH) is a proven low-cost means to curtail the problem of hospital-acquired infection (HAI). However, a low HH compliance rate of 17.1% was found among surgical health workers at Ahmadu Bello University Teaching Hospital (ABUTH) in Zaria, Nigeria.

METHODS

This was an intervention study conducted utilizing mixed methods to investigate the effectiveness of the World Health Organization (WHO) multimodal strategy to improve the HH compliance rate of doctors at ABUTH Zaria. The study was conducted between June and August 2022 and included delivering a behavioural change HH workshop to doctors followed by data collection in the surgical wards that had received environmental modification through the provision of an alcohol-based hand rub (ABHR), HH posters and nurses for visual and/or verbal reminders.

RESULTS

The cumulative HH compliance rate was 69% (n=1774) and was significantly different from the baseline HH compliance rate of 17.1% (confidence interval 45.5 to 57.7, p<0.001). Observed HH was highest in the ward with both visual and verbal reminders (78%) and lowest (59%) where neither visual nor verbal reminders were provided (n=444 per ward). All respondents reported motivation to perform HH with the presence of ABHR.

CONCLUSIONS

The WHO multimodal strategy is good for enhancing HH among health workers in the context of low- and middle-income countries. More research is needed to understand how much of a reduction in HAI is directly associated with efficient HH by health workers.

Antibacterial assessment of commercially available hand sanitizers in Pakistan by EN-1500

BACKGROUND

The effectiveness of hand sanitizers marketed to the general population is essential for infection prevention and control. Main theme of the study was that whether the commercially available hand sanitizers meet the WHO recommended standards in terms of efficacy? Current study aims to investigate the efficacy of ten commercially available hand sanitizers.

METHODS

The methodology was based on European Standard EN-1500. Following the artificial contamination of hands, pre and post samples were obtained to determine the log reduction values for each sanitizer.

RESULTS

The results showed that out of ten only one sanitizer showed highest log reduction which was comparable to the reference product. Product B was most efficient in sanitization of hands with mean log reduction of 6.00 ± 0.15. The lowest sanitization efficacy was recorded for product F with mean log reduction of 2.40 ± 0.51, however the reference product 2-propanol result in mean log reduction of 6.0 ± 0.00. The products used in this study show a statistical significant results (p value: < 0.01).

CONCLUSION

It is concluded that only one product showed active sanitizer efficacy. This study provides an important insight for manufacturing company and authorizing authorities to assess the efficacy of hand sanitizer. Hand sanitization is one approach to stop the spread of diseases carried on by harmful bacteria inhabiting our hands. Apart from the manufacturing strategies, ensuring proper use and quantity of hand sanitizers is very important.

Defining and evaluating the Hawthorne effect in primary care, a systematic review and meta-analysis

In 2015, we conducted a randomized controlled trial (RCT) in primary care to evaluate if posters and pamphlets dispensed in general practice waiting rooms enhanced vaccination uptake for seasonal influenza. Unexpectedly, vaccination uptake rose in both arms of the RCT whereas public health data indicated a decrease. We wondered if the design of the trial had led to a Hawthorne effect (HE). Searching the literature, we noticed that the definition of the HE was unclear if stated. Our objectives were to refine a definition of the HE for primary care, to evaluate its size, and to draw consequences for primary care research. We designed a Preferred Reporting Items for Systematic reviews and Meta-Analyses review and meta-analysis between January 2012 and March 2022. We included original reports defining the HE and reports measuring it without setting limitations. Definitions of the HE were collected and summarized. Main published outcomes were extracted and measures were analyzed to evaluate odds ratios (ORs) in primary care. The search led to 180 records, reduced on review to 74 for definition and 15 for quantification. Our definition of HE is "an aware or unconscious complex behavior change in a study environment, related to the complex interaction of four biases affecting the study subjects and investigators: selection bias, commitment and congruence bias, conformity and social desirability bias and observation and measurement bias." Its size varies in time and depends on the education and professional position of the investigators and subjects, the study environment, and the outcome. There are overlap areas between the HE, placebo effect, and regression to the mean. In binary outcomes, the overall OR of the HE computed in primary care was 1.41 (95% CI: [1.13; 1.75]; I 2 = 97%), but the significance of the HE disappears in well-designed studies. We conclude that the HE results from a complex system of interacting phenomena and appears to some degree in all experimental research, but its size can considerably be reduced by refining study designs.

Factors influencing health workers’ compliance with the WHO intermittent preventive treatment for malaria in pregnancy recommendations in the Northern Region, Ghana

Background

Although IPTp-SP is a lifesaving World Health Organization (WHO) recommended preventive intervention for pregnant women in malaria-endemic regions, IPTp-SP uptake in the Northern region of Ghana is much lower than the sub-optimal national coverage level. Assessing the extent of health workers’ compliance and its associated factors will generate valuable pointers to be targeted at the program level. The study examined the factors influencing health workers’ compliance with the WHO recommended guidelines for IPTp-SP in the Northern Region.

Methods

A cross-sectional study among 315 health workers in the Northern region was conducted. Semi-structured questionnaires were used to collect data on health workers’ sociodemographic characteristics, facility-based factors and knowledge level. Data were collected on health workers’ compliance with the recommended practices through covert observations using a checklist. Facility observations were carried out using a checklist. Crude and adjusted logistic regression were used to determine predictors of health workers’ compliance, at a 5% significance level adjusting for clustering.

Results

Of the 315 health workers studied, the median age was 29 years (26–34 years). Females constituted (80.5%; 252) of the 313 workers. The majority (47.4%;148) of the 312 health workers were midwives. Overall, 56.2% (CI 51.0 – 62.0) were adequately complying with the recommended guidelines. Lower levels of compliance were recorded in health centres 15.6% (5.0 – 33.0) and CHPS compounds 21.2% (11.0 – 35.0). The factors associated with compliance included health workers’ knowledge (aOR = 7.64, 95% CI 4.21 – 13.87, p < 0.001), job satisfaction (aOR 10.87, 95% CI 7.04 – 16.79, p < 0.001), in-service training (aOR 10.11, 95% CI 4.53 – 22.56, p < 0.001), supervision (aOR 4.01, 95% CI 2.09 – 7.68, p < 0.001), availability of job aids (aOR 3.61, 95% CI 2.44 – 5.35, p < 0.001), health workers experience (aOR = 10.64, 95% CI 5.99 – 18.91, p < 0.001) and facility type (aOR 0.03, 95% CI 0.01–0.07, p < 0.001).

Conclusion

Compliance with the recommended IPTp-SP guidelines is suboptimal in the region, with lower-level health facilities recording the least compliance levels. Health centres and CHPS facilities should be prioritized in distributing limited resources to improve health worker quality of care for antenatal care clients.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12936-022-04286-4.

Hand hygiene compliance by direct observation in physicians and nurses: a systematic review and meta-analysis

BACKGROUND

Direct observation of hand hygiene compliance is the "gold standard" despite limitations and potential for bias. Previous literature highlights poorer hand hygiene compliance amongst physicians than nurses and suggests that covert monitoring may give better compliance estimates than overt monitoring.

AIM

This review aimed to explore differences in compliance between physicians and nurses further, and to analyse if compliance estimates differed when observations were covert rather than overt.

METHODS

A systematic search of databases PubMed, EMBASE, CENTRAL and CINAHL was performed. Experimental or observational studies in hospital settings in high-income countries published in English from 2010 onwards were included if estimates for both physicians and nurses using direct observation were reported. The search yielded 4814 studies, of which 105 were included.

FINDINGS

The weighted pooled compliance rate for nurses was 52% (95% CI 47% to 57%) and for doctors was 45% (95% CI 40% to 49%). Heterogeneity was considerable (I²=99%). The majority of studies were at moderate or high risk of bias. Random-effects meta-analysis of low risk of bias studies suggests higher compliance for nurses than physicians for both overt (difference of 7%, 95% CI for the difference 0.8% to 13.5%, p=0.027) and covert (difference of 7%, 95% CI 3% to 11%, p=0.0002) observation. Considerable heterogeneity was found in all analyses.

CONCLUSION

Wide variability in compliance estimates and differences in the methodological quality of hand hygiene studies were identified. Further research with meta-regression should explore sources of heterogeneity and improve the conduct and reporting of hand hygiene studies.

Out of sight, out of mind: a prospective observational study to estimate the duration of the Hawthorne effect on hand hygiene events

Background

Human auditing has been the gold standard for evaluating hand hygiene (HH) compliance but is subject to the Hawthorne effect (HE), the change in subjects’ behaviour due to their awareness of being observed. For the first time, we used electronic HH monitoring to characterise the duration of the HE on HH events after human auditors have left the ward.

Methods

Observations were prospectively conducted on two transplant wards at a tertiary centre between May 2018 and January 2019. HH events were measured using the electronic GOJO Smartlink Activity Monitoring System located throughout the ward. Non-covert human auditing was conducted in 1-hour intervals at random locations on both wards on varying days of the week. Two adjusted negative binomial regression models were fit in order to estimate an overall auditor effect and a graded auditor effect.

Results

In total, 365 674 HH dispensing events were observed out of a possible 911 791 opportunities. In the adjusted model, the presence of an auditor increased electronic HH events by approximately 2.5-fold in the room closest to where the auditor was standing (9.86 events per hour/3.98 events per hour; p<0.01), an effect sustained across only the partial hour before and after the auditor was present but not beyond the first hour after the auditor left. This effect persisted but was attenuated in areas distal from the auditor (total ward events of 6.91*6.32–7.55, p<0.01). Additionally, there was significant variability in the magnitude of the HE based on temporal and geographic distribution of audits.

Conclusion

The HE on HH events appears to last for a limited time on inpatient wards and is highly dynamic across time and auditor location. These findings further challenge the validity and value of human auditing and support the need for alternative and complementary monitoring methods.

The effect of incorporating covert observation into established overt observation-based hand hygiene promotion programs

BACKGROUND

Covert observation (CO) is reliable for measuring hand hygiene compliance (HHC). However, the benefit of adding CO to overt observation (OO) is uncertain. We evaluated whether incorporating CO into an OO-based hand hygiene (HH) promotion program improves HH rate.

METHODS

Health care worker's HH activities were observed through 5 monitoring sessions (2 in phases 1 and 2 and 1 in phase 3) of simultaneous CO and OO. An intervention was applied-barrier identification interview-only in phase 2.

RESULTS

Overall HHC was 91.0% for OO, and 49.3% for CO. HHC in phase 1 was not changed by repeated CO (34.7% and 34.0%, P = .70). HHC based on CO increased to 66.9% in phase 2 after the application of an intervention (P < .01), but decreased to 57.5% in phase 3 (P < .01). HHC based on OO increased significantly between only the first and second sessions in phase 2 (90.8% and 94.5%, respectively, P = .01).

DISCUSSION

Although CO did not significantly change behavior, HHC with CO responded promptly to the application and cessation of a new intervention.

CONCLUSIONS

CO reflects HHC change more reliably than does OO. However, it is uncertain whether CO will improve HHC.

Testing a novel audit and feedback method for hand hygiene compliance: A multicenter quality improvement study

OBJECTIVE

Although most hospitals report very high levels of hand hygiene compliance (HHC), the accuracy of these overtly observed rates is questionable due to the Hawthorne effect and other sources of bias. In the study, we aimed (1) to compare HHC rates estimated using the standard audit method of overt observation by a known observer and a new audit method that employed a rapid (&lt;15 minutes) "secret shopper" method and (2) to pilot test a novel feedback tool.

DESIGN

Quality improvement project using a quasi-experimental stepped-wedge design.

SETTING

This study was conducted in 5 acute-care hospitals (17 wards, 5 intensive care units) in the Midwestern United States.

METHODS

Sites recruited a hand hygiene observer from outside the acute-care units to rapidly and covertly observe entry and exit HHC during the study period, October 2016-September 2017. After 3 months of observations, sites received a monthly feedback tool that communicated HHC information from the new audit method.

RESULTS

The absolute difference in HHC estimates between the standard and new audit methods was ~30%. No significant differences in HHC were detected between the baseline and feedback phases (OR, 0.92; 95% CI, 0.84-1.01), but the standard audit method had significantly higher estimates than the new audit method (OR, 9.83; 95% CI, 8.82-10.95).

CONCLUSIONS

HHC estimates obtained using the new audit method were substantially lower than estimates obtained using the standard audit method, suggesting that the rapid, secret-shopper method is less subject to bias. Providing feedback using HHC from the new audit method did not seem to impact HHC behaviors.

Identifying heterogeneity in the Hawthorne effect on hand hygiene observation: a cohort study of overtly and covertly observed results

Background

Observation and feedback are core strategies of hand hygiene (HH) improvement. Direct overt observation is currently the gold standard method. Observation bias, also known as the Hawthorne effect, is a major disadvantage of this method. Our aim was to examine the variation of the Hawthorne effect on HH observation in different healthcare groups and settings.

Methods

A prospective cohort study was performed in a tertiary teaching hospital during a 15-month period. Up to 38 overt observers (82% nurses) and 93 covert observers (81% medical students) participated in HH observation. The HH events observed overtly were matched for occupation, department, observation time, and location with those observed covertly. The data of matched pairs were then analysed to detect possible Hawthorne effects on different variables.

Results

A total of 31,522 HH opportunities were observed (4581 overtly, 26,941 covertly). There were 3047 matched pairs after 1:1 matching of overt and covert observations. The overall HH compliance was higher with overt observation than with covert observation (78% vs. 55%, p < 0.001). The Hawthorne effect was nearly three times larger in nurses (30 percentage points) than in physicians (11 percentage points) and was significantly greater in outpatient clinics (41 percentage points) than in intensive care units (11 percentage points). The magnitude of the Hawthorne effect varied among healthcare worker occupations and observation locations (p values both < 0.001) but not among departments, observation times, or HH indications.

Conclusions

Heterogeneity in the Hawthorne effect may influence the interpretation of overt observations and prevent the correct identification of target populations with poor HH compliance. Therefore, directly observed HH compliance may not be an adequate performance indicator for infection control.

Quantifying the Hawthorne effect using overt and covert observation of hand hygiene at a tertiary care hospital in Saudi Arabia

INTRODUCTION

Although direct human observation of hand hygiene (HH) is considered the gold standard for measuring HH compliance, its accuracy is challenged by the Hawthorne effect.

OBJECTIVES

To compare HH compliance using both overt and covert methods of direct observation in different professional categories, hospital settings, and HH indications.

METHODS

A cross-sectional study was conducted in 28 units at King Abdulaziz Medical City, Riyadh, Saudi Arabia, between October 2012 and July 2013. Compliance was defined as performing handrubbing or handwashing during 1 of the World Health Organization 5 Moments for HH indications (ie, opportunities). Overt observation was done by infection preventionists (IPs) who were doing their routine HH observation. Covert observation was done by unrecognized temporarily hired professionally trained observers.

RESULTS

A total of 15,883 opportunities were observed using overt observation and 7,040 opportunities were observed using covert observation. Overall HH compliance was 87.1% versus 44.9% using overt/covert observations, respectively (risk ratio, 1.94; P < .001). The significant overestimation was seen across all professional categories, hospital settings, and HH indications.

CONCLUSION

There is a considerable difference in HH compliance being observed overtly and covertly in all categories. More work is required to improve the methodology of direct observation to minimize the influence of the Hawthorne effect.

Behavioral Interventions to Reduce Infections in Pediatric Long-term Care Facilities: The Keep It Clean for Kids Trial

Children in pediatric long-term care facilities (pLTCF) represent a highly vulnerable population and infectious outbreaks occur frequently, resulting in significant morbidity, mortality, and resource use. The purpose of this quasi-experimental trial using time series analysis was to assess the impact of a 4-year theoretically based behavioral intervention on infection prevention practices and clinical outcomes in three pLTCF (288 beds) in New York metropolitan area including 720 residents, ages 1 day to 26 years with mean lengths of stay: 7.9-33.6 months. The 5-pronged behavioral intervention included explicit leadership commitment, active staff participation, work flow assessments, training staff in the World Health Organization "'five moments of hand hygiene (HH)," and electronic monitoring and feedback of HH frequency. Major outcomes were HH frequency, rates of infections, number of hospitalizations associated with infections, and outbreaks. Mean infection rates/1000 patient days ranged from 4.1-10.4 pre-intervention and 2.9-10.0 post-intervention. Mean hospitalizations/1000 patient days ranged from 2.3-9.7 before and 6.4-9.8 after intervention. Number of outbreaks/1000 patient days per study site ranged from 9-24 pre- and 9-18 post-intervention (total = 95); number of cases/outbreak ranged from 97-324 (total cases pre-intervention = 591 and post-intervention = 401). Post-intervention, statistically significant increases in HH trends occurred in one of three sites, reductions in infections in two sites, fewer hospitalizations in all sites, and significant but varied changes in the numbers of outbreaks and cases/outbreak. Modest but inconsistent improvements occurred in clinically relevant outcomes. Sustainable improvements in infection prevention in pLTCF will require culture change; increased staff involvement; explicit administrative support; and meaningful, timely behavioral feedback.

Impact of a multicomponent hand hygiene intervention strategy in reducing infection rates at a university hospital in Saudi Arabia

BACKGROUND AND AIMS

Few studies have reported the correlation between hand hygiene (HH) practices and infection rates in Saudi Arabia. This work was aimed to study the effect of a multicomponent HH intervention strategy in improving HH compliance and reducing infection rates at King Fahd Hospital of the University, Al-Khobar, Saudi Arabia between January 2014 and December 2016.

METHODS

A yearlong multicomponent HH intervention, which included various strategies recommended by the World Health Organization, was introduced. HH compliance among staff and infection rates observed in the inpatient wards were assessed and compared at pre- and post-interventional phases.

RESULTS

There was a significant increase in mean HH compliance from 50.17% to 71.75% after the intervention (P < 0.05). Hospital-acquired infection (HAI) and catheter-associated urinary tract infection (CAUTI) rates decreased from 3.37 to 2.59 and from 3.73 to 1.75, respectively (P < 0.05). HH compliance was found to be negatively correlated with HAI (r = -0.278) and CAUTI (r = -0.523) rates.

CONCLUSIONS

Results show that multicomponent intervention is effective in improving HH compliance, and that an increase in HH compliance among hospital staff decreases infection rates. Further studies on cost-effectiveness of such a model could augment to these findings.