1
|
Baradaran A, Tolentino R, Grad R, Ganache I, Gore G, Abbasgholizadeh Rahimi S, Pluye P. Outcomes of guidelines from health technology assessment organizations in community-based primary care: a systematic mixed studies review. Int J Technol Assess Health Care 2024; 40:e56. [PMID: 39539094 PMCID: PMC11579698 DOI: 10.1017/s0266462324000370] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/29/2024] [Revised: 05/16/2024] [Accepted: 06/28/2024] [Indexed: 11/16/2024]
Abstract
BACKGROUND Health technology assessment (HTA) organizations generate guidelines to inform healthcare practices toward improved health outcomes. This review sought to identify and classify outcomes of guidelines from HTA organizations within published research. METHODOLOGY We performed a systematic mixed studies review of empirical studies that (a) referred to a published guideline from an HTA organization and (b) reported an outcome resulting from a guideline. We searched the published literature in English or French within seven databases. Outcome types were classified within five dimensions of an existing framework for online health information (e.g., relevance, cognitive/affective impact, and use). Subdimensions were inductively developed. A two-phase sequential data synthesis was performed. Phase 1: a hybrid deductive-inductive thematic analysis identified the types of outcomes and displayed their relationships on a concept map. Phase 2: descriptive statistics were tabulated by the type of outcome. RESULTS A total of 6,719 records were retrieved through searches on 6 February 2023. After screening, we included 120 observational studies (twenty-one qualitative, ninety-four quantitative, and five mixed methods). Phase 1 identified twenty-nine types of outcomes. The most frequently reported outcomes were within the organizational dimension (reported in ninety-four studies). The most common subdimensions were "Referrals" (thirty-eight occurrences), the "Quality of Prescriptions" (fifteen occurrences), and the "Quality of Diagnosis" (eight occurrences). For Phase 2, we could only generate descriptive statistics on seventeen outcomes. These were almost equally distributed among positive, neutral, and negative effects. Our results contribute to knowledge about the outcomes of HTA guidelines and options for documenting and measuring them in future evaluations.
Collapse
Affiliation(s)
- Ashkan Baradaran
- Department of Family Medicine, McGill University, Montréal, QC, Canada
| | - Raymond Tolentino
- Department of Family Medicine, McGill University, Montréal, QC, Canada
| | - Roland Grad
- Department of Family Medicine, McGill University, Montréal, QC, Canada
| | - Isabelle Ganache
- Institut national d’excellence en santé et en services sociaux (INESSS), Montréal, QC, Canada
| | - Geneviève Gore
- Schulich Library of Physical Sciences, Life Sciences, and Engineering, McGill University, Montréal, QC, Canada
| | - Samira Abbasgholizadeh Rahimi
- Department of Family Medicine, McGill University, Montréal, QC, Canada
- Lady Davis Institute for Medical Research, Jewish General Hospital, Montréal, QC, Canada
- Mila-Quebec Artificial Intelligence Institute, Montréal, QC, Canada
- Faculty of Dental Medicine and Oral Health Sciences, McGill University, Montréal, QC, Canada
| | - Pierre Pluye
- Department of Family Medicine, McGill University, Montréal, QC, Canada
| |
Collapse
|
2
|
Gransjøen AM. Impact of an online training tool on individual and organizational resilience and mindfulness among radiological personnel in Norway. BMC Res Notes 2023; 16:373. [PMID: 38115096 PMCID: PMC10729412 DOI: 10.1186/s13104-023-06659-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/16/2023] [Accepted: 12/07/2023] [Indexed: 12/21/2023] Open
Abstract
BACKGROUND Heavy workloads and increasing demands for productivity have contributed to rising rates of stress and burnout among radiological staff. Different forms of mindfulness and resilience-training might assist with stress management and protect these employees against burnout. AIM The objective of this study is to evaluate the impact of an online training tool on individual and organizational resilience, mindfulness and quality of care. METHODS An online questionnaire was used, consisting of the Connor-Davidson Resilience Scale, the Mindful Attention Awareness Scale, the Benchmark Resilience Tool, and questions pertaining to quality, safety, and burnout (baseline = 68 participants between July 2022 - October 2022, follow-up = 13 participants between November 2022 - February 2023). Descriptive statistics and a paired-sampled t-test were used for statistical analysis. RESULTS AND CONCLUSIONS Few participants reported completing any of the exercises. The baseline group had significantly higher mean resilience (p = 0.018) and mindfulness scores (p = < 0.001), mean decrease in scores was 7.46 for resilience and 1.7 for mindfulness. In conclusion, both individual and organizational resilience are perceived as low among radiological personnel in Norway. However, it does not seem to affect quality and safety.
Collapse
Affiliation(s)
- Ann Mari Gransjøen
- Department of Health Sciences in Gjøvik, Norwegian University of Science and Technology in Gjøvik (NTNU), Teknologiveien 22, Gjøvik, 2815, Norway.
- SHARE-Centre for Resilience in Healthcare, Faculty of Health Sciences, University of Stavanger, Kjell Arholmsgate 41, Stavanger, 4036, Norway.
| |
Collapse
|
3
|
Moyal-Smith R, Etheridge JC, Karlage A, Sonnay Y, Yuan CT, Havens JM, Brindle ME, Berry W. Defining re-implementation. Implement Sci Commun 2023; 4:60. [PMID: 37277862 DOI: 10.1186/s43058-023-00440-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/15/2022] [Accepted: 05/19/2023] [Indexed: 06/07/2023] Open
Abstract
BACKGROUND The first attempt to implement a new tool or practice does not always lead to the desired outcome. Re-implementation, which we define as the systematic process of reintroducing an intervention in the same environment, often with some degree of modification, offers another chance at implementation with the opportunity to address failures, modify, and ultimately achieve the desired outcomes. This article proposes a definition and taxonomy for re-implementation informed by case examples in the literature. MAIN BODY We conducted a scoping review of the literature for cases that describe re-implementation in concept or practice. We used an iterative process to identify our search terms, pilot testing synonyms or phrases related to re-implementation. We searched PubMed and CINAHL, including articles that described implementing an intervention in the same environment where it had already been implemented. We excluded articles that were policy-focused or described incremental changes as part of a rapid learning cycle, efforts to spread, or a stalled implementation. We assessed for commonalities among cases and conducted a thematic analysis on the circumstance in which re-implementation occurred. A total of 15 articles representing 11 distinct cases met our inclusion criteria. We identified three types of circumstances where re-implementation occurs: (1) failed implementation, where the intervention is appropriate, but the implementation process is ineffective, failing to result in the intended changes; (2) flawed intervention, where modifications to the intervention itself are required either because the tool or process is ineffective or requires tailoring to the needs and/or context of the setting where it is used; and (3) unsustained intervention, where the initially successful implementation of an intervention fails to be sustained. These three circumstances often co-exist; however, there are unique considerations and strategies for each type that can be applied to re-implementation. CONCLUSIONS Re-implementation occurs in implementation practice but has not been consistently labeled or described in the literature. Defining and describing re-implementation offers a framework for implementation practitioners embarking on a re-implementation effort and a starting point for further research to bridge the gap between practice and science into this unexplored part of implementation.
Collapse
Affiliation(s)
- Rachel Moyal-Smith
- Ariadne Labs, Brigham and Women's Hospital, Harvard T.H. Chan School of Public Health, 401 Park Drive, 3Rd Floor West, Boston, MA, 02215, USA.
| | - James C Etheridge
- Ariadne Labs, Brigham and Women's Hospital, Harvard T.H. Chan School of Public Health, 401 Park Drive, 3Rd Floor West, Boston, MA, 02215, USA
- Department of Surgery, Brigham and Women's Hospital, Boston, MA, USA
| | - Ami Karlage
- Ariadne Labs, Brigham and Women's Hospital, Harvard T.H. Chan School of Public Health, 401 Park Drive, 3Rd Floor West, Boston, MA, 02215, USA
| | - Yves Sonnay
- Ariadne Labs, Brigham and Women's Hospital, Harvard T.H. Chan School of Public Health, 401 Park Drive, 3Rd Floor West, Boston, MA, 02215, USA
| | - Christina T Yuan
- Department of Health Policy and Management, Johns Hopkins Bloomberg School of Public Health, Baltimore, MD, USA
| | - Joaquim M Havens
- Ariadne Labs, Brigham and Women's Hospital, Harvard T.H. Chan School of Public Health, 401 Park Drive, 3Rd Floor West, Boston, MA, 02215, USA
- Department of Surgery, Brigham and Women's Hospital, Boston, MA, USA
| | - Mary E Brindle
- Ariadne Labs, Brigham and Women's Hospital, Harvard T.H. Chan School of Public Health, 401 Park Drive, 3Rd Floor West, Boston, MA, 02215, USA
- Department of Surgery, Cumming School of Medicine, University of Calgary, Calgary, Canada
- Department of Surgery, Massachusetts General Hospital, Boston, MA, USA
| | - William Berry
- Ariadne Labs, Brigham and Women's Hospital, Harvard T.H. Chan School of Public Health, 401 Park Drive, 3Rd Floor West, Boston, MA, 02215, USA
| |
Collapse
|
4
|
Horppu R, Väänänen A, Kausto J. Evaluation of a guidelines implementation intervention to reduce work disability and sick leaves related to chronic musculoskeletal pain: a theory-informed qualitative study in occupational health care. BMC Musculoskelet Disord 2022; 23:272. [PMID: 35317760 PMCID: PMC8938719 DOI: 10.1186/s12891-022-05234-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/31/2021] [Accepted: 03/16/2022] [Indexed: 11/10/2022] Open
Abstract
Background Guidelines for pain management and sick leave prescription were formulated and implemented in an occupational health services (OHS) in Finland to reduce work disability and sick leaves related to musculoskeletal pain. We investigated how the guidelines implementation intervention may have produced its effects, how the number of prescribed sick leave days varied before and after the launch of the guidelines, and which factors beyond physician behaviour were seen to influence sick leaves. Methods Seventeen physicians, two occupational physiotherapists and one occupational health care nurse were interviewed. Qualitative content analysis using both inductive and deductive approaches was performed, informed by Behaviour Change Wheel and Theoretical Domains Framework. Employees’ sick leave days related to musculoskeletal disorders in 2015–2019 were drawn from the employer’s register. Results Physicians’ guidelines adherence was facilitated by psychological capability (e.g., having relevant knowledge, remembering to engage in recommended behaviours), reflective motivation (e.g., guidelines-related behaviours regarded as central part of one’s professional role; beliefs in the positive consequences of recommended behaviours to employees and employers), and physical and social opportunities (e.g., adequate physical resources, culture of social support). Some physicians also described barriers to recommended behaviours (e.g., lack of knowledge or non-pharmacological pain treatment tools). The guidelines had served as sources of new knowledge, reminders of recommended practices and means of self-assessment. Considerable declining trend of prescribed sick leave days was detected, especially during the first years after the intervention, levelling off somewhat thereafter. OHS policies and structures were seen to enable professionals’ focusing on preventing pain-related disability and prolonged sick leaves. The decline of sickness absences was also attributed to the municipal client organization’s commitment and the employees’ positive attitudes towards the alternatives to full-time sick leave. Conclusions The guidelines implementation intervention was found successful. The study showed the importance of social and organizational environment supporting physicians’ engagement in recommended practices. Supplementary Information The online version contains supplementary material available at 10.1186/s12891-022-05234-8.
Collapse
Affiliation(s)
- Ritva Horppu
- Finnish Institute of Occupational Health, P.O Box 40, 00032, Helsinki, Finland.
| | - Ari Väänänen
- Finnish Institute of Occupational Health, P.O Box 40, 00032, Helsinki, Finland
| | - Johanna Kausto
- Finnish Institute of Occupational Health, P.O Box 40, 00032, Helsinki, Finland
| |
Collapse
|
5
|
Gransjøen AM, Thorsen K, Lysdahl KB, Wiig S, Hofmann BM. Impact on radiological practice of active guideline implementation of musculoskeletal guideline, as measured over a 12-month period. Acta Radiol Open 2021; 10:2058460120988171. [PMID: 33796335 PMCID: PMC7975584 DOI: 10.1177/2058460120988171] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/22/2020] [Accepted: 12/27/2020] [Indexed: 12/01/2022] Open
Abstract
Background An ever-increasing technological development in the field of radiology urges
a need for guidelines to provide predictable and just health services. A
musculoskeletal guideline was developed in Norway in 2014, without active
implementation. Purpose To investigate the impact of active guideline implementation on the use of
musculoskeletal diagnostic imaging most frequently encountered in general
practice (pain in the neck, shoulders, lower back, and knees). Material and Methods The total number of outpatient radiological examinations across modalities
registered at the Norwegian Health Economics Administration between January
2013 and February 2019 was assessed using an interrupted time series
design. Results A 12% reduction in the total examination of Magnetic Resonance Imaging
shoulder and knee, and x-ray lower back and shoulder was found at a
significant level (p = 0.05). Stratified analysis (Magnetic
Resonance Imaging examination as one group and x-ray examinations as the
other) showed that this reduction mainly was due to the reduction in the use
of Magnetic Resonance Imaging examinations (shoulder and knee) which was
reduced by 24% at a significant level (p = 0.002), while
x-ray examinations had no significant level change
(p = 0.71). No other statistically significant changes were
found. Conclusion The impact of the implementation on the use of imaging of the neck, shoulder,
lower back, and knee is uncertain. Significant reductions were demonstrated
in the use of some examinations in the intervention county, but similar
effects were not seen when including a control group in the analysis. This
indicates a diffusion of the implementation, or other interventions or
events that affected both counties and occurred in the intervention
period.
Collapse
Affiliation(s)
- Ann M Gransjøen
- Department of Health Sciences, Norwegian University of Science and Technology (NTNU), Gjøvik, Norway
| | | | - Kristin B Lysdahl
- Department of Optometry, Radiography and Lighting Design, University of South-Eastern Norway, Kongsberg, Norway
| | - Siri Wiig
- SHARE-Centre for Resilience in Healthcare, University of Stavanger, Stavanger, Norway
| | - Bjørn M Hofmann
- Department of Health Sciences, Norwegian University of Science and Technology (NTNU), Gjøvik, Norway.,Center for Medical Ethics, University of Oslo, Blindern, Oslo
| |
Collapse
|