Web-based comparative study of some national experiences of health care quality management

Since the publication of study results on adverse events to health care in OECD countries, the importance of the national quality improvement strategies has been recognised. To examine how these strategies have been shaped in different jurisdictions, we carried out this study. We conducted a web-based comparative study of international practices. We first defined seven key health care and services quality management functions. We then drew on the experience of authors to make a reasoned selection of 13 countries or states across the world. We determined the distance that separates each of these functions from a country's Ministry of Health (MoH); and examined whether these functions are concentrated in a single organisation or dispersed across several organisations. Afterwards, we correlated our results with the quality level of these countries based on the OECD's health care indicators. Overall, Netherlands, Québec (Canada), Korea, Germany, England (UK), and the United States had at least 50% of their quality management functions controlled by self-regulated organisations. The Market Concentration Index ranged from 937 for the United States to 6800 for Russia. Graphical representation has shown us two health system models. Our results also clearly showed that countries had a better quality of care most often when they belong to model 1 of our taxonomy. These findings will help countries design and implement large-scale health care and services quality strategies for better and safer health care and services.

[Contextual factors influencing the delegation of tasks to Multi-skilled Community Health Workers in Haiti]

INTRODUCTION

In Haiti, the delegation of tasks to Multi-skilled Community Health Workers (locally called ASCP) is a strategy implemented by the Ministry of Public Health and Population to improve universal health coverage.

PURPOSE OF RESEARCH

To contribute to the successful implementation of this strategy, this article reports on a case study of its implementation in the northern health department of Haiti. More specifically, this article provides information on the contextual factors that facilitate or hinder the implementation of task delegation to ASCP.

RESULTS

The results obtained show notable progress in the implementation of task delegation to ASCP in the northern health department of Haiti. These mainly concern the following activities: selection, training, and deployment of ASCPs, endowment of work materials, supervision, collection and analysis of data on the results obtained. In September 2019, 215 ASCPs were active in the department. This corresponds to 44.3% of the 485 ASCPs planned to cover the department’s needs. Several contextual factors hindering or facilitating the implementation of this intervention were also identified with 35 resource persons during semi-structured interviews. These relate to the planning and monitoring of the implementation of the intervention (cited by 12 out of 35 people), the institutional context (10/35), and political (17/35), structural (30/35) and environmental factors (7/35).

CONCLUSIONS

This study highlights several contextual factors that need to be considered to ensure the successful implementation of the delegation of tasks to ASCP in Haiti and possibly in other contexts.

Nutritionists as policy advocates: the case of obesity prevention in Quebec, Canada

OBJECTIVE

A core function of the public health nutrition workforce is advocacy. Little is known of the nutritionists' role in policymaking from a policy process theory perspective. The current study analyses the nutritionists' role in advocating for a six-year governmental plan on obesity prevention in Quebec, Canada.

DESIGN

We conducted qualitative research using Quebec's obesity policy as a case study to understand the role of nutritionists in advocating for obesity prevention policies. A conceptual framework combining the Advocacy Coalition Framework with a political analysis model based on the Theory of the Strategic Actor was developed to analyse the beliefs, interests and strategies of policy actors including nutritionists. Data sources comprised semi-structured open-ended interviews with key policy actors (n 25), including eight nutritionists (32 %) and policy-related documents (n 267). Data analysis involved thematic coding and analysis using NVivo 11 Pro.

SETTING

Quebec, Canada.

PARTICIPANTS

Key policy actors including nutritionists.

RESULTS

Nutritionists formed the core of the dominant public health coalition. They advocated for an inter-sectoral governmental plan to prevent obesity through enabling environments. Their advocacy, developed through an iterative process, comprised creating a think tank and reinforcing partnerships with key policy actors, conducting research and developing evidence, communicating policy positions and advocacy materials, participating in deliberative forums and negotiating an agreement with other coalitions in the policy subsystem.

CONCLUSIONS

Nutritionists' advocacy influenced agenda setting and policy formulation. This research may contribute to empowering the public health nutrition workforce and strengthening its advocacy practices. It informs practitioners and researchers concerned with obesity policy and workforce development.

Building capacity in mental health care in low- and middle-income countries by training primary care physicians using the mhGAP: a randomized controlled trial

To address the rise in mental health conditions in Tunisia, a training based on the Mental Health Gap Action Programme (mhGAP) Intervention Guide (IG) was offered to primary care physicians (PCPs) working in the Greater Tunis area. Non-specialists (such as PCPs)' training is an internationally supported way to target untreated mental health symptoms. We aimed to evaluate the programme's impact on PCPs' mental health knowledge, attitudes, self-efficacy and self-reported practice, immediately following and 18 months after training. We conducted an exploratory trial with a combination of designs: a pretest-posttest control group design and a one-group pretest-posttest design were used to assess the training's short-term impact; and a repeated measures design was used to assess the training's long-term impact. The former relied on a delayed-intervention strategy: participants assigned to the control group (Group 2) received the training after the intervention group (Group 1). The intervention consisted of a weekly mhGAP-based training session (totalling 6 weeks), comprising lectures, discussions, role plays and a support session offered by trainers. Data were collected at baseline, following Group 1's training, following Group 2's training and 18 months after training. Descriptive, bivariate and ANOVA analyses were conducted. Overall, 112 PCPs were randomized to either Group 1 (n = 52) or Group 2 (n = 60). The training had a statistically significant short-term impact on mental health knowledge, attitudes and self-efficacy scores but not on self-reported practice. When comparing pre-training results and results 18 months after training, these changes were maintained. PCPs reported a decrease in referral rates to specialized services 18 months after training in comparison to pre-training. The mhGAP-based training might be useful to increase mental health knowledge and self-efficacy, and decrease reported referral rates and negative mental health attitudes among PCPs in Tunisia and other low- and middle-income countries. Future studies should examine relationships among these outcome variables.

The influence of primary care physicians' mental health knowledge, attitudes and self-efficacy on referrals to specialised services: findings from a longitudinal pilot trial

BACKGROUND

Training based on the Mental Health Gap Action Programme (mhGAP) is being increasingly adopted by countries to enhance non-specialists' mental health capacities. However, the influence of these enhanced capacities on referral rates to specialised mental health services remains unknown.

AIMS

We rely on findings from a longitudinal pilot trial to assess the influence of mental health knowledge, attitudes and self-efficacy on self-reported referrals from primary to specialised mental health services before, immediately after and 18 months after primary care physicians (PCPs) participated in an mhGAP-based training in the Greater Tunis area of Tunisia.

METHOD

Participants included PCPs who completed questionnaires before (n = 112), immediately after (n = 88) and 18 months after (n = 59) training. Multivariable analyses with linear mixed models accounting for the correlation among participants were performed with the SAS version 9.4 PROC MIXED procedure. The significance level was α < 0.05.

RESULTS

Data show a significant interaction between time and mental health attitudes on referrals to specialised mental health services per week. Higher scores on the attitude scale were associated with more referrals to specialised services before and 18 months after training, compared with immediately after training.

CONCLUSION

Findings indicate that, in parallel to mental health training, considering structural/organisational supports to bring about a sustainable change in the influence of PCPs' mental health attitudes on referrals is important. Our results will inform the scale-up of an initiative to further integrate mental health into primary care settings across Tunisia, and potentially other countries with similar profiles interested in further developing task-sharing initiatives.

Reflecting on knowledge translation strategies from global health research projects in Tunisia and the Republic of Côte d'Ivoire

OBJECTIVES

We describe the knowledge translation strategies in two projects and share lessons learned about knowledge sharing and uptake.

METHODS

To generate findings for dissemination: (1) the Republic of Côte d'Ivoire (RCI) project relied on a multiple case study design to document barriers and facilitators to implementing a community-led prevention strategy targeting Ebola virus disease; and (2) the Tunisia project used several designs to assess a mental health training's effectiveness, and a case study design to explore contextual factors that may influence anticipated outcomes.

RESULTS

To share findings with participants, the RCI project relied on workshops and a pamphlet, and the Tunisia project relied on a structured half-day dissemination workshop and research summary. Facilitators that may have encouraged sharing and using findings include involving champions in dissemination activities, ongoing collaboration, and developing/implementing context-specific knowledge sharing strategies. Barriers include omitting to assess strategies, limited consideration of a wider audience, and the exclusion of a knowledge translation training component.

CONCLUSIONS

Our experiences might be useful to contexts involved in global and public health research that wish to address the "know-do gap."

Theoretical analysis of policies to improve the recruitment and retention of rural physicians

The lack of success in resolving the shortage of rural physicians in Organisation for Economic Cooperation and Development countries has been attributed to the weakness of implemented policies. This research examines the theoretical plausibility of policies to improve the recruitment and retention of rural physicians, first, by modelling the policies; and then, by describing how they might achieve their intended outcome based on a theoretical analysis. A theory-driven method relying on published research and expert analysis is used. A conceptual model is created to represent the policies and their underlying assumptions. Then, the functional mechanism of the policies is defined. This research demonstrates that financial, educational and tailored interventions might improve rural physician recruitment and retention, but that regulatory interventions are unlikely to do this. The majority of the policies implemented in Organisation for Economic Cooperation and Development countries are therefore theoretically plausible.

Governance of health research funding institutions: an integrated conceptual framework and actionable functions of governance

BACKGROUND

Health research has scientific, social and political impacts. To achieve such impacts, several institutions need to participate; however, health research funding institutions are seldom nominated in the literature as essential players. The attention they have received has so far focused mainly on their role in knowledge translation, informing policy-making and the need to organise health research systems. In this article, we will focus solely on the governance of national health research funding institutions. Our objectives are to identify the main functions of governance for such institutions and actionable governance functions. This research should be useful in several ways, including in highlighting, tracking and measuring the governance trends in a given funding institution, and to forestall low-level governance.

METHODS

First, we reviewed existing frameworks in the grey literature, selecting seven relevant documents. Second, we developed an integrated framework for health research funding institution governance and management. Third, we extracted actionable information for governance by selecting a mix of North American, European and Asian institutions that had documentation available in English (e.g. annual report, legal status, strategy).

RESULTS

The framework contains 13 functions - 5 dedicated to governance (intelligence acquisition, resourcing and instrumentation, relationships management, accountability and performance, and strategy formulation), 3 dedicated to management (priority-setting, financing and knowledge transfer), and 5 dedicated to transversal logics that apply to both governance and management (ethics, transparency, capacity reinforcement, monitoring and evaluation, and public engagement).

CONCLUSIONS

Herein, we provide a conceptual contribution for scholars in the field of governance and health research as well as a practical contribution, with actionable functions for high-level managers in charge of the governance of health research funding institutions.

What are the characteristics of the champion that influence the implementation of quality improvement programs?

BACKGROUND

Quality improvement in Healthcare is the new fashion actually. Rich countries and developing countries alike are trying to implement quality improvement initiatives to improve their performance and the quality of care. There is evidence in the scientific literature that the existence of a "champion" can play an important role in the successful implementation of quality improvement strategies. Most of the time, people get stuck at the implementation level: they know what to do but they fail to execute it in the organizational setting. That's where a champion can be useful to facilitate the success of the change. There is a paucity of research on the link between the champion and the implementation of quality improvement programs. The aim of the study was to investigate the perceptions of stakeholders about the characteristics and qualities of the champion that could facilitate the successful implementation of quality improvement programs in health care settings in Haiti.

METHODS

Twenty semi-structured individual interviews and one small group discussion (n = 4) with providers, administrators, directors, and NGO representatives were conducted during a six months period. The total sample size was twenty-four (n = 24). The methods were informed by grounded theory and the data were analyzed using the constant comparative method and thematic content analysis approach.

RESULTS

The analysis resulted in eleven themes describing the characteristics and qualities of a successful champion: Communication and persuasion, proactivity, humility, horizontal and collective leadership style, sense of responsibility and accountability, go-ahead type, empathy, dedication and motivation, ability to inspire and motivate people, have a vision, and encourage learning.

CONCLUSIONS

It is important to support and encourage champions in the health care systems in developing countries to master and exhibit those qualities and characteristics in order to lead a team for the successful implementation of quality improvement initiatives in the health facilities. More research is needed to understand how to better articulate those qualities in the context of the Haitian health care system.

[Health Ethics in Benin and HIV-AIDS : What are the stakes]

As part of the fight against HIV-AIDS, an effort was made at the ethical component, namely that there are legal texts, institutional and ethical. There are ethics committees (three) that give reasoned opinions on study protocols and are endeavoring to raise awareness of the actors. But we note that there is not yet a real ownership and adoption of ethical practice by them. This study targeted research projects on HIV-AIDS and centers supported PLHIV in order to analyze ethical issues : 1) the method of recruitment of participants and beneficiaries ; 2) obtaining informed consent from them ; 2) measures of confidentiality and anonymity ; 3) the integrity of staff of these projects and centers and conflicts of interest. A thematic analysis of data collected, which is done, after semi-structured interviews, helped to highlight the issues related to the recruitment process, obtaining informed consent, confidentiality measures and anonymity, integrity and Conflict of Interest. Let us remember that what is done, not done yet in the forms of art. Constant monitoring is called for, as leaders with ethics committees.They are supposed to play fully their roles.

"We find what we look for, and we look for what we know": factors interacting with a mental health training program to influence its expected outcomes in Tunisia

BACKGROUND

Primary care physicians (PCPs) working in mental health care in Tunisia often lack knowledge and skills needed to adequately address mental health-related issues. To address these lacunas, a training based on the Mental Health Gap Action Programme (mhGAP) Intervention Guide (IG) was offered to PCPs working in the Greater Tunis area between February and April 2016. While the mhGAP-IG has been used extensively in low- and middle-income countries (LMICs) to help build non-specialists' mental health capacity, little research has focused on how contextual factors interact with the implemented training program to influence its expected outcomes. This paper's objective is to fill that lack.

METHODS

We conducted a case study with a purposeful sample of 18 trained PCPs. Data was collected by semi-structured interviews between March and April 2016. Qualitative data was analyzed using thematic analysis.

RESULTS

Participants identified more barriers than facilitators when describing contextual factors influencing the mhGAP-based training's expected outcomes. Barriers were regrouped into five categories: structural factors (e.g., policies, social context, local workforce development, and physical aspects of the environment), organizational factors (e.g., logistical issues for the provision of care and collaboration within and across healthcare organizations), provider factors (e.g., previous mental health experience and personal characteristics), patient factors (e.g., beliefs about the health system and healthcare professionals, and motivation to seek care), and innovation factors (e.g., training characteristics). These contextual factors interacted with the implemented training to influence knowledge about pharmacological treatments and symptoms of mental illness, confidence in providing treatment, negative beliefs about certain mental health conditions, and the understanding of the role of PCPs in mental health care delivery. In addition, post-training, participants still felt uncomfortable with certain aspects of treatment and the management of some mental health conditions.

CONCLUSIONS

Findings highlight the complexity of implementing a mhGAP-based training given its interaction with contextual factors to influence the attainment of expected outcomes. Results may be used to tailor structural, organizational, provider, patient, and innovation factors prior to future implementations of the mhGAP-based training in Tunisia. Findings may also be used by decision-makers interested in implementing the mhGAP-IG training in other LMICs.

Mental health knowledge, attitudes, and self-efficacy among primary care physicians working in the Greater Tunis area of Tunisia

BACKGROUND

Non-specialists' involvement in mental health care is encouraged in the field of global mental health to address the treatment gap caused by mental illness, especially in low- and middle-income countries. While primary care physicians (PCPs) are involved in mental health care in Tunisia, a lower-middle-income country in North Africa, it is unclear to what extent they are prepared and willing to address mental health problems, substance use disorders, and suicide/self-harm. In this context, we aim (1) to report on mental health knowledge, attitudes, and self-efficacy among a sample of PCPs working in the Greater Tunis area, prior to the implementation of a mental health training program developed by the World Health Organization; and (2) to identify what characteristics are associated with these competencies.

METHODS

In total, 112 PCPs completed questionnaires related to their socio-demographic and practice characteristics, as well as their mental health knowledge, attitudes, and self-efficacy. Descriptive analyses and regression models were performed.

FINDINGS

PCPs had more knowledge about depression, symptoms related to psychosis, and best practices after a suicide attempt; had favourable attitudes about distinctions between physical and mental health, learning about mental health, and the acceptance of colleagues with mental health issues; and believed most in their capabilities related to depression and anxiety. However, most PCPs had less knowledge about substance use disorders and myths about suicide attempts; had unfavorable attitudes about the dangerousness of people with mental health problems, personal disclosure of mental illness, non-specialists' role in assessing mental health problems, and personal recovery; and believed the least in their capabilities related to substance use disorders, suicide/self-harm, and psychosis. Participation in previous mental health training, weekly hours (and weekly hours dedicated to mental health), weekly provision of psychoeducation, and certain work locations were associated with better mental health competencies, whereas mental health knowledge was negatively associated with weekly referrals to specialized services.

CONCLUSIONS

Findings suggest that PCPs in our sample engage in mental health care, but with some gaps in competencies. Mental health training and increased interactions/involvement with people consulting for mental health issues may help further develop non-specialists' mental health competencies, and integrate mental health into primary care settings.

Building system capacity for the integration of mental health at the level of primary care in Tunisia: a study protocol in global mental health

BACKGROUND

In low- and middle-income countries (LMICs), addressing the high prevalence of mental disorders is a challenge given the limited number and unequal distribution of specialists, as well as scarce resources allocated to mental health. The Mental Health Gap Action Programme (mhGAP) and its accompanying Intervention Guide (IG), developed by the World Health Organization (WHO), aim to address this challenge by training non-specialists such as general practitioners (GPs) in mental health care. This trial aims to implement and evaluate an adapted version of the mhGAP-IG (version 1.0) offered to GPs in 2 governorates of Tunisia (i.e., Tunis and Sousse), in order to uncover important information regarding implementation process and study design before country-wide implementation and evaluation.

METHODS/DESIGN

First, a systematic review will be conducted to explore types and effectiveness of mental health training programs offered to GPs around the world, with a specific focus on programs implemented and evaluated in LMICs. Second, a cluster randomized controlled trial (RCT) will be conducted to evaluate the effectiveness of the implemented training based on the mhGAP-IG (version 1.0). Third, multiple case study design will be used to explore how contextual factors impact the successful implementation of the training and desired outcomes.

DISCUSSION

In Tunisia, an important need exists to further develop proximity health services and to address the growing mental health treatment gap. One solution is to train GPs in the detection, treatment, and management of mental health problems, given their strategic role in the healthcare system. This trial thus aims to implement and evaluate an adapted version of a training based on the mhGAP-IG (version 1.0) in Tunis and Sousse before country-wide implementation and evaluation. Several contributions are envisioned: adding to the growing evidence on the mhGAP and its accompanying guide, especially in French-speaking nations; building research capacity in Tunisia and more generally in LMICs by employing rigorous designs; evaluating an adapted version of the mhGAP-IG (version 1.0) on a sample of GPs; generating important information regarding implementation process and study design before country-wide implementation; and complimenting the trial results with implementation analysis, a priority in global mental health.

Creating a new articulation between research and practice through policy? The views and experiences of researchers and practitioners

OBJECTIVES

In 1990, the Quebec Social Research Council - a body financing social research in Quebec, Canada - launched a new policy encouraging the development of social research units within health care organizations. Through financial incentives, it encouraged the implementation of long-term collaborations between researchers and practitioners with the purpose of transforming both scientific knowledge production and professional practices. This paper examines the perceptions of researchers and practitioners regarding the attributes and the usefulness of this collaborative research policy.

METHODS

A self-administered survey was sent to all the researchers (n = 146; response rate 78.1%) and practitioners (n = 204; response rate 44.1%) involved in the 21 collaborative research teams funded in 1998. T-tests were performed in order to assess the difference between the perceptions of researchers and practitioners in five key dimensions of collaborative research.

RESULTS

The results showed that, contrary to expectations, researchers and practitioners shared fairly similar views regarding the various dimensions of collaborative research. They both agreed that their involvement within collaborative research teams had contributed to the development of new skills and practices but had not facilitated their participation in external activities nor their involvement in networks and organizations that influence environments in which public policies and practices are deployed. They also both encountered some difficulties in putting the dimensions that they highly valued into practice.

CONCLUSIONS

Collaborative research within health care organizations succeeded in fostering the implementation of new modes of knowledge production and intervention. Nevertheless, special attention needs to be given to the development of strategies to reduce the discrepancies between values and practices.

A Collaborative Approach to a Chronic Care Problem

Quality improvement collaboratives (QICs) are popular vehicles for supporting healthcare improvement; however, the effectiveness of these models and the factors associated with their success are not fully understood. This paper presents a QIC in the Canadian context, where provincial healthcare systems have historically faced difficulty in transcending their structural and political limitations as well as moving from reactive models of care (prioritizing illness treatment in a hospital-reliant system) to more proactive ones (prioritizing population health in a primary care-based system). In March 2012, in a move that has been described as "unprecedented," 17 health regions across four provinces in Atlantic Canada, together with the Canadian Foundation for Healthcare Improvement (CFHI), developed a collaborative to improve chronic disease prevention and management. This paper introduces the Atlantic Healthcare Collaboration for Innovation and Improvement in Chronic Disease (AHC), reflecting on the experience of developing and implementing the model, which involved teams of front-line clinicians and managers working with CFHI faculty, coaches and staff to assess, design, implement, evaluate and share healthcare improvements for people living with chronic diseases. The paper shares key results and lessons learned from the AHC QIC experience, thus far, for improving chronic disease prevention and management in healthcare in Canada.

Exploring the diversity of conceptualizations of work (dis)ability: a scoping review of published definitions

PURPOSE

Researchers are confronted to numerous definitions of work ability/disability, influenced by their context of emergence, discipline, purpose, underlying paradigm and relationship to time. This study provides an in-depth analysis of the concept through a systematic scoping review and the development of an integrative concept map of work (dis)ability. The research questions are: How has work (dis)ability been conceptualized from the perspectives of research, practice, policy and industry in the published scientific literature? How has the conceptualization of work (dis)ability evolved over time?

METHODS

A search strategy was designed with a library scientist to retrieve scientific publications containing explicit definition(s) of work (dis)ability in leading-edge databases. The screening and the extraction of the definitions were achieved by duplicate assessment. The definitions were subject to a comparative analysis based on the grounded theory approach.

RESULTS

In total, 423 abstracts were retrieved from the bibliographic databases. After removing duplicates, 280 unique records were screened for inclusion. A final set of 115 publications containing unique original conceptual definitions served as basis for analysis.

CONCLUSIONS

The scientific literature does not reflect a shared, integrated vision of the exact nature and dimensions of work (dis)ability. However, except for a few definitions, there seems to be a consensus that work (dis)ability is a relational concept resulting from the interaction of multiple dimensions that influence each other through different ecological levels. The conceptualization of work (dis)ability also seems to have become more dynamic over time. The way work (dis)ability is defined has important implications for research, compensation and rehabilitation.

Organizational impact of evidence-informed decision making training initiatives: a case study comparison of two approaches

BACKGROUND

The impact of efforts by healthcare organizations to enhance the use of evidence to improve organizational processes through training programs has seldom been assessed. We therefore endeavored to assess whether and how the training of mid- and senior-level healthcare managers could lead to organizational change.

METHODS

We conducted a theory-driven evaluation of the organizational impact of healthcare leaders' participation in two training programs using a logic model based on Nonaka's theory of knowledge conversion. We analyzed six case studies nested within the two programs using three embedded units of analysis (individual, group and organization). Interviews were conducted during intensive one-week data collection site visits. A total of 84 people were interviewed.

RESULTS

We found that the impact of training could primarily be felt in trainees' immediate work environments. The conversion of attitudes was found to be easier to achieve than the conversion of skills. Our results show that, although socialization and externalization were common in all cases, a lack of combination impeded the conversion of skills. We also identified several individual, organizational and program design factors that facilitated and/or impeded the dissemination of the attitudes and skills gained by trainees to other organizational members.

CONCLUSIONS

Our theory-driven evaluation showed that factors before, during and after training can influence the extent of skills and knowledge transfer. Our evaluation went further than previous research by revealing the influence--both positive and negative--of specific organizational factors on extending the impact of training programs.

[Strategies to increase the brief interventions in smoking cessation among nurses in hospital settings: experimental study]

INTRODUCTION

Research results demonstrate a decrease in cigarette smoking when preventive professional interventions are routinely carried out. Literature reports that 30% of hospital nurses assess their patient smoking habits. The objective of the present study is to compare, on medical and surgical units, the effectiveness of three strategies (interactive educational session, recall, and both together) to a control group, on the number of nursing interventions pertaining to cessation of cigarette smoking. Research design is experimental with group randomisation. Pre and post strategy multi-measurements (at 1 and 3 months) are sought from nursing staff (69), patients and patient charts (351). Results show that nursing staff assesses cigarette smoking habits for only 35.7% of the patients, and their intent to stop smoking only of the time. Results show that the educational strategy increases the number of nursing interventions during a short period (1 month), and decreases perception of barriers to tobacco counselling. Impact of recall could not be assessed as it was not introduced as planned.

CONCLUSION

Considering modest results from the strategies, the interactive educational sessions shows a short- term effect on the nursing staff's interventions.

Communities of practice as a professional and organizational development strategy in local public health organizations in Quebec, Canada: an evaluation model

Communities of practice (CoPs) are among the professional development strategies most widely used in such fields as management and education. Though the approach has elicited keen interest, knowledge pertaining to its conceptual underpinnings is still limited, thus hindering proper assessment of CoPs' effects and the processes generating the latter. To address this shortcoming, this paper presents a conceptual model that was developed to evaluate an initiative based on a CoP strategy: Health Promotion Laboratories are a professional development intervention that was implemented in local public health organizations in Montreal (Quebec, Canada). The model is based on latest theories on work-group effectiveness and organizational learning and can be usefully adopted by evaluators who are increasingly called upon to illuminate decision-making about CoPs. Ultimately, validation of this conceptual model will help advance knowledge and practice pertaining to CoPs as well as professional and organizational development strategies in public health.

The multiple causal pathways between performance measures' use and effects

In recent decades, there has been a growing interest in the design and implementation of systems using public reporting of performance measures to improve performance. In their simplest form, such interventions rest on the market-based logic of consumers using publicly released information to modify their behavior, thereby penalizing poor performers. However, evidence from large-scale efforts to use public reporting of performance measures as an instrumental performance improvement tool suggests that the causal mechanisms involved are much more complex. This article offers a typology of four different plausible causal pathways linking public reporting of performance measures and performance improvement. This typology rests on a variety of conceptual models and a review of available empirical evidence. We then use this typology to discuss the core elements that need to be taken into account in efforts to use public reporting of performance measures as a performance improvement tool.

Determinants of pain, functional limitations and health-related quality of life six months after total knee arthroplasty: results from a prospective cohort study

Background

Total knee arthroplasty (TKA) is an effective procedure. However, for some patients, the outcomes are not satisfactory. Identification of TKA determinants could help manage these patients more efficiently. The purpose of this study was to identify pre- and perioperative determinants of pain, functional limitations and health-related quality of life (HRQoL) 6 months after TKA.

Methods

138 participants were recruited from 3 hospitals in Quebec City, Canada and followed up until 6 months after surgery. Data were collected through review of the subjects’ medical files and structured telephone interviews before and 6 months after TKA. Pain and functional limitations were measured with the Western Ontario and McMaster Osteoarthritis Index (WOMAC) and HRQoL was measured with the SF-36 Health Survey. Independent variables included demographic, socioeconomic, psychosocial, clinical and surgical characteristics of participants as well as data on health services utilization. Stepwise multiple regression analysis was used to assess the strength of the associations between the independent variables and the WOMAC and SF-36 scores.

Results

Higher preoperative pain, cruciate retaining implants and the number of complications were significantly associated with worse pain 6 months after TKA (p < 0.05) and explained 11% of the variance of the WOMAC pain score. Higher preoperative functional limitations, being single, separated, divorced or widowed, being unemployed or retired and the number of complications were significantly associated (p < 0.05) with worse functional limitations 6 months after TKA and explained 16% of the variance of the WOMAC function score. Lower preoperative HRQoL, contralateral knee pain, higher psychological distress and comorbidities were significantly associated (p < 0.05) with worse HRQoL 6 months after TKA and explained 23% of the variance of the SF-36 physical functioning score.

Conclusions

Several variables were found to be significantly associated with worse outcomes 6 months after TKA and may help identify patients at risk of poorer outcome. The identification of these determinants could help manage patients more efficiently and may help target patients who may benefit from extensive rehabilitation.

[A tool to evaluate hospital nursing practices toward smoking cessation]

Nurses in hospitals are not active in smoking cessation because of certain beliefs and attitudes. Beliefs and attitudes must be measured for changing practice in quitting smoking. The objective is to develop and validate a questionnaire on smoking cessation practices of nurses in hospitals.

METHODOLOGY

A methodological study was conducted to construct a questionnaire (n = 118) according to the theory of planned behaviour, to validate by four experts, for reliability and validation of instruments constructs (n = 38; n = 29; n = 157).

RESULTS

An initial questionnaire on practices in smoking cessation was built according to the beliefs of a convenience sample of 118 nurses. Validation of experts was conducted, and the questionnaire obtained an index of content validation (ICV) of 0.94. Subsequently, after two convenience samples (n = 38; n = 29) and a random sample (n = 157), the questionnaire obtained reliability, measured by Cronbach's alpha ranging in 0.697 and 0.93 1. Finally, moderately high correlations (0.406 to 0.569) were obtained between concepts.

CONCLUSION

A reliable and valid questionnaire in French is available to measure smoking cessation practices.

Advanced practice physiotherapy in patients with musculoskeletal disorders: a systematic review

Background

The convergence of rising health care costs and physician shortages have made health care transformation a priority in many countries resulting in the emergence of new models of care that often involve the extension of the scope of practice for allied health professionals. Physiotherapists in advanced practice/extended scope roles have emerged as key providers in such new models, especially in settings providing services to patients with musculoskeletal disorders. However, evidence of the systematic evaluation of advance physiotherapy practice (APP) models of care is scarce. A systematic review was done to update the evaluation of physiotherapists in APP roles in the management of patients with musculoskeletal disorders.

Methods

Structured literature search was conducted in 3 databases (Medline, Cinahl and Embase) for articles published between 1980 and 2011. Included studies needed to present original quantitative data that addressed the impact or the effect of APP care. A total of 16 studies met all inclusion criteria and were included. Pairs of raters used four structured quality appraisal methodological tools depending on design of studies to analyse included studies.

Results

Included studies varied in designs and objectives and could be categorized in four areas: diagnostic agreement or accuracy compared to medical providers, treatment effectiveness, economic efficiency or patient satisfaction. There was a wide range in the quality of studies (from 25% to 93%), with only 43% of papers reaching or exceeding a score of 70% on the methodological quality rating scales. Their findings are however consistent and suggest that APP care may be as (or more) beneficial than usual care by physicians for patients with musculoskeletal disorders, in terms of diagnostic accuracy, treatment effectiveness, use of healthcare resources, economic costs and patient satisfaction.

Conclusions

The emerging evidence suggests that physiotherapists in APP roles provide equal or better usual care in comparison to physicians in terms of diagnostic accuracy, treatment effectiveness, use of healthcare resources, economic costs and patient satisfaction. There is a need for more methodologically sound studies to evaluate the effectiveness APP care.

Beyond resistance: exploring health managers' propensity for participatory evaluation in a developing country

The evaluation of interventions is becoming increasing common and now often seeks to involve managers in the process. Such practical participatory evaluation (PPE) aims to increase the use of evaluation results through the participation of stakeholders. This study focuses on the propensity of health managers for PPE, as measured through the components of learning, working in groups, use of judgment and use of systematic methods. We interviewed 16 health managers to determine the meaning they ascribe to these four components in their practice in a developing country, Haïti. We found that learning was often informal and that all managers attached a negative meaning to the use of judgment. Working in groups was favored by all managers, while the health managers viewed the use of systematic methods differently than do evaluators. The administrative health managers generally ranked lower in propensity for PPE than did their clinical colleagues. Implications for the practice of evaluation are discussed in relation to the work styles exhibited by managers in everyday practice, the proactive repetition of actions, the control exercised by formal procedures, and the collective versus "solitary" image of one's environment of action.

[PMTCT in Benin: Is the pregnant women's consent free and informed?]

INTRODUCTION

In international and national HIV/AIDS policies, free and informed consent is recognized as one of the major components of testing programs. For pregnant women, free and informed consent means that they should get information on prevention of mother-to-child transmission (PMTCT), understand them and make an independent choice after weighing the risks and advantages. However, no PMTCT program looked into the issue of consent. The objective of this paper is to explore the free and informed nature of pregnant women's consent with regard to testing and their rationale for accepting to be tested.

METHODS

We used data collected within the framework of the analysis of the creation of the PMTCT program in Benin. This analysis is based on multiple case studies that covered six maternity homes selected from 56 operational sites. For the specific analysis of consent, we used both survey data and qualitative research data.

FINDINGS

Apart from three cases of secret testing, the free nature of the consent to the test is respected on the PMTCT sites. Twenty-nine cases of refusal were recorded. The reasons put forth by most pregnant women include the fear of a positive test and its consequences on family life in 55.2% of cases and the expectation of their husbands' agreement or disagreement in 27.6% of cases. On the whole, the consent was free on all the sites but its informed nature is less respected.

A mixed method study of propensity for participatory evaluation

One way to increase the use of evaluation results is practical participatory evaluation (PPE), which enables non-evaluator participants to join the evaluation process in a participatory mode. We examined the propensity for PPE of health professionals by focusing on four components: learning, working in groups, using judgment and using systematic methods. We interviewed the professionals at a Haitian health institution to determine their positioning on a scale of propensity (low, medium and high) for the four components. The professionals defined each component in relation to the energy puts into them, being more or less proactive. Facilitating elements for all three levels of propensity integration included past positive experiences, external pressure and a desire for better individual and organizational performance. Impeding factors included a lack of available resources perceived responsibilities and commitments toward private patients. The reported advantages included improved organizational performance and idea sharing, and the disadvantages included availability of, difficulty implementing solutions and altered human relationships.

Program theory evaluation: Logic analysis

Program theory evaluation, which has grown in use over the past 10 years, assesses whether a program is designed in such a way that it can achieve its intended outcomes. This article describes a particular type of program theory evaluation-logic analysis-that allows us to test the plausibility of a program's theory using scientific knowledge. Logic analysis is useful for improving the intervention or finding alternatives for achieving intended outcomes; it influences the choice of type of evaluation to conduct and strengthens the validity of subsequent evaluations. The objective of this article is to present the methodological principles and the roots of this type of program theory evaluation. We illustrate two types of logic analysis with two actual evaluation cases. There are very few published examples of program theory evaluation. This article will provide evaluators with both theoretical and practical information to help them in conceptualizing their evaluations.

[Not Available]

Theoretically, evaluation should help decision-makers address contemporary health system challenges. Paradoxically, the use of evaluation results by decision-makers remains poor, despite rapid development in the evaluation field. The level of use depends on the evaluator's ability to account for the complexity of health-care systems. The complex nature of an intervention often compels evaluators to adopt unconventional approaches to account for the roles of the players. The evaluation of a complex intervention raises conceptual, methodological, and operational challenges the evaluation has to overcome to increase the level of use of its findings by decision-makers.

Patient safety and systematic reviews: finding papers indexed in MEDLINE, EMBASE and CINAHL

OBJECTIVE

To develop search strategies for identifying papers on patient safety in MEDLINE, EMBASE and CINAHL.

METHODS

Six journals were electronically searched for papers on patient safety published between 2000 and 2006. Identified papers were divided into two gold standards: one to build and the other to validate the search strategies. Candidate terms for strategy construction were identified using a word frequency analysis of titles, abstracts and keywords used to index the papers in the databases. Searches were run for each one of the selected terms independently in every database. Sensitivity, precision and specificity were calculated for each candidate term. Terms with sensitivity greater than 10% were combined to form the final strategies. The search strategies developed were run against the validation gold standard to assess their performance. A final step in the validation process was to compare the performance of each strategy to those of other strategies found in the literature.

RESULTS

We developed strategies for all three databases that were highly sensitive (range 95%-100%), precise (range 40%-60%) and balanced (the product of sensitivity and precision being in the range of 30%-40%). The strategies were very specific and outperformed those found in the literature.

CONCLUSION

The strategies we developed can meet the needs of users aiming to maximise either sensitivity or precision, or seeking a reasonable compromise between sensitivity and precision, when searching for papers on patient safety in MEDLINE, EMBASE or CINAHL.

Does accreditation stimulate change? A study of the impact of the accreditation process on Canadian healthcare organizations

BACKGROUND

One way to improve quality and safety in healthcare organizations (HCOs) is through accreditation. Accreditation is a rigorous external evaluation process that comprises self-assessment against a given set of standards, an on-site survey followed by a report with or without recommendations, and the award or refusal of accreditation status. This study evaluates how the accreditation process helps introduce organizational changes that enhance the quality and safety of care.

METHODS

We used an embedded multiple case study design to explore organizational characteristics and identify changes linked to the accreditation process. We employed a theoretical framework to analyze various elements and for each case, we interviewed top managers, conducted focus groups with staff directly involved in the accreditation process, and analyzed self-assessment reports, accreditation reports and other case-related documents.

RESULTS

The context in which accreditation took place, including the organizational context, influenced the type of change dynamics that occurred in HCOs. Furthermore, while accreditation itself was not necessarily the element that initiated change, the accreditation process was a highly effective tool for (i) accelerating integration and stimulating a spirit of cooperation in newly merged HCOs; (ii) helping to introduce continuous quality improvement programs to newly accredited or not-yet-accredited organizations; (iii) creating new leadership for quality improvement initiatives; (iv) increasing social capital by giving staff the opportunity to develop relationships; and (v) fostering links between HCOs and other stakeholders. The study also found that HCOs' motivation to introduce accreditation-related changes dwindled over time.

CONCLUSIONS

We conclude that the accreditation process is an effective leitmotiv for the introduction of change but is nonetheless subject to a learning cycle and a learning curve. Institutions invest greatly to conform to the first accreditation visit and reap the greatest benefits in the next three accreditation cycles (3 to 10 years after initial accreditation). After 10 years, however, institutions begin to find accreditation less challenging. To maximize the benefits of the accreditation process, HCOs and accrediting bodies must seek ways to take full advantage of each stage of the accreditation process over time.

[Analysis of the nursing role in the care of patients with neuromuscular disorders]

The nursing role in neuromuscular disorders has been shown as a promising solution in service organization. However, the role of neuromuscular nurses has scarcely been addressed in the literature. The present evaluation process was geared toward defining nursing role in relation to systematic follow-up of neuromuscular disorders and to assess its theoretical background.

TOCSIN: a proposed dashboard of indicators to control healthcare-associated infections

Healthcare-associated infections (HAIs) constitute a major safety problem. Healthcare managers need complete and valid information to fight against these infections. The purpose of this study was to develop a dashboard of indicators to help healthcare managers monitor HAIs. A pilot testing approach was used that was composed of the following steps: literature review, consultation with infection control experts and healthcare managers, operationalization of selected indicators, data collection from six Quebec hospital complexes to test the feasibility of the selected indicators and results dissemination. The literature review identified 299 possible indicators. After consulting infection control experts and healthcare managers and having collected data in the hospitals, a proposed dashboard was created that includes 97 indicators divided in three categories (structure, process and outcome) and grouped in 22 themes. The proposed indicators are both scientifically valid and administratively feasible. However, many healthcare facilities need additional financial resources and expertise to measure these indicators and manage the information they will generate.

Evaluating Service Organization Models: The Relevance and Methodological Challenges of a Configurational Approach

Based on the example of the evaluation of service organization models, this article shows how a configurational approach overcomes the limits of traditional methods which for the most part have studied the individual components of various models considered independently of one another. These traditional methods have led to results (observed effects) that are difficult to interpret. The configurational approach, in contrast, is based on the hypothesis that effects are associated with a set of internally coherent model features that form various configurations. These configurations, like their effects, are context-dependent. We explore the theoretical basis of the configuration approach in order to emphasize its relevance, and discuss the methodological challenges inherent in the application of this approach through an in-depth analysis of the scientific literature. We also propose methodological solutions to these challenges. We illustrate from an example how a configurational approach has been used to evaluate primary care models. Finally, we begin a discussion on the implications of this new evaluation approach for the scientific and decision-making communities.

Use of health care services by patients with co-occurring severe mental illness and substance use disorders

BACKGROUND

To better respond to the health care needs of people with co-occurring mental illness and substance use disorders, it is vital to understand their itinerary through the health care system.

AIM

To describe the characteristics of service utilization among patients with co-occurring disorders in a large urban area.

METHOD

We used a sample (n = 5467) constituted from administrative and clinical databases. Those identified as having substance use disorders and psychoses were followed over 12 months with respect to their utilization of medical services. A descriptive analysis of the data and a two-step cluster analysis were undertaken.

RESULTS

Our analyses revealed a relatively high utilization of emergency services, outpatient clinics, private practices and hospitalization among patients with co-occurring disorders of severe mental illness and substance use. The two-step cluster analysis produced four heterogeneous groups in terms of service utilization.

CONCLUSIONS

This study demonstrates the need to develop strategies for organizing health care and services that are adapted to various sites of service utilization and to diverse profiles of patients with co-occurring mental illness and substance use disorders.

Accreditation: a cultural control strategy

PURPOSE

The purpose of this paper is to describe and understand the effects of the accreditation process on organizational control and quality management practices in two Quebec primary-care health organizations.

DESIGN/METHODOLOGY/APPROACH

A multiple-case longitudinal study was conducted taking a mixed qualitative/quantitative approach. An analytical model was developed of the effects of the accreditation process on the type of organizational control exercised and the quality management practices implemented. The data were collected through group interviews, semi-directed interviews of key informers, non-participant observations, a review of the literature, and structured questionnaires distributed to all the employees working in both institutions.

FINDINGS

The accreditation process has fostered the implementation of consultation mechanisms in self-assessment teams. Improving assessments of client satisfaction was identified as a prime objective but, in terms of the values promoted in organizations, accreditation has little effect on the perceptions of employees not directly involved in the process. As long as not all staff members have integrated the basis for accreditation and its outcomes, the accreditation process appears to remain an external, bureaucratic control instrument.

ORIGINALITY/VALUE

This study provides a theoretical model for understanding organizational changes brought about by accreditation of primary services. Through self-assessment of professional values and standards, accreditation may foster better quality management practices.

Conceptualizing performance in accreditation

OBJECTIVE

To compare the conceptualization of performance underlying different accreditation manuals.

DATA SOURCES

Accreditation manuals were selected from the 2003 WHO report titled 'Quality and Accreditation in Healthcare Services'. We used manuals from WHO-listed countries that most influenced the standards: Canada, France, the USA and Australia. The fifth manual is published by the Pan American Health Organization (PAHO).

EXTRACTION METHODS

Standards from each manual were classified by two independent reviewers. The coding grid, which was based on a Parsonian-based integrative framework on performance, was composed of performance dimensions and their interlinks/alignments.

PRINCIPAL FINDINGS

The four dimensions of quality, goal-attainment, adaptation to the external environment and values, along with their alignments, were given differing levels of importance in the five manuals. The Australian manual emphasizes all four dimensions and their alignments. The PAHO accreditation focuses mainly on quality. The manuals from Canada, France and the USA fall somewhere between the two accreditation extremes of complete versus one-dimensional. Finally, we present a taxonomy of the conceptualization of performance in accreditation manuals that distinguishes between quality-oriented and alignment-oriented accreditation manuals.

CONCLUSIONS

Specific conceptualizations of performance underlying accreditation manuals may not be neutral. Perhaps, more normative accreditation manuals are associated with authoritative management styles, or more balanced accreditation manuals with comprehensive management styles. Our comparative analysis is a first step toward better understanding the relationship between the conceptualization of performance and the management style adopted in a particular healthcare organization. This relationship could help explain the variation observed in healthcare organization performance.

Wait times for paediatric rehabilitation

BACKGROUND

Early therapy intervention for children with disabilities may improve functional outcomes. Access to paediatric rehabilitation services can sometimes be difficult.

OBJECTIVES

To describe waiting time to receive physical therapy (PT) and occupational therapy (OT) services at rehabilitation centres for young children with physical disabilities; to examine factors associated with these waiting times.

DESIGN

Prospective cohort.

SUBJECTS

Two hundred and six children with physical disabilities, aged 6 to 72 months, referred in 2002-2004 from the Montreal Children's Hospital and Sainte-Justine Hospital to paediatric rehabilitation centres.

MEASURES

Data on date of referral, age, gender and diagnosis were obtained from the hospital databases. Data on date of first PT or OT appointments at the rehabilitation centre, family socio-demographics and disability severity (WeeFIM) were obtained during parental interviews.

RESULTS

Half of the sample waited more than 7 and 11 months for PT and OT services, respectively. Shorter waiting time was significantly associated with younger child's age and referral to one particular rehabilitation centre.

CONCLUSION

Children with physical disabilities experience long waiting times for PT and OT rehabilitation services. Strategies to improve timely service delivery are needed.