Access to primary care for socio-economically disadvantaged older people in rural areas: exploring realist theory using structural equation modelling in a linked dataset

Methods in realist evaluation: A mapping review

Realist evaluation is becoming increasingly popular as an evaluation methodology. Its main objective is to uncover the mechanisms that lead to observed outcomes following an intervention and the contextual conditions that enabled this. The focus is on explaining why, for whom and in what circumstances an intervention works. It is a theory-driven approach and is explicitly method neutral, meaning that both quantitative and qualitative data collection methods can be used to unearth the underlying mechanisms that cause the intervention outcomes. In this review, we aim to map the methods used in realist evaluation studies, to draw lessons from the findings and to reflect on ways forward. We found that qualitative methods and interviews specifically are most commonly used in realist evaluations; that theory is often absent behind the methods and sampling techniques used; and that more innovative methods remain underexplored. We conclude the review by proposing four ways forward: (1) developing realist surveys, (2) exploring the relevance of innovative methods, (3) increasing the attention paid to sampling procedures and (4) strengthening the theory-driven nature of method. We believe that these four action points can strengthen the practice of realist evaluation and its outcomes.

Availability and Accessibility of Primary Care for the Remote, Rural, and Poor Population of Indonesia

Background: Adopting Universal Health Coverage for implementation of a national health insurance system [Jaminan Kesehatan Nasional (JKN)/Badan Penyelenggara Jaminan Sosial or the Indonesian National Social Health Insurance Scheme (BPJS)] targets the 255 million population of Indonesia. The availability, accessibility, and acceptance of healthcare services are the most important challenges during implementation. Referral behavior and the utilization of primary care structures for underserved (rural/remote regions) populations are key guiding elements. In this study, we provided the first assessment of BPJS implementation and its resulting implications for healthcare delivery based on the entire insurance dataset for the initial period of implementation, specifically focusing on poor and remote populations. Methods: Demographic, economic, and healthcare infrastructure information was obtained from public resources. Data about the JKN membership structure, performance information, and reimbursement were provided by the BPJS national head office. For analysis, an ANOVA was used to compare reimbursement indexes for primary healthcare (PHC) and advanced healthcare (AHC). The usage of primary care resources was analyzed by comparing clustered provinces and utilization indices differentiating poor [Penerima Bantuan Iur (PBI) membership] and non-poor populations (non-PBI). Factorial and canonical discrimination analyses were applied to identify the determinants of PHC structures. Results: Remote regions cover 27.8% of districts/municipalities. The distribution of the poor population and PBI members were highly correlated (r2 > 0.8; p < 0.001). Three clusters of provinces [remote high-poor (N = 13), remote low-poor (N = 15), non-remote (N = 5)] were identified. A discrimination analysis enabled the >82% correct cluster classification of infrastructure and human resources of health (HRH)-related factors. Standardized HRH (nurses and general practitioners [GP]) availability showed significant differences between clusters (p < 0.01), whereas the availability of hospital beds was weakly correlated. The usage of PHC was ~2-fold of AHC, while non-PBI members utilized AHC 4- to 5-fold more frequently than PBI members. Referral indices (r2 = 0.94; p < 0.001) for PBI, non-PBI, and AHC utilization rates (r2 = 0.53; p < 0.001) were highly correlated. Conclusion: Human resources of health availability were intensively related to the extent of the remote population but not the numbers of the poor population. The access points of PHC were mainly used by the poor population and in remote regions, whereas other population groups (non-PBI and non-Remote) preferred direct access to AHC. Guiding referral and the utilization of primary care will be key success factors for the effective and efficient usage of available healthcare infrastructures and the achievement of universal health coverage in Indonesia. The short-term development of JKN was recommended, with a focus on guiding referral behavior, especially in remote regions and for non-PBI members.

Programme theory and realist evaluation of the 'Smoke-Free Vocational Schools' research and intervention project: a study protocol

INTRODUCTION

Smoke-free school hours (SFSHs) entails a smoking ban during school hours and might be an effective intervention to reduce the high smoking prevalence in vocational schools. For SFSH to be effective, the policy must be adequately implemented and enforced; this challenge for schools constitutes a research gap. The 'Smoke-Free Vocational Schools' research and intervention project has been developed to facilitate schools' implementation of SFSH. It is scheduled to run from 2018 to 2022, with SFSH being implemented in 11 Danish vocational schools. This study protocol describes the intervention project and evaluation design of the research and intervention project.

METHODS AND ANALYSIS

The intervention project aims to develop an evidence-based model for implementing SFSH in vocational schools and similar settings. The project is developed in a collaboration between research and practice. Two public health NGOs are responsible for delivering the intervention activities in schools, while the research partner evaluates what works, for whom, and under what circumstances. The intervention lasts one year per school, targeting different socioecological levels. During the first 6 months, activities are delivered to stimulate organisational readiness to implement SFSH. Then, SFSH is established, and during the next 6 months, activities are delivered to stimulate implementation of SFSH into routine practice. The epistemological foundation is realistic evaluation. The evaluation focuses on both implementation and outcomes. Process evaluation will determine the level of implementation and explore what hinders or enables SFSH becoming part of routine practice using qualitative and quantitative methods. Outcomes evaluation will quantitively assess the intervention's effectiveness, with the primary outcome measure being changes in smoking during school hours.

ETHICS AND DISSEMINATION

Informed consent will be obtained from study participants according to the General Data Protection Regulation (GDPR) and Danish data protection law. The study adheres to Danish ethics procedures. Study findings will be disseminated at conferences and further published in open-access peer-reviewed journals.

Serious Gaming During Multidisciplinary Rehabilitation for Patients With Chronic Pain or Fatigue Symptoms: Mixed Methods Design of a Realist Process Evaluation

BACKGROUND

Serious gaming could support patients in learning to cope with chronic pain or functional somatic syndromes and reduce symptom burdens.

OBJECTIVE

To realize this potential, insight is needed into how, why, for whom, and when it works in actual treatment circumstances.

METHODS

Following a realist approach, process evaluations were performed before, during, and after a two-armed, natural quasi-experiment (n=275). A group of patients with interfering chronic pain or fatigue symptoms received a short additional blended mindfulness-based serious gaming intervention during a multidisciplinary rehabilitation program. A control group only received the regular rehabilitation program. During two sessions before and one session after the experiment, expectations about serious gaming processes were discussed in focus groups with local care providers, implementers, and experts. Patients participated in a survey (n=114) and in semistructured interviews (n=10). The qualitative data were used to develop tentative expectations about aspects of serious gaming that, in certain patients and circumstances, trigger mechanisms of learning and health outcome change. Hypotheses about indicative quantitative data patterns for tentative expectations were formulated before inspecting, describing, and analyzing-with regression models-routinely collected clinical outcome data. An updated program theory was formulated after mixing the qualitative and quantitative results.

RESULTS

Qualitative data showed that a subset of patients perceived improvement of their self-awareness in moments of daily social interactions. These results were explained by patients, who played the serious game LAKA, as a "confrontation with yourself," which reflected self-discrepancies. Important characteristics of serious gaming in the study's context included innovation factors of relative advantage with experiential learning opportunity, compatibility with the treatment approach, and the limited flexibility in regard to patient preferences. Perceived patient factors included age and style of coping with stress or pain. Learning perceptions could also depend on care provider role-taking and the planning and facilitating (ie, local organization) of serious gaming introduction and feedback sessions in small groups of patients. Quantitative data showed very small average differences between the study groups in self-reported depression, pain, and fatigue changes (-.07<beta<-.17, all 95% CI upper bounds <0), which were mediated by small group differences in mindfulness (beta=.26, 95% CI .02-.51). Mindfulness changes were positively associated with patient involvement in serious gaming (n=114, beta=.36, P=.001). Acceptance of serious gaming was lower in older patients. Average health outcome changes went up to a medium size in patients that reported lower active coping with stress and lower pain coping before serious gaming. Mindfulness changes and gaming acceptance perceptions covaried with group structure and immediate feedback sessions after serious gaming.

CONCLUSIONS

This study developed transferable insight into how and why serious gaming can facilitate additional learning about coping in order to reduce burdens of chronic pain or fatigue symptoms in certain patients and in actual treatment circumstances. Future studies are needed to continue the development of this fallible theory. Such research will further support decisions about using, designing, allocating, and tailoring serious gaming to optimize important patient health benefits.

TRIAL REGISTRATION

Netherlands Trial Register NTR6020; https://www.trialregister.nl/trial/5754.

Improving primary care Access in Context and Theory (I-ACT trial): a theory-informed randomised cluster feasibility trial using a realist perspective

Background

Primary care access can be challenging for older, rural, socio-economically disadvantaged populations. Here we report the I-ACT cluster feasibility trial which aims to assess the feasibility of trial design and context-sensitive intervention to improve primary care access for this group and so expand existing theory.

Methods

Four general practices were recruited; three randomised to intervention and one to usual care. Intervention practices received £1500, a support manual and four meetings to develop local, innovative solutions to improve the booking system and transport.

Patients aged over 64 years old and without household car access were recruited to complete questionnaires when booking an appointment or attending the surgery. Outcome measures at 6 months included: self-reported ease of booking an appointment and transport; health care use; patient activation; capability; and quality of life. A process evaluation involved observations and interviews with staff and participants.

Results

Thirty-four patients were recruited (26 female, eight male, mean age 81.6 years for the intervention group and 79.4 for usual care) of 1143 invited (3% response rate). Most were ineligible because of car access. Twenty-nine participants belonged to intervention practices and five to usual care. Practice-level data was available for all participants, but participant self-reported data was unavailable for three. Fifty-six appointment questionnaires were received based on 150 appointments (37.3%).

Practices successfully designed and implemented the following context-sensitive interventions: Practice A: a stacked telephone system and promoting community transport; Practice B: signposting to community transport, appointment flexibility, mobility scooter charging point and promoting the role of receptionists; and Practice C: local taxi firm partnership and training receptionists. Practices found the process acceptable because it gave freedom, time and resource to be innovative or provided an opportunity to implement existing ideas. Data collection methods were acceptable to participants, but some found it difficult remembering to complete booking and appointment questionnaires. Expanded theory highlighted important mechanisms, such as reassurance, confidence, trust and flexibility.

Conclusions

Recruiting older participants without access to a car proved challenging. Retention of participants and practices was good but only about a third of appointment questionnaires were returned. This study design may facilitate a shift from one-size-fits-all interventions to more context-sensitive interventions.

Trial registration

ISRCTN18321951, Registered on 6 March 2017.

Electronic supplementary material

The online version of this article (10.1186/s13063-019-3299-2) contains supplementary material, which is available to authorized users.