Development and Valuation of a Preference-Weighted Measure in Age-Related Macular Degeneration From the Vision Impairment in Low Luminance Questionnaire: A MACUSTAR Report

OBJECTIVES

This study generates VILL-UI (Vision Impairment in Low Luminance - Utility Index), a preference-weighted measure (PWM) derived from the VILL-33 measure for use in patients with age-related macular degeneration (AMD) and valued to generate United Kingdom and German preference weights.

METHODS

A PWM consists of a classification system to describe health and utility values for every state described by the classification. The classification was derived using existing data collected as part of the MACUSTAR study, a low-interventional study on AMD, conducted at 20 clinical sites across Europe. Items were selected using psychometric and Rasch analyses, published criteria around PWM suitability, alongside instrument developer views and concept elicitation work that informed VILL-33 development. An online discrete choice experiment (DCE) with duration of the health state was conducted with the United Kingdom and German public. Responses were modeled to generate utility values for all possible health states.

RESULTS

The classification system has 5 items across the 3 domains of VILL-33: reading and accessing information, mobility and safety, and emotional well-being. The DCE samples (United Kingdom: n = 1004, Germany: n = 1008) are broadly representative and demonstrate good understanding of the tasks. The final DCE analyses produce logically consistent and significant coefficients.

CONCLUSIONS

This study enables responses to VILL-33 to be directly used to inform economic evaluation in AMD. The elicitation of preferences from both United Kingdom and Germany enables greater application of VILL-UI for economic evaluation throughout Europe. VILL-UI fills a gap in AMD in which generic preference-weighted measures typically lack sensitivity.

Exploring the Factors that Drive Clinical Negligence Claims: Stated Preferences of Those Who Have Experienced Unintended Harm

BACKGROUND

Better understanding of the factors that influence patients to make a financial claim for compensation is required to inform policy decisions. This study aimed to assess the relative importance of factors that influence those who have experienced a patient safety incident (PSI) to make a claim for compensation.

METHOD

Participants completed an online discrete choice experiment (DCE) involving 10 single profile tasks where they chose whether or not to file a claim. DCE data were modelled using logistic, mixed logit and latent class regressions; scenario analyses, external validity, and willingness to accept were also conducted.

RESULTS

A total of 1029 participants in the United Kingdom responded to the survey. An appropriate apology and a satisfactory investigation reduced the likelihood of claiming. Respondents were more likely to claim if they could hold those responsible accountable, if the process was simple and straightforward, if the compensation amount was higher, if the likelihood of compensation was high or uncertain, if the time to receive a decision was quicker, and if they used the government compensation scheme. Men are more likely to claim for low impact PSIs.

DISCUSSION AND CONCLUSIONS

The actions taken by the health service after a PSI, and people's perceptions about the probability of success and the size of potential reward, can influence whether a claim is made. Results show the importance of giving an appropriate apology and conducting a satisfactory investigation. This stresses the importance around how patients are treated after a PSI in influencing the clinical negligence claims that are made.

Measuring quality of life for people with common mental health problems

BACKGROUND

It is important to identify valid and acceptable outcome measures so that interventions evaluating common mental health problems can be assessed appropriately. Some advocate the use of generic preference-based measures claimed to be applicable for all health interventions, but others argue that they are insensitive for common mental health problems. The aim of this paper is to evaluate the Clinical Outcomes in Routine Evaluation-Outcome Measure (CORE-OM), to be used in cost-effectiveness studies in people with common mental health problems.

METHOD

The CORE-OM measure was tested for completeness, acceptability and responsiveness in a pilot study. Analyses for missing data, distribution of scores, and standardised response means (SRMs) were calculated.

RESULTS

Missing data did not exceed 5% for any of the CORE-6D items both at baseline and follow-up. The overall comprehension rate was high, and only 19 participants (14%) requested clarifications to complete the questionnaire. As expected in a feasibility study, there was a small and non-significant SRM.

CONCLUSION

CORE-OM is a valid and acceptable instrument to evaluate quality of life for people with common mental health problems. More research is needed with larger sample sizes to compare CORE-6D with other condition specific quality of life instruments.

Patient preferences for pilonidal sinus treatments: a discrete choice experiment survey

BACKGROUND

A range of treatments are available for pilonidal sinus disease (PSD), each of which has a different risk/benefit profile. The aim of this study was to collect patient views on which interventions they would rather avoid and which outcomes they most value for PSD.

METHOD

We conducted an online survey using the discrete choice experiment (DCE) method. DCE task involved participants choosing the best treatment option when presented with a set of competing hypothetical treatment profiles. Participants with symptomatic PSD, referred for elective surgery were recruited from 33 NHS trusts between 2020 and 2022. Collected DCE data were analysed using regression analyses.

RESULTS

One hundred and eleven participants completed the survey. In the overall group, low risk of infection/persistence was the most important characteristic when making a treatment decision (attribute importance score of 70%), followed by treatments with shorter recovery time with an attribute importance score of 30%. The results demonstrated that patients are willing to accept trade-offs between treatment recovery time and risk of infection/persistence. Patients above 30 years old are willing to accept a higher chance of treatment failure in exchange for rapid treatment recovery (risk tolerance between 22.35 - 34.67 percentage points). Conversely, patients in the younger age groups, were risk averse, and were only willing to accept a small risk 1.51-2.15 in exchange for a treatment with faster recovery time. All patient groups appear to the reject the excision and leave open technique due to the need for protracted nursing care.

CONCLUSION

This study highlights the need for shared decision making when it comes to surgery for PSD.

Surgeon preference for treatment allocation in older people facing major gastrointestinal surgery: an application of the discrete choice experiment methodology

AIM

Variation in major gastrointestinal surgery rates in the older population suggests heterogeneity in surgical management. A higher prevalence of comorbidities, frailty and cognitive impairments in the older population may account for some variation. The aim of this study was to determine surgeon preference for major surgery versus conservative management in hypothetical patient scenarios based on key attributes.

METHOD

A survey was designed according to the discrete choice methodology guided by a separate qualitative study. Questions were designed to test for associations between key attributes (age, comorbidity, urgency of presentation, pathology, functional and cognitive status) and treatment preference for major gastrointestinal surgery versus conservative management. The survey consisting of 18 hypothetical scenarios was disseminated electronically to UK gastrointestinal surgeons. Binomial logistic regression was used to identify associations between the attributes and treatment preference.

RESULTS

In total, 103 responses were received after 256 visits to the questionnaire site (response rate 40.2%). Participants answered 1847 out of the 1854 scenarios (99.6%). There was a preference for major surgery in 1112/1847 (60.2%) of all scenarios. Severe comorbidities (OR 0.001, 95% CI 0.000-0.030; P = 0.000), severe cognitive impairment (OR 0.001, 95% CI 0.000-0.033; P = 0.000) and age 85 years and above (OR 0.028, 95% CI 0.005-0.168; P = 0.000) were all significant in the decision not to offer major gastrointestinal surgery.

CONCLUSION

This study has demonstrated variation in surgical treatment preference according to key attributes in hypothetical scenarios. The development of fitness-stratified guidelines may help to reduce variation in surgical practice in the older population.

Patient preferences and current practice for adults with steroid-resistant ulcerative colitis: POPSTER mixed-methods study

Background

Corticosteroids are a mainstay of the treatment of moderately severe relapses of ulcerative colitis, yet almost 50% of patients do not respond fully to these and risk prolonged steroid use and side effects. There is a lack of clarity about the definitions of steroid resistance, the optimum choice of treatment, and patient and health-care professional treatment preferences.

Objectives

The overall aim of this research was to understand how steroid-resistant ulcerative colitis is managed in adult secondary care and how current practice compares with patient and health-care professional preferences.

Design

A mixed-methods study, including an online survey, qualitative interviews and discrete choice experiments.

Setting

NHS inflammatory bowel disease services in the UK.

Participants

Adults with ulcerative colitis and health-care professionals treating inflammatory bowel disease.

Results

We carried out a survey of health-care professionals (n = 168), qualitative interviews with health-care professionals (n = 20) and patients (n = 33), discrete choice experiments with health-care professionals (n = 116) and patients (n = 115), and a multistakeholder workshop (n = 9). The interviews with and survey of health-care professionals showed that most health-care professionals define steroid resistance as an incomplete response to 40 mg per day of prednisolone after 2 weeks. The survey also found that anti-tumour necrosis factor drugs (particularly infliximab) are the most frequently offered drugs across most steroid-resistant (and steroid-dependent) patient scenarios, but they are less frequently offered to thiopurine-naive patients. Patient interviews identified several factors influencing their treatment choices, including effectiveness of treatment, recommendations from health-care professionals, route of administration and side effects. Over time, depending on the severity and duration of symptoms and, crucially, as medical treatment options become exhausted, patients are willing to try alternative treatments and, eventually, to undergo surgery. The discrete choice experiments found that the probability of remission and of side effects strongly influences the treatment choices of both patients and health-care professionals. Patients are less likely to choose a treatment that takes longer to improve symptoms. Health-care professionals are willing to make difficult compromises by tolerating greater safety risks in exchange for therapeutic benefits. The treatments ranked most positively by patients were infliximab and tofacitinib (each preferred by 38% of patients), and the predicted probability of uptake by health-care professionals was greatest for infliximab (62%).

Limitations

The survey and the discrete choice experiments with patients and health-care professionals are limited by their relatively small sample sizes. The qualitative studies are subject to selection bias. The timing of the different substudies, both before and during the COVID-19 pandemic, is a potential limitation.

Conclusions

We have identified factors influencing treatment decisions for steroid-resistant ulcerative colitis and the characteristics to consider when choosing treatments to evaluate in future randomised controlled trials. The findings may be used to improve discussions between patients and health-care professionals when they review treatment options for steroid-resistant ulcerative colitis.

Future work

This research highlights the need for consensus work to establish an agreed definition of steroid resistance in ulcerative colitis and a greater understanding of the optimal use of tofacitinib and surgery for this patient group. A randomised controlled trial comparing infliximab with tofacitinib is also recommended.

Funding

This project was funded by the National Institute for Health and Care Research (NIHR) Health Technology Assessment programme and will be published in full in Health Technology Assessment; Vol. 26, No. 41. See the NIHR Journals Library website for further project information.

A Discrete Choice Experiment to Elicit General Population Preferences Around the Factors Influencing the Choice to Make Clinical Negligence Claims

OBJECTIVES

This article determines public stated preferences around different factors that influence the choice to make clinical negligence claims against a national healthcare system.

METHODS

A large online survey was conducted using a discrete choice experiment (DCE) with the UK general population (N = 1013). DCE tasks involved a single profile and participants chose whether to make a claim for compensation (yes/no) after one of 3 randomly allocated patient safety incident (PSI) "scenarios" of different severities (mild, moderate, severe). DCE attributes described the actions of the healthcare system after a PSI and characteristics of the clinical negligence claims process. The data were modeled separately for each scenario (mild, moderate, severe) using logistic regression. Marginal effects and the probability of making a claim in a baseline case were estimated.

RESULTS

Probability of choosing to claim was reduced by receipt of an apology, investigation and prevention of recurrence of the PSI, and longer time until claim decision and increased by an easy and straightforward claims process and high chance of compensation and for the mild scenario higher compensation amounts. Marginal effects and baseline case probabilities differed by scenario severity.

CONCLUSIONS

The results suggest the actions of the healthcare system after a PSI and characteristics of the claims process have a larger impact on the probability of making a claim for milder PSIs. For more severe PSIs, a larger probability of making a claim was observed, and the choice was less influenced by the actions of the healthcare system after the PSI and characteristics of the claims process.

Patient preferences for treatment in steroid resistant ulcerative colitis - a discrete-choice experiment

BACKGROUND AND AIM

Understanding treatment preferences in those patients who are not responding to corticosteroids for ulcerative colitis is important in informing treatment choices. This study aimed to assess the relative importance of treatment characteristics to patients by conducting a discrete-choice experiment.

METHODS

Patients completed the questionnaire online. All data were collected between September and December 2020. Participants were shown 13 discrete-choice experiment tasks - a series of side-by-side comparisons of competing, hypothetical treatment characteristics and asked to select a preferred treatment. Survey responses were analysed using descriptive statistics and regression analyses.

RESULTS

115 patients completed the study. Patient preferences were strongest for treatments with a lower chance of side effects, this attribute had the most influence on the choice of treatment patients preferred. The second most important attribute was an improvement in maintaining remission. Conversely, route and frequency of administration were least important on the choice of treatment patients preferred. Respondents were willing to make trade offs and accept treatment benefits to compensate them for receiving a treatment with a less desirable attribute level. Participants were willing to accept a larger benefit of 45% improvement in maintenance of remission to accept a treatment with a higher probability of side effects. The benefit required was smaller with a 10% improvement in remission required to accept a treatment with a lower probability of side effects.

CONCLUSION

Quantifying preferences helps to identify and prioritise treatment characteristics that are important to patients. The results highlight the importance of careful discussion of side effects, including the magnitude of risk, using visualisation tools during a patient consultation to support decisions.

Managing the delivery of venous leg ulcer services: A willingness to pay study

Background and Aims

Methods

Results

Conclusions

Patient decision-making and regret in pilonidal sinus surgery: a mixed-methods study

AIM

Little is known about optimal management strategies for pilonidal sinus disease (PSD). We conducted a mixed-methods study to understand why patients make, and sometimes regret, treatment decisions.

METHOD

We conducted longitudinal semi-structured interviews at the time of surgery and 6 months later with 20 patients from 13 UK hospitals. Framework analysis was performed, and themes were mapped to (1) the coping in deliberation framework and (2) an acceptability framework. Results were triangulated with those from structured survey instruments evaluating shared decision-making (SDM, best = 9) at baseline and decision regret (DR, most regret = 100) at 6 months.

RESULTS

Nine of 20 patients were not offered a choice of treatment, but this was not necessarily seen as negative (SDM median 4; range 2-4). Factors that influenced decision-making included previous experience and anticipated recovery time. Median (range) DR was 5 (0-50). Those with the highest DR (scores 40-50) were, paradoxically, also amongst the highest scores on SDM (scores 4). Burden of wound care and the disparity between anticipated and actual recovery time were the main reasons for decision regret.

CONCLUSION

To minimize regret about surgical decisions, people with PSD need better information about the burden of wound care and the risks of recurrence associated with different surgical approaches.

Person-centred experiential therapy versus cognitive behavioural therapy delivered in the English Improving Access to Psychological Therapies service for the treatment of moderate or severe depression (PRaCTICED): a pragmatic, randomised, non-inferiority trial

BACKGROUND

The UK Government's implementation in 2008 of the Improving Access to Psychological Therapies (IAPT) initiative in England has hugely increased the availability of cognitive behavioural therapy (CBT) for the treatment of depression and anxiety in primary care. Counselling for depression-a form of person-centred experiential therapy (PCET)-has since been included as an IAPT-approved therapy, but there is no evidence of its efficacy from randomised controlled trials (RCTs), as required for recommendations by the National Institute for Health and Care Excellence. Therefore, we aimed to examine whether PCET is cost effective and non-inferior to CBT in the treatment of moderate and severe depression within the IAPT service.

METHODS

This pragmatic, randomised, non-inferiority trial was done in the Sheffield IAPT service in England and recruited participants aged 18 years or older with moderate or severe depression on the Clinical Interview Schedule-Revised. We excluded participants presenting with an organic condition, a previous diagnosis of personality disorder, bipolar disorder, or schizophrenia, drug or alcohol dependency, an elevated clinical risk of suicide, or a long-term physical condition. Eligible participants were randomly assigned (1:1), independently of the research team, and stratified by site with permuted block sizes of two, four, or six, to receive either PCET or CBT by use of a remote, web-based system that revealed therapy after patient details were entered. Those assessing outcomes were masked to treatment allocation. Participants were seen by appropriately trained PCET counsellors and CBT therapists in accordance with the IAPT service delivery model. Depression severity and symptomatology measured by the Patient Health Questionnaire-9 (PHQ-9) at 6 months post-randomisation was the primary outcome, with the PHQ-9 score at 12 months post-randomisation being a key secondary outcome. These outcomes were analysed in the modified intention-to-treat population, which comprised all randomly assigned patients with complete data, and the per-protocol population, which comprised all participants who did not switch from their randomised treatment and received between four and 20 sessions. Safety was analysed in all randomly assigned patients. The non-inferiority margin was set a priori at 2 PHQ-9 points. Patient safety was monitored throughout the course of therapy, adhering to service risk procedures for monitoring serious adverse events. This trial is registered at the ISRCTN Registry, ISRCTN06461651, and is complete.

FINDINGS

From Nov 11, 2014, to Aug 3, 2018, 9898 patients were referred to step three treatments in the Sheffield IAPT service for common mental health problems, of whom 761 (7·7%) were referred to the trial. Of these, we recruited and randomly assigned 510 participants to receive either PCET (n=254) or CBT (n=256). In the PCET group, 138 (54%) participants were female and 116 (46%) were male, and 225 (89%) were White, 16 (6%) were non-White, and 13 (5%) had missing ethnicity data. In the CBT group, 155 (61%) participants were female and 101 (39%) were male, and 226 (88%) were White, 17 (7%) were non-White, and 13 (5%) had missing ethnicity data. The 6-month modified intention-to-treat analysis comprised 401 (79%) of the enrolled participants (201 in the PCET group; 200 in the CBT group) and the 12-month modified intention-to-treat analysis comprised 319 participants (167 in the PCET group; 152 in the CBT group). The 6-month per-protocol analysis comprised 298 participants (154 in the PCET group; 144 in the CBT group). At 6 months post-randomisation, PCET was non-inferior to CBT in the intention-to-treat population (mean PHQ-9 score 12·74 [SD 6·54] in the PCET group and 13·25 [6·35] in the CBT group; adjusted mean difference -0·35 [95% CI -1·53 to 0·84]) and in the per-protocol population (12·73 [SD 6·57] in the PCET group and 12·71 [6·33] in the CBT group; 0·27 [95% CI -1·08 to 1·62]). At 12 months post-randomisation, there was a significant adjusted between-group difference in mean PHQ-9 score in favour of CBT (1·73 [95% CI 0·26-3·19]), with a 95% CI exceeding the 2-point non-inferiority margin. There were two deaths, one death by suicide in the PCET group and one due to chronic obstructive pulmonary disease in the CBT group. Both were assessed by the responsible clinician to be unrelated to the trial. In terms of using emergency departments for depression-related events, four people (three in the PCET group; one in the CBT group) made more than a single use and six people (three in the PCET group; three in the CBT group) made a single use. One patient in the PCET group had inpatient treatment for a depression-related event.

INTERPRETATION

This trial is the first to examine the two most frequently administered psychological therapies in the IAPT service. The finding of non-inferiority of PCET to CBT at 6 months supports the results from large, routine, non-randomised datasets from the IAPT programme. Given the high demand for psychological therapies and the need for patient choice, our findings suggest the need for continued investment in the training and delivery of PCET for improving short-term outcomes, but suggest that PCET might be inferior to CBT at 12 months.

FUNDING

British Association for Counselling and Psychotherapy Research Foundation.

Configuration of vascular services: a multiple methods research programme

Background

Vascular services is changing rapidly, having emerged as a new specialty with its own training and specialised techniques. This has resulted in the need for reconfiguration of services to provide adequate specialist provision and accessible and equitable services.

Objectives

To identify the effects of service configuration on practice, resource use and outcomes. To model potential changes in configuration. To identify and/or develop electronic data collection tools for collecting patient-reported outcome measures and other clinical information. To evaluate patient preferences for aspects of services other than health-related quality of life.

Design

This was a multiple methods study comprising multiple systematic literature reviews; the development of a new outcome measure for users of vascular services (the electronic Personal Assessment Questionnaire – Vascular) based on the reviews, qualitative studies and psychometric evaluation; a trade-off exercise to measure process utilities; Hospital Episode Statistics analysis; and the development of individual disease models and a metamodel of service configuration.

Setting

Specialist vascular inpatient services in England.

Data sources

Modelling and Hospital Episode Statistics analysis for all vascular inpatients in England from 2006 to 2018. Qualitative studies and electronic Personal Assessment Questionnaire – Vascular evaluation with vascular patients from the Sheffield area. The trade-off studies were based on a societal sample from across England.

Interventions

The data analysis, preference studies and modelling explored the effect of different potential arrangements for service provision on the resource use, workload and outcomes for all interventions in the three main areas of inpatient vascular treatment: peripheral arterial disease, abdominal aortic aneurysm and carotid artery disease. The electronic Personal Assessment Questionnaire – Vascular was evaluated as a potential tool for clinical data collection and outcome monitoring.

Main outcome measures

Systematic reviews assessed quality and psychometric properties of published outcome measures for vascular disease and the relationship between volume and outcome in vascular services. The electronic Personal Assessment Questionnaire – Vascular development considered face and construct validity, test–retest reliability and responsiveness. Models were validated using case studies from previous reconfigurations and comparisons with Hospital Episode Statistics data. Preference studies resulted in estimates of process utilities for aneurysm treatment and for travelling distances to access services.

Results

Systematic reviews provided evidence of an association between increasing volume of activity and improved outcomes for peripheral arterial disease, abdominal aortic aneurysm and carotid artery disease. Reviews of existing patient-reported outcome measures did not identify suitable condition-specific tools for incorporation in the electronic Personal Assessment Questionnaire – Vascular. Reviews of qualitative evidence, primary qualitative studies and a Delphi exercise identified the issues to be incorporated into the electronic Personal Assessment Questionnaire – Vascular, resulting in a questionnaire with one generic and three disease-specific domains. After initial item reduction, the final version has 55 items in eight scales and has acceptable psychometric properties. The preference studies showed strong preference for endovascular abdominal aortic aneurysm treatment (willingness to trade up to 0.135 quality-adjusted life-years) and for local services (up to 0.631 quality-adjusted life-years). A simulation model with a web-based interface was developed, incorporating disease-specific models for abdominal aortic aneurysm, peripheral arterial disease and carotid artery disease. This predicts the effects of specified reconfigurations on workload, resource use, outcomes and cost-effectiveness. Initial exploration suggested that further reconfiguration of services in England to accomplish high-volume centres would result in improved outcomes, within the bounds of cost-effectiveness usually considered acceptable in the NHS.

Limitations

The major source of evidence to populate the models was Hospital Episode Statistics data, which have limitations owing to the complexity of the data, deficiencies in the coding systems and variations in coding practice. The studies were not able to address all of the potential barriers to change where vascular services are not compliant with current NHS recommendations.

Conclusions

There is evidence of potential for improvement in the clinical effectiveness and cost-effectiveness of vascular services through further centralisation of sites where major vascular procedures are undertaken. Preferences for local services are strong, and this may be addressed through more integrated services, with a range of services being provided more locally. The use of a web-based tool for the collection of clinical data and patient-reported outcome measures is feasible and can provide outcome data for clinical use and service evaluation.

Future work

Further evaluation of the economic models in real-world situations where local vascular service reconfiguration is under consideration and of the barriers to change where vascular services do not meet NHS recommendations for service configuration is needed. Further work on the electronic Personal Assessment Questionnaire – Vascular is required to assess its acceptability and usefulness in clinical practice and to develop appropriate report formats for clinical use and service evaluation. Further studies to assess the implications of including non-health-related preferences for care processes, and location of services, in calculations of cost-effectiveness are required.

Study registration

This study is registered as PROSPERO CRD42016042570, CRD42016042573, CRD42016042574, CRD42016042576, CRD42016042575, CRD42014014850, CRD42015023877 and CRD42015024820.

Funding

This project was funded by the National Institute for Health Research (NIHR) Programme Grants for Applied Research programme and will be published in full in Programme Grants for Applied Research; Vol. 9, No. 5. See the NIHR Journals Library website for further project information.

Can electronic assessment tools improve the process of shared decision-making? A systematic review

Background:

Patient involvement in decision-making plays a prominent role in improving the quality of healthcare. Despite this, shared decision-making is not routinely implemented. However, electronic assessment tools that capture patients’ history, symptoms, opinions and values prior to their medical appointment are used by healthcare professionals during patient consultations to facilitate shared decision-making.

Objective:

To assess the effectiveness of electronic assessment tools to improve the shared decision-making process.

Method:

A systematic review was conducted following PRISMA guidelines. Published literature was searched on MEDLINE, EMBASE and PsycINFO to identify potentially relevant studies. Data were extracted and analysed narratively.

Results:

Seventeen articles, representing 4004 participants, were included in this review. The main findings were significant improvement in patient–provider communication and provider management of patient condition in the intervention group compared to the control group. In contrast, patient–provider satisfaction and time efficiency were assessed by relatively few included studies, and the effects of these outcomes were inconclusive.

Conclusion:

This review found that communication and healthcare professional’s management of a patient’s condition improves because of the use of electronic questionnaires. This is encouraging because the process of shared decision-making is reliant on high-quality communication between healthcare professionals and patients.

Implications:

We found that this intervention is especially important for people with chronic diseases, as they need to establish a long-term relationship with their healthcare provider and agree to a treatment plan that aligns with their values. More rigorous research with validated instruments is required.

The impact of care farms on quality of life, depression and anxiety among different population groups: A systematic review

Care farming (also called social farming) is the therapeutic use of agricultural and farming practices. Service users and communities supported through care farming include people with learning disabilities, mental and physical health problems, substance misuse, adult offenders, disaffected youth, socially isolated older people and the long term unemployed. Care farming is growing in popularity, especially around Europe. This review aimed to understand the impact of care farming on quality of life, depression and anxiety, on a range of service user groups. It also aimed to explore and explain the way in which care farming might work for different groups. By reviewing interview studies we found that people valued, among other things, being in contact with each other, and feeling a sense of achievement, fulfilment and belonging. Some groups seemed to appreciate different things indicating that different groups may benefit in different ways but, it is unclear if this is due to a difference in the types of activities or the way in which people take different things from the same activity. We found no evidence that care farms improved people's quality of life and some evidence that they might improve depression and anxiety. Larger studies involving single service user groups and fully validated outcome measures are needed to prove more conclusive evidence about the benefits of care farming.

Strength of public preferences for endovascular or open aortic aneurysm repair

Background

This study evaluated public preferences for the treatment processes for abdominal aortic aneurysm repair in order to allow them to be incorporated into a cost-effectiveness analysis.

Methods

This was a telephone survey using a trade-off method in UK resident adults (aged at least 18 years) with no previous diagnosis of a vascular condition.

Results

Some 167 of 209 participants (79·9 per cent) stated that they would prefer endovascular aneurysm repair (EVAR), 40 (19·1 per cent) preferred open surgery and two (1·0 per cent) stated no preference. Participants preferred EVAR because of the less invasive nature of the intervention and quicker recovery. Participants preferring open surgery cited reasons such as having a single follow-up appointment, and a procedure that felt more permanent. When participants were asked to make a sacrifice in order to have their preferred treatment, 122 (58·4 per cent) favoured EVAR, 18 (8·6 per cent) favoured open surgery and 69 (33·0 per cent) had no preference. Those preferring EVAR were willing to give up a mean of 0·135 expected quality-adjusted life-years (QALYs) to have EVAR, compared with a willingness to give up 0·033 expected QALYs among those preferring open repair.

Conclusion

These results indicate a clear preference for EVAR over open surgery for aortic aneurysm.

From embracing to managing risks

OBJECTIVE

To assess developments over time in the capture, curation and use of quality and safety information in managing hospital services.

SETTING

Four acute National Health Service hospitals in England.

PARTICIPANTS

111.5 hours of observation of hospital board and directorate meetings, and 72 hours of ward observations. 86 interviews with board level and middle managers and with ward managers and staff.

RESULTS

There were substantial improvements in the quantity and quality of data produced for boards and middle managers between 2013 and 2016, starting from a low base. All four hospitals deployed data warehouses, repositories where datasets from otherwise disparate departmental systems could be managed. Three of them deployed real-time ward management systems, which were used extensively by nurses and other staff.

CONCLUSIONS

The findings, particularly relating to the deployment of real-time ward management systems, are a corrective to the many negative accounts of information technology implementations. The hospital information infrastructures were elements in a wider move, away from a reliance on individual professionals exercising judgements and towards team-based and data-driven approaches to the active management of risks. They were not, though, using their fine-grained data to develop ultrasafe working practices.

Quality and safety between ward and board: a biography of artefacts study

Background

There have been concerns about the quality and safety of NHS hospital services since the turn of the millennium. This study investigated the progress that acute NHS hospital trusts have made in developing and using technology infrastructures to enable them to monitor quality and safety following the publication in 2013 of the second Francis report on the scandal at Mid Staffordshire NHS Foundation Trust (The Mid Staffordshire NHS Foundation Trust Public Inquiry. Chaired by Sir Robert Francis QC.Report of the Mid Staffordshire NHS Foundation Trust Public Inquiry. HC 898. London: The Stationery Office; 2013).

Methods

A telephone survey of 15 acute NHS trusts in the Yorkshire and the Humber region, and a review of board papers of all acute NHS trusts in England for January 2015, were undertaken. The telephone survey was used to identify trusts for a larger field study, which was undertaken in four acute NHS trusts between April 2015 and September 2016. The methods included the direct observation of the use of whiteboards and other technologies on two wards in each trust, an observation of board quality committees, semistructured interviews and an analysis of the quality and safety data in board papers. Published sources about national and local agencies were reviewed to identify the trust quality and safety data that these agencies accessed and used. An interview programme was also undertaken with those organisations. The Biography of Artefacts approach was used to analyse the data.

Findings

The data and technology infrastructures within trusts had developed over many years. The overall design had been substantially determined by national agencies, and was geared to data processing: capturing and validating data for submission to national agencies. Trust boards had taken advantage of these data and used them to provide assurance about quality and safety. Less positively, the infrastructures were fragmented, with different technologies used to handle different quality and safety data. Real-time management systems on wards, including electronic whiteboards and mobile devices, were used and valued by nurses and other staff. The systems support the proactive management of clinical risks. These developments have occurred within a broad context, with trusts focusing on improving the quality and safety of services and publishing far more data on their performance than they did just 3 years earlier. Trust-level data suggest that quality and safety improved at all four trusts between 2013 and 2016. Our findings indicate that the technology infrastructures contributed to these improvements. There remains considerable scope to rationalise those infrastructures.

Limitations

The four trusts in the main study were, in part, purposively selected, and deliberately biased towards sites that had made progress with designing and deploying real-time ward management systems. This limits the generalisability of the study. The study focused more on the work of nurses and nurse managers, and has relatively little to say about the experiences of doctors or allied health professionals.

Future work

Future research might focus on the effects of mobile technologies and electronic whiteboards on acute wards, the value of current national data returns, and the uses and value of trust data warehouses.

Funding

The National Institute for Health Research Health Services and Delivery Research programme.

Assessing the impact of care farms on quality of life and offending: a pilot study among probation service users in England

OBJECTIVES

To assess the feasibility of conducting a cost-effectiveness study of using care farms (CFs) to improve quality of life and reduce reoffending among offenders undertaking community orders (COs). To pilot questionnaires to assess quality of life, connection to nature, lifestyle behaviours, health and social-care use. To assess recruitment and retention at 6 months and feasibility of data linkage to Police National Computer (PNC) reconvictions data and data held by probation services.

DESIGN

Pilot study using questionnaires to assess quality of life, individually linked to police and probation data.

SETTING

The pilot study was conducted in three probation service regions in England. Each site included a CF and at least one comparator CO project. CFs are working farms used with a range of clients, including offenders, for therapeutic purposes. The three CFs included one aquaponics and horticulture social enterprise, a religious charity focusing on horticulture and a family-run cattle farm. Comparator projects included sorting secondhand clothes and activities to address alcohol misuse and anger management.

PARTICIPANTS

We recruited 134 adults (over 18) serving COs in England, 29% female.

RESULTS

52% of participants completed follow-up questionnaires. Privatisation of UK probation trusts in 2014 negatively impacted on recruitment and retention. Linkage to PNC data was a more successful means of follow-up, with 90% consenting to access their probation and PNC data. Collection of health and social-care costs and quality-adjusted life year derivation were feasible. Propensity score adjustment provided a viable comparison method despite differences between comparators. We found worse health and higher reoffending risk among CF participants due to allocation of challenging offenders to CFs, making risk of reoffending a confounder.

CONCLUSIONS

Recruitment would be feasible in a more stable probation environment. Follow-up was challenging; however, assessing reconvictions from PNC data is feasible and a potential primary outcome for future studies.

Impact and cost-effectiveness of care farms on health and well-being of offenders on probation: a pilot study

Background

Care farms (CFs), in which all or part of the farm is used for therapeutic purposes, show potential for improving well-being for disadvantaged groups. We assessed the feasibility of determining the cost-effectiveness of CFs in improving quality of life compared with comparator sites among probationers undertaking community orders (COs).

Objectives

(1) To conduct a systematic review of CF impacts and mechanisms in improving health and logic model development; (2) to inform future studies by estimating differences in quality of life and other outcomes, identifying factors driving CO allocation and ways to maximise recruitment and follow-up; and (3) to assess feasibility of cost-effectiveness analysis.

Review methods

A mixed-methods synthesis following Campbell Collaboration guidelines. Pilot study: three probation service regions in England, each with a CF and a comparator CO site. Participants were adult offenders (aged ≥ 18 years) serving COs. The primary outcome was quality of life [as measured via the Clinical Outcome in Routine Evaluation–Outcome Measure (CORE-OM)]. Other outcomes were health behaviours, mental well-being, connectedness to nature and reconvictions.

Data sources

In November 2014, we searched 22 health, education, environmental, criminal justice and social science electronic databases, databases of grey literature and care farming websites across Europe. There were no language restrictions. A full list of databases searched is given in Appendix 1; some examples include Web of Science, Cumulative Index to Nursing and Allied Health Literature (via EBSCOhost), The Campbell Library, Criminal Justice Abstracts (via EBSCOhost), MEDLINE (via Ovid) and Scopus (Elsevier B.V., Amsterdam, the Netherlands).

Results

Our systematic review identified 1659 articles: 14 qualitative, 12 quantitative and one mixed-methods study. Small sample sizes and poor design meant that all were rated as being at a high risk of bias. Components of CFs that potentially improve health are being in a group, the role of the farmer and meaningful work, and interaction with animals. There was a lack of quantitative evidence indicating that CFs improve quality of life and there was weak evidence of improved mental health, self-efficacy, self-esteem, affect and mood. In the pilot study we recruited 134 respondents, and only 21 declined; 37% were allocated to three CFs and the remainder to comparators. This was below our recruitment target of 300. Recruitment proved challenging as a result of the changes in probation (probation trusts were disbanded in 2014) and closure of one CF. We found significant differences between CFs and comparator users: those at CFs were more likely to be male, smokers, substance users, at higher risk of reoffending (a confounder) and have more missing CORE-OM questions. Despite these differences, the use of propensity analysis facilitated comparison. Participants consented to our team accessing, and we were able to link, probation and police reconviction data for 90% of respondents. We gained follow-up questionnaire data from 52% of respondents, including health and social care use cost data. We transformed CORE-OM into CORE-6D, allowing derivation of quality-adjusted life-years. As a pilot, our study was not powered to identify significant differences in outcomes. Qualitatively, we observed that within COs, CFs can be formally recognised as rehabilitative but in practice can be seen as punitive.

Limitations

Changes in probation presented many challenges that limited recruitment and collection of cost data.

Conclusions

Recruitment is likely to be feasible in a more stable probation environment. Retention among probationers is challenging but assessing reconvictions from existing data is feasible. We found worse health and risk of reoffending among offenders at CFs, reflecting the use of CFs by probation to manage challenging offenders.

Future work

A sufficiently powered natural experiment is feasible and of value. Using reconvictions (from police data) as a primary outcome is one solution to challenges with retention. Propensity analysis provides a viable method for comparison despite differences in participants at CFs and comparator sites. However, future work is dependent on stability and support for CFs within probation services.

Study registration

This study is registered as PROSPERO CRD42014013892 and SW2013–04 (the Campbell Collaboration).

Funding details

The National Institute for Health Research Public Health Research programme.

Erratum to: Methods for evaluating medical tests and biomarkers

[This corrects the article DOI: 10.1186/s41512-016-0001-y.].

Understanding the impacts of care farms on health and well-being of disadvantaged populations: a protocol of the Evaluating Community Orders (ECO) pilot study

INTRODUCTION

Care farms, where all or part of the farm is used for therapeutic purposes, show much potential for improving the health and well-being of a range of disadvantaged groups. Studies to date have been qualitative or observational, with limited empirical evidence of the effectiveness of care farms in improving health and well-being. Understanding the underlying mechanisms that lead to improvements for different disadvantaged groups is a further gap in the evidence. Participants in this study are offenders serving community orders. Their low socioeconomic status and poor health outcomes relative to the general population exemplifies disadvantage.

METHODS AND ANALYSIS

This paper describes the protocol of a study to understand the impacts of care farms and to pilot the design and tools for a study to assess cost-effectiveness of care farms in improving the quality of life of offenders. As a pilot study, no power calculation has been conducted. However, 150 offenders serving community sentences on care farms and 150 on other probation locations (eg, litter picking, painting) will be recruited over a 1-year period. Changes in quality of life, measured by Clinical Outcome in Routine Evaluation-Outcome Measure, health and reconvictions of offenders at care farms compared to other probation locations will be analysed to inform the sample size calculation for the follow on study. The feasibility of recruitment, retention, collecting cost data and modelling cost-effectiveness will also be assessed. The study will use qualitative methods to explore the experiences of offenders attending care farms and perceptions of probation and care farm staff on the processes and impacts of the intervention.

ETHICS AND DISSEMINATION

Findings will be published and inform development of a natural experiment and will be disseminated to probation services, care farms and academics. University of Leeds Ethical Review Board approved: SoMREC/13/014. National Offender Management Service (NOMS) approved: 2013-257.