1
|
McConnell T, Blair C, Burden J, Duddy C, Hill L, Howie C, Jones B, Ruane B, Wong G, Reid J. Integrating palliative care and heart failure: a systematic realist synthesis (PalliatHeartSynthesis). Open Heart 2023; 10:e002438. [PMID: 38097362 PMCID: PMC10729146 DOI: 10.1136/openhrt-2023-002438] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/29/2023] [Accepted: 11/10/2023] [Indexed: 12/18/2023] Open
Abstract
OBJECTIVES (1) Develop a programme theory of why, for whom and in what contexts integrated palliative care (PC) and heart failure (HF) services work/do not work; (2) use the programme theory to co-produce with stakeholders, intervention strategies to inform best practice and future research. METHODS A systematic review of all published articles and grey literature using a realist logic of analysis. The search strategy combined terms significant to the review questions: HF, PC and end of life. Documents were included if they were in English and provided data relevant to integration of PC and HF services. Searches were conducted in November 2021 in EMBASE, MEDLINE, PsycINFO, AMED, HMIC and CINAHL. Further relevant documents were identified via monthly alerts (up until April 2023) and the project stakeholder group (patient/carers, content experts and multidisciplinary practitioners). RESULTS 130 documents were included (86 research, 22 literature reviews, 22 grey literature). The programme theory identified intervention strategies most likely to support integration of PC and HF services. These included protected time for evidence-based PC and HF education from undergraduate/postgraduate level and continuing professional practice; choice of educational setting (eg, online, face-to-face or hybrid); increased awareness and seeing benefits of PC for HF management; conveying the emotive and intellectual need for integrating PC and HF via credible champions; and prioritising PC and HF guidelines in practice. CONCLUSIONS The review findings outline the required steps to take to increase the likelihood that all key players have the capacity, opportunity and motivation to integrate PC into HF management. PROSPERO REGISTRATION NUMBER CRD42021240185.
Collapse
Affiliation(s)
- Tracey McConnell
- School of Nursing and Midwifery, Queen's University Belfast Faculty of Medicine, Health and Life Sciences, Belfast, UK
| | - Carolyn Blair
- School of Nursing and Midwifery, Queen's University Belfast Faculty of Medicine, Health and Life Sciences, Belfast, UK
| | - John Burden
- Patient and Public Involvement Network members, British Heart Foundation, London, UK
| | - Claire Duddy
- Nuffield Department of Primary Care Health Sciences, University of Oxford, Oxford, UK
| | - Loreena Hill
- School of Nursing and Midwifery, Queen's University Belfast Faculty of Medicine, Health and Life Sciences, Belfast, UK
| | - Clare Howie
- School of Nursing and Midwifery, Queen's University Belfast Faculty of Medicine, Health and Life Sciences, Belfast, UK
| | - Bob Jones
- Patient and Public Involvement Network members, British Heart Foundation, London, UK
| | - Bob Ruane
- Patient and Public Involvement Network members, British Heart Foundation, London, UK
| | - Geoff Wong
- Nuffield Department of Primary Care Health Sciences, University of Oxford, Oxford, UK
| | - Joanne Reid
- School of Nursing and Midwifery, Queen's University Belfast Faculty of Medicine, Health and Life Sciences, Belfast, UK
| |
Collapse
|
2
|
Birt L, West J, Poland F, Wong G, Handley M, Litherland R, Hackmann C, Moniz-Cook E, Wolverson E, Teague B, Mills R, Sams K, Duddy C, Fox C. Protocol for a realist evaluation of Recovery College dementia courses: understanding coproduction through ethnography. BMJ Open 2023; 13:e078248. [PMID: 38149417 PMCID: PMC10711820 DOI: 10.1136/bmjopen-2023-078248] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/27/2023] [Accepted: 11/07/2023] [Indexed: 12/28/2023] Open
Abstract
INTRODUCTION Support following a dementia diagnosis in the UK is variable. Attending a Recovery College course with and for people with dementia, their supporters and healthcare professionals (staff), may enable people to explore and enact ways to live well with dementia. Recovery Colleges are established within mental health services worldwide, offering peer-supported short courses coproduced in partnership between staff and people with lived experience of mental illness. The concept of recovery is challenging in dementia narratives, with little evidence of how the Recovery College model could work as a method of postdiagnostic dementia support. METHODS AND ANALYSIS Using a realist evaluation approach, this research will examine and define what works, for whom, in what circumstances and why, in Recovery College dementia courses. The ethnographic study will recruit five case studies from National Health Service Mental Health Trusts across England. Sampling will seek diversity in new or long-standing courses, delivery methods and demographics of population served. Participant observations will examine course coproduction. Interviews will be undertaken with people with dementia, family and friend supporters and staff involved in coproducing and commissioning the courses, as well as people attending. Documentary materials will be reviewed. Analysis will use a realist logic of analysis to develop a programme theory containing causal explanations for outcomes, in the form of context-mechanism-outcome-configurations, at play in each case. ETHICS AND DISSEMINATION The study received approval from Coventry & Warwickshire Research Ethics Committee (22/WM/0215). Ethical concerns include not privileging any voice, consent for embedded observational fieldwork with people who may experience fluctuating mental capacity and balancing researcher 'embedded participant' roles in publicly accessible learning events. Drawing on the realist programme theory, two stakeholder groups, one people living with dementia and one staff will work with researchers to coproduce resources to support coproducing Recovery College dementia courses aligned with postdiagnostic services.
Collapse
Affiliation(s)
- Linda Birt
- School of Health Sciences, University of East Anglia, Norwich, UK
- School of Healthcare University of Leicester, Leicester, UK
| | - Juniper West
- Research and Development, Norfolk and Suffolk NHS Foundation Trust, Norwich, UK
| | - Fiona Poland
- School of Health Sciences, University of East Anglia, Norwich, UK
| | - Geoff Wong
- Nuffield Department of Primary Care Health Sciences, Oxford University, Oxford, UK
| | | | | | - Corinna Hackmann
- Research and Development, Norfolk and Suffolk NHS Foundation Trust, Norwich, UK
| | - Esme Moniz-Cook
- Faculty of Health Sciences, Department of Psychological Health and Well Being, University of Hull, Hull, UK
| | - Emma Wolverson
- Faculty of Health Sciences, University of Hull, Hull, UK
- Dementia, London, UK
| | - Bonnie Teague
- Research, Norfolk and Suffolk NHS Foundation Trust, Norwich, UK
| | - Ruth Mills
- Older People's Services, Norfolk and Suffolk NHS Foundation Trust, Norwich, UK
| | - Kathryn Sams
- Older People's Services, Norfolk and Suffolk NHS Foundation Trust, Norwich, UK
| | - Claire Duddy
- Nuffield Department of Primary Care Health Sciences, University of Oxford, Oxford, UK
| | - Chris Fox
- Department of Psychological Sciences, Norwich Medical School, Norwich, UK
- Medical School, College House University of Exeter, Exeter, UK
| |
Collapse
|
3
|
Howe J, MacPhee M, Duddy C, Habib H, Wong G, Jacklin S, Oduola S, Upthegrove R, Carlish M, Allen K, Patterson E, Maidment I. A realist review of medication optimisation of community dwelling service users with serious mental illness. BMJ Qual Saf 2023:bmjqs-2023-016615. [PMID: 38071586 DOI: 10.1136/bmjqs-2023-016615] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/06/2023] [Accepted: 10/14/2023] [Indexed: 12/22/2023]
Abstract
BACKGROUND Severe mental illness (SMI) incorporates schizophrenia, bipolar disorder, non-organic psychosis, personality disorder or any other severe and enduring mental health illness. Medication, particularly antipsychotics and mood stabilisers are the main treatment options. Medication optimisation is a hallmark of medication safety, characterised by the use of collaborative, person-centred approaches. There is very little published research describing medication optimisation with people living with SMI. OBJECTIVE Published literature and two stakeholder groups were employed to answer: What works for whom and in what circumstances to optimise medication use with people living with SMI in the community? METHODS A five-stage realist review was co-conducted with a lived experience group of individuals living with SMI and a practitioner group caring for individuals with SMI. An initial programme theory was developed. A formal literature search was conducted across eight bibliographic databases, and literature were screened for relevance to programme theory refinement. In total 60 papers contributed to the review. 42 papers were from the original database search with 18 papers identified from additional database searches and citation searches conducted based on stakeholder recommendations. RESULTS Our programme theory represents a continuum from a service user's initial diagnosis of SMI to therapeutic alliance development with practitioners, followed by mutual exchange of information, shared decision-making and medication optimisation. Accompanying the programme theory are 11 context-mechanism-outcome configurations that propose evidence-informed contextual factors and mechanisms that either facilitate or impede medication optimisation. Two mid-range theories highlighted in this review are supported decision-making and trust formation. CONCLUSIONS Supported decision-making and trust are foundational to overcoming stigma and establishing 'safety' and comfort between service users and practitioners. Avenues for future research include the influence of stigma and equity across cultural and ethnic groups with individuals with SMI; and use of trained supports, such as peer support workers. PROSPERO REGISTRATION NUMBER CRD42021280980.
Collapse
Affiliation(s)
- Jo Howe
- Pharmacy School, College of Health and Life Sciences, Aston University, Birmingham, UK
| | - Maura MacPhee
- School of Nursing, The University of British Columbia, Vancouver, British Columbia, Canada
| | - Claire Duddy
- Primary Care Health Sciences, University of Oxford, Oxford, UK
| | - Hafsah Habib
- Pharmacy School, Aston University College of Health and Life Sciences, Birmingham, UK
| | - Geoff Wong
- Primary Care Health Sciences, University of Oxford, Oxford, UK
| | - Simon Jacklin
- School of Pharmacy and Bioengineering, Keele University, Keele, UK
| | - Sheri Oduola
- School of Health Sciences, University of East Anglia, Norwich, UK
| | - Rachel Upthegrove
- Institute for Mental Health, University of Birmingham, Birmingham, UK
- Birmingham Early Intervention Service, Birmingham Women's and Children's NHS Foundation Trust, Birmingham, UK
| | - Max Carlish
- Birmingham and Solihull Mental Health NHS Foundation Trust, Birmingham, UK
| | - Katherine Allen
- Birmingham and Solihull Mental Health NHS Foundation Trust, Birmingham, UK
| | - Emma Patterson
- Birmingham and Solihull Mental Health NHS Foundation Trust, Birmingham, UK
| | - Ian Maidment
- Pharmacy School, College of Health and Life Sciences, Aston University, Birmingham, UK
| |
Collapse
|
4
|
Lean I, Arnold J, Duddy C, Church S, Rose R, Hodgson D. Kristin Arnold 1956-2023. Aust Vet J 2023; 101:462. [PMID: 37918953 DOI: 10.1111/avj.13286] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 08/09/2023] [Indexed: 11/04/2023]
|
5
|
Hammond SP, Mickleburgh E, Duddy C, Hiller R, Neil E, Blackett R, Williams K, Wilson J, Wong G. Improving the mental health and mental health support available to adolescents in out-of-home care via Adolescent-Focused Low-Intensity Life Story Work: a realist review. BMJ Open 2023; 13:e075093. [PMID: 37813542 PMCID: PMC10565277 DOI: 10.1136/bmjopen-2023-075093] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/26/2023] [Accepted: 08/21/2023] [Indexed: 10/13/2023] Open
Abstract
OBJECTIVES Life Story Work (LSW) is used to promote the mental health and well-being of children and adolescents living in out-of-home care. LSW should be offered to all but is conventionally delivered in high-intensity ways. Low-intensity approaches are more accessible but there is significant variation and little guidance for supporting adolescents. We aimed to create guidance for Adolescent-Focused Low-Intensity LSW. DESIGN Realist review. DATA SOURCES MEDLINE, Embase, PsycINFO, Sociology Collection (ProQuest), CINAHL, CDAS, Web of Science (SCIE, SSCI), Social Care Online and grey literature sources. Searches were performed between December 2021 and March 2022. ELIGIBILITY CRITERIA Documents on children and adolescents in care, LSW and/or low-intensity interventions to improve mental health were included. Documents focusing on parenting style and contact with birth family were excluded. ANALYSIS Documents were analysed using a realist logic of analysis. In consultation with Content Expert Groups (comprising professionals and care leavers), we developed an initial programme theory. Data relating to and challenging the initial programme theory were extracted and context-mechanism-outcome-configurations developed, critiqued and refined in an iterative fashion. Interpretations were drawn from context-mechanism-outcome-configurations to enhance the programme theory. RESULTS 75 documents contributed to the analysis. Generally, studies were small-scale and lacked in-depth methods and evaluation descriptions. Findings indicated important factors contribute to the development of high-quality Adolescent-Focused Low-Intensity LSW. Adolescent-Focused Low-Intensity LSW should be person-centred, begin in the now, involve co-construction, record everyday positive life events and be supported by trained carer(s). Context-mechanism-outcome-configurations relating to these themes are reported. CONCLUSIONS Using this knowledge we developed initial practice guidance to support social care to deliver better quality Adolescent-Focused Low-Intensity LSW more consistently. To address gaps in our knowledge about the impact of Adolescent-Focused Low-Intensity LSW, further primary research is needed to strengthen understandings of how this intervention works (or not) in different contexts. PROSPERO REGISTRATION NUMBER CRD42021279816.
Collapse
Affiliation(s)
- Simon P Hammond
- School of Education and Lifelong Learning, University of East Anglia, Norwich, UK
- Norfolk and Suffolk NHS Foundation Trust, Norwich, UK
| | | | - Claire Duddy
- Nuffield Department of Primary Care Health Sciences, University of Oxford, Oxford, UK
| | - Rachel Hiller
- Division of Psychology and Language Sciences, University College London, London, UK
| | - Elsbeth Neil
- School of Social Work, University of East Anglia, Norwich, UK
| | | | | | - Jon Wilson
- Norfolk and Suffolk NHS Foundation Trust, Norwich, UK
| | - Geoff Wong
- Nuffield Department of Primary Care Health Sciences, University of Oxford, Oxford, UK
| |
Collapse
|
6
|
Coombs C, Cohen T, Duddy C, Mahtani KR, Owen E, Roberts N, Saini A, Foster AS, Park S. Primary care micro-teams: an international systematic review of patient and healthcare professional perspectives. Br J Gen Pract 2023; 73:e651-e658. [PMID: 37549994 PMCID: PMC10428005 DOI: 10.3399/bjgp.2022.0545] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/03/2022] [Accepted: 04/01/2023] [Indexed: 08/09/2023] Open
Abstract
BACKGROUND International trends have shifted to creating large general practices. There is an assumption that interdisciplinary teams will increase patient accessibility and provide more cost-effective, efficient services. Micro-teams have been proposed to mitigate for some potential challenges of practice expansion, including continuity of care. AIM To review available literature and examine how micro-teams are described, and identify opportunities and limitations for patients and practice staff. DESIGN AND SETTING This was an international systematic review of studies published in English. METHOD Databases (MEDLINE, EMBASE, CINAHL, Cochrane Library, and Scopus) and grey literature were searched. Studies were included if they provided evidence about implementation of primary care micro-teams. Framework analysis was used to synthesise identified literature. The research team included a public contributor co-applicant. The authors conducted stakeholder discussions with those with and without experience of micro-team implementation. RESULTS Of the 462 studies identified, 24 documents met the inclusion criteria. Most included empirical data from healthcare professionals, describing micro-team implementation. Results included characteristics of the literature; micro-team description; range of ways micro-teams have been implemented; reported outcomes; and experiences of patients and staff. CONCLUSION The organisation of primary care has potential impact on the nature and quality of patient care, safety, and outcomes. This review contributes to current debate about care delivery and how this can impact on the experiences and outcomes of patients and staff. This analysis identifies several key opportunities and challenges for future research, policy, and practice.
Collapse
|
7
|
Gadsby EW, Krska J, Duddy C, Hibberd V, Wong G. The NHS Health Check programme: a survey of programme delivery in England before and after the Covid-19 pandemic response. NIHR Open Res 2023; 3:32. [PMID: 37881459 PMCID: PMC10593320 DOI: 10.3310/nihropenres.13436.2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Accepted: 08/21/2023] [Indexed: 10/27/2023]
Abstract
Background This study investigated NHS Health Check programme delivery before and after the Covid-19 pandemic response, with a focus on support services and referral methods available to Health Check attendees. The NHS Health Check is an important part of England's Cardiovascular Disease (CVD) prevention programme. Methods Public health commissioners from all 151 local authorities responsible for commissioning the NHS Health Check programme were surveyed in 2021, using an online questionnaire to capture detail about programme delivery, changes in delivery because of the pandemic response, and monitoring of programme outcomes. Four-point rating scales were used to obtain level of confidence in capacity, accessibility and usage of follow-on support services for Health Check attendees. A typology of programme delivery was developed, and associations between delivery categories and a range of relevant variables were assessed using one-way analysis of variance. Results Sixty-eight responses were received on behalf of 74 (of 151) local authorities (49%), across all geographical regions. Our findings suggest a basic typology of delivery, though with considerable variation in who is providing the Checks, where and how, and with continued changes prompted by the Covid-19 pandemic. Support for risk management is highly varied with notable gaps in some areas. Local authorities using a model of delivery that includes community venues tended to have a higher number of services to support behaviour change following the Check, and greater confidence in the accessibility and usage of these services. A minority of local authorities gather data on referrals for Health Check attendees, or on outcomes of referrals. Conclusions The Covid-19 pandemic has prompted continued changes in delivery, which are likely to influence patient experience and outcomes; these need careful evaluation. The programme's delivery and commissioners' intentions to follow through risk communication with appropriate support is challenged by the complexity of the commissioning landscape.
Collapse
Affiliation(s)
- Erica Wirrmann Gadsby
- Faculty of Health Sciences and Sport, University of Stirling, Stirling, Scotland, FK9 4LA, UK
- Centre for Health Services Studies, University of Kent, Canterbury, England, CT2 7NX, UK
| | - Janet Krska
- Medway School of Pharmacy, Universities of Greenwich and Kent, Medway, ME4 4TB, UK
| | - Claire Duddy
- Nuffield Department of Primary Care Health Sciences, University of Oxford, Oxford, OX2 6GG, UK
| | - Vivienne Hibberd
- Public Involvement in Pharmacy Studies Group, Medway School of Pharmacy, Medway, ME4 4TB, UK
| | - Geoff Wong
- Nuffield Department of Primary Care Health Sciences, University of Oxford, Oxford, OX2 6GG, UK
| |
Collapse
|
8
|
Duddy C, Gadsby E, Hibberd V, Krska J, Wong G. What happens after an NHS Health Check? A survey and realist review. Health Soc Care Deliv Res 2023; 11:1-133. [PMID: 37830173 DOI: 10.3310/rgth4127] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 10/14/2023]
Abstract
Background The National Health Service Health Check in England aims to provide adults aged 40 to 74 with an assessment of their risk of developing cardiovascular disease and to offer advice to help manage and reduce this risk. The programme is commissioned by local authorities and delivered by a range of providers in different settings, although primarily in general practices. This project focused on variation in the advice, onward referrals and prescriptions offered to attendees following their health check. Objectives (1) Map recent programme delivery across England via a survey of local authorities; (2) conduct a realist review to enable understanding of how the National Health Service Health Check programme works in different settings, for different groups; (3) provide recommendations to improve delivery. Design Survey of local authorities and realist review of the literature. Review methods Realist review is a theory-driven, interpretive approach to evidence synthesis that seeks to explain why, when and for whom outcomes occur. We gathered published research and grey literature (including local evaluation documents and conference materials) via searching and supplementary methods. Extracted data were synthesised using a realist logic of analysis to develop an understanding of important contexts that affect the delivery of National Health Service Health Checks, and underlying mechanisms that produce outcomes related to our project focus. Results Our findings highlight the variation in National Health Service Health Check delivery models across England. Commissioners, providers and attendees understand the programme's purpose in different ways. When understood primarily as an opportunity to screen for disease, responsibility for delivery and outcomes rests with primary care, and there is an emphasis on volume of checks delivered, gathering essential data and communicating risk. When understood as an opportunity to prompt and support behaviour change, more emphasis is placed on delivery of advice and referrals to 'lifestyle services'. Practical constraints limit what can be delivered within the programme's remit. Public health funding restricts delivery options and links with onward services, while providers may struggle to deliver effective checks when faced with competing priorities. Attendees' responses to the programme are affected by features of delivery models and the constraints they face within their own lives. Limitations Survey response rate lower than anticipated; review findings limited by the availability and quality of the literature. Conclusions and implications The purpose and remit of the National Health Service Health Check programme should be clarified, considering prevailing attitudes about its value (especially among providers) and what can be delivered within existing resources. Some variation in delivery is likely to be appropriate to meet local population needs, but lack of clarity for the programme contributes to a 'postcode lottery' effect in the support offered to attendees after a check. Our findings raise important questions about whether the programme itself and services that it may feed into are adequately resourced to achieve positive outcomes for attendees, and whether current delivery models may produce inequitable outcomes. Future work Policy-makers and commissioners should consider the implications of the findings of this project; future research should address the relative scarcity of studies focused on the end of the National Health Service Health Check pathway. Study registration PROSPERO registration CRD42020163822. Funding This project was funded by the National Institute for Health and Care Research (NIHR) Health Services and Delivery Research programme (NIHR129209).
Collapse
Affiliation(s)
- Claire Duddy
- Nuffield Department of Primary Care Health Sciences, University of Oxford, Oxford, UK
| | - Erica Gadsby
- Centre for Health Services Studies, University of Kent, Canterbury, UK
| | - Vivienne Hibberd
- Public Involvement in Pharmacy Studies Group, Medway School of Pharmacy, Universities of Greenwich and Kent, Chatham Maritime, UK
| | - Janet Krska
- Medway School of Pharmacy, Universities of Greenwich and Kent, Chatham Maritime, UK
| | - Geoff Wong
- Nuffield Department of Primary Care Health Sciences, University of Oxford, Oxford, UK
| |
Collapse
|
9
|
King E, Gadsby E, Bell M, Duddy C, Kendall S, Wong G. Health visiting in the UK in light of the COVID-19 pandemic experience (RReHOPE): a realist review protocol. BMJ Open 2023; 13:e068544. [PMID: 36889822 PMCID: PMC10008202 DOI: 10.1136/bmjopen-2022-068544] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 03/10/2023] Open
Abstract
INTRODUCTION Health visiting services, providing support to under 5s and their families, are organised and delivered in very different ways in different parts of the UK. While there has been attention to the key components of health visiting practice and what works well and how, there is little research on how health visiting services are organised and delivered and how that affects their ability to meet their objectives. The COVID-19 pandemic rapidly disrupted service delivery from March 2020. This realist review aims to synthesise the evidence on changes during the pandemic to identify the potential for improving health visiting services and their delivery. METHODS AND ANALYSIS This review will follow the RAMESES (Realist And Meta-narrative Evidence Syntheses: Evolving Standards) quality standards and Pawson's five iterative stages to locate existing theories, search for evidence, select literature, extract data, synthesise evidence and draw conclusions. It will be guided by stakeholder engagement with practitioners, commissioners, policymakers, policy advocates and people with lived experience. This approach will consider the emerging strategies and evolving contexts in which the services are delivered, and the varied outcomes for different groups. A realist logic of analysis will be used to make sense of what was happening to health visiting services during and following the pandemic response through the identification and testing of programme theories. Our refined programme theory will then be used to develop recommendations for improving the organisation, delivery and ongoing postpandemic recovery of health visiting services. ETHICS AND DISSEMINATION General University Ethics Panel approval has been obtained from University of Stirling (reference 7662). Dissemination will build on links to policymakers, commissioners, providers, policy advocates and the public. A range of audiences will be targeted using outputs tailored to each. A final stakeholder event focused on knowledge mobilisation will aid development of recommendations. PROSPERO REGISTRATION NUMBER CRD42022343117.
Collapse
Affiliation(s)
- Emma King
- Faculty of Health Sciences and Sport, University of Stirling, Stirling, UK
| | - Erica Gadsby
- Faculty of Health Sciences and Sport, University of Stirling, Stirling, UK
| | | | - Claire Duddy
- Nuffield Department of Primary Care Health Sciences, University of Oxford, Oxford, UK
| | - Sally Kendall
- Centre for Health Services Studies, University of Kent, Canterbury, UK
| | - Geoff Wong
- Nuffield Department of Primary Care Health Sciences, University of Oxford, Oxford, UK
| |
Collapse
|
10
|
Duddy C, Wong G. Grand rounds in methodology: when are realist reviews useful, and what does a 'good' realist review look like? BMJ Qual Saf 2023; 32:173-180. [PMID: 36585019 DOI: 10.1136/bmjqs-2022-015236] [Citation(s) in RCA: 8] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/09/2022] [Accepted: 12/07/2022] [Indexed: 01/01/2023]
Abstract
Research in the quality and safety field often necessitates an approach that supports the development of an in-depth understanding of how a complex phenomenon occurs, or how an intervention works. Realist review is an increasingly popular form of evidence synthesis that provides a theory-driven, interpretive approach to secondary research. Realist reviews offer quality and safety researchers the opportunity to draw on diverse types of evidence to develop explanatory theory about how, when and for whom interventions 'work' or outcomes occur. The approach is flexible, iterative and practical, typically drawing on the experience of policymakers, practitioners and patients throughout the review. With the increasing use of realist reviews, some common misconceptions about the approach have become evident in the literature. This paper introduces what is involved when planning and conducting a realist review, and where the approach can offer most value, as well as outlining common challenges that researchers may face when adopting the approach, and recommended solutions. Our aim is to support researchers who are considering conducting a realist review to understand the key principles and concepts involved, and how they can go about producing high-quality work.
Collapse
Affiliation(s)
- Claire Duddy
- Nuffield Department of Primary Care Health Sciences, University of Oxford, Oxford, UK
| | - Geoff Wong
- Nuffield Department of Primary Care Health Sciences, University of Oxford, Oxford, UK
| |
Collapse
|
11
|
Owen EC, Abrams R, Cai Z, Duddy C, Fudge N, Hamer-Hunt J, Husson F, Mahtani KR, Ogden M, Swinglehurst D, Turner M, Whittlesea C, Wong G, Park S. Community pharmacy and general practice collaborative and integrated working: a realist review protocol. BMJ Open 2022; 12:e067034. [PMID: 36581431 PMCID: PMC9806063 DOI: 10.1136/bmjopen-2022-067034] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/30/2022] Open
Abstract
INTRODUCTION Increasing collaborative and integrated working between General practice (GP) and Community pharmacy (CP) is a key priority of the UK National Health Service and has been proposed as a solution to reducing health system fragmentation, improving synergies and coordination of care. However, there is limited understanding regarding how and under which circumstances collaborative and integrated working between GP and CP can be achieved in practice and how regulatory, organisational and systemic barriers can be overcome. METHODS AND ANALYSIS The aim of our review is to understand how, when and why working arrangements between GP and CP can provide the conditions necessary for optimal communication, decision-making, and collaborative and integrated working. A realist review approach will be used to synthesise the evidence to make sense of the complexities inherent in the working relationships between GP and CP. Our review will follow Pawson's five iterative stages: (1) finding existing theories; (2) searching for evidence (our main searches were conducted in April 2022); (3) article selection; (4) data extraction and (5) synthesising evidence and drawing conclusions. We will synthesise evidence from grey literature, qualitative, quantitative and mixed-methods research. The research team will work closely with key stakeholders and include patient and public involvement and engagement throughout the review process to refine the focus of the review and the programme theory. Collectively, our refined programme theory will explain how collaborative and integrated working between GP and CP works (or not), for whom, how and under which circumstances. ETHICS AND DISSEMINATION Formal ethical approval is not required for this review as it draws on secondary data from published articles and grey literature. Findings will be widely disseminated through: publication in peer-reviewed journals, seminars, international conference presentations, patients' association channels, social media, symposia and user-friendly summaries. PROSPERO REGISTRATION NUMBER CRD42022314280.
Collapse
Affiliation(s)
- Emily Claire Owen
- Department of Primary Care & Population Health, University College London, London, UK
| | - Ruth Abrams
- School of Health Sciences, University of Surrey, Surrey, UK
| | - Ziyue Cai
- Research Department of Practice and Policy, School of Pharmacy, University College London, London, UK
| | - Claire Duddy
- Nuffield Department of Primary Care Health Sciences, University of Oxford, Oxford, UK
| | - Nina Fudge
- Wolfson Institute of Population Health, Queen Mary University of London, London, UK, London, UK
| | - Julia Hamer-Hunt
- Department of Primary Care & Population Health, University College London, London, UK
- Department of Psychiatry, University of Oxford, Oxford, UK
| | - Fran Husson
- Department of Primary Care & Population Health, University College London, London, UK
- Faculty of Medicine, Imperial College London, London, UK
| | - Kamal Ram Mahtani
- Nuffield Department of Primary Care Health Sciences, University of Oxford, Oxford, UK
| | - Margaret Ogden
- Department of Primary Care & Population Health, University College London, London, UK
| | - Deborah Swinglehurst
- Wolfson Institute of Population Health, Queen Mary University of London, London, UK, London, UK
| | - Malcolm Turner
- Department of Primary Care & Population Health, University College London, London, UK
| | - Cate Whittlesea
- Research Department of Practice and Policy, School of Pharmacy, University College London, London, UK
| | - Geoff Wong
- Nuffield Department of Primary Care Health Sciences, University of Oxford, Oxford, UK
| | - Sophie Park
- Department of Primary Care & Population Health, University College London, London, UK
| |
Collapse
|
12
|
Abstract
OBJECTIVES The NHS Health Check offers adults aged 40-74 an assessment of their risk of developing cardiovascular disease. Attendees should be offered appropriate clinical or behavioural interventions to help them to manage or reduce these risks. This project focused on understanding variation in the advice and support offered to Health Check attendees. DESIGN We conducted a realist review, assembling a diverse body of literature via database searches (MEDLINE, Embase, CINAHL, HMIC, Web of Science) and other search methods, and synthesised data extracted from documents using a realist logic of analysis. Our aim was to develop an understanding of contexts affecting delivery of the NHS Health Check and the underlying mechanisms producing outcomes related to the offer for attendees post-Check. RESULTS Our findings demonstrate differences in how NHS Health Check commissioners, providers and attendees understand the primary purpose of the programme. A focus on screening for disease can produce an emphasis on high-volume delivery in primary care. When delivery models are organised around behavioural approaches to risk reduction, more emphasis is placed on advice, and referrals to 'lifestyle services'. However, constrained funding and competing priorities for providers limit what can be delivered within the programme's remit. Attendees' experiences and responses to the programme are affected by how the programme is delivered, and by the difficulty of incorporating its outputs into their lives. CONCLUSIONS The remit of the NHS Health Check should be reviewed with consideration of what can be effectively delivered within existing resources. Variation in delivery may be appropriate to meet local needs, but differences in how the programme's primary purpose is understood contribute to a 'postcode lottery' in post-Check advice and support. Our findings underline existing concerns that the programme may generate inequitable outcomes and raise questions about whether it can deliver positive outcomes for the majority of attendees. TRIAL REGISTRATION NUMBER PROSPERO CRD42020163822.
Collapse
Affiliation(s)
- Claire Duddy
- Nuffield Department of Primary Care Health Sciences, University of Oxford, Oxford, UK
| | - Erica Gadsby
- Faculty of Health Sciences and Sport, University of Stirling, Stirling, UK
| | - Vivienne Hibberd
- Public Involvement in Pharmacy Studies Group, University of Greenwich Medway School of Pharmacy, Chatham, UK
| | - Janet Krska
- Medway School of Pharmacy, Universities of Greenwich and Kent, Chatham, UK
| | - Geoff Wong
- Nuffield Department of Primary Care Health Sciences, Oxford University, Oxford, UK
| |
Collapse
|
13
|
Hammond SP, Duddy C, Mickleburgh E, Hiller R, Neil E, Williams K, Rodgers L, Wilson J, Wong G. Improving the mental health and mental health support available to adolescents with social care-experience via low-intensity life story work: a realist review protocol. BMJ Open 2022; 12:e058424. [PMID: 35264370 PMCID: PMC8915363 DOI: 10.1136/bmjopen-2021-058424] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/26/2022] Open
Abstract
INTRODUCTION Adolescents are the fastest growing group entering social care and are most at risk of mental ill-health. Life Story Work (LSW) is an existing transdiagnostic intervention thought to improve the well-being and mental health of children and adolescents under the care of a local authority by assisting the processing of trauma. Yet LSW is poorly evidenced, lacks standardisation and focuses on younger children. LSW is also high-intensity, relying on specialist input over several months. Adolescent-focused low-intensity-LSW is a promising alternative. However, there is poor evidence on how LSW, let alone low-intensity-LSW should be delivered to adolescents. We aim to identify why, how, in what contexts, for whom and to what extent low-intensity-LSW interventions can be delivered to adolescents with care-experience. METHODS AND ANALYSIS Undertaking a realist review, we will: (1) develop an initial programme theory (PrT) of adolescent-focused low-intensity-LSW by consulting with two key expert panels (care-experienced and professional stakeholders), and by searching the literature to identify existing relevant theories; (2) undertake a comprehensive literature search to identify secondary data to develop and refine our emerging PrT. Searches will be run between 12/2021-06/2022 in databases including MEDLINE, PsycINFO, ASSIA and relevant sources of grey literature; (3) select, extract and organise data; (4) synthesise evidence using a realist logic of analysis and undertake further iterative data searching and consultation with our expert panels; (5) write up and share the refined PrT with our expert panels for their final comments. From this process guidance will be developed to help improve the delivery of LSW to support the mental health needs of adolescents with care-experience. ETHICS AND DISSEMINATION Ethical approval is not required. Dissemination will include input from expert panels. We will develop academic, practice and youth focused outputs targeting adolescents, their carers, social, healthcare, and educational professionals, academics, and policymakers. PROSPERO REGISTRATION NUMBER CRD42021279816.
Collapse
Affiliation(s)
- Simon P Hammond
- School of Education and Lifelong Learning, University of East Anglia, Norwich, UK
- Norfolk and Suffolk NHS Foundation Trust, Norwich, UK
| | - Claire Duddy
- Nuffield Department of Primary Care Health Sciences, University of Oxford, Oxford, UK
| | | | - Rachel Hiller
- Division of Psychology and Language Sciences, University College London, London, UK
| | - Elsbeth Neil
- School of Social Work, University of East Anglia, Norwich, UK
| | | | | | - Jon Wilson
- Norfolk and Suffolk NHS Foundation Trust, Norwich, UK
| | - Geoff Wong
- Nuffield Department of Primary Care Health Sciences, University of Oxford, Oxford, UK
| |
Collapse
|
14
|
Maidment ID, Wong G, Duddy C, Upthegrove R, Oduola S, Robotham D, Higgs S, Ahern A, Birdi G. REalist Synthesis Of non-pharmacologicaL interVEntions for antipsychotic-induced weight gain (RESOLVE) in people living with severe mental illness (SMI). Syst Rev 2022; 11:42. [PMID: 35264212 PMCID: PMC8906356 DOI: 10.1186/s13643-022-01912-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/24/2021] [Accepted: 03/01/2022] [Indexed: 11/10/2022] Open
Abstract
BACKGROUND People with severe mental illnesses (SMI) such as schizophrenia die on average 15 to 20 years earlier than everyone else. Two thirds of these deaths are from preventable physical illnesses such as hypertension, cardiovascular disease, and diabetes, which are worsened by weight gain. Antipsychotics are associated with significant weight gain. In REalist Synthesis Of non-pharmacologicaL interVEntions (RESOLVE), a realist synthesis, combining primary and secondary data, will be used to understand and explain how, why, for whom, and in what contexts non-pharmacological interventions can help service users to manage antipsychotic-induced weight gain. METHODS A five-step approach will be used to develop guidance: 1. Developing the initial programme theory An initial (candidate) programme theory, which sets out how and why outcomes occur within an intervention, will be developed. 2. Developing the search The initial programme theory will be refined using academic and grey literature. The proposed initial sampling frame are as follows: Context: people living with SMI, taking antipsychotics, different types of SMI. INTERVENTION non-pharmacological interventions. MECHANISMS triggered by the intervention. Outcomes e.g. weight, metabolic adverse events, quality of life, adherence, burden, economic. Searching for relevant documents will continue until sufficient data is found to conclude that the refined programme theory is coherent and plausible. Lived experience (service users) and stakeholder (practitioners) groups will provide feedback. 3. Selection, appraisal and data extraction Documents will be screened against inclusion and exclusion criteria. The text extracted from these documents will be coded as contexts, mechanisms and their relationships to outcomes. 4. Primary data collection Realist interviews with up to 30 service users and informal carers, and 20 practitioners will gather data to support, refute or refine the programme theory. 5. Data analysis A realist logic of analysis will be used to develop and refine the programme theory from secondary and primary data. The analysis will aim to identify practical intervention strategies to change contexts so that key mechanisms are triggered to produce desired outcomes. Guidance will be produced based on these strategies. DISCUSSION This realist synthesis aims to develop guidance for service users and practitioners on the most appropriate interventional strategies to manage and limit antipsychotic weight gain. SYSTEMATIC REVIEW REGISTRATION PROSPERO: CRD42021268697.
Collapse
Affiliation(s)
- Ian D Maidment
- College of Health and Life Sciences, Aston University, Birmingham, B4 7ET, UK.
| | - Geoffrey Wong
- Nuffield Department of Primary Care Health Sciences, University of Oxford, Oxford, OX2 6GG, UK
| | - Claire Duddy
- Nuffield Department of Primary Care Health Sciences, University of Oxford, Oxford, OX2 6GG, UK
| | - Rachel Upthegrove
- School of Psychology, University of Birmingham, Edgbaston, Birmingham, B15 2TT, UK
| | - Sheri Oduola
- School of Health Sciences, University of East Anglia, Norwich Research Park, Norwich, NR4 7TJ, UK
| | - Dan Robotham
- The McPin Foundation, 7-14 Great Dover St, London, SE1 4YR, UK
| | - Suzanne Higgs
- School of Psychology, University of Birmingham, Edgbaston, Birmingham, B15 2TT, UK
| | - Amy Ahern
- MRC Epidemiology Unit, University of Cambridge School of Clinical Medicine, Cambridge Biomedical Campus, Cambridge, CB2 0QQ, UK
| | - Gurkiran Birdi
- College of Health and Life Sciences, Aston University, Birmingham, B4 7ET, UK
| |
Collapse
|
15
|
Coombs CRH, Cohen T, Duddy C, Mahtani KR, Roberts N, Saini A, Foster AS, Park S. Primary care micro-teams: a protocol for an international systematic review to describe and examine the opportunities and challenges of implementation for patients and healthcare professionals. BMJ Open 2022; 12:e052651. [PMID: 35232781 PMCID: PMC8889310 DOI: 10.1136/bmjopen-2021-052651] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/03/2022] Open
Abstract
INTRODUCTION There has been a recent trend towards creating larger primary care practices with the assumption that interdisciplinary teams can deliver improved and more cost-effective services to patients with better accessibility. Micro-teams have been proposed to mitigate some of the potential challenges with practice expansion, including continuity of care. We aim to review the available literature to improve understanding of how micro-teams are described and the opportunities which primary care micro-teams can provide for practice staff and patients and limitations to their introduction and implementation. Our review asks: how is micro-team implementation described? What are the experiences of healthcare professionals and patients concerning micro-teams in primary care? What are the reported implications of micro-teams for patient care? METHODS AND ANALYSIS CINAHL, Cochrane Library, Embase, MEDLINE and Scopus will be searched for studies in English. Grey literature will be sourced from Google Scholar, government websites, CCG websites, general practice directives and strategies with advice from stakeholders. Included studies will give evidence regarding the implementation of micro-teams. Data will be synthesised using framework analysis. We will use iterative stakeholder and public and patient participation to embed the perspectives of those whom micro-teams could impact. Included studies will be quality assessed using the Mixed Methods Appraisal Tool. The quality assessment will not be used to exclude any evidence but rather to develop a narrative discussion evaluating included literature. ETHICS AND DISSEMINATION Ethical approval will not be necessary for this systematic review as there will only be a secondary analysis of data already available in scientific databases and the grey literature. This protocol has been submitted for registration to be made available on a review database (PROSPERO). Findings will be disseminated widely through peer-reviewed publication and in various media, for example, conferences, congresses or symposia. PROSPERO REGISTRATION NUMBER CRD42021225367.
Collapse
Affiliation(s)
| | | | - Claire Duddy
- Nuffield Department of Primary Care Health Sciences, University of Oxford, Oxford, UK
| | - Kamal Ram Mahtani
- Nuffield Department of Primary Care Health Sciences, University of Oxford, Oxford, UK
| | - Nia Roberts
- Nuffield Department of Primary Care Health Sciences, University of Oxford, Oxford, UK
| | | | | | - Sophie Park
- Department of Primary Care and Population Health, UCL, London, UK
| |
Collapse
|
16
|
Abstract
INTRODUCTION Severe mental illness (SMI) is associated with significant morbidity and mortality. People living with SMI often receive complex medication regimens. Optimising these regimens can be challenging. Non-adherence is common and addressing it requires a collaborative approach to decision making. MEDIATE uses a realist approach with extensive engagement with experts-by-experience to make sense of the complexities and identify potential solutions.Realist research is used to unpack and explain complexity using programme theory/theories that contain causal explanations of outcomes, expressed as context-mechanism-outcome-configurations. The programme theory/theories will enable MEDIATE to address its aim of understanding what works, for whom, in what circumstances, to optimise medication use with people living with SMI. METHOD AND ANALYSIS MEDIATE will be conducted over six stages. In stage 1, we will collaborate with our service user/family carer lived experience group (LEG) and practitioner stakeholder group (SG), to determine the focus. In stage 2, we will develop initial programme theories for what needs to be done, by whom, how and why, and in what contexts to optimise medication use. In stage 3, we will develop and run searches to identify secondary data to refine our initial programme theories.Stage 4 involves selection and appraisal: documents will be screened by title, abstract/keywords and full text against inclusion and exclusion criteria. In stage 5, relevant data will extracted, recorded and coded. Data will be analysed using a realist logic with input from the LEG and SG. Finally, in stage 6, refined programme theories will be developed, identifying causal explanations for key outcomes and the strategies required to change contexts to trigger the key mechanisms that produce these outcomes. ETHICS AND DISSEMINATION Primary data will not be collected, and therefore, ethical approval is not required. MEDIATE will be disseminated via publications, conferences and form the basis for future grant applications. PROSPERO REGISTRATION NUMBER CRD42021280980.
Collapse
Affiliation(s)
- Ian Maidment
- College of Health and Life Sciences, Aston University, Birmingham, UK
| | - Geoff Wong
- Nuffield Department of Primary Care Health Sciences, Oxford University, Oxford, UK
| | - Claire Duddy
- Nuffield Department of Primary Care Health Sciences, Oxford University, Oxford, UK
| | - Rachel Upthegrove
- Department of Psychiatry, School of Psychology and College of Medical and Dental Sciences, University of Birmingham, Birmingham, UK
| | - Sherifat Oduola
- Health Service Population Research, University of East Anglia, Norwich, UK
| | - Katherine Allen
- Birmingham and Solihull Mental Health NHS Foundation Trust, Birmingham, Birmingham, UK
| | - Simon Jacklin
- School of Pharmacy and Bioengineering, Keele University, Keele, UK
| | - Jo Howe
- College of Health and Life Sciences, Aston University, Birmingham, UK
| | - Maura MacPhee
- School of Nursing, The University of British Columbia, Vancouver, British Columbia, Canada
| |
Collapse
|
17
|
Vincent R, Adhikari B, Duddy C, Richardson E, Wong G, Lavery J, Molyneux S. 'Working relationships' across difference - a realist review of community engagement with malaria research. Wellcome Open Res 2022; 7:13. [PMID: 37621950 PMCID: PMC10444998 DOI: 10.12688/wellcomeopenres.17192.1] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 12/07/2021] [Indexed: 08/26/2023] Open
Abstract
Background: Community engagement (CE) is increasingly accepted as a critical aspect of health research, because of its potential to make research more ethical, relevant and well implemented. While CE activities linked to health research have proliferated in Low and Middle Income Countries (LMICs), and are increasingly described in published literature, there is a lack of conceptual clarity around how engagement is understood to 'work', and the aims and purposes of engagement are varied and often not made explicit. Ultimately, the evidence base for engagement remains underdeveloped. Methods: To develop explanations for how and why CE with health research contributes to the pattern of outcomes observed in published literature , we conducted a realist review of CE with malaria research - a theory driven approach to evidence synthesis. Results: We found that community engagement relies on the development of provisional 'working relationships' across differences, primarily of wealth, power and culture. These relationships are rooted in interactions that are experienced as relatively responsive and respectful, and that bring tangible research related benefits. Contextual factors affecting development of working relationships include the facilitating influence of research organisation commitment to and resources for engagement, and constraining factors linked to the prevailing 'dominant health research paradigm context', such as: differences of wealth and power between research centres and local populations and health systems; histories of colonialism and vertical health interventions; and external funding and control of health research. Conclusions: The development of working relationships contributes to greater acceptance and participation in research by local stakeholders, who are particularly interested in research related access to health care and other benefits. At the same time, such relationships may involve an accommodation of some ethically problematic characteristics of the dominant health research paradigm, and thereby reproduce this paradigm rather than challenge it with a different logic of collaborative partnership.
Collapse
Affiliation(s)
- Robin Vincent
- Centre for Tropical Medicine and Global Health, Nuffield Department of Clinical Medicine, University of Oxford, Oxford, OX3 7LG, UK
- Robin Vincent Learning and Evaluation Ltd, Sheffield, S89FH, UK
| | - Bipin Adhikari
- Centre for Tropical Medicine and Global Health, Nuffield Department of Clinical Medicine, University of Oxford, Oxford, OX3 7LG, UK
- Mahidol-Oxford Tropical Medicine Research Unit, Faculty of Tropical Medicine, Mahidol University, Bangkok, Thailand
| | - Claire Duddy
- Nuffield Department of Primary Health Care Services, University of Oxford, Oxford, OX2 6GG, UK
| | - Emma Richardson
- Health Research, Evidence and Impact, McMaster University, Hamilton, ON L8S 4L8, Canada
| | - Geoff Wong
- Nuffield Department of Primary Health Care Services, University of Oxford, Oxford, OX2 6GG, UK
| | - James Lavery
- Hubert Department of Global Health, Rollins School of Public Health, Emory University, Atlanta, Georgia, 30322, USA
- Center for Ethics, Emory University, Atlanta, Georgia, 30322, USA
| | - Sassy Molyneux
- Centre for Tropical Medicine and Global Health, Nuffield Department of Clinical Medicine, University of Oxford, Oxford, OX3 7LG, UK
- Kenya Medical Research Institute (KEMRI) Wellcome Trust Research Programme, University of Oxford, Kilifi, 80108, Kenya
| | - The REAL team: Mary Chambers, Phaik Yeong Cheah, Al Davies, Kate Gooding, Dorcas Kamuya, Vicki Marsh, Noni Mumba, Deborah Nyirenda, and Paulina Tindana.
- Centre for Tropical Medicine and Global Health, Nuffield Department of Clinical Medicine, University of Oxford, Oxford, OX3 7LG, UK
- Robin Vincent Learning and Evaluation Ltd, Sheffield, S89FH, UK
- Mahidol-Oxford Tropical Medicine Research Unit, Faculty of Tropical Medicine, Mahidol University, Bangkok, Thailand
- Nuffield Department of Primary Health Care Services, University of Oxford, Oxford, OX2 6GG, UK
- Health Research, Evidence and Impact, McMaster University, Hamilton, ON L8S 4L8, Canada
- Hubert Department of Global Health, Rollins School of Public Health, Emory University, Atlanta, Georgia, 30322, USA
- Center for Ethics, Emory University, Atlanta, Georgia, 30322, USA
- Kenya Medical Research Institute (KEMRI) Wellcome Trust Research Programme, University of Oxford, Kilifi, 80108, Kenya
| |
Collapse
|
18
|
McConnell T, Burden J, Duddy C, Hill L, Howie C, Jones B, Ruane B, Wong G, Reid J. Integrating palliative care and heart failure: a protocol for a realist synthesis (PalliatHeartSynthesis). BMJ Open 2022; 12:e058848. [PMID: 34996806 PMCID: PMC8744113 DOI: 10.1136/bmjopen-2021-058848] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/26/2022] Open
Abstract
INTRODUCTION Heart failure affects over 26 million people worldwide with prevalence expected to grow due to an ageing global population. Palliative care can address the holistic needs of patients with heart failure, and integrated palliative care in heart failure management has been indicated to improve outcomes for patients. Despite known benefits for integrated palliative care in heart failure management, implementation is poor across the majority of global health services. Recent systematic reviews have identified the benefits of integrating palliative care into heart failure management and highlighted barriers to implementation. However, there was heterogeneity in terms of countries, healthcare settings, delivery by differing staff across multidisciplinary teams, modes of delivery and different intervention components. METHODS AND ANALYSIS The aim of this study is to identify how integrated palliative care and heart failure interventions produce desired outcomes, in which contexts, and for which patients. We will undertake a realist synthesis to identify this, using Pawson's five iterative steps. We will recruit an international stakeholder group comprised of healthcare providers and patients with heart failure to advise and provide feedback throughout the review. Our initial realist programme theory sets out the necessary steps needed to accomplish the final intended outcome(s) from the implementation of integrated palliative care and heart failure. This initial programme theory will be shaped through an iterative process of testing and refinement. ETHICS AND DISSEMINATION Ethical approval is not required for this study. With our stakeholder group, we will coproduce a user guide that outlines practical advice to optimise, tailor and implement interventions designed to integrate palliative care and heart failure, taking into consideration local context, alongside user-friendly summaries of the synthesis findings using short animations to convey complex findings. We will draw on the expertise within the stakeholder group to identify key stakeholders for disseminating to relevant audiences, ensuring outputs are tailored for their respective needs. PROSPERO REGISTRATION NUMBER CRD42021240185.
Collapse
Affiliation(s)
- Tracey McConnell
- School of Nursing and Midwifery, Queen's University Belfast, Belfast, UK
- Marie Curie Hospice, Belfast, UK
| | - John Burden
- Patient and Public Involvement Group, British Heart Foundation, London, UK
| | - Claire Duddy
- Nuffield Department of Primary Care Health Sciences, University of Oxford, Oxford, UK
| | - Loreena Hill
- School of Nursing and Midwifery, Queen's University Belfast, Belfast, UK
| | - Clare Howie
- School of Nursing and Midwifery, Queen's University Belfast, Belfast, UK
| | - Bob Jones
- Patient and Public Involvement Group, British Heart Foundation, London, UK
| | - Bob Ruane
- Patient and Public Involvement Group, British Heart Foundation, London, UK
| | - Geoff Wong
- Nuffield Department of Primary Care Health Sciences, University of Oxford, Oxford, UK
| | - Joanne Reid
- School of Nursing and Midwifery, Queen's University Belfast, Belfast, UK
| |
Collapse
|
19
|
Duddy C, Roberts N. Identifying evidence for five realist reviews in primary health care: A comparison of search methods. Res Synth Methods 2021; 13:190-203. [PMID: 34494358 DOI: 10.1002/jrsm.1523] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/19/2021] [Revised: 06/28/2021] [Accepted: 08/20/2021] [Indexed: 01/14/2023]
Abstract
The approach to identifying evidence for inclusion in realist reviews differs from that used in 'traditional' systematic reviews. Guidance suggests that realist reviews should be inclusive of diverse data from a range of sources, gathered in iterative searching cycles. Saturation is prioritised over exhaustiveness. Supplementary techniques such as citation snowballing are emphasised as potentially important sources of evidence. This paper describes the processes used to identify evidence in a selection of realist reviews focused on primary health care settings and examines the origin and type of evidence selected for inclusion. Data from five realist reviews were extracted from (a) reviewers' reference management libraries and (b) records kept by review teams. Although all reviews focused on primary health care, they used data from a wide range of document types and research designs, drawing on learning from multiple perspectives and settings, and sourced the documents containing this data in a variety of ways. Systematic searching of academic databases played an important role, supplementary search techniques such as snowballing were used to identify a significant proportion of documents included in the reviews. Our analysis demonstrates the diverse data sources used within realist reviews and the need for flexible, responsive efforts to identify relevant documents. Reviewers and information specialists should devise approaches to data gathering that reflect the individual needs of realist review projects and report these transparently.
Collapse
Affiliation(s)
- Claire Duddy
- Nuffield Department of Primary Care Health Sciences, University of Oxford, Oxford, UK
| | - Nia Roberts
- Bodleian Health Care Libraries, University of Oxford, Oxford, UK
| |
Collapse
|
20
|
Grünwald LM, Duddy C, Byng R, Crellin N, Moncrieff J. The role of trust and hope in antipsychotic medication reviews between GPs and service users a realist review. BMC Psychiatry 2021; 21:390. [PMID: 34348680 PMCID: PMC8340528 DOI: 10.1186/s12888-021-03355-3] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/12/2021] [Accepted: 06/26/2021] [Indexed: 12/17/2022] Open
Abstract
BACKGROUND Increasing number of service users diagnosed with schizophrenia and psychosis are being discharged from specialist secondary care services to primary care, many of whom are prescribed long-term antipsychotics. It is unclear if General Practitioners (GPs) have the confidence and experience to appropriately review and adjust doses of antipsychotic medication without secondary care support. AIM To explore barriers and facilitators of conducting antipsychotic medication reviews in primary care for individuals with no specialist mental health input. DESIGN & SETTING Realist review in general practice settings. METHOD A realist review has been conducted to synthesise evidence on antipsychotic medication reviews conducted in primary care with service users diagnosed with schizophrenia or psychosis. Following initial scoping searches and discussions with stakeholders, a systematic search and iterative secondary searches were conducted. Articles were systematically screened and analysed to develop a realist programme theory explaining the contexts (C) and mechanisms (M) which facilitate or prevent antipsychotic medication reviews (O) in primary care settings, and the potential outcomes of medication reviews. RESULTS Meaningful Antipsychotic medication reviews may not occur for individuals with only primary care medical input. Several, often mutually reinforcing, mechanisms have been identified as potential barriers to conducting such reviews, including low expectations of recovery for people with severe mental illness, a perceived lack of capability to understand and participate in medication reviews, linked with a lack of information shared in appointments between GPs and Service Users, perceived risk and uncertainty regarding antipsychotic medication and illness trajectory. CONCLUSIONS The review identified reciprocal and reinforcing stereotypes affecting both GPs and service users. Possible mechanisms to counteract these barriers are discussed, including realistic expectations of medication, and the need for increased information sharing and trust between GPs and service users.
Collapse
Affiliation(s)
- L M Grünwald
- Division of Psychiatry, University College London, 149 Tottenham Court Rd, Bloomsbury, London, W1T 7NF, UK.
- Comprehensive Clinical Trials Unit, 90 High Holborn, London, WC1V 6LJ, UK.
| | - C Duddy
- Nuffield Department of Primary Care Health Sciences, University of Oxford Radcliffe Observatory Quarter, Woodstock Road, Oxford, OX2 6GG, UK
| | - R Byng
- Peninsula Medical School, University of Plymouth, Drake Circus, Plymouth, Devon, PL4 8AA, UK
| | - N Crellin
- Nuffield Trust, 59 New Cavendish Street, London, W1G 7LP, UK
| | - J Moncrieff
- Division of Psychiatry, University College London, 149 Tottenham Court Rd, Bloomsbury, London, W1T 7NF, UK
- Research and Development Department, North East London Foundation Trust, Maggie Lilley Suite, Goodmayes Hospital, Barley Lane, Ilford, Essex, IG3 8XJ, UK
| |
Collapse
|
21
|
Abstract
INTRODUCTION The NHS Health Check aims to identify individuals at increased risk of cardiovascular diseases (CVDs) among the adult population in England. The Health Check includes calculation of CVD risk and discussion of pharmacological and lifestyle approaches to manage risk, including referral to lifestyle support services. The programme is commissioned by Local Authorities (LAs) and is delivered by a range of different providers in different settings. There is significant variation in activity, with uptake ranging from 25% to 85% in different areas, and clear evidence of variation in implementation and delivery practice. METHODS AND ANALYSIS We aim to understand how the NHS Health Check programme works in different settings, for different groups, so that we can recommend improvements to maximise intended outcomes. To do so, we will undertake a realist review and a survey of LA public health teams. Our review will follow Pawson's five iterative stages: (1) locate existing theories, (2) search for evidence, (3) article selection, (4) extract and organise data and (5) synthesise evidence and draw conclusions. Our review will include documents describing local implementation alongside published research studies. We will recruit a stakeholder group (including Public Health England, commissioners and providers of Health Checks, plus members of the public and patients) to advise us throughout. Our survey will be sent to all 152 LAs in England to gather detailed information on programme delivery (including COVID-19-related changes) and available referral services. This will enable us to map delivery across England and relate these data to programme outcomes. ETHICS AND DISSEMINATION Ethical approval is not required for this review. For the survey, we have received approval from the University of Kent Research Ethics Committee. Our findings will be used to develop recommendations on tailoring, implementation and design strategies to improve delivery of the NHS Health Check in different settings, for different groups. PROSPERO REGISTRATION NUMBER CRD42020163822.
Collapse
Affiliation(s)
- Claire Duddy
- Nuffield Department of Primary Care Health Sciences, Oxford University, Oxford, UK
| | - Geoff Wong
- Nuffield Department of Primary Care Health Sciences, Oxford University, Oxford, UK
| | - E W Gadsby
- Centre for Health Services Studies, University of Kent, Canterbury, UK
| | - Janet Krska
- Universities of Greenwich and Kent, Medway School of Pharmacy, Chatham Maritime, UK
| | - Vivienne Hibberd
- Public Involvement in Pharmacy Studies Group, University of Kent Medway School of Pharmacy, Chatham Maritime, UK
| |
Collapse
|
22
|
Dixon S, Duddy C, Harrison G, Papoutsi C, Ziebland S, Griffiths F. Conversations about FGM in primary care: a realist review on how, why and under what circumstances FGM is discussed in general practice consultations. BMJ Open 2021; 11:e039809. [PMID: 33753429 PMCID: PMC7986780 DOI: 10.1136/bmjopen-2020-039809] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/01/2020] [Revised: 09/11/2020] [Accepted: 11/09/2020] [Indexed: 02/07/2023] Open
Abstract
OBJECTIVES Little is known about the management of female genital mutilation (FGM) in primary care. There have been significant recent statutory changes relevant to general practitioners (GPs) in England, including a mandatory reporting duty. We undertook a realist synthesis to explore what influences how and when GPs discuss FGM with their patients. SETTING Primary care in England. DATA SOURCES Realist literature synthesis searching 10 databases with terms: GPs, primary care, obstetrics, gynaecology, midwifery and FGM (UK and worldwide). Citation chasing was used, and relevant grey literature was included, including searching FGM advocacy organisation websites for relevant data. Other potentially relevant literature fields were searched for evidence to inform programme theory development. We included all study designs and papers that presented evidence about factors potentially relevant to considering how, why and in what circumstances GPs feel able to discuss FGM with their patients. PRIMARY OUTCOME MEASURE This realist review developed programme theory, tested against existing evidence, on what influences GPs actions and reactions to FGM in primary care consultations and where, when and why these influences are activated. RESULTS 124 documents were included in the synthesis. Our analysis found that GPs need knowledge and training to help them support their patients with FGM, including who may be affected, what needs they may have and how to talk sensitively about FGM. Access to specialist services and guidance may help them with this role. Reporting requirements may complicate these conversations. CONCLUSIONS There is a pressing need to develop (and evaluate) training to help GPs meet FGM-affected communities' health needs and to promote the accessibility of primary care. Education and resources should be developed in partnership with community members. The impact of the mandatory reporting requirement and the Enhanced Dataset on healthcare interactions in primary care warrants evaluation. PROSPERO REGISTRATION NUMBER CRD42018091996.
Collapse
Affiliation(s)
- Sharon Dixon
- Nuffield Department of Primary Care Health Sciences, University of Oxford, Oxford, UK
| | - Claire Duddy
- Nuffield Department of Primary Care Health Sciences, University of Oxford, Oxford, UK
| | | | - Chrysanthi Papoutsi
- Nuffield Department of Primary Care Health Sciences, University of Oxford, Oxford, UK
| | - Sue Ziebland
- Nuffield Department of Primary Care Health Sciences, University of Oxford, Oxford, UK
| | - Frances Griffiths
- Centre for Health Policy, University of the Witwatersrand, Johannesburg, South Africa
- Warwick Medical School, University of Warwick, Coventry, UK
| |
Collapse
|
23
|
Abstract
Introduction: Community engagement is increasingly recognized as a critical aspect of global health. Recent years have seen an expansion of community engagement activities linked to health research, but debates and inconsistencies remain about the aims of different types of engagement, mechanisms underpinning their implementation and impact, and influential contextual factors. Greater commitment to and consistency around community engagement by health research programs, implementers and funders requires a more coherent evidence base. This realist review is designed to improve our understanding of how and why community engagement contributes to intended and unintended outcomes (including research and ethical outcomes) in different contexts. Given the breadth and diversity of the literature on community engagement in health research, the review will initially focus on malaria research in low- and middle-income countries (LMICs) and draw on wider global health literature where needed. Methods and analysis: Community engagement in practice is often a complex set of interventions. We will conduct a realist review - a theory driven approach to evidence synthesis - to provide explanations for how and why community engagement with health research produces the pattern of outcomes observed across different contexts of application. We will consolidate evidence from a range of documents, including qualitative, quantitative and mixed method studies. The review will follow several stages: devising an initial programme theory, searching evidence, selecting appropriate documents, extracting data, synthesizing and refining the programme theory, and reiteration of these steps as needed. Ethics and dissemination: A formal ethics review is not required for this literature review. Findings will be disseminated in a peer reviewed journal, through national and international conferences, and through a set of short briefings tailored for audiences with an interest in community engagement. Outputs and presentations will be informed by and feed into our network of community engagement experts. PROSPERO registration number: CRD42019125687.
Collapse
Affiliation(s)
- Bipin Adhikari
- Centre for Tropical Medicine and Global Health, Nuffield Department of Medicine, University of Oxford, Oxford, OX1 3SY, UK
| | - Robin Vincent
- Robin Vincent Learning and Evaluation Limited, Sheffield, UK
| | - Geoff Wong
- Nuffield Department of Primary Health Care Services, University of Oxford, Oxford, OX2 6GG, UK
| | - Claire Duddy
- Nuffield Department of Primary Health Care Services, University of Oxford, Oxford, OX2 6GG, UK
| | - Emma Richardson
- Centre for Ethical, Social & Cultural Risk, St Michael's Hospital, Toronto, ON M5B 1W8, Canada
| | - James V. Lavery
- Hubert Department of Global Health, Rollins School of Public Health, Emory University, Atlanta, Georgia, 30322, USA
- Center for Ethics, Emory University, Altanta, Georgia, 30322, USA
| | - Sassy Molyneux
- Centre for Tropical Medicine and Global Health, Nuffield Department of Medicine, University of Oxford, Oxford, OX1 3SY, UK
- Kenya Medical Research Institute (KEMRI) Wellcome Trust Research Programme, University of Oxford, Kilifi, 80108, Kenya
| |
Collapse
|
24
|
Adhikari B, Vincent R, Wong G, Duddy C, Richardson E, Lavery JV, Molyneux S. A realist review of community engagement with health research. Wellcome Open Res 2019; 4:87. [PMID: 31289754 PMCID: PMC6611131 DOI: 10.12688/wellcomeopenres.15298.1] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 05/22/2019] [Indexed: 09/07/2023] Open
Abstract
Introduction: Community engagement is increasingly recognized as a critical aspect of global health. Recent years have seen an expansion of community engagement activities linked to health research, but debates and inconsistencies remain about the aims of different types of engagement, mechanisms underpinning their implementation and impact, and influential contextual factors. Greater commitment to and consistency around community engagement by health research programs, implementers and funders requires a more coherent evidence base. This realist review is designed to improve our understanding of how and why community engagement contributes to intended and unintended outcomes (including research and ethical outcomes) in different contexts. Given the breadth and diversity of the literature on community engagement in health research, the review will initially focus on malaria research in low- and middle-income countries (LMICs) and draw on wider global health literature where needed. Methods and analysis: Community engagement in practice is often a complex set of interventions. We will conduct a realist review - a theory driven approach to evidence synthesis - to provide explanations for how and why community engagement with health research produces the pattern of outcomes observed across different contexts of application. We will consolidate evidence from a range of documents, including qualitative, quantitative and mixed method studies. The review will follow several stages: devising an initial programme theory, searching evidence, selecting appropriate documents, extracting data, synthesizing and refining the programme theory, and reiteration of these steps as needed. Ethics and dissemination: A formal ethics review is not required for this literature review. Findings will be disseminated in a peer reviewed journal, through national and international conferences, and through a set of short briefings tailored for audiences with an interest in community engagement. Outputs and presentations will be informed by and feed into our network of community engagement experts. PROSPERO registration number: CRD42019125687.
Collapse
Affiliation(s)
- Bipin Adhikari
- Centre for Tropical Medicine and Global Health, Nuffield Department of Medicine, University of Oxford, Oxford, OX1 3SY, UK
| | - Robin Vincent
- Robin Vincent Learning and Evaluation Limited, Sheffield, UK
| | - Geoff Wong
- Nuffield Department of Primary Health Care Services, University of Oxford, Oxford, OX2 6GG, UK
| | - Claire Duddy
- Nuffield Department of Primary Health Care Services, University of Oxford, Oxford, OX2 6GG, UK
| | - Emma Richardson
- Centre for Ethical, Social & Cultural Risk, St Michael's Hospital, Toronto, ON M5B 1W8, Canada
| | - James V. Lavery
- Hubert Department of Global Health, Rollins School of Public Health, Emory University, Atlanta, Georgia, 30322, USA
- Center for Ethics, Emory University, Altanta, Georgia, 30322, USA
| | - Sassy Molyneux
- Centre for Tropical Medicine and Global Health, Nuffield Department of Medicine, University of Oxford, Oxford, OX1 3SY, UK
- Kenya Medical Research Institute (KEMRI) Wellcome Trust Research Programme, University of Oxford, Kilifi, 80108, Kenya
| |
Collapse
|
25
|
Abstract
INTRODUCTION Studies have demonstrated the existence of significant variation in test-ordering patterns in both primary and secondary care, for a wide variety of tests and across many health systems. Inconsistent practice could be explained by differing degrees of underuse and overuse of tests for diagnosis or monitoring. Underuse of appropriate tests may result in delayed or missed diagnoses; overuse may be an early step that can trigger a cascade of unnecessary intervention, as well as being a source of harm in itself. METHODS AND ANALYSIS This realist review will seek to improve our understanding of how and why variation in laboratory test ordering comes about. A realist review is a theory-driven systematic review informed by a realist philosophy of science, seeking to produce useful theory that explains observed outcomes, in terms of relationships between important contexts and generative mechanisms.An initial explanatory theory will be developed in consultation with a stakeholder group and this 'programme theory' will be tested and refined against available secondary evidence, gathered via an iterative and purposive search process. This data will be analysed and synthesised according to realist principles, to produce a refined 'programme theory', explaining the contexts in which primary care doctors fail to order 'necessary' tests and/or order 'unnecessary' tests, and the mechanisms underlying these decisions. ETHICS AND DISSEMINATION Ethical approval is not required for this review. A complete and transparent report will be produced in line with the RAMESES standards. The theory developed will be used to inform recommendations for the development of interventions designed to minimise 'inappropriate' testing. Our dissemination strategy will be informed by our stakeholders. A variety of outputs will be tailored to ensure relevance to policy-makers, primary care and pathology practitioners, and patients. PROSPERO REGISTRATION NUMBER CRD42018091986.
Collapse
Affiliation(s)
- Claire Duddy
- Nuffield Department of Primary Care Health Sciences, Radcliffe Observatory Quarter, Oxford, UK
| | - Geoffrey Wong
- Nuffield Department of Primary Care Health Sciences, Radcliffe Observatory Quarter, Oxford, UK
| |
Collapse
|
26
|
Duddy C. A personal perspective on accessing academic information in the Google era, or ‘How I learned to stop worrying and love Google’. ACTA ACUST UNITED AC 2009. [DOI: 10.1629/22131] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/03/2022]
|