1
|
Mannethodi K, Hassan N, Kunjavara J, Pitiquen EE, Joy G, Al-Lenjawi B. Research Self-Efficacy and Research-Related Behavior Among Nurses in Qatar: A Cross-Sectional Study. FLORENCE NIGHTINGALE JOURNAL OF NURSING 2023; 31:138-144. [PMID: 37847012 PMCID: PMC10724818 DOI: 10.5152/fnjn.2023.23002] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/08/2023] [Accepted: 06/13/2023] [Indexed: 10/18/2023]
Abstract
AIM Research self-efficacy helps predict the individual interest and confidence in conducting research. The study was conducted to identify the research self-efficacy among nurses working in a group of tertiary hospitals and their research-related behavior. METHOD The study design was descriptive cross-sectional and conducted among nurses at Hamad Medical Corporation, Qatar Convenient sampling was done and 500 is the sample size. Data were collected through an online survey during 2 months in 2019 by using a validated "Nursing Research Self-Efficacy Scale" questionnaire. The scale includes 38 items under five domains, and the response was collected on a Likert scale from 1 to 5. The authors of the scale suggested excellent reliability score for the subscales, ranging from .94 to .97 and the existence of subscales was supported by exploratory and confirmatory factor analysis. RESULTS A completed survey was collected from 780 nurses. The mean self-efficacy score was 2.92 ± 0.97. The mean score for the subscale of obtaining science-based knowledge resources was the highest (3.24 ± 1.03) and the lowest for critically read and evaluate qualitative research literature (2.63 ± 1.12). Nurses with higher educational qualifications and those who enrolled in any educational program further to their nursing education have statistically significantly high research self-efficacy. CONCLUSION The overall research self-efficacy of working nurses is moderate. However, nurses' confidence in the ability to perform critiquing research and understand the concept and methodology in research is minimal. Introduction of nurse-tailored research training, which covers fundamental aspects of research to an advanced level, will help make them more confident in research.
Collapse
Affiliation(s)
| | - Nesiya Hassan
- Department of Nursing and Midwifery Research, Hamad Medical Corporation, Doha, Qatar
| | - Jibin Kunjavara
- Department of Nursing and Midwifery Research, Hamad Medical Corporation, Doha, Qatar
| | | | - George Joy
- Department of Nursing and Midwifery Research, Hamad Medical Corporation, Doha, Qatar
| | - Badriya Al-Lenjawi
- Department of Nursing and Midwifery Research, Hamad Medical Corporation, Doha, Qatar
| |
Collapse
|
2
|
Farrar N, Elliott D, Houghton C, Jepson M, Mills N, Paramasivan S, Plumb L, Wade J, Young B, Donovan JL, Rooshenas L. Understanding the perspectives of recruiters is key to improving randomised controlled trial enrolment: a qualitative evidence synthesis. Trials 2022; 23:883. [PMID: 36266700 PMCID: PMC9585862 DOI: 10.1186/s13063-022-06818-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/17/2022] [Accepted: 10/05/2022] [Indexed: 11/10/2022] Open
Abstract
Background Recruiting patients to randomised controlled trials (RCTs) is often reported to be challenging, and the evidence base for effective interventions that could be used by staff (recruiters) undertaking recruitment is lacking. Although the experiences and perspectives of recruiters have been widely reported, an evidence synthesis is required in order to inform the development of future interventions. This paper aims to address this by systematically searching and synthesising the evidence on recruiters’ perspectives and experiences of recruiting patients into RCTs. Methods A qualitative evidence synthesis (QES) following Thomas and Harden’s approach to thematic synthesis was conducted. The Ovid MEDLINE, CINAHL, EMBASE, PsycInfo, Cochrane Central Register of Controlled Trials, ORRCA and Web of Science electronic databases were searched. Studies were sampled to ensure that the focus of the research was aligned with the phenomena of interest of the QES, their methodological relevance to the QES question, and to include variation across the clinical areas of the studies. The GRADE CERQual framework was used to assess confidence in the review findings. Results In total, 9316 studies were identified for screening, which resulted in 128 eligible papers. The application of the QES sampling strategy resulted in 30 papers being included in the final analysis. Five overlapping themes were identified which highlighted the complex manner in which recruiters experience RCT recruitment: (1) recruiting to RCTs in a clinical environment, (2) enthusiasm for the RCT, (3) making judgements about whether to approach a patient, (4) communication challenges, (5) interplay between recruiter and professional roles. Conclusions This QES identified factors which contribute to the complexities that recruiters can face in day-to-day clinical settings, and the influence recruiters and non-recruiting healthcare professionals have on opportunities afforded to patients for RCT participation. It has reinforced the importance of considering the clinical setting in its entirety when planning future RCTs and indicated the need to better normalise and support research if it is to become part of day-to-day practice. Trial registration PROSPERO CRD42020141297 (registered 11/02/2020). Supplementary Information The online version contains supplementary material available at 10.1186/s13063-022-06818-4.
Collapse
Affiliation(s)
- Nicola Farrar
- Population Health Sciences, University of Bristol, Canynge Hall, 39 Whatley Road, Bristol, BS8 2PS, UK.
| | - Daisy Elliott
- Population Health Sciences, University of Bristol, Canynge Hall, 39 Whatley Road, Bristol, BS8 2PS, UK
| | - Catherine Houghton
- School of Nursing and Midwifery, Áras Moyola, National University of Ireland Galway, Galway, Ireland
| | - Marcus Jepson
- Population Health Sciences, University of Bristol, Canynge Hall, 39 Whatley Road, Bristol, BS8 2PS, UK
| | - Nicola Mills
- Population Health Sciences, University of Bristol, Canynge Hall, 39 Whatley Road, Bristol, BS8 2PS, UK
| | - Sangeetha Paramasivan
- Population Health Sciences, University of Bristol, Canynge Hall, 39 Whatley Road, Bristol, BS8 2PS, UK
| | - Lucy Plumb
- Population Health Sciences, University of Bristol, Canynge Hall, 39 Whatley Road, Bristol, BS8 2PS, UK.,UK Kidney Association, UK Renal Registry, Bristol, UK
| | - Julia Wade
- Population Health Sciences, University of Bristol, Canynge Hall, 39 Whatley Road, Bristol, BS8 2PS, UK
| | - Bridget Young
- Department of Public Health, Policy and Systems, Institute of Population Health, University of Liverpool, Liverpool, L69 3GB, UK
| | - Jenny L Donovan
- Population Health Sciences, University of Bristol, Canynge Hall, 39 Whatley Road, Bristol, BS8 2PS, UK
| | - Leila Rooshenas
- Population Health Sciences, University of Bristol, Canynge Hall, 39 Whatley Road, Bristol, BS8 2PS, UK
| |
Collapse
|
3
|
Olson RE, Smith A, Huggett G, Good P, Dudley M, Hardy J. Using a qualitative sub-study to inform the design and delivery of randomised controlled trials on medicinal cannabis for symptom relief in patients with advanced cancer. Trials 2022; 23:752. [PMID: 36064621 PMCID: PMC9444122 DOI: 10.1186/s13063-022-06691-1] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/04/2022] [Accepted: 08/24/2022] [Indexed: 01/07/2023] Open
Abstract
Background Recruitment for randomised controlled trials in palliative care can be challenging; disease progression and terminal illness underpin high rates of attrition. Research into participant decision-making in medicinal cannabis randomised controlled trials (RCTs) is very limited. Nesting qualitative sub-studies within RCTs can identify further challenges to participation, informing revisions to study designs and recruitment practices. This paper reports on findings from a qualitative sub-study supporting RCTs of medicinal cannabis for symptom burden relief in patients with advanced cancer in one Australian city. Methods Semi-structured qualitative interviews were conducted with 48 patients with advanced cancer, eligible to participate in a medicinal cannabis RCT (n=28 who consented to participate in an RCT; n=20 who declined). An iterative and abductive approach to thematic analysis and data collection fostered exploration of barriers and enablers to participation. Results Key enablers included participants’ enthusiasm and expectations of medicinal cannabis as beneficial (to themselves and future patients) for symptom management, especially after exhausting currently approved options, and a safer alternative to opioids. Some believed medicinal cannabis to have anti-cancer effects. Barriers to participation were the logistical challenges of participating (especially due to driving restrictions and fatigue), reluctance to interfere with an existing care plan, cost, and concerns about receiving the placebo and the uncertainty of the benefit. Some declined due to concerns about side-effects or a desire to continue accessing cannabis independent of the study. Conclusions The findings support revisions to subsequent medicinal cannabis RCT study designs, namely, omitting a requirement that participants attend weekly hospital appointments. These findings highlight the value of embedding qualitative sub-studies into RCTs. While some challenges to RCT recruitment are universal, others are context (population, intervention, location) specific. A barrier to participation found in research conducted elsewhere—stigma—was not identified in the current study. Thus, findings have important implications for those undertaking RCTs in the rapidly developing context of medical cannabis.
Collapse
Affiliation(s)
- Rebecca E Olson
- School of Social Science, The University of Queensland, Michie Building #9, St Lucia, QLD, 4072, Australia.
| | - Alexandra Smith
- School of Social Science, The University of Queensland, Michie Building #9, St Lucia, QLD, 4072, Australia
| | - Georgie Huggett
- Department of Palliative and Supportive Care Mater Health Services, Mater Research-University of Queensland, Raymond Terrace, South Brisbane, QLD, Australia
| | - Phillip Good
- Department of Palliative and Supportive Care Mater Health Services, Mater Research-University of Queensland, Raymond Terrace, South Brisbane, QLD, Australia.,Department of Palliative Care, St. Vincent's Private Hospital Brisbane, 411 Main Street, Kangaroo Point, QLD, Australia
| | - Morgan Dudley
- School of Social Science, The University of Queensland, Michie Building #9, St Lucia, QLD, 4072, Australia
| | - Janet Hardy
- Department of Palliative and Supportive Care Mater Health Services, Mater Research-University of Queensland, Raymond Terrace, South Brisbane, QLD, Australia
| |
Collapse
|
4
|
Amorin-Woods LG, Woods BL, Moore CS, Leach MJ, Kawchuk GN, Adams J. Research Priorities of the Australian Chiropractic Profession: A Cross-Sectional Survey of Academics and Practitioners. J Manipulative Physiol Ther 2022; 45:73-89. [PMID: 35760594 DOI: 10.1016/j.jmpt.2022.03.015] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/12/2021] [Revised: 10/08/2021] [Accepted: 03/17/2022] [Indexed: 10/17/2022]
Abstract
OBJECTIVE The purpose of this study was to explore the research priorities of Australian practicing chiropractors and academics across a set of research domains to determine the agreement or disagreement based on these domains. METHODS We conducted a pilot-tested online survey focusing on the following 5 principal research domains: basic science, conditions (disorders chiropractors may encounter), patient subgroups, clinical interventions, and practice and public health/health services. Responses were sought regarding support for funding research scholarships, practice-based research networks, scientific conferences/symposia, journals, and existing research agendas. Data were collected (February 19 to May 24, 2019) from a sample of chiropractic academics (n1 = 33) representing 4 Australian programs and practicing chiropractors (n2 = 340). Collected data were ranked and analyzed to determine agreement across domains and items. RESULTS There was agreement between the 2 groups across the majority (>90%) of domain items. The closest agreement and highest rankings were achieved for the "clinical interventions and practice" and "conditions" domains. Disagreement was observed within specific domain items, such as patient subgroups (infants), and for 1 intervention (chiropractic-specific techniques). Disagreement also occurred outside of the main domains, including research agenda support and funding. CONCLUSIONS There was overall agreement between practicing chiropractors and academics across most research area domain items, which should help facilitate consensus-led development of any potential Australian Chiropractic research agenda. Disagreements across specific domain items, such as population subgroups, interventions, and funding require further investigation.
Collapse
Affiliation(s)
- Lyndon G Amorin-Woods
- Murdoch University Chiropractic Clinic/College of Science, Health, Engineering and Education (SHEE), Perth, Western Australia.
| | - Beau L Woods
- Private Practice, Perth, Western Australia, Australia
| | - Craig S Moore
- Department of Chiropractic, Faculty of Medicine, Health and Human Science, Macquarie University, Sydney, New South Wales, Australia
| | - Matthew J Leach
- National Centre for Naturopathic Medicine, Southern Cross University, Lismore, New South Wales, Australia
| | | | - Jon Adams
- School of Public Health, University of Technology, Sydney, New South Wales, Australia
| |
Collapse
|
5
|
Farrar N, Elliott D, Jepson M, Houghton C, Young B, Donovan J, Rooshenas L. Recruiters' perspectives and experiences of trial recruitment processes: a qualitative evidence synthesis protocol. BMJ Open 2021; 11:e045233. [PMID: 34686547 PMCID: PMC8543629 DOI: 10.1136/bmjopen-2020-045233] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 01/18/2023] Open
Abstract
INTRODUCTION Recruitment to randomised trials (RCTs) is often challenging. Reviews of interventions to improve recruitment have highlighted a paucity of effective interventions aimed at recruiters and the need for further research in this area. Understanding the perspectives and experiences of those involved in RCT recruitment can help to identify barriers and facilitators to recruitment, and subsequently inform future interventions to support recruitment. This protocol describes methods for a proposed qualitative evidence synthesis (QES) of recruiters' perspectives and experiences relating to RCT recruitment. METHODS AND ANALYSIS The proposed review will synthesise studies reporting clinical and non-clinical recruiters' perspectives and experiences of recruiting to RCTs. The following databases will be searched: Ovid MEDLINE, CINAHL, EMBASE, PsycInfo, Cochrane Central Register of Controlled Trials, ORRCA and Web of Science. A thematic synthesis approach to analysing the data will be used. An assessment of methodological limitations of each study will be performed using the Critical Appraisal Skills Programme tool. Assessing the confidence in the review findings will be evaluated using the GRADE Confidence in Evidence from Reviews of Qualitative research (GRADE-CERQual) tool. ETHICS AND DISSEMINATION The proposed QES will not require ethical approval as it includes only published literature. The results of the synthesis will be published in a peer-reviewed journal and publicised using social media. The results will be considered alongside other work addressing factors affecting recruitment in order to inform future development and refinement of recruitment interventions. PROSPERO REGISTRATION NUMBER CRD42020141297.
Collapse
Affiliation(s)
- Nicola Farrar
- Population Health Sciences, University of Bristol, Bristol, UK
| | - Daisy Elliott
- Population Health Sciences, University of Bristol, Bristol, UK
| | - Marcus Jepson
- Population Health Sciences, University of Bristol, Bristol, UK
| | - Catherine Houghton
- School of Nursing and Midwifery, National University of Ireland Galway, Galway, Galway, Ireland
| | - Bridget Young
- Department of Health Services Research, University of Liverpool, Liverpool, UK
| | - Jenny Donovan
- Population Health Sciences, University of Bristol, Bristol, UK
| | - Leila Rooshenas
- Population Health Sciences, University of Bristol, Bristol, UK
| |
Collapse
|
6
|
Aspden T, Armstrong M, Serfaty M. Views of healthcare professionals on recruiting to a psychosocial randomised controlled trial: a qualitative study. BMC Health Serv Res 2021; 21:837. [PMID: 34407826 PMCID: PMC8371878 DOI: 10.1186/s12913-021-06817-2] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/21/2020] [Accepted: 07/23/2021] [Indexed: 01/19/2023] Open
Abstract
BACKGROUND Randomised controlled trials, and in particular those of psychosocial interventions, often fail to recruit to target, resulting in underpowered trials with poor generalisability of findings. The objectives of this study were to explore the views of healthcare professionals on recruiting to psychosocial research studies, and to explore their views on factors that may hinder or facilitate recruitment. METHODS We conducted 14 semi-structured interviews, with healthcare professionals who had been involved in recruitment into a randomised controlled trial of a talking therapy for depression in patients with advanced cancer. Interviews were transcribed and analysed using thematic analysis. RESULTS Five primary themes were identified, comprised of 11 subthemes. Attitudes towards research were largely positive. Health care professionals identified lack of time and narrow screening criteria as barriers to recruitment, and also noted the tendency to withhold participants from research for reasons other than eligibility (e.g., gatekeeping). The engagement of the study team with the clinical recruitment site, and the frequent presence of a researcher in clinics, were noted as facilitating recruitment. CONCLUSIONS Healthcare professionals involved in recruiting to trials of psychosocial interventions hold generally positive views of psychosocial research. However, they report that constraints including space and time limit their ability to recruit, and express anxieties about approaching patients for trial recruitment in the palliative phase of their illness. The findings from this study can inform how best to design trials, and in particular trials of psychosocial interventions, and train health care professionals for the study, to maximise recruitment.
Collapse
Affiliation(s)
- Trefor Aspden
- Division of Psychiatry, University College London, London, W1T 7NF, UK
| | - Megan Armstrong
- Marie Curie Palliative Care Research Department, University College London, London, UK
| | - Marc Serfaty
- Division of Psychiatry, University College London, London, W1T 7NF, UK.
| |
Collapse
|
7
|
Kettle J, Deery C, Bolt R, Papaioannou D, Marshman Z. Stakeholder perspectives on barriers and enablers to recruiting anxious children undergoing day surgery under general anaesthetic: a qualitative internal pilot study of the MAGIC randomised controlled trial. Trials 2021; 22:458. [PMID: 34271982 PMCID: PMC8285773 DOI: 10.1186/s13063-021-05425-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/26/2020] [Accepted: 07/06/2021] [Indexed: 11/29/2022] Open
Abstract
Background The ‘Melatonin for Anxiety prior to General anaesthesia In Children’ (MAGIC) trial was designed to compare midazolam and melatonin as pre-medications for anxious children (aged five to fourteen), undergoing day-case surgical procedures under general anaesthesia. Low recruitment is a challenge for many trials, particularly paediatric trials and those in ‘emergency’ settings. A qualitative study as part of MAGIC aimed to gather stakeholder perspectives on barriers and enablers to recruitment. Methods Sixteen stakeholders from six sites participated in semi-structured interviews about their experiences of setting up the MAGIC trial and recruiting patients as part of the internal pilot. Data was analysed using framework analysis. Results Participants identified barriers and enablers to recruitment. Barriers and enablers related to the study, participants, the population of anxious children, practitioners, collaboration with other health professionals, ethics, specific settings and the context of surgical day units and the wider health system. Attempting to recruit anxious children from a surgical day unit is particularly challenging for several reasons. Issues include the practicalities of dealing with a child experiencing anxiety for parents/guardians; professional unwillingness to make things more difficult for families and clinicians and nurses valuing predictability within a busy and time-sensitive setting. Conclusions Multi-site RCTs face recruitment barriers relating to study-wide and site-specific factors. There are multiple barriers to recruiting anxious children due to undergo day-case surgery. Barriers across domains can interrelate and reinforce each other, reflecting challenges relating to populations and settings. For example, in the case of anxious children, parents and other health professionals are concerned about exacerbating children’s anxiety prior to surgery. They may look for ways to keep things predictable and avoid the uncertainty of an RCT. Pre-trial engagement work could help address concerns among collaborating health professionals. Using rapid ethnography during set-up or an internal pilot to focus on how the protocol will be or has been operationalised in practice may help identify issues. Allowing time to reflect on the findings of internal pilots and implement necessary changes could facilitate higher recruitment during the main phase of a trial. Trial registration NIHR Trial Registration Number: ISRCTN18296119. Registered on October 01, 2019. Supplementary Information The online version contains supplementary material available at 10.1186/s13063-021-05425-z.
Collapse
Affiliation(s)
- Jennifer Kettle
- School of Clinical Dentistry, University of Sheffield, 19 Claremont Crescent, Sheffield, S10 2TA, UK.
| | - Chris Deery
- School of Clinical Dentistry, University of Sheffield, 19 Claremont Crescent, Sheffield, S10 2TA, UK
| | - Robert Bolt
- School of Clinical Dentistry, University of Sheffield, 19 Claremont Crescent, Sheffield, S10 2TA, UK
| | - Diana Papaioannou
- School of Health and Related Research (ScHARR), University of Sheffield, Sheffield, UK
| | - Zoe Marshman
- School of Clinical Dentistry, University of Sheffield, 19 Claremont Crescent, Sheffield, S10 2TA, UK
| |
Collapse
|
8
|
Exploring feedback from research nurses in relation to the design and conduct of a randomised controlled trial of wound care treatments: A sequential, dependent, mixed-methods study. J Tissue Viability 2020; 29:342-347. [PMID: 32888791 DOI: 10.1016/j.jtv.2020.07.007] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/28/2019] [Revised: 06/04/2020] [Accepted: 07/27/2020] [Indexed: 11/21/2022]
Abstract
BACKGROUND Research nurse involvement in trials is crucial to successful conduct, however their feedback on trial design and conduct is not necessarily always collected and shared. This study was designed to explore research nurse feedback in relation to study and protocol design and implementation in the National Institute for Health Research Programme Grants for Applied Research funded Surgical Wounds Healing by Secondary Intention pilot and feasibility trial (SWHSI). The primary aim of this study was to inform the design and conduct of a proposed future, larger study in this area. Given the evidence gap, it was deemed prudent to share these findings for the benefit of others. METHODS A sequential, dependent mixed methods study, comprising a Likert scale questionnaire and semi-structured interviews, explored the experiences, in relation to study design and conduct, of research nurses involved in the trial. Of the 10 research nurses involved in the trial, eight nurses completed a questionnaire and were interviewed. Questionnaire data was analysed using descriptive statistics and interview data using thematic analysis. RESULTS A range of questionnaire responses were provided, however at least 50% (n = 4) of respondents indicated that they were happy with both the study design and conduct. Interview data identified key themes to consider when involving research nurses in the design, delivery and conduct of RCTs; removing barriers to recruitment, time management, engagement strategies and resource provision. CONCLUSION Engagement of research nurses is important to enable effective trial conduct. Research teams should therefore consider how best to obtain and include input from all members of the research team from the outset. Furthermore, the sharing of feedback on research design and conduct, from the perspective of research nurses delivering trial recruitment and retention, remains crucial to effective and efficient trial conduct. TRIAL REGISTRATION Clinical Trial Registry: ISRCTN12761776. Date of registration: 10th December 2015.
Collapse
|
9
|
McGill K, McGarry J, Sackley C, Godwin J, Nicoll A, Brady MC. Recruitment challenges in stroke rehabilitation randomized controlled trials: a qualitative exploration of trialists' perspectives using Framework analysis. Clin Rehabil 2020; 34:1122-1133. [PMID: 32493125 DOI: 10.1177/0269215520930796] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Abstract
OBJECTIVE To explore the underlying reasons for recruitment difficulties to stroke rehabilitation randomized controlled trials from the perspective of trialists. DESIGN A qualitative study using semi-structured interviews and Framework analysis. PARTICIPANTS Twenty multidisciplinary stroke rehabilitation trialists across 13 countries with a range of clinical and research experience. METHODS Twenty semi-structured telephone interviews were carried out. Purposeful sampling ensured a range of opinions were gathered from across the international stroke rehabilitation research community. Using Framework analysis, the analytical framework was formed by three researchers and tested before being applied to the total dataset. RESULTS Three themes described the trialists' perception of the underlying reasons for recruitment difficulties: (i) decision making, (ii) importance of recruiters and (iii) a broken system. Trialists described frequently disregarding evidence in favour of prior research experiences when planning randomized controlled trial recruitment. All felt that the relationship between the research and clinical teams was vital to ensure recruiters prioritized and found value in recruitment to the trial. Experienced trialists were frustrated by the lack of reporting of the reality of running trials, research governance demands and the feeling that they had to deliberately underestimate recruitment timeframes to secure funding. CONCLUSION Stroke rehabilitation trialists described recruitment difficulties which may be related to their experiential based recruitment decision making, a lack of understanding of how best to incentivize and maintain relationships with recruiters and unrealistic bureaucratic expectations both in terms of gaining funding and research governance.
Collapse
Affiliation(s)
- Kris McGill
- Nursing, Midwifery and Allied Health Professionals Research Unit, Glasgow Caledonian University, Glasgow, UK.,Facility of Life Sciences and Medicine, School of Population and Environmental Sciences, King's College London, London, UK
| | - Jodie McGarry
- School of Health and Life Sciences, Glasgow Caledonian University, Glasgow, UK
| | - Catherine Sackley
- Facility of Life Sciences and Medicine, School of Population and Environmental Sciences, King's College London, London, UK
| | - Jon Godwin
- School of Health and Life Sciences, Glasgow Caledonian University, Glasgow, UK
| | - Avril Nicoll
- Nursing, Midwifery and Allied Health Professionals Research Unit, Glasgow Caledonian University, Glasgow, UK.,Health Services Research Unit, University of Aberdeen, Aberdeen
| | - Marian C Brady
- Nursing, Midwifery and Allied Health Professionals Research Unit, Glasgow Caledonian University, Glasgow, UK
| |
Collapse
|
10
|
Shiplo S, Meaney S, O'Donoghue K. Maternity care providers' involvement in research. Eur J Obstet Gynecol Reprod Biol 2020; 251:48-52. [PMID: 32480180 DOI: 10.1016/j.ejogrb.2020.05.021] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/26/2020] [Revised: 05/11/2020] [Accepted: 05/11/2020] [Indexed: 10/24/2022]
Abstract
OBJECTIVE Despite the widely acknowledged importance of research for improving patient care and outcomes, research in pregnant women is lacking. Many challenges innate to conducting research in pregnant women may discourage maternity care providers from engaging in research. Thus, the current study assessed maternity care providers' involvement in research, their perception of the relevance of research, as well as facilitators and barriers to participating in research. STUDY DESIGN A total sample of 145 maternity care providers were recruited from a large tertiary-referral university-based teaching maternity hospital. Maternity care providers included, midwives, nurses, sonographers, consultant obstetricians, and non-consultant hospital doctors. Participants completed a cross-sectional survey between May and October 2018. RESULTS The present study found that overall, 49.7% of maternity care providers who participated reported never taking part in conducting research. Medical staff were more likely to report being given the opportunity and to have ever conducted research compared to midwives (p < 0.05). Participants agreed that research is important to maintain the quality of care provided to women (Mean = 4.86/5 in agreeance). However, medical staff were more likely to report understanding research methodology and feeling competent to undertake research compared to midwives (Mean = 3.85 v 3.28, p = 0.002; Mean = 3.56 v 2.60, p < 0.05). CONCLUSION The findings suggest future strategies aimed at increased opportunities and additional research training will likely support maternity care providers', specifically midwives, involvement in conducting effective research studies in pregnancy. Such actions hold the potential to contribute research evidence lacking in pregnant women necessary to provide appropriate maternity care.
Collapse
Affiliation(s)
- S Shiplo
- Department of Obstetrics and Gynaecology, Cork University Maternity Hospital, Cork,T12 YE02, Ireland.
| | - S Meaney
- Department of Obstetrics and Gynaecology, Cork University Maternity Hospital, Cork,T12 YE02, Ireland; Pregnancy Loss Research Group, The Irish Centre for Maternal and Child Health Research (INFANT), University College Cork, T12 YE02, Ireland; National Perinatal Epidemiology Centre, University College Cork, T12 YE02, Ireland
| | - K O'Donoghue
- Department of Obstetrics and Gynaecology, Cork University Maternity Hospital, Cork,T12 YE02, Ireland; Pregnancy Loss Research Group, The Irish Centre for Maternal and Child Health Research (INFANT), University College Cork, T12 YE02, Ireland
| |
Collapse
|
11
|
Lehmann BA, Lindert L, Ohlmeier S, Schlomann L, Pfaff H, Choi KE. "And Then He Got into the Wrong Group": A Qualitative Study Exploring the Effects of Randomization in Recruitment to a Randomized Controlled Trial. INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH 2020; 17:ijerph17061886. [PMID: 32183250 PMCID: PMC7143713 DOI: 10.3390/ijerph17061886] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 01/28/2020] [Revised: 02/21/2020] [Accepted: 03/09/2020] [Indexed: 11/16/2022]
Abstract
Background: Randomized controlled trials (RCTs) are regarded as the most internally valid means of estimating the effectiveness of complex public health interventions, but the recruitment of participants can be difficult. The aim of this study was to explore factors that may have affected the recruitment of employees with musculoskeletal disorders (MSDs) to a multicenter worksite health promotion program from the perspective of recruiting case managers. Methods: Factors in recruitment to the RCT were explored using three focus group discussions with case managers. Data were processed using MAXQDA and analyzed with a combination of content and sequence analysis. Results: Findings showed that randomization is a major challenge for recruitment. Case managers adapted their communication with, and approaches to possible participants because of the randomization design and employed coping strategies to compensate for allocation into the control arm of the study. Perceptions of the superiority of the intervention group over the control group, perceptions of the (mis)match of participants to one of the groups, as well as the understanding of the necessity of randomization for effectiveness evaluations, further affected recruitment. Perceived expectations of possible participants and their (emotional) reactions to the randomization allocation also complicated recruitment. Conclusion: We were able to gain insight into the challenges of randomization for the recruitment of participants to a multicenter RCT. This study assisted the development of strategies to overcome barriers in the ongoing implementation process of the trial (i.e., the adaption of best practice information sheets and newsletters). There remains a need to develop effective interventions to help those recruiting to trials.
Collapse
Affiliation(s)
- Birthe Andrea Lehmann
- Communication Science, University of Amsterdam, 1001 NH Amsterdam, The Netherlands
- Correspondence:
| | - Lara Lindert
- Institute of Medical Sociology, Health Services Research and Rehabilitation Science, University of Cologne, 50933 Köln, Germany; (L.L.); (S.O.); (L.S.); (H.P.); (K.-E.C.)
| | - Silke Ohlmeier
- Institute of Medical Sociology, Health Services Research and Rehabilitation Science, University of Cologne, 50933 Köln, Germany; (L.L.); (S.O.); (L.S.); (H.P.); (K.-E.C.)
| | - Lara Schlomann
- Institute of Medical Sociology, Health Services Research and Rehabilitation Science, University of Cologne, 50933 Köln, Germany; (L.L.); (S.O.); (L.S.); (H.P.); (K.-E.C.)
| | - Holger Pfaff
- Institute of Medical Sociology, Health Services Research and Rehabilitation Science, University of Cologne, 50933 Köln, Germany; (L.L.); (S.O.); (L.S.); (H.P.); (K.-E.C.)
| | - Kyung-Eun Choi
- Institute of Medical Sociology, Health Services Research and Rehabilitation Science, University of Cologne, 50933 Köln, Germany; (L.L.); (S.O.); (L.S.); (H.P.); (K.-E.C.)
| |
Collapse
|
12
|
Frost J, Britten N. Learning from a Feasibility Trial of a Simple Intervention: Is Research a Barrier to Service Delivery, or is Service Delivery a Barrier to Research? Healthcare (Basel) 2020; 8:healthcare8010053. [PMID: 32138337 PMCID: PMC7151079 DOI: 10.3390/healthcare8010053] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/10/2020] [Accepted: 02/27/2020] [Indexed: 11/16/2022] Open
Abstract
(1) Background: Applied health services research (AHSR) relies upon coordination across multiple organizational boundaries. Our aim was to understand how competing organizational and professional goals enhance or impede the conduct of high quality AHSR. (2) Methods: A qualitative study was conducted in two local health care systems in the UK, linked to a feasibility trial of a clinic-based intervention in secondary care. Data collection involved 24 semi-structured interviews with research managers, clinical research staff, health professionals, and patients. (3) Results: This study required a dynamic network of interactions between heterogeneous health and social care stakeholders, each characterized by differing ways of organizing activities which constitute their core functions; cultures of collaboration and interaction and understanding of what research involves and how it contributes to patient care. These interrelated factors compounded the occupational and organizational boundaries that hindered communication and coordination. (4) Conclusions: Despite the strategic development of multiple organizations to foster inter-professional collaboration, the competing goals of research and clinical practice can impede the conduct of high quality AHSR. To remedy this requires the alignment and streamlining of organizational goals, so that all agencies involved in AHSR develop a shared understanding and mutual respect for the progress of evidence-based medicine and the complex and often nuanced environments in which it is created and practiced.
Collapse
|
13
|
McGill K, Sackley CM, Godwin J, McGarry J, Brady MC. A systematic review of the efficiency of recruitment to stroke rehabilitation randomised controlled trials. Trials 2020; 21:68. [PMID: 31924252 PMCID: PMC6954526 DOI: 10.1186/s13063-019-3991-2] [Citation(s) in RCA: 20] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/09/2019] [Accepted: 12/11/2019] [Indexed: 01/10/2023] Open
Abstract
Introduction Randomised controlled trials (RCTs) that fail to meet their recruitment target risk increasing research waste. Acute stroke RCTs experience notable recruitment issues. The efficiency of recruitment to stroke rehabilitation RCTs has not been explored. Aims and objectives To explore recruitment efficiency and the trial features associated with efficient recruitment to stroke rehabilitation RCTs. Methods A systematic review of stroke rehabilitation RCTs published between 2005 and 2015 identified in a search of the Cochrane Stroke Group (CSG) Trials Register from 35 electronic databases (e.g. Medline, CINAHL; EMBASE), clinical trial registers, and hand-searching. Inclusion criteria are stroke rehabilitation intervention, delivered by a member of the rehabilitation team, and clinically relevant environment. We extracted data on recruitment efficiency and trial features. Results We screened 12,939 titles, 1270 abstracts and 788 full texts, before extracting data from 512 included RCTs (n = 28,804 stroke survivor participants). This is the largest systematic review of recruitment to date. A third of stroke survivors screened consented to participate (median 34% (IQR 14–61), on average sites recruited 1.5 participants per site per month (IQR 0.71–3.22), and one in twenty (6% (IQR 0–13) dropped out during the RCT. Almost half (48%) of those screened in the community were recruited compared to hospital settings (27%). Similarly, almost half (47%) those screened at least 6 months after stroke participated, compared to 23% of stroke survivors screened within a month of stroke. When one recruiter screened multiple sites, a median of one stroke survivor was recruited every 2 months compared to more than two per month when there was a dedicated recruiter per site. RCT recruitment was significantly faster per site, with fewer dropouts, for trials conducted in Asia (almost three stroke survivors monthly; 2% dropout) compared to European trials (approximately one stroke survivor monthly; 7% dropout). Conclusions One third of stroke survivors screened were randomised to rehabilitation RCTs at a rate of between one and two per month, per site. One in twenty did not complete the trial. Our findings will inform recruitment plans of future stroke rehabilitation RCTs. Limited reporting of recruitment details restricted the subgroup analysis performed. Trial registration Prospective Register of Systematic Reviews, registration number CRD42016033067.
Collapse
Affiliation(s)
- Kris McGill
- Nursing Midwifery and Allied Health Professionals Research Unit, Glasgow Caledonian University, Glasgow, UK.
| | | | - Jon Godwin
- Glasgow Caledonian University, Glasgow, UK
| | | | - Marian C Brady
- Nursing Midwifery and Allied Health Professionals Research Unit, Glasgow Caledonian University, Glasgow, UK
| |
Collapse
|
14
|
Abstract
Clinical trials are a fundamental component of high-quality care, and have been widely reported to improve care and patient outcomes. For research trials to be successful, patients need to have awareness of trials, be invited to participate, and be supported to make informed decisions about consenting to enrol in clinical trials. Some cancer nurses have been reported to be reluctant to discuss clinical trials with patients, based on their own beliefs about the perceived burden of clinical trials, while others have been reported to facilitate patient access to clinical trials by working closely with their clinical research nurse colleagues. Nursing patients enrolled in cancer clinical trials is a specialised (and often complex) area of practice. There is significant opportunity for nurses to develop their knowledge about clinical trials, for example, through reciprocal learning between clinical and research teams, which might enhance patients' experiences of, and outcomes from, clinical trials.
Collapse
Affiliation(s)
- Verna Lavender
- Head of Guy's Cancer Academy, Guy's and St Thomas' NHS Foundation Trust, London
| | | |
Collapse
|
15
|
Mallows A, Littlewood C, Jackson J, Debenham J. Managing Achilles Pain (the MAP study) - A process evaluation of data collection methods. Musculoskelet Sci Pract 2019; 42:60-66. [PMID: 31039454 DOI: 10.1016/j.msksp.2019.04.008] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/21/2019] [Revised: 03/22/2019] [Accepted: 04/12/2019] [Indexed: 12/16/2022]
Abstract
BACKGROUND Process evaluations explore the way in which a study was conducted. The Managing Achilles Pain study (MAP study) had the primary aim of assessing the feasibility of the protocol for a future large longitudinal cohort study that would investigate the association and predictive relationship of self-efficacy, working alliance and expectations with outcome in the management of Achilles tendinopathy. OBJECTIVES This study aimed to evaluate the processes conducted in the MAP study by exploring the acceptability of the study procedures from the participants' and physiotherapists' perspectives. DESIGN A qualitative evaluation using semi-structured telephone interviews. METHOD All physiotherapists and participants who participated in the MAP study were invited. Data from physiotherapists (n = 6) and participants (n = 7) were transcribed and analysed using the Framework Approach. FINDINGS From the physiotherapists' perspective 4 themes were identified relating to obstacles; (1) access to participants; (2) recall; (3) visibility; (4) time, and 4 themes were identified relating to facilitating success; (1) training; (2) motivation; (3) incentives; (4) simplicity. From the participants' perspective 2 themes were identified relating to obstacles; (1) information from the physiotherapist; (2) follow up, 3 themes were identified relating to facilitating success; (1) motivation; (2) website; (3) questionnaire, and 1 theme relating to unintended consequences of participating in the study; positive experience. CONCLUSIONS Although clinicians are enthused to be involved in research, organisational factors impact levels of engagement. Key influences to optimising the potential success of a study include the publicising of the study; optimising verbal recruitment strategies; and clarity in communication.
Collapse
Affiliation(s)
- Adrian Mallows
- School of Sport, Rehabilitation & Exercise Sciences, University of Essex, Colchester, Essex, CO4 3SQ, United Kingdom.
| | - Chris Littlewood
- Research Institute for Primary Care and Health Sciences, David Weatherall Building, Keele University, Staffordshire, ST5 5BG, United Kingdom
| | - Jo Jackson
- School of Sport, Rehabilitation & Exercise Sciences, University of Essex, Colchester, Essex, CO4 3SQ, United Kingdom
| | - James Debenham
- School of Physiotherapy, The University of Notre Dame Australia, Fremantle, WA, Australia
| |
Collapse
|
16
|
Motivators and challenges to research recruitment - A qualitative study with midwives. Midwifery 2019; 74:14-20. [PMID: 30925414 DOI: 10.1016/j.midw.2019.03.011] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/15/2018] [Revised: 02/13/2019] [Accepted: 03/17/2019] [Indexed: 01/16/2023]
Abstract
OBJECTIVE To explore midwives' experiences of recruiting participants to research studies conducted by other researchers. DESIGN An inductive qualitative study. METHODS Individual face-to-face or telephone interviews using a semi-structured interview guide. Interviews were analysed thematically. SETTINGS One large urban maternity hospital in Ireland. PARTICIPANTS A purposive sample of 19 midwives FINDINGS: Three co-dependent themes emerged: intrinsic motivations, extrinsic motivations and challenges. Intrinsic motivations included midwives' personal beliefs about the value of research in general, its potential to improve practice, and their perceptions of how robust a particular study was and how it might impact on an individual woman and her baby. This included an inherent desire to shield some women, those who were perceived to have ongoing health issues or be anticipating a sub-optimal pregnancy outcome, from being offered study information. Extrinsic motivations related to the complexity of a research study and a specific researcher's characteristics. Challenges to offering potential participants research study information and, therefore, to successful recruitment included time constraints, workload and the volume of research being conducted simultaneously. KEY CONCLUSIONS Participants navigated the two, sometimes competing, worlds of clinical practice and clinical research. Set in the context of workload and the volume of research being conducted simultaneously, midwives' perceptions of a study's robustness, clarity, its potential impact on individual women and ability to improve practice governed their motivation to offer information on research studies to potential participants. IMPLICATIONS FOR PRACTICE Inviting clinicians to assess the study information may improve its clarity and create opportunities to discuss the potential value and recruitment bias. Researchers should be available to address clinicians' questions about particular research studies. At an organisational level, a system for managing the volume of research activity is required.
Collapse
|
17
|
Scott SL, Bondoc S. Return to Work After Stroke: A Survey of Occupational Therapy Practice Patterns. Occup Ther Health Care 2018; 32:195-215. [PMID: 30052112 DOI: 10.1080/07380577.2018.1491083] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/28/2022]
Abstract
This descriptive study, consisting of a survey followed by semi-structured interviews, sought to describe the practice patterns and perceived competencies of occupational therapy practitioners in the provision of return to work (RTW) services for stroke survivors. Respondents (n = 119) were mostly occupational therapists (95%) working in outpatient settings (61%); 47% reported a caseload of mostly stroke survivors; and most addressing RTW (60%). Respondents focused predominantly on remediation of cognitive and physical skills and less on actual work performance and supports. Respondents assert occupational therapy's role in RTW for stroke survivors but generally reported limited competencies and low utilization of evidence-based approaches and theoretical models when addressing RTW. Systems, organizational support, and practitioner factors emerged as barriers and facilitators to RTW service provision. This study suggests there may be a critical gap in practitioners' RTW competencies with profound implications for entry-level education, professional development, advocacy, and research.
Collapse
Affiliation(s)
- Shannon L Scott
- a Department of Occupational Science/Occupational Therapy , Ithaca College , Ithaca , NY , USA
| | - Salvador Bondoc
- b School of Health Sciences, Department of Occupational Therapy , Quinnipiac University , Hamden , CT , USA
| |
Collapse
|
18
|
Health professional perceptions of communicating with adolescents and young adults about bone cancer clinical trial participation. Support Care Cancer 2018; 27:467-475. [DOI: 10.1007/s00520-018-4337-4] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/29/2018] [Accepted: 06/26/2018] [Indexed: 01/02/2023]
|
19
|
Team V, Bugeja L, Weller CD. Barriers and facilitators to participant recruitment to randomised controlled trials: A qualitative perspective. Int Wound J 2018; 15:929-942. [PMID: 29974634 DOI: 10.1111/iwj.12950] [Citation(s) in RCA: 15] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/21/2018] [Revised: 05/23/2018] [Accepted: 05/27/2018] [Indexed: 11/29/2022] Open
Abstract
Low recruitment rates for randomised controlled trials (RCTs) are a common issue. Information on barriers and facilitators to recruitment for RCTs may inform researchers on how to improve the recruitment rate. The aim of this qualitative project was to identify barriers and facilitators to participant recruitment for a randomised double-blinded placebo-controlled trial on the clinical effectiveness of aspirin as an adjunct to compression therapy in healing chronic venous leg ulcers. We have conducted interviews with health professionals and project workers to understand their perspective on low recruitment rate, barriers to, and facilitators of recruitment. NVivo 11 software was used for data management and coding. Thematic analysis was applied as a method of data analysis. Although strict recruitment criteria were the main barrier, there were other recruitment barriers that should be considered when planning RCTs. We have further developed a framework of factors influencing the recruitment rate. The main recruitment barriers, including study-related, participant-related, practitioner-related, collaboration-related, ethics-related, practice-related, and health system-related barriers, should be considered for inclusion in the "Other Information" section of Consolidated Standards of Reporting Trials Statement to improve the quality of reporting and ensure the strategic planning of future RCTs.
Collapse
Affiliation(s)
- Victoria Team
- Monash Nursing and Midwifery, Monash University, Clayton, Victoria, Australia
| | - Lyndal Bugeja
- Monash Nursing and Midwifery, Monash University, Clayton, Victoria, Australia
| | - Carolina D Weller
- Monash Nursing and Midwifery, Monash University, Clayton, Victoria, Australia
| |
Collapse
|
20
|
Zucchelli F, Rumsey N, Humphries K, Bennett R, Davies A, Sandy J, Stock NM. Recruiting to cohort studies in specialist healthcare services: Lessons learned from clinical research nurses in UK cleft services. J Clin Nurs 2018; 27:e787-e797. [DOI: 10.1111/jocn.14188] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 11/18/2017] [Indexed: 11/28/2022]
Affiliation(s)
- Fabio Zucchelli
- Centre for Appearance Research; University of the West of England (UWE); Bristol UK
| | - Nichola Rumsey
- Centre for Appearance Research; University of the West of England (UWE); Bristol UK
- The Cleft Collective; School of Oral and Dental Sciences; University of Bristol; Bristol UK
| | - Kerry Humphries
- The Cleft Collective; School of Oral and Dental Sciences; University of Bristol; Bristol UK
| | - Rhiannon Bennett
- The Cleft Collective; School of Oral and Dental Sciences; University of Bristol; Bristol UK
| | - Amy Davies
- The Cleft Collective; School of Oral and Dental Sciences; University of Bristol; Bristol UK
| | - Jonathan Sandy
- The Cleft Collective; School of Oral and Dental Sciences; University of Bristol; Bristol UK
| | - Nicola Marie Stock
- Centre for Appearance Research; University of the West of England (UWE); Bristol UK
- The Cleft Collective; School of Oral and Dental Sciences; University of Bristol; Bristol UK
| |
Collapse
|
21
|
Understanding and Improving Recruitment to Randomised Controlled Trials: Qualitative Research Approaches. Eur Urol 2017; 72:789-798. [DOI: 10.1016/j.eururo.2017.04.036] [Citation(s) in RCA: 83] [Impact Index Per Article: 11.9] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/15/2017] [Accepted: 04/28/2017] [Indexed: 11/22/2022]
|