1
|
Herbert E, Papaioannou D, Loban A, Totton N, Hyslop M, Bolt R, Deery C. Personalised versus standard text message prompts for increasing trial participant response to telephone follow-up: an embedded randomised controlled retention trial. Trials 2024; 25:108. [PMID: 38321484 PMCID: PMC10848401 DOI: 10.1186/s13063-024-07916-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/17/2023] [Accepted: 01/09/2024] [Indexed: 02/08/2024] Open
Abstract
BACKGROUND Improving retention within randomised controlled trials is important. The effectiveness of different strategies can be assessed using a Study Within A Trial (SWAT). Previous research has shown personalised text message reminders improve clinic attendance rates; however, the results are mixed on improving postal questionnaire return. This SWAT aims to assess whether personalised text message reminders improve completion rates for scheduled telephone follow-ups. METHODS This SWAT is a two-arm, multi-centre randomised controlled trial with equal allocation. The host trial was the Melatonin for Anxiety prior to General anaesthesia In Children trial (ISRCTN 18296119), where the child's caregiver was to answer a scheduled telephone follow-up 14 days post-surgery; participants for the SWAT were therefore the caregiver. Text messages were sent 24-48 h before the scheduled call and the personalised version contained the first name of the caregiver which was omitted in the non-personalised version. The primary outcome was questionnaire completion rate, defined as the proportion of caregivers successfully contacted, and completed any of the questionnaires, over the telephone within the follow-up window (day 14 + 7 days). RESULTS The SWAT included 100 of the 110 (91%) participants randomised into the host trial. Randomisation within the SWAT was equal between non-personalised (n = 50) and personalised (n = 50) interventions. The overall questionnaire response rate was 73% with a difference between the two interventions of 68% in the non-personalised text message arm and 78% in the personalised text message arm. The adjusted absolute risk difference was 7.1% (95% confidence interval = -10.2%, 24.4%). There was no difference in either the time to response or the number of contact attempts between the two interventions. CONCLUSIONS There is some evidence that personalised text messages could be effective at increasing response rates when data is collected via telephone and in a population of caregivers for paediatric trial participants. However, similar SWATs have shown mixed results. Given the low-cost and low risks associated with personalising text message reminders, this SWAT could be implemented easily in other RCTs scheduling telephone follow-up appointments. TRIAL REGISTRATION ISRCTN 18296119 , SWAT 35 (MRC Northern Ireland Network for Trials Methodology Network).
Collapse
Affiliation(s)
- Esther Herbert
- Sheffield Centre for Health and Related Research, University of Sheffield, Regent Court, 30 Regent Street, S1 4DA, Sheffield, UK.
| | - Diana Papaioannou
- Sheffield Centre for Health and Related Research, University of Sheffield, Regent Court, 30 Regent Street, S1 4DA, Sheffield, UK
| | - Amanda Loban
- Sheffield Centre for Health and Related Research, University of Sheffield, Regent Court, 30 Regent Street, S1 4DA, Sheffield, UK
| | - Nikki Totton
- Sheffield Centre for Health and Related Research, University of Sheffield, Regent Court, 30 Regent Street, S1 4DA, Sheffield, UK
| | - Marie Hyslop
- Sheffield Centre for Health and Related Research, University of Sheffield, Regent Court, 30 Regent Street, S1 4DA, Sheffield, UK
| | - Robert Bolt
- School of Clinical Dentistry, University of Sheffield, Claremont Crescent, S10 2TA, Sheffield, UK
| | - Christopher Deery
- School of Clinical Dentistry, University of Sheffield, Claremont Crescent, S10 2TA, Sheffield, UK
| |
Collapse
|
2
|
Parker A, Arundel C, Clark L, Coleman E, Doherty L, Hewitt CE, Beard D, Bower P, Cooper C, Culliford L, Devane D, Emsley R, Eldridge S, Galvin S, Gillies K, Montgomery A, Sutton CJ, Treweek S, Torgerson DJ. Undertaking Studies Within A Trial to evaluate recruitment and retention strategies for randomised controlled trials: lessons learnt from the PROMETHEUS research programme. Health Technol Assess 2024; 28:1-114. [PMID: 38327177 PMCID: PMC11017159 DOI: 10.3310/htqw3107] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/09/2024] Open
Abstract
Background Randomised controlled trials ('trials') are susceptible to poor participant recruitment and retention. Studies Within A Trial are the strongest methods for testing the effectiveness of strategies to improve recruitment and retention. However, relatively few of these have been conducted. Objectives PROMoting THE Use of Studies Within A Trial aimed to facilitate at least 25 Studies Within A Trial evaluating recruitment or retention strategies. We share our experience of delivering the PROMoting THE Use of Studies Within A Trial programme, and the lessons learnt for undertaking randomised Studies Within A Trial. Design A network of 10 Clinical Trials Units and 1 primary care research centre committed to conducting randomised controlled Studies Within A Trial of recruitment and/or retention strategies was established. Promising recruitment and retention strategies were identified from various sources including Cochrane systematic reviews, the Study Within A Trial Repository, and existing prioritisation exercises, which were reviewed by patient and public members to create an initial priority list of seven recruitment and eight retention interventions. Host trial teams could apply for funding and receive support from the PROMoting THE Use of Studies Within A Trial team to undertake Studies Within A Trial. We also tested the feasibility of undertaking co-ordinated Studies Within A Trial, across multiple host trials simultaneously. Setting Clinical trials unit-based trials recruiting or following up participants in any setting in the United Kingdom were eligible. Participants Clinical trials unit-based teams undertaking trials in any clinical context in the United Kingdom. Interventions Funding of up to £5000 and support from the PROMoting THE Use of Studies Within A Trial team to design, implement and report Studies Within A Trial. Main outcome measures Number of host trials funded. Results Forty-two Studies Within A Trial were funded (31 host trials), across 12 Clinical Trials Units. The mean cost of a Study Within A Trial was £3535. Twelve Studies Within A Trial tested the same strategy across multiple host trials using a co-ordinated Study Within A Trial design, and four used a factorial design. Two recruitment and five retention strategies were evaluated in more than one host trial. PROMoting THE Use of Studies Within A Trial will add 18% more Studies Within A Trial to the Cochrane systematic review of recruitment strategies, and 79% more Studies Within A Trial to the Cochrane review of retention strategies. For retention, we found that pre-notifying participants by card, letter or e-mail before sending questionnaires was effective, as was the use of pens, and sending personalised text messages to improve questionnaire response. We highlight key lessons learnt to guide others planning Studies Within A Trial, including involving patient and public involvement partners; prioritising and selecting strategies to evaluate and elements to consider when designing a Study Within A Trial; obtaining governance approvals; implementing Studies Within A Trial, including individual and co-ordinated Studies Within A Trials; and reporting Study Within A Trials. Limitations The COVID-19 pandemic negatively impacted five Studies Within A Trial, being either delayed (n = 2) or prematurely terminated (n = 3). Conclusions PROMoting THE Use of Studies Within A Trial significantly increased the evidence base for recruitment and retention strategies. When provided with both funding and practical support, host trial teams successfully implemented Studies Within A Trial. Future work Future research should identify and target gaps in the evidence base, including widening Study Within A Trial uptake, undertaking more complex Studies Within A Trial and translating Study Within A Trial evidence into practice. Study registration All Studies Within A Trial in the PROMoting THE Use of Studies Within A Trial programme had to be registered with the Northern Ireland Network for Trials Methodology Research Study Within A Trial Repository. Funding This award was funded by the National Institute for Health and Care Research (NIHR) Health Technology Assessment programme (NIHR award ref: 13/55/80) and is published in full in Health Technology Assessment; Vol. 28, No. 2. See the NIHR Funding and Awards website for further award information.
Collapse
Affiliation(s)
- Adwoa Parker
- York Trials Unit, Department of Health Sciences, University of York, York, UK
| | - Catherine Arundel
- York Trials Unit, Department of Health Sciences, University of York, York, UK
| | - Laura Clark
- York Trials Unit, Department of Health Sciences, University of York, York, UK
| | - Elizabeth Coleman
- York Trials Unit, Department of Health Sciences, University of York, York, UK
| | - Laura Doherty
- York Trials Unit, Department of Health Sciences, University of York, York, UK
| | | | - David Beard
- Nuffield Department of Orthopaedics, Rheumatology, and Musculoskeletal Science, NIHR Biomedical Research Unit, University of Oxford, Oxford, UK
| | - Peter Bower
- National Institute for Health Research School for Primary Care Research, Centre for Primary Care and Health Services Research, University of Manchester, Manchester, UK
| | - Cindy Cooper
- School of Health and Related Research, University of Sheffield, Sheffield, UK
| | - Lucy Culliford
- Bristol Trials Centre, Clinical Trials and Evaluation Unit, University of Bristol, Bristol Royal Infirmary, Bristol, UK
| | - Declan Devane
- School of Nursing and Midwifery, University of Galway, Galway, Republic of Ireland
- Health Research Board-Trials Methodology Research Network, Galway, Republic of Ireland
| | - Richard Emsley
- Department of Biostatistics and Health Informatics, Institute of Psychiatry, Psychology and Neuroscience, King's College London, London, UK
| | - Sandra Eldridge
- Institute of Population Health Sciences, Queen Mary University of London, London, UK
| | - Sandra Galvin
- School of Nursing and Midwifery, University of Galway, Galway, Republic of Ireland
- Health Research Board-Trials Methodology Research Network, Galway, Republic of Ireland
| | - Katie Gillies
- Health Services Research Unit, University of Aberdeen, Foresthill, Aberdeen, UK
| | - Alan Montgomery
- University of Nottingham, Nottingham Clinical Trials Unit, University Park Nottingham, Nottinghamshire, UK
| | | | - Shaun Treweek
- Health Services Research Unit, University of Aberdeen, Foresthill, Aberdeen, UK
| | - David J Torgerson
- York Trials Unit, Department of Health Sciences, University of York, York, UK
| |
Collapse
|
3
|
Thiblin E, Woodford J, Öhman M, von Essen L. The effect of personalised versus non-personalised study invitations on recruitment within the ENGAGE feasibility trial: an embedded randomised controlled recruitment trial. BMC Med Res Methodol 2022; 22:65. [PMID: 35249543 PMCID: PMC8898447 DOI: 10.1186/s12874-022-01553-5] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/16/2021] [Accepted: 02/24/2022] [Indexed: 12/12/2022] Open
Abstract
Background Recruitment into clinical trials is challenging and there is a lack of evidence on effective recruitment strategies. Personalisation of invitation letters is a potentially pragmatic and feasible way of increasing recruitment rates at a low-cost. However, there is a lack of evidence concerning the effect of personalising of study invitation letters on recruitment rates. Methods We undertook a Study Within A Trial (SWAT) to investigate the effect of personalised versus non-personalised study invitation letters on recruitment rates into the host feasibility trial ENGAGE, a feasibility study of an internet-administered, guided, Low Intensity Cognitive-Behavioural Therapy based self-help intervention for parents of children previously treated for cancer. An intervention group (n = 254) received a personalised study invitation letter and the control group (n = 255) received a non-personalised study invitation letter. The primary outcome was the proportion of participants in the intervention group and the control group enrolled into the ENGAGE host feasibility trial. Secondary outcomes relating to the recruitment and screening process, and retention were examined. Differences in proportions between groups for the primary and secondary outcomes were estimated using logistic regression. Results Of the 509 potential participants, 56 (11.0%) were enrolled into the ENGAGE host feasibility trial: personalised: 30/254 (11.8%) and non-personalised: 26/255 (10.2%). No statistically significant effect on personalisation of enrolment was found (OR 1.18, 95% CI 0.68–2.06). No statistically significant differences were found for any secondary outcome. Conclusions Personalisation of study invitations had no effect on recruitment. However, given the small study sample size in the present SWAT, and lack of similar embedded recruitment RCTs to enable a meta-analysis, additional SWATs to examine the personalisation of study invitation letters are warranted. Trial registration ISRCTN57233429; ISRCTN18404129; SWAT 112, Northern Ireland Hub for Trials Methodology Research SWAT repository (2018 OCT 1 1231) (https://www.qub.ac.uk/sites/TheNorthernIrelandNetworkforTrialsMethodologyResearch/FileStore/Filetoupload,939618,en.pdf). Supplementary Information The online version contains supplementary material available at 10.1186/s12874-022-01553-5.
Collapse
|
4
|
Mitchell AS, Cook L, Dean A, Fairhurst C, Northgraves M, Torgerson DJ, Reed M. An embedded randomised controlled retention trial of personalised text messages compared to non-personalised text messages in an orthopaedic setting. F1000Res 2021; 9:591. [PMID: 35600143 PMCID: PMC9091807 DOI: 10.12688/f1000research.24244.2] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Accepted: 09/01/2021] [Indexed: 11/20/2022] Open
Abstract
Background: Several studies have investigated whether personalising trial documentation can aid recruitment and retention. We did a ‘study within a trial’ (SWAT) evaluating the effectiveness of a personalised text message compared to a non-personalised text message, on the retention rate in a large orthopaedic trial. Methods: The SWAT was embedded in the Knee Replacement Bandaging Study (KReBS) trial. The primary outcome was the proportion of 12-month questionnaires returned. Secondary outcomes were the proportion of questionnaires completed and time to questionnaire return. Binary data were analysed using logistic regression and time to return using Cox proportional hazards regression. Odds ratios (OR) and hazard ratios (HR) are presented, with associated 95% confidence intervals (CI) and p-values. Results: In total, 1465 participants were included in the SWAT. In the personalised group, 644/723 (89.1%) of participants returned a questionnaire, compared to 654/742 (88.1%) in the non-personalised group. The absolute difference in return rate was 0.9% (95% CI: -2.3% to 4.2%; p=0.57). There was no evidence of a difference between the groups in the likelihood of returning a questionnaire (OR 1.09; 95% CI: 0.79 to 1.51; p=0.61), the likelihood of returning a complete questionnaire (OR 1.11; 95% CI: 0.82 to 1.51; p=0.50) nor in time to return (HR 1.05; 95% CI: 0.94 to 1.17; p=0.40). Conclusion: This SWAT adds to the growing evidence base for whether personalised text messages are effective. Registration: ISRCTN87127065 (20/02/2017); SWAT 35 (01/12/2015)
Collapse
Affiliation(s)
- Alex S. Mitchell
- Department of Health Sciences, University of York, UK, York, Y010 5DD, UK
| | - Liz Cook
- Department of Health Sciences, University of York, UK, York, Y010 5DD, UK
| | - Alexandra Dean
- Department of Health Sciences, University of York, UK, York, Y010 5DD, UK
| | - Caroline Fairhurst
- Department of Health Sciences, University of York, UK, York, Y010 5DD, UK
| | | | - David J. Torgerson
- Department of Health Sciences, University of York, UK, York, Y010 5DD, UK
| | - Mike Reed
- Department of Health Sciences, University of York, UK, York, Y010 5DD, UK
- North Tyneside General Hospital, Northumbria Healthcare NHS Foundation Trust, North Shields, Tyne and Wear, NE29 8NH, UK
| |
Collapse
|
5
|
Cureton L, Marian IR, Barber VS, Parker A, Torgerson DJ, Hopewell S. Randomised study within a trial (SWAT) to evaluate personalised versus standard text message prompts for increasing trial participant response to postal questionnaires (PROMPTS). Trials 2021; 22:502. [PMID: 34321055 PMCID: PMC8320189 DOI: 10.1186/s13063-021-05452-w] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/20/2021] [Accepted: 07/13/2021] [Indexed: 11/29/2022] Open
Abstract
BACKGROUND Use of a person's name in a text message has been shown to be effective in instigating behaviour change. We evaluated the effectiveness of a personalised text message (including the recipient's name) versus a standardised text message for prompting a response from trial participants to complete and return postal follow-up questionnaires. METHODS Using a randomised study within a trial (SWAT) embedded within the host GRASP (Getting it Right: Addressing Shoulder Pain) trial, participants who provided a mobile telephone number were randomised (1:1) by a central computer system to receive either (1) a personalised text message which included their name or (2) a standard text message. Text messages were sent by the trial office on the same day as the 6-month GRASP follow-up questionnaire. The primary outcome was questionnaire response rate, defined as the proportion of 6-month GRASP follow-up questionnaires returned by participants. Secondary outcomes included time to response, the proportion of participants sent a reminder follow-up questionnaire, and cost. RESULTS Between March 2017 and May 2019 (recruitment period for GRASP trial), 618 participants were randomised to a personalised (n = 309) or standard (n = 309) text message and all were included in the analysis. The overall questionnaire response rate was 87% (n = 537/618); 90% (n = 277/309) of participants responded in the personalised text message group compared to 84% (n = 260/309) in the standard text message group (relative risk (RR) 1.07; 95% CI 1.00 to 1.13). Participants randomised to receive the personalised text message were more likely to return their initial postal questionnaire than those who received the standard text message (n = 185/309; 60% vs. n = 160/309; 52%) (RR 1.16; 95% CI 1.00 to 1.33); this represents an absolute percentage difference between intervention groups of 8%. Post hoc subgroup analysis showed that males under 65 years were the group most likely to return their initial questionnaire if they received a personalised text message. CONCLUSION Overall, participants who received a personalised text message were more likely to return their questionnaire than those who received the standard text message. TRIAL REGISTRATION GRASP Trial ISRCTN16539266 ; SWAT Repository ID 35.
Collapse
Affiliation(s)
- Lucy Cureton
- Centre for Rehabilitation Research in Oxford, Nuffield Department of Orthopaedics, Rheumatology and Musculoskeletal Sciences, University of Oxford, Oxford, UK
| | - Ioana R Marian
- Oxford Clinical Trials Research Unit/Centre for Statistics in Medicine, Nuffield Department of Orthopaedics, Rheumatology and Musculoskeletal Sciences, University of Oxford, Botnar Research Building, Windmill Road, Oxford, OX3 7LD, UK
| | - Vicki S Barber
- Oxford Clinical Trials Research Unit/Centre for Statistics in Medicine, Nuffield Department of Orthopaedics, Rheumatology and Musculoskeletal Sciences, University of Oxford, Botnar Research Building, Windmill Road, Oxford, OX3 7LD, UK
| | | | | | - Sally Hopewell
- Centre for Rehabilitation Research in Oxford, Nuffield Department of Orthopaedics, Rheumatology and Musculoskeletal Sciences, University of Oxford, Oxford, UK.
- Oxford Clinical Trials Research Unit/Centre for Statistics in Medicine, Nuffield Department of Orthopaedics, Rheumatology and Musculoskeletal Sciences, University of Oxford, Botnar Research Building, Windmill Road, Oxford, OX3 7LD, UK.
| |
Collapse
|
6
|
Coleman E, Whitemore R, Clark L, Daykin K, Clark M. Pre-notification and personalisation of text messages to increase questionnaire completion in a smoking cessation pregnancy RCT: an embedded randomised factorial trial. F1000Res 2021; 10:637. [PMID: 34631028 PMCID: PMC8491148 DOI: 10.12688/f1000research.51964.2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Accepted: 09/10/2021] [Indexed: 11/20/2022] Open
Abstract
BACKGROUND Low completion rates of questionnaires in randomised controlled trials can compromise the reliability of the results, so ways to boost questionnaire completion are often implemented. Although there is evidence to suggest that sending a text message to participants increases completion, there is little evidence around the timing or personalisation of these text messages. Methods: A two-by-two factorial SWAT (study within a trial) was embedded within the MiQuit-3 trial, looking at smoking cessation within pregnant smokers. Participants who reached their 36-week gestational follow-up were randomised to receive a personalised or non-personalised text message, either one week or one day prior to their follow-up. Primary outcomes were completion rate of questionnaire via telephone. Secondary outcomes included: completion rate via any method, time to completion, and number of attempts to contact required. Results In total 194 participants were randomised into the SWAT to receive a text message that was personalised early(n=50), personalised late (n=47), non-personalised early(n=50), or non-personalised late(n=47). There was no evidence that timing of the text message (early: one week before; or late: one day before) had an effect on any of the outcomes. There was evidence that a personalised text message would result in fewer completions compared with a non-personalised text message when data was collected only via the telephone(adjusted OR 0.44, 95% CI 0.22-0.87, p=0.02). However, these results were not significant when looking at completion via any method (adjusted OR 0.61, 95% CI 0.30-1.24, p=0.17). There was no evidence to show that personalisation or not was better for any of the secondary outcomes. Conclusion Timing of the text message does not appear to influence the completion of questionnaires. Personalisation of a text message may be detrimental to questionnaire completion, if data is only collected via the telephone - however, more SWATs should be undertaken in this field.
Collapse
Affiliation(s)
- Elizabeth Coleman
- York Trials Unit, Department of Health Sciences, University of York, UK, York, YO10 5DD, UK
| | - Rachel Whitemore
- Division of Primary Care, Tower Building, University of Nottingham, Nottingham, NG7 2RD, UK
| | - Laura Clark
- York Trials Unit, Department of Health Sciences, University of York, UK, York, YO10 5DD, UK
| | - Karen Daykin
- Division of Primary Care, Tower Building, University of Nottingham, Nottingham, NG7 2RD, UK
| | - Miranda Clark
- Division of Primary Care, Tower Building, University of Nottingham, Nottingham, NG7 2RD, UK
| |
Collapse
|
7
|
Coleman E, Whitemore R, Clark L, Daykin K, Clark M. Pre-notification and personalisation of text-messages to retain participants in a smoking cessation pregnancy RCT: an embedded randomised factorial trial. F1000Res 2021; 10:637. [PMID: 34631028 PMCID: PMC8491148 DOI: 10.12688/f1000research.51964.1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Accepted: 04/26/2021] [Indexed: 09/22/2023] Open
Abstract
BACKGROUND Low response rates in randomised controlled trials can compromise the reliability of the results, so ways to boost retention are often implemented. Although there is evidence to suggest that sending a text message to participants increases retention, there is little evidence around the timing or personalisation of these messages. Methods: A two-by-two factorial SWAT (study within a trial) was embedded within the MiQuit-3 trial, looking at smoking cessation within pregnant smokers. Participants who reached their 36-week gestational follow-up were randomised to receive a personalised or non-personalised text message, either one week or one day prior to the telephone follow-up. Primary outcomes were completion rate of questionnaire via telephone. Secondary outcomes included: completion rate via any method, time to completion, and number of reminders required. Results In total 194 participants were randomised into the SWAT; 50 to personalised early text, 47 to personalised late text, 50 to non-personalised early text, and 47 to non-personalised late text. There was no evidence that timing of the text message (early: one week before; or late: one day before) had an effect on any of the outcomes. There was evidence that a personalised text would result in fewer completions via telephone compared with a non-personalised text (adjusted OR 0.44, 95% CI 0.22-0.87, p=0.02). However, there was no evidence to show that personalisation or not was better for any of the secondary outcomes. Conclusion Timing of the text message does not appear to influence the retention of participants. Personalisation of a text message may be detrimental to retention; however, more SWATs should be undertaken in this field.
Collapse
Affiliation(s)
- Elizabeth Coleman
- York Trials Unit, Department of Health Sciences, University of York, UK, York, YO10 5DD, UK
| | - Rachel Whitemore
- Division of Primary Care, Tower Building, University of Nottingham, Nottingham, NG7 2RD, UK
| | - Laura Clark
- York Trials Unit, Department of Health Sciences, University of York, UK, York, YO10 5DD, UK
| | - Karen Daykin
- Division of Primary Care, Tower Building, University of Nottingham, Nottingham, NG7 2RD, UK
| | - Miranda Clark
- Division of Primary Care, Tower Building, University of Nottingham, Nottingham, NG7 2RD, UK
| |
Collapse
|
8
|
Cockayne S, Pighills A, Adamson J, Fairhurst C, Crossland S, Drummond A, Hewitt CE, Rodgers S, Ronaldson SJ, McCaffery J, Whiteside K, Scantlebury A, Robinson-Smith L, Cochrane A, Lamb SE, Boyes S, Gilbody S, Relton C, Torgerson DJ. Home environmental assessments and modification delivered by occupational therapists to reduce falls in people aged 65 years and over: the OTIS RCT. Health Technol Assess 2021; 25:1-118. [PMID: 34254934 PMCID: PMC8287374 DOI: 10.3310/hta25460] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/20/2022] Open
Abstract
BACKGROUND Falls and fall-related fractures are highly prevalent among older people and are a major contributor to morbidity and costs to individuals and society. Only one small pilot trial has evaluated the effectiveness of a home hazard assessment and environmental modification in the UK. This trial reported a reduction in falls as a secondary outcome, and no economic evaluation was undertaken. Therefore, the results need to be confirmed and a cost-effectiveness analysis needs to be undertaken. OBJECTIVE To determine the clinical effectiveness and cost-effectiveness of a home hazard assessment and environmental modification delivered by occupational therapists for preventing falls among community-dwelling people aged ≥ 65 years who are at risk of falling, relative to usual care. DESIGN This was a pragmatic, multicentre, modified cohort randomised controlled trial with an economic evaluation and a qualitative study. SETTING Eight NHS trusts in primary and secondary care in England. PARTICIPANTS In total, 1331 participants were randomised (intervention group, n = 430; usual-care group, n = 901) via a secure, remote service. Blinding was not possible. INTERVENTIONS All participants received a falls prevention leaflet and routine care from their general practitioner. The intervention group were additionally offered one home environmental assessment and modifications recommended or provided to identify and manage personal fall-related hazards, delivered by an occupational therapist. MAIN OUTCOME MEASURES The primary outcome was the number of falls per participant during the 12 months from randomisation. The secondary outcomes were the proportion of fallers and multiple fallers, time to fall, fear of falling, fracture rate, health-related quality of life and cost-effectiveness. RESULTS The primary analysis included all 1331 randomised participants and indicated weak evidence of a difference in fall rate between the two groups, with an increase in the intervention group relative to usual care (adjusted incidence rate ratio 1.17, 95% confidence interval 0.99 to 1.38; p = 0.07). A similar proportion of participants in the intervention group (57.0%) and the usual-care group (56.2%) reported at least one fall over 12 months. There were no differences in any of the secondary outcomes. The base-case cost-effectiveness analysis from an NHS and Personal Social Services perspective found that, on average per participant, the intervention was associated with additional costs (£18.78, 95% confidence interval £16.33 to £21.24), but was less effective (mean quality-adjusted life-year loss -0.0042, 95% confidence interval -0.0041 to -0.0043). Sensitivity analyses demonstrated uncertainty in these findings. No serious, related adverse events were reported. The intervention was largely delivered as intended, but recommendations were followed to a varying degree. LIMITATIONS Outcome data were self-reported by participants, which may have led to inaccuracies in the reported falls data. CONCLUSIONS We found no evidence that an occupational therapist-delivered home assessment and modification reduced falls in this population of community-dwelling participants aged ≥ 65 years deemed at risk of falling. The intervention was more expensive and less effective than usual care, and therefore it does not provide a cost-effective alternative to usual care. FUTURE WORK An evaluation of falls prevention advice in a higher-risk population, perhaps those previously hospitalised for a fall, or given by other professional staff could be justified. TRIAL REGISTRATION Current Controlled Trials ISRCTN22202133. FUNDING This project was funded by the National Institute for Health Research (NIHR) Health Technology Assessment programme and will be published in full in Health Technology Assessment; Vol. 25, No. 46. See the NIHR Journals Library website for further project information.
Collapse
Affiliation(s)
- Sarah Cockayne
- York Trials Unit, Department of Health Sciences, University of York, York, UK
| | - Alison Pighills
- Mackay Institute of Research and Innovation, Queensland Health, Mackay Base Hospital, Mackay, QLD, Australia
- Division of Tropical Health and Medicine, James Cook University, Townsville, QLD, Australia
| | - Joy Adamson
- York Trials Unit, Department of Health Sciences, University of York, York, UK
| | - Caroline Fairhurst
- York Trials Unit, Department of Health Sciences, University of York, York, UK
| | | | - Avril Drummond
- School of Health Sciences, University of Nottingham, Nottingham, UK
| | - Catherine E Hewitt
- York Trials Unit, Department of Health Sciences, University of York, York, UK
| | - Sara Rodgers
- York Trials Unit, Department of Health Sciences, University of York, York, UK
| | - Sarah J Ronaldson
- York Trials Unit, Department of Health Sciences, University of York, York, UK
| | - Jennifer McCaffery
- York Trials Unit, Department of Health Sciences, University of York, York, UK
| | - Katie Whiteside
- York Trials Unit, Department of Health Sciences, University of York, York, UK
| | | | - Lyn Robinson-Smith
- York Trials Unit, Department of Health Sciences, University of York, York, UK
| | - Ann Cochrane
- York Trials Unit, Department of Health Sciences, University of York, York, UK
| | - Sarah E Lamb
- Institute of Health Research, College of Medicine and Health, University of Exeter, Exeter, UK
| | - Sophie Boyes
- York Teaching Hospital NHS Foundation Trust, York, UK
| | - Simon Gilbody
- York Trials Unit, Department of Health Sciences, University of York, York, UK
| | - Clare Relton
- Institute of Population Health Sciences, Queen Mary University of London, London, UK
| | - David J Torgerson
- York Trials Unit, Department of Health Sciences, University of York, York, UK
| |
Collapse
|
9
|
Gillies K, Kearney A, Keenan C, Treweek S, Hudson J, Brueton VC, Conway T, Hunter A, Murphy L, Carr PJ, Rait G, Manson P, Aceves-Martins M. Strategies to improve retention in randomised trials. Cochrane Database Syst Rev 2021; 3:MR000032. [PMID: 33675536 PMCID: PMC8092429 DOI: 10.1002/14651858.mr000032.pub3] [Citation(s) in RCA: 30] [Impact Index Per Article: 10.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/14/2022]
Abstract
BACKGROUND Poor retention of participants in randomised trials can lead to missing outcome data which can introduce bias and reduce study power, affecting the generalisability, validity and reliability of results. Many strategies are used to improve retention but few have been formally evaluated. OBJECTIVES To quantify the effect of strategies to improve retention of participants in randomised trials and to investigate if the effect varied by trial setting. SEARCH METHODS We searched the Cochrane Central Register of Controlled Trials (CENTRAL), MEDLINE, Scopus, PsycINFO, CINAHL, Web of Science Core Collection (SCI-expanded, SSCI, CPSI-S, CPCI-SSH and ESCI) either directly with a specified search strategy or indirectly through the ORRCA database. We also searched the SWAT repository to identify ongoing or recently completed retention trials. We did our most recent searches in January 2020. SELECTION CRITERIA We included eligible randomised or quasi-randomised trials of evaluations of strategies to increase retention that were embedded in 'host' randomised trials from all disease areas and healthcare settings. We excluded studies aiming to increase treatment compliance. DATA COLLECTION AND ANALYSIS We extracted data on: the retention strategy being evaluated; location of study; host trial setting; method of randomisation; numbers and proportions in each intervention and comparator group. We used a risk difference (RD) and 95% confidence interval (CI) to estimate the effectiveness of the strategies to improve retention. We assessed heterogeneity between trials. We applied GRADE to determine the certainty of the evidence within each comparison. MAIN RESULTS We identified 70 eligible papers that reported data from 81 retention trials. We included 69 studies with more than 100,000 participants in the final meta-analyses, of which 67 studies evaluated interventions aimed at trial participants and two evaluated interventions aimed at trial staff involved in retention. All studies were in health care and most aimed to improve postal questionnaire response. Interventions were categorised into broad comparison groups: Data collection; Participants; Sites and site staff; Central study management; and Study design. These intervention groups consisted of 52 comparisons, none of which were supported by high-certainty evidence as determined by GRADE assessment. There were four comparisons presenting moderate-certainty evidence, three supporting retention (self-sampling kits, monetary reward together with reminder or prenotification and giving a pen at recruitment) and one reducing retention (inclusion of a diary with usual follow-up compared to usual follow-up alone). Of the remaining studies, 20 presented GRADE low-certainty evidence and 28 presented very low-certainty evidence. Our findings do provide a priority list for future replication studies, especially with regard to comparisons that currently rely on a single study. AUTHORS' CONCLUSIONS Most of the interventions we identified aimed to improve retention in the form of postal questionnaire response. There were few evaluations of ways to improve participants returning to trial sites for trial follow-up. None of the comparisons are supported by high-certainty evidence. Comparisons in the review where the evidence certainty could be improved with the addition of well-done studies should be the focus for future evaluations.
Collapse
Affiliation(s)
- Katie Gillies
- Health Services Research Unit, University of Aberdeen, Aberdeen, UK
| | - Anna Kearney
- Dept. of Health Data Science, University of Liverpool, Liverpool, UK
| | - Ciara Keenan
- Campbell UK & Ireland, Centre for Evidence and Social Innovation, Queen's University, Belfast, UK
| | - Shaun Treweek
- Health Services Research Unit, University of Aberdeen, Aberdeen, UK
| | - Jemma Hudson
- Health Services Research Unit, University of Aberdeen, Aberdeen, UK
| | - Valerie C Brueton
- Department of Adult Nursing, Florence Nightingale Faculty of Nursing Midwifery and Palliative Care, King's College, London, UK
| | - Thomas Conway
- Clinical Research Facility Galway, National University of Ireland Galway, Galway, Ireland
| | - Andrew Hunter
- School of Nursing and Midwifery, National University of Ireland Galway, Galway, Ireland
| | - Louise Murphy
- School of Nursing and Midwifery, National University of Ireland Galway, Galway, Ireland
| | - Peter J Carr
- School of Nursing and Midwifery, National University of Ireland Galway, Galway, Ireland
| | - Greta Rait
- Research Department of Primary Care and Population Health, University College London, London, UK
| | - Paul Manson
- Health Services Research Unit (HSRU), University of Aberdeen, Aberdeen, UK
| | | |
Collapse
|
10
|
Mitchell AS, Cook L, Dean A, Fairhurst C, Northgraves M, Torgerson DJ, Reed M. An embedded randomised controlled retention trial of personalised text messages compared to non-personalised text messages in an orthopaedic setting. F1000Res 2020; 9:591. [PMID: 35600143 PMCID: PMC9091807 DOI: 10.12688/f1000research.24244.1] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Accepted: 09/01/2021] [Indexed: 07/22/2023] Open
Abstract
Background: Several studies have investigated whether personalising trial documentation can aid recruitment and retention. We did a 'study within a trial' (SWAT) evaluating the effectiveness of a personalised text message compared to a non-personalised text message, on the retention rate in a large orthopaedic trial. Methods: The SWAT was embedded in the Knee Replacement Bandaging Study (KReBS) trial. The primary outcome was the proportion of 12-month questionnaires returned. Secondary outcomes were the proportion of questionnaires completed and time to questionnaire return. Binary data were analysed using logistic regression and time to return using Cox proportional hazards regression. Odds ratios (OR) and hazard ratios (HR) are presented, with associated 95% confidence intervals (CI) and p-values. Results: In total, 1465 participants were included in the SWAT. In the personalised group, 644/723 (89.1%) of participants returned a questionnaire, compared to 654/742 (88.1%) in the non-personalised group. The absolute difference in return rate was 0.9% (95% CI: -2.3% to 4.2%; p=0.57). There was no evidence of a difference between the groups in the likelihood of returning a questionnaire (OR 1.09; 95% CI: 0.79 to 1.51; p=0.61), the likelihood of returning a complete questionnaire (OR 1.11; 95% CI: 0.82 to 1.51; p=0.50) nor in time to return (HR 1.05; 95% CI: 0.94 to 1.17; p=0.40). Conclusion: This SWAT adds to the growing evidence base for whether personalised text messages are effective. Registration: ISRCTN87127065 (20/02/2017); SWAT 35 (01/12/2015).
Collapse
Affiliation(s)
- Alex S. Mitchell
- Department of Health Sciences, University of York, UK, York, Y010 5DD, UK
| | - Liz Cook
- Department of Health Sciences, University of York, UK, York, Y010 5DD, UK
| | - Alexandra Dean
- Department of Health Sciences, University of York, UK, York, Y010 5DD, UK
| | - Caroline Fairhurst
- Department of Health Sciences, University of York, UK, York, Y010 5DD, UK
| | | | - David J. Torgerson
- Department of Health Sciences, University of York, UK, York, Y010 5DD, UK
| | - Mike Reed
- Department of Health Sciences, University of York, UK, York, Y010 5DD, UK
- North Tyneside General Hospital, Northumbria Healthcare NHS Foundation Trust, North Shields, Tyne and Wear, NE29 8NH, UK
| |
Collapse
|
11
|
Woodford J, Norbäck K, Hagström J, Grönqvist H, Parker A, Arundel C, von Essen L. Study within a trial (SWAT) protocol. Investigating the effect of personalised versus non-personalised study invitations on recruitment: An embedded randomised controlled recruitment trial. Contemp Clin Trials Commun 2020; 18:100572. [PMID: 32420511 PMCID: PMC7214762 DOI: 10.1016/j.conctc.2020.100572] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/12/2019] [Revised: 03/31/2020] [Accepted: 04/19/2020] [Indexed: 11/18/2022] Open
Abstract
Introduction Recruitment into clinical trials is a common challenge experienced by healthcare researchers. Currently, there is little evidence regarding strategies to improve recruitment into clinical trials. However, preliminary research suggests the personalisation of study invitation letters may increase recruitment rates. As such, there is a need to investigate the effectiveness of personalisation strategies on trial recruitment rates. This study within a trial (SWAT) will investigate the effect of personalised versus non-personalised study invitation letters on recruitment rates into the host trial ENGAGE, a feasibility study of an internet-administered, guided, Cognitive-Behavioural Therapy (CBT) based self-help intervention for parents of children previously treated for cancer. Methods An embedded randomised controlled trial (RCT) will investigate the effectiveness of a personalised study invitation letter including the potential participant’s name and address compared with a standard, non-personalised letter without name or address, on participant recruitment rates into the ENGAGE study. The primary outcome is differences in the proportion of participants recruited, examined using logistic regression. Results will be reported as adjusted odds ratios with 95% confidence intervals. Discussion Even moderate effects of the personalisation of study invitation letters on recruitment rates could be of significant value by shortening study length, saving resources, and providing a faster answer to the clinical question posed by the study. This protocol can be used as a template for other researchers who wish to contribute to the evidence base for trial decision-making, by embedding a similar SWAT into their trial. Trial registration ISRCTN 57233429; ISRCTN 18404129; SWAT 112, Northern Ireland Hub for Trials Methodology Research SWAT repository (2018 OCT 1 1231).
Collapse
Affiliation(s)
- Joanne Woodford
- Department of Women's and Children's Health, Uppsala University Psychosocial Care Programme (U-CARE), Uppsala University, Sweden
| | - Kajsa Norbäck
- Department of Women's and Children's Health, Uppsala University Psychosocial Care Programme (U-CARE), Uppsala University, Sweden
| | - Josefin Hagström
- Department of Women's and Children's Health, Uppsala University Psychosocial Care Programme (U-CARE), Uppsala University, Sweden
| | - Helena Grönqvist
- Department of Women's and Children's Health, Uppsala University Psychosocial Care Programme (U-CARE), Uppsala University, Sweden
| | - Adwoa Parker
- Department of Health Sciences, Faculty of Sciences, York Trials Unit, University of York, United Kingdom
| | - Catherine Arundel
- Department of Health Sciences, Faculty of Sciences, York Trials Unit, University of York, United Kingdom
| | - Louise von Essen
- Department of Women's and Children's Health, Uppsala University Psychosocial Care Programme (U-CARE), Uppsala University, Sweden
- Corresponding author. Uppsala University, Clinical Psychology in Healthcare, Department of Women’s and Children’s Health, Box 572, 751 23, Uppsala, Sweden.
| |
Collapse
|