Validity of mobile electronic data capture in clinical studies: a pilot study in a pediatric population

MyCap: a flexible and configurable platform for mobilizing the participant voice

This paper provides a description of the MyCap data collection platform, utilization metrics, and vignettes associated with use from diverse research institutions. MyCap is a participant-facing mobile application for survey data collection and the automated administration of active tasks (activities performed by participants using mobile device sensors under semi-controlled conditions). Launched in 2018, MyCap is a no-code solution for research teams conducting longitudinal studies, integrates tightly with REDCap and is available at no cost to research teams at academic, nonprofit, or government organizations. MyCap has been deployed at multiple research institutions with application usage logged across 135 countries in 2021. Vignettes demonstrate that MyCap empowered research teams to explore and implement novel methods of information collection and use. MyCap’s integration with REDCap provides a comprehensive data collection ecosystem and is best suited for longitudinal studies with frequent requests for information from participants.

Patients' Perspectives on Transforming Clinical Trial Participation: Large Online Vignette-based Survey

Background

Patients’ participation is crucial to the success of randomized controlled trials (RCTs). However, recruiting and retaining patients in trials remain a challenge.

Objective

This study aims to describe patients’ preferences for the organization of RCTs (visits on- site or remotely) and evaluate the potential impact of fulfilling preferences on their willingness to participate in a clinical trial.

Methods

This was a vignette-based survey. Vignettes were case scenarios of real clinical trials assessing pharmacological treatments. These RCTs evaluated 6 prevalent chronic diseases (ie, osteoporosis, osteoarthritis, asthma, cardiovascular diseases, diabetes, and endometriosis). Each vignette described (1) the RCT and characteristics of the treatment tested (ie, doses, administration routes) and (2) the trial procedures and different options (on-site or remotely) for how the trial was organized for informed consent, follow-up visits, and communication of results when the trial was completed. We recruited 628 participants from ComPaRe (www.compare.aphp.fr), a French e-cohort of patients with chronic diseases. The outcomes were the participants’ preferences for the way the trial was organized (on-site or remotely) and their willingness to participate in the trial.

Results

Of the 628 participants who answered the vignettes, 491 (78.2%) were female (median age 55 years), with different chronic diseases ranging from endometriosis in 59 of 491 (12%) patients to asthma in 133 of 628 (21.2%) patients. In addition, 38 (6.1%) participants wanted to provide informed consent and all trial visits on-site, 176 (28%) wished to participate in the trial entirely remotely, and 414 (65.9%) wanted to combine remote-based and hospital-based visits. Considering the trial as a whole, when the trial was organized in a way that the patients preferred, the median (Q1-Q3) likelihood of participation in the trial was 90% (80-100) versus 60% (30-80) if the trial followed the patients’ nonpreferred model. Furthermore, 256 (40.8%) patients responded to open-ended questions expressing their experience with trial participation and visits to the hospital and providing suggestions for improvement. The patients emphasized the need to personalize the way a trial is organized according to each patient’s needs and conditions.

Conclusions

There was a significant diversity in the participants’ preferences. Most participants preferred hybrid organization involving both on-site and remote visits. Participants were more likely to participate in a trial organized according to their preferences.

Digital clinical trial: A new norm in clinical research

The advent of digital technologies has been well blended with every aspect of human lives. Despite not being a new concept, the adoption of digital health technologies in clinical research, i.e., digital clinical trial has not been utilized extensively. However, with the prevailing COVID-19 pandemics, such transformation in clinical trial seems imminent. Few components of a trial such as consent, remote site monitoring, recruitment process which can be modified through digital technologies, are further specified by the regulatory authorities such as FDA and EMA. However, such novel method cannot be implemented without facing any limitations. All stakeholders pertinent to virtual clinical trial including the provider of digital technologies should align themselves with the patient-centric approach to propagate this concept. It is expected that such a transition is well accomplished and adopted by the sponsors without any compromise in scientific as well as ethical standard.

Conservative treatment for uncomplicated appendicitis in children: the CONTRACT feasibility study, including feasibility RCT

BACKGROUND

Although non-operative treatment is known to be effective for the treatment of uncomplicated acute appendicitis in children, randomised trial data comparing important outcomes of non-operative treatment with those of appendicectomy are lacking.

OBJECTIVES

The objectives were to ascertain the feasibility of conducting a multicentre randomised controlled trial comparing the clinical effectiveness and cost-effectiveness of a non-operative treatment pathway with appendicectomy for the treatment of uncomplicated acute appendicitis in children.

DESIGN

This was a mixed-methods study, which included a feasibility randomised controlled trial, embedded and parallel qualitative and survey studies, a parallel health economic feasibility study and the development of a core outcome set.

SETTING

This study was set in three specialist NHS paediatric surgical units in England.

PARTICIPANTS

Children (aged 4-15 years) clinically diagnosed with uncomplicated acute appendicitis participated in the feasibility randomised controlled trial. Children, their families, recruiting clinicians and other health-care professionals involved in caring for children with appendicitis took part in the qualitative study. UK specialist paediatric surgeons took part in the survey. Specialist paediatric surgeons, adult general surgeons who treat children, and children and young people who previously had appendicitis, along with their families, took part in the development of the core outcome set.

INTERVENTIONS

Participants in the feasibility randomised controlled trial were randomised to a non-operative treatment pathway (broad-spectrum antibiotics and active observation) or appendicectomy.

MAIN OUTCOME MEASURES

The primary outcome measure was the proportion of eligible patients recruited to the feasibility trial.

DATA SOURCES

Data were sourced from NHS case notes, questionnaire responses, transcribed audio-recordings of recruitment discussions and qualitative interviews.

RESULTS

Overall, 50% (95% confidence interval 40% to 59%) of 115 eligible patients approached about the trial agreed to participate and were randomised. There was high acceptance of randomisation and good adherence to trial procedures and follow-up (follow-up rates of 89%, 85% and 85% at 6 weeks, 3 months and 6 months, respectively). More participants had perforated appendicitis than had been anticipated. Qualitative work enabled us to communicate about the trial effectively with patients and families, to design and deliver bespoke training to optimise recruitment and to understand how to optimise the design and delivery of a future trial. The health economic study indicated that the main cost drivers are the ward stay cost and the cost of the operation; it has also informed quality-of-life assessment methods for future work. A core outcome set for the treatment of uncomplicated acute appendicitis in children and young people was developed, containing 14 outcomes. There is adequate surgeon interest to justify proceeding to an effectiveness trial, with 51% of those surveyed expressing a willingness to recruit with an unchanged trial protocol.

LIMITATIONS

Because the feasibility randomised controlled trial was performed in only three centres, successful recruitment across a larger number of sites cannot be guaranteed. However, the qualitative work has informed a bespoke training package to facilitate this. Although survey results suggest adequate clinician interest to make a larger trial possible, actual participation may differ, and equipoise may have changed over time.

CONCLUSIONS

A future effectiveness trial is feasible, following limited additional preparation, to establish appropriate outcome measures and case identification. It is recommended to include a limited package of qualitative work to optimise recruitment, in particular at new centres.

FUTURE WORK

Prior to proceeding to an effectiveness trial, there is a need to develop a robust method for distinguishing children with uncomplicated acute appendicitis from those with more advanced appendicitis, and to reach agreement on a primary outcome measure and effect size that is acceptable to all stakeholder groups involved.

TRIAL REGISTRATION

Current Controlled Trials ISRCTN15830435.

FUNDING

This project was funded by the National Institute for Health Research (NIHR) Health Technology Assessment programme and will be published in full in Health Technology Assessment; Vol. 25, No. 10. See the NIHR Journals Library website for further project information.

An Interactive Text Message Survey as a Novel Assessment for Bedtime Routines in Public Health Research: Observational Study

BACKGROUND

Traditional research approaches, especially questionnaires and paper-based assessments, limit in-depth understanding of the fluid dynamic processes associated with child well-being and development. This includes bedtime routine activities such as toothbrushing and reading a book before bed. The increase in innovative digital technologies alongside greater use and familiarity among the public creates unique opportunities to use these technical developments in research.

OBJECTIVE

This study aimed to (1) examine the best way of assessing bedtime routines in families and develop an automated, interactive, text message survey assessment delivered directly to participants' mobile phones and (2) test the assessment within a predominately deprived sociodemographic sample to explore retention, uptake, feedback, and effectiveness.

METHODS

A public and patient involvement project showed clear preference for interactive text surveys regarding bedtime routines. The developed interactive text survey included questions on bedtime routine activities and was delivered for seven consecutive nights to participating parents' mobile phones. A total of 200 parents participated. Apart from the completion of the text survey, feedback was provided by participants, and data on response, completion, and retention rates were captured.

RESULTS

There was a high retention rate (185/200, 92.5%), and the response rate was high (160/185, 86.5%). In total, 114 participants provided anonymized feedback. Only a small percentage (5/114, 4.4%) of participants reported problems associated with completing the assessment. The majority (99/114, 86.8%) of participants enjoyed their participation in the study, with an average satisfaction score of 4.6 out of 5.

CONCLUSIONS

This study demonstrated the potential of deploying SMS text message-based surveys to capture and quantify real-time information on recurrent dynamic processes in public health research. Changes and adaptations based on recommendations are crucial next steps in further exploring the diagnostic and potential intervention properties of text survey and text messaging approaches.

Parents' understanding and motivation to take part in a randomized controlled trial in the field of adolescent mental health: a qualitative study

BACKGROUND

Little is known about why parents agree to take part in randomized controlled trials for adolescent mental health. This study aimed to investigate parents' perspectives on participating in a trial for psychological treatment of depression. The study explored parents' motivations, understanding of the trial and perspectives on the acceptability of the trial.

METHODS

Sixty-five parents took part in this qualitative study. Their adolescent children had been randomly allocated to one of three active psychological treatments for depression as part of the IMPACT trial and were interviewed about their experiences of participating in the study. Semi-structured interviews were analysed using framework analysis.

RESULTS

For seven of the sixty-five parents, their experience of taking part in the trial was not covered in their interview so they were excluded from the analysis. The analysis was therefore based on the data from the parents of 58 adolescents taking part in the trial. The most commonly cited motivation for taking part in the study reported by parents was a desire to help others going through similar difficulties. Parents generally reported finding trial participation acceptable, although there were aspects that some reported finding less acceptable, including randomization and the burden of research assessments. Others spoke positively about the experience of trial participation and found it enjoyable or even therapeutic. Importantly, some did not appear to have a good understanding of the trial design, including randomization and treatment allocation.

CONCLUSIONS

This study indicates that trial participation can be a positive experience for parents, yet it raises concerns about how trialists can ensure that consent is fully informed, given that some parents appeared to have a poor understanding of the trial. Future studies should seek to explore how communication with trial participants can be improved, to ensure that trial participation is fully informed. Patient and public involvement will be crucial in ensuring this communication is accessible to stakeholders.

TRIAL REGISTRATION

ISRCTN registry ISRCTN83033550 . Registered on 15 October 2009.

How to collect non-medical data in a pediatric trial: diaries or interviews

BACKGROUND

Non-medical data, such as the amount of time that patients and caregivers spend managing their condition, may be relevant when assessing therapeutic strategies. For chronic pediatric conditions, the time that patients and caregivers spend in seeking and providing care (which are the indirect costs in an economic evaluation) can be significantly different depending on the treatment arm. To explore methods for collecting information on the care burden for caregivers and patients, we investigated whether a patient diary provided additional information compared to retrospective investigator-led interviews and whether a diary that was completed intermittently produced more or less information than a diary completed continually. The main objective of this study was to identify which type of data collection was most effective for measuring the time spent by caregivers and for estimating indirect treatment costs over 9 months.

METHODS

Start-In! is a randomized controlled trial comparing the efficacy of three strategies of real-time continuous glucose monitoring for 12 months in children and adolescents with type 1 diabetes. We designed an ancillary study to assess methods of collecting information on the time spent by patients and caregivers in managing their condition (indirect costs). Data were entered retrospectively in case report forms (CRFs) by investigators during quarterly follow-up visits, which were supplemented with diaries completed prospectively by children or caregivers either continuously or intermittently. Data about absences from school and work as well as the time that caregivers spent on diabetes care were collected and the three collection methods were compared.

RESULTS

At the end of the 9-month study, 42% of the study participants failed to return their diary. For the diaries that were received, less than 10% of expected data were collected versus 82% during investigators'interviews. Based on all the information collected, we calculated that over 9 months, caregivers lost on average 3.9 days of working time (€786) and 4 days of personal time, i.e. the equivalent of €526, and spent around 15 min of time on care per day, i.e. the equivalent of €1700.

CONCLUSIONS

The CRFs completed by investigators during quarterly visits cannot be replaced by a diary. Completing the diaries appeared to represent an important additional burden to children and their caregivers, and the diaries provided little additional information compared to investigators' entries in the CRF.

TRIAL REGISTRATION

ClinicalTrials.gov, NCT00949221. Registered on 30 July 2009. Registry name: Study of Insulin Therapy Augmented by Real Time Sensor in Type 1 Children and Adolescents (START-IN!).

A Protocol to Assess Feasibility, Acceptability, and Usability of Mobile Technology for Symptom Management in Pediatric Transplant Patients

BACKGROUND

Pediatric blood and marrow transplant (PBMT) patients experience significant symptom distress, and the use of mobile health (mHealth) technologies may enhance symptom management by providing patient-generated health data to foster personalized health strategies.

OBJECTIVES

The aim of this study was to present a study protocol to explore feasibility, acceptability, and usability of integrating mHealth technologies to collect and monitor symptom data for PBMT patients.

METHODS

An exploratory mixed-methods design is employed for 20 PBMT patients to monitor symptoms using real-time data from two mHealth devices: (a) a self-developed mHealth application and (b) a wearable tracking device. Patient-Reported Outcomes Measurement Information System surveys for fatigue, pain, and sleep disturbance are obtained monthly. Interviews are conducted to obtain further feasibility and usability data.

RESULTS

The study began in October 2017; data collection should be completed in 2018. Feasibility and usability results to monitor and record symptom-related data daily via mobile devices will be reported. Patient-Reported Outcomes Measurement Information System surveys and interviews will further explore patients' symptoms and experiences with the mobile devices.

DISCUSSION

This study will be among the first to explore the feasibility, acceptability, and usability of integrating multiple mHealth technologies to obtain patient-generated symptom data for the PBMT population. Results will enhance our understanding of how these data present, interact, and cluster together throughout the posttransplant period for these children and lead to symptom management strategies. Results will focus on a high-risk population that potentially stands to benefit from the use of mobile technologies.

Literature review to characterize the empirical basis for response scale selection in pediatric populations

BACKGROUND

Despite the importance of response option selection for patient-reported outcome measures, there seems to be little empirical evidence for the selected scale type. This article provides an overview of the published research on response scale types and empirical support within pediatric populations.

METHODS

A comprehensive review of the scientific literature was conducted to identify response scale option types appropriate for use in pediatric populations and to review and summarize the available empirical evidence for each scale type.

RESULTS

Eleven review/consensus guideline/expert opinion articles and 20 empirical articles that provided guidance or evidence regarding pediatric response scale selection were identified. There was general consensus that 5-point verbal rating scales, including Likert scales, were appropriate for children aged 7 or 8 and older, while graphical or faces scales are often used in pediatric studies with children of younger ages.

CONCLUSION

In general, the verbal rating scale, numeric rating scale, visual analogue scale, and graphical scales have each demonstrated to be reliable and valid response option formats in specific contexts among pediatric populations; however, their appropriateness is dependent upon sample age. When selecting response scales, it is important to consider target population and context of use during the development of patient-reported outcome measures, especially with respect to tense, recall period, attribution, number of options, etc. In addition to age, cognitive development is an important aspect to consider for optimizing pediatric self-reported measures. More research is needed to determine clinically relevant changes and differences within pediatric research, which includes different response scale options.