Remote Assessment of Functional Mobility and Strength in Older Cancer Survivors: Protocol for a Validity and Reliability Study

Best Practices and Recommendations for Research Using Virtual Real-Time Data Collection: Protocol for Virtual Data Collection Studies

BACKGROUND

The COVID-19 pandemic and the subsequent need for social distancing required the immediate pivoting of research modalities. Research that had previously been conducted in person had to pivot to remote data collection. Researchers had to develop data collection protocols that could be conducted remotely with limited or no evidence to guide the process. Therefore, the use of web-based platforms to conduct real-time research visits surged despite the lack of evidence backing these novel approaches.

OBJECTIVE

This paper aims to review the remote or virtual research protocols that have been used in the past 10 years, gather existing best practices, and propose recommendations for continuing to use virtual real-time methods when appropriate.

METHODS

Articles (n=22) published from 2013 to June 2023 were reviewed and analyzed to understand how researchers conducted virtual research that implemented real-time protocols. "Real-time" was defined as data collection with a participant through a live medium where a participant and research staff could talk to each other back and forth in the moment. We excluded studies for the following reasons: (1) studies that collected participant or patient measures for the sole purpose of engaging in a clinical encounter; (2) studies that solely conducted qualitative interview data collection; (3) studies that conducted virtual data collection such as surveys or self-report measures that had no interaction with research staff; (4) studies that described research interventions but did not involve the collection of data through a web-based platform; (5) studies that were reviews or not original research; (6) studies that described research protocols and did not include actual data collection; and (7) studies that did not collect data in real time, focused on telehealth or telemedicine, and were exclusively intended for medical and not research purposes.

RESULTS

Findings from studies conducted both before and during the COVID-19 pandemic suggest that many types of data can be collected virtually in real time. Results and best practice recommendations from the current protocol review will be used in the design and implementation of a substudy to provide more evidence for virtual real-time data collection over the next year.

CONCLUSIONS

Our findings suggest that virtual real-time visits are doable across a range of participant populations and can answer a range of research questions. Recommended best practices for virtual real-time data collection include (1) providing adequate equipment for real-time data collection, (2) creating protocols and materials for research staff to facilitate or guide participants through data collection, (3) piloting data collection, (4) iteratively accepting feedback, and (5) providing instructions in multiple forms. The implementation of these best practices and recommendations for future research are further discussed in the paper.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

DERR1-10.2196/53790.

Remotely delivered exercise to older rural cancer survivors: a randomized controlled pilot trial

PURPOSE

The study aimed to determine the feasibility of remotely delivered exercise (tele-exercise) for older, rural cancer survivors and to explore the effects of tele-exercise on physical function, physical activity, and patient-reported outcomes.

METHODS

Participants were rural cancer survivors age ≥ 60 years (79% female; mean age 70.4 ± 5.7) randomly assigned to the remotely delivered EnhanceFitness (tele-EF) exercise program, inclusive of aerobic, strength, and balance training and led by American Council on Exercise certified instructors for 1 h, 3 days/week for 16 weeks (n = 20) or to a waitlist control group (n = 19). We assessed feasibility, physical function, accelerometer-measured physical activity, and patient-reported outcomes at baseline and post intervention.

RESULTS

Among those screened as eligible, 44 (64%) consented to participate with 39 randomized after completing baseline measures. Attrition was equivalent between groups (n = 1, each) with 95% completing the study. The median class attendance rate was 86.9% (interquartile range: 79-94%). Compared to controls, tele-EF participants had statistically significant improvement in the five-time sit-to-stand test (- 3.4 vs. - 1.1 s, p = 0.03, effect size = 0.44), mean daily light physical activity (+ 38.5 vs 0.5 min, p = 0.03, effect size = 0.72) and step counts (+ 1977 vs. 33, p = 0.01, effect size = 0.96). There were no changes in self-efficacy for exercise, fatigue, or sleep disturbance between groups.

CONCLUSIONS

Findings indicate that tele-EF is feasible in older, rural cancer survivors and results in positive changes in physical function and physical activity.

IMPLICATIONS FOR CANCER SURVIVORS

Tele-EF addresses common barriers to exercise for older, rural cancer survivors, including limited accessible opportunities for professional instruction and supervision.

Validity and Reliability of a Telehealth Physical Fitness and Functional Assessment Battery for Ambulatory Youth With and Without Mobility Disabilities: Observational Measurement Study

BACKGROUND

Youth (age 15-24 years) with and without disability are not adequately represented enough in exercise research due to a lack of time and transportation. These barriers can be overcome by including accessible web-based assessments that eliminate the need for on-site visitations. There is no simple, low-cost, and psychometrically sound compilation of measures for physical fitness and function that can be applied to youth with and without mobility disabilities.

OBJECTIVE

The first purpose was to determine the statistical level of agreement of 4 web-modified clinical assessments with how they are typically conducted in person at a laboratory (convergent validity). The second purpose was to determine the level of agreement between a novice and an expert rater (interrater reliability). The third purpose was to explore the feasibility of implementing the assessments via 2 metrics: safety and duration.

METHODS

The study enrolled 19 ambulatory youth: 9 (47%) with cerebral palsy with various mobility disabilities from a children's hospital and 10 (53%) without disabilities from a university student population. Participants performed a battery of tests via videoconferencing and in person. The test condition (teleassessment and in person) order was randomized. The battery consisted of the hand grip strength test with a dynamometer, the five times sit-to-stand test (FTST), the timed up-and-go (TUG) test, and the 6-minute walk test (6MWT) either around a standard circular track (in person) or around a smaller home-modified track (teleassessment version, home-modified 6-minute walk test [HM6MWT]). Statistical analyses included descriptive data, intraclass correlation coefficients (ICCs), and Bland-Altman plots.

RESULTS

The mean time to complete the in-person assessment was 16.9 (SD 4.8) minutes and the teleassessment was 21.1 (SD 5.9) minutes. No falls, injuries, or adverse events occurred. Excellent convergent validity was shown for telemeasured hand grip strength (right ICC=0.96, left ICC=0.98, P<.001) and the TUG test (ICC=0.92, P=.01). The FTST demonstrated good agreement (ICC=0.95, 95% CI 0.79-0.98; P=.01). The HM6MWT demonstrated poor absolute agreement with the 6MWT. However, further exploratory analysis revealed a strong positive correlation between the tests (r=0.83, P<.001). The interrater reliability was excellent for all tests (all ICCs>0.9, P<.05).

CONCLUSIONS

This study suggests that videoconference assessments are convenient and useful measures of fitness and function among youth with and without disabilities. This paper presents operationalized teleassessment procedures that can be replicated by health professionals to produce valid and reliable measurements. This study is a first step toward developing teleassessments that can bypass the need for on-site data collection visitations for this age group. Further research is needed to identify psychometrically sound teleassessment procedures, particularly for measures of cardiorespiratory endurance or walking ability.

Test-retest reliability and agreement of remote home-based functional capacity self-administered assessments in community-dwelling, socially isolated older adults

Objectives

To determine the test-retest reliability and agreement of home-based functional capacity self-administered assessments in socially isolated older adults.

Methods

Fourteen community-dwelling older adults (eight females, 67.9 ± 7.7 years) volunteered for this study. Before testing, participants were screened online for eligibility and received instructional videos explaining test set-up and execution. Participants underwent the 30-second sit-to-standing test, gait speed tests at the usual pace, and timed-up-and-go tests administered 4 weeks apart. For the 30-second sit-to-standing protocol, participants were instructed to repeatedly sit and stand from a chair (with a height of ∼ 43 cm and without armrests) for 30 s, with the number of repetitions recorded. In the gait speed test protocol, participants were instructed to walk at their usual and comfortable pace, with the time taken recorded (seconds). In the timed-up-and-go, participants stood up from a chair, walked as fast as possible for 3 m, circled a marked point, and returned to the chair to sit down, completing the test, with the score recorded (seconds). A trained researcher conducted the scoring virtually via synchronous video.

Results

30-second sit-to-standing, gait speed test, and timed-up-and-go showed excellent mean coefficient of variation values (2.0-4.9), small standard error of measurement (0.08-1.27), excellent intraclass coefficient (0.97-0.99), very strong correlations (0.97-0.99) and good agreement between the two days of testing.

Conclusion

Self-administered functional capacity tests performed by older adults at home were reliable with good agreement. Healthcare professionals and older adults should take advantage of simple remote self-administered assessments performed at home to evaluate older adults' health status.

Remote Administration of Physical and Cognitive Performance Assessments in a Predominantly Black Cohort of Persons With Systemic Lupus Erythematosus

OBJECTIVE

In a study of physical and cognitive functioning among predominantly Black individuals with systemic lupus erythematosus (SLE), we compared remotely administered physical and cognitive performance assessments to those collected in person.

METHODS

A subset of participants who completed an in-person visit in our parent study from 2021 to 2022 (n = 30) were recruited to complete a second, remote visit within 28 days. Physical performance (measured by a modified Short Physical Performance Battery [SPPB]; range 0-12; subscale ranges 0-4; higher = better performance) and cognitive performance (episodic and working memory adjusted t-scores, measured using NIH Toolbox) were measured at both visits. Mean scores were compared using paired t-tests; intraclass correlation coefficients (ICCs) were obtained from two-way mixed effects models. Linear and logistic models were used to estimate stratified associations between performance measures and related outcomes.

RESULTS

Participants were primarily female (93.3%) and Black (93.3%). In-person versus remote overall SPPB (8.76 vs. 9.43) and chair stand (1.43 vs. 1.90) scores were statistically significantly lower. t-Scores for episodic memory (47.27 vs. 49.53) and working memory (45.37 vs. 47.90) were lower for in-person versus remote visits. The ICC for overall SPPB indicated good agreement (0.76), whereas the ICCs for episodic (0.49) and working memory (0.57) indicated poor-moderate agreement. Associations between assessments of performance with related outcomes were similar and did not statistically significantly differ by modality of visit.

CONCLUSION

To possibly expand and diversify pools of participants in studies of physical and cognitive performance in SLE, remote administration of assessments should be considered for future research.

Feasibility, Reliability, and Safety of Remote Five Times Sit to Stand Test in Patients with Gastrointestinal Cancer

Background: To determine the feasibility, reliability, and safety of the remote five times sit to stand test (5STS) test in patients with gastrointestinal cancer. Methods: Consecutive adult patients undergoing surgical treatment for lower gastrointestinal cancer at a major referral hospital in Sydney between July and November 2022 were included. Participants completed the 5STS test both face-to-face and remotely, with the order randomised. Outcomes included measures of feasibility, reliability, and safety. Results: Of fifty-five patients identified, seventeen (30.9%) were not interested, one (1.8%) had no internet coverage, and thirty-seven (67.3%) consented and completed both 5STS tests. The mean (SD) time taken to complete the face-to-face and remote 5STS tests was 9.1 (2.4) and 9.5 (2.3) seconds, respectively. Remote collection by telehealth was feasible, with only two participants (5.4%) having connectivity issues at the start of the remote assessment, but not interfering with the tests. The remote 5STS test showed excellent reliability (ICC = 0.957), with limits of agreement within acceptable ranges and no significant systematic errors observed. No adverse events were observed within either test environment. Conclusions: Remote 5STS for the assessment of functional lower extremity strength in gastrointestinal cancer patients is feasible, reliable, and safe, and can be used in clinical and research settings.

Validity of On-Line Supervised Fitness Tests in People with Low Back Pain

This study aimed to investigate the concurrent validity between online evaluations (OEs) and face-to-face evaluations (IPEs) of a Senior Fitness Test and two balance tests in people with low back pain (LBP). Forty participants of 58.48 (9.87) years were included. The 30 s chair stand-up, arm curl, 2 min step, chair-sit and reach, back scratch, 8 foot up-and-go, sharpened Romberg, and one-legged stance tests were administrated using both OE and IPE methods. The results indicated no significant differences (p > 0.05) between the two methods except in the 8-foot up-and-go test (p = 0.007). Considering the ICC values and Bland-Altman plots, excellent agreement was found for the chair-sit and reach test, moderate agreement for the arm-curl and 8-foot up-and-go tests, and good agreement for the other tests. Strong correlations (p < 0.001) were observed in all variables except for the arm-curl and 8-foot up-and-go tests, where moderate correlations were found (p < 0.05). These results support the validity of OEs and IPEs in all tests, except for the arm-curl and 8-foot up-and-go tests, where lower ICC values and moderate correlations were found. However, it is important to consider the range of fluctuation of the ICC and the significant values obtained through correlations.

Assessing the Suitability of a Virtual 'Pink Warrior' for Older Breast Cancer Survivors during COVID-19: A Pilot Study

The COVID-19 pandemic impacted the conduct of in-person physical activity (PA) interventions among older survivors of BC, who need such interventions to stay active and prevent functional decline. We tested the feasibility of virtually delivering an exergame-based PA intervention to older BC survivors. We enrolled 20 female BC survivors ≥55 years and randomly assigned them to two groups. The intervention group (Pink Warrior 2) received 12 weekly virtual exergame sessions with behavioral coaching, survivorship navigation support, and a Fitbit for self-monitoring. The control group received 12 weekly phone-based survivorship discussion sessions and wore a Mi Band 3. Feasibility was evaluated by rates of recruitment (≥0.92 participants/center/month), retention (≥80%), and group attendance (≥10 sessions), percentage of completed virtual assessments, and number of technology-related issues and adverse events. Intervention acceptability was measured by participants' ratings on a scale of 1 (strongly disagree) to 5 (strongly agree). The recruitment rate was 1.93. The retention and attendance rates were 90% and 88% (≥10 sessions), respectively. Ninety-six percent completed virtual assessments without an adverse event. Acceptability was high (≥4). The intervention met benchmarks for feasibility. Additional research is needed to further understand the impact of virtually delivered PA interventions on older BC survivors.

Assessment of Cancer-Associated Cachexia - How to Approach Physical Function Evaluation

PURPOSE OF REVIEW

Cachexia is a devastating syndrome that impacts a majority of cancer patients. Early assessment of cachexia is critical to implementing cachexia treatments. Our aim was to summarize the existing cachexia assessment tools for their utility in both symptom and function evaluation.

RECENT FINDINGS

Several tools now exist that provide a symptom-based approach for evaluating weight change, appetite, and nutrition impact symptoms in cancer patients with cachexia. However, current instruments used to assess physical function changes related to cachexia are limited in depth and breadth. Instead, we recommend a tiered approach to cachexia-related functional assessment that involves evaluation of activities of daily living, general mobility, and exercise tolerance in a prioritized sequence. Current tools for cancer-associated cachexia assessment are adept at symptom evaluation. New approaches to physical function evaluation are needed that efficiently and broadly evaluate the diverse functional needs of cachexia patients.

Test/Retest Reliability and Validity of Remote vs. In-Person Anthropometric and Physical Performance Assessments in Cancer Survivors and Supportive Partners

(1) Background: Anthropometric and physical performance testing is commonly done in lifestyle research and is traditionally performed in-person. To expand the scalability of lifestyle interventions among cancer survivors, in-person assessments were adapted to remote means and evaluated for feasibility, safety, validity, and reliability. (2) Methods: Cancer survivors and supportive partners were approached to participate in three anthropometric and physical performance testing sessions (two remote/one in-person). Correlations, concordance, and differences between testing modes were evaluated. (3) Results: 110-of-112 individuals approached for testing participated (98% uptake); the sample was 78% female, 64% non-Hispanic White, of mean age 58 years and body mass index = 32.4 kg/m2. ICCs for remote assessments ranged from moderate (8' walk = 0.47), to strong (8' get-up-and-go = 0.74), to very strong (30 s chair stand = 0.80; sit-and-reach = 0.86; 2 min step test = 0.87; back scratch = 0.90; weight = 0.93; waist circumference = 0.98) (p-values < 0.001). Perfect concordance (100%) was found for side-by-side and semi-tandem balance, and 87.5-90.3% for tandem balance. No significant differences between remote and in-person assessments were found for weight, 8' walk, and 8' get-up-and-go. No adverse events occurred and 75% indicated no preference or preferred virtual testing to in-person. (4) Conclusions: Remote anthropometric and physical performance assessments are reliable, valid, acceptable, and safe among cancer survivors and supportive partners.