Data Quality and Cost-effectiveness Analyses of Electronic and Paper-Based Interviewer-Administered Public Health Surveys: Systematic Review

Exploring the Patients' Perspective on Digital Tools for Psychosocial Assessment in Dentistry

BACKGROUND

Psychosocial screening is a valuable part of the assessment of patients with orofacial pain, as psychosocial factors will affect prognosis and treatment outcomes. Paper-based questionnaires are predominately used to assess the degree of psychosocial comorbidity; however, digital alternatives for screening questionnaires may be more cost-effective and resource-saving if patients are receptive to using them.

OBJECTIVE

To evaluate how patients perceive digital psychosocial screening in dentistry.

METHOD

Using a qualitative approach, individual semi-structured interviews were conducted with a purposive sample of adult patients with orofacial pain (n = 16) recruited from specialist dental clinics in Umeå and Gävle, Sweden. The interviews were transcribed verbatim and then analysed using Qualitative Content Analysis. Before the interviews, patients first completed the paper-based questionnaires and then the digital version.

RESULTS

The analysis of patients' experiences resulted in an overarching theme: Patients appreciate a holistic approach, thus valuing psychosocial screening, and they particularly favour screening in a digital format. From this theme, two categories emerged: Perceptions about health shape patients' expectations of dental care, and with deeper understanding of the value of psychosocial assessment, patients appreciate a holistic approach that includes psychosocial factors. Digital screening is perceived by patients as a reliable, meaningful and environmentally sustainable method.

CONCLUSIONS

In general, the patients appreciated a holistic approach in dentistry and understood the value of psychosocial screening as part of this. From the patients' perspective, digital psychosocial screening was both acceptable and beneficial. The findings support the introduction of digital psychosocial screening into daily dental practice.

Piloting Market Food Environment Assessments in LMICs: A Feasibility Assessment and Lessons Learned

BACKGROUND

Food environments are rapidly changing in low- and middle-income countries (LMICs), leading to dietary shifts. Many gaps exist in the measurement of food environments in LMICs making it difficult to characterize the linkages between food environments and diets.

OBJECTIVE

The objective of this study was to examine the feasibility of implementing USAID Advancing Nutrition's Market Food Environment Assessment (MFEA)-a suite of 7 non-resource intensive food environment assessments.

METHODS

We implemented the MFEA package in 4 countries (Liberia, Honduras, Nigeria, and Timor-Leste) and assessed the feasibility of implementing the package by conducting a descriptive analysis, using both qualitative and quantitative data of enumerators' feedback collected through training evaluations, feedback forms, detailed notes from meetings, and final reports from in-country partners.

RESULTS

Overall, we found it feasible to implement the MFEA, some assessments being easier to implement and more practical than others. Several key themes related to the MFEA implementation were identified across the countries, including: the potential for vendors to be hesitant to engage in assessments; the importance of ascertaining buy-in from local officials; the need to shift toward electronic, rather than paper-based, data collection; difficulties in selecting markets; the time constraints of conducting some of the assessments; and the need for better alignment between the instructions, data collection, and data analysis sheets.

CONCLUSIONS

The package of food environment assessments, with minimal additional refinement, can be used to characterize market food environments in LMIC settings to inform context-specific interventions.

Testing the feasibility of implementing a package of 7 assessments to measure factors influencing food access in low-resource settings.

Is the online 'creating healthy eating and active environments survey' (CHEERS) tool reliable for early childhood educators in Alberta, Canada: a randomized crossover trial

BACKGROUND

The creating healthy eating and active environments survey (CHEERS) is an audit tool used to assess the nutrition and physical activity environment in early childhood education and care (ECEC) centres. Availability of the tool has been limited to paper-based versions. Digital health initiatives offer improved reach and immediacy of support for community-based clients through novel technology products. In order to provide increased access to the CHEERS tool, an online version was developed. The objective of this study was to assess the reliability of an online version of CHEERS.

METHODS

Utilizing a randomized crossover design, ECEC educators completed either a paper-based or online-based survey and then the opposite mode with a two to three-week interval. The intraclass correlation coefficient (ICC, with 95% confidence interval) was used to determine the reliability between test and retest. Absolute index of reliability in the original measurement was assessed through the standard error of measurement (SEM = SD × √1-ICC). The smallest amount of change not due to inherent variation was assessed by determining minimal detectable change at the 95% confidence level (MDC₉₅ = SEM × 1.96 ×√2; MDC₉₅% = MDC₉₅/mean ×100).

RESULTS

Test-retest reliability was good to excellent for the online-based CHEERS total score (ICC = 0.86) and for each of the four subscales: food served (ICC = 0.82), healthy eating environment (ICC = 0.76), program planning (ICC = 0.76), and physical activity environment (ICC = 0.79). The SEM, MDC_95, and MDC₉₅% for the CHEERS overall score were 0.79, 2.19, and 9.6%, respectively.

CONCLUSIONS

The results of this study demonstrate that the online-based and paper-based versions of the CHEERS audit tool share comparable accuracy. The CHEERS tool can be reliably implemented in an online environment and this provides users an alternative means to complete the centre-based health assessment. The advantage of the online-based version includes user accessibility and the potential to develop a feedback response for participants using digitally collected data.

Considerations for conducting and reporting digitally supported cognitive interviews with children and adults

BACKGROUND

Cognitive interviewing is a well-established qualitative method used to develop and refine PRO measures. A range of digital technologies including phone, web conferencing, and electronic survey platforms can be leveraged to support the conduct of cognitive interviewing in both children and adults. These technologies offer a potential solution to enrolling underrepresented populations, including those with rare conditions, functional limitations and geographic or socioeconomic barriers. In the aftermath of the COVID-19 pandemic, the use of digital technologies for qualitative interviewing will remain essential. However, there is limited guidance about adapting cognitive interviewing procedures to allow for remote data capture, especially with children.

METHODS

Synthesizing the literature and our research experiences during the COVID-19 pandemic, we examine considerations for implementing digitally supported cognitive interviews with children, adolescents, and adults. We offer recommendations to optimize data quality and empirical rigor and illustrate the application of these recommendations in an ongoing cognitive interviewing study to develop and refine a new pediatric PRO measure.

RESULTS

Good research practices must address participant and researcher preparation for study-related procedures and should anticipate and pre-emptively manage technological barriers. Field notes should detail interview context, audio/video cues, and any impact of technological difficulties on data quality. The approaches we recommend have been tested in an ongoing cognitive interviewing study that is enrolling children/adolescents with cGVHD ages 5-17 and their caregivers [NCT04044365]. The combined use of telephone and videoconferencing to conduct cognitive interviews remotely is feasible and acceptable and yields meaningful data to improve the content validity of our new PRO measure of cGVHD symptom bother.

CONCLUSION

Digitally supported cognitive interviewing procedures will be increasingly employed. Remote data collection can accelerate accrual, particularly in multi-site studies, and may allow for interviewer personnel and data management to be centralized within a coordinating center, thus conserving resources. Research is needed to further test and refine techniques for remote cognitive interviewing, particularly in traditionally underrepresented populations, including children and non-English speakers. Expansion of international standards to address digitally supported remote qualitative data capture appears warranted.

Body mass index and physical activity in seven-year-old children whose mothers exercised during pregnancy: follow-up of a multicentre randomised controlled trial

BACKGROUND

There are limited data on long-term outcomes of children whose mothers have followed exercise interventions during pregnancy. The aim of this paper was to investigate whether regular moderate intensity exercise during pregnancy affected the children's body mass index (BMI) and physical activity (PA) at 7 years of age, and determine the relationship between children's and mothers' BMI and PA.

METHODS

This was a follow-up of a multicentre randomised controlled trial, carried out at St. Olavs Hospital, Trondheim University Hospital, and Stavanger University Hospital, Norway (2007-2009 and 2014-2016). Women were randomised to follow a 12-week structured exercise protocol or standard antenatal care during pregnancy. At the 7-year follow-up, parents reported their child's height, weight, and PA. The mothers also reported their own weight and PA. Main outcome variables were BMI, frequency and duration of moderate to vigorous PA (MVPA), and intensity of PA.

RESULTS

A total of 855 women were randomised to exercise (n = 429) or standard antenatal care (n = 426) during pregnancy. At follow-up, 164 (38.2%) children and mothers in the intervention group and 117 (27.5%) in the control group participated. We found no group differences in the children's iso-BMI or PA. Findings were similar when we performed stratified analyses by sex, except boys in the control group spent more time on electrical devices than boys in the intervention group. Subgroup analyses of children of mothers who adhered to the exercise protocol and sensitivity analyses excluding children born preterm, children admitted to the neonatal intensive care unit, and children with diseases or health problems at the 7-year follow-up, did not change the results. Children's BMI, weekly leisure time MVPA and intensity of PA correlated with mothers' BMI, daily exercise, and intensity of exercise.

CONCLUSIONS

Regular moderate intensity exercise during pregnancy did not affect BMI or PA of the children at 7 years. Good maternal health should be encouraged as it may influence the health of the next generation.

TRIAL REGISTRATION

The initial RCT study was registered in ClinicalTrials.gov NCT00476567 .