1
|
Siesel CJ, Lee J, Phadnis R, Davlin S, Brevik T, Lea V. Using mobile phone survey paradata for process evaluations and improvements: best practices and lessons learned from nine surveys in seven sites. OXFORD OPEN DIGITAL HEALTH 2025; 3:oqaf003. [PMID: 40230874 PMCID: PMC11932146 DOI: 10.1093/oodh/oqaf003] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/01/2024] [Revised: 11/20/2024] [Accepted: 01/08/2025] [Indexed: 04/16/2025]
Abstract
The use of mobile phone surveys (MPS) for regionally or nationally representative data allows for quick, efficient and affordable data collection for monitoring trends and generating results to guide action. By digitizing this process, data flows can be expanded to include metadata and paradata that allow survey administrators to evaluate and improve survey processes and parameters. Between 2017 and early 2022, the Centers for Disease Control and Prevention provided technical support to country partners to implement MPS gathering indicators on noncommunicable diseases within adult populations in seven countries. These surveys resulted in 37 591 completed interviews containing no personal identifiable information. When combined, these surveys result in over 25 million rows of paradata representing timestamped interactions between the data collection platform and each survey respondent. Using exploratory data analysis, five key metrics were identified which had implications on MPS process optimization: timing of engagement, question randomization, contacts to complete, errors and mode effect. The use of survey paradata allows for real-time process evaluations and identifies factors that can improve efficiency and effectiveness of MPS methods.
Collapse
Affiliation(s)
- Casey J Siesel
- Division of Global Health Protection, Global Health Center, Centers for Disease Control and Prevention, 1600 Clifton Road, Atlanta, GA 30329, USA
| | - Juliette Lee
- Division of Global Health Protection, Global Health Center, Centers for Disease Control and Prevention, 1600 Clifton Road, Atlanta, GA 30329, USA
| | - Rachael Phadnis
- Division of Global Health Protection, Global Health Center, Centers for Disease Control and Prevention, 1600 Clifton Road, Atlanta, GA 30329, USA
- CDC Foundation, 600 Peachtree Street NE, Suite 1000, Atlanta, GA 30308, USA
| | - Stacy Davlin
- Division of Global Health Protection, Global Health Center, Centers for Disease Control and Prevention, 1600 Clifton Road, Atlanta, GA 30329, USA
- CDC Foundation, 600 Peachtree Street NE, Suite 1000, Atlanta, GA 30308, USA
| | - Tobias Brevik
- Alexton, 8210 Cinder Bed Road, Suite 02, Lorton, VA 22079, USA
| | - Veronica Lea
- Division of Global Health Protection, Global Health Center, Centers for Disease Control and Prevention, 1600 Clifton Road, Atlanta, GA 30329, USA
| |
Collapse
|
2
|
Worges M, Ashton RA, Wisniewski J, Hutchinson P, Koenker H, Taylor T, Metcalfe H, Elisaria E, Gitanya MP, Mwalimu CD, Chacky F, Yukich JO. Assessing trends in non-coverage bias in mobile phone surveys for estimating insecticide-treated net coverage: a cross-sectional analysis in Tanzania, 2007-2017. BMJ PUBLIC HEALTH 2025; 3:e001379. [PMID: 40051538 PMCID: PMC11883883 DOI: 10.1136/bmjph-2024-001379] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 07/09/2024] [Accepted: 01/29/2025] [Indexed: 03/09/2025]
Abstract
Introduction Monitoring insecticide-treated net (ITN) coverage and use generally relies on household surveys which occur on a relatively infrequent basis. Because indicators of coverage are used to forecast the need for ITNs and aid in planning ITN distribution campaigns, higher frequency monitoring could be helpful to guide programme strategies. The use of mobile phone-based survey (MPS) strategies in low-income and middle-income countries has emerged as a rapid and comparatively inexpensive complement to large-scale population-based household surveys, considering the dramatic growth trend of mobile phone ownership. Methods The potential for non-coverage bias in the calculation of ITN coverage estimates from MPSs was assessed through the use of five consecutive Tanzania-specific Demographic and Health Surveys (DHS). Primary comparisons were made between all households included in the data sets (the reference standard) and mobile phone-owning households (the comparator). Deviations in ITN coverage estimates between the reference standard and mobile phone-owning households were used as a proxy for assessing potential non-coverage bias, with estimates calculated using a bootstrap method. Results By the 2017 DHS, regional measures of non-coverage bias for ITN coverage indicators rarely exceeded a ±3 percentage point difference when comparing mobile phone-owning households to the overall sample. However, larger differences were observed when comparing mobile phone-owning households to non-mobile phone-owning households, particularly in periods without recent mass ITN distributions. Conclusion Results suggest that MPSs can reliably estimate ITN coverage at the population level when both ITN coverage and mobile phone ownership are high. However, as ITN coverage declines, the gap between phone-owning and non-phone-owning households widens, indicating potential non-coverage bias and underscoring the need for caution in interpreting MPS data under such conditions.
Collapse
Affiliation(s)
- Matt Worges
- Tropical Health, New Orleans, Louisiana, USA
| | - Ruth A Ashton
- Tulane University School of Public Health and Tropical Medicine, New Orleans, Louisiana, USA
| | - Janna Wisniewski
- Tulane University School of Public Health and Tropical Medicine, New Orleans, Louisiana, USA
| | - Paul Hutchinson
- Tulane University School of Public Health and Tropical Medicine, New Orleans, Louisiana, USA
| | | | - Tory Taylor
- The University of North Carolina, Carolina Population Center, Chapel Hill, North Carolina, USA
| | | | - Ester Elisaria
- Department of Impact Evaluation, Ifakara Health Institute, Ifakara, Dar es Salaam, Tanzania, United Republic of
| | - Mponeja P Gitanya
- National Malaria Control Program, Ministry of Health, Dodoma, Tanzania, United Republic of
| | - Charles Dismas Mwalimu
- National Malaria Control Program, Ministry of Health, Dodoma, Tanzania, United Republic of
| | - Frank Chacky
- National Malaria Control Program, Ministry of Health, Dodoma, Tanzania, United Republic of
| | - Joshua O Yukich
- Tulane University School of Public Health and Tropical Medicine, New Orleans, Louisiana, USA
| |
Collapse
|
3
|
Brønnum-Hansen H. Continued increasing social inequality in mortality in Denmark - a nationwide register-based follow-up on previous mortality studies. Scand J Public Health 2024:14034948241302921. [PMID: 39658549 DOI: 10.1177/14034948241302921] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/12/2024]
Abstract
OBJECTIVE Social inequality in mortality has increased in many countries worldwide and does not appear to be levelling off. Denmark is no exception, and the latest developments are presented in this short communication. METHODS Trends in life expectancy and changes in the shape of the age-at-death distribution are calculated from nationwide register data on income and education linked to mortality data. RESULTS Since 1987, the difference in life expectancy between the lowest and highest income quartiles has increased by 5.4 years for men and by 2.0 years for women. The difference in life expectancy (at age 30) between education groups has also increased. The latest developments indicate a decline in life expectancy for men and women in the lowest income quartile and with the shortest education. CONCLUSIONS Reducing social inequality in health and mortality has been on the agenda for successive Danish governments for more than 20 years, but social inequality in life expectancy is still increasing.
Collapse
Affiliation(s)
- Henrik Brønnum-Hansen
- Faculty of Health and Medical Sciences, Department of Public Health, University of Copenhagen, Denmark
| |
Collapse
|
4
|
Vecino-Ortiz AI, Guzman-Tordecilla DN, Maniar V, Agudelo-Londoño S, Franco-Suarez O, Aya Pastrana N, Rodríguez-Patarroyo M, Mejía-Rocha M, Cardona J, Chavez Chamorro M, Gibson D. Mobile Phone Syndromic Surveillance for Respiratory Conditions in an Emergency (COVID-19) Context in Colombia: Representative Survey Design. J Med Internet Res 2024; 26:e50184. [PMID: 39418077 PMCID: PMC11528172 DOI: 10.2196/50184] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/22/2023] [Revised: 03/03/2024] [Accepted: 03/08/2024] [Indexed: 10/19/2024] Open
Abstract
BACKGROUND Syndromic surveillance for respiratory infections such as COVID-19 is a crucial part of the public health surveillance toolkit as it allows decision makers to detect and prepare for new waves of the disease in advance. However, it is labor-intensive, costly, and increases exposure to survey personnel. This study assesses the feasibility of conducting a mobile phone-based respiratory syndromic surveillance program in a middle-income country during a public health emergency, providing data to support the inclusion of this method in the standard infection control protocols at the population level. OBJECTIVE This study aims to assess the feasibility of a national active syndromic surveillance system for COVID-19 disease in Colombia. METHODS In total, 2 pilots of syndromic mobile phone surveys (MPSs) were deployed using interactive voice response technology in Colombia (367 complete surveys in March 2022 and 451 complete surveys in April and May 2022). Respondents aged 18 years and older were sampled using random digit dialing, and after obtaining consent, they were sent a 10-minute survey with modules on sociodemographic status, respiratory symptoms, past exposure to COVID-19 infection and vaccination status, preferences about COVID-19 vaccination, and information source for COVID-19. Pilot 1 used a nationally representative sample while pilot 2 used quota sampling to yield representative results at the regional level. In this work, we assessed the performance characteristics of the survey pilots and compared the demographic information collected with a nationally representative household survey. RESULTS For both pilots, contact rates were between 1% and 2%, while participation rates were above 80%. The results revealed that younger, female, and higher educated participants were more likely to participate in the syndromic survey. Survey rates as well as demographics, COVID-19 vaccination status, and prevalence of respiratory symptoms are reported for both pilots. We found that respondents of the MPSs are more likely to be younger and female. CONCLUSIONS In a COVID-19 pandemic setting, using an interactive voice response MPS to conduct syndromic surveillance may be a transformational, low-risk, and feasible method to detect outbreaks. This evaluation expects to provide a path forward to the inclusion of MPSs as a traditional surveillance method.
Collapse
Affiliation(s)
- Andres I Vecino-Ortiz
- Health Systems Program, International Health Department, Johns Hopkins Bloomberg School of Public Health, Baltimore, MD, United States
| | - Deivis Nicolas Guzman-Tordecilla
- Health Systems Program, International Health Department, Johns Hopkins Bloomberg School of Public Health, Baltimore, MD, United States
| | - Vidhi Maniar
- Health Systems Program, International Health Department, Johns Hopkins Bloomberg School of Public Health, Baltimore, MD, United States
| | | | | | | | | | | | | | | | - Dustin Gibson
- Health Systems Program, International Health Department, Johns Hopkins Bloomberg School of Public Health, Baltimore, MD, United States
| |
Collapse
|
5
|
Aya Pastrana N, Agudelo-Londoño S, Franco-Suarez O, Otero Machuca J, Guzman-Tordecilla DN, López Sánchez MC, Rodriguez-Patarroyo M, Rivera-Sánchez CA, Castro-Barbudo D, Trujillo AJ, Maniar V, Vecino-Ortiz AI. Improving COVID-19 vaccine uptake: a message co-design process for a national mHealth intervention in Colombia. Glob Health Action 2023; 16:2242670. [PMID: 37643136 PMCID: PMC10467523 DOI: 10.1080/16549716.2023.2242670] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/29/2022] [Accepted: 07/23/2023] [Indexed: 08/31/2023] Open
Abstract
BACKGROUND COVID-19 vaccination is a global priority. Latin American countries have some of the highest COVID-19 death rates worldwide with vaccination hampered by a variety of reasons, including mis- and disinformation, vaccine hesitancy, and vaccine supply constraints. Addressing vaccine hesitancy through effective messages has been found to help increase vaccine uptake. Participatory processes could be used to co-design health messages for this purpose. OBJECTIVE This article describes the methodology used to co-design evidence-based audio messages to be deployed in a cohort of individuals through an interactive voice response (IVR) mobile phone survey intervention, aimed towards increasing vaccination uptake in an adult population in Colombia. METHODS Participants of the COVID-19 vaccination message co-design process included a sample of the general population of the country, representatives of the funder organisation, and research team members. The co-design process consisted of four phases: (1) formative quantitative and qualitative research, (2) message drafting based on the results of the formative research, (3) message content evaluation, and (4) evaluation of the voices to deliver the audio messages; and was informed by reflexive meetings. RESULTS Three categories of evidence-based audio messages were co-designed, each corresponding to an arm of the mHealth intervention: (1) factual messages, (2) narrative messages, and (3) mixed messages. An additional fourth arm with no message was proposed for control. The iterative co-design process ended with a total of 14 audio messages recorded to be deployed via the intervention. CONCLUSIONS Co-developing health messages in response to health emergencies is possible. Adopting more context-relevant, participatory, people-centred, and reflexive multidisciplinary approaches could help develop solutions that are more responsive to the needs of populations and public health priorities. Investing resources in message co-design is deemed to have a greater potential for influencing behaviours and improving health outcomes.
Collapse
Affiliation(s)
- Nathaly Aya Pastrana
- IMEK Centro de Investigación en Mercadeo & Desarrollo, Santiago de Cali, Colombia
- Instituto de Salud Pública, Pontificia Universidad Javeriana, Bogotá, Colombia
| | | | - Oscar Franco-Suarez
- Instituto de Salud Pública, Pontificia Universidad Javeriana, Bogotá, Colombia
| | - Jessica Otero Machuca
- Instituto de Salud Pública, Pontificia Universidad Javeriana, Bogotá, Colombia
- Health Behavior, Gillings School of Global Public Health, University of North Carolina at Chapel Hill, Chapel Hill, NC, USA
| | | | | | | | | | | | - Antonio J. Trujillo
- Department of International Health, Johns Hopkins Bloomberg School of Public Health, Baltimore, MD, USA
| | - Vidhi Maniar
- Department of International Health, Johns Hopkins Bloomberg School of Public Health, Baltimore, MD, USA
| | - Andres I. Vecino-Ortiz
- Department of International Health, Johns Hopkins Bloomberg School of Public Health, Baltimore, MD, USA
| |
Collapse
|
6
|
Sartorao Filho CI, Sartorao Neto CI, Sartorao ALV, Terribile DC, Mello R, Mello BB, Zoqui MC, Duarte DO, Cachoni LEG, Bisseto VCQ, Ribeiro EAC. Using mobile phone-based text message to recruit representative samples: Assessment of a cross-sectional survey about the COVID-19 vaccine hesitation. Int J Med Inform 2022; 165:104832. [PMID: 35842978 PMCID: PMC9278996 DOI: 10.1016/j.ijmedinf.2022.104832] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/17/2022] [Revised: 06/30/2022] [Accepted: 07/09/2022] [Indexed: 11/29/2022]
Abstract
BACKGROUND Limited research has examined mobile phone-based platforms for survey recruitment, especially during the COVID-19 pandemic in Brazil. Our objective was to investigate the feasibility and representativeness of mobile phone-based advertisement during a preliminary study about COVID-19 vaccine hesitation in Brazil. Moreover, we evaluate whether the older population can be reached through mobile phone-based platforms of the survey. METHODS We conducted a study in December 2021 based on a preliminary survey about the COVID-19 vaccine hesitation in Assis, Brazil, Sao Paulo state. From a list of the adult population hesitant about the second dose of the COVID-19 vaccine, we sent a mobile phone-based advertisement inviting the participants to answer the survey for one week. The respondent's data were collected in a Google form platform. The comparison between the target population and the respondents was made using the Chi-squared test and the Welch's test, using a P-value of 0.05 as significative. RESULTS The response rate was 9.99% after one week. The mean age of the respondent group was 33.97 (SD 14.99) and 35.05 (SD 14.19) of the population, with a P-value of 0.192 and a Cohen's d coefficient of 0.0754, corresponding to a small effect size between groups. We demonstrate that the mobile phone-based survey is a feasible and representative strategy during the pandemics in Brazil. Moreover, the older population respondent was representative. CONCLUSION We achieved a representative sample of respondents using the mobile phone-based survey in Brazil. Furthermore, it was representative of all sociodemographic and health characteristics assessed. Finally, these findings suggest that the method is a highly feasible and economical means of recruiting for survey research.
Collapse
Affiliation(s)
- C I Sartorao Filho
- Educational Foundation of the Municipality of Assis, Faculty of Medicine, Brazil; Sao Paulo Medical Association, Brazil; Sao Paulo State University - Botucatu Medical School, Brazil.
| | | | - A L V Sartorao
- Educational Foundation of the Municipality of Assis, Faculty of Medicine, Brazil
| | - D C Terribile
- Educational Foundation of the Municipality of Assis, Faculty of Medicine, Brazil
| | - R Mello
- Sao Paulo Medical Association, Brazil
| | - B B Mello
- Educational Foundation of the Municipality of Assis, Faculty of Medicine, Brazil
| | - M C Zoqui
- Educational Foundation of the Municipality of Assis, Faculty of Medicine, Brazil
| | - D O Duarte
- Educational Foundation of the Municipality of Assis, Faculty of Medicine, Brazil
| | - L E G Cachoni
- Educational Foundation of the Municipality of Assis, Faculty of Medicine, Brazil
| | - V C Q Bisseto
- Educational Foundation of the Municipality of Assis, Faculty of Medicine, Brazil
| | - E A C Ribeiro
- Educational Foundation of the Municipality of Assis, Faculty of Medicine, Brazil
| |
Collapse
|
7
|
Li Y, Wang Z, You W, Liu X. Core self-evaluation, mental health and mobile phone dependence in Chinese high school students: why should we care. Ital J Pediatr 2022; 48:28. [PMID: 35164819 PMCID: PMC8842945 DOI: 10.1186/s13052-022-01217-6] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/07/2021] [Accepted: 01/18/2022] [Indexed: 11/24/2022] Open
Abstract
Background Mobile phone dependence is a common problem in the population of high school students. We aimed to evaluate the core self-evaluation, mental health and mobile phone dependence in Chinese high school students, to provide reliable evidence to the support of high school students. Methods We conducted a survey of high school students in Xiamen, China. The self-assessment questionnaire on mobile phone use dependence among teenagers (SQAPMPU), Mental Health Scale for Middle School Students (MSSMHS) and Core self-evaluation scale were used to evaluate the mobile phone dependence, mental health and core self-evaluation. t-tests, Pearson correlation and multiple linear stepwise regression analyses were conducted to analyze the potential relationships. Results A total of 1692 students were enrolled. The total score of mobile phone dependence of students in grades 10–12 was higher than that of students in grades 7–9. A total of 329 students in grades 7–9 and 371 students in grades 10–12 had abnormal mental status. The detection rate of psychological abnormalities among students in grades 10–12 was higher than that of students in grades 10–12. Core self-evaluation had significantly negative correlation with various factors of mental health (P < 0.01). The worse the mental health, the higher the degree of mobile phone dependence, core self-evaluation played a mediating role between mental health and mobile phone dependence (8.03%). Conclusions Core self-evaluation is an important factor affecting the mental health of high school students and mobile phone dependence. Educators should strengthen core self-evaluation of high school students to improve the mental health and reduce the mobile phone dependence.
Collapse
|