Opportunities and Challenges of Web-Based and Remotely Administered Surveys for Patient Preference Studies in a Vulnerable Population

Willingness of people with type 2 diabetes to engage in healthy eating, physical activity and medication taking

AIM

To assess the willingness of people with type 2 diabetes (T2D) to engage in healthy eating, physical activity and medication taking, and explore associated patient factors.

METHODS

Online survey among recently diagnosed T2D patients recruited in the Netherlands and the United Kingdom (UK). Patient factors included general factors and behaviour-specific beliefs. Logistic regression analyses and explorative comparisons were conducted.

RESULTS

Overall, 48% of 67 patients were willing to engage in all three management options, whereas 6% were not willing to follow any of them. 73% were willing to manage T2D with healthy eating, 73% with physical activity, and 72% with medication. Country of recruitment was significantly associated with willingness for healthy eating, with higher willingness among Dutch participants. Beliefs surrounding capability, opportunity, and motivation were significantly associated with willingness to engage in physical activity and medication taking. Many beliefs were similar regardless of willingness but those willing to engage in physical activity perceived less barriers and those willing to take medication had more positive and less negative outcome beliefs than those not willing.

CONCLUSIONS

Willingness to engage in all management options was limited among recently diagnosed patients, and partly associated with behaviour-specific patient beliefs.

An Overview of Data Collection in Health Preference Research

This paper focuses on survey administration and data collection methods employed for stated-preference studies in health applications. First, it describes different types of survey administration methods, encompassing web-based surveys, face-to-face (in-person) surveys, and mail surveys. Second, the concept of sampling frames is introduced, clarifying distinctions between the target population and survey frame population. The discussion then extends to different types of sampling methods, such as probability and non-probability sampling, along with an evaluation of potential issues associated with different sampling methods within the context of health preference research. Third, the paper provides information about different recruitment methods, including web-surveys, leveraging patient groups, and in-clinic recruitment. Fourth, a crucial aspect addressed is the calculation of response rate, with insights into determining an adequate response rate and strategies to improve response rates in stated-preference surveys. Lastly, the paper concludes by discussing data management plans and suggesting insights for future research in this field. In summary, this paper examines the nuanced aspects of survey administration and data collection methods in stated-preference studies, offering valuable guidance for researchers and practitioners in the health domain.

Comparing Discrete Choice Experiment with Swing Weighting to Estimate Attribute Relative Importance: A Case Study in Lung Cancer Patient Preferences

INTRODUCTION

Discrete choice experiments (DCE) are commonly used to elicit patient preferences and to determine the relative importance of attributes but can be complex and costly to administer. Simpler methods that measure relative importance exist, such as swing weighting with direct rating (SW-DR), but there is little empirical evidence comparing the two. This study aimed to directly compare attribute relative importance rankings and weights elicited using a DCE and SW-DR.

METHODS

A total of 307 patients with non-small-cell lung cancer in Italy and Belgium completed an online survey assessing preferences for cancer treatment using DCE and SW-DR. The relative importance of the attributes was determined using a random parameter logit model for the DCE and rank order centroid method (ROC) for SW-DR. Differences in relative importance ranking and weights between the methods were assessed using Cohen's weighted kappa and Dirichlet regression. Feedback on ease of understanding and answering the 2 tasks was also collected.

RESULTS

Most respondents (>65%) found both tasks (very) easy to understand and answer. The same attribute, survival, was ranked most important irrespective of the methods applied. The overall ranking of the attributes on an aggregate level differed significantly between DCE and SW-ROC (P < 0.01). Greater differences in attribute weights between attributes were reported in DCE compared with SW-DR (P < 0.01). Agreement between the individual-level attribute ranking across methods was moderate (weighted Kappa 0.53-0.55).

CONCLUSION

Significant differences in attribute importance between DCE and SW-DR were found. Respondents reported both methods being relatively easy to understand and answer. Further studies confirming these findings are warranted. Such studies will help to provide accurate guidance for methods selection when studying relative attribute importance across a wide array of preference-relevant decisions.

HIGHLIGHTS

Both DCEs and SW tasks can be used to determine attribute relative importance rankings and weights; however, little evidence exists empirically comparing these methods in terms of outcomes or respondent usability.Most respondents found the DCE and SW tasks very easy or easy to understand and answer.A direct comparison of DCE and SW found significant differences in attribute importance rankings and weights as well as a greater spread in the DCE-derived attribute relative importance weights.

A videoconferencing verification method for enrollment of breastfeeding dyads to an online prospective mixed methods study during the COVID-19 pandemic

AIMS

To apply videoconferencing as a new verification method prior to enrollment for an online survey-based study.

DESIGN

A prospective-observational, mixed methods, three group, repeated measures study involved recruiting a population-based sample of breastfeeding mothers and infants (N = 81). Twenty-seven mothers were recruited for each group: mothers returning to work outside of the home, mothers returning to work from home and mothers staying home with their infants full-time.

METHODS

Data were collected at four time points, infant age 4, 12, 20 and 24 weeks, via online survey. Participating mothers received a $10 gift card for completing each survey. Social media, word of mouth and brochures promoted United States-based recruitment nationwide. A publicly available direct link to the survey was initially provided to interested mothers. After the suspicion of online fraud, videoconferencing was instituted for self-referrals and phone calls for professional referrals.

RESULTS

The survey was invaded by response fraud 3 weeks after the initial survey deployment. Out of 109 respondents who visited the survey site during that timeframe, only eight mothers (10%) were eligible (22 June 2022 to 14 July 2022). After recruitment modification, 313 individuals emailed the study team with 65 self-referred mothers (80%) enrolled in the study via videoconferencing while eight mothers (10%) had a professional referral and enrolled via phone call (23 August 2022 to 30 March 2023).

CONCLUSION

Providing a direct survey link, even with CAPTCHA-protection, evoked fraudulent responses. Videoconferencing is an emerging verification method that can be readily applied to the enrollment of breastfeeding dyads for an online study.

IMPACT

The emergence of fraudulent respondents and internet bots threatens data quality. This study addressed the strategy of videoconferencing as a new verification method for recruitment and enrollment of breastfeeding dyads. This knowledge can be applied by researchers to secure sample validity and data integrity.

Balancing benefits and risks in lung cancer therapies: patient preferences for lung cancer treatment alternatives

Background

In the treatment of Non-Small Cell Lung Cancer (NSCLC) the combination of Immuno- Oncotherapy (IO) and chemotherapy (CT) has been found to be superior to IO or CT alone for patients' survival. Patients and clinicians are confronted with a preference sensitive choice between a more aggressive treatment with a greater negative effect on quality of life versus alternatives that are less effective but have fewer side effects.

Objectives

The aims of this study were to: (a) quantify patients' preferences for relevant attributes related to Immuno-Oncotherapy treatment alternatives, and (b) evaluate the maximum acceptable risk (MAR)/Minimum acceptable benefit (MAB) that patients would accept for treatment alternatives.

Methods

An online preference survey using discrete-choice experiment (DCE) was completed by NSCLC patients from two hospitals in Italy and Belgium. The survey asked patients' preferences for five patient- relevant treatment attributes. The DCE was developed using a Bayesian D-efficient design. DCE analyses were performed using mixed logit models. Information regarding patient demographics, health literacy, locus of control, and quality of life was also collected.

Results

307 patients (158 Italian, 149 Belgian), stage I to IV, completed the survey. Patients preferred treatments with a higher 5-year survival chance as the most important attribute over all the other attributes. Preference heterogeneity for the attribute weights depended on health literacy, patients' age and locus of control. Patients were willing to accept a substantially increased risks of developing side effects in exchange for the slightest increase (1%) in the chance of surviving at least 5 years from the diagnosis of cancer. Similarly, patients were willing to accept a switch in the mode of administration or complete loss of hair to obtain an increase in survival.

Conclusion

In this study, the proportion of respondents who systematically preferred survival over all other treatment attributes was particularly high. Age, objective health literacy and locus of control accounted for heterogeneity in patients' preferences. Evidence on how NSCLC patients trade between survival and other NSCLC attributes can support regulators and other stakeholders on assessing clinical trial evidence and protocols, based on patients' conditions and socio-demographic parameters.

Development of Japanese Cancer Intelligence Quotient to Measure Cancer Literacy and Knowledge among Japanese Laypersons

INTRODUCTION

Health literacy has been identified an essential factor in leading a healthy lifestyle. Because some cancer prevention and screening methods have been established, we believe that identifying disadvantaged populations with low literacy regarding cancer is crucial. Thus, in this study, we aim to create a self-administered cancer-specific health literacy scale to be administered to Japanese laypersons.

METHODS

Using definitions from previous studies, we constructed a scale named the Japanese Cancer Intelligence Quotient (JCIQ) for both literacy (JCIQ-L) and knowledge (JCIQ-K) aspects. We generated potential items for both aspects, extracted appropriate ones using two-step online surveys, and compared the JCIQ and cancer-preventive behaviors and cancer-screening intentions, both of which we set as alternative indicators of the right attitude and practice toward cancer by performing a multiple regression analysis from another web survey.

RESULTS

Between April and May 2020, we conducted three-step surveys online. After conducting the two-step surveys for thousands of people, we extracted 12 literacy questions and 22 knowledge questions using factor analysis and the correct answer ratio of every item. In the final investigation of 3,094 people, a multiple regression analysis found that the JCIQ-L and JCIQ-K were significant factors in terms of predicting both behaviors (JCIQ-L:β = 0.07, p < 0.001, JCIQ-K:β = 0.05, p < 0.01) and willingness (JCIQ-L:β = 0.04, p < 0.05, JCIQ-K:β = 0.17, p < 0.001) after adjusting for participant characteristics (e.g., gender, age, income level, employment status).

CONCLUSIONS

We developed the first reliable scale for measuring cancer literacy and knowledge of Japanese laypersons.