Is the European Health Interview Survey online yet? Response and net sample composition of a web-based data collection

Opportunities for a population-based cohort in Belgium

Population-based cohorts allow providing answers to a wide range of policy-relevant research questions. In Belgium, existing cohort-like initiatives are limited by their focus on specific population groups or specific topics, or they lack a true longitudinal design. Since 2016, consultations and deliberative processes have been set up to explore the opportunities for a population-based cohort in Belgium. Through these processes, several recommendations emerged to pave the way forward – i.e., to facilitate the establishment of administrative linkages, increase digitalisation, secure long-term financial and organisational efforts, establish a consortium of the willing, and identify and tackle ethical and legal bottlenecks. This comment summarizes these recommendations, as these opportunities should be explored in depth to consolidate the existing collaborations between different stakeholders, and refers to current initiatives that can further facilitate the establishment of a Belgian population-based cohort and, more generally, administrative and health data linkage and reuse for research and policy-making.

Organizing the health interview survey at the local level: design of a pilot study

Background

The local Health Interview Study (LHIS) was developed to gain health information at the level of the municipality in Flanders, the northern part of Belgium. It enables municipalities to make evidence-based decisions in their public health policy. To test the feasibility of implementing the LHIS, a pilot study was conducted in Melle, a small Flemish municipality with 11.736 inhabitants.

Methods

The target sample size was 1000 (≥ 15 years). A systematic sampling technique was applied with substitutes for non-respondents who were matched in terms of statistical sector, age and sex. Selected persons were contacted by post to complete the questionnaire and in case of non-response, a reminder was sent. Questionnaires were collected using a concurrent mixed-mode design: a paper and pencil, and web option. All questions were selected from the Belgian Health Interview Survey relating to health status and determinants of health.

Results

One thousand twenty-two questionnaires were obtained after inviting 3137 individuals (response rate = 32.6%). Older adults were more likely to participate than younger adults, and women more than men. The final sample resembled the initial sample in terms of sex and statistical sector, but not in terms of age. Younger adults were underrepresented whereas older adults were overrepresented. Lastly, older adults were more likely to fill in the questionnaire on paper than younger adults, and women more than men.

Conclusion

The LHIS can be successfully implemented in Flemish municipalities. The method, however, does not guarantee that the composition of the final sample reflects the initial sample. Therefore, weights should be added in the analyses to correct for potential deviations in sample composition. Furthermore, implementing a sequential mixed-mode design with a web option preceding a paper and pencil option in future studies could reduce costs and improve data quality.

Supplementary Information

The online version contains supplementary material available at 10.1186/s13690-022-00909-z.

How can a joint European health technology assessment provide an 'additional benefit' over the current standard of national assessments? : Insights generated from a multi-stakeholder survey in hematology/oncology

OBJECTIVES

We conducted a multi-stakeholder survey to determine key areas where a joint European health technology assessment (HTA) could provide 'additional benefit' compared to the status quo of many parallel independent national and subnational assessments.

METHODS

Leveraging three iterative Delphi cycles, a semiquantitative questionnaire was developed covering evidence challenges and heterogeneity of value drivers within HTAs across Europe with a focus on hematology/oncology. The questionnaire consisted of five sections: i) background information; ii) value drivers in HTA assessments today; iii) evolving evidence challenges; iv) heterogeneity of value drivers across Europe; v) impact of Europe's Beating Cancer Plan (EBCP). The questionnaire was circulated across n = 189 stakeholder institutions comprising HTA and regulatory bodies, clinical oncology associations, patient representatives, and industry associations.

RESULTS

N = 30 responses were received (HTA bodies: 9; regulators: 10; patients' and physicians' associations: 3 each; industry: 5). Overall, 17 countries and EU level institutions were represented in the responses. Consistency across countries and stakeholder groups was high. Most relevant value drivers in HTAs today (scale 1, low to 5, high) were clinical trial design (mean 4.45), right endpoints (mean 4.40), and size of comparative effect (mean 4.33). Small patient numbers (mean 4.28) and innovative study designs (mean 4.1) were considered the most relevant evolving evidence challenges. Heterogeneity between regulatory and HTA evidence requirements and heterogeneity of the various national treatment standards and national HTA evidence requirements was high. All clinical and patient participants stated to have been with EBCP initiatives.

CONCLUSIONS

For a European HTA to provide an 'additional benefit' over the multitude of existing national assessments key methodological and process challenges need to be addressed. These include approaches to address uncertainty in clinical development; comparator choice; consistency in approaching patient-relevant endpoints; and a transparent and consistent management of both HTA and regulatory procedures as well as their interface, including all involved stakeholder groups.

Unit Response and Costs in Web Versus Face-To-Face Data Collection: Comparison of Two Cross-sectional Health Surveys

Background

Potential is seen in web data collection for population health surveys due to its combined cost-effectiveness, implementation ease, and increased internet penetration. Nonetheless, web modes may lead to lower and more selective unit response than traditional modes, and this may increase bias in the measured indicators.

Objective

This research assesses the unit response and costs of a web study versus face-to-face (F2F) study.

Methods

Alongside the Belgian Health Interview Survey by F2F edition 2018 (BHISF2F; net sample used: 3316), a web survey (Belgian Health Interview Survey by Web [BHISWEB]; net sample used: 1010) was organized. Sociodemographic data on invited individuals was obtained from the national register and census linkages. Unit response rates considering the different sampling probabilities of both surveys were calculated. Logistic regression analyses examined the association between mode system and sociodemographic characteristics for unit nonresponse. The costs per completed web questionnaire were compared with the costs for a completed F2F questionnaire.

Results

The unit response rate is lower in BHISWEB (18.0%) versus BHISF2F (43.1%). A lower response rate was observed for the web survey among all sociodemographic groups, but the difference was higher among people aged 65 years and older (15.4% vs 45.1%), lower educated people (10.9% vs 38.0%), people with a non-Belgian European nationality (11.4% vs 40.7%), people with a non-European nationality (7.2% vs 38.0%), people living alone (12.6% vs 40.5%), and people living in the Brussels-Capital (12.2% vs 41.8%) region. The sociodemographic characteristics associated with nonresponse are not the same in the 2 studies. Having another European (OR 1.60, 95% CI 1.20-2.13) or non-European nationality (OR 2.57, 95% CI 1.79-3.70) compared to a Belgian nationality and living in the Brussels-Capital (OR 1.72, 95% CI 1.41-2.10) or Walloon (OR 1.47, 95% CI 1.15-1.87) regions compared to the Flemish region are associated with a higher nonresponse only in the BHISWEB study. In BHISF2F, younger people (OR 1.31, 95% CI 1.11-1.54) are more likely to be nonrespondents than older people, and this was not the case in BHISWEB. In both studies, lower educated people have a higher probability of being nonrespondent, but this effect is more pronounced in BHISWEB (low vs high education level: Web, OR 2.71, 95% CI 2.21-3.39 and F2F OR 1.70, 95% CI 1.48-1.95). The BHISWEB study had a considerable advantage; the cost per completed questionnaire was almost 3 times lower (€41 [US $48]) compared with F2F data collection (€111 [US $131]).

Conclusions

The F2F unit response rate was generally higher, yet for certain groups the difference between web and F2F was more limited. Web data collection has a considerable cost advantage. It is therefore worth experimenting with adaptive mixed-mode designs to optimize financial resources without increasing selection bias (eg, only inviting sociodemographic groups who are keener to participate online for web surveys while continuing to focus on increasing F2F response rates for other groups).

Short-term impact of the COVID-19 confinement measures on health behaviours and weight gain among adults in Belgium

BACKGROUND

In Belgium, confinement measures were introduced on the 13th of March 2020 to curb the spread of the coronavirus disease (COVID-19). These measures may affect health behaviours of the population such as eating habits, physical activity and alcohol consumption, which in turn can lead to weight gain resulting in overweight and obesity, increasing the risk of several chronic diseases, but also of severe COVID-19. The purpose of this study is to assess the impact of confinement measures on health behaviours and their associations with weight gain.

METHODS

Data were derived from the second national COVID-19 health survey. Data were collected between the 16th and the 23rd of April 2020. The recruitment of participants was based on snowball sampling via Sciensano's website, invitations via e-mail and social media. The study sample includes participants aged 18 years and over with no missing data on the variables of interest (n = 28,029). The association between self-reported weight gain and health behaviour changes, adjusted for gender, age group and household composition was assessed through OR's (95% CI) calculated with logistic regression models, using post-stratification weights.

RESULTS

Overall, 28.6% reported weight gain after 6 weeks of confinement. Higher odds of weight gain were observed among participants who increased or decreased their consumption of sugar-sweetened beverages (OR = 1.39 (1.15-1.68) and 1.29 (1.04-1.60), respectively), among those who increased their consumption of sweet or salty snacks (OR = 3.65 (3.27-4.07)), among those who became less physically active (OR = 1.91 (1.71-2.13)), and among those who increased their alcohol consumption (OR = 1.86 (1.66-2.08)).

CONCLUSIONS

The most important correlates of weight gain during confinement were an increased consumption of sweet or salty snacks and being less physically active. These findings confirm the impact of diet and exercise on short term weight gain and plead to take more action, in supporting people to achieve healthier behaviours in order to tackle overweight and obesity, especially during the COVID-19 pandemic.

A cross-sectional survey examining motivation and beliefs to participating in a web-based prospective cohort study on nutrition and health among individuals with a low socioeconomic status

Background

Prospective cohort studies may support public health efforts in reducing health inequalities. However, individuals with a low socioeconomic status (SES) are generally underrepresented in health research. This study aimed to examine the intention and determinants of intention of individuals with a low SES towards participation in a Web-based prospective project on nutrition and health (NutriQuébec) in order to develop recruitment and retention strategies.

Methods

A cross-sectional survey based on the Theory of planned behaviour was conducted in the Province of Québec, Canada. Low SES individuals (high school or less and annual household income < $55,000 CAN) were recruited through a Web panel of a polling firm to assess intention, attitude, subjective norm and perceived behavioural control (PBC) towards participation in the NutriQuébec project. Linear regression and logistic regression analyses were conducted.

Results

Mean age of respondents (184 women, 141 men) was 57.6 y (SD = 13.6). Attitude (ß = 0.54, 95%CI: 0.41–0.68) and PBC (ß = 0.50, 95%CI: 0.37–0.63) were significantly associated with intention. Participants who agreed that participating in the study would contribute to an improvement in 1) collective health (odds ratio [OR] = 2.15, 95%CI: 1.27–3.64) and in 2) one’s lifestyle habits (OR = 1.70, 95%CI: 1.04–2.78) were more likely to express positive intention compared to participants who did not agree with these statements. Participants who agreed to participate in the study even 1) in the absence of a financial incentive (OR = 1.43, 95%CI: 1.04–1.99) and even 2) if the completion of questionnaires took up to two hours (OR = 1.78, 95%CI: 1.27–2.48) were also more likely to express high intention. Receiving a personalized brief health assessment (OR = 1.61, 95%CI: 1.13–2.30) and the use of simple questions in the questionnaires (OR = 1.54, 95%CI: 1.05–2.25) were facilitating factors associated with high intention. Participants believing that participation would be too time-consuming were less likely to have positive intention (OR = 0.57, 95%CI: 0.43–0.75).

Conclusions

The development of a positive attitude and a high PBC towards participation in the NutriQuébec project will be necessary to obtain representative data of low SES adults.

Comparing web-based versus face-to-face and paper-and-pencil questionnaire data collected through two Belgian health surveys

OBJECTIVES

Using the European Health Interview Survey (EHIS) questionnaire, a web-based survey was organized alongside a face-to-face (F2F) survey including a paper-and-pencil (P&P) questionnaire for sensitive topics. Associated with these different modes, other design features varied too (e.g., recruitment, incentives, sampling). We assessed whether these whole data collection systems developed around the modes produced equivalent health estimates.

METHODS

Data were obtained from two population-based surveys: the EHISWEB (web-administered, n = 1010) and the Belgian Health Interview Survey 2018 (BHIS2018) (interviewer-administered, n = 2748). Logistic regression analyses were used to assess mode system differences while adjusting for socio-demographic differences in the net samples.

RESULTS

For the P&P mode of the BHIS, significant mode system differences were detected for 2 of the 9 health indicators. Among the indicators collected via the F2F mode, 9 of the 18 indicators showed significant differences.

CONCLUSIONS

Indicators collected via the web-based and P&P self-administered modes were generally more comparable than indicators collected via the web-based and F2F mode. Furthermore, fewer differences were detected for indicators based on simple and factual questions compared to indicators based on subjective or complex questions.

Mixing mixed-mode designs in a national health interview survey: a pilot study to assess the impact on the self-administered questionnaire non-response

BACKGROUND

Many population health surveys consist of a mixed-mode design that includes a face-to-face (F2F) interview followed by a paper-and-pencil (P&P) self-administered questionnaire (SAQ) for the sensitive topics. In order to alleviate the burden of a supplementary P&P questioning after the interview, a mixed-mode SAQ design including a web and P&P option was tested for the Belgian health interview survey.

METHODS

A pilot study (n = 266, age 15+) was organized using a mixed-mode SAQ design following the F2F interview. Respondents were invited to complete a web SAQ either immediately after the interview or at a later time. The P&P option was offered in case respondents refused or had previously declared having no computer access, no internet connection or no recent usage of computers. The unit response rate for the web SAQ and the overall unit response rate for the SAQ independent of the mode were evaluated. A logistic regression analysis was conducted to explore the association of socio-demographic characteristics and interviewer effects with the completed SAQ mode. Furthermore, a logistic regression analysis assessed the differential user-friendliness of the SAQ modes. Finally, a logistic multilevel model was used to evaluate the item non-response in the two SAQ modes while controlling for respondents' characteristics.

RESULTS

Of the eligible F2F respondents in this study, 76% (107/140) agreed to complete the web SAQ. Yet among those, only 78.5% (84/107) actually did. At the end, the overall (web and P&P) SAQ unit response rate reached 73.5%. In this study older people were less likely to complete the web SAQ. Indications for an interviewer effect were observed as regard the number of web respondents, P&P respondents and respondents who refused to complete the SAQ. The web SAQ scored better in terms of user-friendliness and presented higher item response than the P&P SAQ.

CONCLUSIONS

The web SAQ performed better regarding user-friendliness and item response than the P&P SAQ but the overall SAQ unit response rate was low. Therefore, future research is recommended to further assess which type of SAQ design implemented after a F2F interview is the most beneficial to obtain high unit and item response rates.