Use of anchoring vignettes to evaluate health reporting behavior amongst adults aged 50 years and above in Africa and Asia--testing assumptions

Self-reported health and the social body

Since the strong predictive power of self-reported health (SRH) for prospective health and social outcomes has been established, researchers have been in a quest to build a theoretical understanding of this widely used health measure. Current literature based predominantly in a biomedical perspective asserts a linear relationship between physical conditions and perception of health. Discrepancies from this expected relationship are considered an important weakness of SRH. Systematic discrepancies between physical conditions and reporting of SRH have been documented across different socio-economic groups. Evidence identified for educational groups shows that for the same level of health status, lower-educated groups report poorer levels of perceived health. This raised doubts whether it is useful to use SRH to measure social inequalities in health within and between countries. To date, sociologists of health have not engaged in the discussion of reporting heterogeneity in SRH. After reviewing existing evidence, we contend that the discrepancy in SRH reporting across social groups argued to be a weakness of SRH as a health measure is a strength from a sociological perspective. SRH as a social measure of health is a better predictor than objective measures of health precisely because it captures the lived experience of the embodied agent.

Is EQ-5D-5L Better Than EQ-5D-3L? A Head-to-Head Comparison of Descriptive Systems and Value Sets from Seven Countries

OBJECTIVE

This study describes the first empirical head-to-head comparison of EQ-5D-3L (3L) and EQ-5D-5L (5L) value sets for multiple countries.

METHODS

A large multinational dataset, including 3L and 5L data for eight patient groups and a student cohort, was used to compare 3L versus 5L value sets for Canada, China, England/UK (5L/3L, respectively), Japan, The Netherlands, South Korea and Spain. We used distributional analyses and two methods exploring discriminatory power: relative efficiency as assessed by the F statistic, and an area under the curve for the receiver-operating characteristics approach. Differences in outcomes were explored by separating descriptive system effects from valuation effects, and by exploring distributional location effects.

RESULTS

In terms of distributional evenness, efficiency of scale use and the face validity of the resulting distributions, 5L was superior, leading to an increase in sensitivity and precision in health status measurement. When compared with 5L, 3L systematically overestimated health problems and consequently underestimated utilities. This led to bias, i.e. over- or underestimations of discriminatory power.

CONCLUSION

We conclude that 5L provides more precise measurement at individual and group levels, both in terms of descriptive system data and utilities. The increased sensitivity and precision of 5L is likely to be generalisable to longitudinal studies, such as in intervention designs. Hence, we recommend the use of the 5L across applications, including economic evaluation, clinical and public health studies. The evaluative framework proved to be useful in assessing preference-based instruments and might be useful for future work in the development of descriptive systems or health classifications.

Using Anchoring Vignettes to Adjust Self-Reported Personality: A Comparison Between Countries

Data from self-report tools cannot be readily compared between cultures due to culturally specific ways of using a response scale. As such, anchoring vignettes have been proposed as a suitable methodology for correcting against this difference. We developed anchoring vignettes for the Big Five Inventory-44 (BFI-44) to supplement its Likert-type response options. Based on two samples (Rwanda: n = 423; Philippines: n = 143), we evaluated the psychometric properties of the measure both before and after applying the anchoring vignette adjustment. Results show that adjusted scores had better measurement properties, including improved reliability and a more orthogonal correlational structure, relative to scores based on the original Likert scale. Correlations of the Big Five Personality Factors with life satisfaction were essentially unchanged after the vignette-adjustment while correlations with counterproductive were noticeably lower. Overall, these changed findings suggest that the use of anchoring vignette methodology improves the cross-cultural comparability of self-reported personality, a finding of potential interest to the field of global workforce research and development as well as educational policymakers.

Variations in disability and quality of life with age and sex between eight lower income and middle-income countries: data from the INDEPTH WHO-SAGE collaboration

Background

Disability and quality of life are key outcomes for older people. Little is known about how these measures vary with age and gender across lower income and middle-income countries; such information is necessary to tailor health and social care policy to promote healthy ageing and minimise disability.

Methods

We analysed data from participants aged 50 years and over from health and demographic surveillance system sites of the International Network for the Demographic Evaluation of Populations and their Health Network in Ghana, Kenya, Tanzania, South Africa, Vietnam, India, Indonesia and Bangladesh, using an abbreviated version of the WHO Study on global AGEing survey instrument. We used the eight-item WHO Quality of Life (WHOQoL) tool to measure quality of life and theWHO Disability Assessment Schedule, version 2 (WHODAS-II) tool to measure disability. We collected selected health status measures via the survey instrument and collected demographic and socioeconomic data from linked surveillance site information. We performed regression analyses to quantify differences between countries in the relationship between age, gender and both quality of life and disability, and we used anchoring vignettes to account for differences in interpretation of disability severity.

Results

We included 43 935 individuals in the analysis. Mean age was 63.7 years (SD 9.7) and 24 434 (55.6%) were women. In unadjusted analyses across all countries, WHOQoL scores worsened by 0.13 points (95% CI 0.12 to 0.14) per year increase in age and WHODAS scores worsened by 0.60 points (95% CI 0.57 to 0.64). WHODAS-II and WHOQoL scores varied markedly between countries, as did the gradient of scores with increasing age. In regression analyses, differences were not fully explained by age, socioeconomic status, marital status, education or health factors. Differences in disability scores between countries were not explained by differences in anchoring vignette responses.

Conclusions

The relationship between age, sex and both disability and quality of life varies between countries. The findings may guide tailoring of interventions to individual country needs, although these associations require further study.

In Pursuit of Anchoring Vignettes That Work: Evaluating Generality Versus Specificity in Vignette Texts

Objective

Anchoring vignettes appear with growing frequency in surveys of health and aging, but little research investigates how to optimize their wording. This study experimentally tests whether mentioning specific health conditions and/or medical procedures enhances or undermines vignette validity.

Methods

Three series of general health anchoring vignettes were fielded to 2,550 respondents in the Wisconsin Longitudinal Study: one mentioning no specific health conditions or procedures, one mentioning heart disease-related ones, and one mentioning diabetes-related ones. Variations on hierarchical ordered probit models were used to test whether vignette wording affected adherence to the key measurement assumptions of vignette equivalence (VE) and response consistency (RC).

Results

While all vignette series showed substantial violations of VE, violations were larger (especially by sex and education) when using disease-specific texts. RC violations appeared relatively minor, but somewhat larger in disease-specific texts.

Discussion

These findings suggest that more general, universal vignette texts may be preferable to ones describing highly specific conditions/procedures. The common advice to prioritize specificity and concreteness in survey texts may be misguided if sociodemographic groups differ in their familiarity or associations with the presented details. Anchoring vignettes are a potentially useful survey tool, but further efforts are needed to optimize their wording.

Differential item functioning in quality of life measurement: An analysis using anchoring vignettes

Systematic differences in the ways that people use and interpret response categories (differential item functioning, DIF) can introduce bias when using self-assessments to compare health or quality of life across heterogeneous groups. This paper reports on an exploratory analysis involving the use of anchoring vignettes to identify DIF in a commonly used measure for assessing health-related quality of life - namely the EQ-5D. Using data from a bespoke (i.e. custom) survey that recruited a representative sample of 4300 respondents from the general Australian population in 2014 and 2015, we find that the assumptions of response consistency (RC) and vignette equivalence (VE) hold in a sub-sample of respondents aged 55-65 years (n = 914), which demonstrates that vignettes can appropriately identify DIF in EQ-5D reporting for this age group. We find that the EQ-5D is indeed subject to DIF, and that failure to account for DIF can lead to conclusions that are misleading when using the instrument to compare health or quality of life across heterogeneous groups. We also provide several important insights in terms of the identifying assumptions of RC and VE. We conclude that the implications of DIF could be of considerable importance, not only for outcomes research, but for funding decisions in healthcare more broadly given the strong reliance on patient-reported outcome measures in economic evaluations for health technology assessment.

Inequality in disability-free life expectancies among older men and women in six countries with developing economies

Background

It is unclear whether the increase in life expectancy (LE) globally is coupled with a postponement of morbidity and disability. Evidence on trends and determinants of disability-free life expectancies (DFLEs) are available in high-income countries but less in low and middle-income countries (LMICs). This study examines the levels of and inequalities in LE, disability and DFLE between men and women across different age groups aged 50 years and over in six countries with developing economies.

Methods

This study utilised the cross-sectional data (n=32 724) from the WHO Study on global AGEing and adult health (SAGE) in China, Ghana, India, Mexico, the Russian Federation and South Africa in 2007–2010. Disability was measured with the activity of daily living (ADL) instrument. The DFLE was estimated using the Sullivan method based on the standard period life table and ADL-disability proportions.

Results

The disability prevalence ranged from 13% in China to 54% in India. The prevalence of disability was highest and occurred at younger age in both sexes in India. Women were more disadvantaged with higher prevalence of disability across all age groups, and the situation was worst among older women in Mexico and the Russian Federation. Though women had higher LE, their proportion of remaining LE free from disability was lower than men.

Conclusions

There are inequalities in the levels of disability and DFLE among men and women in different age groups among people aged over 50 years in these six countries. Countermeasures to decrease intercountry and gender gaps in DFLE, including improvements in health promotion and healthcare distribution, with a gender equity focus, are needed.

Health and ageing in Nairobi's informal settlements-evidence from the International Network for the Demographic Evaluation of Populations and Their Health (INDEPTH): a cross sectional study

BACKGROUND

Much of the focus on population ageing has been in high-income counties. Relatively less attention is given to the world's poorest region, Sub-Saharan Africa (SSA) where children and adolescents still comprise a high proportion of the population. Yet the number of adults aged 60-plus in SSA is already twice that in northern Europe. In addition, SSA is experiencing massive rural to urban migration with consequent expansion of informal urban settlements, or slums, whose health problems are usually unrecognised and not addressed. This study aims to improve understanding of functional health and well-being in older adult slum-dwellers in Nairobi (Kenya).

METHODS

The study sample comprised men and women, aged 50 years and over, living in Korogocho and Viwandani, Nairobi, Kenya (n = 1,878). Data from the International Network for the Demographic Evaluation of Populations and Their Health (INDEPTH) and the WHO Study on global AGEing and adult health (SAGE Wave 1) were analysed. The prevalence of poor self-reported quality of life (QoL) and difficulties in domain-specific function is estimated by age and sex. Logistic regression investigates associations between difficulties in the domains of function and poor QoL, adjusting for age, sex and socio-demographic factors. Statistical significance is set at P<0.05.

RESULTS

Women reported poorer QoL and greater functional difficulties than men in all domains except self-care. In the multivariable logistic regression the odds of poor QoL among respondents with problems or difficulties in relation to affect (OR = 7.0; 95%CI = 3.0-16.0), pain/discomfort (OR = 3.6; 95%CI = 2.3-5.8), cognition (OR = 1.8; 95 %CI = 1.2-2.9) and mobility (OR = 1.8; 95%CI = 1.1-2.8) were statistically significant.

CONCLUSIONS

The findings underscore differences in the domains of functional health that encapsulate women and men's capacities to perform regular activities and the impact of poor functioning on QoL. Investing in the health and QoL of older people in SSA will be crucial in helping the region to realise key development goals and in opening opportunities for improved health outcomes and sustainable economic development.

Bonding, Bridging, and Linking Social Capital and Self-Rated Health among Chinese Adults: Use of the Anchoring Vignettes Technique

Three main opposing camps exist over how social capital relates to population health, namely the social support perspective, the inequality thesis, and the political economy approach. The distinction among bonding, bridging, and linking social capital probably helps close the debates between these three camps, which is rarely investigated in existing literatures. Moreover, although self-rated health is a frequently used health indicator in studies on the relationship between social capital and health, the interpersonal incomparability of this measure has been largely neglected. This study has two main objectives. Firstly, we aim to investigate the relationship between bonding, bridging, and linking social capital and self-rated health among Chinese adults. Secondly, we aim to improve the interpersonal comparability in self-rated health measurement. We use data from a nationally representative survey in China. Self-rated health was adjusted using the anchoring vignettes technique to improve comparability. Two-level ordinal logistic regression was performed to model the association between social capital and self-rated health at both individual and community levels. The interaction between residence and social capital was included to examine urban/rural disparities in the relationship. We found that most social capital indicators had a significant relationship with adjusted self-rated health of Chinese adults, but the relationships were mixed. Individual-level bonding, linking social capital, and community-level bridging social capital were positively related with health. Significant urban/rural disparities appeared in the association between community-level bonding, linking social capital, and adjusted self-rated health. For example, people living in communities with higher bonding social capital tended to report poorer adjusted self-rated health in urban areas, but the opposite tendency held for rural areas. Furthermore, the comparison between multivariate analyses results before and after the anchoring vignettes adjustment showed that the relationship between community-level social capital and self-rated health might be distorted if comparability problems are not addressed. In conclusion, the framework of bonding, bridging, and linking social capital helps us better understand the mechanism between social capital and self-rated health. Cultural and socioeconomic factors should be considered when designing health intervention policies using social capital. Moreover, we recommend that more studies improve the comparability of self-rated health by using the anchoring vignettes technique.

Does reporting behaviour bias the measurement of social inequalities in self-rated health in Indonesia? An anchoring vignette analysis

Purpose

Studies on self-rated health outcomes are fraught with problems when individuals’ reporting behaviour is systematically biased by demographic, socio-economic, or cultural factors. Analysing the data drawn from the Indonesia Family Life Survey 2007, this paper aims to investigate the extent of differential health reporting behaviour by demographic and socio-economic status among Indonesians aged 40 and older (\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$N = 3735$$\end{document}N=3735).

Methods

Interpersonal heterogeneity in reporting style is identified by asking respondents to rate a number of vignettes that describe varying levels of health status in targeted health domains (mobility, pain, cognition, sleep, depression, and breathing) using the same ordinal response scale that is applied to the self-report health question. A compound hierarchical ordered probit model is fitted to obtain health differences by demographic and socio-economic status. The obtained regression coefficients are then compared to the standard ordered probit model.

Results

We find that Indonesians with more education tend to rate a given health status in each domain more negatively than their less-educated counterparts. Allowing for such differential reporting behaviour results in relatively stronger positive education effects.

Conclusion

There is a need to correct for differential reporting behaviour using vignettes when analysing self-rated health measures in older adults in Indonesia. Unless such an adjustment is made, the salutary effect of education will be underestimated.

Correcting bias in self-rated quality of life: an application of anchoring vignettes and ordinal regression models to better understand QoL differences across commuting modes

PURPOSE

Likert scales are frequently used in public health research, but are subject to scale perception bias. This study sought to explore scale perception bias in quality-of-life (QoL) self-assessment and assess its relationships with commuting mode in the Sydney Travel and Health Study.

METHODS

Multilevel ordinal logistic regression analysis was used to analyse the association between two global QoL items about overall QoL and health satisfaction, with usual travel mode to work or study. Anchoring vignettes were applied using parametric and simpler nonparametric methods to detect and adjust for differences in reporting behaviour across age, sex, education, and income groups.

RESULTS

The anchoring vignettes exposed differences in scale responses across demographic groups. After adjusting for these biases, public transport users (OR = 0.37, 95 % CI 0.21-0.65), walkers (OR = 0.44, 95 % CI 0.24-0.82), and motor vehicle users (OR = 0.47, 95 % CI 0.25-0.86) were all found to have lower odds of reporting high QoL compared with bicycle commuters. Similarly, the odds of reporting high health satisfaction were found to be proportionally lower amongst all competing travel modes: motor vehicle users (OR = 0.31, 95 % CI 0.18-0.56), public transport users (OR = 0.34, 95 % CI 0.20-0.57), and walkers (OR = 0.35, 95 % CI 0.20-0.64) when compared with cyclists. Fewer differences were observed in the unadjusted models.

CONCLUSION

Application of the vignettes by the two approaches removed scaling biases, thereby improving the accuracy of the analyses of the associations between travel mode and quality of life. The adjusted results revealed higher quality of life in bicycle commuters compared with all other travel mode users.

Risk Factors and Disability Associated with Low Back Pain in Older Adults in Low- and Middle-Income Countries. Results from the WHO Study on Global AGEing and Adult Health (SAGE)

BACKGROUND

Back pain is a common disabling chronic condition that burdens individuals, families and societies. Epidemiological evidence, mainly from high-income countries, shows positive association between back pain prevalence and older age. There is an urgent need for accurate epidemiological data on back pain in adult populations in low- and middle-income countries (LMICs) where populations are ageing rapidly. The objectives of this study are to: measure the prevalence of back pain; identify risk factors and determinants associated with back pain, and describe association between back pain and disability in adults aged 50 years and older, in six LMICs from different regions of the world. The findings provide insights into country-level differences in self-reported back pain and disability in a group of socially, culturally, economically and geographically diverse LMICs.

METHODS

Standardized national survey data collected from adults (50 years and older) participating in the World Health Organization (WHO) Study on global AGEing and adult health (SAGE) were analysed. The weighted sample (n = 30, 146) comprised respondents in China, Ghana, India, Mexico, South Africa and the Russian Federation. Multivariable regressions describe factors associated with back pain prevalence and intensity, and back pain as a determinant of disability.

RESULTS

Prevalence was highest in the Russian Federation (56%) and lowest in China (22%). In the pooled multi-country analyses, female sex, lower education, lower wealth and multiple chronic morbidities were significant in association with past-month back pain (p<0.01). About 8% of respondents reported that they experienced intense back pain in the previous month.

CONCLUSIONS

Evidence on back pain and its impact on disability is needed in developing countries so that governments can invest in cost-effective education and rehabilitation to reduce the growing social and economic burden imposed by this disabling condition.

Linking Health System Responsiveness to Political Rights and Civil Liberties

Responsiveness is a dimension of health system functioning and might be dependent upon contextual factors related to politics. Given this, we performed cross-national comparisons with the aim of investigating: 1) the associations of political factors with patients’ reports of health system responsiveness and 2) the extent to which health input and output might explain these associations. World Health Survey data were analyzed for 44 countries (n = 103 541). Main outcomes included, respectively, 8 and 7 responsiveness domains for inpatient and outpatient care. Linear multilevel regressions were used to assess the associations of politics (namely, civil liberties and political rights), socioeconomic development, health system input, and health system output (measured by maternal mortality) with responsiveness domains, adjusted for demographic factors. Political rights showed positive associations with dignity (regression coefficient = 0.086 [standard error = 0.039]), quality (0.092 [0.049]), and support (0.113 [0.048]) for inpatient care and with dignity (0.075 [0.040]), confidentiality (0.089 [0.043]), and quality (0.124 [0.053]) for outpatient care. Positive associations were observed for civil liberties as well. Health system input and output reduced observed associations. Results tentatively suggest that strengthening political rights and, to a certain extent, civil liberties might improve health system responsiveness, in part through their effect on health system input and output.