The RETRIEVE Checklist for Studies Reporting the Elicitation of Stated Preferences for Child Health-Related Quality of Life

BACKGROUND

Recent systematic reviews show varying methods for eliciting, modelling, and reporting preference-based values for child health-related quality-of-life (HRQoL) outcomes, thus producing value sets with different characteristics. Reporting in many of the reviewed studies was found to be incomplete and inconsistent, making them difficult to assess. Checklists can help to improve standards of reporting; however, existing checklists do not address methodological issues for valuing child HRQoL. Existing checklists also focus on reporting methods and processes used in developing HRQoL values, with less focus on reporting of the values' key characteristics and properties. We aimed to develop a checklist for studies generating values for child HRQoL, including for disease-specific states and value sets for generic child HRQoL instruments.

DEVELOPMENT

A conceptual model provided a structure for grouping items into five modules. Potential items were sourced from an adult HRQoL checklist review, with additional items specific to children developed using recent reviews. Checklist items were reduced by eliminating duplication and overlap, then refined for relevance and clarity via an iterative process. Long and short checklist versions were produced for different user needs. The resulting long RETRIEVE contains 83 items, with modules for reporting methods (A-D) and characteristics of values (E), for researchers planning and reporting child health valuation studies. The short RETRIEVE contains 14 items for decision makers or researchers choosing value sets.

CONCLUSION

Applying the RETRIEVE checklists to relevant studies suggests feasibility. RETRIEVE has the potential to improve completeness in the reporting of preference-based values for child HRQOL outcomes and to improve assessment of preference-based value sets.

Impact of surgical-site infection on health utility values: a meta-analysis

BACKGROUND

Surgical-site infections (SSIs) are recognized as negatively affecting patient quality of life. No meta-analysis of SSI utility values is available in the literature to inform estimates of this burden and investment decisions in prevention.

METHODS

A systematic search of PubMed, MEDLINE, CINAHL, and the National Health Service Economic Evaluation Database was performed in April 2022 in accordance with PROSPERO registration CRD 42021262633. Studies were included where quality-of-life data were gathered from adults undergoing surgery, and such data were presented for those with and without an SSI at similar time points. Two researchers undertook data extraction and quality appraisal independently, with a third as arbiter. Utility values were converted to EuroQol 5D (EQ-5D™) estimates. Meta-analyses were conducted using a random-effects model across all relevant studies, with subgroup analyses on type and timing of the SSI.

RESULTS

In total, 15 studies with 2817 patients met the inclusion criteria. Six studies across seven time points were used in the meta-analysis. The pooled mean difference in EQ-5D™ utility in all studies combined was -0.08 (95 per cent c.i. -0.11 to -0.05; prediction interval -0.16 to -0.01; I2 = 40 per cent). The mean difference in EQ-5D™ utility associated with deep SSI was -0.10 (95 per cent c.i. -0.14 to -0.06; I2 = 0 per cent) and the mean difference in EQ-5D™ utility persisted over time.

CONCLUSION

The present study provides the first synthesized estimate of SSI burden over the short and long term. EQ-5D™ utility estimates for a range of SSIs are essential for infection prevention planning and future economic modelling.

Quality appraisal for systematic literature reviews of health state utility values: a descriptive analysis

BACKGROUND

Health state utility values (HSUVs) are an essential input parameter to cost-utility analysis (CUA). Systematic literature reviews (SLRs) provide summarized information for selecting utility values from an increasing number of primary studies eliciting HSUVs. Quality appraisal (QA) of such SLRs is an important process towards the credibility of HSUVs estimates; yet, authors often overlook this crucial process. A scientifically developed and widely accepted QA tool for this purpose is lacking and warranted.

OBJECTIVES

To comprehensively describe the nature of QA in published SRLs of studies eliciting HSUVs and generate a list of commonly used items.

METHODS

A comprehensive literature search was conducted in PubMed and Embase from 01.01.2015 to 15.05.2021. SLRs of empirical studies eliciting HSUVs that were published in English were included. We extracted descriptive data, which included QA tools checklists or good practice recommendations used or cited, items used, and the methods of incorporating QA results into study findings. Descriptive statistics (frequencies of use and occurrences of items, acceptance and counterfactual acceptance rates) were computed and a comprehensive list of QA items was generated.

RESULTS

A total of 73 SLRs were included, comprising 93 items and 35 QA tools and good recommendation practices. The prevalence of QA was 55% (40/73). Recommendations by NICE and ISPOR guidelines appeared in 42% (16/40) of the SLRs that appraised quality. The most commonly used QA items in SLRs were response rates (27/40), statistical analysis (22/40), sample size (21/40) and loss of follow up (21/40). Yet, the most commonly featured items in QA tools and GPRs were statistical analysis (23/35), confounding or baseline equivalency (20/35), and blinding (14/35). Only 5% of the SLRS used QA to inform the data analysis, with acceptance rates of 100% (in two studies) 67%, 53% and 33%. The mean counterfactual acceptance rate was 55% (median 53% and IQR 56%).

CONCLUSIONS

There is a considerably low prevalence of QA in the SLRs of HSUVs. Also, there is a wide variation in the QA dimensions and items included in both SLRs and extracted tools. This underscores the need for a scientifically developed QA tool for multi-variable primary studies of HSUVs.

Consolidated Health Economic Evaluation Reporting Standards (CHEERS) 2022 Explanation and Elaboration: A Report of the ISPOR CHEERS II Good Practices Task Force

Health economic evaluations are comparative analyses of alternative courses of action in terms of their costs and consequences. The Consolidated Health Economic Evaluation Reporting Standards (CHEERS) statement, published in 2013, was created to ensure health economic evaluations are identifiable, interpretable, and useful for decision making. It was intended as guidance to help authors report accurately which health interventions were being compared and in what context, how the evaluation was undertaken, what the findings were, and other details that may aid readers and reviewers in interpretation and use of the study. The new CHEERS 2022 statement replaces the previous CHEERS reporting guidance. It reflects the need for guidance that can be more easily applied to all types of health economic evaluation, new methods and developments in the field, and the increased role of stakeholder involvement including patients and the public. It is also broadly applicable to any form of intervention intended to improve the health of individuals or the population, whether simple or complex, and without regard to context (such as healthcare, public health, education, and social care). This Explanation and Elaboration Report presents the new CHEERS 2022 28-item checklist with recommendations and explanation and examples for each item. The CHEERS 2022 statement is primarily intended for researchers reporting economic evaluations for peer-reviewed journals and the peer reviewers and editors assessing them for publication. Nevertheless, we anticipate familiarity with reporting requirements will be useful for analysts when planning studies. It may also be useful for health technology assessment bodies seeking guidance on reporting, given that there is an increasing emphasis on transparency in decision making.

A systematic review of direct preference measurements in health states treated with plastic surgery

One way to compare health care needs and outcomes on common scales is by estimating the strength of preferences or willingness-to-pay (WTP). The aim of this study was to review directly measured preference values and WTP estimates for health states treated by plastic surgery. The included articles had to meet the criteria defined in the SPIDER (Sample, Phenomenon of Interest, Design, Evaluation, Research type). Relevant databases were searched using predetermined strings. Data were extracted in a standardised manner. Included studies were appraised according to the Grading of Recommendations Assessment, Development, and Evaluation (GRADE) approach for rating the importance of outcomes. In total, 213 abstracts were retrieved. Of these, 179 did not meet the inclusion criteria and were excluded, leaving 34 studies in the review. The risk of bias was considered moderate in four studies and serious in the rest. The overall certainty of evidence for directly measured preference values and WTP estimates for health states treated by plastic surgery is low (Grade ƟƟОО). The lowest preference scores were generally elicited for facial defects/anomalies and the highest for excess skin after massive weight loss. Scientific knowledge about preferences and the resulting health gains might play an essential role in deciding which procedures should be considered for public funding or rather rationed within the system. Better quality studies are required to allow for such applications.

Evaluating the conduct and application of health utility studies: a review of critical appraisal tools and reporting checklists

BACKGROUND

Published health utility studies are increasingly cited in cost-utility analyses to inform reimbursement decision-making. However, there is limited guidance for investigators looking to systematically evaluate the methodological quality of health utility studies or their applicability to decision contexts.

OBJECTIVE

To describe how health utility concepts are reflected in tools intended for use with the health economic literature, particularly with respect to the evaluation of methodological quality and context applicability.

METHODS

We reviewed the critical appraisal and reporting tools described in a 2012 report published by the Agency for Healthcare Research and Quality (AHRQ), supplemented with a keyword search of MEDLINE and EMBASE, to identify existing tools which include health utility constructs. From these tools, a list of relevant items was compiled and grouped into domain categories based on the methodological or applicability aspect they were directed toward.

RESULTS

Of the 24 tools we identified, 12 contained items relevant to the evaluation of health utilities. Sixty-five items were considered relevant to the evaluation of quality, while 44 were relevant to the evaluation of applicability. Items were arranged into four domains: health state descriptions; selection and description of respondents; elicitation and measurement methods; and other considerations.

CONCLUSION

As key inputs to cost-utility analyses, health utilities have the potential to significantly impact estimates of cost-effectiveness. Existing tools contain only general items related to the conduct or use of health utility studies. There is a need to develop tools that systematically evaluate the methodological quality and applicability of health utility studies.

Cultural Values: Can They Explain Differences in Health Utilities between Countries?

Introduction. Health utilities are widely used in health care. The distributions of utilities differ between countries; some countries more often report worse than dead health states, while mild states are valued more or less the same. We hypothesize that cultural values explain these country-related utility differences. Research Question. What is the effect of sociodemographic background, methodological factors, and cultural values on differences in health utilities? Methods and Analyses. Time tradeoff data from 28 EQ-5D valuation studies were analyzed, together with their sociodemographic variables. The dependent variable was Δu, the utility difference between mild and severe states. Country-specific cultural variables were taken from the World Values Survey. Multilevel models were used to analyze the effect of sociodemographic background, methodology (3L v. 5L), and cultural values on Δu. Intraclass correlation (ICC) for country variation was used to assess the impact of the predicting variables on the variation between countries. Results. Substantial variation in Δu was found between countries. Adding cultural values did not reduce ICCs for country variation. Sociodemographic background variables were only weakly associated with Δu and did not affect the ICC. Δu was 0.118 smaller for EQ-5D-5L studies. Discussion. Δu varies between countries. These differences were not explained by national cultural values. In conclusion, despite correction for various variables, utility differences between countries remain substantial and unexplained. This justifies the use of country-specific value sets for instruments such as the EQ-5D.

Toward a Centralized, Systematic Approach to the Identification, Appraisal, and Use of Health State Utility Values for Reimbursement Decision Making: Introducing the Health Utility Book (HUB)

Cost-utility analysis (CUA) is a widely recommended form of health economic evaluation worldwide. The outcome measure in CUA is quality-adjusted life-years (QALYs), which are calculated using health state utility values (HSUVs) and corresponding life-years. Therefore, HSUVs play a significant role in determining cost-effectiveness. Formal adoption and endorsement of CUAs by reimbursement authorities motivates methodological advancement in HSUV measurement and application. A large body of evidence exploring various methods in measuring HSUVs has accumulated, imposing challenges for investigators in identifying and applying HSUVs to CUAs. First, large variations in HSUVs between studies are often reported, and these may lead to different cost-effectiveness conclusions. Second, issues concerning the quality of studies that generate HSUVs are increasingly highlighted in the literature. This issue is compounded by the limited published guidance and methodological standards for assessing the quality of these studies. Third, reimbursement decision making is a context-specific process. Therefore, while an HSUV study may be of high quality, it is not necessarily appropriate for use in all reimbursement jurisdictions. To address these issues, by promoting a systematic approach to study identification, critical appraisal, and appropriate use, we are developing the Health Utility Book (HUB). The HUB consists of an HSUV registry, a quality assessment tool for health utility studies, and a checklist for interpreting their use in CUAs. We anticipate that the HUB will make a timely and important contribution to the rigorous conduct and proper use of health utility studies for reimbursement decision making. In this way, health care resource allocation informed by HSUVs may reflect the preferences of the public, improve health outcomes of patients, and maintain the efficiency of health care systems.

What were they thinking when providing preference measurements for generic health states? The evidence for HUI3

Background

Multi-attribute generic preference-based measures of health-related quality of life are used as comprehensive outcome measures. Typically preferences for health states defined by these systems are elicited from a representative sample of the general population. An important element in that elicitation process is the information that respondents were instructed to consider in providing their responses.

Methods

A random sample of community-dwelling respondents in Canada was surveyed in face-to-face interviews. Respondents provided preference scores for selected Health Utilities Index Mark 3 (HUI3) health states. Respondents also answered questions about the most important attributes and the importance of various impacts of the health states in providing their preference scores.

Results

Fifty per cent of respondents reported that they focussed on two, and 21% on three, attributes of the eight HUI3 attributes. Each of the eight attributes was identified as important; pain (49%), vision (37%), cognition (34%), emotion (28%), and ambulation (28%) were the most important. The null hypothesis that all of the attributes were equally important was rejected (p < 0.001). With respect to the impacts, 89% of respondents indicated that the ability to take care of oneself was quite or very important; similarly 76% reported the same for impact on family life, 69% for impact on the happiness of others, 61% for the impact on their ability to work, and 42% for the impact on their leisure activities. The null hypothesis that all of the impacts were equally important was rejected (p < 0.001).

Conclusions

In providing preference scores for HUI3 health states, respondents thoughtfully examined the implications of the health states for their ability to live, work, socialize, and function.

Bleeding out the quality-adjusted life years: evaluating the burden of primary dysmenorrhea using time trade-off and willingness-to-pay methods

Primary dysmenorrhea (PD), or painful menstruation in the absence of identified uterine pathology, affects 5 to 9 in every 10 reproductive-aged women. Despite its high prevalence, just a few studies with very small patient numbers have focused on health-related quality of life impairment in PD. We aimed to assess health-related quality of life values for a severe and a mild hypothetical PD health state using 10-year time trade-off and willingness-to-pay methods. In 2015, a nationwide convenience sample of women, aged between 18 and 40 years, was recruited using an Internet-based cross-sectional survey in Hungary. Respondents with a known history of secondary dysmenorrhea were excluded. Data on 1836 and 160 women, with and without a history of PD, respectively, were analysed. Mean utility values for the severe and mild health states were 0.85 (median 0.95) and 0.94 (median 1), respectively. Participants were willing to pay a mean of &OV0556;1127 (median &OV0556;161) and &OV0556;142 (median &OV0556;16) for a complete cure from the severe and mild PD health states. Compared with the non-PD group, women with PD valued both health states worse according to willingness to pay (P < 0.05) but similar in the time trade-off. It seems that PD substantially contributes to the quality-adjusted life year loss in this age group, which is comparable with losses from chronic diseases such as type 1 diabetes, asthma, atopic eczema, or chronic migraine. Our findings provide a useful input to cost-effectiveness and cost-benefit analyses of PD treatments.

Application of Discrete-Choice Experiment Methods in Tobacco Control: A Systematic Review

BACKGROUND

Economic evidence relating to tobacco control is generally derived from the cost effectiveness of smoking-cessation programs or the economic impact of tobacco-induced disease, based on revealed-preference data. However, empirical estimates from stated-preference data on tobacco users' preferences, smoking behaviour and smoking cessation aids using analytical techniques such as discrete-choice experiments (DCEs) could be important for policy decision making in tobacco control.

OBJECTIVES

Our objective was to review the practice and utility of DCE methodology across nicotine- and tobacco-related issues, particularly smoking and smoking-cessation behaviour, anti-smoking policies and preferences for smoking-cessation aids.

METHODS

We searched the PubMed, MEDLINE and ECONLIT databases for full-text original research articles on tobacco-related issues published between January 2000 and April 2016 that used a DCE method. We summarised the evidence and methodological characteristics of DCEs according to Lancsar and Louviere, 2008.

RESULTS

Our review of the 12 eligible studies showed that DCE methodology was used to elicit smoker preferences and to evaluate tobacco-control policies. The majority of the studies were published in the last 5 years. The areas of application were smoking cessation, smoking behaviour, electronic cigarette use, water-pipe smoking and tobacco packaging. Monetary attributes were the most influential attributes in all studies. The design of the DCEs varied.

CONCLUSION

DCE studies of tobacco-related issues were methodologically consistent with guidelines proposed for conducting health-related DCEs.

Subjective health expectations of patients with age-related macular degeneration treated with antiVEGF drugs

Background

Subjective expectations regarding future health may influence patients’ judgement of current health and treatment effects, as well as adherence to therapies in chronic diseases. We aimed to explore subjective expectations on longevity and future health-related quality of life (HRQOL) of patients with age-related macular degeneration (AMD) treated with antiVEGF injections and analyse the influencing factors.

Methods

Consecutive AMD patients in two ophthalmology centres were included. Demographics, clinical characteristics and informal care utilisation were recorded. Current health was evaluated by the EQ-5D generic health status questionnaire and time trade-off (TTO) methods. Happiness was measured on a visual analogue scale (VAS). Subjective life-expectancy and expected EQ-5D status at ages 70, 80 and 90 were surveyed. T-test was applied to compare subgroups and Pearson correlations were performed to analyse relationships between variables.

Results

One hundred twenty two patients were involved (females 62%) with a mean (SD) age of 75.2 (7.9) years and disease duration of 2.9 (2.5) years. The majority were in AREDS-4 state, the better eye’s ETDRS was 64.7 (15.4). EQ-5D and TTO revealed moderate deterioration of health (0.66 vs. 0.72, p = 0.131), happiness VAS was 6.3 (2.2). Correlation between EQ-5D and ETDRS was moderate (R = 0.242, p < 0.05) and having both versus one eye in AREDS-4 resulted lower TTO (0.68 vs. 0.83; p = 0.013). Subjective life-expectancy did not differ significantly from statistical life-expectancy and had no significant impact on TTO. The self-estimated mean EQ-5D score was 0.60, 0.40 and 0.24 for ages 70, 80 and 90 which is lower than the population norm of age-groups 65–74, 75–84 and 85+ (0.77, 0.63 and 0.63, respectively). Age, gender, current EQ-5D, need for informal care and happiness were deterministic factors of subjective health expectations.

Conclusion

AMD patients with antiVEGF treatment have comparable HRQOL as the age-matched general public but expect a more severe deterioration of health with age. Older patients with worse HRQOL have worse subjective expectations. Exploring patients’ health expectations provides an opportunity for ophthalmologists to correct misperceptions and improve the quality of AMD care. Further studies should provide evidences on the relationship between subjective expectations and actual health outcomes, and on its impact on patients’ AMD-specific health behaviour.

Electronic supplementary material

The online version of this article (10.1186/s12877-017-0619-9) contains supplementary material, which is available to authorized users.

Many Miles to Go: A Systematic Review of the State of Cost-Utility Analyses in Brazil

BACKGROUND

Little is known about the quality and quantity of cost-utility analyses (CUAs) in Brazil.

OBJECTIVE

The objective of this study was to provide a systematic review of published CUAs of healthcare technologies in Brazil.

METHODS

We performed a systematic review of economic evaluations studies published in MEDLINE, EMBASE, LILACS (Latin American and Caribbean Health Sciences Literature), SciELO (Scientific Electronic Library Online), NHS EED (National Health Service Economic Evaluation Database), HTA (Health Technology Assessment) Database, Web of Science, Scopus, Bireme (Biblioteca Regional de Medicina), BVS ECOS (Health Economics database of the Brazilian Virtual Library of Health), and SISREBRATS (Sistema de Informação da Rede Brasileira de Avaliação de Tecnologias em Saúde [Brazilian Network for the Evaluation of Health Technologies]) from 1980 to 2013. Articles were included if they were CUAs according to the classification devised by Drummond et al. Two independent reviewers screened articles for relevance and carried out data extraction. Disagreements were resolved through discussion or through consultation with a third reviewer. We performed a qualitative narrative synthesis.

RESULTS

Of the 535 health economic evaluations (HEEs) relating to Brazil, only 40 were CUAs and therefore included in the analysis. Most studies adhered to methodological guidelines for quality of reporting and 77.5% used quality-adjusted life-years (QALYs) as the health outcome. Of these studies, 51.6% did not report the population used to elicit preferences for outcomes and 45.2% used a specific population such as expert opinion. The preference elicitation method was not reported in 58.1% of these studies. The majority (80.6%) of studies did not report the instrument used to derive health state valuations and no publication reported whether tariffs (or preference weights) were national or international. No study mentioned the methodology used to estimate QALYs.

CONCLUSIONS

Many published Brazilian cost-utility studies adhere to key recommended general methods for HEE; however, the use of QALY calculations is far from being the current international standard. Development of health preferences research can contribute to quality improvement of health technology assessment reports in Brazil.

Utility approach to decision-making in extended T1 and limited T2 glottic carcinoma

BACKGROUND

It is still undecided if endoscopic laser surgery or radiotherapy is the preferable treatment in extended T1 and limited T2 glottic tumors. Health utilities assessed from patients can aid in decision-making.

METHODS

Patients treated for extended T1 or limited T2 glottic carcinoma by laser surgery (n = 12) or radiotherapy (n = 14) assigned health utilities using a visual analog scale (VAS), time tradeoff (TTO) technique and scored their voice handicap using the Voice Handicap Index (VHI).

RESULTS

VAS and TTO scores were slightly lower for the laser group compared to the radiotherapy group, however, not significantly so. The VHI showed a correlation with the VAS score, which was very low in both groups and can be considered (near) normal.

CONCLUSION

Patients show no clear preference for the outcomes of laser surgery or radiotherapy from a quality of life (QOL) or voice handicap point of view. These data can now be incorporated into decision-making models. © 2017 Wiley Periodicals, Inc. Head Neck, 2017 © 2016 Wiley Periodicals, Inc. Head Neck 39: 779-785, 2017.

Valuation of pemphigus vulgaris and pemphigus foliaceus health states: a convenience sample experiment

BACKGROUND

Health-related quality of life (HRQoL) in pemphigus has been widely investigated; nevertheless, utility values for economic evaluations are still lacking.

OBJECTIVES

To estimate health utilities for hypothetical pemphigus vulgaris (PV) and pemphigus foliaceus (PF) health states in a general population sample.

METHODS

Three health states (uncontrolled PV, uncontrolled PF and controlled pemphigus) were developed based on a systematic literature review of HRQoL studies in pemphigus. Utilities were obtained from a convenience sample of 108 adults using a visual analogue scale (VAS) and 10-year time trade-off (TTO). Lead-time TTO was applied for health states regarded as worse than dead with a lead time to disease time ratio of 1 : 1.

RESULTS

The mean VAS utility scores for PV, PF and controlled pemphigus were 0·25 ± 0·15, 0·37 ± 0·17 and 0·63 ± 0·16, respectively. Corresponding TTO utilities were as follows: 0·34 ± 0·38, 0·51 ± 0·32 and 0·75 ± 0·31. Overall, 14% and 6% judged PV and PF as being worse than dead. For both VAS and TTO values, significant differences were observed between all health states (P < 0·001). VAS utilities were rated significantly lower compared with TTO in each health state (P < 0·001).

CONCLUSIONS

This is the first study that reports health utility values for PV and PF. Successful treatment of pemphigus might result in significant utility gain (0·24-0·41). These empirical findings with respect to three health states in pemphigus may serve as anchor points for further utility studies and cost-effectiveness analyses.

A Checklist for Reporting Valuation Studies of Multi-Attribute Utility-Based Instruments (CREATE)

Multi-attribute utility-based instruments (MAUIs) assess health status and provide an index score on the full health-dead scale, and are widely used to support reimbursement decisions for new healthcare interventions worldwide. A valuation study is a key part of the development of MAUIs, with the primary goal of developing a scoring algorithm through eliciting societal preferences. We developed the 21-item Checklist for REporting VAluaTion StudiEs (CREATE) by following a modified two-round Delphi panel approach plus an email survey. CREATE is intended to promote good reporting practice as well as guiding developers to thoroughly and carefully think through key methodological elements in designing valuation studies.

Sourcing quality-of-life weights obtained from previous studies: theory and reality in Korea

BACKGROUND

The quality-of-life weights obtained in previous studies are frequently used in cost-utility analyses. The purpose of this study is to describe how the values obtained in previous studies are incorporated into the industry submissions requesting listing at the Korean National Health Insurance (NHI), focusing on the issues discussed in theoretical studies and national guidelines.

METHODS

The industry submissions requesting listing at the Korean NHI from January 2007 until December 2009 were evaluated by two independent researchers at the Health Insurance Review and Assessment Service (HIRA). Specifically, we observed the methods that were used to pool, predict joint health state utilities, and retain consistency within submissions in terms of the issues discussed in methodological research papers and recommendations from national guidelines.

RESULTS

More than half of the submissions used QALY as an outcome measure, and most of these submissions were sourced from prior studies. Heterogeneous methodologies were frequently used within a submission, with the inconsistent use of upper and lower anchors being prevalent. Assumptions behind measuring joint health state utilities or pooling multiple values for single health states were omitted in all submissions. Most national guidelines were rather vague regarding how to predict joint health states, how to select the best available value, how to maintain consistency within a submission, and how to generalize values obtained from prior studies.

CONCLUSIONS

Previously-generated values were commonly sourced, but this practice was frequently related to inconsistencies within and among submissions. Attention should be paid to the consistency and transparency of the value, especially if the value is sourced from prior studies.

Time trade-off: one methodology, different methods

There is no scientific consensus on the optimal specification of the time trade-off (TTO) task. As a consequence, studies using TTO to value health states may share the core element of trading length of life for quality of life, but can differ considerably on many other elements. While this pluriformity in specifications advances the understanding of TTO from a methodological point of view, it also results in incomparable health state values. Health state values are applied in health technology assessments, and in that context comparability of information is desired. In this article, we discuss several alternative specifications of TTO presented in the literature. The defining elements of these specifications are identified as being either methodological, procedural or analytical in nature. Where possible, it is indicated how these elements affect health state values (i.e., upward or downward). Finally, a checklist for TTO studies is presented, which incorporates a list of choices to be made by researchers who wish to perform a TTO task. Such a checklist enables other researchers to align methodologies in order to enhance the comparability of health state values.

Preference values associated with stage III colon cancer and adjuvant chemotherapy

PURPOSE

To elicit preference values for health states associated with Stage III colon cancer (CRC) and to explore the effect of neuropathy associated with current adjuvant treatment.

METHODS

We used time trade-off (TTO) techniques to elicit preferences from 49 CRC patients and 49 community members. We elicited preferences for 7 health states: remission; adjuvant therapy with no, mild, moderate, and severe neuropathy; metastatic stable; and metastatic progressive disease. Mean TTO values were adjusted for the covariates age, education, and current health.

RESULTS

Patients' adjusted mean TTO value for remission was 0.83; adjuvant chemotherapy health states ranged from 0.48 to 0.61. Significant differences were observed for both patient and community groups between TTO for remission and all adjuvant health states (P < 0.001), and between adjuvant therapy with no neuropathy and metastatic health states (P < or = 0.001). Across all health states, patients' values were on average 0.12 higher than community members (P < 0.05).

CONCLUSIONS

The findings highlight the trade-offs between the disutility of adjuvant treatment, the higher utility of remission, and the severe utility loss during metastatic disease. The preference values obtained from this study will be useful for informing patients' treatment decisions and payer cost-utility analyses of adjuvant treatment for colon cancer.

Protocols for time tradeoff valuations of health states worse than dead: a literature review

BACKGROUND

The time tradeoff (TTO) method of preference elicitation allows respondents to value a state as worse than dead, generally either through the Torrance protocol or the Measurement and Valuation of Health (MVH) protocol. Both of these protocols have significant weaknesses: Valuations for states worse than dead (SWD) are elicited through procedures different from those for states better than dead (SBD), and negative values can be extremely negative.

PURPOSE

To provide an account of the different TTO designs for SWD, to identify any alternatives to the MVH and Torrance approaches, and to consider the merits of the approaches identified.

METHODS

Medline was searched to identify all health state valuation studies employing TTO. The ways in which SWD were handled were recorded. Furthermore, to ensure that there are no unpublished but feasible TTO variants, the authors developed a theoretical framework for identifying all potential variants.

RESULTS

The search produced 593 hits, of which 218 were excluded. Of the remaining 375 articles, only 29 included protocols for SWD. Of these, 23 used the MVH protocol and 4 used the Torrance protocol. The other 2 used 1 protocol for SBD and SWD, one making use of lead time and the other using a 2-stage procedure with chaining. The systematic framework did not identify any alternatives to the Torrance and MVH protocols that were superior to the lead time approach.

CONCLUSIONS

Few studies elicit values for SWD. The lead time approach is a potential alternative to the Torrance and MVH protocols. Key words: QALY; states worse than dead; health state valuation; preference elicitation.

A randomized study of scleroderma health state values: a picture is worth a thousand words, and quite a few utiles. [corrected]

OBJECTIVE

Assigning utilities to hypothetical health states requires that the health states be described in adequate detail, but there is no agreement on exactly how health states should be described. We assess utilities from the general public for health states common in scleroderma (SSc) by describing the health states in writing alone v. with photographs of patients with SSc.

METHODS

Subjects rated several SSc health states on a 0 to 100 rating scale (RS) and completed computer-assisted time tradeoff (TTO; range, 0.0-1.0) and standard gamble (SG; range, 0.0-1.0) assessments. Half of the subjects were assigned to be shown photographs of patients with SSc health states in addition to written health state descriptions, whereas the other half were given only the written descriptions.

RESULTS

Of the 213 participants, 133 (62%) were female, 138 (65%) were Caucasian, and 62 (29%) were African American. Median RS, TTO, and SG scores for 5 SSc health states ranged from 20 to 70, 0.28 to 0.94, and 0.50 to 0.90, respectively. In bivariate analyses, showing pictures was associated with lower RS scores for 2 of 5 health states and lower SG values for all 5 health states (P < 0:05 for comparison of pictures v. no pictures), but with no difference in TTO values. Multivariable analyses revealed negative associations between pictures and SG valuations for the 3 most severe SSc health states (R(2) range, 0.04-0.08).

CONCLUSION

Adding pictures of people with SSc to written health state descriptions can affect valuations of SSc health states, although the effect differs by valuation measurement method and by health state severity.

Health Utility Bias: A Systematic Review and Meta-Analytic Evaluation

Background. A common assertion is that rating scale (RS) values are lower than both standard gamble (SG) and time tradeoff (TTO) values. However, differences among these methods may be due to method specific bias. Although SG and TTOs suffer systematic bias, RS responses are known to depend on the range and frequency of other health states being evaluated. Over many diverse studies this effect is predicted to diminish. Thus, a systematic review and data synthesis of RS-TTO and RS-SG difference scores may better reveal persistent dissimilarities. Purpose. The purpose of this study was to establish through systematic review and meta-analysis the net effect of biases that endure over many studies of utilities. Methods. A total of 2206 RS and TTO and 1318 RS and SG respondents in 27 studies of utilities participated. MEDLINE was searched for data from 1976 to 2004, complemented by a hand search of full-length articles and conference abstracts for 9 journals known to publish utility studies, as well as review of results and additional recommendations by 5 outside experts in the field. Two investigators abstracted the articles. We contacted the investigators of the original if required information was not available. Results. No significant effect for RS and TTO difference scores was observed: effect size (95% confidence interval [CI]) = 0.04 (−0.02, 0.09). In contrast, RS scores were significantly lower than SG scores: effect size (95% CI ) =−0.23 (−0.28, −0.19). Correcting SG scores for 3 known biases (loss aversion, framing, and probability weighting) eliminated differences between RS and SG scores: effect size (95% CI ) = 0.01 (−0.03, 0.05). Systematic bias in the RS method may exist but be heretofore unknown. Bias correction formulas were applied to mean not individual utilities. Conclusions. The results of this study do not support the common view that RS values are lower than TTO values, may suggest that TTO biases largely cancel, and support the validity of formulas for correcting SG bias.

The disutility of chronic gout

INTRODUCTION

Gout is a chronic painful inflammatory arthritis. Data regarding the impact of gout on health-related quality of life, however, are limited.

METHODS

We interviewed patients with chronic stable gout. Health status was measured by using the Short Form 36 (SF-36) physical component summary (PCS) and physical component summary (MCS) and the Health Assessment Questionnaire-Disability Index (HAQ-DI). Direct preference-based measures included a health rating scale (RS), the time tradeoff (TTO), and standard gamble (SG) for one's current health state with gout and current health state without gout; indirect preference-based measures included the SF-6D and the EQ-5D. Disutilities for gout were assessed by subtracting preference scores for current health states with gout from those for current health without gout and were compared between patients ranking gout as their top health concern versus the rest of the patients.

RESULTS

Of the 80 interviewees, 72 (90%) were male, 55 (69%) were Caucasian, and the mean (SD) age was 60 (11) years. The mean SF-36 PCS and MCS scores were 38.9 and 48.6, respectively. The mean (SD) SF-6D score was 0.68 (0.13) and the mean (SD) EQ-5D score was 0.73 (0.23). The mean (SD) RS disutility for gout was 0.05 (0.12), the mean TTO disutility was 0.03 (0.12), and the mean SG disutility was 0.02 (0.11). The RS disutilities of subject patients who ranked gout as their top concern (n = 17) trended towards being statistically significantly larger than those of the remaining patients, P = 0.06 but their TTO and SG disutilities were similar to those of the remaining patients.

CONCLUSION

Although physical functioning of patients with gout is often compromised, patients with chronic stable gout do not assign a large disutility to gout per se. Still, patients who rank their gout as their top health concern tend to assign greater RS disutility to gout than do other patients.

Quality of life valuations of mammography screening

OBJECTIVE

To obtain quality-of-life (QOL) valuations associated with mammography screening and breast cancer treatment that are suitable for use in cost-effectiveness analyses.

METHODS

Subjects comprised 131 women (age range 50-79 years) randomly sampled from a breast cancer screening program. In an in-person or telephone interview, women rated the QOL impact of 14 clinical scenarios (ranging from mammography to end-of-life care for breast cancer) using a visual analogue scale anchored by death (0) and perfect health/quality of life (100).

RESULTS

Women rated the scenarios describing true negative results, false positive results, and routine screening mammography at 80 or above on a scale of 0-100, suggesting that they perceive these states as being close to perfect health. They rated adjuvant chemotherapy (39.7; range 10-90), palliation/end-of-life care (35.8; range 0-100), and recurrence at 1 year (33.0; range 0-95) the lowest, suggesting that these health states are perceived as compromised. Women rated receiving news of a breast cancer diagnosis (true positive) (45.7; range 5-100) and receiving delayed news of a breast cancer diagnosis (false negative) (48.5; range 5-100) as being comparable to undergoing mastectomy (48.3; range 10-100) and radiation therapy (46.2; range 5-100) for breast cancer.

CONCLUSIONS

These data can be used to update cost analyses of mammography screening that wish to take into account the QOL impact of screening.

Health state utilities: a framework for studying the gap between the imagined and the real

OBJECTIVES

Health state utilities play an important role in decision analysis and cost-utility analysis. The question whose utilities to use at various levels of health-care decision-making has been subject of considerable debate. The observation that patients often value their own health, but also other health states, higher than members of the general public raises the question what underlies such differences? Is it an artifact of the valuation methods? Is it adaptation versus poor anticipated adaptation? This article describes a framework for the understanding and study of potential mechanisms that play a role in health state valuation. It aims at connecting research from within different fields so that cross-fertilization of ideas may occur.

METHODS

The framework is based on stimulus response models from social judgment theory. For each phase, from stimulus, through information interpretation and integration, to judgment, and, finally, to response, we provide evidence of factors and processes that may lead to different utilities in patients and healthy subjects.

RESULTS

Examples of factors and processes described are the lack of scope of scenarios in the stimulus phase, and appraisal processes and framing effects in the information interpretation phase. Factors that play a role in the judgment phase are, for example, heuristics and biases, adaptation, and comparison processes. Some mechanisms related to the response phase are end aversion bias, probability distortion, and noncompensatory decision-making.

CONCLUSIONS

The framework serves to explain many of the differences in valuations between respondent groups. We discuss some of the findings as they relate to the field of response shift research. We propose issues for discussion in the field, and suggestions for improvement of the process of utility assessment.

Health values of patients with systemic sclerosis

OBJECTIVE

To assess health values in subjects with systemic sclerosis (SSc) and determine variability explained by demographics, clinical factors, health status, and disease severity.

METHODS

We interviewed 107 individuals with SSc who attended national and local Scleroderma Foundation meetings in 2005. Health status was measured using the Short Form 36 (SF-36) Physical Component Summary (PCS; range 0-100) and Mental Component Summary (MCS; range 0-100), the Center for Epidemiologic Studies Depression Scale (CES-D; range 0-60), and the Health Assessment Questionnaire (HAQ) disability index (DI; range 0-3). Disease severity was assessed using a visual analog scale (VAS; range 0-150). Health value measures included the 0-100 health rating scale (RS), standard gamble (SG; range 0.0-1.0), and time trade-off (TTO; range 0.0-1.0). We performed univariate analyses to compare scores between participants with limited cutaneous SSc (lcSSc) and diffuse cutaneous SSc (dcSSc), and multivariable analyses for 3 outcome measures: RS, SG, and TTO, controlling for demographics, type of SSc, health status, and disease severity.

RESULTS

Of the 107 participants, 48 had dcSSc and 59 had lcSSc. Ninety-seven were women and 83 were white. The median scores for the PCS, MCS, and HAQ DI were 36.9, 45.5, and 0.9, respectively. Fifty-five subjects had significant depressive symptoms (CES-D score >or=16). The median RS, SG, and TTO scores were 62, 0.83 (indicating a willingness to accept up to a 17% risk of immediate death in exchange for perfect health), and 0.88 (indicating a willingness to give up a median of 12% of life expectancy in exchange for perfect health), respectively. Subjects with dcSSc had lower RS scores but higher SG scores (corresponding to a willingness to accept only a smaller risk of death) than subjects with lcSSc. TTO scores were similar in the 2 groups. Health values were variably related to factors such as demographics, VAS score, disease classification, and SF-36 PCS and MCS scores (R(2) = 0.22, 0.23, and 0.66 for the SG, TTO, and RS models, respectively).

CONCLUSION

Individuals with dcSSc have lower health ratings but higher SG health values than individuals with lcSSc. These findings have implications for decision analysis and cost-effectiveness analysis.

HEE-GER: a systematic review of German economic evaluations of health care published 1990-2004

Background

Studies published in non-English languages are systematically missing in systematic reviews of growth and quality of economic evaluations of health care. The aims of this study were: to characterize German evaluations, published in English or German-language, in terms of various key parameters; to investigate methods to derive quality-of-life weights in cost-utility studies; and to examine changes in study characteristics over the years.

Methods

We conducted a country-specific systematic review of the German and English-language literature of German economic evaluations (assessment of or application to the German health care system) published 1990–2004. Generic and specialized health economic databases were searched. Two independent reviewers verified fulfillment of inclusion criteria and extracted study characteristics.

Results

The fulltexts of 730 articles were reviewed of which 283 fulfilled all entry criteria. 32% of included studies were published in German-language. 51% of studies evaluated pharmaceuticals and 63% were cost-effectiveness analyses. Economic appraisals concentrate on few disease categories and important health areas are strongly underrepresented. Declaration of sponsorship was associated with article language (49% English articles vs. 29% German articles, p < 0.001). The methodology used to obtain quality-of-life weights in published cost-utility studies was very diverse, poorly reported and most studies did not use German patients' or community health state valuations.

Conclusion

Many of the German-language evaluations included in our study are likely to be missing in international reviews and may be systematically different from English-language reviews from Germany. Lack of transparency and adherence to recommended reporting practices constitute a serious problem in German economic evaluations.

Measuring health preferences for use in cost-utility and cost-benefit analyses of interventions in children: theoretical and methodological considerations

Valuing the health of children for cost-utility or cost-benefit analysis poses a number of additional challenges when compared with valuing adult health. Some of these challenges relate to the inability of young children to value changes in health directly and the potential biases associated with using proxy respondents. Other challenges arise from children not being able to perform as independent economic actors, but dependent on others for care and decision making. In addition, illness in children may affect parent/caregiver quality of life, further complicating the measurement of value associated with a change in a child's health status. We review the most common approaches (QALYs and willingness-to-pay values) for valuing health in economic evaluations and consider the methodological and practical issues associated with measuring child health using each framework. Recommendations for advancing the field of valuing child health for economic evaluations will vary by age; a 'one size fits all' approach does not readily fit. Although limitations exist for all of the methods considered for valuing child health, the currently recommended approach for infants and preschoolers is direct valuation by a proxy respondent. For school-age children and adolescents, existing multi-attribute instruments can be applied in some situations but direct valuation may be required for others. Future research should focus on minimising bias from proxy respondents, consideration of a family- or household-based approach to valuing health effects, and development of generic instruments with domains that are appropriate to children and that vary with age.

Putting the ‘Q’ in quality adjusted life years (QALYs) for advanced ovarian cancer – An approach using data clustering methods and the internet

There are few clearly described utility studies in advanced ovarian cancer, despite the public health importance of condition and the need for preference based measures of quality of life in economic evaluation of the new treatments. We used data clustering techniques to develop health state descriptions based on data from 66 women who completed the EORTC QLQ-C30 over a six month period while receiving chemotherapy for ovarian cancer. The health state descriptions were presented to a group of members of the general public (n=38), via the internet, and preferences elicited using the standard gamble technique. Mean utility values ranged from 0.685 to 0.977, although the range of individual preferences was wider, including values as low as 0.125. This is the first study to use data clustering methods combined with internet preference elicitation in oncology. The resulting health state model is parsimonious, data driven, and incorporates quality of life items tailored to cancer. The estimates therefore meet the needs of policy makers while reflecting more accurately the experience of disease than those based on generic preference measures.

Does cancer risk affect health-related quality of life in patients with Barrett's esophagus?

BACKGROUND

Health-related quality of life is decreased in patients with GERD and Barrett's esophagus (BE).

OBJECTIVE

To determine whether time-tradeoff (TTO) values would differ in patients with BE when patients were asked to trade away the potential risk of esophageal adenocarcinoma rather than chronic heartburn symptoms.

DESIGN

A prospective clinical trial.

PATIENTS

Subjects with biopsy-proven BE.

INTERVENTIONS

Custom-designed computer program to elicit health-state utility values, quality of life in reflux and dyspepsia (QOLRAD), and Medical Outcomes Survey short form-36 surveys.

MAIN OUTCOME MEASUREMENTS

TTO utility values for the annual cancer-risk-associated current health state and for hypothetical scenarios of dysplasia and esophageal cancer.

RESULTS

We studied 60 patients in the cancer-risk cohort (57 men, 92% veteran; mean age [standard deviation; SD], 65 years [11 years], mean GERD duration 17 years [12 years]). The heartburn cohort included 40 patients with GERD and BE with TTO values derived for GERD symptoms. The mean (SD) utility for nondysplastic BE was 0.91 (0.13) compared with 0.90 (0.12) for the heartburn cohort (P = .7). The mean utility values were significantly lower for scenarios of low-grade dysplasia (0.85 [0.12], P = .02) and high-grade dysplasia (0.77 [0.14], P < .005). The mean TTO was 0.67 (0.19) for the scenario of esophageal cancer. There was no correlation between the utility scores and the disease-specific survey scores.

LIMITATIONS

TTO values were hypothetical for states of dysplasia and cancer.

CONCLUSIONS

TTO utility values based on heartburn symptoms or annual risk of cancer in patients with nondysplastic BE are roughly equivalent. However, TTO utility values are significantly lower for health states with increasing cancer risks.

Health-related quality of life in veterans and nonveterans with HIV/AIDS

PURPOSE

To compare health-related quality of life (HRQoL) between patients receiving care in Veterans Administration (VA) settings (veterans) and non-VA settings (nonveterans), and to explore determinants of HRQoL and change in HRQoL over time in subjects living with HIV/AIDS.

SUBJECTS

One hundred veterans and 350 nonveterans with HIV/AIDS from 2 VA and 2 university-based sites in 3 cities interviewed in 2002 to 2003 and again 12 to 18 months later.

METHODS

We assessed health status (functional status and symptom bother), health ratings, and health values (time tradeoff [TTO] and standard gamble [SG] utilities). We also explored bivariate and multivariable associations of HRQoL measures with a number of demographic, clinical, spiritual/religious, and psychosocial characteristics.

RESULTS

Compared with nonveterans, the veteran population was older (47.7 vs 42.0 years) and consisted of a higher proportion of males (97% vs 83%), of participants with a history of injection drug use (23% vs 15%), and of subjects with unstable housing situations (14% vs 6%; P<.05 for all comparisons). On scales ranging from 0 (worst) to 100 (best), veterans reported significantly poorer overall function (mean [SD]; 65.9 [17.2] vs 71.9 [16.8]); lower rating scale scores (67.6 [21.7] vs 73.5 [21.0]), lower TTO values (75.7 [37.4] vs 89.0 [23.2]), and lower SG values (75.0 [35.8] vs 83.2 [28.3]) than nonveterans (P<.05 for all comparisons); however, in multivariable models, veteran status was only a significant determinant of SG and TTO values at baseline. Among other determinants that were associated with multiple HRQoL outcomes in baseline and follow-up multivariable analyses were: symptom bother, overall function, religiosity/spirituality, depressive symptoms, and financial worries.

CONCLUSIONS

Veterans reported significantly poorer HRQoL than nonveterans, but when controlling for other factors, veteran status was only a significant determinant of TTO and SG health values at baseline. Correlates of HRQoL such as symptom bother, spirituality/religiosity, and depressive symptoms could be fruitful potential targets for interventions to improve HRQoL in patients with HIV/AIDS.

Quality of life among pregnant women with chronic energy deficiency in rural Bangladesh

Quality of life scores of health conditions are needed for measuring quality adjusted life years (QALY), the most common outcome measure in cost-utility analysis. To measure QALY scores we used EQ-5D and a visual analogue scales (VIS). EQ-5D is a standardised instrument for measuring quality of life using five dimensions applicable to a wide range of health conditions. VAS had the endpoints "full health" and "death". We assessed the scores for chronic energy deficiency (CED) characterised by low body mass index (BMI<18.5), a condition highly prevalent among rural Bangladeshi women. EuroQol (EQ)-5D and VAS were used to measure when the condition was worst and VAS measured the current health status. We interviewed 285 pregnant and postpartum women, with 236 (83%) having complete information. Mean scores for CED when perceived to be most severe were 0.30 (EQ-5D, interquartile range -0.02 to 0.52) and 0.27 (visual analogue scale, interquartile range 0.12-0.39) in scales with scores ranging from -0.54 to 1.00 and from 0 to 1.00, respectively. The mean score for current health status derived from the visual analogue scale was 0.49 (95% CI for mean 0.45-0.52) in a scale with scores ranging from 0 to 1.00. Rural Bangladeshi women attached very low quality of life scores to CED. The scores are comparable to scores attached to severe debilitating conditions like cancer in western countries. If considered in the global perspective, prevention of chronic energy deficiency among women in developing countries should be given high priority.

Do Clinical Marker States Improve Responsiveness and Construct Validity of the Standard Gamble and Feeling Thermometer: A Randomized Multi-Center Trial in Patients with Chronic Respiratory Disease

BACKGROUND

Optimizing the validity and responsiveness of utility measures will enhance their usefulness in randomized trials. We evaluated the impact of clinical marker state (CMS) rating prior to patients' rating their own health on two utility instruments (feeling thermometer (FT) and standard gamble (SG)) in patients with chronic respiratory disease (CRD).

METHODS

We randomized 182 patients with CRD to complete the FT (self-administered) and SG with CMS (FT+/SG+, n=91) or without marker states (FT-/SG-, n=91) before and after undergoing respiratory rehabilitation in a multi-center trial.

RESULTS

Use of CMS did not influence baseline utility scores. Improvement after therapy on the scale from 0 (dead) to 1.0 (full health) was 0.04 both in FT+ (p=0.03) and FT- (p=0.02; the difference between FT+ and FT- was 0.00, p=0.83). Improvement on the SG was 0.05 in both SG+ (p=0.08) and SG- (p=0.04; difference between SG+ and SG- 0.00, p=0.95). Correlations with other health related quality of life scores were highest for FT+.

CONCLUSION

Administration of CMS did not improve responsiveness of the FT but may have improved construct validity. The SG showed limited construct validity and responsiveness that was not influenced by CMS use.

Self-reported health status of the general adult U.S. population as assessed by the EQ-5D and Health Utilities Index

OBJECTIVE

This study aimed to describe the self-reported health status of the general adult U.S. population using 3 multi-attribute preference-based measures: the EQ-5D, Health Utilities Index Mark 2 (HUI2), and Mark 3 (HUI3).

METHODS

We surveyed the general adult U.S. population using a probability sample with oversampling of Hispanics and non-Hispanic blacks. Respondents to this home-visit survey self-completed the EQ-5D and HUI2/3 questionnaires. Overall health index scores of the target population and selected subgroups were estimated and construct validity of these measures was assessed by testing a priori hypotheses.

RESULTS

Completed questionnaires were collected from 4048 respondents (response rate: 59.4%). The majority of the respondents were women (52.0%); the mean age of the sample was 45 years, with 14.8% being 65 or older. Index scores (standard errors) for the general adult U.S. population as assessed by the EQ-5D, HUI2, and HUI3 were 0.87 (0.01), 0.86 (0.01), and 0.81 (0.01), respectively. Generally, younger, male and Hispanic or non-Hispanic black adults had higher (better) index scores than older, female and other racial/ethnic adults; index scores were higher with higher educational attainment and household income. The 3 overall preference indices were strongly correlated (Pearson's r: 0.67-0.87), but systematically different, with intraclass correlation coefficients between these indices ranging from 0.59 to 0.77.

CONCLUSIONS

This study provides U.S. population norms for self-reported health status on the EQ-5D, HUI2, and HUI3. Although these measures appeared to be valid and demonstrated similarities, health status assessed by these measures is not exactly the same.

The relationship between health perception and utility in heart failure patients in a clinical trial: results from an OVERTURE substudy

BACKGROUND

Cost-effectiveness analyses should be based on incremental years of life gained adjusted with a health status measure known as a utility. Measuring utilities for all subjects in a large-scale randomized trial, however, would be prohibitively cumbersome. We therefore sought to estimate utilities for all subjects from results obtained in a subset of patients.

METHODS AND RESULTS

We studied a subset of patients enrolled in a randomized trial of omapatrilat for the treatment of heart failure. Survey instruments (a time trade-off questionnaire, a visual analog scale [VAS] score of overall health perception, and the Duke Activity Status Index [DASI]) were administered to patients by mail and by telephone interviews. There was a significant (P <.0001) relationship between VAS score and utility described by the power function u=1-(1-v)q, where q=2.17 (95% CI 1.76 to 2.58). There was a significant positive correlation (r=.17, P <.04) between the DASI and utility, and a significant negative correlation (r=-.26, P <.001) between utility and New York Heart Association functional class.

CONCLUSION

There is a significant relationship between the relatively easily obtainable health perception score by VAS with the more complex utility by time tradeoff for a subset of patients in a multicenter randomized clinical trial. This relationship may be helpful in examining the cost-effectiveness of new treatments for heart failure.

Invariance and inconsistency in utility ratings

PURPOSE

To assess utilities of composite health states for dependence in activities of daily living (ADLs) for invariance (i.e., when subjects provide a utility of 1 for all health states) and order inconsistency (i.e., when subjects order their utilities such that their utility for a combination of ADL dependencies is greater than their utility for any subset of the combination).

METHODS

Each of the 400 subjects, age 65 y and older, enrolled in one of several regional medical centers of the Kaiser Permanente Medical Care Program of Northern California and provided standard-gamble utilities for single ADL dependencies (e.g., bathing, dressing, continence) and for dependence in 8 other combinations of ADL dependencies. For order-inconsistent responses, the authors calculated the maximum magnitude of inconsistency as the maximum difference between the utility for the combined ADL dependence health state and that of its inconsistent subset.

RESULTS

A total of 76 subjects (19%) gave a utility of 1.0 for all health states presented to them; 19 (5%) gave the same utility other than 1.0 for all health states; 130 (33%) gave at least 1 utility < 1.0 and had no order inconsistencies; and 175 (44%) had at least 1 order inconsistency. Invariance was associated with a Mini-Mental Status Examination score < 28.6 (P = 0.01), with education < 12 y (P = 0.004), with race/ethnicity other than non-Hispanic White/Caucasian (P = 0.001), and with shorter time spent on the utility elicitation task (P < 0.0001). Among the inconsistent subjects, 69% had a maximal magnitude of inconsistency that was within 1 standard deviation of the mean utilities. The maximal magnitude of inconsistency was associated with longer time spent on the elicitation task (P < 0.0001) and race/ethnicity other than non-Hispanic White/Caucasian (P = 0.005). The mean (s) utility for dependence in continence among consistent subjects who were not invariant (0.88 [0.24]) was higher than among inconsistent subjects (0.80 [0.27]; P = 0.01).

CONCLUSIONS

Invariance and order inconsistencies in utility ratings for complex health states occur frequently. Utilities of consistent subjects may differ from those of inconsistent subjects. Utility assessments should attempt to measure and report these patterns.

Patient preferences and cost-utility analysis

This column discusses patient preference measures and their application in cost utility analysis. A variety of methods of eliciting patient preferences by use of generic utility measures are described. Practical issues in the use of utility measures are discussed.

Assessing patient utilities for varying degrees of low back pain

RATIONALE AND OBJECTIVES

We sought to quantify patient preferences for mild, moderate, and severe low back pain via time-tradeoff analysis and utility measurement.

MATERIALS AND METHODS

Forty-one patients being treated for low back pain in a tertiary care teaching hospital participated in the study. Patients were asked to decide which of three health states they were currently experiencing as well as which of the three health states was the worst experienced during their lifetime. A time-tradeoff analysis was performed, during which patients were asked the amount of time in each of the health states they would exchange for complete resolution of symptoms. We correlated (1) subjects' current health state with reported utility and (2) degree of previous low back pain with results of time-tradeoff measurements.

RESULTS

All patients were willing to trade a greater number of life-years for resolution of symptoms given a more severe perceived health state. Utility decreased as severity of back pain scenarios increased, with an average utility of 0.93 +/- 0.11 for mild, 0.65 +/- 0.21 for moderate, and 0.18 +/- 0.17 for severe pain. No significant difference in time-tradeoff among subjects was identified based upon current health state on the day of interview. A statistically significant difference was seen in patients' willingness to trade time among those who had actually experienced severe pain versus those who had not. Kendall's correlation revealed that subjects who had experienced severe back pain exhibited significantly lower utilities (P < 0.01) compared with subjects who had never experienced severe pain.

CONCLUSIONS

As expected, patients with severe low back pain were willing to sacrifice more potential years of life for resolution of symptoms, suggesting time-tradeoff can accurately reflect patient utility. 2. However, we found no correlation between a subject's current health state and reported utility.

Valuations of EQ-5D health states: are the United States and United Kingdom different?

PURPOSE

We sought to compare directly elicited valuations for EQ-5D health states between the US and UK general adult populations.

METHODS

We analyzed data from 2 EQ-5D valuation studies where, using similar time trade-off protocols, values for 42 common health states were elicited from representative samples of the US and UK general adult populations. First, US and UK population mean valuations were estimated and compared for each health state. Second, random-effect models were used to compare the US and UK valuations while adjusting for known predictors of EQ-5D valuations (ie, age, sex, health state descriptors) and to investigate whether and how the valuations differ.

RESULTS

Population mean valuations of the 42 health states ranged from -0.38 to 0.88 for the United States and from -0.54 to 0.88 for the United Kingdom, with the US mean scores being numerically higher than the UK for 39 health states (mean difference: 0.11; range: -0.01 to 0.25). After adjusting for the main effects of known predictors, the average difference in valuations was 0.10 (P < 0.001). The magnitude of the difference in the US and UK valuations was not constant across EQ-5D health states; greater differences in valuations were present in health states characterized by extreme problems.

CONCLUSIONS

Meaningful differences exist in directly elicited TTO valuations of EQ-5D health states between the US and UK general populations. Therefore, EQ-5D index scores generated using valuations from the US general population should be used for studies aiming to reflect health state preferences of the US general public.

Patient-derived health state utilities for gastroesophageal reflux disease

BACKGROUND AND AIMS

Gastroesophageal reflux disease is a chronic disease that adversely affects health-related quality of life. The purpose of this study was to derive health state utilities for patients with chronic heartburn symptoms.

METHODS

We used a custom-designed computer program in order to elicit utilities with the time-tradeoff and standard-gamble techniques. Patients with chronic (more than 6 months) symptoms of gastroesophageal reflux disease entered the study. Two interviews were performed in random sequence either initially on medications for heartburn that adequately controlled symptoms, or off of medications for 1 wk while the patient was symptomatic. We also collected data using visual-analog scales, quality of life in reflux and dyspepsia (QOLRAD), and Gastrointestinal Symptom Rating Scale (GSRS) scores.

RESULTS

We invited 222 patients to participate; 158 (71%) patients (129 men, 29 women) completed the study. Barrett's esophagus was present in 40 (25%), erosive disease in 17 (11%), and 118 (74%) had comorbid conditions. The mean (+/-SD) utility ratings were 0.94 +/- 0.09 on medical therapy and 0.90 +/- 0.12 off medications for patients with reflux alone using time tradeoff (p= 0.004), and 0.94 +/- 8.0 both on and off of antireflux medications with standard-gamble assessment (p= 0.96). Mean time-tradeoff scores were also significantly lower off of medications for patients with other comorbid conditions (p= 0.002). There was no significant difference between mean utility scores for patients with or without Barrett's esophagus or erosive disease.

CONCLUSION

Gastroesophageal reflux disease adversely affects health-related quality of life. Time-tradeoff utility for patients with reflux disease is substantially higher when patients are on medication than off medications.

Health-related quality of life in patients with pulmonary arterial hypertension

STUDY OBJECTIVES

Patients with pulmonary arterial hypertension (PAH) often present with dyspnea and severe functional limitations, but their health-related quality of life (HRQOL) has not been studied extensively. This study describes HRQOL in a cohort of patients with PAH.

DESIGN

Cross-sectional study.

SETTING

A tertiary care, university hospital-based, pulmonary hypertension (PH) clinic.

PARTICIPANTS

We studied HRQOL in 53 patients with PAH (mean age, 47 years; median duration of disease, 559 days). Eighty-three percent were women, 53% received epoprostenol, and 72% reported moderate-to-severe functional limitations with a New York Heart Association class 3 or 4 at enrollment.

MEASUREMENTS AND RESULTS

We examined HRQOL by administering the Nottingham Health Profile, Congestive Heart Failure Questionnaire, and Hospital Anxiety and Depression Scale. We used the Visual Analog Scale and standard gamble (SG) techniques to measure preferences for current health (utilities). Compared with population norms, participants reported moderate-to-severe impairment in multiple domains of HRQOL, including physical mobility, emotional reaction, pain, energy, sleep, and social isolation. Mean SG utilities were 0.71, suggesting that, on average, participants were willing to accept a 29% risk of death in order to be cured of PH.

CONCLUSIONS

PAH is a devastating condition that affects predominately young women in the prime of their life. Understanding HRQOL and preferences are important in the care and management of these patients. Compared with population norms, patients with PAH have substantial functional and emotional limitations that adversely affect their HRQOL.

What value health?: A review of health state values used in early technology assessments for NICE

The objective of this article was to review the methods used to obtain quality-of-life (utility) weights reported in assessments carried out for the National Institute for Health and Clinical Excellence (NICE).The design of the review was a cross-sectional survey. Health technology assessment (HTA) reports published on the NICE website up to May 2003 were reviewed. Data were extracted on the following: the approach to utility estimation (direct or indirect), how health states were described for indirect estimation, valuation techniques used (standard gamble [SG], time trade-off [TTO], visual analogue scale [VAS], etc.), whether uncertainty in utility estimates was explored in cost-utility analyses, and whether utility values were identified as a priority for further research by assessment authors.Fifty-six assessments were reviewed, of which 28 reported 45 cost-utility analyses. There was striking variation in the values used to describe different health states. Data from patients were used in 15 (33%) analyses, from the general public in 10 (22%) and from clinicians in 4 (9%). In 16 (36%) cases, the source for utility estimates was unclear. Health states were described using a range of generic and disease-specific measures, although the EQ-5D was used most frequently. In 25 analyses (56%), the valuation technique used was not reported. TTO was used in 11 (24%), SG in 3 (7%), magnitude estimation in 5 (11%) and VAS in 1 (2%). Sensitivity analyses based on utility values were reported in 25 cases (56%), more commonly in reports of analyses carried out by independent teams than technology sponsors although this may be subject to reporting bias. Further research into quality of life was recommended in 17 (61%) of the 28 assessment reports that contained at least one cost-utility analysis. Greater transparency and consistency are required in reporting the methods used to obtain quality-of-life weights in cost-utility analyses, and better sources of data are required. Methodological variation results in important differences in values. Therefore, caution must be exercised when comparing the results of different cost-utility analyses.

Are QALYs based on time trade-off comparable?--A systematic review of TTO methodologies

A wide range of methods is used to elicit quality-of-life weights of different health states to generate 'Quality-adjusted life years' (QALYs). The comparability between different types of health outcomes at a numerical level is the main advantage of using a 'common currency for health' such as the QALY. It has been warned that results of different methods and perspectives should not be directly compared in QALY league tables. But do we know that QALYs are comparable if they are based on the same method and perspective?The Time trade-off (TTO) consists in a hypothetical trade-off between living shorter and living healthier. We performed a literature review of the TTO methodology used to elicit quality-of-life weights for own, current health. Fifty-six journal articles, with quality-of-life weights assigned to 102 diagnostic groups were included. We found extensive differences in how the TTO question was asked. The time frame varied from 1 month to 30 years, and was not reported for one-fourth of the weights. The samples in which the quality-of-life weights were elicited were generally small with a median size of 53 respondents. Comprehensive inclusion criteria were given for half the diagnostic groups. Co-morbidity was described in less than one-tenth of the groups of respondents. For two-thirds of the quality-of-life weights, there was no discussion of the influence of other factors, such as age, sex, employment and children. The different methodological approaches did not influence the TTO weights in a predictable or clear pattern. Whether or not it is possible to standardise the TTO method and the sampling procedure, and whether or not the TTO will then give valid quality-of-life weights, remains an open question.This review of the TTO elicited on own behalf, shows that limiting cost-utility analysis to include only quality life weights from one method and one perspective is not enough to ensure that QALYs are comparable.

A catalog of dermatology utilities: a measure of the burden of skin diseases

Utilities are measures of quality of life that reflect the strength of individuals' preferences or values for a particular health outcome. As such, utilities represent a measure of disease burden. The aim of this article is to introduce the concept of utilities to the dermatology community and to present a catalog of dermatology utilities obtained from direct patient interviews. Our data are based on 236 total subjects from Grady Hospital (Atlanta, GA), Stanford Medical Center (Palo Alto, CA), and Parkland Hospital (Dallas, TX). The mean time trade-off utilities ranged from 0.640 for blistering disorders to 1.000 for alopecia, cosmetic, and urticaria. The mean utility across all diagnoses was 0.943. We present utilities for 17 diagnostic categories and discuss the underlying reasons for the significant disease burden that these utilities represent. We also present these dermatology categories relative to noncutaneous diseases to place the cutaneous utilities in perspective and to compare the burden of disease. We have demonstrated that skin diseases have considerable burden of disease and provided a preliminary repository of utility data for future researchers and policy makers.

Pilot Study of a Utilities-Based Treatment Decision Intervention for Prostate Cancer Patients

This pilot study evaluates a shared decision-making approach to individual decision making in localized prostate cancer care. The approach is based on a decision analytic model that incorporates patient utilities, ie, patient preferences among possible health states that might occur with prostate cancer treatments. Data on comorbidities, histologic grade of the biopsy, and age were obtained for 13 patients with newly diagnosed localized prostate cancer who received care in a Veterans Administration medical center. Using a standard gamble technique, interviewers obtained patient utilities for 5 distinct health states related to prostate cancer treatment. Utilities and patient clinical and pathologic characteristics were incorporated into the decision analytic model, and the derived quality-adjusted life expectancies were shared with the treating urologist before the first patient-physician discussion about treatment options. The results of the pilot study raised 2 major concerns. First, 4 patients had utility scores of 1.0 for all of the possible health states, and 7 patients had inconsistent utilities in which they rated both impotence and incontinence as a better health state than having just one of these problems. Second, the model recommended radiation therapy to individuals with a broad range of clinical characteristics, pathologic findings, and utility scores. Many of the patients who were recommended radiation therapy by the model received discordant recommendations from the treating urologist. Future refinements of both the utility assessment exercise and decision analytic model may be needed before the feasibility of the model in the clinical setting can be determined.