Methodologic evaluation of the radiology cost-effectiveness literature

Sustainability of paediatric radiology in Italy

Italy is the sixth most populous country in Europe and has the second highest average life expectancy, reaching 79.4 years for men and 84.5 for women. However, Italy has one of the lowest total fertility rates in the world: in 2018 it was 1.3 births per woman, with the population older than 65 comprising more than 30%, and those younger-than-19 less than 15%. Older people are the main concern of the Italian health system. Weighted coefficients for the allocation of funds favour older adults. As confirmed by our study, paediatric radiology is expensive, and the reimbursement based on Italian adult rates is not sufficient. The negative impact on the budget discourages the diffusion of paediatric radiology both in the private practices that provide services paid for by the state government and in the public hospitals. The 501 paediatric hospital units in Italy are not homogeneously distributed throughout the national territory. Furthermore, in Italy there are 12 highly specialised children's hospitals whose competences were defined in 2005 by the Ministry of Health. Paediatric radiology is not included among the highly qualified specialties. The quality gap in paediatric radiology between children's hospitals and general hospitals, the latter often without paediatric radiologists, is evident in daily practice with misdiagnoses and investigations not carried out.

Methodological reviews of economic evaluations in health care: what do they target?

INTRODUCTION AND OBJECTIVES

An increasing number of published studies of economic evaluations of health technologies have been reviewed and summarized with different purposes, among them to facilitate decision-making processes. These reviews have covered different aspects of economic evaluations, using a variety of methodological approaches. The aim of this study is to analyze the methodological characteristics of the reviews of economic evaluations in health care, published during the period 1990-2010, to identify their main features and the potential missing elements. This may help to develop a common procedure for elaborating these kinds of reviews.

METHODS

We performed systematic searches in electronic databases (Scopus, Medline and PubMed) of methodological reviews published in English, period 1990-2010. We selected the articles whose main purpose was to review and assess the methodology applied in the economic evaluation studies. We classified the data according to the study objectives, period of the review, number of reviewed studies, methodological and non-methodological items assessed, medical specialty, type of disease and technology, databases used for the review and their main conclusions. We performed a descriptive statistical analysis and checked how generalizability issues were considered in the reviews.

RESULTS

We identified 76 methodological reviews, 42 published in the period 1990-2001 and 34 during 2002-2010. The items assessed most frequently (by 70% of the reviews) were perspective, type of economic study, uncertainty and discounting. The reviews also described the type of intervention and disease, funding sources, country in which the evaluation took place, type of journal and author's characteristics. Regarding the intertemporal comparison, higher frequencies were found in the second period for two key methodological items: the source of effectiveness data and the models used in the studies. However, the generalizability issues that apparently are creating a growing interest in the economic evaluation literature did not receive as much attention in the reviews of the second period. The remaining items showed similar frequencies in both periods.

CONCLUSIONS

Increasingly more reviews of economic evaluation studies aim to analyze the application of methodological principles, and offer summaries of papers classified by either diseases or health technologies. These reviews are useful for finding literature trends, aims of studies and possible deficiencies in the implementation of methods of specific health interventions. As no significant methodological improvement was clearly detected in the two periods analyzed, it would be convenient to pay more attention to the methodological aspects of the reviews.

Systematic review, critical appraisal, and analysis of the quality of economic evaluations in stroke imaging

BACKGROUND AND PURPOSE

This study reviews the quality of economic evaluations of imaging after acute stroke and identifies areas for improvement.

METHODS

We performed full-text searches of electronic databases that included Medline, Econlit, the National Health Service Economic Evaluation Database, and the Tufts Cost Effectiveness Analysis Registry through July 2012. Search strategy terms included the following: stroke*; cost*; or cost-benefit analysis*; and imag*. Inclusion criteria were empirical studies published in any language that reported the results of economic evaluations of imaging interventions for patients with stroke symptoms. Study quality was assessed by a commonly used checklist (with a score range of 0% to 100%).

RESULTS

Of 568 unique potential articles identified, 5 were included in the review. Four of 5 articles were explicit in their analysis perspectives, which included healthcare system payers, hospitals, and stroke services. Two studies reported results during a 5-year time horizon, and 3 studies reported lifetime results. All included the modified Rankin Scale score as an outcome measure. The median quality score was 84.4% (range=71.9%-93.5%). Most studies did not consider the possibility that patients could not tolerate contrast media or could incur contrast-induced nephropathy. Three studies compared perfusion computed tomography with unenhanced computed tomography but assumed that outcomes guided by the results of perfusion computed tomography were equivalent to outcomes guided by the results of magnetic resonance imaging or noncontrast computed tomography.

CONCLUSIONS

Economic evaluations of imaging modalities after acute ischemic stroke were generally of high methodological quality. However, important radiology-specific clinical components were missing from all of these analyses.

Traumatic brain injury: methodological approaches to estimate health and economic outcomes

The effort to standardize the methodology and adherence to recommended principles for all economic evaluations has been emphasized in medical literature. The objective of this review is to examine whether economic evaluations in traumatic brain injury (TBI) research have been compliant with existing guidelines. Medline search was performed between January 1, 1995 and August 11, 2012. All original TBI-related full economic evaluations were included in the study. Two authors independently rated each study's methodology and data presentation to determine compliance to the 10 methodological principles recommended by Blackmore et al. Descriptive analysis was used to summarize the data. Inter-rater reliability was assessed with Kappa statistics. A total of 28 studies met the inclusion criteria. Eighteen of these studies described cost-effectiveness, seven cost-benefit, and three cost-utility analyses. The results showed a rapid growth in the number of published articles on the economic impact of TBI since 2000 and an improvement in their methodological quality. However, overall compliance with recommended methodological principles of TBI-related economic evaluation has been deficient. On average, about six of the 10 criteria were followed in these publications, and only two articles met all 10 criteria. These findings call for an increased awareness of the methodological standards that should be followed by investigators both in performance of economic evaluation and in reviews of evaluation reports prior to publication. The results also suggest that all economic evaluations should be made by following the guidelines within a conceptual framework, in order to facilitate evidence-based practices in the field of TBI.

Neuroimaging in patients referred to a neuro-ophthalmology service: the rates of appropriateness and concordance in interpretation

OBJECTIVE

Neuroimaging studies frequently are ordered to investigate neuro-ophthalmic symptoms. When misused, these studies are expensive and time consuming. This study describes the type and frequency of neuroimaging errors in patients referred to an academic neuro-ophthalmology service and measures how frequently these neuroimaging studies were reinterpreted.

DESIGN

Prospective cohort study.

PARTICIPANTS

Eighty-four consecutive patients referred to an academic neuro-ophthalmology practice.

METHODS

From November 2009 through July 2010, 84 consecutive new patients who had undergone a neuroimaging study in the last 12 months specifically to evaluate their presenting neuro-ophthalmic symptoms were enrolled prospectively. Participants then underwent a complete neuro-ophthalmic evaluation, followed by a review of prior neuroimaging. Questions regarding appropriateness of the most recent imaging, concordance of radiologic interpretation, and re-evaluation of referring diagnoses were answered by the attending physician.

MAIN OUTCOME MEASURES

The frequency and types of errors committed in the use of neuroimaging and the frequency of reinterpretation of prereferral neuroimaging studies after neuro-ophthalmic history and examination.

RESULTS

Most study participants (84.5%; 71/84) underwent magnetic resonance imaging before referral; 15.5% (13/84) underwent only computed tomography. The rate of suboptimal neuroimaging studies was 38.1% (32/84). The 3 most common reasons for suboptimal studies were incomplete area of imaging (34.4%; 11/32), wrong study type (28.1%; 9/32), and poor image quality (21.9%; 7/32). Twenty-four of 84 subjects (28.6%) required additional neuroimaging. The authors agreed with the radiology interpretation of the prior neuroimaging studies in most patients (77.4%; 65/84). The most common anatomic locations for discordance in interpretation were the intraorbital optic nerve (35%; 7/20) and the brainstem (20%; 4/20).

CONCLUSIONS

There was a high rate of suboptimal neuroimaging studies performed in patients referred for neuro-ophthalmology examination. These findings have significant implications given the increasing attention to resource use currently and in the near future.

Economic evaluation in radiology: reviewing the literature and examples in oncology

RATIONALE AND OBJECTIVES

To review US health care trends related to medical imaging utilization and costs as well as to present standard methods for conducting economic evaluation for health care interventions and medical imaging specifically.

MATERIALS AND METHODS

A review of the medical literature was performed to assess health policy and health technology assessment trends, expenditures, and cost-effectiveness analysis (CEA) related to medical imaging. Standard approaches to conducting economic evaluation and cost-effectiveness analysis were reviewed and summarized. Examples of CEA evidence related to imaging in select oncology conditions were presented.

RESULTS

Several high-quality methodology publications have provided guidance for conducting economic evaluation and CEA in radiology. There is variability in the quality of CEA models and their dissemination. However, there are numerous methodologically sound cost-effectiveness analyses for radiology procedures, and the evidence base of CEA studies for medical imaging continues to increase. Advanced imaging approaches for diagnosing and staging oncology conditions have the potential to provide cost-effective care when used in appropriate patient subpopulations.

CONCLUSIONS

Additional rigorous comparative effectiveness studies for advanced imaging, including cost-effectiveness analyses, can provide useful information to policy makers and health care providers on the relative effects and costs associated with diagnostic alternatives.

Applying evidence-based imaging to policy: the Washington State experience

In response to escalating medical costs and a lack of evidence supporting some medical procedures, the state of Washington initiated a new program to use evidence-based medicine to determine if medical technologies should be covered for reimbursement by state agencies. The Washington State Health Technology Assessment Program was formed to commission evidence reports on selected technologies and to determine reimbursement on the basis of evidence of effectiveness, safety, and cost-effectiveness. To date, the program has reviewed the imaging technologies of upright magnetic resonance imaging, computed tomographic colonography, and lumbar discography and has not found sufficient evidence to support reimbursement. This report details the structure of the program, the reasons for the committee's decisions, and the implications for radiology. Under the Washington model, stronger evidence for the effectiveness, safety, and cost-effectiveness of imaging will be required for the dissemination of new technologies and for reimbursement for some existing imaging approaches.

Cost-effectiveness of 99mTc-sestamibi in predicting response to chemotherapy in patients with lung cancer: systematic review and meta-analysis

Multidrug resistance (MDR) is a major problem in lung cancer. (99m)Tc-methoxyisobutylisonitrile ((99m)Tc-MIBI) has been demonstrated to be a noninvasive marker for the diagnosis of MDR-related P glycoprotein and MDR-associated protein expression in various solid tumors. Studies have shown that (99m)Tc-MIBI could play a significant role in the management of lung cancer; for example, it could be used in the selection of patients for chemotherapy or radiotherapy or in combined protocols before the start of treatment. Accurate selection of chemosensitive patients with (99m)Tc-MIBI would result not only in effective treatment of patients but also in significant cost savings for health care providers. There is increasing pressure on health care providers to consider costs in medical decision making, particularly in the last decade, as several economic evaluations have appeared in the medical literature. The aims of this study were to undertake a systematic review of the performance of (99m)Tc-MIBI imaging in the assessment of treatment resistance in lung cancer and to use the findings of the review in a decision tree analysis of the potential cost-effectiveness of (99m)Tc-MIBI imaging in selecting lung cancer patients for chemotherapy.

METHODS

This study included a systematic review of the literature and a meta-analysis together with a cost-effectiveness analysis of studies with a decision tree analysis model.

RESULTS

Analysis of the studies revealed that the overall sensitivity of (99m)Tc-MIBI in identifying responders to chemotherapy was 94%, the specificity was 90%, and the accuracy was 92%. The sensitivity analysis revealed an incremental cost-effectiveness ratio of greater than pound30,000 ( approximately $42,900) for the strategy of treating all patients to recover the small loss of life expectancy (7.5 d) associated with the use of (99m)Tc-MIBI to preselect patients for chemotherapy.

CONCLUSION

(99m)Tc-MIBI SPECT can accurately predict which patients with lung cancer will respond to chemotherapy. The use of (99m)Tc-MIBI to preselect patients for chemotherapy has the potential to yield significant cost savings in the health care system without a significant loss of life expectancy for patients.

A brief commentary on cost-effectiveness analysis in radiologic research

OBJECTIVE

This commentary provides a brief overview of cost-effectiveness analysis, which is increasingly applied in radiologic research. The purpose is to familiarize readers with the basic concepts in this topic and to provide help in appraising original articles in this area of research, as featured in this issue of the AJR.

CONCLUSION

Despite some limitations, decision-analytic modeling provides a useful tool for cost-effectiveness analysis in emerging technologies and helps to direct future research and the practice of radiology.

Evidence-based radiology and the ACR Appropriateness Criteria

The ACR Appropriateness Criteria are an important effort aimed at establishing when imaging should be used in medicine. However, substantial improvements in the Appropriateness Criteria are necessary for them to meet current standards for evidence-based guidelines. In this article, we provide concrete suggestions for improving the evidence basis of the Appropriateness Criteria.

Contrast-enhanced ultrasonography in the characterization of benign focal liver lesions: activity-based cost analysis

PURPOSE

The aim of this study was to perform a cost analysis of contrast-enhanced ultrasonography (CEUS) in the study of benign focal liver lesions (BFLL) with indeterminate appearance on ultrasonography (US).

MATERIALS AND METHODS

A decision model of patients with suspected BFLL on baseline US who subsequently underwent CEUS between 2002 and 2005 was constructed. We analysed the cost effectiveness of CEUS, considering whether or not computed tomography (CT) was necessary for the diagnosis. There were 398 patients with 213 angiomas, 41 focal nodular hyperplasias (FNH) and 154 pseudolesions (focal fatty sparing, focal fatty areas). Each patient underwent CEUS, and 98 of them were also studied by CT. All lesions were followed up.

RESULTS

The cost of a single CEUS examination was 101.51 euros, and that of a single CT scan was 211.48 euros. For diagnosis of haemangiomas, we saved 1,406.97 euros in 2002, 5,315.22 euros in 2003, 10,317.78 euros in 2004 and 9,536.13 euros in 2005. For diagnosis of focal nodular hyperplasias, we saved 781.65 euros in 2003, 781.65 euros in 2004 and 1,406.97 euros in 2005. For diagnosis of pseudolesions, we saved 2,813.94 euros in 2002, 5,158.89 euros in 2003, 5,158.89 euros in 2004 and 4,220.91 euros in 2005. In the period 2002-2005, the introduction of CEUS allowed us to save a total of 47,055.33 euros in the diagnosis of benign focal hepatic liver lesions.

CONCLUSIONS

This cost analysis shows that CEUS is the least expensive second-line modality after baseline US for the diagnosis of BFLL.

Quality appraisal of pediatric health economic evaluations

Objectives: This study was undertaken to appraise the quality of published pediatric economic evaluations.

Methods: Two independent reviewers appraised 149 randomly selected pediatric health economic studies. Data were collected from full economic evaluations published between 1980 and 1999. Economic evaluations of interventions, programs, and services aimed at neonates to adolescents were included. The Pediatric Quality Appraisal Questionnaire (PQAQ) was used for appraisal. The PQAQ is a 57-item instrument with 13 domains scored from 0 to 1 and one descriptive domain, each corresponding to a key aspect of health economic methodology. The primary outcome was the score for each domain. Additional analyses examined the global rating, the distribution of analytic technique, and the association between domain score and analytic technique.

Results: A total of 38 percent of publications were very good to excellent, whereas 43 percent were fair or worse. Although the Discounting, Target Population, Economic Evaluation, Conclusions, and Comparators domains exhibited good quality (0.74 to 0.78), the papers were of poor quality for Conflict of Interest, Incremental Analysis, and Perspective (0.32 to 0.39). Analytic technique was a significant predictor of quality for study design-related domains, with cost-utility analyses demonstrating the highest domain scores.

Conclusions: Domains closely related to the elements of economic evaluation demonstrated medium to high quality. However, domains related to analysis fared poorly and are worthy of further methodological research to improve the use of health economic methods in children.

Criteria list for assessment of methodological quality of economic evaluations: Consensus on Health Economic Criteria

Objectives:The aim of the Consensus on Health Economic Criteria (CHEC) project is to develop a criteria list for assessment of the methodological quality of economic evaluations in systematic reviews. The criteria list resulting from this CHEC project should be regarded as a minimum standard.

Methods:The criteria list has been developed using a Delphi method. Three Delphi rounds were needed to reach consensus. Twenty-three international experts participated in the Delphi panel.

Results:The Delphi panel achieved consensus over a generic core set of items for the quality assessment of economic evaluations. Each item of the CHEC-list was formulated as a question that can be answered by yes or no. To standardize the interpretation of the list and facilitate its use, the project team also provided an operationalization of the criteria list items.

Conclusions:There was consensus among a group of international experts regarding a core set of items that can be used to assess the quality of economic evaluations in systematic reviews. Using this checklist will make future systematic reviews of economic evaluations more transparent, informative, and comparable. Consequently, researchers and policy-makers might use these systematic reviews more easily. The CHEC-list can be downloaded freely fromhttp://www.beoz.unimaas.nl/chec/.

Growth and quality of the cost-utility literature, 1976-2001

PURPOSE

Cost-utility analyses (CUAs) have become increasingly popular, although questions persist about their comparability and credibility. Our objectives were to: 1) describe the growth and characteristics of CUAs published in the peer-reviewed literature through 2001; 2) investigate whether CUA quality has improved over time; 3) examine whether quality varies by the experience of journals in publishing CUAs, or the source of external funding for study investigators; and 4) examine changes in practices in US-based studies following recommendations of the US Panel on Cost-Effectiveness in Health and Medicine (USPCEHM). This study updates and expands our previous work, which examined CUAs through 1997.

METHODS

We conducted a systematic search of the English-language medical literature for original CUAs published from 1976 through 2001, using Medline and other databases. Each study was audited independently by two trained readers, who recorded the methodological and reporting practices used.

RESULTS

Our review identified 533 original CUAs. Comparing articles published in 1998 to 2001 (n = 305) with those published in 1976 to 1997 (n = 228), studies improved in almost all categories, including: clearly presenting the study perspective (73% vs. 52%, P < 0.001); discounting both costs and quality-adjusted life-years (82% vs. 73%, P = 0.0115); and reporting incremental cost-utility ratios (69% vs. 46%, P < 0.001). The proportion of studies disclosing funding sources did not change (65% vs. 65%, P = 0.939). Adherence to recommended practices was greater in more experienced journals, and roughly equal in industry versus non-industry-funded analyses. The data suggest an impact in methodological practices used in US-based CUAs in accordance with recommendations of the USPCEHM.

CONCLUSIONS

Adherence to methodological and reporting practices in published CUAs is improving, although many studies still omit basic elements. Medical journals, particularly those with little experience publishing cost-effectiveness analyses, should adopt and enforce standard protocols for conducting and reporting CUAs.

Functional MR Imaging versus Wada Test for Evaluation of Language Lateralization: Cost Analysis

PURPOSE

To compare the total direct costs (fixed and variable costs) of functional magnetic resonance (MR) imaging and of the Wada test for evaluation of language lateralization.

MATERIALS AND METHODS

The direct fixed and variable costs of functional MR imaging (performed in 21 patients with mean age +/- SD of 15.5 years +/- 8.9) and of the Wada test (performed in 18 patients aged 19.2 years +/- 5.4) were determined prospectively with time and motion analyses. The labor of all personnel involved in evaluations of language lateralization was tracked, and involvement times were recorded to the nearest minute. All material items used in the studies were recorded. Costs of labor and of materials were determined from personnel reimbursement data and from vendor pricing, respectively. Direct fixed costs were determined from hospital accounting department records. Means (+/- SDs) were calculated for all direct fixed and variable costs. Total direct costs were determined for each procedure and compared by using the Student t test.

RESULTS

The total direct costs of the Wada test (US dollars 1130.01 +/- US dollars 138.40) and of functional MR imaging (US dollars 301.82 +/- US dollars 10.65) were significantly different (P <.001). The cost of the Wada test was 3.7 times higher than that of functional MR imaging.

CONCLUSION

Substantial savings are achievable with the use of functional MR imaging instead of the Wada test to evaluate language lateralization.

The Pediatric Quality Appraisal Questionnaire: an instrument for evaluation of the pediatric health economics literature

OBJECTIVES

Currently there is no tool available to adequately appraise the quality of the pediatric health economics literature. A comprehensive pediatric-specific instrument would be valuable in informing allocation decisions related to pediatric interventions and services. The goal of this study was to develop the Pediatric Quality Appraisal Questionnaire (PQAQ).

METHODS

A draft instrument was constructed from published checklists and questionnaires. New questions pertaining to the pediatric population were incorporated. An expert panel reviewed the draft instrument and the proposed scoring scheme for face and content validity. A revised version was pilot tested by three independent appraisers. After addressing discrepancies in scores, a final version was created and subjected to interrater and test-retest reliability assessment.

RESULTS

The 57 items in the final PQAQ were mapped onto 14 domains: economic evaluation, comparators, target population, time horizon, perspective, costs and resource use, outcomes, quality of life, analysis, discounting, incremental analysis, sensitivity analysis, conflict of interest, and conclusions. Among the 57 items, 46 have response options that are scored from 0 to 1. Interrater reliability was 0.75 (95% confidence interval [CI] 0.66-0.81) and test-retest reliability was 0.92 (95% CI 0.71-0.98).

CONCLUSIONS

The PQAQ is a comprehensive instrument demonstrating face and content validity and strong interrater and test-retest reliability in the appraisal of pediatric economic evaluations. This tool will be valuable to health economists, methods researchers, and policy decision makers involved in allocation decisions for pediatric health care.

Vesicoureteral reflux imaging in children: comparative cost analysis

RATIONALE AND OBJECTIVES

The purpose of this study was to compare the costs of voiding cystourethrography (VCUG) versus radionuclide cystography (RNC) for evaluation of vesicoureteral reflux in children.

MATERIALS AND METHODS

The variable direct costs of performing 25 VCUG and 25 RNC examinations in age- and general health-matched patients suspected of having vesicoureteral reflux was determined by using time and motion analyses. All personnel directly involved in the cases were tracked, and the involvement times were recorded to the nearest minute. All material items used during the procedures were recorded. The cost of labor was determined from personnel reimbursement data, and the cost of materials, from vendor pricing. The fixed direct costs were assessed from hospital accounting records. Mean, standard deviation, and 95% confidence interval (CI) were determined for all direct (fixed and variable) costs. The total costs were determined for each procedure and compared by using the Student t test.

RESULTS

There was a significant difference (P < .0001) between the mean total direct cost of VCUG ($112.17 +/- 10.33) and that of RNC ($64.58 +/- 1.91). VCUG examination for vesicoureteral reflux in children cost 1.74 times more than RNC examination (95% CI: 1.28, 2.36).

CONCLUSION

When the technique is clinically appropriate, institutions may obtain substantial cost savings by using RNC in place of VCUG for examining children suspected of having vesicoureteral reflux.

Effect of emergency department CT on neuroimaging case volume and positive scan rates

RATIONALE AND OBJECTIVES

The authors performed this study to determine the effect a computed tomographic (CT) scanner in the emergency department (ED) has on neuroimaging case volume and positive scan rates.

MATERIALS AND METHODS

The total numbers of ED visits and neuroradiology CT scans requested from the ED were recorded for 1998 and 2000, the years before and after the installation of a CT unit in the ED. For each examination type (brain, face, cervical spine), studies were graded for major findings (those that affected patient care), minor findings, and normal findings. The CT utilization rates and positive study rates were compared for each type of study performed for both years.

RESULTS

There was a statistically significant increase in the utilization rate after installation of the CT unit (P < .001). The fractions of studies with major findings, minor findings, and normal findings changed significantly after installation of the CT unit for facial examinations (P = .002) but not for brain (P = .12) or cervical spine (P = .24) examinations. In all types of studies, the percentage of normal examinations increased. In toto, there was a significant decrease in the positive scan rate after installation of the CT scanner (P = .004).

CONCLUSION

After installation of a CT scanner in the ED, there was increased utilization and a decreased rate of positive neuroradiologic examinations, the latter primarily due to lower positive rates for facial CT scans.

Cost analysis model: US versus endometrial biopsy in evaluation of peri- and postmenopausal abnormal vaginal bleeding

PURPOSE

To develop a cost minimization analysis model from the societal perspective of Medicare reimbursement to determine whether endometrial biopsy or transvaginal ultrasonography (US) is less expensive in evaluating peri- and postmenopausal women with abnormal vaginal bleeding and to assess whether this strategy is equally effective in populations at low and high risk for endometrial carcinoma.

MATERIALS AND METHODS

Clinical algorithms were constructed that detailed diagnostic evaluation of the target population by using office-based endometrial biopsy versus transvaginal US as starting points. An economic model based on Medicare reimbursement and average wholesale drug price data and using disease prevalences and modality sensitivities from the scientific literature was then created to examine common bleeding causes in this population. All models included the cost of obtaining a tissue diagnosis for focal or diffuse endometrial thickening found at US. Modality sensitivities and prevalences of disease states were varied within the model to discover limits at which each modality became cheaper versus the other for assessing a population of women.

RESULTS

Population prevalence of neoplastic disease is the principal factor governing total cost between competing diagnostic algorithms. In populations with 31% or less combined prevalence of endometrial carcinoma/atypical adenomatous hyperplasia, algorithms utilizing transvaginal US as the initial test are most cost minimizing. At combined endometrial carcinoma/atypical adenomatous hyperplasia prevalence of 10%, savings of up to 11% and 16% over pathways initiated with endometrial biopsy are predicted. In populations with a high incidence of neoplastic disease (>31%), biopsy-based algorithms should become least costly.

CONCLUSION

Transvaginal US-initiated triage predicts substantial cost savings versus biopsy-based algorithms in evaluating typical populations of peri- and postmenopausal women with abnormal vaginal bleeding seen in clinical practice.

Resource cost analysis of cervical spine trauma radiography

PURPOSE

To determine the resource costs of the technical component of cervical spine radiography in patients with trauma and the factors that drive resource costs, to provide a model for resource cost estimation, and to compare resource costs with other methods of cost estimation.

MATERIALS AND METHODS

Direct measurement was made of technologist labor and supply costs of a cohort of 409 consecutive patients with trauma who underwent cervical spine radiography. Probability of cervical spine injury was determined by reviewing emergency department medical records. An animated simulation model was used to combine cost and injury probability estimates to determine resource costs. Sensitivity analysis explored factors that determined costs and estimated uncertainty in model estimations. Comparison was made with other cost estimates.

RESULTS

The average technical resource cost for cervical spine radiography was $49.60. Both direct labor ($19.60 vs $13.33; P <.005) and film ($8.39 vs $6.76; P <.005) costs were greater in patients with high probability of injury than in those with low probability of injury. Overall costs in patients with high probability of injury exceeded those in patients with low probability of injury by 33%. Resource costs exceeded Medicare resource-based relative value unit reimbursements for all patients with trauma.

CONCLUSION

Resource costs of the technical components of cervical spine radiography varied with patient probability of injury and were higher than Medicare reimbursements.

Cost-effectiveness analysis in radiology

In the past 20 years, there has been increasing recognition of the need to consider cost in medical decision making. This period has seen an explosion in the number of economic evaluations appearing in the medical literature. Cost-effectiveness analysis is an objective systematic technique for comparing alternative health care strategies on both cost and effectiveness simultaneously. Cost-effectiveness analysis can be used to inform medical decision makers in the establishment of clinical practice guidelines and in the setting of health policy. Cost-effectiveness analysis is a state-of-the-art research tool with its own terminology and methods. It is critical that radiologists become familiar with the concepts and procedures of cost-effectiveness analysis so they can properly evaluate cost-effectiveness analysis studies and be more knowledgeable participants in the health care decision-making process. This article explains the rationale, terminology, and methods of cost-effectiveness analysis as applied to radiology.

Accuracy of terminology and methodology in economic analyses in otolaryngology

OBJECTIVE

Economic studies increasingly guide health care resource allocation decisions. Because rigorous adherence to accepted definitions and research techniques is critical to ensure accuracy, we evaluated the terminology and methods of otolaryngology economic analyses.

STUDY DESIGN

A total of 71 articles published from 1990 to 1999 in 6 peer-reviewed otolaryngology journals with terms such as "cost-effective" in their title or representing economic analyses were reviewed for terminology and use of established methodology guidelines.

RESULTS

Over half (35 of 66) of terms such as "cost-effective" were used incorrectly, and 60% of articles (39 of 64) confused "charge" and "cost" data. Eleven percent (7 of 64) of papers specified the perspective of their analysis. About half (17 of 30) reported a summary measure such as a cost-effectiveness ratio. Only one third (23 of 63) performed sensitivity analyses.

CONCLUSION

Adherence to accepted definitions and research methods is inconsistent, although we did note moderate improvements in making the distinction between costs and charges, defining of study perspective, and performing sensitivity analysis.

SIGNIFICANCE

Greater attention to both terminology and methodology can enhance the quality of economic analyses and ultimately improve certain resource allocation decisions.

Critical issues in the economic evaluation of interventions against communicable diseases

Economic appraisal seeks to provide policy-makers with guidance about how scarce resources can be used to derive the greatest possible social benefit. Its use in the health sector has increased dramatically over the last decade although much of it has been focused on the problems of the more developed countries. The relatively sparse literature on communicable diseases has been dominated by interventions related to HIV/AIDS, hepatitis, malaria and tropical diseases. Reviews of this literature from the perspective of specific conditions such as Hepatitis B are already available, and recently the entire literature has been evaluated against the technical criteria for economic evaluations published in standard textbooks. Accordingly, this paper focuses on issues which would make economic appraisal more useful to policy-makers than it currently is. Given that few countries have the resources to undertake all the necessary analysis in their own settings, it is important that studies in one setting are undertaken in a way that allow generalisability to similar settings. Some of the most important challenges this poses for cost-effectiveness analysis (CEA) are identified. Firstly, incremental analysis is appropriate to local decision making when policy-makers are constrained to keep the current interventions and can consider only marginal improvements. However, it does not allow re-evaluation of existing interventions and is not transferable across settings. A version of Generalised CEA is proposed as an alternative. Secondly, data on costs and effectiveness are often not presented appropriately. The challenge for effectiveness is to adjust the evidence from efficacy studies to allow for different patient or population groups, and local variations in adherence, coverage, and infrastructure. For costs, it is important for studies to report the physical resources used in an intervention as well as unit prices. Thirdly, some long-term effects are still not well incorporated into CEA, especially those affecting child development and drug resistance. These questions are technically challenging and require more concerted efforts over the next few years. Finally, it is important for analysts to provide decision-makers with estimates of the resources that would be required to implement interventions claimed to be cost-effective. These improvements would better enable the evidence from economic analyses to enter the policy debate and be weighed against the other goals and objectives of the health system when allocating scarce resources.

A comprehensive league table of cost-utility ratios and a sub-table of "panel-worthy" studies

OBJECTIVES

The authors compiled a comprehensive league table of cost/QALY ratios, and a standardized table of analyses satisfying selected Reference Case criteria from the USPHS Panel on Cost-Effectiveness in Health and Medicine.

METHODS

They identified 228 cost-utility analyses (CUAs) through literature searches, and abstracted data on methods and cost-utility ratios. The subset of "Panel-worthy" analyses used: a societal or broad health-care perspective, community or patient preference weights, net costs, incremental comparisons, and discounting of costs and QALYs.

RESULTS

The 228 CUAs included ratios for 647 interventions, ranging from cost-saving to $52,000,000/QALY (median = $12,000/QALY). The standardized table presents 112 ratios that met the "Panel-worthy" criteria, with articles published in recent years more likely to meet all of the criteria.

CONCLUSIONS

The comprehensive league table (available on the Web) provides a useful reference, but ratios may not be comparable because of methodologic variations. The standardized table focuses on studies meeting basic methodologic criteria, potentially allowing for better comparison with future Reference Case analyses. Future studies should investigate the quality of analyses' underlying assumptions in addition to whether certain key procedural protocols were met.

The breast imaging center. Successful management in today's environment

Radiologists, because of their expertise in mammography and other diagnostic and imaging tests, are assuming an increasing role in the diagnosis of breast cancer, but are faced with decreasing reimbursements and a shortage of trained mammographers. Delegation of many physicians' tasks to nonphysician employees is more cost-effective. Reimbursements must be increased to support radiologists in their expanded role.

The quality of reporting in published cost-utility analyses, 1976-1997

PURPOSE

Cost-utility analysis is a type of cost-effectiveness analysis in which health effects are measured in terms of quality-adjusted life-years (QALYs) gained. Such analyses have become popular for examining the health and economic consequences of health and medical interventions, and they have been recommended by leaders in the field. These recommendations emphasize the importance of good reporting practices. This study determined 1) the quality of reporting in published cost-utility analyses through 1997 and 2) whether reporting practices have improved over time. We examined quality of reporting by journal type and number of cost-utility analyses a journal has published.

DATA SOURCES

Computerized databases were searched through 1997 for the Medical Subject Headings or text keywords quality-adjusted, QALY, and cost-utility analysis. Published bibliographies of the field were also searched.

STUDY SELECTION

Original cost-utility analyses written in English were included. Cost-effectiveness analyses that measured health effects in units other than QALYs and review, editorial, or methodologic articles were excluded.

DATA EXTRACTION

Each of the 228 articles found was audited independently by two trained readers who used a standard data collection form to determine the quality of reporting in several categories: disclosure of funding, framing, reporting of costs, reporting of preference weights, reporting of results, and discussion.

RESULTS

The number of cost-utility analyses in the medical literature increased greatly between 1976 and 1997. Analyses covered a wide range of diseases and interventions. Most studies listed modeling assumptions (82%), described the comparator intervention (83%), reported sensitivity analysis (89%), and noted study limitations (84%). Only 52% clearly stated the study perspective; 34% did not disclose the funding source. Methods of reporting costs and preference weights varied widely. The quality of published analyses improved slightly over time and was higher in general clinical journals and in journals that published more of these analyses.

CONCLUSIONS

The study results reveal an active and evolving field but also underscore the need for more consistency and clarity in reporting. Better peer review and independent, third-party audits may help in this regard. Future investigations should examine the quality of clinical and economic assumptions used in cost-utility analyses, in addition to whether analysts followed recommended protocols for performance and reporting.

Cost identification of abdominal aortic aneurysm imaging by using time and motion analyses

PURPOSE

To compare the costs of performing helical computed tomographic (CT) angiography with three-dimensional rendering versus intraarterial digital subtraction angiography (DSA) for preoperative imaging of abdominal aortic aneurysms (AAAs).

MATERIALS AND METHODS

A single observer determined the variable direct costs of performing nine intraarterial DSA and 10 CT angiographic examinations in age- and general health-matched patients with AAA by using time and motion analyses. All personnel directly involved in the cases were tracked, and the involvement times were recorded to the nearest minute. All material items used during the procedures were recorded. The cost of labor was determined from personnel reimbursement data, and the cost of materials, from vendor pricing. The variable direct costs of laboratory tests and using the ambulatory treatment unit for postprocedural monitoring, as well as all fixed direct costs, were assessed from hospital accounting records. The total costs were determined for each procedure and compared by using the Student t test and calculating the CIs.

RESULTS

The mean total direct cost of intraarterial DSA (+/- SD) was $1,052 +/- 71, and that of CT angiography was $300 +/- 30, which are significantly different (P < 4.1 x 10(-11)). With 95% confidence, intraarterial DSA cost 3.2-3.7 times more than CT angiography for the assessment of AAA.

CONCLUSION

Assuming equal diagnostic utility and procedure-related morbidity, institutions may have substantial cost savings whenever CT angiography can replace intraarterial DSA for imaging AAAs.

Development of WHO guidelines on generalized cost-effectiveness analysis

The growing use of cost-effectiveness analysis (CEA) to evaluate specific interventions is dominated by studies of prospective new interventions compared with current practice. This type of analysis does not explicitly take a sectoral perspective in which the costs and effectiveness of all possible interventions are compared, in order to select the mix that maximizes health for a given set of resource constraints. WHO guidelines on generalized CEA propose the application of CEA to a wide range of interventions to provide general information on the relative costs and health benefits of different interventions in the absence of various highly local decision constraints. This general approach will contribute to judgements on whether interventions are highly cost-effective, highly cost-ineffective, or something in between. Generalized CEAs require the evaluation of a set of interventions with respect to the counterfactual of the null set of the related interventions, i.e. the natural history of disease. Such general perceptions of relative cost-effectiveness, which do not pertain to any specific decision-maker, can be a useful reference point for evaluating the directions for enhancing allocative efficiency in a variety of settings. The proposed framework allows the identification of current allocative inefficiencies as well as opportunities presented by new interventions.

The past 25 years in medical imaging research: a memoir

During the past 25 years, medical imaging research has progressed in both scope and quality. Factors intrinsic to the specialty and changes occurring in medicine and society have fostered imaging research development. The advent of new, computer-based technologies that can be brought to bear on research, the increasing sophistication of researchers, and the greater availability of extramural funding have been primary factors in the promulgation of research improvements. Radiology researchers have the opportunity to play an important role in the genesis of the molecular medicine of the future. Whether they do so is dependent on whether radiologists identify necessary resources, new researchers receive appropriate training, and investigators are willing to think differently than they have in the past about the capabilities of imaging.

A critical synopsis of the diagnostic and screening radiology outcomes literature

In summary, the radiology outcomes research literature is both extensive and broad. The methodologic quality, however, is quite variable. Overall, this quality could be improved by intervention in two areas: methodologic dissemination and development. The number of researchers investigating radiology-related outcomes is high, and presently there are over 20 journals devoted exclusively to radiology research. Even with a relatively narrow definition of "outcomes," we identified over 200 radiology outcomes studies, most from the past few years. However, the methodologic quality of most of these articles was relatively low, with important design flaws and biases. Nonetheless, a substantial number of radiology publications do employ state-of-the-art research methods and innovative approaches to methodologic challenges. The quality of radiology outcomes research overall would benefit tremendously from dissemination of such research methods. Instruction in outcomes research methods is accessible to radiologists. For example, there have been several recent articles and series of articles on outcomes research methods in JAMA, including guidelines for the performance and reporting of cost-effectiveness analyses (38-40) and for developing clinical prediction rules (57). Within radiology, several recent articles have appeared on, among other things, cost-effectiveness analysis (34,59,60), assessing quality of life (43), screening for disease (53), and defining the study population (61). The research compendium compiled for the GERRAF (General Electric-Association of University Radiologists Radiology Research Academic Fellowships) program remains a comprehensive methodologic source for many of the issues in radiology outcomes research, and outcomes research methods courses are offered every year at the Society for Health Services Research in Radiology and Society for Medical Decision Making meetings, as well as at the meeting of the Radiological Society of North America. Even so, awareness of the need for such research techniques remains limited. Dissemination of sound research methods is limited at least in part by the current incentives in radiology research. At many institutions, the number of research publications produced, rather than their quality, determines promotion or academic success. Unfortunately, more rigorous study designs often require more time and resources. Further, because peer reviewers are often as uninformed about research methods as the bulk of those who are submitting manuscripts, it may actually be more difficult to publish articles with more advanced methodologic designs. The standard in radiology is the uncontrolled case series, and deviation from the standard may make acceptance for publication more difficult. On a more optimistic note, recent publication of a number of methodology articles suggests that at least some journals are promoting improved research in methodology (43,53,59-61). We hope that time will be available for manuscript reviewers to learn to understand the strengths and weaknesses of various research approaches. If more rigorous study designs were required for publication, radiology outcomes research would probably improve drastically. Nevertheless, the current peer-review system does not effectively promote sound research design. The other great incentive in research is funding. Clearly, if advanced research design is required for funding, then there is incentive for improvement in research quality. Traditionally, National Cancer Institute and other National Institutes of Health and public sector funding has been predicated on a high level of research sophistication. Undoubtedly, availability of grants for diagnostic and screening imaging clinical trials and other research will go far to improve radiology research methods. The other traditional source of research funding is industry.

The cost-effectiveness of fine-needle aspiration cytology and 14-gauge core needle biopsy compared with open surgical biopsy in the diagnosis of breast carcinoma

BACKGROUND

Judicious utilization of fine-needle aspiration cytology (FNAC) and 14-gauge core needle biopsy (CB) theoretically should result in greater accuracy in breast carcinoma diagnosis and fewer unnecessary open surgical biopsies (OSBs), thus lowering health care costs.

METHODS

In 1995 in Rochester, New York, the ratio of open surgical breast biopsies per each verified breast carcinoma (OSB/Ca) in a freestanding breast clinic (EWBC) was compared with the OSB/Ca ratio of all physicians in the remainder of the city. The EWBC differs from all other diagnostic facilities in Rochester in that it routinely performs FNAC and CB.

RESULTS

The EWBC recommended 462 OSBs resulting in 310 verified carcinomas, for a OSB/Ca ratio of 1.5. The physicians in the remainder of the city recommended 2036 OSBs resulting in 513 verified carcinomas, for a OSB/Ca ratio of 4.0. If the EWBC OSB/Ca ratio had been identical to the remainder of the city, the number of extra OSBs recommended by the clinic would have been 778, resulting in an additional cost of $1,712,082. When the added cost of the 2594 FNACs ($256,285) and 403 CBs ($252,278) performed by the clinic was subtracted from the $1,712,082, the freestanding breast clinic cost savings was $1,203,519. The lymph node metastasis rate of 19% for the breast carcinomas diagnosed in clinic patients was identical to that of the women with breast carcinoma in the remainder of the city.

CONCLUSIONS

Utilization of FNAC and CB allows radiologists to lower their OSB/Ca ratio without sacrificing early detection. In this study, these less expensive procedures result in lowered medical costs for the health care system.

Economic analyses of radiological procedures: a methodological evaluation of the medical literature

OBJECTIVE

Increasing pressure to curb health care costs has led to considerable interest in economic analyses, including both cost-effectiveness and cost-benefit analyses. Numerous economic analyses of radiological procedures have appeared in both the radiology and non-radiology literature. The objective of this study was to evaluate the methodological quality of economic analyses of radiological procedures published in the non-radiology medical literature during the years 1990 1995.

METHODS

Original investigations from the medical (non-radiological) literature that include economic analyses of radiological interventions were identified from a computerized literature search. Each economic analysis article was evaluated by two independent reviewers for adherence to ten methodological criteria. The criteria were derived from review of the medical and radiological economic analysis methodology literature and consisted of the following: (1) Comparative options stated; (2) perspective of analysis defined; (3) outcome measure identified; (4) cost data included; (5) source of cost data stated; (6) long term costs included; (7) discounting employed; (8) summary measure provided; (9) incremental computation method used; and (10) sensitivity analysis performed. The results were compared to a previous study that evaluated the radiological literature.

RESULTS

Of the 56 articles in the medical literature that included economic analyses of radiological procedures, only eight (14%) conformed to all ten methodological criteria. The cost data (98%) and comparative options (89%) criteria exhibited high compliance, while the perspective of analysis (25%) and discounting (32%) criteria had relatively low compliance. Agreement between the reviewers was excellent (kappa = 0.88).

CONCLUSIONS

Published economic analyses of radiology procedures usually do not meet accepted methodological standards.