Guidelines for the clinical and economic evaluation of health care technologies

Therapeutic value in the time of digital brainwaves

This article examines the value of medical technology through the case of electroencephalograms (EEGs), devices used to visualize brain activity and diagnose seizures. Drawing on ethnographic fieldwork, the article shows that EEGs are valued differently by patients and medical practitioners. While practitioners value EEGs for their clinical utility, i.e., ability to inform clinical decisions, patients value EEGs even in the absence of clinical utility. Indeed, patients derive long-lasting therapeutic effects from this diagnostic technology. These findings intervene in the utilitarian calculus of therapeutic value-a mode of reasoning that equates value with clinical utility-commonly deployed in biomedicine and engineering and call for a recognition of alternative notions such as the therapeutic value of being witnessed and cared for by medical experts via EEGs and other technologies that require time to work. Expansive notions of therapeutic value are imperative for including marginalized patients-especially low-income, disabled, and women patients-in debates on automation and the future of healthcare. Studying how multiple stakeholders value a medical technology provides insight into valuation, objectification, expertise, and other concerns central to science and technology studies.

A systematic review of discounting in national health economic evaluation guidelines: healthcare value implications

Aim: This review summarizes the discounting approaches recommended in current economic evaluation (EE) guidelines for healthcare programs and interventions. Materials & methods: A systematic review of EE guidelines for healthcare, published up to July 2022, was conducted. Results: A total of 52 EE guidelines were reviewed. The majority of these guidelines recommend equal discounting (80.8%) rather than differential discounting (9.6%). The rationale for equal discounting includes recommendations by the government, consistency with other countries, and economic development. However, the rationale for differential discounting is based on the interest in short-term government bonds and anticipated budget changes. Discussion: This review demonstrates variation in both discounting approaches and rates across EE guidelines and underscores the need for a global consensus on discounting approaches.

A comprehensive review of official discount rates in guidelines of health economic evaluations over time: the trends and roots

BACKGROUND

The question of discounting in health economics is anything but settled, so much so that a section of the Health Technology Assessment (HTA) guidelines is devoted to it.

OBJECTIVE

This study aimed to review the trend of the value of the official discount rates (DRs) of costs and health outcomes and their roots worldwide.

METHODS

Four methods were combined to identify official DRs over time globally. These methods included a systematic review of the HTA/pharmacoeconomic/health economic evaluation guidelines, a review of methodological documents or guidelines accessible on the websites of HTA organizations, and two separated reviews of the websites of the International Society for Pharmacoeconomics and Outcomes Research (ISPOR) and the Guide to Health Economic Analysis and Research (GEAR).

RESULTS

Our systematic search eventually yielded 339 documents from the literature, 35 links from the website of the HTA organizations, 51 documents from the website of the ISPOR, and 29 documents from the website of the GEAR. These documents referred to 48 countries over 30 years and 43 transnational guidelines over 43 years. DRs of 3% and 5% had the most frequent value. Among them, 38 countries always used an equal DR of costs and health outcomes. We categorized the rationales for selecting DRs into eight groups for the national documents and six groups for the transnational documents.

CONCLUSION

The comparability approach was the most frequent rationale for choosing the DR in national and transnational guidelines. The value of DR of costs and health outcomes ranged from zero to 10% over the years, but the most common values were 3% and 5%, mainly arising from the comparability approach chosen. Several transnational guidelines have suggested a specific DR without taking into account countries' economic conditions. It is useful to establish a specific guideline for calculating and updating the DR of the health sector in each country.

Carpal Tunnel Syndrome Management in Breast Cancer Survivors at Risk for Lymphedema: A Markov Model

BACKGROUND

Breast cancer survivors that have undergone axillary lymph node dissection have an increased risk of developing same-side upper extremity lymphedema. Patients with carpal tunnel syndrome in the ipsilateral limb may not receive appropriate surgical therapy (carpal tunnel release) because of concerns that it may trigger or worsen lymphedema.

METHODS

A state transition cohort model was used to evaluate the treatment options for breast cancer survivors at risk of upper extremity lymphedema presenting with carpal tunnel syndrome. The model reflected three treatment strategies: (1) early surgical intervention, (2) delayed surgical intervention, or (3) nonsurgical management. Both life-years and quality-adjusted life-years were modeled over a 30-year time horizon.

RESULTS

Over a 30-year time horizon, the preferred strategy was delayed surgery, which resulted in 21.41 quality-adjusted life-years. Early surgery and nonsurgical management yielded 20.42 and 21.06 quality-adjusted life-years, respectively. The model was robust and was not sensitive to variation in any of the parameters within the clinically plausible ranges.

CONCLUSIONS

Based on this decision analytic model, the optimal choice for breast cancer survivors with mild carpal tunnel syndrome who are at risk for lymphedema would be delaying surgery until severe symptoms develop. This strategy balances the potential increased risk of lymphedema following carpal tunnel release with the decreased long-term risk of severe carpal tunnel syndrome. The model comprehensively assesses a controversial area in the breast cancer and hand surgery literature to inform decision-making for patients and clinicians.

A systematic review of pharmacoeconomic guidelines

OBJECTIVE

To review, summarize, and analyze both similarities and differences of pharmacoeconomic (PE) guidelines, to enable researchers to access their characteristics and the current state of PE guidelines; furthermore, to learn which methodological issues still remain contested and to promote the methodological development of PE guidelines.

MATERIALS AND METHODS

The authors performed a search for PE guidelines using PubMed, the Cochrane library database, and the websites of the International Society for Pharmacoeconomics and Outcomes Research. Information of each guideline was extracted using a pre-designed extraction template, which included 22 aspects; the guidelines were summarized in the forms of charts, and their characteristics have been described.

RESULTS

A total of 40 PE guidelines were studied. The most common methodological issues include the types of analysis, sources for effectiveness, use of quality-adjusted life-years (QALYs) to measure outcomes, and use of incremental cost effectiveness ratios to present results. The majority of the guidelines preferred a cost utility analysis with outcomes expressed in terms of QALYs. Most of the guidelines preferred meta-analysis or meta-analysis of the randomized controlled trials, and required a systematic review of all evidence. Issues that varied most in the guidelines were the choice of the comparator, recommended costs to be included, methods related to indirect cost calculations, methods of sensitivity analysis, and discounting rate.

CONCLUSION

A comparison of these guidelines revealed that a number of differences exist among them in several key aspects, and some critical methodological issues still exist, for which no best solution is available. Furthermore, efforts need to be made to develop harmonious methods for the PE, and to improve the transferability of the outcomes of PE evaluations.

How do economic evaluations inform health policy decisions for treatment and prevention in Canada and the United States?

Canadian and US health systems have often been characterized as having vastly different approaches to the financing and delivery of healthcare, with Canada portrayed as more reliant on rationing based on costs. In this article, we examine the similarities and differences between the two countries, the evolution and current role of health economic evaluation, and the roles played by health economists. We suggest both countries have similarly used economic evaluation to a limited extent for drug and immunization decisions, with variability in use more of a reflection of the incompleteness of both systems and their inherent institutional barriers rather than political ideology.

Image-based medical expert teleconsultation in acute care of injuries. A systematic review of effects on information accuracy, diagnostic validity, clinical outcome, and user satisfaction

Objective

To systematically review the literature on image-based telemedicine for medical expert consultation in acute care of injuries, considering system, user, and clinical aspects.

Design

Systematic review of peer-reviewed journal articles.

Data sources

Searches of five databases and in eligible articles, relevant reviews, and specialized peer-reviewed journals.

Eligibility criteria

Studies were included that covered teleconsultation systems based on image capture and transfer with the objective of seeking medical expertise for the diagnostic and treatment of acute injury care and that presented the evaluation of one or several aspects of the system based on empirical data. Studies of systems not under routine practice or including real-time interactive video conferencing were excluded.

Method

The procedures used in this review followed the PRISMA Statement. Predefined criteria were used for the assessment of the risk of bias. The DeLone and McLean Information System Success Model was used as a framework to synthesise the results according to system quality, user satisfaction, information quality and net benefits. All data extractions were done by at least two reviewers independently.

Results

Out of 331 articles, 24 were found eligible. Diagnostic validity and management outcomes were often studied; fewer studies focused on system quality and user satisfaction. Most systems were evaluated at a feasibility stage or during small-scale pilot testing. Although the results of the evaluations were generally positive, biases in the methodology of evaluation were concerning selection, performance and exclusion. Gold standards and statistical tests were not always used when assessing diagnostic validity and patient management.

Conclusions

Image-based telemedicine systems for injury emergency care tend to support valid diagnosis and influence patient management. The evidence relates to a few clinical fields, and has substantial methodological shortcomings. As in the case of telemedicine in general, user and system quality aspects are poorly documented, both of which affect scale up of such programs.

Improving the quality of abstract reporting for economic analyses in oncology

BACKGROUND

The increasing cost of cancer drugs underscores the importance of economic analyses. Although guidelines for abstract reporting of randomized controlled studies and phase i trials are available, similar recommendations for conference abstracts of economic analyses are lacking. Our objectives were to identify items considered to be essential in abstracts of economic analyses;to evaluate the quality of abstracts submitted to the American Society of Clinical Oncology (asco), the American Society of Hematology (ash), and the International Society for Pharmacoeconomics and Outcomes Research (ispor) meetings; andto propose guidelines for future abstract reporting at conferences.

METHODS

Health economic experts were surveyed and asked to rate each of 24 possible abstract elements on a 5-point Likert scale. A scoring system for abstract quality was devised based on elements with an average expert rating of 3.5 or greater. Abstracts for economic analyses from asco, ash, and ispor meetings were reviewed and assigned a quality score.

RESULTS

Of 99 experts, 50 (51%) responded to the survey (average age: 53 years; 78% men; 54% from the United States, 28% from Europe, 18% from Canada). In total, 216 abstracts were reviewed: asco, 53%; ash, 14%; and ispor, 33%. The median quality score was 75, but notable deficiencies were observed. Cost perspective was reported in only 61% of abstracts, and time horizon was described in only 47%. Abstracts from recent years demonstrated better quality scores. We also observed disparities in quality scores for various cancer sites (p = 0.005).

CONCLUSIONS

The quality of conference abstracts for economic analyses in oncology has room for improvement. Abstracts may be enhanced using the guidelines derived from our survey of experts.

[Cost-effectiveness of the previous appointment in family medicine outpatient clinics]

OBJECTIVE

To determine the cost-effectiveness of the previous appointment.

DESIGN

Cost-effectiveness study.

SETTING

Family Medicine Unit in the Mexican Public Health System, in March and April 2008.

PARTICIPANTS

All Family Medicine outpatient clinic offices who use the appointment system were included (n=32).

MEASUREMENTS

The productivity, doctor and user dimensions were analysed in the two shifts (morning and evening) operated by the Unit. Productivity included the percentage of appointments (appointment requested more than 12h before the visit), spontaneous users, those seen and cancellations; the cost was adjusted for productivity. Effectiveness was measured using doctor and patient satisfaction, on a scale from 1 to 10. The cost-effectiveness analysis took into account the perspective of the patient and the doctor in the different scenarios that considered the percentage of previous appointments. The evaluation included an incremental analysis.

RESULTS

For the doctor, the best cost-effectiveness is in the scenario of 60% previous appointments, and the worst with 50% previous appointments. The cost differences in the incremental analysis by scenarios is 15,019 euro and 76,611 euro. From the perspective of the patient (n=96), the best cost-effectiveness is in the 70% previous appointment scenario, while the worst is the one with 50%. The incremental analysis with differences by scenarios is 5,248 euro and 330,293 euro.

CONCLUSIONS

The best cost-effectiveness of the previous appointment is achieved with appointment percentages between 60 and 70%.

Functional and Cognitive Capacity and Health-Related Quality of Life 2 Years After Day Hospital Rehabilitation for Stroke: A Prospective Study

This study prospectively evaluated long-term outcome 2 years after 6-8 weeks of day hospital rehabilitation (DHR) for stroke in younger patients. Assessment findings after discharge from DHR and at follow-up 2 years later using 3 instruments--the FIM (originally known as the Functional Independence Measure), SF-36, and EuroQol (now known as EQ-5D)--were compared. The study group comprised 50 consecutive patients age 18-60 years at the time of their initial stroke who had participated in a prospective study of the effects of DHR after stroke. Living conditions were assessed using the Riks-Stroke stroke care register. Patient handicaps were graded according to the Oxford Handicap Scale. The patients maintained functional and cognitive capacity, as well as self-rated health and health-related quality of life (HRQoL), 2 years after discharge. A significant improvement was also seen in cognitive capacity and in HRQoL as assessed by EuroQol, but in only 1 of the 8 SF-36 domains. The changes in functional capacity and HRQoL were significantly and inversely correlated with the scores at discharge from DHR. Follow-up scores for EuroQol were correlated with scores for physical and cognitive capacity. Women demonstrated less improvement in EuroQol scores than men. Our findings indicate that most stroke patients who sustained initial acute stroke at age 18-60 years and received 6-8 weeks of DHR poststroke maintained functional and cognitive capacity as well as HRQoL after 2 years. Some patients even may have improved their cognitive capacity and HRQoL.

Prospective randomized trial comparing shock wave lithotripsy and ureteroscopic lithotripsy for management of large upper third ureteral stones

OBJECTIVES

To conduct a prospective and randomized trial to compare the efficiency quotient and cost-effectiveness index of shock wave lithotripsy (SWL) and ureteroscopic lithotripsy (URSL) for the treatment of large upper third ureteral stones.

METHODS

A total of 35 male patients and 7 female patients with a solitary, radiopaque upper ureteral stone, 15 mm or more in diameter, who underwent SWL or URSL were enrolled in this study. The mean patient age was 53.1 +/- 14.5 years. The endpoint of the study was for the patient to be stone free or to have insignificant residual stone (3 mm or less) within the kidney.

RESULTS

The mean stone length +/- SD was 17.9 +/- 3.9 cm in the SWL group and 18.5 +/- 2.9 cm in the URSL group (P > 0.05). The efficiency quotient for SWL and URSL was 0.61 and 0.63, respectively. The cost-effectiveness index, treatment time, pain score, and hospital stay were greater in the URSL group. However, the degree of hydronephrosis significantly influenced the success rate of SWL. All patients with severe hydronephrosis in the SWL group needed auxiliary surgical procedures to become stone free.

CONCLUSIONS

The efficiency quotients of SWL and URSL were comparable in the treatment of large upper third ureteral stones. However, SWL should not be recommended as the first-line treatment option for the management of upper third ureteral stones larger than 1.5 cm with severe hydronephrosis. Understanding the cost-effectiveness, success rate, pain score, and patient satisfaction score for the two different approaches constitutes the indispensable requisites for choosing the optimal first-line therapeutic strategy.

Farmacoeconomia: perspectiva emergente no processo de tomada de decisão

A farmacoeconomia, uma disciplina nova, surgida no cenário internacional na década de 1980, tem crescido de forma expressiva, especialmente no âmbito dos sistemas de saúde. Sua forma de investigação mais difundida é a avaliação econômica da terapia medicamentosa, em que são usados métodos oriundos da economia da saúde. A farmacoeconomia identifica, calcula e compara custos (recursos consumidos), riscos e benefícios (clínicos, econômicos, humanísticos) de programas ou terapias específicas, e determina quais são as alternativas que produzem os melhores resultados em face dos recursos investidos. O presente artigo aborda os princípios norteadores da farmacoeconomia; descreve os tipos de análise e discorre sobre as aplicações da disciplina nos diferentes segmentos da sociedade. A farmacoeconomia pode constituir-se num importante instrumento de auxilio à tomada de decisões, pois introduz nos serviços de saúde, entre os profissionais, a racionalidade econômica, como o intuito de complementar a clínica. A utilização correta dos termos e o conhecimento da metodologia são, porém, pré-requisitos indispensáveis para aplicar, e interpretar corretamente, os resultados das investigações.

Adapting and disseminating effective public health interventions in another country: towards a systematic approach

BACKGROUND

Public health interventions that have proven effective in one country, are often adapted and disseminated in other countries. However, the process by which effective interventions are chosen for adaptation and dissemination in another country is often not conducted systematically.

METHODS

We propose a more systematic approach and describe the main steps that have to be taken in the assessment of the usefulness of effective interventions in another national context.

RESULTS

The following steps are proposed. Step 0: Point out the most relevant areas in public health (this is a collaborative effort by policy makers, scientists and practitioners). Step 1: Identification of potentially effective interventions (through systematic literature searches). Step 2: Assessing the levels of evidence and grades of recommendation for adoption. Step 3: Can the results of the trials be generalized to the national situation? Step 4: Can the intervention be implemented in the national situation?

CONCLUSION

A more systematic approach to the adaptation and dissemination can be adopted. The basic steps described should be worked out in more detail before they can be used in practice.

Evaluation and review of pharmacoeconomic models

Difficult decisions as to whether to provide or withhold drug therapy to patients are needed to be made on a daily basis. These decisions should be based on carefully designed and constructed pharmacoeconomic models, with explicit and justifiable parameter values, validated by publication in peer-reviewed literature. This review describes and evaluates the common types of pharmacoeconomic models, modelling approaches and methods. It also discusses model quality, validity and usefulness.

Introducing economic evaluation as a policy tool in Korea: will decision makers get quality information? : a critical review of published Korean economic evaluations

Interest in the use of economic evaluations in Korea as an aid for healthcare decision makers has been growing rapidly since the financial crisis of the Korean National Health Insurance fund and the separation in 2000 of the roles of prescribing and dispensing drugs. The Korean Health Insurance Review Agency (HIRA) is considering making it mandatory for pharmaceutical companies to submit the results of an economic evaluation when demanding reimbursement of new pharmaceuticals. The usefulness of the results of economic evaluations depends highly on the quality of the studies. The purpose of this paper, therefore, is to provide a critical review of economic evaluations of healthcare technologies published in the Korean context. Our results show that many studies did not meet international standards. Study designs were suboptimal, study perspectives and types were often stated incompletely, time periods were often too short, and outcome measures were often less than ideal. In addition, some articles did not distinguish between measurement and valuation of resource use. Capital, overhead and productivity costs were often omitted. Only half of the studies performed sensitivity analyses. In order to further rationalise resource allocation in the Korean healthcare sector, the quality of the information provided through economic evaluations needs to improve. Developing clear guidelines and educating and training researchers in performing economic evaluations is necessary.

Clinical informatics in critical care

Health care information systems have the potential to enable better care of patients in much the same manner as the widespread use of the automobile and telephone did in the early 20th century. The car and phone were rapidly accepted and embraced throughout the world when these breakthroughs occurred. However, the automation of health care with use of computerized information systems has not been as widely accepted and implemented as computer technology use in all other sectors of the global economy. In this article, the authors examine the need, risks, and rewards of clinical informatics in health care as well as its specific relationship to critical care medicine.

Development and validation of a grading system for the quality of cost-effectiveness studies

PURPOSE

To provide a practical quantitative tool for appraising the quality of cost-effectiveness (CE) studies.

METHODS

A committee comprising [corrected] of health economists selected a set of criteria for the instrument from an item pool. Data collected with a conjoint analysis survey on 120 international health economists were used to estimate weights for each criterion with a random effects regression model. To validate the grading system, a survey was sent to 60 individuals with health economics expertise. Participants first rated the quality of three CE studies on a visual analogue scale, and then evaluated each study using the grading system. Spearman rho and Wilcoxon tests were used to detect convergent validity and analysis of covariance (ANCOVA) for discriminant validity. Agreement between the global rating by experts and the grading system was also examined.

RESULTS

Sixteen criteria were selected. Their coefficient estimates ranged from 1.2 to 8.9, with a sum of 93.5 on a 100-point scale. The only insignificant criterion was "use of subgroup analyses." Both convergent validity and discriminant validity of the grading system were shown by the results of the Spearman rho (correlation coefficient = 0.78, P < 0.0001), Wilcoxon test (P = 0.53), and ANCOVA (F(3,146) = 5.97, p = 0.001). The grading system had good agreement with global rating by experts.

CONCLUSIONS

The instrument appears to be simple, internally consistent, and valid for measuring the perceived quality of CE studies. Applicability for use in clinical and resource allocation decision-making deserves further study.

Comparison of heel ultrasound and finger DXA to central DXA in the detection of osteoporosis. Implications for patient management

The goal of the study was to investigate the potential discordance in patient management when a clinician assumes that a peripheral device is a diagnostic surrogate for central DXA in the detection and treatment of osteoporosis. Over a period of 2 mo, asymptomatic women seeking conventional central DXA evaluation for osteoporosis at a diagnostic imaging center were also evaluated with heel ultrasound and finger DXA peripheral imaging devices. T-Scores of -2.5 or less in screening examinations were used to evaluate the discordance between the two peripheral devices and central DXA in the identification of patients with osteoporosis. Higher T-score cutoffs (>-2.5) were also evaluated. Using central DXA as the standard for comparison, the sensitivity of heel ultrasound for screening cases was 0.34 and specificity was 0.92. For finger DXA, sensitivity was 0.23 and specificity was 0.92. Overall discordance between the peripheral devices and central DXA was 21% (heel) and 23% (finger). Heel ultrasound identified 7 out of every 22 osteoporotic patients diagnosed with central DXA. Finger DXA identified 5 out of every 22 osteoporotic patients. Using lower T-scores for the peripheral devices increased sensitivity but markedly increased discordance with DXA. The peripheral devices we studied cannot be considered equivalent surrogates for central DXA in the screening of asymptomatic women for osteoporosis.

Cost analysis of the use of inhaled corticosteroids in the treatment of asthma: a 1-year follow-up

A retrospective cohort using pharmacy and medical claims was analysed to determine whether the differences in efficacy of various inhaled corticosteroids demonstrated in clinical trials lead to differences in costs of care observed in clinical practice. Subjects that had an ICD-9 (493.XX) code for asthma and a new pharmacy claim for inhaled fluticasone propionate 44 mcg (FP), beclomethasone dipropionate (BDP), triamcinolone acetonide (TAA), budesonide (BUD) or flunisolide (FLU) were identified and followed for 12 months. Annual asthma care charges (pharmacy and medical) over the 12-month observation period were significantly (P < 0.03) higher in patients treated with BDPTAA, BUD and FLU compared to FP, 24%, 27%, 34% and 45% respectively In addition, patients treated with BDPTAA, and FLU were associated with significantly (P < 0.005) higher total healthcare (asthma + non-asthma) charges compared to patients on FP, 53%, 46% and 39% respectively Asthma care and total healthcare charges remained lower for FP after including FP110 mcg and excluding patients who were extreme cost outliers (+/- 2 SD from the mean) in a univariate sensitivity analysis. This analysis supports recent randomized control trials that FP offers a superior efficacy profile at lower asthma care as well as total healthcare charges compared to other inhaled corticosteroids.

Transcranial Doppler versus angiography in patients with vasospasm due to a ruptured cerebral aneurysm: A systematic review

BACKGROUND AND PURPOSE

Transcranial Doppler (TCD) is used for diagnosis of vasospasm in patients with subarachnoid hemorrhage due to a ruptured aneurysm. Our aim was to evaluate both the accuracy of TCD compared with angiography and its usefulness as a screening method in this setting.

METHODS

A search (MEDLINE, EMBASE, Cochrane Library, bibliographies, hand searching, any language, through January 31, 2001) was performed for studies comparing TCD with angiography. Data were critically appraised using a modified published 10-point score and were combined using a random-effects model.

RESULTS

Twenty-six reports compared TCD with angiography. Median validity score was 4.5 (range 1 to 8). Meta-analyses could be performed with data from 7 trials. For the middle cerebral artery (5 trials, 317 tests), sensitivity was 67% (95% CI 48% to 87%), specificity was 99% (98% to 100%), positive predictive value (PPV) was 97% (95% to 98%), and negative predictive value (NPV) was 78% (65% to 91%). For the anterior cerebral artery (3 trials, 171 tests), sensitivity was 42% (11% to 72%), specificity was 76% (53% to 100%), PPV was 56% (27% to 84%), and NPV was 69% (43% to 95%). Three of these 7 studies reported on the same patients, each on another artery, and for 4, data recycling could not be disproved. Other arteries were tested in only 1 trial each.

CONCLUSIONS

For the middle cerebral artery, TCD is not likely to indicate a spasm when angiography does not show one (high specificity), and TCD may be used to identify patients with a spasm (high PPV). For all other situations and arteries, there is either lack of evidence of accuracy or of any usefulness of TCD. Most of these data are of low methodological quality, bias cannot not be ruled out, and data reporting is often uncritical.

Knowledge discovery and knowledge validation in intensive care

Operational protocols are a valuable means for quality control. However, developing operational protocols is a highly complex and costly task. We present an integrated approach involving both intelligent data analysis and knowledge acquisition from experts that support the development of operational protocols. The aim is to ensure high quality standards for the protocol through empirical validation during the development, as well as lower development cost through the use of machine learning and statistical techniques. We demonstrate our approach of integrating expert knowledge with data driven techniques based on our effort to develop an operational protocol for the hemodynamic system.

Computerized protocols and bedside decision support

Many clinicians are concerned that protocol supported care will become rote or "cookbook" care and will be generated without attention to the specific and changing needs of the individual critically ill patient. This article addresses that concern. In addition, the author discusses the potential advantages that this decision-support approach, with bedside computerized protocols, brings to the healthcare delivery system, and what contributions to clinical care and to clinical research might be anticipated from its widespread application.

Optimized therapy for the edentulous predicament: cost-effectiveness considerations

After proof of the clinical effectiveness of prosthodontic interventions, comparative economic analyses (cost-effectiveness, cost benefit, cost utility) should be undertaken to establish the relative value of each intervention in terms of its costs and consequences. Over time, these analyses must consider the balance between each intervention's initial and maintenance costs versus a broad array of clinician and patient-based multidimensional benefits or outcomes. The findings of current research will enhance increased economic analysis in prosthodontics, which, in turn, may help both dentists' and patients' decision-making. Even implant-supported prostheses that are clinically effective have yet to be proven societally effective because they are inaccessible economically to some who need them. Long-term, multidimensional comparative economic analyses of overdenture and conventional denture use may lead to the expansion of implant-supported dentures to selected patients who, to date, have not had access to this treatment modality.

[Cost-benefit analysis of the active screening of pulmonary tuberculosis in a recluse population entering prison]

BACKGROUND

In spanish prisons, tuberculosis is a serious problem of public health and health authorities don't take it seriously.

OBJECTIVE

To prove the efficiency of pulmonary tuberculosis case-finding on arrival at prison in order to get location resources in this activity.

METHODS

Cost-benefit analysis of a case-finding program compared with to wait for diagnostic to illness. The sensitivity of test was fixed in 80% and the specificity in 99.99%. The cost was based on market prices. Sensitivity analysis was done in every variables as well as tridimensional analysis in those one of more influence.

RESULTS

The case-finding was efficient on prevalences of tuberculosis over 5 per mil. Its efficiency was hardly affected by discount social rates or the sensitivity of diagnostic tests. The prevalence of illness, the cost of diagnostic activities as well as the success of treatment and the specificity of diagnostic tests used had as influence on the efficiency model. The tridimensional analysis proved that the case-finding of pulmonary tuberculosis has efficiency on low prevalences (1 per thousand), provided the number of people cured is a 5% higher than the alternative one and the costs of case-finding less than 1,000 pesetas per subject.

CONCLUSIONS

The case-finding pulmonary tuberculosis on arrival at prisons is of high efficiency. In a cost-opportunity situation (location of available resources, penitentiary and extrapenitentiary) the program is very efficacious taking into account the fact of higher prevalence of pulmonary tuberculosis in this people.

Cost-effectiveness of initial therapy with 3-hydroxy-3-methylglutaryl coenzyme A reductase inhibitors to treat hypercholesterolemia in a primary care setting of a managed-care organization

From January 1994 through May 1995, Prudential HealthCare-North Texas prospectively studied 299 member patients diagnosed with hypercholesterolemia for whom pharmacotherapy with one of four 3-hydroxy-3-methylglutaryl coenzyme A reductase inhibitors, also known as statins, was prescribed. The purpose of this study was to measure the relative cost-effectiveness (CE) of these drugs in a real-world setting. This study provides information to assist decision makers in managed-care organizations (MCO) in making formulary selections. The study used a prospective, randomized, balanced cohort design, examining patients who had been prescribed initial therapy with a statin drug as monotherapy. Costs (direct medical and indirect costs) and effectiveness (percent reduction in low-density lipoprotein cholesterol levels) were based on approximately the first 6 months of initial therapy. Both the MCO and patient perspectives were considered. In the base case, mean CE ratios were significantly lower for fluvastatin compared with lovastatin, pravastatin, and simvastatin from both the managed-care perspective and the patient perspective. Sensitivity analysis did not alter the CE conclusions, even under conditions of varying cost structures. Although differences were found in the effectiveness of lovastatin, pravastatin, and simvastatin measured in this study versus efficacy measured for these drugs in controlled clinical trials, sensitivity analysis suggests that these differences alone do not determine the superior CE of fluvastatin. Finally, this study supports the idea that well-designed formularies should consider drug CE (based on safety, effectiveness, and cost) and that integration of the pharmacy benefit management with other medical management is essential. These results provide evidence that fluvastatin may represent a more cost-effective formulary choice among statin products used for initial monotherapy of hypercholesterolemia.

Making cost assessments based on RCTs more useful to decision-makers

The appropriateness of results from economic evaluation for allocation-decisions in health care is a point of major concern for decision-makers. Much attention has been focused on potential biases stemming form the methodological shortcomings of economic evaluation. This article adds to this and concentrates on the 'real world' relevance of results from economic evaluation as an additional step towards making results more useful to decision-makers. Being the accepted standard for economic evaluation, the RCT is used as the reference case; yet, many of the issues raised are also relevant for other research designs. Three classes of biases are examined. The first relates to the limited scope that economic analysts sometimes choose in RCTs. The second class involves the methodological aspects of RCTs and questions the 'real world' relevance of the tools with which economic analysts estimate costs on the basis of RCTs. The third class concerns the representativeness of RCT results, i.e. the generalizability of these results and their usefulness in other treatment contexts. options for limiting the potential confounding influences of these biases are discussed. A check-list is provided which should be applied by decision-makers when using constructing and describing RCTs. This will enhance the relevance of the results of economic evaluation in decision-making and improve the information basis for actual allocation decisions in health care.

A strategy for accurate collection of incremental cost data for cost-effectiveness analyses in field trials. Pawtucket's minimal contact cholesterol education intervention

With many community field trials or education interventions, the cost-effectiveness analyses are not given a high priority. However, this type of evaluation is important for purposes of future adoption of the intervention. The accurate measurement of costs can best be served by prospective collection of data. This article describes a methodology for collection of cost data that coincides with the intervention implementation. This cost analysis strategy has seven discrete steps. The Minimal Contact Education for Cholesterol Change study is used as an example of the use of this strategy. This intervention provides cholesterol education at six different levels of intensity at four different sectors. The intensity levels vary along a continuum from very little education input to a maximum level of intervention that might be practical in a screening setting. The cost-effectiveness analysis component of the study will identify the incremental cost-effectiveness of each intervention along the continuum.

Pharmacoeconomic studies. Pitfalls and problems

The literature on economic evaluation of pharmaceuticals is growing rapidly. Although there have been substantial methodologic advances, there remain serious problems and pitfalls. This presentation focuses on three aspects, i.e., use (and abuse) of evaluation studies, methodologic problems, and the quality of published studies.

Rank-order stability analysis (ROSA): testing pharmacoeconomic data

In a pharmacoeconomic analysis, the validity of findings is critical because product ranking may influence formulary decision making. The authors present an approach for examining uncertainty in a pharmacoeconomic analysis that parallels the confidence-interval approach to statistical analysis. This method, rank-order stability analysis (ROSA), is a clear and comprehensive method for validating results of a pharmacoeconomic analysis, as it identifies and evaluates all inputs and values. It is a break-even analysis that identifies the specific point of insensitivity for all parameters analyzed in the pharmacoeconomic model. ROSA is proposed as the preferred method for judging the validity of results derived from estimated parameters in pharmacoeconomic analyses.

Comparative costs of the various strategies of urinary stone disease management

New technology is a major determinant of total healthcare costs. The assessment of alternative technologies from a cost-effectiveness perspective is important, although other considerations may finally determine which technology is used. The alternatives of extracorporeal shock wave lithotripsy (ESWL) and percutaneous nephrostolithotomy (PCNL) for the treatment of renal stone disease were compared by studying 1000 cases of ESWL and 133 cases of PCNL using a noncontemporaneous cohort study with PCNL representing the earlier cohort. The effectiveness, defined by success and stone-free rates, was higher with PCNL than with ESWL (96% success vs. 70%); PCNL was also accompanied by a lower burden of additional therapy, whereas ESWL had a higher retreatment rate. From the perspective of a third-party payer, total costs per case of ESWL ($2,746) were lower than those of PCNL ($4,087), but the figure varies with the annual volume. These represent the costs for complete treatment of a patient, including the costs of alternative technology such as PCNL or ureteroscopy that may ultimately be necessary in a patient initially managed by ESWL. The cost for a single ESWL treatment was $2,226 (at a volume of 1000 cases per year), but this increased to $2,746 when costs of retreatment and alternative treatment were prorated to each patient treated. The relative contribution of capital costs to the total cost of ESWL was always less than total professional fees and was only 12% at a volume of 2000 cases/year. Therefore ESWL is less expensive but it is also less effective in rendering patients stone-free.

Meta-analytic methods for health services research--an example from geriatrics

The authors recently published a meta-analysis of controlled trials of comprehensive geriatric assessment (CGA). The results supported the view that efficacy of CGA is strongly related to the patients, objectives, and basic design of CGA programs, and that particular program models and design features are associated with important health outcome improvements (e.g., survival, living at home, and functional improvement at follow-up). Present objectives include the outline of methods and how they were developed given the condition of the trial database and scientific context. Aspects of the approach, such as (a) survey of primary trialists to recover unpublished information and standardize data, (b) development of a program typology to guide the principal analysis, and (c) incorporation of program design features as covariates where statistical heterogeneity was detected, proved extremely useful, and have implications for other systematic reviews of similarly complex primary trials of new health care technologies, health services, and organizational interventions.

Quality assessment of economic evaluations in selected pharmacy, medical, and health economics journals

OBJECTIVE

To assess and compare the quality of economic studies in selected pharmacy, medical, and health economics journals.

DATA SOURCES

DICP The Annals of Pharmacotherapy, American Journal of Hospital Pharmacy, Hospital Pharmacy, New England Journal of Medicine, Medical Care, Journal of the American Medical Association, PharmacoEconomics, International Journal of Technology Assessment in Health Care, and Journal of Health Economics using MEDLINE, EMBASE, and International Pharmaceutical Abstracts. Search terms included "economic," "cost," and "cost analysis."

STUDY SELECTION

Reviewers appraised abstracts to identify original research published during 1989-1993 comparing costs and outcomes between drugs, treatments, and/or services. Initially, 123 articles met criteria; 16 were inappropriate, 17 were randomized out, and 90 (73%) were used (30/group).

DATA EXTRACTION

Quality was assessed using a 13-item checklist. Interrater reliability was 0.91 (p < 0.05) for 9 raters, test-retest reliability was 0.94 (p < 0.001).

DATA SYNTHESIS

A 2-way ANOVA, with overall quality scores as a dependent variable with journal type and year as independent variables, was significant (F = 2.79, p = 0.002, r2 = 0.34), with no significant interaction (F = 0.71, p = 0.68) or time effect (F = 0.70, p = 0.60). Journal types differed; pharmacy journals scored significantly lower (chi 2 = 53.89, df = 2, p < 0.001). Items rated adequate (i.e., correct or acceptable) increased over time (chi 2 = 21.18, df = 4, p < 0.001). Ethical issues and study perspective most needed improvement.

CONCLUSIONS

Article quality for all journal types increased over time nonsignificantly; health economics journals scored highest, then medical journals, with pharmacy journals significantly lower (and having the highest standard deviation). We recommend that authors and reviewers pay closer attention to study perspective and ethical implications.

Protocol for the clinical functionality assessment of a workstation for stereotactic neurosurgery

The objective of this study is to establish a protocol for the technical and clinical evaluation of a workstation for the planning of stereotactic neurosurgical interventions that has been developed in the framework of a joint European research project. Although several such workstations have been proposed before, they lacked the final and most important step, that of clinical validation. They failed to rigorously prove that their product was useful. The authors present a new method that is applicable to the evaluation of a wide range of medical technologies. Their protocol basically assesses the clinical relevance of the user requirements that are at the root of the development of the new technology. The evaluation consists of two stages. During functional specification, iterative prototyping is used to establish the clinical requirements and to assure the quality of the final product. A case study design is used in a second stage that assesses the clinical usability. A before-after study gives a first indication of cost effectiveness and improvement of health care quality.

Clinical practice guidelines: from methodological to practical issues

The main goal of clinical practice guidelines is to help clinical decision by practitioners, who can not integrate in their daily practice all the published data concerning new technologies and knowledge. Guidelines also have growing applications in the ethical, legal, socio-economic, public policy and health care funding fields. This article describes the various methodologies that have been proposed to develop guidelines. These methods rely to varying degrees on formal methods of analysis of scientific evidence and expert opinions. Then a step by step process is described, that should ensure a rigorous, feasible and explicit guideline development and lead to valid and applicable recommendations. In order for guidelines to be used, they have to be efficiently implemented. Respective efficiency and justification of educational and coercive methods of implementation are discussed.

Statistical analysis of cost outcomes in a randomized controlled clinical trial

This paper suggests an approach to deal with an estimation problem which is often encountered in analyzing the longitudinal cost data gathered in a clinical trial. The source of that estimation problem is twofold: 1) a considerable number of missing data due to treatment-related withdrawal of severely affected patients with high health care costs in only one the treatment groups and 2) a heavily skewed cost distribution due to rare high-cost events. The approach is illustrated using data from a trial comparing 3 different drug regimes. In order to calculate costs per patient-year in case of selectively missing data we extrapolated the costs of patients with incomplete follow-up. Due to the skewness and the associated large variance in costs per patient-year, these costs cannot be analyzed using common parametric statistical methods relying on underlying normal distributions. A logarithmic transformation was performed to approximate a normal distribution, reduce the impact of extreme values and create similar size variances in the treatment groups. An ordinary least squares regression analysis of transformed data then standardized for differences in patient characteristics between the groups. For the retransformation, the so-called smearing estimate was used. This 'transformation-standardization-retransformation' approach enabled us to provide more consistent and efficient estimates of cost differences that were shown to be statistically significant and judged to be important.

Researcher-driven versus policy-driven economic appraisal of health technologies: the case of France

From the failure of early voluntarist attempts of the 1970's to introduce formal economic assessment in administrative decision-making for public health policies, to the recent introduction of new regulatory mechanisms to control the diffusion and use of health care technologies, the French experience deeply questions the mechanistic idea that reinforcement of cost-containment policies necessarily means successful opportunities for economic appraisal. The article presents various examples from the French health care system showing how ambiguities between the management goals of cost-containment and the promotion of economic appraisal can create barriers for acceptance of any form of economic analysis. But, it also draws some positive lessons about the ways to surpass the traditional opposition between 'researcher-driven' vs 'policy-driven' research in the field of health economic assessment through institutional innovations and methodological advances.

Effectiveness and cost-benefit analysis of intensive treatment and teaching programmes for type 1 (insulin-dependent) diabetes mellitus in Moscow--blood glucose versus urine glucose self-monitoring

In a prospective controlled trial the effects of a 5-day in-patient treatment and teaching programme for Type 1 (insulin-dependent) diabetes mellitus on metabolic control and health care costs were studied in Moscow. Two different intervention programmes were compared, one based upon urine glucose self-monitoring (UGSM, n = 61) and one using blood glucose self-monitoring (BGSM, n = 60). Follow-up was 2 years. A control group (n = 60) continued the standard treatment of the Moscow diabetes centre and was followed-up for 1 year. Costs and benefits with respect to hospitalizations and lost productivity (according to average wage) were measured in November 1992 rubles (Rb.), with respect to imported drugs and test strips in 1992 German marks (DM). In the intervention groups there were significant decreases of HbA1 values [UGSM: 12.5% before, 9.4% after 1 year, 9.2% after 2 years (p < 0.0001); BGSM: 12.6% before, 9.3% after 1 year, 9.2% after 2 years (p < 0.0001) compared to no change in the control group (12.2% before, 12.3% after 1 year)], and of the frequency of ketoacidosis. The frequency of severe hypoglycaemia was comparable between the UGSM (10 cases during 2 years), BGSM (10 cases during 2 years), and the control group (8 cases during 1 year).(ABSTRACT TRUNCATED AT 250 WORDS)

Impact of microbiological consultation on clinical decision making: a case-control study of clinical management of recurrent periodontitis

Data obtained from diagnostic tests may influence the clinician's perception of the patient's state and in some instances may alter subsequent choices of therapeutic interventions. To determine if microbiological consultation influences the clinical management of patients with recurrent periodontitis, an observational, case-control study was conducted to measure the amount and type of periodontal treatment provided by periodontists (n = 13) who had referred patients with recurrent periodontitis for microbiological consultation. The control group consisted of periodontists (n = 10) who had not referred recurrent periodontitis patients for testing. Patients (n = 31; 20 females, 11 males; mean age 49.8 +/- 10.0 years) treated by the case group of periodontists were matched for age and sex to patients (n = 48; 22 females, 26 males; mean age 49.9 +/- 8.5 years) treated by the control group of periodontists. Questionnaires were administered to quantitatively assess the amount and type of treatment before and after receiving the microbiological report. Specific analyses were performed as a function of the time of receipt of the microbiology report. Case-control differences prior to the receipt of the report indicated that the amount of surgery/year was 43% greater for controls (P < 0.04), in spite of control patients exhibiting fewer deep pockets than case patients (P < 0.05). Case-control differences after the receipt of the report indicated that case patients were provided with 45% greater number of appointments/year (P < 0.005), 46% greater scaling/year (P < 0.02), and 79% greater antibiotics/year (P < 0.01) compared with controls. The report influenced 9 (69%) case periodontists to change treatment. Case patients who received a change in treatment (n = 21) exhibited greater number of deep pockets at the time of entry into the study (P < 0.05) as compared with case patients who did not receive a change in treatment. Paired t-tests of differences within groups before and after the report demonstrated that case patients had a significant increase in treatment after the report as shown by 22% greater number of visits/year (P < 0.05) and 54% greater number of antibiotic prescriptions/year (P < 0.01). In contrast, controls demonstrated no significant change in treatment. Further, contrasts of change in treatment before and after the report again indicated that case patients exhibited a significantly higher number of visits/year (P < 0.04) and number of antibiotic prescriptions/year (P < 0.02) compared with control patients.(ABSTRACT TRUNCATED AT 400 WORDS)