Can knowledgeable experts assess costs and outcomes as if they were ignorant? An experiment within precision medicine evaluation

OBJECTIVES

The purpose of this study is to evaluate the validity of the standard approach in expert judgment for evaluating precision medicines, in which experts are required to estimate outcomes as if they did not have access to diagnostic information, whereas in fact, they do.

METHODS

Fourteen clinicians participated in an expert judgment task to estimate the cost and medical outcomes of the use of exome sequencing in pediatric patients with intractable epilepsy in Thailand. Experts were randomly assigned to either an "unblind" or "blind" group; the former was provided with the exome sequencing results for each patient case prior to the judgment task, whereas the latter was not provided with the exome sequencing results. Both groups were asked to estimate the outcomes for the counterfactual scenario, in which patients had not been tested by exome sequencing.

RESULTS

Our study did not show significant results, possibly due to the small sample size of both participants and case studies.

CONCLUSIONS

A comparison of the unblind and blind approach did not show conclusive evidence that there is a difference in outcomes. However, until further evidence suggests otherwise, we recommend the blind approach as preferable when using expert judgment to evaluate precision medicines because this approach is more representative of the counterfactual scenario than the unblind approach.

Using an experiment among clinical experts to determine the cost and clinical impact of rapid whole exome sequencing in acute pediatric settings

Objective

Evaluate the cost and clinical impacts of rapid whole-exome sequencing (rWES) for managing pediatric patients with unknown etiologies of critical illnesses through an expert elicitation experiment.

Method

Physicians in the intervention group (n = 10) could order rWES to complete three real-world case studies, while physicians in the control group (n = 8) could not. Costs and health outcomes between and within groups were compared.

Results

The cost incurred in the intervention group was consistently higher than the control by 60,000-70,000 THB. Fewer other investigation costs were incurred when rWES could provide a diagnosis. Less cost was incurred when an rWES that could lead to a change in management was ordered earlier. Diagnostic accuracy and the quality of non-pharmaceutical interventions were superior when rWES was available.

Conclusion

In acute pediatric settings, rWES offered clinical benefits at the average cost of 60,000-70,000 THB. Whether this test is cost-effective warrants further investigations. Several challenges, including cost and ethical concerns for assessing high-cost technology for rare diseases in resource-limited settings, were potentially overcome by our study design using expert elicitation methods.

Cost-Utility Analysis of Universal Maternal Pertussis Immunisation in Thailand: A Comparison of Two Model Structures

OBJECTIVES

This study aimed to assess the cost-effectiveness of introducing universal maternal pertussis immunisation under the national vaccine programme in Thailand.

METHODS

We conducted a cost-utility analysis from a societal perspective to compare maternal vaccination with (1) TdaP vaccine, (2) Td vaccine and aP vaccine, and (3) Td vaccine only. We constructed two decision-tree models with Markov elements, each following a different clinical pathway, to allow us to examine structural uncertainty. Costs were converted to 2021 Thai Baht (THB) and a discount rate of 3% was applied to health and cost outcomes, with sensitivity analysis at 0% and 6%. Parameter uncertainty was investigated through deterministic and probabilistic sensitivity analysis, with expected value of perfect information analysis.

RESULTS

Maternal pertussis vaccination would avert 27 cases and up to one death per year. The incremental cost-effectiveness ratio (ICER) for adding aP to the maternal immunisation schedule is 2,184,025 THB/QALY and the ICER for replacing maternal Td vaccination with TdaP is 3,198,101 THB/QALY. Maternal pertussis vaccination only becomes favourable in the probabilistic sensitivity analysis at cost-effectiveness thresholds above 6,000,000 THB/QALY, far above the Thai threshold of 160,000 THB/QALY. If incidence is less than 397 cases per 100,000, maternal pertussis vaccination will not be cost-effective in Thailand, within the plausible range for vaccine effectiveness and probability of hospitalisation. Budget impact is dominated by vaccination costs, which represent 12% and 18% of the 2021 national vaccine programme budget for introducing aP vaccine or for switching Td with TdaP vaccine, respectively.

CONCLUSIONS

We have found that maternal pertussis immunisation is not cost-effective in Thailand. Although there may be substantial under-reporting of pertussis cases, comparison with hospital data suggests that most under-reported cases are not hospitalised and therefore have negligible impact on our results. However, considerations such as affordability and local manufacturing may also be important for national immunisation programme decision-making.

Impact of Pharmacist Activities in Patients With Depression: A Systematic Review and Meta-analysis of Randomized Controlled Trials

BACKGROUND

Depression is a substantial health burden. Pharmacist activities may help improve health outcomes of patients with depression when comparing to current practice with no pharmacist-involved intervention.

OBJECTIVE

To systematically review and analyze randomized controlled trials assessing the impact of pharmacist services on patients with depression compared to usual care using a meta-analysis approach.

METHODS

Four international and 3 domestic electronic databases were systematically searched. Data from database inception to December 2019 were included. Studies were selected using predefined inclusion criteria, and quality was assessed using the risk-of-bias criteria. Pooled estimation was analyzed to report the relative risk (RR) and standard mean difference (SMD). The meta-analysis used the random-effect model when heterogeneity was observed between studies.

RESULTS

A total of 12 eligible studies with 2133 patients with depression were included in the analysis. The relevant pharmacist interventions included medication therapy management, adherence counseling, and educational advice about depression and antidepressants. Pooled data in the meta-analysis showed a significantly increased number of patients with good adherence (RR = 1.39; 95% CI = 1.11 to 1.75) and improved medication adherence score (SMD = 0.32; 95% CI = 0.07 to 0.56) associated with pharmacist activities compared to usual care. No significant differences were detected in clinical rating scales (SMD = -0.03; 95% CI = -0.16 to 0.10) and quality of life (SMD = 0.10; 95% CI = -0.04 to 0.25).

CONCLUSION AND RELEVANCE

This review suggests that the role of pharmacists in patients with depression has a positive impact on medication adherence.

Systematic review of economic evaluation studies on preconception care interventions

Implementation of preconception care interventions have been encouraged for improving maternal and child health outcomes; therefore, evidence on their cost-effectiveness is needed. We conducted the systematic review to examine the efficiency of those interventions by collecting evidence from published economic evaluation studies. Out of 14 included studies, almost all (12/14) were in high-income countries. All studies were not cost-utility analysis with genetic disease screening and diabetes management were the common interventions for evaluating their efficiency during preconception period. Preconception care interventions are likely to be cost-effective, especially in low-income countries which incremental benefits had a greater return than developed nations.

Current state of cancer patient care incorporating Thai traditional medicine in Thailand: A qualitative study

OBJECTIVE

To assess the current state of cancer treatment incorporating Thai traditional medicine (TTM) and to identify problems in the system, by using the health system framework of the World Health Organization.

METHODS

A qualitative study was conducted by interviewing three groups of people involved in the healthcare system. The groups were constructed via purposive sampling of patients with cancer, caregivers and service providers. The study groups included 37 individuals from five TTM hospitals. In-depth interviews were conducted from October 2017 to March 2018. The interview questions were developed based on the six building blocks of a health system framework. Free form answers from participants were analyzed and interpreted to develop the study conclusions.

RESULTS

All five TTM hospitals provided treatment to patients with cancer based on provincial public health policy. The policy allows patients with cancer to obtain TTM services in outpatient and inpatient departments and via home visits; most patients used outpatient services. The TTM services were primarily provided by TTM practitioners and included massage, herbal steam, herbal compress and meditation. Herbal medicines were widely used and included Benja-amarit, an anticancer formulation made from Wat Khampramong and Phytoplex. The problems included poor acceptance of TTM practitioners by other healthcare practitioners, lack of experience among TTM practitioners in treating patients with cancer, lack of herbal medicine research trials, contamination in herbal medicine preparations and absence of practical treatment guidelines.

CONCLUSION

TTM is an alternative treatment modality for patients with cancer and is supported by a national policy in Thailand. To increase accountability to patients and other practitioners, TTM treatments should be refined to rely on scientific principles and practitioners of TTM should receive academic training. Practical treatment guidelines need to be established and thoroughly disseminated to TTM practitioners.

Economic evaluation of pegylated interferon plus ribavirin for treatment of chronic hepatitis C in Thailand: genotype 1 and 6

Background

Pegylated interferon alpha 2a, alpha 2b and ribavirin have been included to the National List of Essential Medicines (NLEM) for treatment of only chronic hepatitis C genotypes 2 and 3 in Thailand. This reimbursement policy has not covered for other genotypes of hepatitis C virus infection (HCV) especially for genotypes 1 and 6 that account for 30-50 % of all HCV infection in Thailand. Therefore, this research determined whether pegylated interferon alpha 2a or alpha 2b plus ribavirin is more cost-effective than a palliative care for treatment of HCV genotype 1 and 6 in Thailand.

Methods

A cost-utility analysis using a model-based economic evaluation was conducted based on a societal perspective. A Markov model was developed to estimate costs and quality-adjusted life years (QALYs) comparing between the combination of pegylated interferon alpha 2a or alpha 2b and ribavirin with a usual palliative care for genotype 1 and 6 HCV patients. Health-state transition probabilities, virological responses, and utility values were obtained from published literatures. Direct medical and direct non-medical costs were included and retrieved from published articles and Thai Standard Cost List for Health Technology Assessment. The incremental cost-effectiveness ratio (ICER) was presented as costs in Thai baht per QALY gained.

Results

HCV treatment with pegylated interferon alpha 2a or alpha 2b plus ribavirin was dominant or cost-saving in Thailand compared to a palliative care. The ICER value was negative with lower in total costs (peg 2a- 747,718vs. peg 2b- 819,921 vs. palliative care- 1,169,121 Thai baht) and more in QALYs (peg 2a- 13.44 vs. peg 2b- 13.14 vs. palliative care- 11.63 years) both in HCV genotypes 1 and 6.

Conclusion

As cost-saving results, the Subcommittee for Development of the NLEM decided to include both pegylated interferon alpha 2a and alpha 2b into the NLEM for treatment of HCV genotype 1 and 6 recently. Economic evaluation for these current drugs can be further applied to other novel medications for HCV treatment.

Pharmacist perceptions of new competency standards

Objective

To suggest revisions to the Thai pharmacy competency standards and determine the perceptions of Thai pharmacy practitioners and faculty about the proposed pharmacy competency standards.

Methods

The current competency standards were revised by brainstorming session with nine Thai pharmacy experts according to their perceptions of society’s pharmacy needs. The revised standards were proposed and validated by 574 pharmacy practitioners and faculty members by using a written questionnaire. The respondents were classified based on their practice setting.

Results

The revision of pharmacy competency standard proposed the integration and addition to current competencies. Of 830 distributed questionnaires, 574 completed questionnaires were received (69.2% response rate). The proposed new competency standards contained 7 domains and 46 competencies. The majority of the respondents were supportive of all 46 proposed competencies. The highest ranked domain was Domain 1 (Practice Pharmacy within Laws, Professional Standards, and Ethics). The second and third highest expectations of pharmacy graduates were Domain 4 (Provide pharmaceutical care) and Domain 3 (Communicate and disseminate knowledge effectively).

Conclusion

The expectation for pharmacy graduates’ competencies were high and respondents encouraged additional growth in multidisciplinary efforts to improve patient care.

Making health technology assessment information available for decision making: the development of a Thai database

In Thailand, there is an attempt to develop the Thai HTA database in order to improve the accessibility and usefulness of HTA information. At present, the database is available online at www.db.hitap.net. The database includes (1) economic evaluation studies i.e. cost-minimization analysis, cost-effectiveness analysis, cost-benefit analysis, and cost-utility analysis, (2) outcome assessment studies i.e. randomized controlled trials, and (3) quantitative measured quality of life studies. All HTA studies related to the Thai context, and published in either Thai or English from 1990 onward, are eligible for inclusion in the database. In addition, there is a quality evaluation for each economic evaluation study which will help readers, who have limited knowledge about the method, to understand and make appropriate use of the information in their own settings. This may also raise awareness among researchers, who will conduct economic evaluation studies in the future, to adhere to the standard methodological guidelines because the quality evaluation was developed based on the national guidelines published in this supplement journal.

Evaluation of curricula content based on Thai pharmacy competency standards

OBJECTIVE

To evaluate the curricula content of Thai pharmacy schools based on the Thai pharmacy competency standards.

METHODS

Course syllabi were collected from 11 pharmacy schools. A questionnaire was developed based on the Thai pharmacy competency standards. Course coordinators completed the questionnaire assessing the curricula content.

RESULTS

The curricula for both the bachelor of science in pharmacy degree (BS Pharm) and doctor of pharmacy (PharmD) degree programs included the minimum content required by the 8 competency domains. The dominant content area in BS Pharm degree programs was product-oriented material. The content ratio of patient to product to social and administrative pharmacy in the BS Pharm degree programs was 2:3:1, respectively. However, the content ratio suggested by the Thai Pharmacy Council was 3:2:1, respectively. For the PharmD programs, the largest content area was patient-oriented material, which was in agreement with the framework suggested by the Thai Pharmacy Council.

CONCLUSIONS

The curricula of all Thai pharmacy schools met the competency standards; however, some patient-oriented material should be expanded and some product-oriented content deleted in order to meet the recommended content ratio.