1
|
Risse J, Krzemien M, Schnalke J, Heinemann T. Towards ethical drug pricing: the European Orphan Genomic Therapies Fund. Gene Ther 2024; 31:353-357. [PMID: 38658672 PMCID: PMC11257980 DOI: 10.1038/s41434-024-00452-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/03/2024] [Revised: 04/11/2024] [Accepted: 04/12/2024] [Indexed: 04/26/2024]
Abstract
An increasing number of novel genomic therapies are expected to become available for patients with rare or ultra-rare diseases. However, the primary obstacle to equal patient access to these orphan genomic therapies are currently very high prices charged by manufacturers in the context of limited healthcare budgets. Taking into account ethical pricing theories, the paper proposes the implementation of a pricing infrastructure covering all European member states, which has the potential to promote distributive justice while maintaining the attractiveness of genomic therapy development.
Collapse
Affiliation(s)
- Johanna Risse
- Institute for Medical Humanities, University Hospital Bonn, Venusberg-Campus 1, D-53127, Bonn, Germany
| | - Merlin Krzemien
- Institute for Medical Humanities, University Hospital Bonn, Venusberg-Campus 1, D-53127, Bonn, Germany
| | - Jan Schnalke
- Institute for Medical Humanities, University Hospital Bonn, Venusberg-Campus 1, D-53127, Bonn, Germany
| | - Thomas Heinemann
- Institute for Medical Humanities, University Hospital Bonn, Venusberg-Campus 1, D-53127, Bonn, Germany.
| |
Collapse
|
2
|
Regier DA, Pollard S, McPhail M, Bubela T, Hanna TP, Ho C, Lim HJ, Chan K, Peacock SJ, Weymann D. A perspective on life-cycle health technology assessment and real-world evidence for precision oncology in Canada. NPJ Precis Oncol 2022; 6:76. [PMID: 36284134 PMCID: PMC9596463 DOI: 10.1038/s41698-022-00316-1] [Citation(s) in RCA: 17] [Impact Index Per Article: 5.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/11/2022] [Accepted: 09/29/2022] [Indexed: 11/09/2022] Open
Abstract
Health technology assessment (HTA) can be used to make healthcare systems more equitable and efficient. Advances in precision oncology are challenging conventional thinking about HTA. Precision oncology advances are rapid, involve small patient groups, and are frequently evaluated without a randomized comparison group. In light of these challenges, mechanisms to manage precision oncology uncertainties are critical. We propose a life-cycle HTA framework and outline supporting criteria to manage uncertainties based on real world data collected from learning healthcare systems. If appropriately designed, we argue that life-cycle HTA is the driver of real world evidence generation and furthers our understanding of comparative effectiveness and value. We conclude that life-cycle HTA deliberation processes must be embedded into healthcare systems for an agile response to the constantly changing landscape of precision oncology innovation. We encourage further research outlining the core requirements, infrastructure, and checklists needed to achieve the goal of learning healthcare supporting life-cycle HTA.
Collapse
Affiliation(s)
- Dean A Regier
- Canadian Centre for Applied Research in Cancer Control (ARCC), Cancer Control Research, BC Cancer, Vancouver, BC, Canada.,School of Population and Public Health, Faculty of Medicine, University of British Columbia, Vancouver, BC, Canada
| | - Samantha Pollard
- Canadian Centre for Applied Research in Cancer Control (ARCC), Cancer Control Research, BC Cancer, Vancouver, BC, Canada
| | - Melanie McPhail
- Faculty of Health Sciences, Simon Fraser University, Burnaby, BC, Canada
| | - Tania Bubela
- Faculty of Health Sciences, Simon Fraser University, Burnaby, BC, Canada
| | - Timothy P Hanna
- Department of Oncology, Queen's University, Kingston, ON, Canada.,Department of Public Health Science, Queen's University, Kingston, ON, Canada
| | - Cheryl Ho
- Department of Medical Oncology, BC Cancer, Vancouver, BC, Canada.,Department of Medicine, University of British Columbia, Vancouver, BC, Canada
| | - Howard J Lim
- Department of Medical Oncology, BC Cancer, Vancouver, BC, Canada.,Department of Medicine, University of British Columbia, Vancouver, BC, Canada
| | - Kelvin Chan
- Sunnybrook Health Sciences Centre, Toronto, ON, Canada
| | - Stuart J Peacock
- Canadian Centre for Applied Research in Cancer Control (ARCC), Cancer Control Research, BC Cancer, Vancouver, BC, Canada.,Faculty of Health Sciences, Simon Fraser University, Burnaby, BC, Canada
| | - Deirdre Weymann
- Canadian Centre for Applied Research in Cancer Control (ARCC), Cancer Control Research, BC Cancer, Vancouver, BC, Canada.
| |
Collapse
|
3
|
Ádám I, Callenbach M, Németh B, Vreman RA, Tollin C, Pontén J, Dawoud D, Elvidge J, Crabb N, van Waalwijk van Doorn-Khosrovani SB, Pisters-van Roy A, Vincziczki Á, Almomani E, Vajagic M, Oner ZG, Matni M, Fürst J, Kahveci R, Goettsch WG, Kaló Z. Outcome-based reimbursement in Central-Eastern Europe and Middle-East. Front Med (Lausanne) 2022; 9:940886. [PMID: 36213666 PMCID: PMC9539523 DOI: 10.3389/fmed.2022.940886] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/10/2022] [Accepted: 09/01/2022] [Indexed: 11/13/2022] Open
Abstract
Outcome-based reimbursement models can effectively reduce the financial risk to health care payers in cases when there is important uncertainty or heterogeneity regarding the clinical value of health technologies. Still, health care payers in lower income countries rely mainly on financial based agreements to manage uncertainties associated with new therapies. We performed a survey, an exploratory literature review and an iterative brainstorming in parallel about potential barriers and solutions to outcome-based agreements in Central and Eastern Europe (CEE) and in the Middle East (ME). A draft list of recommendations deriving from these steps was validated in a follow-up workshop with payer experts from these regions. 20 different barriers were identified in five groups, including transaction costs and administrative burden, measurement issues, information technology and data infrastructure, governance, and perverse policy outcomes. Though implementing outcome-based reimbursement models is challenging, especially in lower income countries, those challenges can be mitigated by conducting pilot agreements and preparing for predictable barriers. Our guidance paper provides an initial step in this process. The generalizability of our recommendations can be improved by monitoring experiences from pilot reimbursement models in CEE and ME countries and continuing the multistakeholder dialogue at national levels.
Collapse
Affiliation(s)
- Ildikó Ádám
- Center for Health Technology Assessment, Semmelweis University, Budapest, Hungary
| | - Marcelien Callenbach
- Division of Pharmacoepidemiology and Clinical Pharmacology, Utrecht Institute for Pharmaceutical Sciences, Utrecht University, Utrecht, Netherlands
| | | | - Rick A. Vreman
- Division of Pharmacoepidemiology and Clinical Pharmacology, Utrecht Institute for Pharmaceutical Sciences, Utrecht University, Utrecht, Netherlands
- National Health Care Institute, Zorginstituut Nederland, Diemen, Netherlands
| | - Cecilia Tollin
- The Dental and Pharmaceutical Benefits Agency, Tandvårds- och Låkemedelsförmånsverket, Stockholm, Sweden
| | - Johan Pontén
- The Dental and Pharmaceutical Benefits Agency, Tandvårds- och Låkemedelsförmånsverket, Stockholm, Sweden
| | - Dalia Dawoud
- National Institute for Health and Care Excellence, London, United Kingdom
- Faculty of Pharmacy, Cairo University, Cairo, Egypt
| | - Jamie Elvidge
- National Institute for Health and Care Excellence, London, United Kingdom
| | - Nick Crabb
- National Institute for Health and Care Excellence, London, United Kingdom
| | | | - Anke Pisters-van Roy
- Department of Medical Advisory and Innovation, Centraal Ziekenfonds (CZ) Health Insurance, Tilburg, Netherlands
| | - Áron Vincziczki
- National Health Insurance Fund of Hungary, Nemzeti Egészségbiztosítási Alapkezelõ, Budapest, Hungary
| | - Emad Almomani
- Department for Health Technology Assessment, Jordanian Royal Medical Services, Amman, Jordan
| | | | | | - Mirna Matni
- Social Security Main Office, Caisse Nationale de la Sécurité Sociale, Beirut, Lebanon
| | - Jurij Fürst
- Department of Drugs, Health Insurance Institute of Slovenia, Ljubljana, Slovenia
| | - Rabia Kahveci
- Pharmaceutical Policies and Governance, Management Sciences for Health, Kyiv, Ukraine
| | - Wim G. Goettsch
- Division of Pharmacoepidemiology and Clinical Pharmacology, Utrecht Institute for Pharmaceutical Sciences, Utrecht University, Utrecht, Netherlands
- National Health Care Institute, Zorginstituut Nederland, Diemen, Netherlands
| | - Zoltán Kaló
- Center for Health Technology Assessment, Semmelweis University, Budapest, Hungary
- Syreon Research Institute, Budapest, Hungary
| |
Collapse
|
4
|
Efthymiadou O, Kanavos P. Impact of Managed Entry Agreements on availability of and timely access to medicines: an ex-post evaluation of agreements implemented for oncology therapies in four countries. BMC Health Serv Res 2022; 22:1066. [PMID: 35987627 PMCID: PMC9392357 DOI: 10.1186/s12913-022-08437-w] [Citation(s) in RCA: 12] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/20/2022] [Accepted: 07/28/2022] [Indexed: 11/10/2022] Open
Abstract
BACKGROUND Despite the increased utilisation of Managed Entry Agreements (MEAs), empirical studies assessing their impact on achieving better access to medicines remains scarce. In this study we evaluated the role of MEAs on enhancing availability of and timely access to a sample of oncology medicines that had received at least one prior rejection from reimbursement. METHODS Funding decisions and their respective timelines for all oncology medicines approved between 2009 and 2018 in Australia, England, Scotland and Sweden were studied. A number of binary logit models captured the probability (Odds ratio (OR)) of a previous coverage rejection being reversed to positive after resubmission with vs. without a MEA. Gamma generalised linear models were used to understand if there is any association between time to final funding decision and the presence of MEA, among other decision-making variables, and if so, the strength and direction of this association (Beta coefficient (B)). RESULTS Of the 59 previously rejected medicine-indication pairs studied, 88.2% (n = 45) received a favourable decision after resubmission with MEA vs. 11.8% (n = 6) without. Average time from original submission to final funding decision was 404 (± 254) and 452 (± 364) days for submissions without vs. with MEA respectively. Resubmissions with a MEA had a higher likelihood of receiving a favourable funding decision compared to those without MEA (43.36 < OR < 202, p < 0.05), although approval specifically with an outcomes-based agreement was associated with an increase in the time to final funding decision (B = 0.89, p < 0.01). A statistically significant decrease in time to final funding decision was observed for resubmissions in Australia and Scotland compared to England and Sweden, and for resubmissions with a clinically relevant instead of a surrogate endpoint. CONCLUSIONS MEAs can improve availability of medicines by increasing the likelihood of reimbursement for medicines that would have otherwise remained rejected from reimbursement due to their evidentiary uncertainties. Nevertheless, approval with a MEA can increase the time to final funding decision, while the true, added value for patients and healthcare systems of the interventions approved with MEAs in comparison to other available interventions remains unknown.
Collapse
Affiliation(s)
- Olina Efthymiadou
- Medical Technology Research Group, Department of Health Policy, London School of Economics, Houghton Street, London, WC2A 2AE, England.
| | - Panos Kanavos
- Medical Technology Research Group, Department of Health Policy, London School of Economics, Houghton Street, London, WC2A 2AE, England
| |
Collapse
|
5
|
van den Berg S, van der Wel V, de Visser SJ, Stunnenberg BC, Timmers L, van der Ree MH, Postema PG, Hollak CEM. Cost-Based Price Calculation of Mexiletine for Nondystrophic Myotonia. VALUE IN HEALTH : THE JOURNAL OF THE INTERNATIONAL SOCIETY FOR PHARMACOECONOMICS AND OUTCOMES RESEARCH 2021; 24:925-929. [PMID: 34243835 DOI: 10.1016/j.jval.2021.02.004] [Citation(s) in RCA: 14] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/16/2020] [Revised: 12/21/2020] [Accepted: 02/07/2021] [Indexed: 06/13/2023]
Abstract
OBJECTIVES Mexiletine is a long-known drug used for the treatment of arrhythmias and repurposed in the 1980s for patients with nondystrophic myotonia (NDM). Recently, the price of mexiletine in Europe increased significantly after registration as an orphan drug for NDM. This led to international discussions on affordability and willingness to reimburse mexiletine in the absence of background information that would justify such a price. Our objective was to calculate a cost-based price for mexiletine for adult patients with NDM based on detailed information on development costs. METHODS We calculated a fair price based on a cost-based pricing model for commercial mexiletine to treat adults with NDM using a recent European drug-pricing model as a framework to include actual costs incurred. Three scenarios were applied: 1 with minimum estimated costs, 1 with maximum estimated costs, and 1 with costs as if mexiletine was innovative. RESULTS The calculated fair price of mexiletine per patient per year (PPPY) is €452 for the minimum scenario and €1996 for the maximum scenario. By using hypothetical R&D costs used for innovative drugs, the price would be €6685 PPPY. In Europe, the list price of mexiletine ranges from €30 707-60 730 PPPY, based on 600 mg daily. CONCLUSIONS The current list price for mexiletine in Europe is manifold higher than any scenario of the cost-based models. Accounting for the reduced costs for clinical development in a repurposing scenario, the cost-based pricing model provides a fair commercial price range, which can be used as benchmark for pricing negotiations and/or reimbursement decisions.
Collapse
Affiliation(s)
- Sibren van den Berg
- Medicine for Society, Platform at Amsterdam UMC - University of Amsterdam, The Netherlands; Department of Endocrinology and Metabolism, Amsterdam UMC - University of Amsterdam, The Netherlands.
| | - Vincent van der Wel
- Medicine for Society, Platform at Amsterdam UMC - University of Amsterdam, The Netherlands
| | - Saco J de Visser
- Medicine for Society, Platform at Amsterdam UMC - University of Amsterdam, The Netherlands
| | - Bas C Stunnenberg
- Department of Neurology, Radboud University Medical Center, Nijmegen, The Netherlands; Department of Neurology, Rijnstate Hospital, Arnhem, The Netherlands
| | - Lonneke Timmers
- National Health Care Institute (Zorginstituut Nederland), Diemen, The Netherlands
| | - Martijn H van der Ree
- Heart Center, Department of Clinical and Experimental Cardiology, Amsterdam UMC, University of Amsterdam, Cardiovascular Sciences, Amsterdam, The Netherlands
| | - Pieter G Postema
- Heart Center, Department of Clinical and Experimental Cardiology, Amsterdam UMC, University of Amsterdam, Cardiovascular Sciences, Amsterdam, The Netherlands
| | - Carla E M Hollak
- Medicine for Society, Platform at Amsterdam UMC - University of Amsterdam, The Netherlands; Department of Endocrinology and Metabolism, Amsterdam UMC - University of Amsterdam, The Netherlands
| |
Collapse
|
6
|
Aranda-Reneo I, Rodríguez-Sánchez B, Peña-Longobardo LM, Oliva-Moreno J, López-Bastida J. Can the Consideration of Societal Costs Change the Recommendation of Economic Evaluations in the Field of Rare Diseases? An Empirical Analysis. VALUE IN HEALTH : THE JOURNAL OF THE INTERNATIONAL SOCIETY FOR PHARMACOECONOMICS AND OUTCOMES RESEARCH 2021; 24:431-442. [PMID: 33641778 DOI: 10.1016/j.jval.2020.10.014] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/22/2020] [Revised: 09/22/2020] [Accepted: 10/11/2020] [Indexed: 05/27/2023]
Abstract
OBJECTIVES To analyze whether the adoption of a societal perspective would alter the results and conclusions of economic evaluations for rare disease-related healthcare technologies. METHODS A search strategy involving all the active substances considered as orphan drugs by the European Medicines Agency plus a list of 76 rare diseases combined with economic-related terms was conducted on Medline and the Cost-Effectiveness Registry from the beginning of 2000 until November 2018. We included studies that considered quality-adjusted life years as an outcome, were published in a scientific journal, were written in English, included informal care costs or productivity losses, and separated the results according to the applied perspective. RESULTS We found 14 articles that fulfilled the inclusion criteria. Productivity losses were considered in 12 studies, the human capital approach being the method most frequently used. Exclusively, informal care was considered in 2 articles, being valued through the opportunity cost method. The 14 articles selected resulted in 26 economic evaluation estimations, from which incremental cost-utility ratio values changed from cost-effective to dominant in 3 estimates, but the consideration of societal costs only modified the authors' conclusion in 1 study. CONCLUSIONS The presence of societal costs in the economic evaluation of rare diseases did not affect the conclusions of the studies except in a single specific case. In those studies where the societal perspective was considered, we did not find significant changes in the economic evaluation results due to the higher costs of treatments and the low quality-adjusted life-years gained.
Collapse
Affiliation(s)
- Isaac Aranda-Reneo
- University of Castilla-La Mancha, Faculty of Social Science, Economics and Finance Department, Talavera de la Reina (Toledo), Spain.
| | - Beatriz Rodríguez-Sánchez
- University of Castilla-La Mancha, Faculty of Social Science, Economics and Finance Department, Talavera de la Reina (Toledo), Spain
| | - Luz María Peña-Longobardo
- University of Castilla-La Mancha, Faculty of Social Science, Economics and Finance Department, Talavera de la Reina (Toledo), Spain
| | - Juan Oliva-Moreno
- University of Castilla-La Mancha, Faculty of Social Science, Economics and Finance Department, Talavera de la Reina (Toledo), Spain
| | - Julio López-Bastida
- University of Castilla-La Mancha, Faculty of Health, Nursing Department, Talavera de la Reina (Toledo), Spain
| |
Collapse
|
7
|
A Vreman R, F Broekhoff T, GM Leufkens H, K Mantel-Teeuwisse A, G Goettsch W. Application of Managed Entry Agreements for Innovative Therapies in Different Settings and Combinations: A Feasibility Analysis. INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH 2020; 17:E8309. [PMID: 33182732 PMCID: PMC7698033 DOI: 10.3390/ijerph17228309] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 09/08/2020] [Revised: 10/30/2020] [Accepted: 11/05/2020] [Indexed: 12/28/2022]
Abstract
The reimbursement of expensive, innovative therapies poses a challenge to healthcare systems. This study investigated the feasibility of managed entry agreements (MEAs) for innovative therapies in different settings and combinations. First, a systematic literature review included studies describing used or conceptual agreements between payers and manufacturers (i.e., MEAs). Identical and similar MEAs were clustered and data were extracted on their benefits and limitations. A feasibility assessment was performed for each individual MEA based on how it could be applied (financial/outcome-based), on what level (individual patients/target population), in which payment setting (centralized pricing and reimbursement authority yes/no), for what type of therapies (one-time/chronic), within what payment structures, and whether combinations with other MEAs were feasible. The literature search ultimately included 82 papers describing 117 MEAs. After clustering, 15 unique MEAs remained, each describing one or multiple similar agreements. Four of those entailed payment structures, while eleven entailed agreements between payers and manufacturers regarding price, usage, and/or evidence generation. The feasibility assessment indicated that most agreements could be applied throughout the different settings that were assessed and could be applied in different payment structures and in combination with multiple other agreements. The potential to combine multiple agreements leads to a multitude of different reimbursement mechanisms that may manage the price, usage, payment structure, and additional conditions for an innovative therapy. This overview of the feasibility of combinations of MEAs can help decision-makers construct a reimbursement mechanism most suited to their preferences, the type of therapy under evaluation, and the applicable healthcare system.
Collapse
Affiliation(s)
- Rick A Vreman
- Division of Pharmacoepidemiology & Clinical Pharmacology, Utrecht Institute for Pharmaceutical Sciences (UIPS), Utrecht University, 3584 CG Utrecht, The Netherlands; (R.A.V.); (T.F.B.); (H.G.M.L.); (A.K.M.-T.)
- National Health Care Institute (ZIN), 1112 ZA Diemen, The Netherlands
| | - Thomas F Broekhoff
- Division of Pharmacoepidemiology & Clinical Pharmacology, Utrecht Institute for Pharmaceutical Sciences (UIPS), Utrecht University, 3584 CG Utrecht, The Netherlands; (R.A.V.); (T.F.B.); (H.G.M.L.); (A.K.M.-T.)
| | - Hubert GM Leufkens
- Division of Pharmacoepidemiology & Clinical Pharmacology, Utrecht Institute for Pharmaceutical Sciences (UIPS), Utrecht University, 3584 CG Utrecht, The Netherlands; (R.A.V.); (T.F.B.); (H.G.M.L.); (A.K.M.-T.)
| | - Aukje K Mantel-Teeuwisse
- Division of Pharmacoepidemiology & Clinical Pharmacology, Utrecht Institute for Pharmaceutical Sciences (UIPS), Utrecht University, 3584 CG Utrecht, The Netherlands; (R.A.V.); (T.F.B.); (H.G.M.L.); (A.K.M.-T.)
| | - Wim G Goettsch
- Division of Pharmacoepidemiology & Clinical Pharmacology, Utrecht Institute for Pharmaceutical Sciences (UIPS), Utrecht University, 3584 CG Utrecht, The Netherlands; (R.A.V.); (T.F.B.); (H.G.M.L.); (A.K.M.-T.)
- National Health Care Institute (ZIN), 1112 ZA Diemen, The Netherlands
| |
Collapse
|
8
|
Allocating healthcare resources to genomic testing in Canada: latest evidence and current challenges. J Community Genet 2019; 13:467-476. [PMID: 31273679 DOI: 10.1007/s12687-019-00428-5] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/18/2018] [Accepted: 06/14/2019] [Indexed: 12/30/2022] Open
Abstract
Precision medicine (PM) informed by next-generation sequencing (NGS) poses challenges for health technology assessment (HTA). To date, there has been limited reimbursement of genomic testing with NGS in Canada, particularly for whole-genome and whole-exome sequencing (WGS/WES). Through a structured literature review, we examine Canadian economic evidence and evidentiary challenges for the adoption of genomic testing. We searched Medline (PubMed) for published Canadian studies generating economic evidence for PM informed by NGS. Our search focused on studies examining the costs and/or value of NGS. We reviewed included studies and summarized results according to evaluation type, clinical context, NGS technology, and test strategy. We then grouped HTA challenges encountered by authors when evaluating NGS. Our review included twenty-five studies. To determine the economic impacts of NGS-informed PM in Canada, studies applied cost-effectiveness analysis (52%, n = 13), stated preference analysis (20%, n = 5), cost-consequence analysis (16%, n = 4), and healthcare resource utilization or costing analysis (12%, n = 3). NGS panels were the most common technology evaluated (n = 13), followed by WGS and/or WES (n = 8). The included studies highlighted multiple challenges when generating economic evidence, many of which remain unaddressed. Challenges were broadly related to (1) accounting for all NGS outcomes; (2) addressing uncertainty; and (3) improving consistency of economic approaches. Canadian studies are beginning to produce estimates of the economic impacts of NGS-informed PM, yet challenges for HTA remain. While solutions and real-world evidence are generated, lifecycle health technology management methods can be designed to better support resource allocation decisions for genomic testing in Canada.
Collapse
|
9
|
Pouwels XGLV, Grutters JPC, Bindels J, Ramaekers BLT, Joore MA. Uncertainty and Coverage With Evidence Development: Does Practice Meet Theory? VALUE IN HEALTH : THE JOURNAL OF THE INTERNATIONAL SOCIETY FOR PHARMACOECONOMICS AND OUTCOMES RESEARCH 2019; 22:799-807. [PMID: 31277827 DOI: 10.1016/j.jval.2018.11.010] [Citation(s) in RCA: 12] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/08/2018] [Revised: 11/07/2018] [Accepted: 11/21/2018] [Indexed: 06/09/2023]
Abstract
OBJECTIVES In theory, a successful coverage with evidence development (CED) scheme is one that addresses the most important uncertainties in a given assessment. We investigated the following: (1) which uncertainties were present during the initial assessment of 3 Dutch CED cases, (2) how these uncertainties were integrated in the initial assessments, (3) whether CED research plans included the identified uncertainties, and (4) issues with managing uncertainty in CED research and ways forward from these issues. METHODS Three CED initial assessment dossiers were analyzed and 16 stakeholders were interviewed. Uncertainties were identified in interviews and dossiers and were categorized in different causes: unavailability, indirectness, and imprecision of evidence. Identified uncertainties could be mentioned, described, and explored. Issues and ways forward to address uncertainty in CED schemes were discussed during the interviews. RESULTS Forty-two uncertainties were identified. Thirteen (31%) were caused by unavailability, 17 (40%) by indirectness, and 12 (29%) by imprecision. Thirty-four uncertainties (81%) were only mentioned, 19 (45%) were described, and the impact of 3 (7%) uncertainties on the results was explored in the assessment dossiers. Seventeen uncertainties (40%) were included in the CED research plans. According to stakeholders, research did not address the identified uncertainty, but CED research should be designed to focus on these. CONCLUSIONS In practice, uncertainties were neither systematically nor completely identified in the analyzed CED schemes. A framework would help to systematically identify uncertainty, and this process should involve all stakeholders. Value of information analysis, and the uncertainties that are not included in this analysis should inform CED research design.
Collapse
Affiliation(s)
- Xavier G L V Pouwels
- Department of Clinical Epidemiology and Medical Technology Assessment, Maastricht University Medical Centre, Maastricht, The Netherlands; Care and Public Health Research Institute, Maastricht University, Maastricht, The Netherlands.
| | | | - Jill Bindels
- Department of Clinical Epidemiology and Medical Technology Assessment, Maastricht University Medical Centre, Maastricht, The Netherlands
| | - Bram L T Ramaekers
- Department of Clinical Epidemiology and Medical Technology Assessment, Maastricht University Medical Centre, Maastricht, The Netherlands
| | - Manuela A Joore
- Department of Clinical Epidemiology and Medical Technology Assessment, Maastricht University Medical Centre, Maastricht, The Netherlands; Care and Public Health Research Institute, Maastricht University, Maastricht, The Netherlands
| |
Collapse
|
10
|
Godman B, Bucsics A, Vella Bonanno P, Oortwijn W, Rothe CC, Ferrario A, Bosselli S, Hill A, Martin AP, Simoens S, Kurdi A, Gad M, Gulbinovič J, Timoney A, Bochenek T, Salem A, Hoxha I, Sauermann R, Massele A, Guerra AA, Petrova G, Mitkova Z, Achniotou G, Laius O, Sermet C, Selke G, Kourafalos V, Yfantopoulos J, Magnusson E, Joppi R, Oluka M, Kwon HY, Jakupi A, Kalemeera F, Fadare JO, Melien O, Pomorski M, Wladysiuk M, Marković-Peković V, Mardare I, Meshkov D, Novakovic T, Fürst J, Tomek D, Zara C, Diogene E, Meyer JC, Malmström R, Wettermark B, Matsebula Z, Campbell S, Haycox A. Barriers for Access to New Medicines: Searching for the Balance Between Rising Costs and Limited Budgets. Front Public Health 2018; 6:328. [PMID: 30568938 PMCID: PMC6290038 DOI: 10.3389/fpubh.2018.00328] [Citation(s) in RCA: 89] [Impact Index Per Article: 12.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/15/2018] [Accepted: 10/26/2018] [Indexed: 01/26/2023] Open
Abstract
Introduction: There is continued unmet medical need for new medicines across countries especially for cancer, immunological diseases, and orphan diseases. However, there are growing challenges with funding new medicines at ever increasing prices along with funding increased medicine volumes with the growth in both infectious diseases and non-communicable diseases across countries. This has resulted in the development of new models to better manage the entry of new medicines, new financial models being postulated to finance new medicines as well as strategies to improve prescribing efficiency. However, more needs to be done. Consequently, the primary aim of this paper is to consider potential ways to optimize the use of new medicines balancing rising costs with increasing budgetary pressures to stimulate debate especially from a payer perspective. Methods: A narrative review of pharmaceutical policies and implications, as well as possible developments, based on key publications and initiatives known to the co-authors principally from a health authority perspective. Results: A number of initiatives and approaches have been identified including new models to better manage the entry of new medicines based on three pillars (pre-, peri-, and post-launch activities). Within this, we see the growing role of horizon scanning activities starting up to 36 months before launch, managed entry agreements and post launch follow-up. It is also likely there will be greater scrutiny over the effectiveness and value of new cancer medicines given ever increasing prices. This could include establishing minimum effectiveness targets for premium pricing along with re-evaluating prices as more medicines for cancer lose their patent. There will also be a greater involvement of patients especially with orphan diseases. New initiatives could include a greater role of multicriteria decision analysis, as well as looking at the potential for de-linking research and development from commercial activities to enhance affordability. Conclusion: There are a number of ongoing activities across countries to try and fund new valued medicines whilst attaining or maintaining universal healthcare. Such activities will grow with increasing resource pressures and continued unmet need.
Collapse
Affiliation(s)
- Brian Godman
- Strathclyde Institute of Pharmacy and Biomedical Sciences, University of Strathclyde, Glasgow, United Kingdom
- Health Economics Centre, University of Liverpool Management School, Liverpool, United Kingdom
- Division of Clinical Pharmacology, Karolinska Institute, Karolinska University Hospital Huddinge, Stockholm, Sweden
- School of Pharmacy, Sefako Makgatho Health Sciences University, Pretoria, South Africa
| | - Anna Bucsics
- Mechanism of Coordinated Access to Orphan Medicinal Products (MoCA), Brussels, Belgium
| | - Patricia Vella Bonanno
- Strathclyde Institute of Pharmacy and Biomedical Sciences, University of Strathclyde, Glasgow, United Kingdom
| | - Wija Oortwijn
- Ecorys, Rotterdam, Netherlands
- Department for Health Evidence, Radboud University Medical Center, Nijmegen, Netherlands
| | - Celia C. Rothe
- Department of Drug Management, Faculty of Health Sciences, Jagiellonian University Medical College, Krakow, Poland
| | - Alessandra Ferrario
- Division of Health Policy and Insurance Research, Department of Population Medicine, Harvard Medical School and Harvard Pilgrim Health Care Institute, Boston, MA, United States
| | | | - Andrew Hill
- Institute of Translational Medicine, University of Liverpool, Liverpool, United Kingdom
| | - Antony P. Martin
- Health Economics Centre, University of Liverpool Management School, Liverpool, United Kingdom
- HCD Economics, The Innovation Centre, Daresbury, United Kingdom
| | - Steven Simoens
- KU Leuven Department of Pharmaceutical and Pharmacological Sciences, Leuven, Belgium
| | - Amanj Kurdi
- Strathclyde Institute of Pharmacy and Biomedical Sciences, University of Strathclyde, Glasgow, United Kingdom
- Department of Pharmacology, College of Pharmacy, Hawler Medical University, Erbil, Iraq
| | - Mohamed Gad
- Global Health and Development Group, Imperial College, London, United Kingdom
| | - Jolanta Gulbinovič
- Department of Pathology, Forensic Medicine and Pharmacology, Faculty of Medicine, Institute of Biomedical Sciences, Vilnius University, Vilnius, Lithuania
| | - Angela Timoney
- Strathclyde Institute of Pharmacy and Biomedical Sciences, University of Strathclyde, Glasgow, United Kingdom
- NHS Lothian, Edinburgh, United Kingdom
| | - Tomasz Bochenek
- Department of Drug Management, Faculty of Health Sciences, Jagiellonian University Medical College, Krakow, Poland
| | | | - Iris Hoxha
- Department of Pharmacy, Faculty of Medicine, University of Medicine, Tirana, Albania
| | - Robert Sauermann
- Hauptverband der Österreichischen Sozialversicherungsträger, Vienna, Austria
| | - Amos Massele
- Department of Biomedical Sciences, Faculty of Medicine, University of Botswana, Gaborone, Botswana
| | - Augusto Alfonso Guerra
- Department of Social Pharmacy, College of Pharmacy, Federal University of Minas Gerais, Av. Presidente Antônio Carlos, Belo Horizonte, Brazil
- SUS Collaborating Centre – Technology Assessment & Excellence in Health (CCATES/UFMG), College of Pharmacy, Federal University of Minas Gerais. Av. Presidente Antônio Carlos, Belo Horizonte, Brazil
| | - Guenka Petrova
- Department of Social Pharmacy and Pharmacoeconomics, Faculty of Pharmacy, Medical University of Sofia, Sofia, Bulgaria
| | - Zornitsa Mitkova
- Department of Social Pharmacy and Pharmacoeconomics, Faculty of Pharmacy, Medical University of Sofia, Sofia, Bulgaria
| | | | - Ott Laius
- State Agency of Medicines, Tartu, Estonia
| | | | - Gisbert Selke
- Wissenschaftliches Institut der AOK (WIdO), Berlin, Germany
| | - Vasileios Kourafalos
- EOPYY-National Organization for the Provision of Healthcare Services, Athens, Greece
| | - John Yfantopoulos
- School of Economics and Political Science, University of Athens, Athens, Greece
| | - Einar Magnusson
- Department of Health Services, Ministry of Health, Reykjavík, Iceland
| | - Roberta Joppi
- Pharmaceutical Drug Department, Azienda Sanitaria Locale of Verona, Verona, Italy
| | - Margaret Oluka
- Department of Pharmacology and Pharmacognosy, School of Pharmacy, University of Nairobi, Nairobi, Kenya
| | - Hye-Young Kwon
- Division of Biology and Public Health, Mokwon University, Daejeon, South Korea
| | | | - Francis Kalemeera
- Department of Pharmacology and Therapeutics, Faculty of Health Sciences, University of Namibia, Windhoek, Namibia
| | - Joseph O. Fadare
- Department of Pharmacology and Therapeutics, Ekiti State University, Ado-Ekiti, Nigeria
| | | | - Maciej Pomorski
- Agency for Health Technology Assessment and Tariff System (AOTMiT), Warsaw, Poland
| | | | - Vanda Marković-Peković
- Ministry of Health and Social Welfare, Banja Luka, Bosnia and Herzegovina
- Department of Social Pharmacy, Faculty of Medicine, University of Banja Luka, Banja Luka, Bosnia and Herzegovina
| | - Ileana Mardare
- Public Health and Management Department, Faculty of Medicine, “Carol Davila”, University of Medicine and Pharmacy Bucharest, Bucharest, Romania
| | - Dmitry Meshkov
- National Research Institution for Public Health, Moscow, Russia
| | | | - Jurij Fürst
- Health Insurance Institute, Ljubljana, Slovenia
| | - Dominik Tomek
- Faculty of Medicine, Slovak Medical University in Bratislava, Bratislava, Slovakia
| | - Corrine Zara
- Drug Territorial Action Unit, Catalan Health Service, Barcelona, Spain
| | - Eduardo Diogene
- Vall d'Hebron University Hospital, Fundació Institut Català de Farmacologia, Barcelona, Spain
| | - Johanna C. Meyer
- School of Pharmacy, Sefako Makgatho Health Sciences University, Pretoria, South Africa
| | - Rickard Malmström
- Department of Medicine Solna, Karolinska Institutet and Clinical Pharmacology Karolinska University Hospital, Stockholm, Sweden
| | - Björn Wettermark
- Department of Medicine Solna, Karolinska Institutet and Clinical Pharmacology Karolinska University Hospital, Stockholm, Sweden
- Department of Healthcare Development, Stockholm County Council, Stockholm, Sweden
| | | | - Stephen Campbell
- Division of Population Health, Health Services Research and Primary Care, Centre for Primary Care, University of Manchester, Manchester, United Kingdom
- NIHR Greater Manchester Patient Safety Translational Research Centre, School of Health Sciences, University of Manchester, Manchester, United Kingdom
| | - Alan Haycox
- Health Economics Centre, University of Liverpool Management School, Liverpool, United Kingdom
| |
Collapse
|
11
|
Grimm SE, Strong M, Brennan A, Wailoo AJ. The HTA Risk Analysis Chart: Visualising the Need for and Potential Value of Managed Entry Agreements in Health Technology Assessment. PHARMACOECONOMICS 2017; 35:1287-1296. [PMID: 28849538 PMCID: PMC5684269 DOI: 10.1007/s40273-017-0562-9] [Citation(s) in RCA: 40] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/09/2023]
Abstract
BACKGROUND Recent changes to the regulatory landscape of pharmaceuticals may sometimes require reimbursement authorities to issue guidance on technologies that have a less mature evidence base. Decision makers need to be aware of risks associated with such health technology assessment (HTA) decisions and the potential to manage this risk through managed entry agreements (MEAs). OBJECTIVE This work develops methods for quantifying risk associated with specific MEAs and for clearly communicating this to decision makers. METHODS We develop the 'HTA risk analysis chart', in which we present the payer strategy and uncertainty burden (P-SUB) as a measure of overall risk. The P-SUB consists of the payer uncertainty burden (PUB), the risk stemming from decision uncertainty as to which is the truly optimal technology from the relevant set of technologies, and the payer strategy burden (PSB), the additional risk of approving a technology that is not expected to be optimal. We demonstrate the approach using three recent technology appraisals from the UK National Institute for Health and Clinical Excellence (NICE), each of which considered a price-based MEA. RESULTS The HTA risk analysis chart was calculated using results from standard probabilistic sensitivity analyses. In all three HTAs, the new interventions were associated with substantial risk as measured by the P-SUB. For one of these technologies, the P-SUB was reduced to zero with the proposed price reduction, making this intervention cost effective with near complete certainty. For the other two, the risk reduced substantially with a much reduced PSB and a slightly increased PUB. CONCLUSIONS The HTA risk analysis chart shows the risk that the healthcare payer incurs under unresolved decision uncertainty and when considering recommending a technology that is not expected to be optimal given current evidence. This allows the simultaneous consideration of financial and data-collection MEA schemes in an easily understood format. The use of HTA risk analysis charts will help to ensure that MEAs are considered within a standard utility-maximising health economic decision-making framework.
Collapse
Affiliation(s)
| | - Mark Strong
- School of Health And Related Research, University of Sheffield, Sheffield, UK
| | - Alan Brennan
- School of Health And Related Research, University of Sheffield, Sheffield, UK
| | - Allan J Wailoo
- School of Health And Related Research, University of Sheffield, Sheffield, UK
| |
Collapse
|
12
|
Ferrario A, Arāja D, Bochenek T, Čatić T, Dankó D, Dimitrova M, Fürst J, Greičiūtė-Kuprijanov I, Hoxha I, Jakupi A, Laidmäe E, Löblová O, Mardare I, Markovic-Pekovic V, Meshkov D, Novakovic T, Petrova G, Pomorski M, Tomek D, Voncina L, Haycox A, Kanavos P, Vella Bonanno P, Godman B. The Implementation of Managed Entry Agreements in Central and Eastern Europe: Findings and Implications. PHARMACOECONOMICS 2017; 35:1271-1285. [PMID: 28836222 PMCID: PMC5684278 DOI: 10.1007/s40273-017-0559-4] [Citation(s) in RCA: 80] [Impact Index Per Article: 10.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/21/2023]
Abstract
BACKGROUND Managed entry agreements (MEAs) are a set of instruments to facilitate access to new medicines. This study surveyed the implementation of MEAs in Central and Eastern Europe (CEE) where limited comparative information is currently available. METHOD We conducted a survey on the implementation of MEAs in CEE between January and March 2017. RESULTS Sixteen countries participated in this study. Across five countries with available data on the number of different MEA instruments implemented, the most common MEAs implemented were confidential discounts (n = 495, 73%), followed by paybacks (n = 92, 14%), price-volume agreements (n = 37, 5%), free doses (n = 25, 4%), bundle and other agreements (n = 19, 3%), and payment by result (n = 10, >1%). Across seven countries with data on MEAs by therapeutic group, the highest number of brand names associated with one or more MEA instruments belonged to the Anatomical Therapeutic Chemical (ATC)-L group, antineoplastic and immunomodulating agents (n = 201, 31%). The second most frequent therapeutic group for MEA implementation was ATC-A, alimentary tract and metabolism (n = 87, 13%), followed by medicines for neurological conditions (n = 83, 13%). CONCLUSIONS Experience in implementing MEAs varied substantially across the region and there is considerable scope for greater transparency, sharing experiences and mutual learning. European citizens, authorities and industry should ask themselves whether, within publicly funded health systems, confidential discounts can still be tolerated, particularly when it is not clear which country and party they are really benefiting. Furthermore, if MEAs are to improve access, countries should establish clear objectives for their implementation and a monitoring framework to measure their performance, as well as the burden of implementation.
Collapse
Affiliation(s)
| | - Diāna Arāja
- Department of Pharmacy, Ministry of Health, Faculty of Pharmacy, Riga Stradins University, Riga, Latvia
| | - Tomasz Bochenek
- Department of Drug Management, Faculty of Health Sciences, Jagiellonian University Medical College, 31-531 Kraków, Poland
| | - Tarik Čatić
- Society for Pharmacoecnomics and Outcomes Research in Bosnia and Herzegovina, Sarajevo, Bosnia and Herzegovina
| | - Dávid Dankó
- Corvinus University of Budapest, Budapest, Hungary
| | - Maria Dimitrova
- Department of Organization and Economy of Pharmacy, Faculty of Pharmacy, Medical University-Sofia, 2-Dunav, str Sofia 1000, Sofia, Bulgaria
| | - Jurij Fürst
- Health Insurance Institute of Slovenia, Miklošičeva 24, 1507 Ljubljana, Slovenia
| | | | - Iris Hoxha
- Department of Pharmacy, Faculty of Medicine, University of Medicine Tirana, Tirana, Albania
| | | | - Erki Laidmäe
- Head of Insurance Benefit Package, Estonian Health Insurance Fund, Tallinn, Estonia
| | - Olga Löblová
- School of Public Policy, Central European University, Nador u. 9, Budapest, 1051 Hungary
| | - Ileana Mardare
- Public Health and Management Department, Faculty of Medicine, “Carol Davila” University of Medicine and Pharmacy, Bucharest, 1-3, Dr. Leonte Anastasievici st., 050463 Bucharest, Romania
| | - Vanda Markovic-Pekovic
- Ministry of Health and Social Welfare, Banja Luka, Republic of Srpska Bosnia and Herzegovina
- Department of Social Pharmacy, Medical Faculty, University Banja Luka, Mrkalja 18, Banja Luka, Republic of Srpska Bosnia and Herzegovina
| | - Dmitry Meshkov
- National Research Institution for Public Health, Moscow, Russia
| | - Tanja Novakovic
- The Pharmacoeconomics Section, Pharmaceutical Association of Serbia, Belgrade, Serbia
| | - Guenka Petrova
- Department of Social Pharmacy and Pharmacoeconomics, Faculty of Pharmacy, Medical University of Sofia, Sofia, Bulgaria
| | - Maciej Pomorski
- Agency for Health Technology Assessment and Tariff System (AOTMiT), Krasickiego Street, Warsaw, Poland
| | - Dominik Tomek
- Faculty of Medicine, Slovak Medical University in Bratislava, Bratislava, Slovakia
| | | | - Alan Haycox
- Health Economics Centre, University of Liverpool Management School, Liverpool, UK
| | - Panos Kanavos
- LSE Health, London School of Economics and Political Science, London, UK
| | - Patricia Vella Bonanno
- Strathclyde Institute of Pharmacy and Biomedical Sciences, University of Strathclyde, Glasgow, G4 0RE United Kingdom
| | - Brian Godman
- Health Economics Centre, University of Liverpool Management School, Liverpool, UK
- Strathclyde Institute of Pharmacy and Biomedical Sciences, University of Strathclyde, Glasgow, G4 0RE United Kingdom
- Division of Clinical Pharmacology, Karolinska Institute, Karolinska University Hospital Huddinge, 141 86 Stockholm, Sweden
| |
Collapse
|
13
|
Hollis A. Bill C-30: who wins and who loses in Canada's pharmaceutical patent battles? Expert Opin Ther Pat 2017; 28:1-3. [PMID: 28974123 DOI: 10.1080/13543776.2018.1388780] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/18/2022]
Affiliation(s)
- Aidan Hollis
- a Department of Economics , University of Calgary , Calgary , Canada
| |
Collapse
|
14
|
Antoñanzas F, Terkola R, Overton PM, Shalet N, Postma M. Defining and Measuring the Affordability of New Medicines: A Systematic Review. PHARMACOECONOMICS 2017; 35:777-791. [PMID: 28477220 DOI: 10.1007/s40273-017-0514-4] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/07/2023]
Abstract
BACKGROUND In many healthcare systems, affordability concerns can lead to restrictions on the use of expensive efficacious therapies. However, there does not appear to be any consensus as to the terminology used to describe affordability, or the thresholds used to determine whether new drugs are affordable. OBJECTIVES The aim of this systematic review was to investigate how affordability is defined and measured in healthcare. METHODS MEDLINE, EMBASE and EconLit databases (2005-July 2016) were searched using terms covering affordability and budget impact, combined with definitions, thresholds and restrictions, to identify articles describing a definition of affordability with respect to new medicines. Additional definitions were identified through citation searching, and through manual searches of European health technology assessment body websites. RESULTS In total, 27 definitions were included in the review. Of these, five definitions described affordability in terms of the value of a product; seven considered affordability within the context of healthcare system budgets; and 15 addressed whether products are affordable in a given country based on economic factors. However, there was little in the literature to indicate that the price of medicines is considered alongside both their value to individual patients and their budget impact at a population level. CONCLUSIONS Current methods of assessing affordability in healthcare may be limited by their focus on budget impact. A more effective approach may involve a broader perspective than is currently described in the literature, to consider the long-term benefits of a therapy and cost savings elsewhere in the healthcare system, as well as cooperation between healthcare payers and the pharmaceutical industry to develop financing models that support sustainability as well as innovation.
Collapse
Affiliation(s)
- Fernando Antoñanzas
- Department of Economics, University of La Rioja, C/La Ciguena 60, 26004, Logrono, Spain.
| | - Robert Terkola
- College of Pharmacy, University of Florida, Gainesville, FL, USA
- Unit of PharmacoTherapy, Epidemiology and Economics (PTE2), Department of Pharmacy, University of Groningen, Groningen, The Netherlands
| | | | | | - Maarten Postma
- Unit of PharmacoTherapy, Epidemiology and Economics (PTE2), Department of Pharmacy, University of Groningen, Groningen, The Netherlands
- University Medical Center Groningen, Institute of Science in Healthy Aging & healthcaRE (SHARE), University of Groningen, Groningen, The Netherlands
- Department of Epidemiology, University Medical Center Groningen, University of Groningen, Groningen, The Netherlands
| |
Collapse
|