Global registries for measuring pharmacoeconomic and quality-of-life outcomes: focus on design and data collection, analysis and interpretation

A Prospective, Observational Registry Study to Evaluate Effectiveness and Safety of Hyaluronic Acid-Based Dermal Fillers in Routine Practice: Interim Analysis Results with One Year of Subject Follow-Up

Background

Monitoring the effectiveness, safety and emerging uses of hyaluronic acid (HA) fillers in their wide range of indications requires a holistic approach.

Purpose

To propose an observational study design aiming to gather real-world evidence (RWE) and continuously evaluate the performance and safety of marketed devices in routine practice.

Materials and Methods

A prospective, observational registry was initiated at six European sites. Investigators enrolled any subject receiving at least one injection with a target study device (TEOSYAL Deep Lines [HA_DL] and/or Global Action [HA_GA]). They followed their routine practice regarding injection technique, volume, and subject follow-up. Effectiveness was evaluated at 3 months using the global aesthetic improvement scale (GAIS). Safety was assessed based on common treatment reactions (CTR) and adverse events (AE).

Results

High quantity of RWE was collected following the initiation of this registry. In the first 158 subjects enrolled, 1220 injections were performed in more than 25 indications, including 679 with the target devices and 271 with devices of the same filler line. The primary objective was achieved, with 93.9% of treatments providing improvement at Month 3 according to the PI and subject. Post-injection CTR were mild to moderate and short-lived, and there was no clinically significant AE. More than 76% of treatments still provided some visible effect at month 12.

Conclusion

Based on RWE, HA_DL and HA_GL are effective and safe in their respective indications mostly distributed in the midface, perioral region, and lower face. Observational registries are a valuable asset in the context of post-market clinical follow-up.

Development of a pharmacoeconomic registry: an example using hormonal contraceptives

BACKGROUND

Disease-specific registries, documenting costs and probabilities from pharmacoeconomic studies along with health state utility values from quality-of-life studies could serve as a resource to guide researchers in evaluating the published literature and in the conduct of future economic evaluations for their own research. Registries cataloging economic evaluations currently exist, however they are restricted by the type of economic evaluations they include. There is a need for intervention-specific registries, that document all types of complete and partial economic evaluations and auxiliary information such as quality of life studies. The objective of this study is to describe the development of a pharmacoeconomic registry and provide best practices using an example of hormonal contraceptives.

METHODS

An expert panel consisting of researchers with expertise in pharmacoeconomics and outcomes research was convened and the clinical focus of the registry was finalized after extensive discussion. A list of key continuous, categorical and descriptive variables was developed to capture all relevant data with each variable defined in a data dictionary. A web-based data collection tool was designed to capture and store the resulting metadata. A keyword based search strategy was developed to retrieve the published sources of literature. Finally, articles were screened for relevancy and data was extracted to populate the registry. Expert opinions were taken from the panel at each stage to arrive at consensus and ensure validity of the registry.

RESULTS

The registry focused on economic evaluation literature of hormonal contraceptives used for contraception. The registry consisted of 65 articles comprising of 22 cost-effectiveness analyses, 9 cost-utility analyses, 7 cost-benefit analyses, 1 cost-minimization, 14 cost analyses, 10 cost of illness studies and 2 quality of life studies. The best practices followed in the development of the registry were summarized as recommendations. The completed registry, data dictionary and associated data files can be accessed in the supplementary information files.

CONCLUSION

This registry is a comprehensive database of economic evaluations, including costs, clinical probabilities and health-state utility estimates. The collated data captured from published information in this registry can be used to identify trends in the literature, conduct systematic reviews and meta-analysis and develop novel pharmacoeconomic models.

Effectiveness of triple therapy with direct-acting antivirals for hepatitis C genotype 1 infection: application of propensity score matching in a national HCV treatment registry

Background

Observational studies are used to measure the effectiveness of an intervention in non-experimental, real world scenarios at the population level and are recognised as an important component of the evidence pyramid. Such data can be accrued through prospective cohort studies and a patient registry is a proven method for this type of study. The national hepatitis C (HCV) registry was established in Ireland in 2012 with the aim of monitoring the clinical and economic outcomes from new, high cost regimens for the treatment of HCV infection. A sustained virological response (SVR) 24 weeks following completion of therapy with interferon-containing regimens is considered a cure. Non-randomisation in these studies can result in confounding or selection bias. Propensity score (PS) matching is one of a number of statistical tools that can be used to mitigate the effects of confounding in observational studies.

Methods

We analysed the data of 309 patients who underwent triple therapy treatment with telaprevir (TPV) in combination with pegylated-interferon and ribavirin (PR) or boceprevir (BOC)/PR between June 2012 and December 2014. The decision to initiate treatment and the selection of the treatment regimen was at the discretion of the physician. To adjust for confounding, three approaches to propensity score matching were assessed Adjusted sustained-virological response rates (SVR), odds ratios, p-values and 95% confidence intervals were calculated from the three PS matched dataset.

Results

Prior to matching, the unadjusted sustained virological response rates 24 weeks after treatment complete (SVR24) were 74% (n = 158/215) and 61% (n = 57/94) for telaprevir/PR and boceprevir/PR, respectively. After matching, adjusted SVR24 rates were between 73–74% and 60–61% for telaprevir/PR and boceprevir/PR, respectively.

Conclusion

Efficacy rates were comparable with those reported in pivotal clinical trials and real world studies. After adjusting for confounding, we conclude that there was no difference in treatment effect after PS matching. The small sample size limits the conclusions that can be made about the effect of PS matching. Propensity score adjustment remains a tool that can be applied to future analysis, however, we suggest, where possible, using a larger sample size in order to reduce the uncertainty around the outcomes.

Electronic supplementary material

The online version of this article (doi:10.1186/s12913-017-2188-1) contains supplementary material, which is available to authorized users.

Cost-Outcome Description of PEG-IFN-α2b+RBV for Hepatitis C: Results Based on the Interferon Database

Economic evaluation of drugs is used in decision-making on medical care and public policy. Recently, real-world data (RWD) have been used in the analysis. In this study, we discuss the risk and benefits of using RWD for economic evaluation. We conducted a cost-outcome description with RWD from a nationwide registry providing information on hepatitis treatment in Japan and estimated the utility of the analysis. We evaluated the cost-outcome description of peginterferon plus ribavirin (PEG-IFN-α2b+RBV) treatment in hepatitis C virus (HCV)-infected patients. Simulations were based on a Markov model. The cohorts were set using data from the registry and we assumed a societal perspective for the calculation of costs. The dose and drug cost were chosen based on the Japanese Guidelines for the Management of Hepatitis C Virus Infection or package inserts. Model details and parameters were as described in previous studies. The simulations were performed for a period of 10 years with no discount rate. We estimated 2.5 million JPY per Quality Adjusted Life Year (QALY) in 48-week PEG-IFN-α2b+RBV treatment for a period of 10 years. The results of this study are in agreement with previous HCV treatment economic evaluation studies in Japan. We analyzed the statistics of the HCV-infected patients at each disease stage using the data in our registry and calculated the costs. The results of this study more closely reflect a real-world clinical situation compared to the widely used randomized clinical trial method, which estimates clinical trial results and scenarios.

How to routinely collect data on patient-reported outcome and experience measures in renal registries in Europe: an expert consensus meeting

Despite the potential for patient-reported outcome measures (PROMs) and experience measures (PREMs) to enhance understanding of patient experiences and outcomes they have not, to date, been widely incorporated into renal registry datasets. This report summarizes the main points learned from an ERA-EDTA QUEST-funded consensus meeting on how to routinely collect PROMs and PREMs in renal registries in Europe. In preparation for the meeting, we surveyed all European renal registries to establish current or planned efforts to collect PROMs/PREMs. A systematic review of the literature was performed. Publications reporting barriers and/or facilitators to PROMs/PREMs collection by registries were identified and a narrative synthesis undertaken. A group of renal registry representatives, PROMs/PREMs experts and patient representatives then met to (i) share any experience renal registries in Europe have in this area; (ii) establish how patient-reported data might be collected by understanding how registries currently collect routine data and how patient-reported data is collected in other settings; (iii) harmonize the future collection of patient-reported data by renal registries in Europe by agreeing upon preferred instruments and (iv) to identify the barriers to routine collection of patient-reported data in renal registries in Europe. In total, 23 of the 45 European renal registries responded to the survey. Two reported experience in collecting PROMs and three stated that they were actively exploring ways to do so. The systematic review identified 157 potentially relevant articles of which 9 met the inclusion criteria and were analysed for barriers and facilitators to routine PROM/PREM collection. Thirteen themes were identified and mapped to a three-stage framework around establishing the need, setting up and maintaining the routine collection of PROMs/PREMs. At the consensus meeting some PROMs instruments were agreed for routine renal registry collection (the generic SF-12, the disease-specific KDQOL™-36 and EQ-5D-5L to be able to derive quality-adjusted life years), but further work was felt to be needed before recommending PREMs. Routinely collecting PROMs and PREMs in renal registries is important if we are to better understand what matters to patients but it is likely to be challenging; close international collaboration will be beneficial.

THERAPY COMPLIANCE IN AMBULATORY PATIENTS: PROFILE REGISTRY DATA

Aim.Using the data from the PROFILE Registry and the patients’ questionnaire survey, to analyse the patients’ compliance with medical recommendations on lipid-lowering therapy (LLT).

Material and methods.Over the period from May 1st 2011 to December 31st 2011, 274 patients were included in the PROFILE Registry: 82 were referred to a specialised medical centre for the first time (control group, CG); 167 were regularly attending the medical centre (main group A, MGA); and 25 last visited the centre >2 years ago (main group B, MGB). 262 patients completed a questionnaire on the therapy compliance, while 12 refused to participate in the questionnaire survey.

Results.According to the results of the questionnaire survey, MGA patients were better informed about the LLT goals (65%) than their CG and MGB peers (35% and 48%, respectively; p<0,0001). The percentage of patients who took statins every day was 87% in MGA vs. 41,5% in CG and 64% in MGB (p=0,002). Statin therapy effectiveness was controlled regularly in MGA: cholesterol (CH) levels were measured every 6 months in 37,5% and every 12 months in 28%. For CG, these figures were 17% and 16%, while for MGB, they were 15% and 40%, respectively (p<0,0001). One-third of CG patients, every fourth MGB patient, and only 13% of MGA patients did not control their CH levels (p<0,0001).

Conclusion.The MGA patients who were regularly attending the State Research Centre for Preventive Medicine were the most LLT-compliant: they were well-informed about their disease and therapy goals, were regularly taking prescribed medications (statins), and had better treatment control and the highest LLT effectiveness.

REGISTERS IN CARDIOLOGY: THEIR PRINCIPLES, RULES, AND REAL-WORD POTENTIAL

The article presents the main goals, tasks, principles, and methodological aspects of the cardiology register development. The authors describe the main types of registers, provide the examples, and specify the key principles of the register development and maintenance. In addition, they discuss the role of both long- and short-term registers in solving a wide range of important research tasks, particularly in the areas of effectiveness and safety of cardiovascular pharmacotherapy and the survival prognosis for specific nosological forms. The task-specific limitations of registers are also discussed. 

Continuous innovation: developing and using a clinical database with new technology for patient-centred care--the case of the Swedish quality register for arthritis

OBJECTIVE

We describe and explain the development of a clinical quality database and its use for different clinical, management and patient empowerment purposes.

DESIGN

A longitudinal case study covering 1993-2009.

SETTING

Rheumatology departments in Swedish hospitals.

PARTICIPANTS

Those involved in developing the clinical database and its applications and a limited number of users.

INTERVENTION(S)

Different methods for inputting and storing clinical and patient data and for analysing and presenting the data to providers and patients.

MAIN OUTCOME MEASURE(S)

Participants' perceptions of the value of different applications and of influences, which helped and hindered the development of the system.

RESULTS

Different innovations were introduced at different times continually to increase the ultility of the clinical data and the clinic- and patient coverage of the clinical data system. Limited interview data show postive patient and provider perceptions of the latest application to collect and present data as time trend visual display in the clinical consultation.

CONCLUSIONS

A longitudinal perspective revealed how a clinical quality register was developed and how new technologies not imagined in the early 1990s continue to increase the ultility and value of the clinical database. This historical perspective provided limited evidence of impact, but does provide lessons for current strategies for innovation for quality in health care and of the need to consider innovolution processes, rather than discrete innovations, given the rapid pace of change in new technologies. More evidence is needed of the impact of such registers, and of enhancements, on providers and patients and on costs.

Observation of health technologies after their introduction into clinical practice: a systematic review on data collection instruments

RATIONALE, AIMS AND OBJECTIVES

Early assessment of health technologies after they are covered by the health system is deemed crucial to promptly identify and analyse unforeseen problems that may arise when these are used in real world settings. This paper aims to describe the various instruments which could be used for collecting information intended for prospective observation of health technologies, so as to choose the specific instrument best suited to each context.

METHODS

Systematic review of the medical literature aimed at retrieving general reference documents on data collection instruments for post-introduction observation of health technologies. A purpose-designed systematic bibliographic search was elaborated for the main three data collection instruments identified.

RESULTS

The three instruments are briefly described along with the main results of the studies retrieved, in terms of the advantages, drawbacks and considerations to be borne in mind when it comes to use these tools in post-introduction observation of new technologies.

CONCLUSIONS

At present, the most appropriate data collection method for conducting post-introduction observation of new technologies is the use of prospective clinical registries. Electronic clinical records may replace clinical registries in the near future, but currently there are still many doubts as to the quality of the information retrieved.

Establishment of electronic chart-based stroke registry system in a medical system in Taiwan

To establish a prospective, real-time, self-sustainable stroke registry system, we incorporated a registry with an electronic chart to create an electronic chart-based stroke registry system in November 2006. The International Classification of Diseases Ninth Revision code (430-437) was used to auto-enroll stroke patients admitted to neurology departments. Clinical information was written by doctors, nursing information was recorded by nurses, and basic patient information was entered by administrative departments. Numerical data and the date and time of any studies were auto-downloaded from the hospital computer. In total, 212 items were auto-downloaded, including basic patient information, laboratory blood test and examination results, and the date and time of imaging and special intervention. The stroke scales (121 items, National Institutes of Health Stroke Scale, Barthel index, and modified Rankin scale) were designed to be auto-adjusted to reduce incompatibility. The 95 items with pull-down options were used to specify the contents. This registry system can be time-, labor- and money-saving with secured data accuracy.

Feasibility of internet-based health-related quality of life data collection in a large patient cohort

Background

Patient registries are commonly used to track survival and medical outcomes in large cohorts. However, large-scale collection of health-related quality of life (HRQOL) data is more challenging because such data must be collected directly from patients. Internet-based HRQOL questionnaires are a potential solution, allowing home data collection with immediate storage in a central database.

Objectives

Our objectives were to investigate the sociodemographic predictors of Internet use and willingness to convey HRQOL information over the Internet in a Canadian tertiary care patient population and to determine whether Internet use patterns of tertiary care patients differ from those of the general Canadian population. Additionally, we sought to identify the success of home completion of Internet-based HRQOL questionnaires, as well as factors hindering home completion.

Methods

We surveyed 644 patients at the Toronto General and St. Michael’s Hospitals from November 2003 through July 2006 within a prospective, longitudinal cohort study of HRQOL in patients with lung disease or lung transplants. Using multiple logistic regression, we assessed patient age, gender, rurality, marital status, and employment or education status as potential sociodemographic predictors of having an Internet-accessible home computer, using email at least weekly, and willingness to complete a quality of life questionnaire over the Internet. Patients electing to complete questionnaires over the Internet were followed from September 2005 through March 2008 to assess completion of HRQOL questionnaires from home, identify barriers for noncompletion, and determine sociodemographic predictors for home completion.

Results

Of the 644 patients, the median age was 51 years, with a similar number of males and females. Most were urban Ontario residents, were unemployed, and were married or in a common-law relationship. Having an Internet-accessible home computer was reported by 79.7% (513/644) of patients and use of email at least weekly by 66.5% (414/623) of patients. A majority of patients (57.1% 368/644) were willing to complete HRQOL questionnaires over the Internet via an emailed link. Of the participating 644 patients, 368 elected to complete future questionnaires from home and, as part of a gradual roll-out of the home HRQOL questionnaire, 211 were sent emails inviting them to do so. Of the invited patients, 78% (165/211) completed at least one questionnaire from home. The most common reason for noncompletion was a lack of or an inability to find time to complete the questionnaire. No statistically significant sociodemographic predictors of Internet use were associated with completion or noncompletion of questionnaires from home.

Conclusions

Home, Internet-based HRQOL assessment is feasible in tertiary care patient populations with a high predicted rate of Internet usage based on sociodemographic parameters. A large minority of patients were unwilling or unable to take part in home HRQOL assessments indicating that alternative methods of data collection are still required. However, the majority of patients electing to complete home HRQOL assessments went on to do so over the Internet.

The role of drug and disease registries in rheumatic disease epidemiology

PURPOSE OF REVIEW

This review highlights the present state of efforts at registry implementation which exist internationally. These efforts are contrasted with those in the USA.

RECENT FINDINGS

The implications of the different data which are derived from diverse registry sources are discussed. The need for long-term data from large and varied sources is fulfilled by registries that collect data from different populations. The potential differences in the nature of the data derived from these registries is dependent upon the national healthcare system from which they are derived, as there are significant differences in access to newer biologic agents which are inconsistent across countries.

SUMMARY

Registry data are critical in order to develop an understanding of the performance and safety of new agents in the real world. The challenges for implementing a registry are manifold in the USA because of the somewhat chaotic nature of the healthcare delivery system. In order to overcome these unique challenges, registries in the USA need to be exceptionally well organized and funded, while maintaining independence from the pharmaceutical industry funding sources in the reporting and interpretation of data in peer-reviewed publications. Examples of these registries are provided and discussed.

Psychosocial registry for persons with cancer: a method of facilitating quality of life and symptom research

Research focused on the psychosocial aspects of the experience of persons with cancer and their family caregivers is hampered by the methodological challenges inherent in quality of life research. A data registry offers a potential solution to many of these problems in providing a large, comprehensive database, using standardized instruments. We report here our preliminary experience with establishing a Psychosocial Registry designed to advance research in the psychological, social, and spiritual aspects of quality of life of newly diagnosed cancer patients and their family caregivers. The first six months of enrollment demonstrated that the majority of newly diagnosed patients approached for consent (68%) and their primary family caregiver (92%) were willing to participate in the registry; of these, 80% also agreed to be contacted in the future for additional studies. Face-to-face interview was the preferred method of data collection. Our preliminary experience suggests that continuation of the registry with the current modest level of resources would generate a sample of approximately 1000 patients in three years. The long-range goal is to establish a national psychosocial data registry that will enroll patients at diagnosis and follow them through the entire cancer experience, including end of life or survivorship.

Analysis of data-collection methods for an acute stroke care registry

This study aims to assess and compare the completeness and reliability of data collected by prospective and retrospective methods for the Paul Coverdell National Acute Stroke Registry. The prototypes consisted of eight states that used the same data elements but differed in their collection approach. Three prototypes employed retrospective case ascertainment (n=1218), and five prototypes used prospective or a combination of prospective and retrospective case ascertainment (n=1602). RTI International performed an audit analysis of the eight prototypes. Completeness, exact match, and discrepancy analyses were performed with data elements grouped into 12 categories for this analysis. A sample of 2820 (37.6%) from a total of 7494 records from 91 hospitals was studied. The "in-hospital complications" section had the highest percentage of completeness (99.6%), followed by "demographic data" (97.7%), and "in-hospital diagnostic procedures" (93.4%). The section with the lowest percentage of completeness was "thrombolytic treatment" (53.5%), followed by "reasons for nontreatment with thrombolytics" (57.1%), and "signs and symptoms onset" (63.5%). Across all prototype elements, exact matches with audit data ranged from 62.8% to 95.9%. Documentation of the date/time of stroke onset and of arrival in the emergency department had a high number of discrepancies with audit data, with exact match percentages of 69.7% and 64.5%, respectively. No significant difference was found between retrospective and prospective case ascertainment in completeness or matching with audit data. Combined retrospective and prospective data-collection approaches for different types of data elements may be best in terms of both completeness and accuracy.

Are registry hospitals different? A comparison of patients admitted to hospitals of a commercial heart failure registry with those from national and community cohorts

BACKGROUND

Clinical registries have been created to address questions that are difficult to answer with clinical trials. However, the applicability of registry findings to the general population has been questioned because of concerns over potential bias in the selection of participating hospitals. The purpose of this study was to determine if patients admitted to hospitals participating in a heart failure registry (ADHERE) are comparable with patients admitted to other hospitals, including those admitted to Framingham area hospitals.

METHODS

We used a 20% random sample of all Medicare patients discharged during 1984 to 2001 to determine rates of hospitalization, procedure use, and survival after a first admission for heart failure (none in the prior 3 years). Hospitals were classified as participating in the ADHERE registry (n = 189), located within or near Framingham, MA (n = 9), or other (n = 5541).

RESULTS

A total of 725,702 first admissions were identified, including 80,338 to ADHERE hospitals and 1716 to Framingham area hospitals. Minimal differences in patient characteristics were noted between patients admitted to ADHERE and non-ADHERE hospitals, although patients admitted to Framingham area hospitals were more likely to be white (95%) than were patients admitted to ADHERE (84%) or other hospitals (87%, P < .0001). Mortality at 1 year was 35.8% for ADHERE, 36.2% for other hospitalized patients, and 32.9% for Framingham patients (P < .0001). Rehospitalization for heart failure at 90 days was 13.0% for following admission to ADHERE, 13.0% to other hospitals, and 16.4% to Framingham hospitals (P = .0004). After adjustment for patient characteristics, differences in outcome between ADHERE and non-ADHERE hospitals remained minimal.

CONCLUSION

Patients admitted with heart failure to ADHERE registry hospitals had similar baseline characteristics and outcomes to other patients.

Health services research in the privacy age

BACKGROUND

Strengthened regulations concerning privacy of health information are affecting large-scale health outcomes research.

OBJECTIVE

To create a data collection system that would facilitate outcomes research, avoid selection bias, and fulfill obligations to protect privacy.

DESIGN

We created a web-based system that uses touch-screen computer technology for longitudinal collection of data. The system provides access to information in deidentified form, enables it to be linked to health services and outcomes data, and allows patients to join a research registry project (RRP) and be placed on a prospective subject list (PSL). PARTICIPANTS, MEASUREMENTS, AND RESULTS: Pilot testing in 86 consecutive patients who were seen at a large, urban, university-based general medicine practice and had a mean age of 50 years showed that 81 patients had no difficulty, 5 had some difficulty, and none had considerable difficulty using the computer technology to complete a health survey. No patients refused to complete the survey and all patients completed the entire survey. Forty-seven (55%) joined the RRP and 42 of these 47 (89%) joined the PSL. RRP participants were less likely than RRP nonparticipants to be divorced or widowed (P=.03) and less likely to have hypertension (P=.03) but had no other significant differences in sociodemographic or clinical characteristics. PSL participants did not differ from PSL nonparticipants.

CONCLUSIONS

The new system ensures privacy and appears to facilitate research recruitment and avoid selection bias.