Using the national registry of HIV-infected veterans in research: lessons for the development of disease registries

Evaluation of Research Accessibility and Data Elements of HIV Registries

BACKGROUND

Patient registries represent a long-term data collection system that is a platform for performing multiple research studies to generate real-world evidence. Many of these registries use common data elements (CDEs) and link data from Electronic Health Records.

OBJECTIVE

This study evaluated HIV registry features that contribute to the registry's usability for retrospective analysis of existing registry data or new prospective interventional studies.

METHODS

We searched PubMed and ClinicalTrials.gov (CTG) to generate a list of HIV registries. We used the framework developed by the European Medical Agency (EMA) to evaluate the registries by determining the presence of key research features. These features included information about the registry, request and collaboration processes, and available data. We acquired data dictionaries and identified CDEs.

RESULTS

We found 13 HIV registries that met our criteria, 11 through PubMed and 2 through CTG. The prevalence of the evaluated features ranged from all 13 (100%) having published key registry information to 0 having a research contract template. We analyzed 6 data dictionaries and identified 14 CDEs that were present in at least 4 of 6 (66.7%) registry data dictionaries.

CONCLUSION

The importance of registries as platforms for research data is growing and the presence of certain features, including data dictionaries, contributes to the reuse and secondary research capabilities of a registry. We found some features such as collaboration policies were in the majority of registries while others such as, ethical support, were in a few and are more for future development.

Alternatives to randomized controlled trials in telemedicine

Research designs other than true experiments may be useful in the evaluation of telemedicine. Potential methods include those that do not rely on randomization and tight control of the intervention, and analysis of existing administrative and clinical databases. Quasi-experimental designs may also be useful, especially when conducted in association with careful statistical methods that allow the investigator to control for certain differences between groups. Databases, such as those maintained by the Centers for Medicare and Medicaid Services, contain information on both outcomes and claims, as well as disease/procedure registries and electronic health records. This may provide a potential tool for understanding the effects of telemedicine on access to care in conjunction with costs and quality. These different approaches have advantages and disadvantages, but may be useful in telemedicine, where the conduct of randomized controlled trials is generally very expensive and frequently not feasible.

Preserving Patient Privacy When Sharing Same-Disease Data

Medical and health data are often collected for studying a specific disease. For such same-disease microdata, a privacy disclosure occurs as long as an individual is known to be in the microdata. Individuals in same-disease microdata are thus subject to higher disclosure risk than those in microdata with different diseases. This important problem has been overlooked in data-privacy research and practice, and no prior study has addressed this problem. In this study, we analyze the disclosure risk for the individuals in same-disease microdata and propose a new metric that is appropriate for measuring disclosure risk in this situation. An efficient algorithm is designed and implemented for anonymizing same-disease data to minimize the disclosure risk while keeping data utility as good as possible. An experimental study was conducted on real patient and population data. Experimental results show that traditional reidentification risk measures underestimate the actual disclosure risk for the individuals in same-disease microdata and demonstrate that the proposed approach is very effective in reducing the actual risk for same-disease data. This study suggests that privacy protection policy and practice for sharing medical and health data should consider not only the individuals' identifying attributes but also the health and disease information contained in the data. It is recommended that data-sharing entities employ a statistical approach, instead of the HIPAA's Safe Harbor policy, when sharing same-disease microdata.

Patient registries for substance use disorders

This commentary discusses the need for developing patient registries of substance use disorders (SUD) in general medical settings. A patient registry is a tool that documents the natural history of target diseases. Clinicians and researchers use registries to monitor patient comorbidities, care procedures and processes, and treatment effectiveness for the purpose of improving care quality. Enactments of the Affordable Care Act 2010 and the Mental Health Parity and Addiction Equity Act 2008 open opportunities for many substance users to receive treatment services in general medical settings. An increased number of patients with a wide spectrum of SUD will initially receive services with a chronic disease management approach in primary care. The establishment of computer-based SUD patient registries can be assisted by wide adoption of electronic health record systems. The linkage of SUD patient registries with electronic health record systems can facilitate the advancement of SUD treatment research efforts and improve patient care.

The European Cystic Fibrosis Society Patient Registry: valuable lessons learned on how to sustain a disease registry

BACKGROUND

Disease registries have the invaluable potential to provide an insight into the natural history of the disease under investigation, to provide useful information (e.g. through health indicators) for planning health care services and to identify suitable groups of patients for clinical trials enrolment. However, the establishment and maintenance of disease registries is a burdensome initiative from economical and organisational points of view and experience sharing on registries management is important to avoid waste of resources. The aim of this paper is to discuss the problems embedded in the institution and management of an international disease registry to warn against common mistakes that can derail the best of intentions: we share the experience of the European Cystic Fibrosis Society Patient Registry, which collects data on almost 30,000 patients from 23 countries.

METHODS

We discuss the major problems that researchers often encounter in the creation and management of disease registries: definition of the aims the registry has to reach, definition of the criteria for patients referral to the registry, definition of the information to record, set up of a data quality process, handling of missing data, maintenance of data confidentiality, regulation of data use and dissemination of research results.

RESULTS

We give examples on how many crucial aspects were solved by the European Cystic Fibrosis Society Patient Registry regarding objectives, inclusion criteria and variables definition, data management, data quality controls, missing data handling, confidentiality maintenance, data use and results dissemination.

CONCLUSIONS

We suggest an extensive literature research and discussions in working groups with different stake holders, including patient representatives, on the objectives, inclusion criteria and the information to record. We propose to pilot the recording of few variables and test the applicability of their definition first. The use of a shared electronic platform for data collection that automatically computes derived variables, and automatically performs basic data quality controls is a good data management practice, that also helps in reducing missing data. We found crucial for success the collaboration with existing national and international registries, cystic fibrosis organisations and patients' associations.

Mental health disorders and the risk of AIDS-defining illness and death in HIV-infected veterans

OBJECTIVE

Mental health comorbidities are common in HIV-infected veterans and can impact clinical outcomes for HIV. We examined the impact of mental health diagnoses on progression to AIDS-defining illness (ADI) and death in a large cohort of HIV-infected veterans who accessed care between 2001 and 2006.

DESIGN

Retrospective cohort study using the national Veterans Health Administration (VHA) HIV Clinical Case Registry.

METHODS

We identified HIV-infected veterans initiating combination antiretroviral therapy (cART) within the VHA between 2000 and 2006. The prevalences of the following mental health diagnoses were examined: schizophrenia, bipolar disorder, depression, anxiety, and substance use disorder. Cox proportional hazards models were constructed to examine the relationship between mental health conditions and two outcomes, all-cause mortality and ADI. Models were computed before and after adjusting for confounding factors including age, race, baseline CD4 cell count, comorbidities and cART adherence.

RESULTS

Among 9003 veterans receiving cART, 31% had no mental health diagnosis. Age, race, baseline comorbidity score, CD4, and cART adherence were associated with shorter time to ADI or death. All-cause mortality was more likely among veterans with schizophrenia, bipolar disorder and substance use, and ADI was more likely to occur among veterans with substance use disorder.

CONCLUSIONS

Our results demonstrate the high prevalence of mental health diagnoses among HIV-infected veterans. In the era of highly active antiretroviral therapy, presence of psychiatric diagnoses impacted survival and development of ADI. More aggressive measures addressing substance abuse and severe mental illness in HIV-infected veterans are necessary.

Utilizing a diabetic registry to manage diabetes in a low-income Asian American population

Racial and income disparities persist in diabetes management in America. One third of African and Hispanic Americans with diabetes receive the recommended diabetes services (hemoglobin A1c [A1c] testing, retinal and foot examinations) shown to reduce diabetes complications and mortality, compared to half of whites with diabetes. National data for Asian Americans are limited, but studies suggest that those with language and cultural barriers have difficulty accessing health services. A diabetic registry has been shown to improve process and clinical outcomes in a population with diabetes. This study examined whether a community center that serves primarily low-income Asian American immigrants in Santa Clara County, California, could improve diabetes care and outcomes by implementing a diabetic registry. The registry was built using the Access 2007 software program. A total of 580 patients with diabetes were identified by reviewing charts, the appointment database, and reimbursement records from Medicaid, Medicare, and private insurance companies. Utilizing the registry, medical assistants contacted patients for follow-up appointments, and medical providers checked and tracked the patients' A1c results. Among the 431 patients who returned for treatment, the mean A1c was reduced from 7.27% to 6.97% over 8 months (P<0.001). Although 10.8% of the patients changed from controlled to uncontrolled diabetes post intervention, 32.6% of patients with uncontrolled diabetes converted to controlled diabetes (P<0.001). The diabetes control rate improved from 47% to 59% at the end of the study. This study demonstrated that a diabetic registry is an effective tool to manage an underserved population with diabetes, thereby reducing disparities in diabetes management.

Accuracy of VA databases for diagnoses of knee replacement and hip replacement

PURPOSE

To examine the validity of International Classification of Diseases-Ninth Revision (ICD-9) and Current Procedural Terminology (CPT) codes for knee replacement and hip replacement in Veterans Affairs (VA) databases.

METHODS

From a cohort of veterans who received health care at Minneapolis VA Medical Center and/or affiliated medical facilities, we obtained four random samples of 50 patients each with: neither hip nor knee replacement code, knee replacement code only, hip replacement code only and both knee and hip replacement codes. The gold standard was documentation of knee or hip replacement surgery in patient medical records. Accuracy of ICD-9 or CPT code for knee and hip replacement was assessed by calculating sensitivity, specificity, positive and negative predictive values (PPV and NPV).

RESULTS

Of the 200 patients, medical records were available for 166:140 (70%) had complete medical records and 26 (13%) had incomplete medical records. Knee replacement codes were accurate with excellent PPV of 95%, sensitivity of 95%, specificity of 96% and NPV of 96%. Hip replacement codes were accurate with excellent PPV of 98%, sensitivity of 96%, specificity of 99% and NPV of 96%. Sensitivity analyses that included incomplete charts had little impact on these estimates. The procedure dates found in VA databases matched exactly with medical records in 96%.

CONCLUSIONS

The ICD-9 and CPT codes for knee replacement and hip replacement in VA databases are valid. These codes may be used to identify cohorts of veterans with knee replacement and hip replacement for research studies.

Retention in care: a challenge to survival with HIV infection

BACKGROUND

Patients with human immunodeficiency virus (HIV) infection need lifelong medical care, but many do not remain in care. The effect of poor retention in care on survival is not known, and we sought to quantify that relationship.

METHODS

We conducted a retrospective cohort study involving persons newly identified as having HIV infection during 1997-1998 at any United States Department of Veterans Affairs hospital or clinic who started antiretroviral therapy after 1 January 1997. To be included in the study, patients had to have seen a clinician at least once after receiving their first antiretroviral prescription and to have survived for at least 1 year. Patients were divided into 4 groups on the basis of the number of quarters in that year during which they had at least 1 HIV primary care visit. Survival was measured through 2002. Because data were available for only a small number of women, female patients were excluded from the study.

RESULTS

A total of 2619 men were followed up for a mean of >4 years each. The median baseline CD4(+) cell count and median log(10) plasma HIV concentration were 228x10(6) cells/L and 4.58 copies/mL, respectively. Thirty-six percent of the patients had visits in <4 quarters, and 16% died during follow-up. In Cox multivariate regression analysis, compared with persons with visits in all 4 quarters during the first year, the adjusted hazard ratio of death was 1.42 (95% confidence interval, 1.11-1.83; P<.01), 1.67 (95% confidence interval, 1.24-2.25; P<.001), and 1.95 (95% confidence interval, 1.37-2.78; P<.001) for persons with visits in 3 quarters, 2 quarters, and 1 quarter, respectively.

CONCLUSIONS

Even in a system with few financial barriers to care, a substantial portion of HIV-infected patients have poor retention in care. Poor retention in care predicts poorer survival with HIV infection. Retaining persons in care may improve survival, and optimal methods to retain patients need to be defined.

Relationship Between Antiretroviral Prescribing Patterns and Treatment Guidelines in Treatment-Naive HIV-1-Infected US Veterans (1992-2004)

OBJECTIVE

To analyze temporal patterns of antiretroviral (ARV) prescribing practices relative to nationally defined guidelines in treatment-naive patients with HIV-1 infection.

DESIGN

Retrospective cohort study.

METHODS

We evaluated ARV prescribing patterns among ARV treatment-naive veterans who were receiving care within the US Department of Veterans Affairs (VA) from 1992 through 2004 in comparison to evolving adult HIV-1 treatment guidelines.

RESULTS

A total of 15,934 patients initiated ARV treatment. Since 1999, >94% of patients initiated at least a 3-ARV medication combination, although the percentage of patients who initiated a guideline "preferred" or "alternative" regimen never rose to greater than 72% and was significantly associated with being black and with region of care. After 1999, 20% of patients started 4 or more active ARV agents in combination, which was significantly associated with lower baseline CD4 cell count, higher viral load, and receiving care in the western United States. The proportion of patients receiving guideline "not recommended" regimens (virologically undesirable or overlapping toxicities) was <1% after 1997. VA prescribing trends generally predated guideline recommendations by 6 to 12 months.

CONCLUSIONS

VA prescribing patterns for ARV initiation adhere to treatment guidelines that maximize safety. Guidelines designed to maximize efficacy were not followed as stringently. Evaluating clinical practice patterns against contemporary treatment guidelines can inform guideline development.

Theoretical and methodological issues in conducting research related to health care utilization among individuals with HIV infection

Although empirical information on resource use during HIV infection is vital to improving quality of care, the issues involved in conducting research on resource use have received little attention in the medical literature. The purpose of this paper is to review the theoretical and methodological issues of conducting research on health care utilization patterns among persons with HIV/AIDS. Conceptual definitions of utilization are compared and contrasted. Three theoretical frameworks, the Andersen Behavioral Model, the Health Belief Model, and the Biopsychosocial Model are described to illustrate their applicability in future research studies. Research designs, measurement considerations, sampling approaches, and existing data sources on utilization are reviewed. Recommendations for health care utilization research are summarized and highlight the importance of designing studies and generating data for investigation of the factors facilitating patients' use of an optimal array of services including prevention, long-term, and rehabilitation care.

A patient registry for cognitive rehabilitation research: a strategy for balancing patients' privacy rights with researchers' need for access

OBJECTIVE

To describe a consent-based Patient Research Registry designed to improve the quality and efficiency of cognitive rehabilitation research by balancing patients' privacy rights with researchers' need for access to research participants.

DESIGN

Description of a protocol for a Patient Research Registry.

SETTING

Three rehabilitation hospitals.

PARTICIPANTS

Inpatients with stroke or traumatic brain injury (TBI) at the 3 participating hospitals.

INTERVENTIONS

Not applicable.

MAIN OUTCOME MEASURES

Percentages of eligible patients with stroke or TBI who consented to be enrolled in the Registry, were subsequently contacted about a study, and ultimately participated in a study. A survey examined satisfaction with the Registry among researchers who used it for recruitment.

RESULTS

After 36 months of operation, 58% of patients approached have consented to be in the Registry (N=1256). Eighty-seven percent of those later identified as potential subjects for research studies expressed interest, and 63% eventually participated. Researchers reported satisfaction with the recruitment opportunities afforded by the Registry.

CONCLUSIONS

The Registry succeeded in identifying eligible patients interested in participating in research studies, while safeguarding their privacy rights. We identify its strengths and limitations and characterize the type of facility that would most profit from adopting this recruitment model.

Using disease registries for pharmacoepidemiological research: a case study of data from a cystic fibrosis registry

BACKGROUND

The Epidemiologic Registry of Cystic Fibrosis (ERCF) was a multicentre, longitudinal follow-up project of cystic fibrosis patients enrolled at some 200 centres in nine European countries between 1994 and 1999.

PURPOSE

We aimed to assess and improve the quality of a subset of data from the ERCF relating to seven English centres (1184 patients), prior to using the data for a long-term cost-effectiveness analysis of dornase alfa (Pulmozyme). Specifically we wanted to assess the completeness and accuracy of the data and the comparability of cases across centres.

METHODS

We used a subset of ERCF data relating to seven UK cystic fibrosis (CF) centres. Following initial data editing, key variable data from a sample of patients from five centres were subjected to a detailed verification of ERCF data against original data sources available in the centres. Disagreements between ERCF reports and original data sources were identified and corrected in the study dataset. In addition, centre staff were questioned about relevant clinical and recording practices.

RESULTS

Thanks to detailed routine data checking procedures on key variables operated by the ERCF, the rates of disagreement between ERCF data and original data as identified in our verification process on the assessed variables are generally low (0.4-3.7%). Some outcome variables (deaths, hospitalisations) seem to be under-reported by some centres. Episodes of pulmonary exacerbation are difficult to identify and also to verify. Twenty-four patients were registered twice (consecutively in two different centres). There were some differences between centres in their interpretation of recording rules.

CONCLUSIONS

Researchers seeking to use disease registry data should consider detailed data quality review processes. Apart from data accuracy, reliable definitions of both critical events as well as their timing are important. The degree of under-reporting, particularly of outcome variables, should be estimated. Information on local clinical and reporting practices is necessary to interpret multi-centre data. Data protection issues may limit the possibilities for detailed data quality assessments of secondary data, as does the accessibility of original data for verification purposes. Our experiences and recommendations may be valuable for those intending to use disease registry data as well as those devising and operating such registries.

Information system concepts for quality measurement

BACKGROUND

Health care information systems in use today frequently fall short of what is needed to meet the demands for data and reporting on performance. Many observers believe substantial improvements in information systems will be necessary if the potential of a national quality measurement and reporting system (NQMRS) is to be realized. A shared vision will facilitate progress in improving information systems.

OBJECTIVES

To articulate a set of guiding principles and operational steps for the development of functional information systems in health care.

RESEARCH DESIGN

Experience in building such systems for one health care delivery system was used to develop an approach. This was discussed with Strategic Framework Board members and integrated with other considerations for going from a local system to one that could accumulate information for national purposes.

FINDINGS

The key elements of a functional information system include provisions that (1) data should be collected once, (2) aggregation of data for higher-level reports should be anticipated, (3) issues related to privacy and confidentiality must be addressed, and (4) measurement systems should include an audit standard. A seven-step process for developing a functional information system is outlined.

CONCLUSIONS

A shared national measurement framework is essential because the data systems that health care delivery organizations use are not static. A long-term vision can guide the growth of a data system over time. An NQMRS can be the vehicle that provides the needed vision.