Identifying priorities in methodological research using ICD-9-CM and ICD-10 administrative data: report from an international consortium

[The REporting of studies Conducted using Observational Routinely-collected health Data (RECORD) statement]

Zunehmend werden routinemäßig gesammelte Gesundheitsdaten, die zu administrativen und klinischen Zwecken und ohne spezifische, a priori festgelegte Forschungsziele erhoben wurden, auch für die Forschung eingesetzt. Die rasche Entwicklung und Verfügbarkeit dieser Daten machten Probleme deutlich, die in den bestehenden Berichts-Leitlinien, wie dem STROBE-Statement (Strengthening the Reporting of Observational Studies in Epidemiology) nicht behandelt werden. Das RECORD-Statement (REporting of studies Conducted using Observational Routinely-collected health Data) wurde entwickelt, um diese Lücken zu schließen. RECORD ist als Erweiterung des STROBE-Statements gedacht, um Punkte abzudecken, die spezifisch sind beim Berichten von Beobachtungsstudien, die routinemäßig gesammelte Gesundheitsdaten verwenden. RECORD besteht aus einer Checkliste von 13 Punkten mit Bezug zu Titel, Abstract, Einleitung, Methoden-, Ergebnis- und Diskussionsteil von Artikeln sowie zu anderen Informationen, die in Forschungsberichten dieser Art enthalten sein sollten. Dieses Dokument enthält die Checkliste sowie Erläuterungen und weitere Erklärungen, um die Verwendung der Checkliste zu verbessern. Beispiele für ein gutes Berichten der einzelnen Punkte der RECORD-Checkliste sind ebenfalls in diesem Dokument enthalten. Dieses Dokument sowie die zugehörige Website und ein Forum (http://www.record-statement.org) werden die Umsetzung und das Verständnis von RECORD verbessern. Autoren, Redakteure von Fachzeitschriften und Peer-Reviewer können die Transparenz beim Berichten von Forschungsergebnissen erhöhen, indem sie RECORD anwenden.

Development of an expert based ICD-9-CM and ICD-10-CM map to AIS 2005 update 2008

OBJECTIVE

This article describes how maps were developed from the clinical modifications of the 9th and 10th revisions of the International Classification of Diseases (ICD) to the Abbreviated Injury Scale 2005 Update 2008 (AIS08). The development of the mapping methodology is described, with discussion of the major assumptions used in the process to map ICD codes to AIS severities. There were many intricacies to developing the maps, because the 2 coding systems, ICD and AIS, were developed for different purposes and contain unique classification structures to meet these purposes.

METHODS

Experts in ICD and AIS analyzed the rules and coding guidelines of both injury coding schemes to develop rules for mapping ICD injury codes to the AIS08. This involved subject-matter expertise, detailed knowledge of anatomy, and an in-depth understanding of injury terms and definitions as applied in both taxonomies. The official ICD-9-CM and ICD-10-CM versions (injury sections) were mapped to the AIS08 codes and severities, following the rules outlined in each coding manual. The panel of experts was composed of coders certified in ICD and/or AIS from around the world. In the process of developing the map from ICD to AIS, the experts created rules to address issues with the differences in coding guidelines between the 2 schemas and assure a consistent approach to all codes.

RESULTS

Over 19,000 ICD codes were analyzed and maps were generated for each code to AIS08 chapters, AIS08 severities, and Injury Severity Score (ISS) body regions. After completion of the maps, 14,101 (74%) of the eligible 19,012 injury-related ICD-9-CM and ICD-10-CM codes were assigned valid AIS08 severity scores between 1 and 6. The remaining 4,911 codes were assigned an AIS08 of 9 (unknown) or were determined to be nonmappable because the ICD description lacked sufficient qualifying information for determining severity according to AIS rules. There were also 15,214 (80%) ICD codes mapped to AIS08 chapter and ISS body region, which allow for ISS calculations for patient data sets.

CONCLUSION

This mapping between ICD and AIS provides a comprehensive, expert-designed solution for analysts to bridge the data gap between the injury descriptions provided in hospital codes (ICD-9-CM, ICD-10-CM) and injury severity codes (AIS08). By applying consistent rules from both the ICD and AIS taxonomies, the expert panel created these definitive maps, which are the only ones endorsed by the Association for the Advancement of Automotive Medicine (AAAM). Initial validation upheld the quality of these maps for the estimation of AIS severity, but future work should include verification of these maps for MAIS and ISS estimations with large data sets. These ICD-AIS maps will support data analysis from databases with injury information classified in these 2 different systems and open new doors for the investigation of injury from traumatic events using large injury data sets.

Research Methods in Healthcare Epidemiology and Antimicrobial Stewardship: Use of Administrative and Surveillance Databases

Administrative and surveillance data are used frequently in healthcare epidemiology and antimicrobial stewardship (HE&AS) research because of their wide availability and efficiency. However, data quality issues exist, requiring careful consideration and potential validation of data. This methods paper presents key considerations for using administrative and surveillance data in HE&AS, including types of data available and potential use, data limitations, and the importance of validation. After discussing these issues, we review examples of HE&AS research using administrative data with a focus on scenarios when their use may be advantageous. A checklist is provided to help aid study development in HE&AS using administrative data.

Infect Control Hosp Epidemiol 2016;1–10

Diagnostic accuracy of administrative data algorithms in the diagnosis of osteoarthritis: a systematic review

Background

Administrative health care data are frequently used to study disease burden and treatment outcomes in many conditions including osteoarthritis (OA). OA is a chronic condition with significant disease burden affecting over 27 million adults in the US. There are few studies examining the performance of administrative data algorithms to diagnose OA. The purpose of this study is to perform a systematic review of administrative data algorithms for OA diagnosis; and, to evaluate the diagnostic characteristics of algorithms based on restrictiveness and reference standards.

Methods

Two reviewers independently screened English-language articles published in Medline, Embase, PubMed, and Cochrane databases that used administrative data to identify OA cases. Each algorithm was classified as restrictive or less restrictive based on number and type of administrative codes required to satisfy the case definition. We recorded sensitivity and specificity of algorithms and calculated positive likelihood ratio (LR+) and positive predictive value (PPV) based on assumed OA prevalence of 0.1, 0.25, and 0.50.

Results

The search identified 7 studies that used 13 algorithms. Of these 13 algorithms, 5 were classified as restrictive and 8 as less restrictive. Restrictive algorithms had lower median sensitivity and higher median specificity compared to less restrictive algorithms when reference standards were self-report and American college of Rheumatology (ACR) criteria. The algorithms compared to reference standard of physician diagnosis had higher sensitivity and specificity than those compared to self-reported diagnosis or ACR criteria.

Conclusions

Restrictive algorithms are more specific for OA diagnosis and can be used to identify cases when false positives have higher costs e.g. interventional studies. Less restrictive algorithms are more sensitive and suited for studies that attempt to identify all cases e.g. screening programs.

Electronic supplementary material

The online version of this article (doi:10.1186/s12911-016-0319-y) contains supplementary material, which is available to authorized users.

Validity of ICD-9-CM codes for breast, lung and colorectal cancers in three Italian administrative healthcare databases: a diagnostic accuracy study protocol

INTRODUCTION

Administrative healthcare databases are useful tools to study healthcare outcomes and to monitor the health status of a population. Patients with cancer can be identified through disease-specific codes, prescriptions and physician claims, but prior validation is required to achieve an accurate case definition. The objective of this protocol is to assess the accuracy of International Classification of Diseases Ninth Revision-Clinical Modification (ICD-9-CM) codes for breast, lung and colorectal cancers in identifying patients diagnosed with the relative disease in three Italian administrative databases.

METHODS AND ANALYSIS

Data from the administrative databases of Umbria Region (910,000 residents), Local Health Unit 3 of Napoli (1,170,000 residents) and Friuli--Venezia Giulia Region (1,227,000 residents) will be considered. In each administrative database, patients with the first occurrence of diagnosis of breast, lung or colorectal cancer between 2012 and 2014 will be identified using the following groups of ICD-9-CM codes in primary position: (1) 233.0 and (2) 174.x for breast cancer; (3) 162.x for lung cancer; (4) 153.x for colon cancer and (5) 154.0-154.1 and 154.8 for rectal cancer. Only incident cases will be considered, that is, excluding cases that have the same diagnosis in the 5 years (2007-2011) before the period of interest. A random sample of cases and non-cases will be selected from each administrative database and the corresponding medical charts will be assessed for validation by pairs of trained, independent reviewers. Case ascertainment within the medical charts will be based on (1) the presence of a primary nodular lesion in the breast, lung or colon-rectum, documented with imaging or endoscopy and (2) a cytological or histological documentation of cancer from a primary or metastatic site. Sensitivity and specificity with 95% CIs will be calculated.

DISSEMINATION

Study results will be disseminated widely through peer-reviewed publications and presentations at national and international conferences.

Validation and optimisation of an ICD-10-coded case definition for sepsis using administrative health data

OBJECTIVE

Administrative health data are important for health services and outcomes research. We optimised and validated in intensive care unit (ICU) patients an International Classification of Disease (ICD)-coded case definition for sepsis, and compared this with an existing definition. We also assessed the definition's performance in non-ICU (ward) patients.

SETTING AND PARTICIPANTS

All adults (aged ≥ 18 years) admitted to a multisystem ICU with general medicosurgical ICU care from one of three tertiary care centres in the Calgary region in Alberta, Canada, between 1 January 2009 and 31 December 2012 were included.

RESEARCH DESIGN

Patient medical records were randomly selected and linked to the discharge abstract database. In ICU patients, we validated the Canadian Institute for Health Information (CIHI) ICD-10-CA (Canadian Revision)-coded definition for sepsis and severe sepsis against a reference standard medical chart review, and optimised this algorithm through examination of other conditions apparent in sepsis.

MEASURES

Sensitivity (Sn), specificity (Sp), positive predictive value (PPV) and negative predictive value (NPV) were calculated.

RESULTS

Sepsis was present in 604 of 1001 ICU patients (60.4%). The CIHI ICD-10-CA-coded definition for sepsis had Sn (46.4%), Sp (98.7%), PPV (98.2%) and NPV (54.7%); and for severe sepsis had Sn (47.2%), Sp (97.5%), PPV (95.3%) and NPV (63.2%). The optimised ICD-coded algorithm for sepsis increased Sn by 25.5% and NPV by 11.9% with slightly lowered Sp (85.4%) and PPV (88.2%). For severe sepsis both Sn (65.1%) and NPV (70.1%) increased, while Sp (88.2%) and PPV (85.6%) decreased slightly.

CONCLUSIONS

This study demonstrates that sepsis is highly undercoded in administrative data, thus under-ascertaining the true incidence of sepsis. The optimised ICD-coded definition has a higher validity with higher Sn and should be preferentially considered if used for surveillance purposes.

Inpatient rehabilitation outcomes in patients with malignant spinal cord compression compared to other non-traumatic spinal cord injury: A population based study

OBJECTIVE

To compare and describe demographic characteristics, clinical, and survival outcomes in patients admitted for inpatient rehabilitation following malignant spinal cord compression (MSCC) or other causes of non-traumatic spinal cord injury (NT-SCI).

DESIGN

A retrospective cohort design was employed, using data retrieved from administrative databases.

SETTING

Rehabilitation facilities or designated rehabilitation beds in Ontario, Canada, from April 2007 to March 2011.

PARTICIPANTS

Patients with incident diagnoses of MSCC (N = 143) or NT-SCI (N = 1,274) admitted for inpatient rehabilitation.

OUTCOME MEASURES

Demographic, impairment, functional outcome (as defined by the Functional Independence Measure (FIM)), discharge, healthcare utilization, survival, and tumor characteristics.

RESULTS

There was a significant improvement in the FIM from admission to discharge (mean change 20.1 ± 14.3, <0.001) in the MSCC cohort. NT-SCI patients demonstrated a higher FIM efficiency (1.2 ± 1.7 vs. 0.8 ± 0.8, <0.001) and higher total (24.0 ± 14.4 vs. 20.1 ± 14.3, <0.001) FIM gains relative to MSCC cases. However, there were no differences between the MSCC and NT-SCI cohorts in length of stay (34.6 ± 30.3 vs. 37.5 ± 35.2, P = 0.8) or discharge FIM (100.7 ± 19.6 vs. 103.3 ± 18.1, P = 0.1). Three-month, 1-year, and 3-year survival rates in the MSCC and NT-SCI cohorts were 76.2% vs. 97.6%, 46.2% vs. 93.7%, and 27.3% vs. 86.7%, respectively. The majority (65.0%) of patients with MSCC was discharged home and met their rehabilitation goals (75.5%) at comparable rates to patients with NT-SCI (69.7 and 81.3%).

CONCLUSION

Despite compromised survival, patients with MSCC make clinically significant functional gains and exhibit favorable discharge outcomes following inpatient rehabilitation. Current administrative data suggests the design and scope of inpatient rehabilitation services should reflect the unique survival-related prognostic factors in patients with MSCC.

The REporting of studies Conducted using Observational Routinely-collected health Data (RECORD) statement

Routinely collected health data, obtained for administrative and clinical purposes without specific a priori research goals, are increasingly used for research. The rapid evolution and availability of these data have revealed issues not addressed by existing reporting guidelines, such as Strengthening the Reporting of Observational Studies in Epidemiology (STROBE). The REporting of studies Conducted using Observational Routinely collected health Data (RECORD) statement was created to fill these gaps. RECORD was created as an extension to the STROBE statement to address reporting items specific to observational studies using routinely collected health data. RECORD consists of a checklist of 13 items related to the title, abstract, introduction, methods, results, and discussion section of articles, and other information required for inclusion in such research reports. This document contains the checklist and explanatory and elaboration information to enhance the use of the checklist. Examples of good reporting for each RECORD checklist item are also included herein. This document, as well as the accompanying website and message board (http://www.record-statement.org), will enhance the implementation and understanding of RECORD. Through implementation of RECORD, authors, journals editors, and peer reviewers can encourage transparency of research reporting.

Bayesian estimation of the accuracy of ICD-9-CM- and CPT-4-based algorithms to identify cholecystectomy procedures in administrative data without a reference standard

PURPOSE

To estimate the accuracy of two algorithms to identify cholecystectomy procedures using International Classification of Diseases, 9th Edition, Clinical Modification (ICD-9-CM) and Current Procedural Terminology (CPT-4) codes in administrative data.

METHODS

Private insurer medical claims for 30 853 patients 18-64 years with an inpatient hospitalization between 2006 and 2010, as indicated by providers/facilities place of service in addition to room and board charges, were cross-classified according to the presence of codes for cholecystectomy. The accuracy of ICD-9-CM- and CPT-4-based algorithms was estimated using a Bayesian latent class model.

RESULTS

The sensitivity and specificity were 0.92 [probability interval (PI): 0.92, 0.92] and 0.99 (PI: 0.97, 0.99) for ICD-9-CM-, and 0.93 (PI: 0.92, 0.93) and 0.99 (PI: 0.97, 0.99) for CPT-4-based algorithms, respectively. The parallel-joint scheme, where positivity of either algorithm was considered a positive outcome, yielded a sensitivity and specificity of 0.99 (PI: 0.99, 0.99) and 0.97 (PI: 0.95, 0.99), respectively.

CONCLUSIONS

Both ICD-9-CM- and CPT-4-based algorithms had high sensitivity to identify cholecystectomy procedures in administrative data when used individually and especially in a parallel-joint approach.

Higher serum carcinoembryonic antigen levels associate with more frequent development of incident fractures in Korean women: a longitudinal study using the national health insurance claim data

BACKGROUND

Pro-inflammatory cytokines play important roles in bone metabolism and several studies have shown that carcinoembryonic antigen (CEA) may promote inflammation. We investigated the association of serum CEA levels with the risk of osteoporosis and incident fracture.

METHODS

We performed a small cross-sectional study with 302 Korean women and a large, longitudinal study with 7192 Korean women in an average 3-year follow-up period. For the cross-sectional study, bone mineral density (BMD) and bone turnover markers (BTMs) were measured. For the longitudinal study, incident fractures in the follow-up period were identified by using the selected International Classification of Diseases, 10th revision (ICD-10) codes and the nationwide claims database of the Health Insurance Review and Assessment Service of Korea.

RESULTS

In the cross-sectional study, serum CEA levels correlated negatively with BMD at the lumbar spine (γ=-0.023; P=0.029) and positively with BTMs (γ=0.122 to 0.138, P=0.002 to P<0.001) after adjustment for confounding variables. In the longitudinal study, 254 (3.5%) women developed incident fractures in the follow-up period (2.8±1.3 years). After adjustment for potential confounders, the hazard ratio (HR) per 1 ng/mL increment of the baseline CEA level for the development of incident fracture was 1.22 [95% confidence interval (CI): 1.05-1.42]. The HR was markedly higher in subjects in the highest CEA quartile category compared with those in the lowest CEA quartile category (HR=1.54, 95% CI: 1.04-2.28).

CONCLUSION

Therefore, serum CEA may be a biomarker of the risk of incident fracture in postmenopausal Korean women.

Burden of digestive diseases in Portugal: trends in hospitalizations between 2000 and 2010

OBJECTIVE

Data on the burden of gastrointestinal diseases are incomplete, particularly in Southern European countries. The aim of this study was to estimate the burden of digestive diseases in Portugal.

PATIENTS AND METHODS

This was a retrospective observational study based on the national hospitalizations database that identified all consecutive episodes with a first diagnosis of a digestive disease between 2000 and 2010 using ICD-9-CM codes. Comparative analyses were carried out to assess hospitalization trends of major indicators over time and across regions.

RESULTS

More than 75,000 deaths attributable to digestive diseases were observed, representing 16% of the overall in-hospital mortality. Over half of these (59%) were premature deaths (in patients <75 years of age). Biliary tract disease was the most common digestive disorder leading to hospitalization (249,817 episodes, 5210 episodes of acute stone-related cholecystitis in 2010, with an 11% increase compared with 2000). Gastric cancer was responsible for the highest number of in-hospital deaths (10,278) and alcohol-related liver disorders accounted for the highest in-hospital premature deaths (7572). Both costs and the in-hospital mortality rate for major digestive diseases showed a significant positive relation with progression of time (β=0.195, P<0.001); however, when adjusted for age, this was not significant. Significant positive associations were found between age and in-hospital mortality (odds ratio=1.032, P<0.001) and between costs and in-hospital mortality (odds ratio=1.054, P<0.001).

CONCLUSION

In Portugal, digestive diseases represent a major burden, with evidence of an increasing trend. An ageing population contributes strongly towards this increase, placing further demands on healthcare organizations. Diseases such as gastric cancer, biliary tract disease and alcohol-related liver disorders may require particular attention.

Disparities in diabetes-related preventable hospitalizations among working-age Native Hawaiians and Asians in Hawai'i

Elderly (65+) Native Hawaiian, Filipino, and Japanese men and Filipino women have a higher risk of diabetes-related potentially preventable hospitalizations than Whites even when demographic factors and the higher diabetes prevalence in these populations is considered. The study objective was to determine if similar disparities are seen among the non-elderly (< 65). We used discharge data for all non-maternity hospitalizations by working-age adults (18-64 years) in Hawai'i from December 2006 to December 2010. Annual diabetes-related preventable hospitalization rates (by population diabetes prevalence) were compared by race/ethnicity (Japanese, Chinese, Native Hawaiian, Filipino, and White) and gender. Adjusted rate ratios (aRR) were calculated relative to Whites using multivariable models controlling for insurer, comorbidity, residence location, and age. After adjusting for ethnic-specific prevalence of diabetes and demographic factors, preventable hospitalizations rates were significantly higher for Native Hawaiians males (aRR:1.48; 95%CI:1.08-2.05) compared to Whites, but significantly lower for Chinese men (aRR:0.43;95%CI:0.30-0.61) and women (aRR:0.18;95%CI: 0.08-0.37), Japanese men (aRR:0.33;95%CI: 0.25-0.44) and women (aRR:0.34; 95%CI:0.23-0.51), and Filipino men (aRR:0.35;95%CI:0.28-0.43) and women (aRR:0.47;95%CI: 0.36-0.62). Rates for Native Hawaiian females did not differ significantly from Whites. Disparities in diabetes-related preventable hospitalizations were seen for working-age (18-64) Native Hawaiian men even when their higher population-level diabetes prevalence was considered. Further research is needed to determine factors affecting these disparities and to develop targeted interventions to reduce them. Significantly lower preventable hospitalization rates were seen among Asian groups compared to Whites. A better understanding of these findings may provide guidance for improving rates among Asian elderly as well as other non-elderly groups with disparities.

Validity of hospital discharge diagnosis codes for stroke: the Atherosclerosis Risk in Communities Study

BACKGROUND AND PURPOSE

Characterizing International Classification of Disease 9th Revision, Clinical Modification (ICD-9-CM) code validity is essential given widespread use of hospital discharge databases in research. Using the Atherosclerosis Risk in Communities (ARIC) Study, we estimated the accuracy of ICD-9-CM stroke codes.

METHODS

Hospitalizations with ICD-9-CM codes 430 to 438 or stroke keywords in the discharge summary were abstracted for ARIC cohort members (1987-2010). A computer algorithm and physician reviewer classified definite and probable ischemic stroke, intracerebral hemorrhage, and subarachnoid hemorrhage. Using ARIC classification as a gold standard, we calculated the positive predictive value (PPV) and sensitivity of ICD-9-CM codes grouped according to the American Heart Association/American Stroke Association (AHA/ASA) 2013 categories and an alternative code grouping for comparison.

RESULTS

Thirty-three percent of 4260 hospitalizations were validated as strokes (1251 ischemic, 120 intracerebral hemorrhage, 46 subarachnoid hemorrhage). The AHA/ASA code groups had PPV 76% and 68% sensitivity compared with PPV 72% and 83% sensitivity for the alternative code groups. The PPV of the AHA/ASA code group for ischemic stroke was slightly higher among blacks, individuals <65 years, and at teaching hospitals. Sensitivity was higher among older individuals and increased over time. The PPV of the AHA/ASA code group for intracerebral hemorrhage was higher among blacks, women, and younger individuals. PPV and sensitivity varied across study sites.

CONCLUSIONS

A new AHA/ASA discharge code grouping to identify stroke had similar PPV and lower sensitivity compared with an alternative code grouping. Accuracy varied by patient characteristics and study sites.

[Development and validation of an algorithm to identify cancer recurrences from hospital data bases]

OBJECTIVES

Hospital cancer registries and hospital databases are valuable and efficient sources of information for research into cancer recurrences. The aim of this study was to develop and validate algorithms for the detection of breast cancer recurrence.

METHODS

A retrospective observational study was conducted on breast cancer cases from the cancer registry of a third level university hospital diagnosed between 2003 and 2009. Different probable cancer recurrence algorithms were obtained by linking the hospital databases and the construction of several operational definitions, with their corresponding sensitivity, specificity, positive predictive value and negative predictive value.

RESULTS

A total of 1,523 patients were diagnosed of breast cancer between 2003 and 2009. A request for bone gammagraphy after 6 months from the first oncological treatment showed the highest sensitivity (53.8%) and negative predictive value (93.8%), and a pathology test after 6 months after the diagnosis showed the highest specificity (93.8%) and negative predictive value (92.6%). The combination of different definitions increased the specificity and the positive predictive value, but decreased the sensitivity.

CONCLUSIONS

Several diagnostic algorithms were obtained, and the different definitions could be useful depending on the interest and resources of the researcher. A higher positive predictive value could be interesting for a quick estimation of the number of cases, and a higher negative predictive value for a more exact estimation if more resources are available. It is a versatile and adaptable tool for other types of tumors, as well as for the needs of the researcher.

Higher serum uric acid as a protective factor against incident osteoporotic fractures in Korean men: a longitudinal study using the National Claim Registry

In this large longitudinal study of 16,078 Korean men aged 50 years or older, we observed that baseline elevation of serum uric acid level significantly associated with a lower risk of incident fractures at osteoporosis-related sites during an average follow-up period of 3 years.

INTRODUCTION

Male osteoporosis and related fractures are becoming recognized as important public health concerns. Oxidative stress has detrimental effects on bone metabolism, and serum uric acid (UA) is known to be a strong endogenous antioxidant. In the present study, we performed a large longitudinal study with an average follow-up period of 3 years to clarify the role of UA on the risk of incident osteoporotic fractures (OFs).

METHODS

A total of 16,078 Korean men aged 50 years or older who had undergone comprehensive routine health examinations were enrolled. Incident fractures at osteoporosis-related sites (e.g., hip, spine, distal radius, and proximal humerus) that occurred after the baseline examinations were identified from the nationwide claims database of the Health Insurance Review and Assessment Service of Korea by using selected International Classification of Diseases, 10th revision codes.

RESULTS

In total, 158 (1.0 %) men developed incident OFs. The event rate was 33.1 per 10,000 person-years. Subjects without incident OFs had 6.0 % higher serum UA levels than subjects with OFs (P = 0.001). Multivariable-adjusted Cox proportional hazard analyses adjusted for age, body mass index, glomerular filtration rate, lifestyle factors, medical and drug histories, and the presence of baseline radiological vertebral fractures revealed that the hazard ratio per standard deviation increase of baseline UA levels for the development of incident OFs was 0.829 (95 % CI = 0.695-0.989, P = 0.038).

CONCLUSIONS

These data provide the epidemiological evidence that serum UA may act as a protective factor against the development of incident OFs in Korean men.

Quality improvement of International Classification of Diseases, 9th revision, diagnosis coding in radiation oncology: single-institution prospective study at University of California, San Francisco

PURPOSE

Accurate International Classification of Diseases (ICD) diagnosis coding is critical for patient care, billing purposes, and research endeavors. In this single-institution study, we evaluated our baseline ICD-9 (9th revision) diagnosis coding accuracy, identified the most common errors contributing to inaccurate coding, and implemented a multimodality strategy to improve radiation oncology coding.

METHODS AND MATERIALS

We prospectively studied ICD-9 coding accuracy in our radiation therapy--specific electronic medical record system. Baseline ICD-9 coding accuracy was obtained from chart review targeting ICD-9 coding accuracy of all patients treated at our institution between March and June of 2010. To improve performance an educational session highlighted common coding errors, and a user-friendly software tool, RadOnc ICD Search, version 1.0, for coding radiation oncology specific diagnoses was implemented. We then prospectively analyzed ICD-9 coding accuracy for all patients treated from July 2010 to June 2011, with the goal of maintaining 80% or higher coding accuracy. Data on coding accuracy were analyzed and fed back monthly to individual providers.

RESULTS

Baseline coding accuracy for physicians was 463 of 661 (70%) cases. Only 46% of physicians had coding accuracy above 80%. The most common errors involved metastatic cases, whereby primary or secondary site ICD-9 codes were either incorrect or missing, and special procedures such as stereotactic radiosurgery cases. After implementing our project, overall coding accuracy rose to 92% (range, 86%-96%). The median accuracy for all physicians was 93% (range, 77%-100%) with only 1 attending having accuracy below 80%. Incorrect primary and secondary ICD-9 codes in metastatic cases showed the most significant improvement (10% vs 2% after intervention).

CONCLUSIONS

Identifying common coding errors and implementing both education and systems changes led to significantly improved coding accuracy. This quality assurance project highlights the potential problem of ICD-9 coding accuracy by physicians and offers an approach to effectively address this shortcoming.

Association between metabolic syndrome and incident fractures in Korean men: a 3-year follow-up observational study using national health insurance claims data

CONTEXT

Although the prevalence of both metabolic syndrome (MetS) and fractures increases with advancing age, studies on possible associations between these conditions in men are limited and the results are inconsistent.

OBJECTIVE

The objective of the study was to clarify the impact of MetS on the male risk of incident fractures.

DESIGN AND SETTING

This was a large, longitudinal study with an average 3-year follow-up period.

PARTICIPANTS

Korean men (n = 16 078) aged 50 years or older who had undergone comprehensive routine health examinations participated in the study.

MAIN OUTCOME MEASURES

Incident fractures found after baseline examinations were identified using selected International Classification of Diseases, tenth revision, codes in the nationwide claims database of the Health Insurance Review and Assessment Service of Korea.

RESULTS

In total, 158 men (1.0%) developed incident fractures. The fracture event rates for subjects with and without MetS were 26.2 and 35.7 per 10 000 person-years, respectively. After adjustment for potential confounders, subjects with MetS had a much lower risk of incident fractures than subjects without MetS (hazard ratio 0.662, 95% confidence interval 0.445-0.986). Furthermore, subjects with three and four or more MetS components had a 49.4% and 50.4% lower risk, respectively, of incident fractures compared with the subjects without any MetS components. Importantly, additional adjustment for body mass index eliminated the statistical significance of these associations.

CONCLUSION

Our current results indicate that the beneficial effects of MetS in reducing fracture risk could be explained by the general obesity that accompanies MetS, although other related factors, such as greater padding effect, peripheral aromatization, or adipokine changes, may also contribute.

Quantifying under-reporting of pathology tests in Medical Benefits Schedule claims data

OBJECTIVE

We investigated the completeness of recording of pathology tests in Australian Medical Benefits Schedule (MBS) claims data, using the example of the prostate-specific antigen (PSA) test. With some exceptions, MBS claims data records only the three most expensive pathology items in an episode of care, and this practice ('episode coning') means that pathology tests can be under-recorded.

METHODS

The analysis used MBS data for male participants in the 45 and Up Study. The number and cost of items in each episode of care were used to determine whether an episode contained a PSA screening test (Item 66655), or could have lacked a record of this item because of episode coning.

RESULTS

MBS data for 1070392 episodes involving a request for a pathology test for 118074 men were analysed. Of these episodes, 11% contained a request for a PSA test; a further 7.5% may have been missing a PSA request that was not recorded because of episode coning.

CONCLUSIONS

It is important to consider under-reporting of pathology tests as a result of episode coning when interpreting MBS claims data. Episode coning creates uncertainty about whether a person has received any given pathology test. The extent of this uncertainty can be estimated by determining the proportion of episodes in which the test may have been performed but was not recorded due to episode coning.

Analysis of questions regarding morbidity coding posted to the online coding clinic of the Korean Medical Record Association

Accuracy and consistency in morbidity coding are important in both clinical research and practice. However,Health Information Managers (HIMs) sometimes face difficulties in assigning morbidity codes. To assist them,the Korean Medical Record Association operates an online coding clinic bulletin board, on which HIMs can post questions and receive answers. Frequency analysis and Fisher's exact testing were performed to identify differences among the types of questions posted and the characteristics of the HIMs who posted them. Through statistical analysis, it was found that HIMs working at hospitals with fewer than 500 beds and those with more than 10 years of work experience were found to post more questions than other HIMs. The study also identified the characteristics of HIMs who require more coding education and particular diagnoses for which further training is required. Our findings will assist the development of coding procedures, guidelines, education programs, and a more user-friendly database.

A higher serum gamma-glutamyl transferase level could be associated with an increased risk of incident osteoporotic fractures in Korean men aged 50 years or older

Oxidative stress has detrimental effects on bone metabolism, and gamma-glutamyl transferase (GGT) is known to play an important role in the generation of free radical species through the extra-cellular hydrolysis of glutathione, the main cellular antioxidant. We performed a large longitudinal study with an average follow-up period of 3 years to investigate the association between baseline serum GGT levels and the development of future osteoporotic fractures (OFs) in men. A total of 16,036 Korean men aged 50 years or older who had undergone comprehensive routine health examinations were enrolled. Incident fractures at osteoporosis-related sites (e.g., hip, spine, distal radius, and proximal humerus) that occurred after baseline examinations were identified from the nationwide claims database of the Health Insurance Review and Assessment Service of Korea using selected ICD-10 codes. Among the study subjects, 156 cases (1.0%) developed incident OFs during the study period. The event rate was 32.7 (95% CI = 28.0-38.3) per 10,000 person-years. Multivariable adjusted Cox proportional hazard analyses adjusted for age, body mass index, lifestyle factors, and medical and drug histories revealed that the hazard ratio per standard deviation increase of the baseline GGT levels for the development of incident fractures was 1.115 (95% CI = 1.011-1.230). These data provide the first epidemiological evidence, in support of previous in vitro and animal studies, of the harmful effects of GGT on bone metabolism, and indicate that the serum GGT level may be a useful biomarker of poor bone health outcomes in men.

Neonatal bloodstream infections in a pediatric hospital in Vietnam: a cohort study

Septicemia and bloodstream infections (BSIs) are major causes of neonatal morbidity and mortality in developing countries. We prospectively recorded all positive blood cultures (BSI) among neonates admitted consecutively to a tertiary pediatric hospital in Vietnam during a 12-month period. Among 5763 neonates, 2202 blood cultures were performed, of which 399 were positive in 385 neonates. Among these, 64 died, 62 in relation to septicemia. Of the BSI isolates, 56% was known pathogenic and 48% was gram-negative bacteria, most frequently Klebsiella spp. (n = 78), Acinetobacter spp. (n = 58) and Escherichia coli (n = 21). Only three Streptococcus spp. were identified, none group B. Resistance against antibiotics applied was common. The mortality was highest in neonates with gram-negative BSI compared with no confirmed BSI and gram-positive BSI (P < 0.01). In this setting, the majority of BSI were likely to have been transmitted from the environment. Improvement of hygienic precautions and systematic BSI surveillance are recommended.

How can the quality of medical data in pharmacovigilance, pharmacoepidemiology and clinical studies be guaranteed?

The development of medicinal products is subject to quality standards aimed at guaranteeing that database contents accurately reflect the source documents. Paradoxically, these standards hardly address the quality of the source data itself. The objective of this work was to propose recommendations to improve data quality in three fields (pharmacovigilance, pharmacoepidemiology and clinical studies). The analysis was focused on the data and on the critical stages presenting critical quality problems, for which the current guidelines are insufficiently detailed, unsuitable and/or poorly applied. Finally, recommendations have been proposed, mainly focused on the origin of the data and its transcription.

Accuracy of International Classification of Diseases, 9th Revision, Clinical Modification codes for upper gastrointestinal complications varied by position and age: a validation study in a cohort of nonsteroidal anti-inflammatory drugs users in Friuli Venezia Giulia, Italy

PURPOSE

To validate the International Classification of Diseases, 9th Revision, Clinical Modification discharge codes used to identify cases of upper gastrointestinal complications (UGICs) in hospitals of Friuli Venezia Giulia, Italy.

METHODS

Cohort study on the risk of UGIC in users of nonsteroidal anti-inflammatory drugs conducted in Friuli Venezia Giulia between 2001 and 2008. Cases were identified through primary and secondary International Classification of Diseases, 9th Revision Clinical specific codes 531 (gastric ulcer), 532 (duodenal ulcer), 533 (peptic ulcer), 534 (gastrojejunal ulcer), and nonspecific code 578 (gastrointestinal hemorrhage). Potential cases were confirmed through hospital chart review.

RESULTS

The chart retrieval percentage was 98.4%.The positive predictive value (PPV) was 94.3% for primary codes 531 and 532, 79.5% for code 533, 83.1% for code 534, 40.2% for code 578. The PPV for secondary codes was 34.7% but increased to 88.9% and 79.2% when the primary code was for peritonitis or acute post-hemorrhagic anemia, respectively. Validation of secondary codes increased case ascertainment by 4.9%. Endoscopy confirmed 79.4% of cases but only 67.2% of those above age 84 years.

CONCLUSIONS

The PPV was high for specific primary codes and moderate to low for nonspecific primary and secondary codes. The inclusion of confirmed cases identified by nonspecific and secondary codes can be of value in studies that need a complete ascertainment of cases occurring in the study population. In this cohort, not including these cases would underestimate the incidence of UGICs. A potential for case misclassification exists in particular in eldest ages.

Accuracy of the Charlson index comorbidities derived from a hospital electronic database in a teaching hospital in Saudi Arabia

Hospital management and researchers are increasingly using electronic databases to study utilization, effectiveness, and outcomes of healthcare provision. Although several studies have examined the accuracy of electronic databases developed for general administrative purposes, few studies have examined electronic databases created to document the care provided by individual hospitals. In this study, we assessed the accuracy of an electronic database in a major teaching hospital in Eastern Province, Saudi Arabia, in documenting the 17 comorbidities constituting the Charlson index as recorded in paper charts by care providers. Using the hospital electronic database, the researchers randomly selected the data for 1,019 patients admitted to the hospital and compared the data for accuracy with the corresponding paper charts. Compared with the paper charts, the hospital electronic database did not differ significantly in prevalence for 9 conditions but differed from the paper charts for 8 conditions. The kappa (K) values of agreement ranged from a high of 0.91 to a low of 0.09. Of the 17 comorbidities, the electronic database had substantial or excellent agreement for 10 comorbidities relative to paper chart data, and only one showed poor agreement. Sensitivity ranged from a high of 100.0 percent to a low of 6.0 percent. Specificity for all comorbidities was greater than 93 percent. The results suggest that the hospital electronic database reasonably agrees with patient chart data and can have a role in healthcare planning and research. The analysis conducted in this study could be performed in individual institutions to assess the accuracy of an electronic database before deciding on its utility in planning or research.

Bisphosphonate use and increased incidence of subtrochanteric fracture in South Korea: results from the National Claim Registry

SUMMARY

We evaluated trends in the incidences of typical and atypical hip fracture in relation to bisphosphonate use in Korea from 2006 to 2010, using nationwide data obtained from the Health Insurance Review and Assessment Service (HIRA).

INTRODUCTION

Recently, atypical hip fractures in the subtrochanteric region have been reported among patients on bisphosphonate. However, the association between atypical hip fracture and bisphosphonate is controversial. We evaluated trends in the incidences of typical and atypical hip fracture in relation to bisphosphonate use in Korea from 2006 to 2010, using nationwide data obtained from the HIRA.

METHODS

All new visits or admissions to clinics or hospitals for a typical and atypical hip fractures were recorded nationwide by HIRA using the ICD-10 code classification. Typical and atypical hip fractures were defined as femoral neck/intertrochanteric and subtrochanteric fracture, respectively. Bisphosphonate prescription data were also abstracted from the HIRA database.

RESULTS

The absolute number of typical and atypical hip fracture increased during the study period. Although age-adjusted incidence rates of typical hip fractures were stable in men and women, those of atypical hip fractures increased in women. Nationally, the annual numbers of prescriptions of bisphosphonate also increased during the study period.

CONCLUSIONS

The results of this study suggest a possible causal relationship between bisphosphonate use and the increased incidence of atypical hip fracture in Korea.

Prematurity, asphyxia and congenital malformations underrepresented among neonates in a tertiary pediatric hospital in Vietnam

BACKGROUND

Estimated 17,000 neonates (≤ 28 days of age) die in Vietnam annually, corresponding to more than half of the child mortality burden. However, current knowledge about these neonates is limited. Prematurity, asphyxia and congenital malformations are major causes of death in neonates worldwide. To improve survival and long term development, these vulnerable neonates need access to the specialized neonatal care existing, although limited, in lower middle-income countries like Vietnam. The aim of this study was to describe these conditions in a specialized Vietnamese hospital, compared to a Danish hospital.

METHODS

We performed a comparative observational study of all neonates admitted to a tertiary pediatric hospital in South Vietnam in 2009-2010. The data were prospectively extracted from the central hospital registry and included basic patient characteristics and diagnoses (International Classification of Diseases, 10th revision). Prematurity, asphyxia and designated congenital malformations (oesophageal atresia, gastroschisis, omphalocoele, diaphragmatic hernia and heart disease) were investigated. In a subgroup, the prematurity diagnosis was validated using a questionnaire. The hospitalization ratio of each diagnosis was compared to those obtained from a Danish tertiary hospital. The Danish data were retrieved from the neonatal department database for a ten-year period.

RESULTS

The study included 5763 neonates (missing<1%). The catchment population was 726,578 live births. The diagnosis was prematurity in 7%, asphyxia in 2% and one of the designated congenital malformations in 6%. The diagnosis of prematurity was correctly assigned to 85% of the neonates, who were very premature or had very low birth weight according to the questionnaire, completed by 2196 neonates. Compared to the Danish Hospital, the hospitalization ratios of neonates diagnosed with prematurity (p<0.01), asphyxia (p<0.01) and designated congenital malformations (p<0.01- 0.04) were significantly lower.

CONCLUSION

Our findings suggest the investigated diagnoses were underrepresented in the Vietnamese study hospital. In contrast, relatively mild diagnoses were frequent. These results indicate the use of specialized care may not be optimal. Pre-hospital selection mechanisms were not investigated and additional studies are needed to optimise utilisation of specialized care and improve neonatal survival.

Hospital discharge diagnostic and procedure codes for upper gastro-intestinal cancer: how accurate are they?

BACKGROUND

Population-level health administrative datasets such as hospital discharge data are used increasingly to evaluate health services and outcomes of care. However information about the accuracy of Australian discharge data in identifying cancer, associated procedures and comorbidity is limited. The Admitted Patients Data Collection (APDC) is a census of inpatient hospital discharges in the state of New South Wales (NSW). Our aim was to assess the accuracy of the APDC in identifying upper gastro-intestinal (upper GI) cancer cases, procedures for associated curative resection and comorbidities at the time of admission compared to data abstracted from medical records (the 'gold standard').

METHODS

We reviewed the medical records of 240 patients with an incident upper GI cancer diagnosis derived from a clinical database in one NSW area health service from July 2006 to June 2007. Extracted case record data was matched to APDC discharge data to determine sensitivity, positive predictive value (PPV) and agreement between the two data sources (κ-coefficient).

RESULTS

The accuracy of the APDC diagnostic codes in identifying site-specific incident cancer ranged from 80-95% sensitivity. This was comparable to the accuracy of APDC procedure codes in identifying curative resection for upper GI cancer. PPV ranged from 42-80% for cancer diagnosis and 56-93% for curative surgery. Agreement between the data sources was >0.72 for most cancer diagnoses and curative resections. However, APDC discharge data was less accurate in reporting common comorbidities - for each condition, sensitivity ranged from 9-70%, whilst agreement ranged from κ = 0.64 for diabetes down to κ < 0.01 for gastro-oesophageal reflux disorder.

CONCLUSIONS

Identifying incident cases of upper GI cancer and curative resection from hospital administrative data is satisfactory but under-ascertained. Linkage of multiple population-health datasets is advisable to maximise case ascertainment and minimise false-positives. Consideration must be given when utilising hospital discharge data alone for generating comorbidity indices, as disease burden at the time of admission is under-reported.

Postoperative complications following colectomy for ulcerative colitis: a validation study

Background

Ulcerative colitis (UC) patients failing medical management require colectomy. This study compares risk estimates for predictors of postoperative complication derived from administrative data against that of chart review and evaluates the accuracy of administrative coding for this population.

Methods

Hospital administrative databases were used to identify adults with UC undergoing colectomy from 1996–2007. Medical charts were reviewed and regression analyses comparing chart versus administrative data were performed to assess the effect of age, emergent operation, and Charlson comorbidities on the occurrence of postoperative complications. Sensitivity, specificity, and positive/negative predictive values of administrative coding for identifying the study population, Charlson comorbidities, and postoperative complications were assessed.

Results

Compared to chart review, administrative data estimated a higher magnitude of effect for emergent admission (OR 2.52 [95% CI: 1.80–3.52] versus 1.49 [1.06–2.09]) and Charlson comorbidities (OR 2.91 [1.86–4.56] versus 1.50 [1.05–2.15]) as predictors of postoperative complications. Administrative data correctly identified UC and colectomy in 85.9% of cases. The administrative database was 37% sensitive in identifying patients with ≥ 1Charlson comorbidity. Restricting analysis to active comorbidities increased the sensitivity to 63%. The sensitivity of identifying patients with at least one postoperative complication was 68%; restricting analysis to more severe complications improved the sensitivity to 84%.

Conclusions

Administrative data identified the same risk factors for postoperative complications as chart review, but overestimated the magnitude of risk. This discrepancy may be explained by coding inaccuracies that selectively identifying the most serious complications and comorbidities.

Incremental prognostic value of 99mTc-tetrofosmin early poststress pulmonary uptake. Determination of the optimal cut-off value

OBJECTIVES

To evaluate the incremental prognostic value of (99m)Tc-tetrofosmin early poststress lung/heart ratio (eLHR) and to assess the optimal cut-off value.

MATERIALS AND METHODS

We studied 503 patients (aged 61.3 years/SD = 8.6 years, 302 men) with stress/rest (99m)Tc-tetrofosmin myocardial gated-single photon emission computed tomography and coronary angiography. To evaluate myocardial ischemia, the summed stress score, summed rest score, and summed difference score indices were calculated. For the eLHR calculation, an anterior image was acquired 4-6 min after radiotracer injection at stress; eLHR was defined as the mean counts/pixel in the lung region of interest divided by the mean counts/pixel in the myocardial region of interest. The incremental prognostic value of eLHR was evaluated by a significant increase in the global χ(2) of the Cox proportional hazard model that included clinical, exercise, angiographic, and scintigraphic variables. Using the receiver operating characteristic analysis, the optimal cut-off of eLHR for the prediction of cardiac events was determined.

RESULTS

During the follow-up period, hard cardiac events occurred in 50 (9.9%) and soft cardiac events in 61 (12.1%) patients. Receiver operating characteristic curve analysis showed that the optimal cut-off of eLHR for the prediction of cardiac events was 0.51, with a sensitivity of 78.4% and specificity of 72.2%. The area under the curve was 0.82 (95% confidence interval: 0.77-0.87). Multiple Cox regression analysis revealed that eLHR more than 0.51 (hazard ratio = 7.78; 95% confidence interval: 5.00-12.11) provided incremental prognostic value over clinical exercise testing and scintigraphic data for cardiac events.

CONCLUSION

A (99m)Tc-tetrofosmin eLHR value larger than 0.51 added incremental value to other variables for the prediction of cardiac events.

Describing the content of primary care: limitations of Canadian billing data

Background

Primary health care systems are designed to provide comprehensive patient care. However, the ICD 9 coding system used for billing purposes in Canada neither characterizes nor captures the scope of clinical practice or complexity of physician-patient interactions. This study aims to describe the content of primary care clinical encounters and examine the limitations of using administrative data to capture the content of these visits. Although a number of U.S studies have described the content of primary care encounters, this is the first Canadian study to do so.

Methods

Study-specific data collection forms were completed by 16 primary care physicians in community health and family practice clinics in Winnipeg, Manitoba, Canada. The data collection forms were completed immediately following the patient encounter and included patient and visit characteristics, such as primary reason for visit, topics discussed, actions taken, degree of complexity as well as diagnosis and ICD-9 codes.

Results

Data was collected for 760 patient encounters. The diagnostic codes often did not reflect the dominant topic of the visit or the topic requiring the most amount of time. Physicians often address multiple problems and provide numerous services thus increasing the complexity of care.

Conclusion

This is one of the first Canadian studies to critically analyze the content of primary care clinical encounters. The data allowed a greater understanding of primary care clinical encounters and attests to the deficiencies of singular ICD-9 coding which fails to capture the comprehensiveness and complexity of the primary care encounter. As primary care reform initiatives in the U.S and Canada attempt to transform the way family physicians deliver care, it becomes increasingly important that other tools for structuring primary care data are considered in order to help physicians, researchers and policy makers understand the breadth and complexity of primary care.

Rising prevalence of vascular comorbidities in multiple sclerosis: validation of administrative definitions for diabetes, hypertension, and hyperlipidemia

BACKGROUND

Despite the importance of comorbidity in multiple sclerosis (MS), methods for comorbidity assessment in MS are poorly developed.

OBJECTIVE

We validated and applied administrative case definitions for diabetes, hypertension, and hyperlipidemia in MS.

METHODS

Using provincial administrative data we identified persons with MS and a matched general population cohort. Case definitions for diabetes, hypertension, and hyperlipidemia were derived using hospital, physician, and prescription claims, and validated in 430 persons with MS. We examined temporal trends in the age-adjusted prevalence of these conditions from 1984-2006.

RESULTS

Agreement between various case definitions and medical records ranged from kappa (κ) =0.51-0.69 for diabetes, κ =0.21-0.71 for hyperlipidemia, and κ =0.52-0.75 for hypertension. The 2005 age-adjusted prevalence of diabetes was similar in the MS (7.62%) and general populations (8.31%; prevalence ratio [PR] 0.91; 0.81-1.03). The age-adjusted prevalence did not differ for hypertension (MS: 20.8% versus general: 22.5% [PR 0.91; 0.78-1.06]), or hyperlipidemia (MS: 13.8% versus general: 15.2% [PR 0.90; 0.67-1.22]). The prevalence of all conditions rose in both populations over the study period.

CONCLUSION

Administrative data are a valid means of tracking diabetes, hypertension, and hyperlipidemia in MS. The prevalence of these comorbidities is similar in the MS and general populations.

Examining the effect of hospital-level factors on mortality of very low birth weight infants using multilevel modeling

OBJECTIVE

The objective of this study was to examine the effect of hospital-level factors on mortality of very low birth weight infants using multilevel modeling.

STUDY DESIGN

This is a secondary data analysis of California maternal-infant hospital discharge data from 1997 to 2002. The study population was limited to singleton, non-anomalous, very low birth weight infants, who delivered in hospitals providing neonatal intensive care services (level-2 and higher). Hierarchical generalized linear modeling, also known as multilevel modeling, was used to adjust for individual-level confounders.

RESULT

In a multilevel model, increasing hospital volume of very low birth weight deliveries was associated with lower odds of very low birth weight mortality. Characteristics of a particular hospital's obstetrical and neonatal services (the presence of residency and fellowship training programs and the availability of perinatal and neonatal services) had no independent effect.

CONCLUSION

Using multilevel modeling, hospital volume of very low birth weight deliveries appears to be the primary driver of reduced mortality among very low birth weight infants.

Validation of case-finding algorithms derived from administrative data for identifying adults living with human immunodeficiency virus infection

Objective

We sought to validate a case-finding algorithm for human immunodeficiency virus (HIV) infection using administrative health databases in Ontario, Canada.

Methods

We constructed 48 case-finding algorithms using combinations of physician billing claims, hospital and emergency room separations and prescription drug claims. We determined the test characteristics of each algorithm over various time frames for identifying HIV infection, using data abstracted from the charts of 2,040 randomly selected patients receiving care at two medical practices in Toronto, Ontario as the reference standard.

Results

With the exception of algorithms using only a single physician claim, the specificity of all algorithms exceeded 99%. An algorithm consisting of three physician claims over a three year period had a sensitivity and specificity of 96.2% (95% CI 95.2%–97.9%) and 99.6% (95% CI 99.1%–99.8%), respectively. Application of the algorithm to the province of Ontario identified 12,179 HIV-infected patients in care for the period spanning April 1, 2007 to March 31, 2009.

Conclusions

Case-finding algorithms generated from administrative data can accurately identify adults living with HIV. A relatively simple “3 claims in 3 years” definition can be used for assembling a population-based cohort and facilitating future research examining trends in health service use and outcomes among HIV-infected adults in Ontario.

Designing an abstraction instrument: lessons from efforts to validate the AHRQ patient safety indicators

BACKGROUND

The U.S. Agency for Healthcare Research and Quality (AHRQ) and other organizations have developed quality indicators based on hospital administrative data. Characteristics of effective abstraction instruments were identified for determining both the positive predictive value (PPV) of Patient Safety Indicators (PSIs) and the extent to which hospitals and clinicians could have prevented adverse events.

METHODS

Through an iterative process involving nurse abstractors, physicians, and nurses with quality improvement experience, and health services researchers, 25 abstraction instruments were designed for 12 AHRQ provider-level morbidity PSIs. Data were analyzed from 13 of these instruments, and data are being collected using several more.

FINDINGS

Common problems in designing the instruments included avoiding uninformative questions and premature termination of the abstraction process, anticipating misinterpretation of questions, allowing an appropriate range of response options; using clear terminology, optimizing the flow of the abstraction process, balancing the utility of data against abstractor burden, and recognizing the needs of end users, such as hospitals and quality improvement professionals and researchers, for the abstracted information.

CONCLUSIONS

Designing medical record abstraction instruments for quality improvement research involves several potential pitfalls. Understanding how we addressed these challenges might help both investigators and users of outcome indicators to appreciate the strengths and limitations of outcome-based quality indicators and tools designed to validate or investigate such indicators within provider organizations.

Multiple chronic conditions and disabilities: implications for health services research and data demands

Increasing numbers of Americans are living with multiple chronic conditions (MCCs) and disabilities. Addressing health care needs of persons with MCCs or disabilities presents challenges on many levels. For health services researchers, priorities include (1) considering MCCs and disabilities in comparative effectiveness research (CER) and assessing quality of care; and (2) identifying and evaluating the data needed to conduct CER, performance measure development, and other research to inform health policy and public health decisions concerning persons with MCCs or disabilities. Little information is available to guide CER or treatment choices for persons with MCCs or disabilities, however, because they are typically excluded from clinical trials that produce the scientific evidence base. Furthermore, most research funding flows through public and private agencies oriented around single organ systems or diseases. Likely changes in the data landscape-notably wider dissemination of electronic health records (EHRs) and moving toward updated coding nomenclatures-may increase the information available to monitor health care service delivery and quality for persons with MCCs and disabilities. Generating this information will require new methods to extract and code information about MCCs and functional status from EHRs, especially narrative texts, and incorporating coding nomenclatures that capture critical dimensions of functional status and disability.

Is risk-adjusted mortality an indicator of quality of care in general surgery?: a comparison of risk adjustment to peer review

OBJECTIVE(S)

Profiling of hospitals using risk-adjusted mortality rates as a measure of quality is becoming increasingly frequent. We sought to determine the validity of this approach by comparing the risk-adjusted predicted mortality to the findings of concurrent peer review and retrospective chart review of deaths that occur on a general surgery service.

METHODS

Consecutive patients admitted to a busy general surgery service from January 2000 to January 2006 were prospectively entered into the Surgical Activity Tracking System. Rigorous, systematic peer review was performed concurrently by service members on all deaths. Adjudication was later validated by an independent senior surgeon. Three methodologies of risk adjustment (University Health Consortium, Physiological and Operative Severity Score for the enUmeration of Mortality, and the Charlson index) were used and compared the "excess mortality" predicted by each to the number of potentially preventable deaths determined by peer review.

RESULTS

A total of 9623 patients were admitted and 75 died (0.7%). University Health Consortium and Physiological and Operative Severity Score predicted an excess mortality of 62 and 65 deaths, respectively; Charlson predicted that 73% of the cohort would be dead in 1 year. Concurrent and retrospective peer review found that death was potentially preventable in only 22 and 21 patients, respectively.

CONCLUSIONS

Peer adjudication and extensive clinical review adds much to the analysis of an adverse outcome, similar to the "black box" in an airplane crash. Although methods of risk adjustment may be helpful in identifying patients for peer review, they should be used for internal process improvement and not published as metrics of hospital or provider performance.

Validation of the NVSCA Registry for Common Oral Clefts: Study Design and First Results

Objective

Since 1997 the Dutch Association for Cleft Palate and Craniofacial Anomalies (NVSCA) has maintained a national registry of congenital craniofacial anomalies. This study validates data on three common oral cleft categories (cleft lip/alveolus = CL/A; cleft lip/alveolus and palate = CL/AP; and cleft palate = CP) and general items.

Design

Retrospective observational study.

Setting

All 15 Dutch cleft palate teams registered presurgery patients with common oral clefts (n = 2553) from 1997 to 2003.

Patients

A random sample of 250 cases was used; 13 cases were excluded.

Main Outcome Measures

The corresponding medical data were reviewed; these medical data served to validate the NVSCA registry data. Prevalence comparisons, 2 × 2 tables and validity measures were performed.

Results

The cleft categories most accurately recorded were CL/A and CP. Both categories had an observed agreement of 98%, kappa of 0.94, and a sensitivity and specificity of 97%. Cleft lip/alveolus and palate had an observed agreement of 95%, kappa of 0.89, a sensitivity of 90%, and a specificity of 99%. Regarding the general items, observed agreement and kappa were highest for adoption/foster child (99%; 0.76) and lowest for remarks about pregnancy (63%; 0.20). Sensitivity ranged from 25% (consanguinity) to 97% (white mother) and specificity was high for all items (93%) except for white father and mother (approximately 35%).

Conclusions

The NVSCA registry is a valuable tool for quality improvement and research because validity on all three common oral cleft categories is very good. Validity on the general items is reasonable to satisfying and appears to be related to the type of information.

Validation of coding algorithms for the identification of patients with primary biliary cirrhosis using administrative data

BACKGROUND

Large-scale epidemiological studies of primary biliary cirrhosis (PBC) have been hindered by difficulties in case ascertainment.

OBJECTIVE

To develop coding algorithms for identifying PBC patients using administrative data--a widely available data source.

METHODS

Population-based administrative databases were used to identify patients with a diagnosis code for PBC from 1994 to 2002. Coding algorithms for confirmed PBC (two or more of antimitochondrial antibody positivity, cholestatic liver biochemistry and/or compatible liver histology) were derived using chart abstraction data as the reference. Patients with a recorded PBC diagnosis but insufficient confirmatory data were classified as 'suspected PBC'.

RESULTS

Of 189 potential PBC cases, 119 (60%) had confirmed PBC and 28 (14%) had suspected PBC. The optimal algorithm including two or more uses of a PBC code had a sensitivity of 94% (95% CI 71% to 100%) and positive predictive values of 73% (95% CI 61% to 75%) for confirmed PBC, and 89% (95% CI 82% to 94%) for confirmed or suspected PBC. Sensitivity analyses revealed greater accuracy among women, and with the use of multiple data sources and one or more years of data. Inclusion of diagnosis codes for conditions frequently misclassified as PBC did not improve algorithm performance.

CONCLUSIONS

Administrative databases can reliably identify patients with PBC and may facilitate epidemiological investigations of this condition.

Do coder characteristics influence validity of ICD-10 hospital discharge data?

Background

Administrative data are widely used to study health systems and make important health policy decisions. Yet little is known about the influence of coder characteristics on administrative data validity in these studies. Our goal was to describe the relationship between several measures of validity in coded hospital discharge data and 1) coders' volume of coding (≥13,000 vs. <13,000 records), 2) coders' employment status (full- vs. part-time), and 3) hospital type.

Methods

This descriptive study examined 6 indicators of face validity in ICD-10 coded discharge records from 4 hospitals in Calgary, Canada between April 2002 and March 2007. Specifically, mean number of coded diagnoses, procedures, complications, Z-codes, and codes ending in 8 or 9 were compared by coding volume and employment status, as well as hospital type. The mean number of diagnoses was also compared across coder characteristics for 6 major conditions of varying complexity. Next, kappa statistics were computed to assess agreement between discharge data and linked chart data reabstracted by nursing chart reviewers. Kappas were compared across coder characteristics.

Results

422,618 discharge records were coded by 59 coders during the study period. The mean number of diagnoses per record decreased from 5.2 in 2002/2003 to 3.9 in 2006/2007, while the number of records coded annually increased from 69,613 to 102,842. Coders at the tertiary hospital coded the most diagnoses (5.0 compared with 3.9 and 3.8 at other sites). There was no variation by coder or site characteristics for any other face validity indicator. The mean number of diagnoses increased from 1.5 to 7.9 with increasing complexity of the major diagnosis, but did not vary with coder characteristics. Agreement (kappa) between coded data and chart review did not show any consistent pattern with respect to coder characteristics.

Conclusions

This large study suggests that coder characteristics do not influence the validity of hospital discharge data. Other jurisdictions might benefit from implementing similar employment programs to ours, e.g.: a requirement for a 2-year college training program, a single management structure across sites, and rotation of coders between sites. Limitations include few coder characteristics available for study due to privacy concerns.

Long-term prognostic value of early poststress (99m)Tc-tetrofosmin lung uptake during exercise (SPECT) myocardial perfusion imaging

PURPOSE

The aim of this study was to determine the long-term prognostic value of early poststress lung/heart ratio (LHR) of (99m)Tc-tetrofosmin radioactivity.

METHODS

We studied 276 patients (aged 62.2 + or - 8.9 years, 168 men) with stress/rest (99m)Tc-tetrofosmin myocardial gated-SPECT and coronary angiography. To evaluate myocardial ischaemia, we calculated the summed stress score, summed rest score and summed difference score indices. For the eLHR calculation, an anterior image was acquired, 4-6 min after radiotracer injection at stress (eLHR was defined as mean counts per pixel in the lung region of interest divided by the mean counts per pixel in the myocardial region of interest). Cardiovascular death and nonfatal myocardial infarction were considered as hard cardiac events, and late revascularization procedures as soft cardiac events. The Cox proportional hazards model in a stepwise method was used to determine the independent predictors for hard and soft cardiac events.

RESULTS

During the follow-up period hard cardiac events occurred in 28 patients (10.1%) and soft cardiac events in 32 patients (11.6%). Implying multiple Cox regression analysis, eLHR was found to be a significant independent predictor for both soft and hard cardiac events. The hazard ratio (for a 0.1 unit increase) was 4.41 (95% CI 1.52-12.73, p=0.006) for soft cardiac events and 4.22 (95% CI 2.07-8.62, p<0.001) for hard cardiac events. The other significant prognostic factors were use of beta-blockers, the summed stress score and the use of nitrates for soft events, and exercise duration and the summed stress score for hard cardiac events.

CONCLUSION

Early poststress (99m)Tc-tetrofosmin LHR has an independent and powerful value in predicting hard and soft cardiac events.

ICD-10 hospital discharge diagnosis codes were sensitive for identifying pulmonary embolism but not deep vein thrombosis

OBJECTIVE

To estimate the sensitivity of International Classification of Diseases, Tenth revision (ICD-10) hospital discharge diagnosis codes for identifying deep vein thrombosis (DVT) and pulmonary embolism (PE).

STUDY DESIGN AND SETTING

We compared predefined ICD-10 discharge diagnosis codes with the diagnoses that were prospectively recorded for 1,375 patients with suspected DVT or PE who were enrolled at 25 hospitals in France. Sensitivity was calculated as the percentage of patients identified by predefined ICD-10 codes among positive cases of acute symptomatic DVT or PE confirmed by objective testing.

RESULTS

The sensitivity of ICD-10 codes was 58.0% (159 of 274; 95% CI: 51.9, 64.1) for isolated DVT and 88.9% (297 of 334; 95% CI: 85.6, 92.2) for PE. Depending on the hospital, the median values for sensitivity were 57.7% for DVT (interquartile range, IQR, 48.6-66.7; intracluster correlation coefficient, 0.02; P=0.31) and 88.9% for PE (IQR, 83.3-96.3; intracluster correlation coefficient, 0.11; P=0.03). The sensitivity of ICD-10 codes was lower for surgical patients and for patients who developed PE or DVT while they were hospitalized.

CONCLUSION

ICD-10 discharge diagnosis codes yield satisfactory sensitivity for identifying objectively confirmed PE. A substantial proportion of DVT cases are missed when using hospital discharge data for complication screening or research purposes.