An emergency department medical record review for adolescent intentional self-harm injuries

Accuracy of ICD-10 codes for suicidal ideation and action in pediatric emergency department encounters

Objectives

According to the ideation-to-action framework of suicidality, suicidal ideation and suicidal action arise via distinct trajectories. Studying suicidality under this framework requires accurate identification of both ideation and action. We sought to assess the accuracy of ICD-10 codes for suicidal ideation and action in emergency department (ED) encounters.

Methods

Accuracy of ICD-10 coding for suicidality was assessed through chart review of clinical notes for 205 ED encounters among patients 6-18 years old at a large academic pediatric hospital between June 1, 2016, and June 1, 2022. Physician notes were reviewed for documentation of past or present suicidal ideation, suicidal action, or both. The study cohort consisted of 103 randomly selected "cases," or encounters assigned at least one ICD-10 code for suicidality, and 102 propensity-matched "non-cases" lacking ICD-10 codes. Accuracy of ICD-10 codes was assessed using sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV).

Results

Against a gold standard chart review, the PPV for ICD-10 suicidality codes was 86.9%, and the NPV was 76.2%. Nearly half of encounters involving suicidality were not captured by ICD-10 coding (sensitivity=53.4%). Sensitivity was higher for ideation-present (82.4%) than for action-present (33.7%) or action-past (20.4%).

Conclusions

Many cases of suicidality may be missed by relying on only ICD-10 codes. Accuracy of ICD-10 codes is high for suicidal ideation but low for action. To scale the ideation-to-action model for use in large populations, better data sources are needed to identify cases of suicidal action.

Validity and reliability International Classification of Diseases-10 codes for all forms of injury: A systematic review

BACKGROUND

Intentional and unintentional injuries are a leading cause of death and disability globally. International Classification of Diseases (ICD), Tenth Revision (ICD-10) codes are used to classify injuries in administrative health data and are widely used for health care planning and delivery, research, and policy. However, a systematic review of their overall validity and reliability has not yet been done.

OBJECTIVE

To conduct a systematic review of the validity and reliability of external cause injury ICD-10 codes.

METHODS

MEDLINE, EMBASE, COCHRANE, and SCOPUS were searched (inception to April 2023) for validity and/or reliability studies of ICD-10 external cause injury codes in all countries for all ages. We examined all available data for external cause injuries and injuries related to specific body regions. Validity was defined by sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV). Reliability was defined by inter-rater reliability (IRR), measured by Krippendorff's alpha, Cohen's Kappa, and/or Fleiss' kappa.

RESULTS

Twenty-seven published studies from 2006 to 2023 were included. Across all injuries, the mean outcome values and ranges were sensitivity: 61.6% (35.5%-96.0%), specificity: 91.6% (85.8%-100%), PPV: 74.9% (58.6%-96.5%), NPV: 80.2% (44.6%-94.4%), Cohen's kappa: 0.672 (0.480-0.928), Krippendorff's alpha: 0.453, and Fleiss' kappa: 0.630. Poisoning and hand and wrist injuries had higher mean sensitivity (84.4% and 96.0%, respectively), while self-harm and spinal cord injuries were lower (35.5% and 36.4%, respectively). Transport and pedestrian injuries and hand and wrist injuries had high PPVs (96.5% and 92.0%, respectively). Specificity and NPV were generally high, except for abuse (NPV 44.6%).

CONCLUSIONS AND SIGNIFICANCE

The validity and reliability of ICD-10 external cause injury codes vary based on the injury types coded and the outcomes examined, and overall, they only perform moderately well. Future work, potentially utilizing artificial intelligence, may improve the validity and reliability of ICD codes used to document injuries.

Trends and Seasonality of Emergency Department Visits and Hospitalizations for Suicidality Among Children and Adolescents in the US from 2016 to 2021

Importance

The detection of seasonal patterns in suicidality should be of interest to clinicians and US public health officials, as intervention efforts can benefit by targeting periods of heightened risk.

Objectives

To examine recent trends in suicidality rates, quantify the seasonality in suicidality, and demonstrate the disrupted seasonality patterns during the spring 2020 COVID-19-related school closures among US children and adolescents.

Design, Setting, and Participants

This population-based, descriptive cross-sectional study used administrative claims data from Optum's deidentifed Clinformatics Data Mart Database. Participants included children aged 10 to 12 years and adolescents aged 13 to 18 years who were commercially insured from January 1, 2016, to December 31, 2021. Statistical analysis was conducted between April and November 2022.

Exposures

Month of the year and COVID-19 pandemic.

Main Outcomes and Measures

Rates and seasonal patterns of emergency department (ED) visits and hospitalizations for suicidality.

Results

The analysis included 73 123 ED visits and hospitalizations for suicidality reported between 2016 and 2021. Among these events, 66.1% were reported for females, and the mean (SD) age at the time of the event was 15.4 (2.0) years. The mean annual incidence of ED visits and hospitalizations for suicidality was 964 per 100 000 children and adolescents (95% CI, 956-972 per 100 000), which increased from 760 per 100 000 (95% CI, 745-775 per 100 000) in 2016 to 1006 per 100 000 (95% CI, 988-10 024 per 100 000) in 2019, with a temporary decrease to 942 per 100 000 (95% CI, 924-960 per 100 000) in 2020 and a subsequent increase to 1160 per 100 000 (95% CI, 1140-1181 per 100 000) in 2021. Compared with January, seasonal patterns showed peaks in April (incidence rate ratio [IRR], 1.15 [95% CI, 1.11-1.19]) and October (IRR, 1.24 [95% CI, 1.19-1.29]) and a nadir in July (IRR, 0.63 [95% CI, 0.61-0.66]) during pre-COVID-19 years and 2021. However, during the spring of 2020, which coincided with school closures, seasonal patterns were disrupted and April and May exhibited the lowest rates.

Conclusions and Relevance

The findings of this study indicated the presence of seasonal patterns and an observed unexpected decrease in suicidality among children and adolescents after COVID-19-related school closures in March 2020, which suggest a potential association between suicidality and the school calendar.

Incidence of suicide and self-harm among people with opioid use disorder and the impact of opioid agonist treatment: A retrospective data linkage study

BACKGROUND

Rates of suicide and self-harm are elevated among people with opioid use disorder (OUD). This study examined incidence of self-harm and suicide among people who have entered OAT and assessed the impact of different OAT exposure periods on these events.

METHOD

We conducted a retrospective population-based cohort study of all OAT recipients (N = 45,664) in New South Wales, Australia (2002-2017), using linked administrative data. Incidence rates of self-harm hospitalisations and suicide deaths were estimated per 1000 person-years (PY). The first 28 days of an OAT episode, ≥ 29 days on OAT, the first 28 days off OAT, and ≥ 29 days off OAT (maximum four years post-OAT) were exposure periods. Poisson regression models with generalised estimating equations estimated the adjusted incidence rate ratios (ARR) of self-harm and suicide by OAT exposure periods, adjusting for covariates.

RESULTS

There were 7482 hospitalisations (4148 individuals) for self-harm and 556 suicides, equating to incidence rates of 19.2 (95% confidence intervals [CI]=18.8-19.7) and 1.0 (95%CI=0.9-1.1) per 1000 PY, respectively. Opioid overdose was implicated in 9.6% of suicides and 28% of self-harm hospitalisations. Compared to ≥ 29 days on OAT, the incidence rate of suicide was elevated in the 28 days following OAT cessation (ARR=17.4 [95%CI=11.7-25.9]), and the rate of self-harm hospitalisations was elevated during the first 28 days of OAT (ARR=2.2 [95%CI=1.9-2.6]) and the 28 days after leaving OAT (ARR=2.7 [95%CI=2.3-3.2]).

CONCLUSIONS

OAT may reduce suicide and self-harm risk among people with OUD; however, OAT initiation and cessation are critical periods for targeting self-harm and suicide prevention interventions.

Trends in ICD-10-CM-Coded Administrative Datasets for Injury Surveillance and Research

Injury surveillance relies heavily on data created for administrative purposes. In the United States, the adoption of the clinical modification of the 10th edition of the International Classification of Diseases, Tenth Revision, Clinical Modification added thousands of potential injury codes, but few are used in administrative datasets. The widespread use of electronic health records has the potential to influence the data sources used for injury surveillance. This investigation explores how trends in clinical coding may affect the consistency of injury surveillance data.

Objectives

Accurate injury surveillance depends on data quality in administrative datasets created for billing and reimbursement. Significant effort has been devoted to testing the ability of candidate injury case definitions to identify injury cases accurately in these datasets. We used interviews with experienced coders, informed by a review of the current literature, to identify three clinical coding trends that may affect the consistency of surveillance data: “clinical documentation improvement or clinical documentation integrity” (CDI), coding by treating clinicians, and certain electronic health record features.

Methods

An extensive literature review informed interviews with coding experts to identify potential issues in coding practice. To determine whether physician coding was associated with information loss, we analyzed data from two hospitals serving the same geographic area. One hospital had used physician coding of emergency department data for the past decade; the other used professional coders. We compared the proportion of emergency department records missing external cause of injury codes and assessed the variation for statistical significance.

Results

CDI audits review patient records to ensure that billing information includes every relevant International Classification of Diseases, Tenth Revision, Clinical Modification code. This approach has increased payment rates awarded to Medicare Advantage plans because additional codes increase the patient acuity level and case mix index. The impact of CDI audits on injury data needs further investigation. The pilot analysis addressing information loss with physician coding found a higher level of external cause coding with clinician self-coding, possibly because of the coding software. Finally, widespread “copy and paste” in patient electronic health records has the potential to increase reported injuries.

Conclusions

Injury surveillance relies on billing and reimbursement records. Financial motivations may interfere with the consistency of surveillance findings and mislead injury epidemiologists. Further investigation is essential to ensure the integrity of surveillance findings.

Low Level of Agreement Between Self-Report and Clinical Assessment of Passive Suicidal Ideation

OBJECTIVE

Discrepancies between patient reports during clinical evaluations and self-reported suicide ideation are of vital importance. We study the agreement in passive suicidal ideation between reports made by clinicians and patients' self-reports.

METHOD

Wish of death in 648 outpatients was assessed by attending clinicians. Within 24 h after clinical evaluation, patients completed a self-report questionnaire in which they were asked whether they had no desire to live. We used cluster analysis to determine the clinical profile of a population of patients according to the concordance between reports made by clinicians and self-reported information.

RESULTS

A low level of agreement (kappa = 0.072) was found between clinicians and patients, as 56.4% (n = 366) of clinician reports classified as containing no death-related ideas although on self-report the patient did state that they had no desire to live. In this group containing discrepancies between the two reports, two clusters were found to have shared characteristics: female sex, middle age, cohabitation, active employment, no history of suicidal behavior, and diagnosis of neurotic, stress-related, and somatoform disorders. In a third, more severe cluster, patients self-reported sleep disturbances, less appetite, poor treatment adherence, and aggressiveness.

CONCLUSIONS

We found low agreement between self-reports and clinician assessments regarding the death wish. Self-reporting may be useful in assessing suicide risk. HIGHLIGHTSLow agreement was found between self-reports and clinician assessments regarding passive suicidal ideation.Most patients in whom the clinician underestimated the risk of suicide were women.Our results suggest that clinicians require adequate documentation of suicidal risk assessment to identify the high-risk population.

Multi-site medical record review for validation of intentional self-harm coding in emergency departments

BACKGROUND

Codes in the International Classification of Diseases, Tenth Revision, Clinical Modification (ICD-10-CM), are used for injury surveillance, including surveillance of intentional self-harm, as they appear in administrative billing records. This study estimated the positive predictive value of ICD-10-CM codes for intentional self-harm in emergency department (ED) billing records for patients aged 10 years and older who did not die and were not admitted to an inpatient medical service.

METHODS

The study team in Maryland, Colorado, and Massachusetts selected all or a random sample of ED billing records with an ICD-10-CM code for intentional self-harm (specific codes that began with X71-X83, T36-T65, T71, T14.91). Positive predictive value (PPV) was determined by the number and percentage of records with a physician diagnosis of intentional self-harm, based on a retrospective review of the original medical record.

RESULTS

The estimated PPV for the codes' capture of intentional self-harm based on physician diagnosis in the original medical record was 89.8% (95% CI 85.0-93.4) for Maryland records, 91.9% (95% CI 87.7-95.0) for Colorado records, and 97.3% (95% CI 95.1-98.7) for Massachusetts records.

CONCLUSION

Given the high PPV of the codes, epidemiologists can use the codes for public health surveillance of intentional self-harm treated in the ED using ICD-10-CM coded administrative billing records. However, these codes and related variables in the billing database cannot definitively distinguish between suicidal and non-suicidal intentional self-harm.

Practitioners Assess Achievements and Challenges of Nonfatal Injury Surveillance

OBJECTIVE

Injury surveillance relies on data coded for administrative rather than epidemiological accuracy. The Centers for Disease Control and Prevention (CDC) established the 5-year Surveillance Quality Improvement (SQI) initiative to advance consensus and methodology for injury epidemiology reporting and analysis. Evaluation of the positive predictive value of the CDC's injury surveillance definitions based on International Classification of Diseases, Ninth Revision, Clinical Modification (ICD-9-CM) and International Classification of Diseases, Tenth Revision, Clinical Modification (ICD-10-CM) coding in designated injury categories comprised much of the SQI initiative's work. The goal of the current study is to identify achievements and challenges in SQI as articulated by experienced injury epidemiology practitioners who participated in the CDC-funded SQI initiative.

DESIGN, SETTING, AND PARTICIPANTS

We conducted semistructured interviews with 12 representatives of state and federal public health agencies who had participated extensively in the SQI initiative. The interviews were transcribed and coded using NVivo qualitative analysis software. Initial coding of the data involved both in vivo coding (using the words of participants) and coding of a priori themes.

MAIN OUTCOME MEASURES

Qualitative analysis identified 2 overarching themes, variability among states and observations on the science of injury surveillance.

RESULTS

Within the 2 broad themes, the respondents provided valuable insights regarding access to medical records, case definition validation, unique contributions of medical record abstracting, variations in the practice of medical coding, and the potential for use of data from medical record reviews in other injury-related areas.

CONCLUSIONS

The contributions of the SQI initiative have provided valuable insights into ICD-10-CM case definitions for national injury surveillance. Challenges remain with regard to data access and quality with ongoing reliance on administrative datasets for injury surveillance.

US Hospital Stays in Children and Adolescents With Acetaminophen Poisoning

OBJECTIVES

Acetaminophen poisoning occurs in all age groups; however, hospital-based outcomes of children with these poisonings were not well characterized. Our objectives were to describe the incidence, characteristics, and outcomes of hospital stays in children with acetaminophen poisoning and evaluate the contribution of intentionality.

METHODS

We used the 2016 Kids' Inpatient Database and validated International Classification of Diseases, 10th Revision diagnostic codes to identify hospitalizations of children aged 0 to 19 years for acetaminophen poisoning. We used standard survey methods to generate weighted population estimates and describe characteristics and outcomes, both overall and stratified by intentionality.

RESULTS

There were 9935 (95% confidence interval [CI], 9252-10 619) discharges from acute care hospitals for acetaminophen poisoning in U.S. children aged 0 to 19 years during 2016, corresponding to a population rate of 12.1 (95% CI, 11.3-12.9) hospitalizations per 100 000 children. Most hospitalizations for both intentional and unintentional acetaminophen poisoning occurred in females, with a strongly age-related sex distribution. Median length of stay was 2 days (interquartile range, 1-4 days); however, nearly half of discharges were subsequently transferred to another type of facility (eg, psychiatric hospital). Median hospital charges for acute care were $14 379 (interquartile range, $9162-$23 114), totaling $204.7 million (95% CI, $187.4-$221.9) in aggregate. Of 31 632 hospital discharges associated with self-harm medication poisoning in children aged 0 to 19 years, acetaminophen was the single most commonly implicated agent.

CONCLUSIONS

Acetaminophen poisoning was the most common cause of U.S. hospital stays associated with medication self-harm poisoning. More effective acetaminophen poisoning prevention strategies are needed, which may reduce the burden of this common adolescent malady.