Simplifying Measurement of Adenoma Detection Rates for Colonoscopy

BACKGROUND

Adenoma detection rate (ADR) is the colonoscopy quality metric with the strongest association to interval or "missed" cancer. Accurate measurement of ADR can be laborious and costly.

AIMS

Our aim was to determine if administrative procedure codes for colonoscopy and text searches of pathology results for adenoma mentions could estimate ADR.

METHODS

We identified US Veterans with a colonoscopy using Current Procedure Terminology (CPT) codes between January 2013 and December 2016 at ten Veterans Affairs sites. We applied simple text searches using Microsoft SQL Server full-text searches to query all pathology notes for "adenoma(s)" or "adenomatous" text mentions to calculate ADRs. To validate our identification of colonoscopy procedures, endoscopists of record, and adenoma detection from the electronic health record, we manually reviewed a random sample of 2000 procedure and pathology notes from the 10 sites.

RESULTS

Structured data fields were accurate in identification of colonoscopies being performed (PPV = 0.99; 95% CI 0.99-1.00) and identifying the endoscopist of record (PPV of 0.95; 95% CI 0.94-0.96) for ADR measurement. Simple text searches of pathology notes for adenoma mentions had excellent performance statistics as follows: sensitivity 0.99 (95% CI 0.98-1.00), specificity 0.93 (95% CI 0.92-0.95), NPV 0.99 (95% CI 0.98-1.00), and PPV 0.93 (0.91-0.94) for measurement of ADR. There was no clinically significant difference in the estimates of overall ADR vs. screening ADR (p > 0.05).

CONCLUSIONS

Measuring ADR using administrative codes and text searches from pathology results is an efficient method to broadly survey colonoscopy quality.

Validity testing in veterans with epileptic seizures and psychogenic nonepileptic seizures

OBJECTIVE

Identification of clinically meaningful subgroups among patients with psychogenic nonepileptic seizures (PNES) or epileptic seizures (ES) is of potential value for assessing prognosis and predicting therapeutic response. Invalid performance on validity tests has been associated with noncredible complaints and worse cognitive test scores, and may be one such classification criteria. We studied invalid performance in Veterans with PNES or ES, and the association of invalid performance with cognitive test scores and subjective complaints.

METHODS

Patients were consecutive admissions to three veterans affairs (VA) epilepsy monitoring units. Evaluations included two validity tests: the Test of Memory Malingering (TOMM); and the Minnesota Multiphasic Personality Inventory-2-Restructured Form (MMPI-2-RF) over-reporting validity scales. We compared the frequency of invalid performance on the TOMM or MMPI-2-RF in patients diagnosed with PNES vs. ES. We evaluated the association of invalid performance with scores on the Repeatable Battery for Assessment of Neuropsychological Status (RBANS), and four subjective symptom measures including the Beck Depression Inventory-II, and Quality of Life in Epilepsy-31.

RESULTS

Invalid TOMM performance was found in 25.3% of Veterans diagnosed with PNES and 10.8% of those with ES (p = .03). Invalid reporting on the MMPI-2-RF was found in 35.9% of the PNES group vs. 15.3% of the ES group (p = .01). Effects of valid vs. invalid reporting on external measures were similar for ES and PNES groups. Patients with invalid vs. valid TOMM performance had lower scores on the RBANS (p < .001). Patients with invalid performance had greater complaints on all subjective measures, with largest effect sizes for the MMPI-2-RF validity scales (p < .001).

SIGNIFICANCE

In Veterans admitted for evaluation of poorly controlled seizures, invalid performance on validity tests was not uncommon. Cognitive test results and subjective reports from patients with invalid performance may not be credible. These observations have implications for the analysis of clinical trials, where primary and secondary outcomes often rely on self-report measures.

Association of a Multisite Interprofessional Education Initiative With Quality of Primary Care

IMPORTANCE

Studies have shown that interprofessional education (IPE) improves learner proficiencies, but few have measured the association of IPE with patient outcomes, such as clinical quality.

OBJECTIVE

To estimate the association of a multisite IPE initiative with quality of care.

DESIGN, SETTING, AND PARTICIPANTS

This study used difference-in-differences analysis of US Department of Veterans Affairs (VA) electronic health record data from July 1, 2008, to June 30, 2015. Patients cared for by resident clinicians in 5 VA academic primary care clinics that participated in the Centers of Excellence in Primary Care Education (CoEPCE), an initiative designed to promote IPE among physician, nurse practitioner, pharmacist, and psychologist trainees, were compared with patients cared for by resident clinicians in 5 regionally matched non-CoEPCE clinics using data for the 3 academic years (ie, July 1 to June 30) before and 4 academic years after the CoEPCE launch. Analysis was conducted from January 18, 2018, to January 17, 2019.

MAIN OUTCOMES AND MEASURES

Among patients with diabetes, outcomes included annual hemoglobin A1c, poor hemoglobin A1c control (ie, <9% or unmeasured), and annual renal test; among patients 65 years and older, outcomes included prescription of high-risk medications; among patients with hypertension, outcomes included hypertension control (ie, blood pressure, <140/90 mm Hg); and among all patients, outcomes included timely mental health referrals, primary care mental health integrated visits, and hospitalizations for ambulatory care-sensitive conditions.

RESULTS

A total of 44 527 patients contributed 107 686 patient-years; 49 279 (45.8%) were CoEPCE resident patient-years (mean [SD] patient age, 59.3 [15.2] years; 26 206 [53.2%] white; 8073 [16.4%] women; mean [SD] patient Elixhauser comorbidity score, 12.9 [15.1]), and 58 407 (54.2%) were non-CoEPCE resident patient-years (mean [SD] patient age, 61.8 [15.3] years; 43 912 [75.2%] white; 4915 [8.4%] women; mean [SD] patient Elixhauser comorbidity score, 13.8 [15.7]). Compared with resident clinicians who did not participate in the CoEPCE initiative, CoEPCE training was associated with improvements in the proportion of patients with diabetes with poor hemoglobin A1c control (-4.6 percentage points; 95% CI, -7.5 to -1.8 percentage points; P < .001), annual renal testing among patients with diabetes (3.2 percentage points; 95% CI, 0.6 to 5.7 percentage points; P = .02), prescription of high-risk medications among patients 65 years and older (-2.3 percentage points; 95% CI, -4.0 to -0.6 percentage points; P = .01), and timely mental health referrals (1.6 percentage points; 95% CI, 0.6 to 2.6 percentage points; P = .002). Fewer patients cared for by CoEPCE resident clinicians had a hospitalization for an ambulatory care-sensitive condition compared with patients cared for by non-CoEPCE resident clinicians in non-CoEPCE clinics (-0.4 percentage points; 95% CI, -0.9 to 0.0 percentage points; P = .01). Sensitivity analyses with alternative comparison groups yielded similar results.

CONCLUSIONS AND RELEVANCE

In this study, the CoEPCE initiative was associated with modest improvements in quality of care. Implementation of IPE was associated with improvements in patient outcomes and may potentiate delivery system reform efforts.

Family Perceptions of Quality of End-of-Life Care for Veterans with Advanced CKD

BACKGROUND AND OBJECTIVES

Little is known about the quality of end-of-life care for patients with advanced CKD. We describe the relationship between patterns of end-of-life care and dialysis treatment with family-reported quality of end-of-life care in this population.

DESIGN, SETTING, PARTICIPANTS, & MEASUREMENTS

We designed a retrospective observational study among a national cohort of 9993 veterans with advanced CKD who died in Department of Veterans Affairs facilities between 2009 and 2015. We used logistic regression to evaluate associations between patterns of end-of-life care and receipt of dialysis (no dialysis, acute dialysis, maintenance dialysis) with family-reported quality of end-of-life care.

RESULTS

Overall, 52% of cohort members spent ≥2 weeks in the hospital in the last 90 days of life, 34% received an intensive procedure, and 47% were admitted to the intensive care unit, in the last 30 days, 31% died in the intensive care unit, 38% received a palliative care consultation in the last 90 days, and 36% were receiving hospice services at the time of death. Most (55%) did not receive dialysis, 12% received acute dialysis, and 34% received maintenance dialysis. Patients treated with acute or maintenance dialysis had more intensive patterns of end-of-life care than those not treated with dialysis. After adjustment for patient and facility characteristics, receipt of maintenance (but not acute) dialysis and more intensive patterns of end-of-life care were associated with lower overall family ratings of end-of-life care, whereas receipt of palliative care and hospice services were associated with higher overall ratings. The association between maintenance dialysis and overall quality of care was attenuated after additional adjustment for end-of-life treatment patterns.

CONCLUSIONS

Among patients with advanced CKD, care focused on life extension rather than comfort was associated with lower family ratings of end-of-life care regardless of whether patients had received dialysis.

Prevalence of twenty-four hour urine testing in Veterans with urinary stone disease

OBJECTIVE

The American Urological Association guidelines recommend 24-hour urine testing in patients with urinary stone disease to decrease the risk of stone recurrence; however, national practice patterns for 24-hour urine testing are not well characterized. Our objective is to determine the prevalence of 24-hour urine testing in patients with urinary stone disease in the Veterans Health Administration and examine patient-specific and facility-level factors associated with 24-hour urine testing. Identifying variations in clinical practice can inform future quality improvement efforts in the management of urinary stone disease in integrated healthcare systems.

MATERIALS AND METHODS

We accessed national Veterans Health Administration data through the Corporate Data Warehouse (CDW), hosted by the Veterans Affairs Informatics and Computing Infrastructure (VINCI), to identify patients with urinary stone disease. We defined stone formers as Veterans with one inpatient ICD-9 code for kidney or ureteral stones, two or more outpatient ICD-9 codes for kidney or ureteral stones, or one or more CPT codes for kidney or ureteral stone procedures from 2007 through 2013. We defined a 24-hour urine test as a 24-hour collection for calcium, oxalate, citrate or sulfate. We used multivariable regression to assess demographic, geographic, and selected clinical factors associated with 24-hour urine testing.

RESULTS

We identified 130,489 Veterans with urinary stone disease; 19,288 (14.8%) underwent 24-hour urine testing. Patients who completed 24-hour urine testing were younger, had fewer comorbidities, and were more likely to be White. Utilization of 24-hour urine testing varied widely by geography and facility, the latter ranging from 1 to 40%.

CONCLUSIONS

Fewer than one in six patients with urinary stone disease complete 24-hour urine testing in the Veterans Health Administration. In addition, utilization of 24-hour urine testing varies widely by facility identifying a target area for improvement in the care of patients with urinary stone disease. Future efforts to increase utilization of 24-hour urine testing and improve clinician awareness of targeted approaches to stone prevention may be warranted to reduce the morbidity and cost of urinary stone disease.

Use of PROMIS-29® in US Veterans: Diagnostic Concordance and Domain Comparisons with the General Population

BACKGROUND

PROMIS® items have not been widely or systematically used within the Veterans Health Administration (VA).

OBJECTIVE

To examine the concordance of PROMIS-29® scores and medical record diagnosis in US Veterans and to compare Veteran scores relative to US population norms.

DESIGN/PARTICIPANTS

Cross-sectional multi-site survey of Veterans (n = 3221) provided sociodemographic and PROMIS-29® domain data. Electronic medical records provided health condition (depression, anxiety, sleep disorders, pain disorders) diagnosis data.

MAIN MEASURES

For each domain, we calculated PROMIS® standardized T scores and used t tests to compare PROMIS® scores for Veterans diagnosed with each targeted health condition vs. those without that documented clinical diagnosis and compare mean Veterans' PROMIS-29® with US adult population norms.

KEY RESULTS

Veterans with (vs. without) a depression diagnosis reported significantly higher PROMIS® depression scores (60.3 vs. 49.6, p < .0001); those with an anxiety diagnosis (vs. without) reported higher average PROMIS® anxiety scores (62.7 vs. 50.9, p < .0001). Veterans with (vs. without) a pain disorder reported higher pain interference (65.3 vs. 57.7, p < .0001) and pain intensity (6.4 vs. 4.4, p < .0001). Veterans with (vs. without) a sleep disorder reported higher sleep disturbance (55.8 vs. 51.2, p < .0001) and fatigue (57.5 vs. 51.8, p < .0001) PROMIS® scores. Compared with the general population norms, Veterans scored worse across all PROMIS-29® domains.

CONCLUSIONS

We found that PROMIS-29® domains are selectively sensitive to expected differences between clinically-defined groups, suggesting their appropriateness as indicators of condition symptomology among Veterans. Notably, Veterans scored worse across all PROMIS-29(^R) domains compared with population norms. Taken collectively, our findings suggest that PROMIS-29® may be a useful tool for VA providers to assess patient's physical and mental health, and because PROMIS® items are normed to the general population, this offers a way to compare the health of Veterans with the adult population at large and identify disparate areas for intervention.

Transforming Veterans Health Administration Mental Health Clinician Education and Practices: 20 Years of Educational Initiatives by a Center of Excellence

Twenty years ago, the US Congress articulated a need to decrease the time it takes clinical best practices to move from the literature to daily clinical practice. The Veterans Affairs South Central Mental Illness Research, Education, and Clinical Center was one of several centers of excellence established to address this need. It is also unique in that it focuses on rural and underserved veterans. This article summarizes the education accomplishments of the South Central Mental Illness Research, Education, and Clinical Center thus far in providing educational resources and trainings to frontline Veterans Affairs mental health staff with the goal of bringing best practices to routine clinical care, thus improving mental health services. We describe the use of implementation science to support dissemination of information, such as the monthly mental health grand rounds, especially for rural staff to receive continuing education, and the adoption of evidence-based psychotherapy trainings. The Clinical Educator Grants program allows clinicians to share their clinical expertise through development of practical tools for practice gaps they identify. We describe some future directions to meet the evolving needs of Veterans Affairs and community clinicians to provide the best possible care to Veterans. Take-away messages are that, for trainings to be successful, an implementation plan is critical and that an effective educational program requires funding and leadership commitment.