Deployment of a human-centred clinical decision support system for pulmonary embolism: evaluation of impact on quality of diagnostic decisions

Pulmonary embolism (PE) is a serious condition that presents a diagnostic challenge for which diagnostic errors often happen. The literature suggests that a gap remains between PE diagnostic guidelines and adherence in healthcare practice. While system-level decision support tools exist, the clinical impact of a human-centred design (HCD) approach of PE diagnostic tool design is unknown.

DESIGN

Before-after (with a preintervention period as non-concurrent control) design study.

SETTING

Inpatient units at two tertiary care hospitals.

PARTICIPANTS

General internal medicine physicians and their patients who underwent PE workups.

INTERVENTION

After a 6-month preintervention period, a clinical decision support system (CDSS) for diagnosis of PE was deployed and evaluated over 6 months. A CDSS technical testing phase separated the two time periods.

MEASUREMENTS

PE workups were identified in both the preintervention and CDSS intervention phases, and data were collected from medical charts. Physician reviewers assessed workup summaries (blinded to the study period) to determine adherence to evidence-based recommendations. Adherence to recommendations was quantified with a score ranging from 0 to 1.0 (the primary study outcome). Diagnostic tests ordered for PE workups were the secondary outcomes of interest.

RESULTS

Overall adherence to diagnostic pathways was 0.63 in the CDSS intervention phase versus 0.60 in the preintervention phase (p=0.18), with fewer workups in the CDSS intervention phase having very low adherence scores. Further, adherence was significantly higher when PE workups included the Wells prediction rule (median adherence score=0.76 vs 0.59, p=0.002). This difference was even more pronounced when the analysis was limited to the CDSS intervention phase only (median adherence score=0.80 when Wells was used vs 0.60 when Wells was not used, p=0.001). For secondary outcomes, using both the D-dimer blood test (42.9% vs 55.7%, p=0.014) and CT pulmonary angiogram imaging (61.9% vs 75.4%, p=0.005) was lower during the CDSS intervention phase.

CONCLUSION

A clinical decision support intervention with an HCD improves some aspects of the diagnostic decision, such as the selection of diagnostic tests and the use of the Wells probabilistic prediction rule for PE.

Interpreting and coding causal relationships for quality and safety using ICD-11

Many circumstances necessitate judgments regarding causation in health information systems, but these can be tricky in medicine and epidemiology. In this article, we reflect on what the ICD-11 Reference Guide provides on coding for causation and judging when relationships between clinical concepts are causal. Based on the use of different types of codes and the development of a new mechanism for coding potential causal relationships, the ICD-11 provides an in-depth transformation of coding expectations as compared to ICD-10. An essential part of the causal relationship interpretation relies on the presence of "connecting terms," key elements in assessing the level of certainty regarding a potential relationship and how to proceed in coding a causal relationship using the new ICD-11 coding convention of postcoordination (i.e., clustering of codes). In addition, determining causation involves using documentation from healthcare providers, which is the foundation for coding health information. The coding guidelines and examples (taken from the quality and patient safety domain) presented in this article underline how new ICD-11 features and coding rules will enhance future health information systems and healthcare.

Effect of a Continuous Bedside Pressure Mapping System for Reducing Interface Pressures: A Randomized Clinical Trial

Importance

Continuous bedside pressure mapping (CBPM) technology can assist in detecting skin areas with excessive interface pressure and inform efficient patient repositioning to prevent the development of pressure injuries (PI).

Objective

To evaluate the efficacy of CBPM technology in reducing interface pressure and the incidence of PIs.

Design, Setting, and Participants

This parallel, 2-group randomized clinical trial was performed at a tertiary acute care center. The study started to enroll participants in December 2014 and was completed in May 2018. Participants included adults partially or completely dependent for bed mobility. Statistical analysis was performed from September 2018 to December 2022.

Intervention

Nursing staff using visual feedback from CBPM technology for 72 hours.

Main Outcomes and Measures

Absolute number of sensing points with pressure readings greater than 40 mm Hg, mean interface pressure across all sensing points under a patient's body, proportion of participants who had pressure readings greater than 40 mm Hg, and pressure-related skin and soft tissue changes.

Results

There were 678 patients recruited. After attrition, 260 allocated to the control group (151 [58.1%] male; mean [SD] age, 61.9 [18.5] years) and 247 in the intervention group (147 [59.5%] male; mean [SD] age, 63.6 [18.1] years) were included in analyses. The absolute number of sensing points with pressures greater than 40 mm Hg were 11 033 in the control group vs 9314 in the intervention group (P = .16). The mean (SD) interface pressure was 6.80 (1.63) mm Hg in the control group vs 6.62 (1.51) mm Hg in the intervention group (P = .18). The proportion of participants who had pressure readings greater than 40 mm Hg was 99.6% in both the control and intervention groups.

Conclusions and Relevance

In this randomized clinical trial to evaluate the efficacy of CBPM technology in the reduction of interface pressure and the incidence of PIs in a tertiary acute care center, no statistically significant benefit was seen for any of the primary outcomes. These results suggest that longer duration of monitoring and adequately powered studies where CBPM feedback is integrated into a multifaceted intervention to prevent PI are needed.

Trial Registration

ClinicalTrials.gov Identifier: NCT02325388.

ICD-11: A catalyst for advancing patient safety surveillance globally

The World Health Organization's (WHO) international classification of disease version 11 (ICD-11) contains several features which enable improved classification of patient safety events. We have identified three suggestions to facilitate adoption of ICD-11 from the patient safety perspective. One, health system leaders at national, regional, and local levels should incorporate ICD-11 into all approaches to monitor patient safety. This will allow them to take advantage of the innovative patient safety classification methods embedded in ICD-11 to overcome several limitations related to existing patient safety surveillance methods. Two, application developers should incorporate ICD-11 into software solutions. This will accelerate adoption and utility of software-enabled clinical and administrative workflows relevant to patient safety management. This is enabled as a result of the ICD-11 application programming interface (or API) developed by the WHO. Third, health system leaders should adopt the ICD-11 using a continuous improvement framework. This will help leaders at national, regional and local levels to take advantage of specific existing initiatives which will be strengthened by ICD-11, including peer review comparisons, clinician engagement, and alignment of front-line safety efforts with post marketing surveillance of medical technologies. While the investment to adopt ICD-11 will be considerable, these will be offset by reducing the ongoing costs related to a lack of accurate routine information.

Computerised clinical decision support system for the diagnosis of pulmonary thromboembolism: a preclinical pilot study

BACKGROUND

Recommendations for the diagnosis of pulmonary embolism are available for healthcare providers. Yet, real practice data show existing gaps in the translation of evidence-based recommendations. This is a study to assess the effect of a computerised decision support system (CDSS) with an enhanced design based on best practices in content and reasoning representation for the diagnosis of pulmonary embolism.

DESIGN

Randomised preclinical pilot study of paper-based clinical scenarios in the diagnosis of pulmonary embolism. Participants were clinicians (n=30) from three levels of experience: medical students, residents and physicians. Participants were randomised to two interventions for the diagnosis of pulmonary embolism: a didactic lecture versus a decision tree via a CDSS. The primary outcome of diagnostic pathway concordance (derived as a ratio of the number of correct diagnostic decision steps divided by the ideal number of diagnostic decision steps in diagnostic algorithms) was measured at baseline (five clinical scenarios) and after either intervention for a total of 10 clinical scenarios.

RESULTS

The mean of diagnostic pathway concordance improved in both study groups: baseline mean=0.73, post mean for the CDSS group=0.90 (p<0.001, 95% CI 0.10-0.24); baseline mean=0.71, post mean for didactic lecture group=0.85 (p<0.001, 95% CI 0.07-0.2). There was no statistically significant difference between the two study groups or between the three levels of participants.

INTERPRETATION

A computerised decision support system designed for both content and reasoning visualisation can improve clinicians' diagnostic decision-making.

Exploring data reduction strategies in the analysis of continuous pressure imaging technology

BACKGROUND

Science is becoming increasingly data intensive as digital innovations bring new capacity for continuous data generation and storage. This progress also brings challenges, as many scientific initiatives are challenged by the shear volumes of data produced. Here we present a case study of a data intensive randomized clinical trial assessing the utility of continuous pressure imaging (CPI) for reducing pressure injuries.

OBJECTIVE

To explore an approach to reducing the amount of CPI data required for analyses to a manageable size without loss of critical information using a nested subset of pressure data.

METHODS

Data from four enrolled study participants excluded from the analytical phase of the study were used to develop an approach to data reduction. A two-step data strategy was used. First, raw data were sampled at different frequencies (5, 30, 60, 120, and 240 s) to identify optimal measurement frequency. Second, similarity between adjacent frames was evaluated using correlation coefficients to identify position changes of enrolled study participants. Data strategy performance was evaluated through visual inspection using heat maps and time series plots.

RESULTS

A sampling frequency of every 60 s provided reasonable representation of changes in interface pressure over time. This approach translated to using only 1.7% of the collected data in analyses. In the second step it was found that 160 frames within 24 h represented the pressure states of study participants. In total, only 480 frames from the 72 h of collected data would be needed for analyses without loss of information. Only ~ 0.2% of the raw data collected would be required for assessment of the primary trial outcome.

CONCLUSIONS

Data reduction is an important component of big data analytics. Our two-step strategy markedly reduced the amount of data required for analyses without loss of information. This data reduction strategy, if validated, could be used in other CPI and other settings where large amounts of both temporal and spatial data must be analysed.

Field testing a new ICD coding system: methods and early experiences with ICD-11 Beta Version 2018

Objective

A beta version (2018) of International Classification of Diseases, 11th Revision for MMS (ICD-11), needed testing. Field-testing involves real-world application of the new codes to examine usability. We describe creating a dataset and characterizing the usability of ICD-11 code set by coders. We compare ICD-11 against ICD-10-CA (Canadian modification) and a reference standard dataset of diagnoses. Real-world usability encompasses code selection and time to code a complete inpatient chart using ICD-11 compared with ICD-10-CA.

Methods and results

A random sample of inpatient records previously coded using ICD-10-CA was selected from hospitals in Calgary, Alberta (N = 2896). Nurses examined these charts for conditions and healthcare-related harms. Clinical coders re-coded the same charts using ICD-11 codes. Inter-rater reliability (IRR) and coding time improved with ICD-11 coding experience (23.6 to 9.9 min average per chart). Code structure comparisons and challenges encountered are described. Overall, 86.3% of main condition codes matched. Coder comments regarding duplicate codes, missing codes, code finding issues enabled improvements to the ICD-11 Browser, Coding Tool, and Reference Guide. Training is essential for solid IRR with 17,000 diagnostic categories in the new ICD-11. As countries transition to ICD-11, our coding experiences and methods can inform users for implementation or field testing.

Perceived discharge quality and associations with hospital readmissions and emergency department use: a prospective cohort study

Background

At hospital discharge, care is handed over from providers to patients. Discharge encounters must prepare patients to self-manage their health, but have been found to be suboptimal. Our study objectives were to describe and determine the correlates of perceived discharge quality and to explore the association between perceived discharge quality and postdischarge outcomes.

Methods

We conducted a prospective cohort study in medical inpatients admitted to a tertiary care hospital in Calgary, Canada. Perceived discharge quality was measured by the Care Transitions Measure (CTM). Linkage to administrative databases provided data for the composite outcome—90-day hospital readmission or emergency department visit. Logistic regression modelling was used to determine the association between global CTM scores, and the individual CTM components, and the composite outcome.

Results

A total of 316 patients were included in the analysis. The median CTM score was 80.0 (IQR 66.6–100.0). The distribution of CTM scores were significantly different based on comorbidity burden, with the median and maximum CTM scores being lower and the IQR being narrower, for those with six or more comorbidities compared with those with fewer comorbidities. CTM scores were not associated with the composite outcome, though a single CTM item—not understanding warning signs and symptoms—was (adjusted OR 3.46 (95% CI 1.02 to 11.73)).

Conclusion

Perceived quality of discharge varies based on patient burden of comorbidities. While global perceived discharge quality was not associated with postdischarge outcomes, lack of patient understanding of warning symptoms was. Discharging healthcare teams should pay special attention to these priority patient groups and specific discharge process components.

Developing EMR-based algorithms to Identify hospital adverse events for health system performance evaluation and improvement: Study protocol

Background

Measurement of care quality and safety mainly relies on abstracted administrative data. However, it is well studied that administrative data-based adverse event (AE) detection methods are suboptimal due to lack of clinical information. Electronic medical records (EMR) have been widely implemented and contain detailed and comprehensive information regarding all aspects of patient care, offering a valuable complement to administrative data. Harnessing the rich clinical data in EMRs offers a unique opportunity to improve detection, identify possible risk factors of AE and enhance surveillance. However, the methodological tools for detection of AEs within EMR need to be developed and validated. The objectives of this study are to develop EMR-based AE algorithms from hospital EMR data and assess AE algorithm’s validity in Canadian EMR data.

Methods

Patient EMR structured and text data from acute care hospitals in Calgary, Alberta, Canada will be linked with discharge abstract data (DAD) between 2010 and 2020 (n~1.5 million). AE algorithms development. First, a comprehensive list of AEs will be generated through a systematic literature review and expert recommendations. Second, these AEs will be mapped to EMR free texts using Natural Language Processing (NLP) technologies. Finally, an expert panel will assess the clinical relevance of the developed NLP algorithms. AE algorithms validation: We will test the newly developed AE algorithms on 10,000 randomly selected EMRs between 2010 to 2020 from Calgary, Alberta. Trained reviewers will review the selected 10,000 EMR charts to identify AEs that had occurred during hospitalization. Performance indicators (e.g., sensitivity, specificity, positive predictive value, negative predictive value, F₁ score, etc.) of the developed AE algorithms will be assessed using chart review data as the reference standard.

Discussion

The results of this project can be widely implemented in EMR based healthcare system to accurately and timely detect in-hospital AEs.

Coding mechanisms for diagnosis timing in the International Classification of Diseases, Version 11

Background

Diagnoses that arise after admission are of interest because they can represent complications of health care, acute conditions arising de novo, or acute decompensation of a chronic comorbidity occurring during the hospital stay. Three countries in the world have adopted diagnosis timing codes for a number of years. Their experience demonstrates the feasibility and utility of associating an International Classification of Diseases, Version 9 or International Classification of Diseases, Version 10 diagnostic code with information on diagnosis timing, either as part of a diagnostic field or as a separate field. However, diagnosis timing is not an integrated feature of these two classifications as it will be for International Classification of Diseases, Version 11.

Methods

We examine the different types of diagnosis timing that can be used to describe complex patients and present examples of how the new International Classification of Diseases, Version 11 codes may be used.

Results

Extension codes are one of the important new features of International Classification of Diseases, Version 11 and allow more specificity in diagnosis timing.

Conclusion

Imbedded and standardized diagnosis timing information is possible within the International Classification of Diseases, Version 11 classification system.

Effect of Clinical Decision Support With Audit and Feedback on Prevention of Acute Kidney Injury in Patients Undergoing Coronary Angiography: A Randomized Clinical Trial

IMPORTANCE

Contrast-associated acute kidney injury (AKI) is a common complication of coronary angiography and percutaneous coronary intervention (PCI) that has been associated with high costs and adverse long-term outcomes.

OBJECTIVE

To determine whether a multifaceted intervention is effective for the prevention of AKI after coronary angiography or PCI.

DESIGN, SETTING, AND PARTICIPANTS

A stepped-wedge, cluster randomized clinical trial was conducted in Alberta, Canada, that included all invasive cardiologists at 3 cardiac catheterization laboratories who were randomized to various start dates for the intervention between January 2018 and September 2019. Eligible patients were aged 18 years or older who underwent nonemergency coronary angiography, PCI, or both; who were not undergoing dialysis; and who had a predicted AKI risk of greater than 5%. Thirty-four physicians performed 7820 procedures among 7106 patients who met the inclusion criteria. Participant follow-up ended in November 2020.

INTERVENTIONS

During the intervention period, cardiologists received educational outreach, computerized clinical decision support on contrast volume and hemodynamic-guided intravenous fluid targets, and audit and feedback. During the control (preintervention) period, cardiologists provided usual care and did not receive the intervention.

MAIN OUTCOMES AND MEASURES

The primary outcome was AKI. There were 12 secondary outcomes, including contrast volume, intravenous fluid administration, and major adverse cardiovascular and kidney events. The analyses were conducted using time-adjusted models.

RESULTS

Of the 34 participating cardiologists who were divided into 8 clusters by practice group and center, the intervention group included 31 who performed 4327 procedures among 4032 patients (mean age, 70.3 [SD, 10.7] years; 1384 were women [32.0%]) and the control group included 34 who performed 3493 procedures among 3251 patients (mean age, 70.2 [SD, 10.8] years; 1151 were women [33.0%]). The incidence of AKI was 7.2% (310 events after 4327 procedures) during the intervention period and 8.6% (299 events after 3493 procedures) during the control period (between-group difference, -2.3% [95% CI, -0.6% to -4.1%]; odds ratio [OR], 0.72 [95% CI, 0.56 to 0.93]; P = .01). Of 12 prespecified secondary outcomes, 8 showed no significant difference. The proportion of procedures in which excessive contrast volumes were used was reduced to 38.1% during the intervention period from 51.7% during the control period (between-group difference, -12.0% [95% CI, -14.4% to -9.4%]; OR, 0.77 [95% CI, 0.65 to 0.90]; P = .002). The proportion of procedures in eligible patients in whom insufficient intravenous fluid was given was reduced to 60.8% during the intervention period from 75.1% during the control period (between-group difference, -15.8% [95% CI, -19.7% to -12.0%]; OR, 0.68 [95% CI, 0.53 to 0.87]; P = .002). There were no significant between-group differences in major adverse cardiovascular events or major adverse kidney events.

CONCLUSIONS AND RELEVANCE

Among cardiologists randomized to an intervention including clinical decision support with audit and feedback, patients undergoing coronary procedures during the intervention period were less likely to develop AKI compared with those treated during the control period, with a time-adjusted absolute risk reduction of 2.3%. Whether this intervention would show efficacy outside this study setting requires further investigation.

TRIAL REGISTRATION

ClinicalTrials.gov Identifier: NCT03453996.

A multi-step approach to developing a health system evaluation framework for community-based health care

Background

Community-based health care (CBHC) is a shift towards healthcare integration and community services closer to home. Variation in system approaches harkens the need for a conceptual framework to evaluate outcomes and impacts. We set out to develop a CBHC-specific evaluation framework in the context of a provincial ministry of health planning process in Canada.

Methods

A multi-step approach was used to develop the CBHC evaluation framework. Modified Delphi informed conceptualization and prioritization of indicators. Formative research identified evaluation framework elements (triple aim, global measures, and impact), health system levels (tiers), and potential CBHC indicators (n = 461). Two Delphi rounds were held. Round 1, panelists independently ranked indicators on CBHC relevance and health system tiering. Results were analyzed by coding agreement/disagreement frequency and central tendency measures. Round 2, a consensus meeting was used to discuss disagreement, identify Tier 1 indicators and concepts, and define indicators not relevant to CBHC (Tier 4). Post-Delphi, indicators and concepts were refined, Tier 1 concepts mapped to the evaluation framework, and indicator narratives developed. Three stakeholder consultations (scientific, government, and public/patient communities) were held for endorsement and recommendation.

Results

Round 1 Delphi results showed agreement for 300 and disagreement for 161 indicators. Round 2 consensus resulted in 103 top tier indicators (Tier 1 = 19, Tier 2 = 84), 358 bottom Tier 3 and 4 indicators, non-CBHC measure definitions, and eight Tier 1 indicator concepts—Mortality/Suicide; Quality of Life, and Patient Reported Outcome Measures; Global Patient Reported Experience Measures; Cost of Care, Access to Integrated Primary Care; Avoidable Emergency Department Use; Avoidable Hospitalization; and E-health Penetration. Post Delphi results refined Tier 3 (n = 289) and 4 (n = 69) indicators, and identified 18 Tier 2 and 3 concepts. When mapped to the evaluation framework, Tier 1 concepts showed full coverage across the elements. ‘Indicator narratives’ depicted systemness and integration for evaluating CBHC. Stakeholder consultations affirmed endorsement of the approach and evaluation framework; refined concepts; and provided key considerations to further operationalize and contextualize indicators, and evaluate CBHC as a health system approach.

Conclusions

This research produced a novel evaluation framework to conceptualize and evaluate CBHC initiatives. The evaluation framework revealed the importance of a health system approach for evaluating CBHC.

Strategic Clinical Network Teams Improve Effectiveness, Team and Leadership Processes and Inputs: Theory-Based Longitudinal Survey

Strategic Clinical Networks (SCNs) in Alberta include multidisciplinary teams that work toward health system innovation and improvement; however, what contributes to team effectiveness is unclear. This theory-informed longitudinal survey (n = 826) evaluated team effectiveness within SCNs and predictors of effectiveness. Satisfaction, inter-team relationships and seven predictors including team inputs and team and leadership processes improved over two years. Attitudinal outputs were predicted by the same factors over time, whereas performance outputs were predicted by different factors. This innovative study emphasizes that SCN teams and their effectiveness evolve over time and that team-based research can refine network evaluations.

Development and validation of a social vulnerabilities survey for medical inpatients

OBJECTIVES

Our objective was to validate a Social Vulnerabilities Survey that was developed to identify patient barriers in the following domains: (1) salience or priority of health; (2) social support; (3) transportation; and (4) finances.

DESIGN

Cross-sectional psychometric study.Questions for one domain (health salience) were developed de novo while questions for the other domains were derived from national surveys and/or previously validated questionnaires. We tested construct (ie, convergent and discriminative) validity for these new questions through hypothesis testing of correlations between question responses and patient characteristics. Exploratory factor analysis was conducted to determine structural validity of the survey as a whole.

SETTING

Patients admitted to the inpatient internal medicine service at a tertiary care hospital in Calgary, Canada.

PARTICIPANTS

A total of 406 patients were included in the study.

RESULTS

The mean age of respondents was 55.5 (SD 18.6) years, with the majority being men (55.4%). In feasibility testing of the first 107 patients, the Social Vulnerabilities Survey was felt to be acceptable, comprehensive and met face validity. Hypothesis testing of the health salience questions revealed that the majority of observed correlations were exactly as predicted. Exploratory factor analysis of the global survey revealed the presence of five factors (eigenvalue >1): social support, health salience, drug insurance, transportation barriers and drug costs. All but four questions loaded to these five factors.

CONCLUSIONS

The Social Vulnerabilities Survey has face, construct and structural validity. It can be used to measure modifiable social vulnerabilities, such that their effects on health outcomes can be explored and understood.

The three-part model for coding causes and mechanisms of healthcare-related adverse events

ICD-11 provides a promising new way to capture healthcare-related harm or injury. In this paper, we elaborate on the framework for describing healthcare-related events where there is a presumed causal link between an event and underlying healthcare-related factors. The three-part model for describing healthcare-related harm or injury in ICD-11 consists of (1) a healthcare-related activity that is the cause of injury or other harm (selected from Chapter 23 of ICD-11); (2) a mode or mechanism of injury or harm, related to the underlying cause (also from Chapter 23 of ICD-11); and (3) the harmful consequences of the event to the patient, selected from any of Chapters 1 through 22 of ICD-11 (most importantly, the injury or harm experienced by the patient). Concepts from these three elements are linked/clustered through postcoordination to reflect the three-part model in a single coded expression. ICD-11 contains many novel features, and the three-part model described here for healthcare-related adverse events is a notable example.

Prevalence of antimicrobial resistance genes and its association with restricted antimicrobial use in food-producing animals: a systematic review and meta-analysis

BACKGROUND

There is ongoing debate regarding potential associations between restrictions of antimicrobial use and prevalence of antimicrobial resistance (AMR) in bacteria.

OBJECTIVES

To summarize the effects of interventions reducing antimicrobial use in food-producing animals on the prevalence of AMR genes (ARGs) in bacteria from animals and humans.

METHODS

We published a full systematic review of restrictions of antimicrobials in food-producing animals and their associations with AMR in bacteria. Herein, we focus on studies reporting on the association between restricted antimicrobial use and prevalence of ARGs. We used multilevel mixed-effects models and a semi-quantitative approach based on forest plots to summarize findings from studies.

RESULTS

A positive effect of intervention [reduction in prevalence or number of ARGs in group(s) with restricted antimicrobial use] was reported from 29 studies for at least one ARG. We detected significant associations between a ban on avoparcin and diminished presence of the vanA gene in samples from animals and humans, whereas for the mecA gene, studies agreed on a positive effect of intervention in samples only from animals. Comparisons involving mcr-1, blaCTX-M, aadA2, vat(E), sul2, dfrA5, dfrA13, tet(E) and tet(P) indicated a reduced prevalence of genes in intervention groups. Conversely, no effects were detected for β-lactamases other than blaCTX-M and the remaining tet genes.

CONCLUSIONS

The available body of scientific evidence supported that restricted use of antimicrobials in food animals was associated with an either lower or equal presence of ARGs in bacteria, with effects dependent on ARG, host species and restricted drug.

Patient navigation programs in Alberta, Canada: an environmental scan

BACKGROUND

Patient navigation is a complex intervention that has garnered substantial interest and investment across Canada. We conducted an environmental scan to understand the landscape of patient navigation programs within the health care system in Alberta, Canada.

METHODS

We included patient navigation programs within Alberta Health Services (AHS) and Alberta's Primary Care Networks (PCNs). Key informants were asked in October 2016 to identify existing programs and their corresponding program contacts. These program contacts were invited to complete a telephone-based survey from October 2016 to July 2017, to provide program descriptions and eligibility criteria, and to identify gaps in navigation. Programs were included if they engaged patients on an individual basis, and either facilitated continuity of care or promoted patient and family empowerment. We tabulated results and calculated summary statistics for program characteristics.

RESULTS

Ninety-five potentially eligible programs were identified by key informants. The response rate to the study survey was 73% (n = 69). After excluding programs not meeting inclusion criteria, we included a total of 58 programs in the study: 43 AHS programs and 15 PCN programs. Nearly all programs (93%, n = 54) delivered navigation via an individual acting as a navigator. A minority of programs also included nonnavigator components, such as Web-based resources (7%, n = 4) and process or structural changes to facilitate navigation (22%, n = 13). Certain patient subgroups were particularly well-served by patient navigation; these included patients with cancer, substance use disorders or mental health concerns, and pediatric patients. Gaps identified in navigation fell under 4 domains: awareness, resources, geographic distribution and integration.

INTERPRETATION

Patient navigation programs are common and have extended beyond cancer care, from which the construct originated; however, gaps include a lack of awareness and inequitable access to the programs. These findings will be of interest to those developing and implementing patient navigation interventions in Alberta and other jurisdictions.

Mitigating imperfect data validity in administrative data PSIs: a method for estimating true adverse event rates

QUESTION

Are there ways to mitigate the challenges associated with imperfect data validity in Patient Safety Indicator (PSI) report cards?

FINDINGS

Applying a methodological framework on simulated PSI report card data, we compare the adjusted PSI rates of three hospitals with variable quality of data and coding. This framework combines (i) a measure of PSI rates using existing algorithms; (ii) a medical record review on a small random sample of charts to produce a measure of hospital-specific data validity and (iii) a simple Bayesian calculation to derive estimated true PSI rates. For example, the estimated true PSI rate, for a theoretical hospital with a moderately good quality of coding, could be three times as high as the measured rate (for example, 1.4% rather than 0.5%). For a theoretical hospital with relatively poor quality of coding, the difference could be 50-fold (for example, 5.0% rather than 0.1%).

MEANING

Combining a medical chart review on a limited number of medical charts at the hospital level creates an approach to producing health system report cards with estimates of true hospital-level adverse event rates.

Leveraging Professional Sports Teams to Encourage Healthy Behavior: A Review of 4 Years of Calgary Flames Health Training Camp Events

Professional sporting teams may be well-positioned to act as promoters of health behaviors given their fixture within a community, and association with physical activity, nutrition, and other healthy behaviors. Over 4 years, the Calgary Flames Sport and Entertainment Corporation in conjunction with local health promotion professionals, delivered a health promotion event to the public, The Calgary Flames Health Training Camp (FHTC) in Calgary, Alberta, Canada. The purpose of these annual events has been to inspire and encourage healthy behavior uptake and adherence. A description of the FHTC over each of 4 years (2015–2018), lessons learned, and some evaluative work done alongside the event on 2 of the 4 years. In 2017, self-report surveys were administered to event attendees to assess current health status including physical activity, socio-cognitive variables, health information preference, and intention to make healthful behavior change based on event attendance. Biometric data was collected including blood pressure, height, weight, and resting heart rate. Evaluations of the four consecutive events showed that the Calgary Flames Sport and Entertainment Corporation has an ability to attract substantial numbers of the general public to attend FHTC events. Self-report measures from 2017 suggest that already-active populations may be most interested in attending however, the events do appear to inspire attendees to consider behavioral changes for health. The events helped to identify individuals with health risks requiring medical attention but has not yet resulted in known behavior changes. Positive community health impacts may arise from collaboration between health promoters and professional sporting organizations.

Psychometric evaluation of a Canadian version of the Seattle Angina Questionnaire (SAQ-CAN)

BACKGROUND

The Seattle Angina Questionnaire (SAQ) is a widely-used patient-reported outcomes measure in patients with heart disease. This study assesses the validity and reliability of the SAQ in a Canadian cohort of individuals with stable angina.

METHODS AND RESULTS

Data are from the Alberta Provincial Project for Outcome Assessment in Coronary Heart Disease (APPROACH) registry, a population-based registry of patients who received cardiac catheterization in Alberta, Canada. The cohort consists of 4052 patients undergoing cardiac catheterization for stable angina and completed the SAQ within 2 weeks. Exploratory factor analysis and confirmatory factor analysis (CFA) were used to assess the factorial structure of the SAQ. Internal and test-retest reliabilities of a new measure (i.e., SAQ-CAN) was measured using Cronbach α and intraclass correlation coefficient, respectively. CFA model fit was assessed using the root mean square error of approximation (RMSEA) and comparative fit index (CFI). Construct validity of the SAQ-CAN was assessed in relation to Hospital Anxiety and Depression Scales (HADS), Euro Quality of life 5 dimension (EQ5D), and original SAQ. Of the 4052 patients included in this analysis, 3281 (80.97%) were younger than 75 years old, while 3239 (79.94%) were male. Both exploratory and confirmatory factor analyses revealed a four-factorial structure consisting of 16 items that provided a better fit to the data (RMSEA = 0.049 [90% CI = (0.047, 0.052)]; CFI = 0.975). The 16-item SAQ demonstrated good to excellent internal reliability (Cronbach's α range from 0.77 to 0.90), moderate to strong correlation with the Original SAQ and EQ5D but negligible correlations with HADS.

CONCLUSION

The SAQ-CAN has acceptable psychometric properties that are comparable to the original SAQ. We recommend its use for assessing coronary health outcomes in Canadian patients with Coronary Artery Disease.

Temporal and spatial effect of air pollution on hospital admissions for myocardial infarction: a case-crossover study

BACKGROUND

In studies showing associations between ambient air pollution and myocardial infarction (MI), data have been lacking on the inherent spatial variability of air pollution. The aim of this study was to determine whether the long-term spatial distribution of air pollution influences short-term temporal associations between air pollution and admission to hospital for MI.

METHODS

We identified adults living in Calgary who were admitted to hospital for an MI between 2004 and 2012. We evaluated associations between short-term exposure to air pollution (ozone [O₃], nitrogen dioxide [NO₂], sulfur dioxide [SO₂], carbon monoxide [CO], particulate matter < 10 μm in diameter [PM₁₀] and particulate matter < 2.5 μm in diameter [PM_2.5]), and hospital admissions for MI using a time-stratified, case-crossover study design. Air Quality Health Index (AQHI) scores were calculated from a composition of O₃, NO₂ and PM_2.5. Conditional logistic regression models were stratified by low, medium and high levels of neighbourhood NO₂ concentrations derived from land use regression models; results of these analyses are presented as odds ratios (ORs) with 95% confidence intervals (CIs).

RESULTS

From 2004 to 2012, 6142 MIs were recorded in Calgary. Individuals living in neighbourhoods with higher long-term air pollution concentrations were more likely to be admitted to hospital for MI after short-term elevations in air pollution (e.g., 5-day average NO₂: OR 1.20, 95% CI 1.03-1.40, per interquartile range [IQR]) as compared with regions with lower air pollution (e.g., 5-day average NO₂: OR 0.90, 95% CI 0.78-1.04, per IQR). In high NO₂ tertiles, the AQHI score was associated with MI (e.g., 5-day average OR 1.13, 95% CI 1.02-1.24, per IQR; 3-day average OR 1.13, 95% CI 1.04-1.23, per IQR).

INTERPRETATION

Our results show that the effect of air pollution on hospital admissions for MI was stronger in areas with higher NO₂ concentrations than that in areas with lower NO₂ concentrations. Individuals living in neighbourhoods with higher traffic-related pollution should be advised of the health risks and be attentive to special air quality warnings.

Prophylactic Endoscopic Clipping Does Not Prevent Delayed Postpolypectomy Bleeding in Routine Clinical Practice: A Propensity Score-Matched Cohort Study

INTRODUCTION

Delayed postpolypectomy bleeding (DPPB) is a relatively common adverse event. Evidence is conflicting on the efficacy of prophylactic clipping to prevent DPPB, and real-world effectiveness data are lacking. We aimed to determine the effectiveness of prophylactic clipping in preventing DPPB in a large screening-related cohort.

METHODS

We manually reviewed records of patients who underwent polypectomy from 2008 to 2014 at a screening facility. Endoscopist-, patient- and polyp-related data were collected. The primary outcome was DPPB within 30 days. All unplanned healthcare visits were reviewed; DPPB cases were adjudicated by committee using a criterion-based lexicon. Multivariable logistic regression was performed, yielding adjusted odds ratios (AORs) for the association between clipping and DPPB. Secondary analyses were performed on procedures where one polyp was removed, in addition to propensity score-matched and subgroup analyses.

RESULTS

In total, 8,366 colonoscopies involving polypectomy were analyzed, yielding 95 DPPB events. Prophylactic clipping was not associated with reduced DPPB (AOR 1.27; 0.83-1.96). These findings were similar in the single-polyp cohort (n = 3,369, AOR 1.07; 0.50-2.31). In patients with one proximal polyp ≥20 mm removed, there was a nonsignificant AOR with clipping of 0.55 (0.10-2.66). Clipping was not associated with a protective benefit in the propensity score-matched or other subgroup analyses.

DISCUSSION

In this large cohort study, prophylactic clipping was not associated with lower DPPB rates. Endoscopists should not routinely use prophylactic clipping in most patients. Additional effectiveness and cost-effectiveness studies are required in patients with proximal lesions ≥20 mm, in whom there may be a role for prophylactic clipping.

Comparison of different approaches to antibiotic restriction in food-producing animals: stratified results from a systematic review and meta-analysis

BACKGROUND

We have previously reported, in a systematic review of 181 studies, that restriction of antibiotic use in food-producing animals is associated with a reduction in antibiotic-resistant bacterial isolates. While informative, that report did not concretely specify whether different types of restriction are associated with differential effectiveness in reducing resistance. We undertook a sub-analysis of the systematic review to address this question.

METHODS

We created a classification scheme of different approaches to antibiotic restriction: (1) complete restriction; (2) single antibiotic-class restriction; (3) single antibiotic restriction; (4) all non-therapeutic use restriction; (5) growth promoter and prophylaxis restriction; (6) growth promoter restriction and (7) other/undetermined. All studies in the original systematic review that were amenable to meta-analysis were included into this substudy and coded by intervention type. Meta-analyses were conducted using random effects models, stratified by intervention type.

RESULTS

A total of 127 studies were included. The most frequently studied intervention type was complete restriction (n=51), followed by restriction of non-therapeutic (n=33) and growth promoter (n=19) indications. None examined growth promoter and prophylaxis restrictions together. Three and seven studies examined single antibiotic-class and single antibiotic restrictions, respectively; these two intervention types were not significantly associated with reductions in antibiotic resistance. Though complete restrictions were associated with a 15% reduction in antibiotic resistance, less prohibitive approaches also demonstrated reduction in antibiotic resistance of 9%-30%.

CONCLUSION

Broad interventions that restrict global antibiotic use appear to be more effective in reducing antibiotic resistance compared with restrictions that narrowly target one specific antibiotic or antibiotic class. Importantly, interventions that allow for therapeutic antibiotic use appear similarly effective compared with those that restrict all uses of antibiotics, suggesting that complete bans are not necessary. These findings directly inform the creation of specific policies to restrict antibiotic use in food-producing animals.

Validation of new ICD-10-based patient safety indicators for identification of in-hospital complications in surgical patients: a study of diagnostic accuracy

OBJECTIVE

Administrative data systems are used to identify hospital-based patient safety events; few studies evaluate their accuracy. We assessed the accuracy of a new set of patient safety indicators (PSIs; designed to identify in hospital complications).

STUDY DESIGN

Prospectively defined analysis of registry data (1 April 2010-29 February 2016) in a Canadian hospital network. Assignment of complications was by two methods independently. The National Surgical Quality Improvement Programme (NSQIP) database was the clinical reference standard (primary outcome=any in-hospital NSQIP complication); PSI clusters were assigned using International Classification of Disease (ICD-10) codes in the discharge abstract. Our primary analysis assessed the accuracy of any PSI condition compared with any complication in the NSQIP; secondary analysis evaluated accuracy of complication-specific PSIs.

PATIENTS

All inpatient surgical cases captured in NSQIP data.

ANALYSIS

We assessed the accuracy of PSIs (with NSQIP as reference standard) using positive and negative predictive values (PPV/NPV), as well as positive and negative likelihood ratios (±LR).

RESULTS

We identified 12 898 linked episodes of care. Complications were identified by PSIs and NSQIP in 2415 (18.7%) and 2885 (22.4%) episodes, respectively. The presence of any PSI code had a PPV of 0.55 (95% CI 0.53 to 0.57) and NPV of 0.93 (95% CI 0.92 to 0.93); +LR 6.41 (95% CI 6.01 to 6.84) and -LR 0.40 (95% CI 0.37 to 0.42). Subgroup analyses (by surgery type and urgency) showed similar performance. Complication-specific PSIs had high NPVs (95% CI 0.92 to 0.99), but low to moderate PPVs (0.13-0.61).

CONCLUSION

Validation of the ICD-10 PSI system suggests applicability as a first screening step, integrated with data from other sources, to produce an adverse event detection pathway that informs learning healthcare systems. However, accuracy was insufficient to directly identify or rule out individual-level complications.

Trajectories of Health-Related Quality of Life in Coronary Artery Disease

BACKGROUND

Health-related quality of life (HRQOL) assessment is an important health outcome for measuring the efficacy of treatments and interventions for coronary artery disease (CAD). HRQOL is known to improve over the first year after interventions for CAD, but there is limited knowledge of the changes in HRQOL beyond 1 year. We investigated heterogeneity in long-term trajectories of HRQOL in patients with CAD.

METHODS AND RESULTS

Data were obtained from 6226 patients identified from the Alberta Provincial Project for Outcome Assessment in Coronary Heart Disease with at least 1-vessel CAD who underwent their first catheterization between 2006 and 2009. HRQOL was assessed using the Seattle Angina Questionnaire, a 19-item disease-specific measure of HRQOL for patients with CAD. Group-based trajectory analysis was used to identify various subgroups of Seattle Angina Questionnaire trajectories over time while adjusting for missing data through a longitudinal multiple imputation model. Multinomial logistic regression was used to identify the predictors of differences among the identified subgroups. Our analysis revealed significant improvements in HRQOL across all the 5 domains of Seattle Angina Questionnaire overtime for the whole data. Multitrajectory analyses revealed 4 HRQOL trajectory subgroups including high (25.1%), largely increased (32.3%), largely decreased (25.0%), and low (17.6%) trajectories. Age, sex, body mass index, diabetes mellitus, previous history of myocardial infarction, smoking, depression, anxiety, type of treatment received, and perceived social support were significant predictors of differences among these trajectory subgroups.

CONCLUSIONS

This study highlights variations in longitudinal trajectories of HRQOL in patients with CAD. Despite overall improvements in HRQOL, about a quarter of our cohort experienced a significant decline in their HRQOL over the 5-year period. Understanding these HRQOL trajectories may help personalize prognostic information, identify patients and HRQOL domains on which clinical interventions are most beneficial, and support treatment decisions for patients with CAD.

Examination of unintended consequences of antibiotic use restrictions in food-producing animals: Sub-analysis of a systematic review

Antimicrobial resistance is considered one of the greatest threats to global and public health today. The World Health Organization, the Food and Agriculture Organization, and the World Organisation for Animal Health, known as the Tripartite Collaboration, have called for urgent action. We have previously published a systematic review of 181 studies, demonstrating that interventions that restrict antibiotic use in food-producing animals are associated with a reduction in antibiotic resistant bacterial isolates in both animals and humans. What remains unknown, however, are whether (and what) unintended consequences may arise from such interventions. We therefore undertook a sub-analysis of the original review to address this research question. A total of 47 studies described potential consequences of antibiotic restrictions. There were no consistent trends to suggest clear harm. There may be increased bacterial contamination of food products, the clinical significance of which remains unclear. There is a need for rigorous evaluation of the unintended consequences of antibiotic restrictions in human health, food availability, and economics, given their possible widespread implications.

Public health: who, what, and why?

There has been renewed concern about the state of public health in Canada, with several recent articles in this journal suggesting that the discipline of public health is under threat and that there has been a significant erosion of its core infrastructure. We strongly agree with the need for a well-resourced formal public health system and preservation of capacity to carry out core public health functions, while also positing a complementary narrative that emphasizes the possibility for a broad notion of public health to persevere and thrive in the face of these challenges. We consider what public health is, who public health is, and why public health exists, and suggest that the answers to these questions point to opportunities to strengthen the necessary interdisciplinary approaches that can best address current and future public health concerns.

Evaluation of an electronic health record structured discharge summary to provide real time adverse event reporting in thoracic surgery

BACKGROUND

The reporting of adverse events (AE) remains an important part of quality improvement in thoracic surgery. The best methodology for AE reporting in surgery is unclear. An AE reporting system using an electronic discharge summary with embedded data collection fields, specifying surgical procedure and complications, was developed. The data are automatically transferred daily to a web-based reporting system.

METHODS

We determined the accuracy and sustainability of this electronic real time data collection system (ERD) by comparing the completeness of record capture on procedures and complications with coded discharge data (administrative data), and with the standard of chart audit at two intervals. All surgical procedures performed for 2 consecutive months at initiation (Ti) and 1 year later (T1yr) were audited by an objective trained abstractor. A second abstractor audited 10% of the charts.

RESULTS

The ERD captured 71/72 (99%) of charts at Ti and 56/65 (86%) at T1yr. Comparing the presence/absence of complications between ERD and chart audit demonstrated at Ti a high sensitivity and specificity, positive predictive value (PPV) of 95.5%, negative predictive value (NPV) of 93.9% with a kappa of 0.872 (95% CI 0.750 to 0.994), and at T1yr a sensitivity, specificity, PPV and NPV of 100% with a kappa of 1.0 (95% CI 1.0). Comparing the presence/absence of complications between administrative data and chart audit at Ti demonstrated a low sensitivity, high specificity and a kappa of 0.471 (95% CI 0.256 to 0.686), and at T1yr a low sensitivity, high specificity of 85% and a kappa of 0.479 (95% CI 0.245 to 0.714).

CONCLUSIONS

We found that the ERD can provide accurate real time AE reporting in thoracic surgery, has advantages over previous reporting methodologies and is an alternative system for surgical clinical teams developing AE reporting systems.

Clinical Utility of Pre-Exercise Stress Testing in People With Diabetes

BACKGROUND

Although suggested by practice guidelines, the need for pre-exercise stress testing in asymptomatic people with diabetes remains controversial. We examined the utility of screening with pre-exercise stress testing in patients with diabetes.

METHODS

We completed a cohort study, evaluating patients with diabetes who attended an exercise program intake session between 2007 and 2012. The exposure of interest was referral for pre-exercise stress testing determined by an algorithm requiring sedentary patients with diabetes and ≥ 1 cardiac risk factor to undergo testing. Outcomes included cardiac catheterization, revascularization, cardiovascular-related admissions, mortality, and change in care.

RESULTS

Among 1705 people with diabetes, 676 (40%) were referred for pre-exercise stress testing. In patients who were referred for stress testing compared with those who were not, there was no difference in the composite of cardiovascular outcomes (revascularization, cardiovascular-related admissions, and cardiovascular-related death) within 1 year (2.8% vs 1.9%, P = 0.250), or subsequent to the first year (3.1% vs 4.6%, P = 0.164). Within 1 year, more revascularizations were performed in patients referred for stress testing compared with those who were not (2.1% vs 0.8%, P = 0.027) but not during longer-term follow-up (mean 3.4 years).

CONCLUSIONS

The rates of cardiovascular outcomes in both tested and untested patients were low. Patients undergoing stress testing had no difference in adverse cardiovascular outcomes over the follow-up periods. Referral for stress testing did not result in a change in care for most patients. Our findings suggest stress testing before beginning an exercise program is not necessary for most asymptomatic patients with diabetes.

Expanding the impact of a longstanding Canadian cardiac registry through data linkage: challenges and opportunities

The Alberta Provincial Project for Outcome Assessment in Coronary Heart Disease (APPROACH) began as a province-wide inception cohort of all adult Alberta residents undergoing cardiac catheterization for ischemic heart disease. Strengths of the APPROACH initiative include the prospective collection of detailed clinical, procedural, and treatment information, measured at point-of-care. While this aspect of APPROACH provides data users with several advantages over use of typical administrative data, the ability to link APPROACH with data from multiple other sources has provided several unique opportunities to measure cardiovascular care and outcomes. As of June 2018, clinical information has been collected by APPROACH on over 240,000 adult Alberta residents. Linkage of this rich clinical data to administrative health data (eg. Vital statistics, hospitalizations, ambulatory events, prescription medications), secondary use clinical data (e.g. laboratory, ECG, rehabilitation, EMR, imaging) and other data sources (eg. Geospatial, crime data, meteorological) allows better study of the determinants of a patient's health trajectory. This paper describes applied examples of work that has leveraged the potential of linking several datasets with the APPROACH registry.

The International Population Data Linkage Network – Banff and Beyond

We write to you, here in the pages of the International Journal of Population Data Science, for the second time in our capacity of co-directors of the International Population Data Linkage Network (IPDLN – www.ipdln.org). Time has certainly passed quickly since our first communication, where we introduced ourselves, and discussed planned initiatives for our tenure as leads of the IPDLN. Our network’s scientific community is steadily growing and thriving in an era of heightened interest around all things ‘data’. Indeed, there is great enthusiasm for all initiatives that explore ways of harnessing information systems and multisource data to enhance collective knowledge of health matters so that better decisions can be made by governments, system planners, providers, and patients. Never before have such initiatives attracted more attention. It is in this context of heightened interest and relevance around IPDLN and its science that we prepare to convene in Banff, Alberta, Canada for the 5th biennial IPDLN Conference – September 11-14. The conference, to be held at the inspiring Banff Centre (www.banffcentre.ca), is almost sold out, with only limited space remaining for late registrants. A tremendous program has been created through the oversight of Scientific Program co-chairs, Drs. Astrid Guttman and Hude Quan. A compelling roster of plenary lectures from Drs. Diane Watson, Jennifer Walker, and Osmar Zaïane is eagerly anticipated, as are topical panel discussions, an entertaining Science Slam session, and a terrific social program. These sessions will be surrounded by rich scientific oral and poster presentations arising from the more than 450 scientific abstracts submitted for review. We are so pleased to see this vibrant scientific engagement from the IPDLN membership and students, and look forward to hosting all delegates in Banff. The Banff conference will also be the venue at which we announce the new Directorship of the IPDLN for the next two years (2019 and 2020). As co-directors, we engaged with a number of individuals and organizations with interest in leading the IPDLN. In the end, two compelling Directorship applications were submitted – one a joint bid from Australia’s Population Health Research Network and the South Australia Northern Territory DataLink, and the other from the US-based Actionable Intelligence for Social Policy. IPDLN members submitted votes on these strong leadership bids through an online voting process, and while the excellence and appeal of both bids was apparent in strong voter support for both, a winning bid has been confirmed, and it will (as mentioned) be announced at the upcoming September conference. As we look forward to the Banff meeting with great anticipation, we are compelled to acknowledge the growing IPDLN legacy created by past directors. We are particularly indebted to our immediate predecessor, Dr. David Ford, and his team at Swansea University. Their work in hosting the 2016 IPDLN conference has been an inspiration to us in the planning of this year’s conference, and their crucial and foundational work in creating an IT platform for the IPDLN website, the membership database, and the new International Journal for Population Data Science has brought the IPDLN to a new level of organizational sophistication. Over the last 18 months, our co-directorship teams from the Institute for Clinical Evaluative Sciences in Ontario and the O’Brien Institute for Public Health at the University of Calgary have built on the foundation established by prior directors to update/enhance the IPDLN website and membership database. The IPDLN has more members than ever before representing a greater number of countries, and we have a more formalized governance structure with the creation of an Executive Committee that will include immediate past-Directors in order to better ensure continuity. A new Executive Committee will be elected by the IPDLN membership following the Banff conference. The waiting is almost over and IPDLN 2018 is upon us! Our scientific domain has never had the prominence or level of anticipation that we currently see. And the IPDLN has grown in its size, vibrancy and scientific scope. The opportunities for us are boundless, and the timing of our upcoming conference could not be better. We are honoured, with our respective organizations, to have had this opportunity to serve as co-directors over the past two years, and look forward to seeing many of you very soon. For those of you who are unable to travel to Canada’s Rocky Mountains this year, we look forward to connecting with you at a later time in the IPDLN’s continuing upward journey.

A Meta-Data Manifesto: The Need for Global Health Meta-Data

Administrative health data recorded for individual health episodes (such as births, deaths, physician visits, and hospital stays) are being widely used to study policy-relevant scientific questions about population health, health services, and quality of care. An increasing number of international health comparisons are undertaken with these data. An essential pre-requisite to such international comparative work is a detailed characterization of existing international health data resources, so that they can be more readily used for comparisons across counties. A major challenge to such international comparative work is the variability across countries in the extent, content, and validity of existing administrative data holdings. Recognizing this, we have undertaken an international proof of concept pilot compiling detailed data about data – i.e., a “meta-data catalogue” – for existing international administrative health data holdings. We describe the methodological process for collecting these meta-data, along with some general descriptive results for selected countries included in the pilot.

A World Health Organization field trial assessing a proposed ICD-11 framework for classifying patient safety events

Objective

To assess the utility of the proposed World Health Organization (WHO)'s International Classification of Disease (ICD) framework for classifying patient safety events.

Setting

Independent classification of 45 clinical vignettes using a web-based platform.

Study participants

The WHO's multi-disciplinary Quality and Safety Topic Advisory Group.

Main outcome measure(s)

The framework consists of three concepts: harm, cause and mode. We defined a concept as 'classifiable' if more than half of the raters could assign an ICD-11 code for the case. We evaluated reasons why cases were nonclassifiable using a qualitative approach.

Results

Harm was classifiable in 31 of 45 cases (69%). Of these, only 20 could be classified according to cause and mode. Classifiable cases were those in which a clear cause and effect relationship existed (e.g. medication administration error). Nonclassifiable cases were those without clear causal attribution (e.g. pressure ulcer). Of the 14 cases in which harm was not evident (31%), only 5 could be classified according to cause and mode and represented potential adverse events. Overall, nine cases (20%) were nonclassifiable using the three-part patient safety framework and contained significant ambiguity in the relationship between healthcare outcome and putative cause.

Conclusions

The proposed framework enabled classification of the majority of patient safety events. Cases in which potentially harmful events did not cause harm were not classifiable; additional code categories within the ICD-11 are one proposal to address this concern. Cases with ambiguity in cause and effect relationship between healthcare processes and outcomes remain difficult to classify.

An exploration of the subjective social status construct in patients with acute coronary syndrome

Background

Perception of low subjective social status (SSS) relative to others in society or in the community has been associated with increased risk of cardiovascular disease. Our objectives were to determine whether low SSS in society was associated with barriers to access to care or hospital readmission in patients with established cardiovascular disease, and whether perceptions of discordantly high SSS in the community modified this association.

Methods

We conducted a prospective cohort study from 2009 to 2013 in Canada, United States, and Switzerland in patients admitted to hospital with acute coronary syndrome (ACS). Data on access to care and SSS variables were obtained at baseline. Readmission data were obtained 12 months post-discharge. We conducted multivariable logistic regression to model the odds of access to care and readmission outcomes in those with low versus high societal SSS.

Results

One thousand ninety patients admitted with ACS provided both societal and community SSS rankings. The low societal SSS cohort had greater odds of reporting that their health was affected by lack of health care access (OR 1.48, 95% CI 1.11, 1.97) and of experiencing cardiac readmissions (1.88, 95% CI 1.15, 3.06). Within the low societal SSS cohort, there was a trend toward fewer access to care barriers for those with discordantly high community SSS though findings varied based on the outcome variable. There were no statistically significant differences in readmissions based on community SSS rankings.

Conclusion

Low societal SSS is associated with increased barriers to access to care and cardiac readmissions. Though attenuated, these trends remained even when adjusting for clinical and sociodemographic factors, suggesting that perceived low societal SSS has health effects above and beyond objective socioeconomic factors. Furthermore, high community SSS may potentially mitigate the risk of experiencing barriers to access to health care in those with low societal SSS, though these associations were not statistically significant. Subjective social status relative to society versus relative to the community seem to represent distinct concepts. Insight into the differences between these two SSS constructs is imperative in the understanding of cardiovascular health and future development of public health policies.

Electronic supplementary material

The online version of this article (10.1186/s12872-018-0759-7) contains supplementary material, which is available to authorized users.

Prospective economic evaluation of an electronic discharge communication tool: analysis of a randomised controlled trial

OBJECTIVE

To complete an economic evaluation within a randomised controlled trial (RCT) comparing the use of an electronic discharge communication tool (eDCT) compared with usual care.

SETTING

Patients being discharged from a single tertiary care centre's internal medicine Medical Teaching Units.

PARTICIPANTS

Between January 2012 and December 2013, 1399 patients were randomised to a discharge mechanism. Forty-five patients were excluded from the economic evaluation as they did not have data for the index hospitalisation cost; 1354 patients contributed to the economic evaluation.

INTERVENTION

eDCT generated at discharge containing structured content on reason for admission, details of the hospital stay, treatments received and follow-up care required. The control group was discharged via traditional dictation methods.

PRIMARY AND SECONDARY OUTCOME MEASURES

The primary economic outcome was the cost per quality-adjusted life year (QALY) gained. Secondary outcomes included the cost per death avoided and the cost per readmission avoided.

RESULTS

The average transcription cost was $C22.28 per patient, whereas the estimated cost of the eDCT was $C13.33 per patient. The cost per QALY gained was $C239 933 in the eDCT arm compared with usual care due to the very small gains in effectiveness and approximately $C800difference in resource utilisation costs. The bootstrap analyses resulted in eDCT being more effective and more costly in 29.2% of samples, less costly and more effective in 29.2% of samples, less effective and more costly in 23.9% of samples and finally, less costly and less effective in 17.7% of samples.

CONCLUSIONS

The eDCT reduced per patient costs of the generation of discharge summaries. The bootstrap estimates demonstrate considerable uncertainty supporting the finding of neutrality reported in the clinical component of the RCT. The immediate transcription cost savings and previously documented provider and patient satisfaction may increase the impetus for organisations to invest in such systems, provided they have a foundation of eHealth infrastructure and readiness.

TRIAL REGISTRATION NUMBER

NCT01402609.

Restricting the use of antibiotics in food-producing animals and its associations with antibiotic resistance in food-producing animals and human beings: a systematic review and meta-analysis

BACKGROUND

Antibiotic use in human medicine, veterinary medicine, and agriculture has been linked to the rise of antibiotic resistance globally. We did a systematic review and meta-analysis to summarise the effect that interventions to reduce antibiotic use in food-producing animals have on the presence of antibiotic-resistant bacteria in animals and in humans.

METHODS

On July 14, 2016, we searched electronic databases (Agricola, AGRIS, BIOSIS Previews, CAB Abstracts, MEDLINE, Embase, Global Index Medicus, ProQuest Dissertations, Science Citation Index) and the grey literature. The search was updated on Jan 27, 2017. Inclusion criteria were original studies that reported on interventions to reduce antibiotic use in food-producing animals and compared presence of antibiotic-resistant bacteria between intervention and comparator groups in animals or in human beings. We extracted data from included studies and did meta-analyses using random effects models. The main outcome assessed was the risk difference in the proportion of antibiotic-resistant bacteria.

FINDINGS

A total of 181 studies met inclusion criteria. Of these, 179 (99%) described antibiotic resistance outcomes in animals, and 81 (45%) of these studies were included in the meta-analysis. 21 studies described antibiotic resistance outcomes in humans, and 13 (62%) of these studies were included in the meta-analysis. The pooled absolute risk reduction of the prevalence of antibiotic resistance in animals with interventions that restricted antibiotic use commonly ranged between 10 and 15% (total range 0-39), depending on the antibiotic class, sample type, and bacteria under assessment. Similarly, in the human studies, the pooled prevalence of antibiotic resistance reported was 24% lower in the intervention groups compared with control groups, with a stronger association seen for humans with direct contact with food-producing animals.

INTERPRETATION

Interventions that restrict antibiotic use in food-producing animals are associated with a reduction in the presence of antibiotic-resistant bacteria in these animals. A smaller body of evidence suggests a similar association in the studied human populations, particularly those with direct exposure to food-producing animals. The implications for the general human population are less clear, given the low number of studies. The overall findings have directly informed the development of WHO guidelines on the use of antibiotics in food-producing animals.

FUNDING

World Health Organization.

A randomised controlled trial assessing the efficacy of an electronic discharge communication tool for preventing death or hospital readmission

OBJECTIVE

To assess the efficacy of an electronic discharge communication tool (e-DCT) for preventing death or hospital readmission, as well as reducing patient-reported adverse events after hospital discharge. The e-DCT assessed has already been shown to yield high-quality discharge summaries with high levels of patient and physician satisfaction.

METHODS

This two-arm randomised controlled trial was conducted in a Canadian tertiary care centre's internal medicine medical teaching units. Out of the 1953 patients approached and screened for inclusion, 1399 were randomised and available for data linkage for determination of the primary outcome. Participants were randomly assigned to e-DCT versus usual care (traditional discharge communication generated by dictation). The primary outcome was a composite of death or readmission within 90 days. The secondary outcome included any patient-reported adverse events within 30 days of discharge.

RESULTS

Among 1399 randomised participants, 230 of 701 participants (32.8%) in the e-DCT group experienced the primary composite outcome of death or readmission within 90 days vs 205 of 698 participants (29.4%) in the usual care group (p=0.166). The incidence at 30 days of patient-reported adverse outcomes (35% for e-DCT vs 34% for usual care) and adverse events (2.1% for e-DCT vs 1.8% for usual care) also did not differ significantly between groups.

CONCLUSIONS

The e-DCT tested did not reduce the composite endpoint of death or readmission at 90 days, nor the incidence of patient-reported adverse events at 30 days. This neutral finding for hard clinical endpoints needs to be considered in the context of high patient and physician satisfaction, and high quality of discharge summaries.

A systematic review of the cost and cost-effectiveness of electronic discharge communications

BACKGROUND

The transition between acute care and community care can be a vulnerable period in a patients' treatment due to the potential for postdischarge adverse events. The vulnerability of this period has been attributed to factors related to the miscommunication between hospital-based and community-based physicians. Electronic discharge communication has been proposed as one solution to bridge this communication gap. Prior to widespread implementation of these tools, the costs and benefits should be considered.

OBJECTIVE

To establish the cost and cost-effectiveness of electronic discharge communications compared with traditional discharge systems for individuals who have completed care with one provider and are transitioning care to a new provider.

METHODS

We conducted a systematic review of the published literature, using best practices, to identify economic evaluations/cost analyses of electronic discharge communication tools. Inclusion criteria were: (1) economic analysis and (2) electronic discharge communication tool as the intervention. Quality of each article was assessed, and data were summarised using a component-based analysis.

RESULTS

One thousand unique abstracts were identified, and 57 full-text articles were assessed for eligibility. Four studies met final inclusion criteria. These studies varied in their primary objectives, methodology, costs reported and outcomes. All of the studies were of low to good quality. Three of the studies reported a cost-effectiveness measure ranging from an incremental daily cost of decreasing average discharge note completion by 1 day of $0.331 (2003 Canadian), a cost per page per discharge letter of €9.51 and a dynamic net present value of €31.1 million for a 5-year implementation of the intervention. None of the identified studies considered clinically meaningful patient or quality outcomes.

DISCUSSION

Economic analyses of electronic discharge communications are scarcely reported, and with inconsistent methodology and outcomes. Further studies are needed to understand the cost-effectiveness and value for patient care.

Economic Evaluations of Strategies to Prevent Hospital-Acquired Pressure Injuries

GENERAL PURPOSE

To provide information from a review of literature about economic evaluations of preventive strategies for pressure injuries (PIs).

TARGET AUDIENCE

This continuing education activity is intended for physicians, physician assistants, nurse practitioners, and nurses with an interest in skin and wound care.

LEARNING OBJECTIVES/OUTCOMES

After participating in this educational activity, the participant should be better able to:1. Identify the purpose and methods used for this study.2. Compare costs and effectiveness related to preventative strategies for PIs.

ABSTRACT

BACKGROUND: Pressure injuries (PIs) are a common and resource-intensive challenge for acute care hospitals worldwide. While a number of preventive strategies have the potential to reduce the cost of hospital-acquired PIs, it is unclear what approach is the most effective.

OBJECTIVE

The authors performed a narrative review of the literature on economic evaluations of preventive strategies to survey current findings and identify important factors in economic assessments.

DATA SOURCES

Ovid, MEDLINE, NHS Economic Evaluation Databases, and the Cochrane Database of Systematic ReviewsSELECTION CRITERIA: Potentially relevant original research articles and systematic reviews were considered.

DATA EXTRACTION

Selection criteria included articles that were written in English, provided data on cost or economic evaluations of preventive strategies of PIs in acute care, and published between January 2004 and September 2015. Data were abstracted from the articles using a standardized approach to evaluate how the items on the Consolidated Health Economic Evaluation Reporting Standards checklist were addressed.

DATA SYNTHESIS

The searches identified 192 references. Thirty-three original articles were chosen for full-text reviews. Nineteen of these articles provided clear descriptions of interventions, study methods, and outcomes considered.

CONCLUSIONS

Limitations in the available literature prevent firm conclusions from being reached about the relative economic merits of the various approaches to the prevention of PIs. The authors' review revealed a need for additional high-quality studies that adhere to commonly used standards of both currently utilized and emerging ways to prevent hospital-acquired PIs.

ACSC Indicator: testing reliability for hypertension

BACKGROUND

With high-quality community-based primary care, hospitalizations for ambulatory care sensitive conditions (ACSC) are considered avoidable. The purpose of this study was to test the inter-physician reliability of judgments of avoidable hospitalizations for one ACSC, uncomplicated hypertension, derived from medical chart review.

METHODS

We applied the Canadian Institute for Health Information's case definition to obtain a random sample of patients who had an ACSC hospitalization for uncomplicated hypertension in Calgary, Alberta. Medical chart review was conducted by three experienced internal medicine specialists. Implicit methods were used to judge avoidability of hospitalization using a validated 5-point scale.

RESULTS

There was poor agreement among three physicians raters when judging the avoidability of 82 ACSC hospitalizations for uncomplicated hypertension (κ = 0.092). The κ also remained low when assessing agreement between raters 1 and 3 (κ = 0.092), but the κ was lower (less than chance agreement) for raters 1 and 2 (κ = -0.119) and raters 2 and 3 (κ = -0.008). When the 5-point scale was dichotomized, there was fair agreement among three raters (κ = 0.217). The proportion of ACSC hospitalizations for uncomplicated hypertension that were rated as avoidable was 32.9%, 6.1% and 26.8% for raters 1, 2, and 3, respectively.

CONCLUSIONS

This study found a low proportion of ACSC hospitalization were rated as avoidable, with poor to fair agreement of judgment between physician raters. This suggests that the validity and utility of this health indicator is questionable. It points to a need to abandon the use of ACSC entirely; or alternatively to work on the development of explicit criteria for judging avoidability of hospitalization for ACSC such as hypertension.

A Mixed-methods Study to Assess Interrater Reliability and Nurse Perception of the Braden Scale in a Tertiary Acute Care Setting

Research regarding the reliability of the Braden Scale and nurses' perspectives on the instrument for predicting pressure ulcer (PU) risk in acute care settings is limited. A mixed-methods study was conducted in a tertiary acute care facility to examine interrater reliability (IRR) of the Braden Scale and its subscales, and a qualitative survey using semi-structured interviews was conducted among nurses caring for patients in acute care units to gain nurse perspective regarding scale usability. Data were extracted from a previous retrospective, randomized, controlled trial involving adult patients with compromised mobility receiving care in a tertiary acute care hospital in Canada. One-way, intraclass correlation coefficients (ICCs) were calculated on item and total scores, and kappa statistics were used to determine reliability of categorizing patients on their risk. Interview results were categorized by common themes. Reliability was assessed on 64 patients, where nurses and research staff independently assessed enrolled participants at baseline and after 72 hours using the Braden Scale as it appeared on an electronic medical record. IRR for the total score was high (ICC = 0.807). The friction and shear item had the lowest reliability (ICC = 0.266). Reliability of categorizing patients' level of risk had moderate agreement (κ = 0.408). Three (3) major and 12 subthemes emerged from the 14 nurse interviews; nurses were aware of the scale's purpose but were uncertain of its effectiveness, some items were difficult to rate, and questions were raised as to whether using the scale enhanced patient care. Aspects identified by nurses to enhance usability included: 1) changes to the electronic version (incorporating the scale into daily assessment documents with readily available item descriptions), 2) additional training, and 3) easily available resource material to improve reliability and usability of scale. These findings need to be considered when using the Braden Scale in clinical practice. Further study of the value of the total Braden Scale and its subscales is warranted.

Geographic Clustering of Acute Complications and Sociodemographic Factors in Adults with Type 1 Diabetes

OBJECTIVES

To assess the geographic distribution of acute complications in patients with type 1 diabetes in a large urban centre; and to assess the association between acute complications and community-level sociodemographic factors.

METHODS

Adults (aged ≥18 years old) with type 1 diabetes and acute complications were identified between 2004 and 2008 by using a diabetes centre clinical database or discharge abstracts for acute complications (diabetic ketoacidosis or hypoglycemia). Using a geographic information system, hot-spot analysis was used to identify spatial clusters of acute complications in a large urban centre. The association between acute complications and community-level sociodemographic factors were assessed by Spearman rank correlation.

RESULTS

We identified 1779 patients with type 1 diabetes, of whom 456 had been hospitalized for acute complications. The mean age of patients was 40.9±16.0 years, and men were more likely to have acute complications (59.2% vs. 52.3%; p<0.01). Spatial clusters of high values and low values were identified. Higher median family income (r=-0.36; p<0.0001) and higher education levels (r=-0.30; p<0.0001) were associated with lower rates of acute complications.

CONCLUSIONS

This study demonstrated geographic clusters of hospitalizations for acute complications and important community sociodemographic factors. Prevention strategies and interventions targeting these geographic and sociodemographic disparities need to be explored as a means of minimizing hospitalizations for acute complications.

Validity of ICD-9-CM Administrative Data for Determining Eligibility for Pneumococcal Vaccination Triggers

The purpose of this study was to evaluate the efficacy of medical record administrative data as coded by the International Classification of Diseases, Ninth Revision, for triggering pneumococcal vaccination reminders of patients following discharge from a tertiary care adult teaching hospital. A retrospective computerized search was conducted using administrative discharge data to detect patients admitted to the medical teaching unit who met clinical criteria for pneumococcal vaccination according to Canadian immunization guidelines. For identification of persons eligible for vaccination, administrative discharge data showed a sensitivity of 83% (confidence interval [CI], 0.73-0.92) and a specificity of 78% (CI, 0.64-0.91), with a positive predictive value of 87% (CI, 0.83-0.90) and a negative predictive value of 72% (CI, 0.58-0.86). The reasonably high specificity and sensitivity of diagnostic codes in administrative data could be used to trigger appropriate pneumococcal vaccination among eligible patients after hospital discharge.

A framework to assess patient-reported adverse outcomes arising during hospitalization

BACKGROUND

The assessment of adverse events from a patient-centered view includes patient-reported adverse outcomes. An adverse outcome refers to any suboptimal outcome experienced by the patient; when adverse outcomes are identified through a patient interview these are called patient-reported adverse outcomes. An adverse event is an adverse outcome that is more likely due to the processes of medical care rather than to the mere progression of disease. In the context of a large-scale study assessing post-hospitalization adverse events, we developed a conceptual framework to assess patient-reported adverse outcomes (PRAOs). This methodological manuscript describes this conceptual framework.

METHODS

The PRAO framework builds on a validated adverse event ascertainment method including three phases: Phase 1 involves an inquiry to ascertain the occurrence of any patient-reported adverse outcome. It is completed by a structured telephone interview to obtain details - from a patient perspective - on symptoms that developed and/or worsened after hospitalization. Phase 2 involves the classification of PRAOs by physicians not involved in the patient care. Physician-reviewers then rate the PRAOs using well-adopted scales to determine whether the occurrence was the natural progression of the underlying illness or due to medical care. When the PRAO is rated as "due to medical care", it is then classified as an "adverse event". Phase 3 involves the classification of adverse events as preventable or ameliorable.

RESULTS

Out of the 1347 patients contacted at 1-month post-discharge, 469 reported AOs and after reviewing 369 cases, 29 were classified as AEs. Observed agreement levels between raters were 87.3, 85.5, and 85.2 % respectively displaying a good agreement (k > 0.60).

CONCLUSION

The framework incorporates PRAOs as a way to identify cases that need to be evaluated for adverse events. Further validation of this framework is warrant with the final aim of implementation at larger scale. The implementation of this framework will enable clinicians, researchers and healthcare institutions to compare outcome rates across providers and over time.

Depressive symptoms and functional decline following coronary interventions in older patients with coronary artery disease: a prospective cohort study

BACKGROUND

Depressive symptoms are prevalent in patients with coronary artery disease (CAD). It is unclear, however, how depressive symptoms change over time and the impact of these changes on long-term functional outcomes. We examined the association between different trajectories of depressive symptoms over 1 year and change in functional status over 30 months among patients undergoing coronary angiography.

METHODS

This was a prospective cohort study of 350 patients aged 60 and older undergoing non-emergent cardiac catheterization (October 2003-February 2007). A dynamic measure of significant depressive symptoms (i.e., Geriatric Depression Scale score 5+) capturing change over 12 months was derived that categorized patients into the following groups: (i) no clinically important depressive symptoms (at baseline, 6 and 12 months); (ii) baseline-only symptoms (at baseline but not at 6 and 12 months); (iii) new onset symptoms (not at baseline but present at either 6 or 12 months); and, (iv) persistent symptoms (at baseline and at either 6 or 12 month assessment). Primary outcomes were mean change in Older Americans Resources and Services (OARS) instrumental (IADL) and basic activities of daily living (BADL) scores (range 0-14 for each) across baseline (pre-procedure) and 6, 12, and 30 months post-procedure visits.

RESULTS

Estimates for the symptom categories were 71 % (none), 9 % (baseline only), 8 % (new onset) and 12 % (persistent). In adjusted models, patients with persistent symptoms showed a significant decrease in mean IADL and BADL scores from baseline to 6 months (-1.32 [95 % CI -1.78 to -0.86] and -0.63 [-0.97 to -0.30], respectively) and from 12 to 30 months (-0.79 [-1.27 to -0.31] and -1.00 [-1.35 to -0.65], respectively). New onset symptoms were associated with a significant decrease in mean IADL scores at 6 months and from 6 to 12 months. Patients with no depressive symptoms showed little change in scores whereas those with baseline only symptoms showed significant improvement in mean IADL at 6 months.

CONCLUSIONS

Patients with persistent depressive symptoms were at greatest risk for worse functional status 30 months following coronary interventions. Proactive screening and follow-up for depression in this population offers prognostic value and may facilitate the implementation of targeted interventions.