Toward a formalization of the process to select IMIA Yearbook best papers

Clinical Decision Support Systems and Computerized Provider Order Entry: Contributions from 2020

OBJECTIVES

To summarize research contributions published in 2020 in the field of clinical decision support systems (CDSS) and computerized provider order entry (CPOE), and select the best papers for the Decision Support section of the International Medical Informatics Association (IMIA) Yearbook 2021.

METHODS

Two bibliographic databases were searched for papers referring to clinical decision support systems. From search results, section editors established a list of candidate best papers, which were then peer-reviewed by seven external reviewers. The IMIA Yearbook editorial committee finally selected the best papers on the basis of all reviews including the section editors' evaluation.

RESULTS

A total of 1,919 articles were retrieved. 15 best paper candidates were selected, the reviews of which resulted in the selection of two best papers. One paper reports on the use of electronic health records to support a public health response to the COVID-19 pandemic in the United States. The second paper proposes a combination of CDSS and telemedicine as a technology-based intervention to improve the outcomes of depression as part of a cluster trial.

CONCLUSIONS

As shown by the number and the variety of works related to clinical decision support, research in the field is very active. This year's selection highlighted the application of CDSS to fight COVID-19 and a combined technology-based strategy to improve the treatment of depression.

Public Health and Epidemiology Informatics: Recent Research Trends

OBJECTIVES

To introduce and analyse current trends in Public Health and Epidemiology Informatics.

METHODS

PubMed search of 2020 literature on public health and epidemiology informatics was conducted and all retrieved references were reviewed by the two section editors. Then, 15 candidate best papers were selected among the 920 references. These papers were then peer-reviewed by the two section editors, two chief editors, and external reviewers, including at least two senior faculty, to allow the Editorial Committee of the 2021 International Medical Informatics Association (IMIA) Yearbook to make an informed decision regarding the selection of the best papers.

RESULTS

Among the 920 references retrieved from PubMed, four were suggested as best papers and the first three were finally selected. The fourth paper was excluded because of reproducibility issues. The first best paper is a very public health focused paper with health informatics and biostatistics methods applied to stratify patients within a cohort in order to identify those at risk of suicide; the second paper describes the use of a randomized design to test the likely impact of fear-based messages, with and without empowering self-management elements, on patient consultations or antibiotic requests for influenza-like illnesses. The third selected paper evaluates the perception among communities of routine use of Whole Genome Sequencing and Big Data technologies to capture more detailed and specific personal information.

CONCLUSIONS

The findings from the three studies suggest that using Public Health and Epidemiology Informatics methods could leverage, when combined with Deep Learning, early interventions and appropriate treatments to mitigate suicide risk. Further, they also demonstrate that well informing and empowering patients could help them to be involved more in their care process.

Electronic Patient-Reported Outcome-Based Interventions for Palliative Cancer Care: A Systematic and Mapping Review

PURPOSE

Capitalizing on the promise of patient-reported outcomes (PROs), electronic implementations of PROs (ePROs) are expected to play an important role in the development of novel digital health interventions targeting palliative cancer care. We performed a systematic and mapping review of the scientific literature on the current ePRO-based approaches used for palliative cancer care.

METHODS

Following the Preferred Reporting Items for Systematic Reviews and Meta-Analyses statement guidelines, the conducted review answered the research questions: "What are the current ePRO-based approaches for palliative cancer care; what is their contribution/value in the domain of palliative cancer care; and what are the potential gaps, challenges, and opportunities for further research?" After a screening step, the corpus of included articles indexed in PubMed or the Web of Science underwent full text review, which mapped the articles across 15 predefined axes.

RESULTS

The corpus of 24 mapped studies includes 9 study protocols, 7 technical tools/solutions, 7 pilot/feasibility/acceptability studies, and 1 evaluation study. The review of the corpus revealed (1) an archetype of ePRO-enabled interventions for palliative cancer care, which most commonly use ePROs as study end point assessment instruments rather than integral intervention components; (2) the fact that the literature has not fully embraced the modern definitions that expand the scope of palliative care; (3) the striking shortage of promising ubiquitous computing devices (eg, smart activity trackers); and (4) emerging evidence about the benefits of narrowing down the target cancer population, especially when combined with modern patient-centered intervention design methodologies.

CONCLUSION

Although research on exploiting ePROs for the development of digital palliative cancer care interventions is considerably active and demonstrates several successful cases, there is considerable room for improvement along the directions of the aforementioned findings.

Applications of Artificial Intelligence and Machine Learning in Disasters and Public Health Emergencies

Indexed literature (from 2015 to 2020) on artificial intelligence (AI) technologies and machine learning algorithms (ML) pertaining to disasters and public health emergencies were reviewed. Search strategies were developed and conducted for PubMed and Compendex. Articles that met inclusion criteria were filtered iteratively by title followed by abstract review and full text review. Articles were organized to identify novel approaches and breadth of potential AI applications. A total of 1217 articles were initially retrieved by the search. Upon relevant title review, 1003 articles remained. Following abstract screening, 667 articles remained. Full text review for relevance yielded 202 articles. Articles that met inclusion criteria totaled 56 articles. Those identifying specific roles of AI and ML (17 articles) were grouped by topics highlighting utility of AI and ML in disaster and public health emergency contexts. Development and use of AI and ML have increased dramatically over the past few years. This review discusses and highlights potential contextual applications and limitations of AI and ML in disaster and public health emergency scenarios.

Public Health and Epidemiology Informatics: Recent Research Trends Moving toward Public Health Data Science

Objectives : To introduce and summarize current research in the field of Public Health and Epidemiology Informatics.

Methods : PubMed searches of 2019 literature concerning public health and epidemiology informatics were conducted and the returned references were reviewed by the two section editors to select 14 candidate best papers. These papers were then peer-reviewed by external reviewers to allow the Editorial Committee a curated selection of the best papers.

Results : Among the 835 references retrieved from PubMed, two were finally selected as best papers. The first best paper leverages satellite images and deep learning to identify remote rural communities in low-income countries; the second paper describes the development of a worldwide human disease surveillance system based on near real-time news data from the GDELT project. Internet data and electronic health records are still widely used to detect and monitor disease activity. Identifying and targeting specific audiences for public health interventions is a growing subject of interest.

Conclusions : The ever-increasing amount of data available offers endless opportunities to develop methods and tools that could assist public health surveillance and intervention belonging to the growing field of public health Data Science. The transition from proofs of concept to real world applications and adoption by health authorities remains a difficult leap to make.

Cancer Informatics in 2019: Deep Learning Takes Center Stage

Objective : To summarize significant research contributions on cancer informatics published in 2019.

Methods : An extensive search using PubMed/Medline and manual review was conducted to identify the scientific contributions published in 2019 that address topics in cancer informatics. The selection process comprised three steps: (i) 15 candidate best papers were first selected by the two section editors, (ii) external reviewers from internationally renowned research teams reviewed each candidate best paper, and (iii) the final selection of two best papers was conducted by the editorial committee of the Yearbook.

Results : The two selected best papers demonstrate the clinical utility of deep learning in two important cancer domains: radiology and pathology.

Conclusion : Cancer informatics is a broad and vigorous subfield of biomedical informatics. Applications of new and emerging computational technologies are especially notable in 2019.

Influence of Connected Health Interventions for Adherence to Cardiovascular Disease Prevention: A Scoping Review

BACKGROUND

Recent health care developments include connected health interventions to improve chronic disease management and/or promote actions reducing aggravating risk factors for conditions such as cardiovascular diseases. Adherence is one of the main challenges for ensuring the correct use of connected health interventions over time.

OBJECTIVE

This scoping review deals with the connected health interventions used in interventional studies, describing the ways in which these interventions and their functions effectively help patients to deal with cardiovascular risk factors over time, in their own environments. The objective is to acquire knowledge and highlight current trends in this field, which is currently both productive and immature.

METHODS

A structured literature review was constructed from Medline-indexed journals in PubMed. We established inclusion criteria relating to three dimensions (cardiovascular risk factors, connected health interventions, and level of adherence). Our initial search yielded 98 articles; 78 were retained after screening on the basis of title and abstract, 49 articles underwent full-text screening, and 24 were finally retained for the analysis, according to preestablished inclusion criteria. We excluded studies of invasive interventions and studies not dealing with digital health. We extracted a description of the connected health interventions from data for the population or end users.

RESULTS

We performed a synthetic analysis of outcomes, based on the distribution of bibliometrics, and identified several connected health interventions and main characteristics affecting adherence. Our analysis focused on three types of user action: to read, to do, and to connect. Finally, we extracted current trends in characteristics: connect, adherence, and influence.

CONCLUSION

Connected health interventions for prevention are unlikely to affect outcomes significantly unless other characteristics and user preferences are considered. Future studies should aim to determine which connected health design combinations are the most effective for supporting long-term changes in behavior and for preventing cardiovascular disease risks.

Contributions from the 2019 Literature on Bioinformatics and Translational Informatics

OBJECTIVES

Summarize recent research and select the best papers published in 2019 in the field of Bioinformatics and Translational Informatics (BTI) for the corresponding section of the International Medical Informatics Association Yearbook.

METHODS

A literature review was performed for retrieving from PubMed papers indexed with keywords and free terms related to BTI. Independent review allowed the section editors to select a list of 15 candidate best papers which were subsequently peer-reviewed. A final consensus meeting gathering the whole Yearbook editorial committee was organized to finally decide on the selection of the best papers.

RESULTS

Among the 931 retrieved papers covering the various subareas of BTI, the review process selected four best papers. The first paper presents a logical modeling of cancer pathways. Using their tools, the authors are able to identify two known behaviours of tumors. The second paper describes a deep-learning approach to predicting resistance to antibiotics in Mycobacterium tuberculosis. The authors of the third paper introduce a Genomic Global Positioning System (GPS) enabling comparison of genomic data with other individuals or genomics databases while preserving privacy. The fourth paper presents a multi-omics and temporal sequence-based approach to provide a better understanding of the sequence of events leading to Alzheimer's Disease.

CONCLUSIONS

Thanks to the normalization of open data and open science practices, research in BTI continues to develop and mature. Noteworthy achievements are sophisticated applications of leading edge machine-learning methods dedicated to personalized medicine.

Contributions on Clinical Decision Support from the 2018 Literature

Objectives : To summarize recent research and select the best papers published in 2018 in the field of computerized clinical decision support for the Decision Support section of the International Medical Informatics Association (IMIA) yearbook.

Methods : A literature review was performed by searching two bibliographic databases for papers referring to clinical decision support systems (CDSSs). The aim was to identify a list of candidate best papers from the retrieved bibliographic records, which were then peer-reviewed by external reviewers. A consensus meeting of the IMIA editorial team finally selected the best papers on the basis of all reviews and the section editors' evaluation.

Results : Among 1,148 retrieved articles, 15 best paper candidates were selected, the review of which resulted in the selection of four best papers. The first paper introduces a deep learning model for estimating short-term life expectancy (>3 months) of metastatic cancer patients by analyzing free-text clinical notes in electronic medical records, while maintaining the temporal visit sequence. The second paper takes note that CDSSs become routinely integrated in health information systems and compares statistical anomaly detection models to identify CDSS malfunctions which, if remain unnoticed, may have a negative impact on care delivery. The third paper fairly reports on lessons learnt from the development of an oncology CDSS using artificial intelligence techniques and from its assessment in a large US cancer center. The fourth paper implements a preference learning methodology for detecting inconsistencies in clinical practice guidelines and illustrates the applicability of the proposed methodology to antibiotherapy.

Conclusions : Three of the four best papers rely on data-driven methods, and one builds on a knowledge-based approach. While there is currently a trend for data-driven decision support, the promising results of such approaches still need to be confirmed by the adoption of these systems and their routine use.

Cancer Informatics in 2018: The Mysteries of the Cancer Genome Continue to Unravel, Deep Learning Approaches the Clinic, and Passive Data Collection Demonstrates Utility

Objective : To summarize significant research contributions on cancer informatics published in 2018.

Methods : An extensive search using PubMed/Medline, Google Scholar, and manual review was conducted to identify the scientific contributions published in 2018 that address topics in cancer informatics. The selection process comprised three steps: (i) 15 candidate best papers were first selected by the two section editors, (ii) external reviewers from internationally renowned research teams reviewed each candidate best paper, and (iii) the final selection of four best papers was conducted by the editorial board of the International Medical Informatics Association (IMIA) Yearbook.

Results : The four selected best papers present studies addressing many facets of cancer informatics, with immediate applicability in the translational and clinical domains.

Conclusion : Cancer informatics is a broad and vigorous subfield of biomedical informatics. Progress in cancer genomics, artificial intelligence, and passively collected data is especially notable in 2018.

Advancing Artificial Intelligence in Sensors, Signals, and Imaging Informatics

Objective : To identify research works that exemplify recent developments in the field of sensors, signals, and imaging informatics.

Method : A broad literature search was conducted using PubMed and Web of Science, supplemented with individual papers that were nominated by section editors. A predefined query made from a combination of Medical Subject Heading (MeSH) terms and keywords were used to search both sources. Section editors then filtered the entire set of retrieved papers with each paper having been reviewed by two section editors. Papers were assessed on a three-point Likert scale by two section editors, rated from 0 (do not include) to 2 (should be included). Only papers with a combined score of 2 or above were considered.

Results : A search for papers was executed at the start of January 2019, resulting in a combined set of 1,459 records published in 2018 in 119 unique journals. Section editors jointly filtered the list of candidates down to 14 nominations. The 14 candidate best papers were then ranked by a group of eight external reviewers. Four papers, representing different international groups and journals, were selected as the best papers by consensus of the International Medical Informatics Association (IMIA) Yearbook editorial board.

Conclusions : The fields of sensors, signals, and imaging informatics have rapidly evolved with the application of novel artificial intelligence/machine learning techniques. Studies have been able to discover hidden patterns and integrate different types of data towards improving diagnostic accuracy and patient outcomes. However, the quality of papers varied widely without clear reporting standards for these types of models. Nevertheless, a number of papers have demonstrated useful techniques to improve the generalizability, interpretability, and reproducibility of increasingly sophisticated models.

Artificial Intelligence in Health in 2018: New Opportunities, Challenges, and Practical Implications

Objective : To summarize significant research contributions to the field of artificial intelligence (AI) in health in 2018.

Methods : Ovid MEDLINE ^® and Web of Science ^® databases were searched to identify original research articles that were published in the English language during 2018 and presented advances in the science of AI applied in health. Queries employed Medical Subject Heading (MeSH ^® ) terms and keywords representing AI methodologies and limited results to health applications. Section editors selected 15 best paper candidates that underwent peer review by internationally renowned domain experts. Final best papers were selected by the editorial board of the 2018 International Medical Informatics Association (IMIA) Yearbook.

Results : Database searches returned 1,480 unique publications. Best papers employed innovative AI techniques that incorporated domain knowledge or explored approaches to support distributed or federated learning. All top-ranked papers incorporated novel approaches to advance the science of AI in health and included rigorous evaluations of their methodologies.

Conclusions : Performance of state-of-the-art AI machine learning algorithms can be enhanced by approaches that employ a multidisciplinary biomedical informatics pipeline to incorporate domain knowledge and can overcome challenges such as sparse, missing, or inconsistent data. Innovative training heuristics and encryption techniques may support distributed learning with preservation of privacy.

Contributions from the 2018 Literature on Bioinformatics and Translational Informatics

Objectives : To summarize recent research and select the best papers published in 2018 in the field of Bioinformatics and Translational Informatics (BTI) for the corresponding section of the International Medical Informatics Association (IMIA) Yearbook.

Methods : A literature review was performed for retrieving from PubMed papers indexed with keywords and free terms related to BTI. Independent review allowed the two section editors to select a list of 14 candidate best papers which were subsequently peer-reviewed. A final consensus meeting gathering the whole IMIA Yearbook editorial committee was organized to finally decide on the selection of the best papers.

Results : Among the 636 retrieved papers published in 2018 in the various subareas of BTI, the review process selected four best papers. The first paper presents a computational method to identify molecular markers for targeted treatment of acute myeloid leukemia using multi-omics data (genome-wide gene expression profiles) and in vitro sensitivity to 160 chemotherapy drugs. The second paper describes a deep neural network approach to predict the survival of patients suffering from glioma on the basis of digitalised pathology images and genomics biomarkers. The authors of the third paper adopt a pan-cancer approach to take benefit of multi-omics data for drug repurposing. The fourth paper presents a graph-based semi-supervised method to accurate phenotype classification applied to ovarian cancer.

Conclusions : Thanks to the normalization of open data and open science practices, research in BTI continues to develop and mature. Noteworthy achievements are sophisticated applications of leading edge machine-learning methods dedicated to personalized medicine.

Artificial Intelligence for Surveillance in Public Health

OBJECTIVES

To introduce and summarize current research in the field of Public Health and Epidemiology Informatics.

METHODS

The 2018 literature concerning public health and epidemiology informatics was searched in PubMed and Web of Science, and the returned references were reviewed by the two section editors to select 15 candidate best papers. These papers were then peer-reviewed by external reviewers to give the editorial team an enlightened selection of the best papers.

RESULTS

Among the 805 references retrieved from PubMed and Web of Science, three were finally selected as best papers. All three papers are about surveillance using digital tools. One study is about the surveillance of flu, another about emerging animal infectious diseases and the last one is about foodborne illness. The sources of information are Google news, Twitter, and Yelp restaurant reviews. Machine learning approaches are most often used to detect signals.

CONCLUSIONS

Surveillance is a central topic in public health informatics with the growing use of machine learning approaches in regards of the size and complexity of data. The evaluation of the approaches developed remains a serious challenge.

Computational Advances in Drug Safety: Systematic and Mapping Review of Knowledge Engineering Based Approaches

Drug Safety (DS) is a domain with significant public health and social impact. Knowledge Engineering (KE) is the Computer Science discipline elaborating on methods and tools for developing “knowledge-intensive” systems, depending on a conceptual “knowledge” schema and some kind of “reasoning” process. The present systematic and mapping review aims to investigate KE-based approaches employed for DS and highlight the introduced added value as well as trends and possible gaps in the domain. Journal articles published between 2006 and 2017 were retrieved from PubMed/MEDLINE and Web of Science® (873 in total) and filtered based on a comprehensive set of inclusion/exclusion criteria. The 80 finally selected articles were reviewed on full-text, while the mapping process relied on a set of concrete criteria (concerning specific KE and DS core activities, special DS topics, employed data sources, reference ontologies/terminologies, and computational methods, etc.). The analysis results are publicly available as online interactive analytics graphs. The review clearly depicted increased use of KE approaches for DS. The collected data illustrate the use of KE for various DS aspects, such as Adverse Drug Event (ADE) information collection, detection, and assessment. Moreover, the quantified analysis of using KE for the respective DS core activities highlighted room for intensifying research on KE for ADE monitoring, prevention and reporting. Finally, the assessed use of the various data sources for DS special topics demonstrated extensive use of dominant data sources for DS surveillance, i.e., Spontaneous Reporting Systems, but also increasing interest in the use of emerging data sources, e.g., observational healthcare databases, biochemical/genetic databases, and social media. Various exemplar applications were identified with promising results, e.g., improvement in Adverse Drug Reaction (ADR) prediction, detection of drug interactions, and novel ADE profiles related with specific mechanisms of action, etc. Nevertheless, since the reviewed studies mostly concerned proof-of-concept implementations, more intense research is required to increase the maturity level that is necessary for KE approaches to reach routine DS practice. In conclusion, we argue that efficiently addressing DS data analytics and management challenges requires the introduction of high-throughput KE-based methods for effective knowledge discovery and management, resulting ultimately, in the establishment of a continuous learning DS system.

On the Way to Close the Loop in Information Logistics: Data from the Patient - Value for the Patient

OBJECTIVE

 To summarize recent research and to propose a selection of best papers published in 2017 in the field of Clinical Information Systems (CIS).

METHOD

 Each year a systematic process is carried out to retrieve articles and to select a set of best papers for the CIS section of the International Medical Informatics Association (IMIA) Yearbook of Medical Informatics. The query aiming at identifying relevant publications in the field of CIS was refined by the section editors during the last years. For three years now, the query is stable. It comprises search terms from the Medical Subject Headings (MeSH) thesaurus as well as additional free text search terms from PubMed and Web of Science^®. The retrieved articles were categorized in a multi-pass review carried out by the two section editors. The final selection of candidate papers was then peer-reviewed by Yearbook editors and external reviewers. Based on the review results, the best papers were then selected by the IMIA Yearbook editorial board. Text mining, and term co-occurrence mapping techniques were used to get an overview on the content of the retrieved articles.

RESULTS

 The query was carried out in mid-January 2018, yielding a consolidated result set of 2,255 articles which had been published in 939 different journals. Out of them, 15 papers were nominated as candidate best papers and four of them were finally selected as best papers in the CIS section. Again, the content analysis of the articles revealed the broad spectrum of topics which is covered by CIS research.

CONCLUSIONS

 Modern clinical information systems serve as backbone for a very complex, trans-institutional information logistics process. Data that is produced by, documented in, shared via, organized in, presented by, and stored within clinical information systems is more and more reused for multiple purposes. We found a lot of examples showing the benefits of such data reuse with various novel approaches implemented to tackle the challenges of this process. We also found that the patient moves in the focus of interest of CIS research. So the loop of information logistics begins to close: data from the patients is used to produce value for the patients.

Cancer Informatics in 2017: A New Beginning and a Bright Future

Objective:  To summarize significant research contributions on cancer informatics published in 2017.

Methods:  An extensive search using PubMed/Medline, Google Scholar, and manual review was conducted to identify the scientific contributions published in 2017 that address topics in cancer informatics. The selection process comprised three steps: (i) 15 candidate best papers were first selected by the two section editors, (ii) external reviewers from internationally renowned research teams reviewed each candidate best paper, and (iii) the final selection of three best papers was conducted by the editorial board of the Yearbook.

Results:  Results: The three selected best papers present studies addressing many facets of cancer informatics, with immediate applicability in the research and clinical domains.

Conclusion: Cancer informatics is a broad and vigorous subfield of biomedical informatics. Strides in knowledge management, crowdsourcing, and visualization are especially notable in 2017.

Artificial Intelligence in Public Health and Epidemiology

Objectives:  To introduce and summarize current research in the field of Public Health and Epidemiology Informatics.

Methods:  The 2017 literature concerning public health and epidemiology informatics was searched in PubMed and Web of Science, and the returned references were reviewed by the two section editors to select 14 candidate best papers. These papers were then peer-reviewed by external reviewers to provide the editorial team with an enlightened vision to select the best papers.

Results:  Among the 843 references retrieved from PubMed and Web of Science, two were finally selected as best papers. The first one analyzes the relationship between the disease, social/mass media, and public emotions to understand public overreaction (leading to a noticeable reduction of social and economic activities) in the context of a nation-wide outbreak of Middle East Respiratory Syndrome (MERS) in Korea in 2015. The second paper concerns a new methodology to de-identify patient notes in electronic health records based on artificial neural networks that outperformed existing methods.

Conclusions:  Surveillance is still a productive topic in public health informatics but other very important topics in Public Health are appearing. For example, the use of artificial intelligence approaches is increasing.

Contributions from the 2017 Literature on Clinical Decision Support

Objectives:  To summarize recent research and select the best papers published in 2017 in the field of computerized clinical decision support for the Decision Support section of the International Medical Informatics Association (IMIA) yearbook.

Methods:  A literature review was performed by searching two bibliographic databases for papers referring to clinical decision support systems (CDSSs). The aim was to identify a list of candidate best papers from the retrieved bibliographic records, which were then peer-reviewed by external reviewers. A consensus meeting of the IMIA editorial team finally selected the best papers on the basis of all reviews and the section editors' evaluation.

Results:  Among the 1,194 retrieved papers, the entire review process resulted in the selection of four best papers. The first paper studies the impact of recency and of longitudinal extent of electronic health record (EHR) datasets used to train a data-driven predictive model of inpatient admission orders. The second paper presents a decision support tool for surgical team selection, relying on the history of surgical team members and the specific characteristics of the patient. The third paper compares three commercial drug-drug interaction knowledge bases, particularly against a reference list of highly-significant known interactions. The fourth paper focuses on supporting the diagnosis of postoperative delirium using an adaptation of the “anchor and learn” framework, which was applied in unstructured texts contained in EHRs.

Conclusions:  The conducted review illustrated also this year that research in the field of CDSS is very active. Of note is the increase in publications concerning data-driven CDSSs, as revealed by the review process and also reflected by the four papers that have been selected. This trend is in line with the current attention that “Big Data” and data-driven artificial intelligence have gained in the domain of health and CDSSs in particular.

Humanitarian health computing using artificial intelligence and social media: A narrative literature review

INTRODUCTION

According to the World Health Organization (WHO), over 130 million people are in constant need of humanitarian assistance due to natural disasters, disease outbreaks, and conflicts, among other factors. These health crises can compromise the resilience of healthcare systems, which are essential for achieving the health objectives of the sustainable development goals (SDGs) of the United Nations (UN). During a humanitarian health crisis, rapid and informed decision making is required. This is often challenging due to information scarcity, limited resources, and strict time constraints. Moreover, the traditional approach to digital health development, which involves a substantial requirement analysis, a feasibility study, and deployment of technology, is ill-suited for many crisis contexts. The emergence of Web 2.0 technologies and social media platforms in the past decade, such as Twitter, has created a new paradigm of massive information and misinformation, in which new technologies need to be developed to aid rapid decision making during humanitarian health crises.

OBJECTIVE

Humanitarian health crises increasingly require the analysis of massive amounts of information produced by different sources, such as social media content, and, hence, they are a prime case for the use of artificial intelligence (AI) techniques to help identify relevant information and make it actionable. To identify challenges and opportunities for using AI in humanitarian health crises, we reviewed the literature on the use of AI techniques to process social media.

METHODOLOGY

We performed a narrative literature review aimed at identifying examples of the use of AI in humanitarian health crises. Our search strategy was designed to get a broad overview of the different applications of AI in a humanitarian health crisis and their challenges. A total of 1459 articles were screened, and 24 articles were included in the final analysis.

RESULTS

Successful case studies of AI applications in a humanitarian health crisis have been reported, such as for outbreak detection. A commonly shared concern in the reviewed literature is the technical challenge of analyzing large amounts of data in real time. Data interoperability, which is essential to data sharing, is also a barrier with regard to the integration of online and traditional data sources. Human and organizational aspects that might be key factors for the adoption of AI and social media remain understudied. There is also a publication bias toward high-income countries, as we identified few examples in low-income countries. Further, we did not identify any examples of certain types of major crisis, such armed conflicts, in which misinformation might be more common.

CONCLUSIONS

The feasibility of using AI to extract valuable information during a humanitarian health crisis is proven in many cases. There is a lack of research on how to integrate the use of AI into the work-flow and large-scale deployments of humanitarian aid during a health crisis.

Trends and Progress in Human Factors and Organizational Issues in 2016: Learning from Experience

Objective: To summarize significant research contributions on human factors and organizational issues in medical informatics published in 2016. Methods: An extensive search using PubMed/Medline and Web of Science® was conducted to identify the scientific contributions published in 2016 that address human factors and organizational issues in medical informatics. The selection process comprised three steps: (i) 15 candidate best papers were first selected by the two section editors, (ii) external reviewers from internationally renowned research teams reviewed each candidate best paper, and (iii) the final selection of five best papers was conducted by the editorial board of the Yearbook. Results: The five selected best papers present studies with rigorous methods, properly designed and described and are, therefore, efficiently reusable for other researches. Conclusion: Human factors and ergonomics- based interventions must be tailored to the context, but meaningful ways must be simultaneously found to generate a stronger evidence base for research and to provide efficient, easy to implement, and useful methods.

Knowledge Representation and Management, It's Time to Integrate!

Objectives: To select, present, and summarize the best papers published in 2016 in the field of Knowledge Representation and Management (KRM). Methods: A comprehensive and standardized review of the medical informatics literature was performed based on a PubMed query. Results: Among the 1,421 retrieved papers, the review process resulted in the selection of four best papers focused on the integration of heterogeneous data via the development and the alignment of terminological resources. In the first article, the authors provide a curated and standardized version of the publicly available US FDA Adverse Event Reporting System. Such a resource will improve the quality of the underlying data, and enable standardized analyses using common vocabularies. The second article describes a project developed in order to facilitate heterogeneous data integration in the i2b2 framework. The originality is to allow users integrate the data described in different terminologies and to build a new repository, with a unique model able to support the representation of the various data. The third paper is dedicated to model the association between multiple phenotypic traits described within the Human Phenotype Ontology (HPO) and the corresponding genotype in the specific context of rare diseases (rare variants). Finally, the fourth paper presents solutions to annotation-ontology mapping in genome-scale data. Of particular interest in this work is the Experimental Factor Ontology (EFO) and its generic association model, the Ontology of Biomedical AssociatioN (OBAN). Conclusion: Ontologies have started to show their efficiency to integrate medical data for various tasks in medical informatics: electronic health records data management, clinical research, and knowledge-based systems development.

Clinical Information Systems as the Backbone of a Complex Information Logistics Process: Findings from the Clinical Information Systems Perspective for 2016

Objective: To summarize recent research and to propose a selection of best papers published in 2016 in the field of Clinical Information Systems (CIS). Method: The query used to retrieve the articles for the CIS section of the 2016 edition of the IMIA Yearbook of Medical Informatics was reused. It again aimed at identifying relevant publications in the field of CIS from PubMed and Web of Science and comprised search terms from the Medical Subject Headings (MeSH) catalog as well as additional free text search terms. The retrieved articles were categorized in a multi-pass review carried out by the two section editors. The final selection of candidate papers was then peer-reviewed by Yearbook editors and external reviewers. Based on the review results, the best papers were then chosen at the selection meeting with the IMIA Yearbook editorial board. Text mining, term co-occurrence mapping, and topic modelling techniques were used to get an overview on the content of the retrieved articles. Results: The query was carried out in mid-January 2017, yielding a consolidated result set of 2,190 articles published in 921 different journals. Out of them, 14 papers were nominated as candidate best papers and three of them were finally selected as the best papers of the CIS field. The content analysis of the articles revealed the broad spectrum of topics covered by CIS research. Conclusions: The CIS field is multi-dimensional and complex. It is hard to draw a well-defined outline between CIS and other domains or other sections of the IMIA Yearbook. The trends observed in the previous years are progressing. Clinical information systems are more than just sociotechnical systems for data collection, processing, exchange, presentation, and archiving. They are the backbone of a complex, trans-institutional information logistics process.

Secondary Use of Patient Data: Review of the Literature Published in 2016

Objectives: To summarize recent research and emerging trends in the area of secondary use of healthcare data, and to present the best papers published in this field, selected to appear in the 2017 edition of the IMIA Yearbook. Methods: A literature review of articles published in 2016 and related to secondary use of healthcare data was performed using two bibliographic databases. From this search, 941 papers were identified. The section editors independently reviewed the papers for relevancy and impact, resulting in a consensus list of 14 candidate best papers. External reviewers examined each of the candidate best papers and the final selection was made by the editorial board of the Yearbook. Results: From the 941 retrieved papers, the selection process resulted in four best papers. These papers discuss data quality concerns, issues in preserving privacy of patients in shared datasets, and methods of decision support when consuming large amounts of raw electronic health record (EHR) data. Conclusion: In 2016, a significant effort was put into the development of new systems which aim to avoid significant human understanding and pre-processing of healthcare data, though this is still only an emerging area of research. The value of temporal relationships between data received significant study, as did effective information sharing while preserving patient privacy.

Public Health and Epidemiology Informatics

Objectives: To summarize current research in the field of Public Health and Epidemiology Informatics. Methods: The complete 2016 literature concerning public health and epidemiology informatics has been searched in PubMed and Web of Science, and the returned references were reviewed by the two section editors to select 14 candidate best papers. These papers were then peer-reviewed by external reviewers to allow the editorial team an enlightened selection of the best papers. Results: Among the 829 references retrieved from PubMed and Web of Science, three were finally selected as best papers. The first one compares Google, Twitter, and Wikipedia as tools for Influenza surveillance. The second paper presents a Geographic Knowledge-Based Model for mapping suitable areas for Rift Valley fever transmission in Eastern Africa. The last paper evaluates the factors associated with the visit of Facebook pages devoted to Public Health Communication. Conclusions: Surveillance is still a productive topic in public health informatics but other very important topics in public health are appearing.

Public Health, Population Health, and Epidemiology Informatics: Recent Research and Trends in the United States

Objectives: To survey advances in public and population health and epidemiology informatics over the past 18 months. Methods: We conducted a review of English-language research works conducted in the domain of public and population health informatics and published in MEDLINE or Web of Science between January 2015 and June 2016 where information technology or informatics was a primary subject or main component of the study methodology. Selected articles were presented using a thematic analysis based on the 2011 American Medical Informatics Association (AMIA) Public Health Informatics Agenda tracks as a typology. Results: Results are given within the context developed by Dixon et al., (2015) and key themes from the 2011 AMIA Public Health Informatics Agenda. Advances are presented within a socio-technical infrastructure undergirded by a trained, competent public health workforce, systems development to meet the business needs of the practice field, and research that evaluates whether those needs are adequately met. The ability to support and grow the infrastructure depends on financial sustainability. Conclusions: The fields of public health and population health informatics continue to grow, with the most notable developments focused on surveillance, workforce development, and linking to or providing clinical services, which encompassed population health informatics advances. Very few advances addressed the need to improve communication, coordination, and consistency with the field of informatics itself, as identified in the AMIA agenda. This will likely result in the persistence of the silos of public health information systems that currently exist. Future research activities need to aim toward a holistic approach of informatics across the enterprise.

Contributions from the 2016 Literature on Clinical Decision Support

Objectives: To summarize recent research and select the best papers published in 2016 in the field of computerized clinical decision support for the Decision Support section of the IMIA yearbook. Methods: A literature review was performed by searching two bibliographic databases for papers related to clinical decision support systems (CDSSs). The aim was to identify a list of candidate best papers from the retrieved papers that were then peer-reviewed by external reviewers. A consensus meeting of the IMIA editorial team finally selected the best papers on the basis of all reviews and section editor evaluation. Results: Among the 1,145 retrieved papers, the entire review process resulted in the selection of four best papers. The first paper describes machine learning models used to predict breast cancer multidisciplinary team decisions and compares them with two predictors based on guideline knowledge. The second paper introduces a linked-data approach for publication, discovery, and interoperability of CDSSs. The third paper assessed the variation in high-priority drug-drug interaction (DDI) alerts across 14 Electronic Health Record systems, operating in different institutions in the US. The fourth paper proposes a generic framework for modeling multiple concurrent guidelines and detecting their recommendation interactions using semantic web technologies. Conclusions: The process of identifying and selecting best papers in the domain of CDSSs demonstrated that the research in this field is very active concerning diverse dimensions, such as the types of CDSSs, e.g. guideline-based, machine-learning-based, knowledge-fusion-based, etc., and addresses challenging areas, such as the concurrent application of multiple guidelines for comorbid patients, the resolution of interoperability issues, and the evaluation of CDSSs. Nevertheless, this process also showed that CDSSs are not yet fully part of the digitalized healthcare ecosystem. Many challenges remain to be faced with regard to the evidence of their output, the dissemination of their technologies, as well as their adoption for better and safer healthcare delivery.

Bioinformatics Methods and Tools to Advance Clinical Care. Findings from the Yearbook 2015 Section on Bioinformatics and Translational Informatics

OBJECTIVES

To summarize excellent current research in the field of Bioinformatics and Translational Informatics with application in the health domain and clinical care.

METHOD

We provide a synopsis of the articles selected for the IMIA Yearbook 2015, from which we attempt to derive a synthetic overview of current and future activities in the field. As last year, a first step of selection was performed by querying MEDLINE with a list of MeSH descriptors completed by a list of terms adapted to the section. Each section editor has evaluated separately the set of 1,594 articles and the evaluation results were merged for retaining 15 articles for peer-review.

RESULTS

The selection and evaluation process of this Yearbook's section on Bioinformatics and Translational Informatics yielded four excellent articles regarding data management and genome medicine that are mainly tool-based papers. In the first article, the authors present PPISURV a tool for uncovering the role of specific genes in cancer survival outcome. The second article describes the classifier PredictSNP which combines six performing tools for predicting disease-related mutations. In the third article, by presenting a high-coverage map of the human proteome using high resolution mass spectrometry, the authors highlight the need for using mass spectrometry to complement genome annotation. The fourth article is also related to patient survival and decision support. The authors present datamining methods of large-scale datasets of past transplants. The objective is to identify chances of survival.

CONCLUSIONS

The current research activities still attest the continuous convergence of Bioinformatics and Medical Informatics, with a focus this year on dedicated tools and methods to advance clinical care. Indeed, there is a need for powerful tools for managing and interpreting complex, large-scale genomic and biological datasets, but also a need for user-friendly tools developed for the clinicians in their daily practice. All the recent research and development efforts contribute to the challenge of impacting clinically the obtained results towards a personalized medicine.

Clinical Natural Language Processing in 2014: Foundational Methods Supporting Efficient Healthcare

OBJECTIVE

To summarize recent research and present a selection of the best papers published in 2014 in the field of clinical Natural Language Processing (NLP).

METHOD

A systematic review of the literature was performed by the two section editors of the IMIA Yearbook NLP section by searching bibliographic databases with a focus on NLP efforts applied to clinical texts or aimed at a clinical outcome. A shortlist of candidate best papers was first selected by the section editors before being peer-reviewed by independent external reviewers.

RESULTS

The clinical NLP best paper selection shows that the field is tackling text analysis methods of increasing depth. The full review process highlighted five papers addressing foundational methods in clinical NLP using clinically relevant texts from online forums or encyclopedias, clinical texts from Electronic Health Records, and included studies specifically aiming at a practical clinical outcome. The increased access to clinical data that was made possible with the recent progress of de-identification paved the way for the scientific community to address complex NLP problems such as word sense disambiguation, negation, temporal analysis and specific information nugget extraction. These advances in turn allowed for efficient application of NLP to clinical problems such as cancer patient triage. Another line of research investigates online clinically relevant texts and brings interesting insight on communication strategies to convey health-related information.

CONCLUSIONS

The field of clinical NLP is thriving through the contributions of both NLP researchers and healthcare professionals interested in applying NLP techniques for concrete healthcare purposes. Clinical NLP is becoming mature for practical applications with a significant clinical impact.

Human Factors and Ergonomics in the Design of Health Information Technology: Trends and Progress in 2014

OBJECTIVE

To summarize significant contributions to the research on human factors and organizational issues in medical informatics.

METHODS

An extensive search using PubMed/Medline and Web of Science® was conducted to identify the scientific contributions, published in 2014, to human factors and organizational issues in medical informatics, with a focus on health information technology (HIT) usability. The selection process comprised three steps: (i) 15 candidate best papers were selected by the two section editors, (ii) external reviewers from a pool of international experts reviewed each candidate best paper, and (iii) the final selection of three best papers was made by the editorial board of the IMIA Yearbook.

RESULTS

Noteworthy papers published in 2014 describe an efficient, easy to implement, and useful process for detecting and mitigating human factors and ergonomics (HFE) issues of HIT. They contribute to promote the HFE approach with interventions based on rigorous and well-conducted methods when designing and implementing HIT.

CONCLUSION

The application of HFE in the design and implementation of HIT remains limited, and the impact of incorporating HFE principles on patient safety is understudied. Future works should be conducted to advance this field of research, so that the safety and quality of patient care are not compromised by the increasing adoption of HIT.

Computerized Clinical Decision Support: Contributions from 2015

OBJECTIVE

To summarize recent research and select the best papers published in 2015 in the field of computerized clinical decision support for the Decision Support section of the IMIA yearbook.

METHOD

A literature review was performed by searching two bibliographic databases for papers related to clinical decision support systems (CDSSs) and computerized provider order entry (CPOE) systems. The aim was to identify a list of candidate best papers from the retrieved papers that were then peer-reviewed by external reviewers. A consensus meeting between the two section editors and the IMIA editorial team was finally conducted to conclude in the best paper selection.

RESULTS

Among the 974 retrieved papers, the entire review process resulted in the selection of four best papers. One paper reports on a CDSS routinely applied in pediatrics for more than 10 years, relying on adaptations of the Arden Syntax. Another paper assessed the acceptability and feasibility of an important CPOE evaluation tool in hospitals outside the US where it was developed. The third paper is a systematic, qualitative review, concerning usability flaws of medication-related alerting functions, providing an important evidence-based, methodological contribution in the domain of CDSS design and development in general. Lastly, the fourth paper describes a study quantifying the effect of a complex, continuous-care, guideline-based CDSS on the correctness and completeness of clinicians' decisions.

CONCLUSIONS

While there are notable examples of routinely used decision support systems, this 2015 review on CDSSs and CPOE systems still shows that, despite methodological contributions, theoretical frameworks, and prototype developments, these technologies are not yet widely spread (at least with their full functionalities) in routine clinical practice. Further research, testing, evaluation, and training are still needed for these tools to be adopted in clinical practice and, ultimately, illustrate the benefits that they promise.

Efficient Results in Semantic Interoperability for Health Care. Findings from the Section on Knowledge Representation and Management

OBJECTIVES

To summarize excellent current research in the field of Knowledge Representation and Management (KRM) within the health and medical care domain.

METHOD

We provide a synopsis of the 2016 IMIA selected articles as well as a related synthetic overview of the current and future field activities. A first step of the selection was performed through MEDLINE querying with a list of MeSH descriptors completed by a list of terms adapted to the KRM section. The second step of the selection was completed by the two section editors who separately evaluated the set of 1,432 articles. The third step of the selection consisted of a collective work that merged the evaluation results to retain 15 articles for peer-review.

RESULTS

The selection and evaluation process of this Yearbook's section on Knowledge Representation and Management has yielded four excellent and interesting articles regarding semantic interoperability for health care by gathering heterogeneous sources (knowledge and data) and auditing ontologies. In the first article, the authors present a solution based on standards and Semantic Web technologies to access distributed and heterogeneous datasets in the domain of breast cancer clinical trials. The second article describes a knowledge-based recommendation system that relies on ontologies and Semantic Web rules in the context of chronic diseases dietary. The third article is related to concept-recognition and text-mining to derive common human diseases model and a phenotypic network of common diseases. In the fourth article, the authors highlight the need for auditing the SNOMED CT. They propose to use a crowdbased method for ontology engineering.

CONCLUSIONS

The current research activities further illustrate the continuous convergence of Knowledge Representation and Medical Informatics, with a focus this year on dedicated tools and methods to advance clinical care by proposing solutions to cope with the problem of semantic interoperability. Indeed, there is a need for powerful tools able to manage and interpret complex, large-scale and distributed datasets and knowledge bases, but also a need for user-friendly tools developed for the clinicians in their daily practice.

Some Innovative Approaches for Public Health and Epidemiology Informatics

OBJECTIVES

Summarize excellent current research published in 2015 in the field of Public Health and Epidemiology Informatics.

METHODS

The complete 2015 literature concerning public health and epidemiology informatics has been searched in PubMed and Web of Science, and the returned references were reviewed by the two section editors to select 14 candidate best papers. These papers were then peer-reviewed by external reviewers to allow the editorial team an enlightened selection of the best papers.

RESULTS

Among the 1,272 references retrieved from PubMed and Web of Science, three were finally selected as best papers. The first one presents a language agnostic approach for epidemic event detection in news articles. The second paper describes a system using big health data gathered by a statewide system to forecast emergency department visits. The last paper proposes a rather original approach that uses machine learning to solve the old issue of outbreak detection and prediction.

CONCLUSIONS

The increasing availability of data, now directly from health systems, will probably lead to a boom in public health surveillance systems and in large-scale epidemiologic studies.

Findings from the Section on Bioinformatics and Translational Informatics

OBJECTIVES

To summarize excellent current research and propose a selection of best papers published in 2015 in the field of Bioinformatics and Translational Informatics with application in the health domain and clinical care.

METHOD

We provide a synopsis of the articles selected for the IMIA Yearbook 2016, from which we attempt to derive a synthetic overview of current and future activities in the field. As last year, a first step of selection was performed by querying MEDLINE with a list of MeSH descriptors completed by a list of terms adapted to the section. Each section editor has evaluated separately the set of 1,566 articles and the evaluation results were merged for retaining 14 articles for peer-review.

RESULTS

The selection and evaluation process of this Yearbook's section on Bioinformatics and Translational Informatics yielded four excellent articles focusing this year on data management of large-scale datasets and genomic medicine that are mainly new method-based papers. Three articles explore the high potential of the re-analysis of previously collected data, here from The Cancer Genome Atlas project (TCGA) and one article presents an original analysis of genomic data from sub-Saharan Africa populations.

CONCLUSIONS

The current research activities in Bioinformatics and Translational Informatics with application in the health domain continues to explore new algorithms and statistical models to manage and interpret large-scale genomic datasets. From population wide genome sequencing for cataloging genomic variants to the comprehension of functional impact on pathways and molecular interactions regarding a given pathology, making sense of large genomic data requires a necessary effort to address the issue of clinical translation for precise diagnostic and personalized medicine.

New Problems - New Solutions: A Never Ending Story. Findings from the Clinical Information Systems Perspective for 2015

OBJECTIVE

To summarize recent research and to propose a selection of best papers published in 2015 in the field of Clinical Information Systems (CIS).

METHOD

The query which had been used last year to retrieve articles for the CIS section of the IMIA Yearbook of Medical Informatics 2015 was refined. It again aimed at identifying relevant publications in the field of CIS and comprised search terms from the Medical Subject Headings (MeSH) catalog as well as additional free text search terms from PubMed and Web of Science. The retrieved articles were categorized in a multi-pass review carried out separately by the two section editors. The final selection of 15 candidate papers was then peer-reviewed by Yearbook editors and external reviewers. Based on the review results the four best papers were then selected at the best papers selection meeting with the IMIA Yearbook editorial board. To get an overview on the content of the retrieved articles we applied text mining and term co-occurrence mapping techniques.

RESULTS

The query was carried out in mid-January 2016, yielding a combined result set of 1851 articles which were published in 790 different journals. The most relevant terms from abstracts and titles of these articles were assigned to six different clusters. A majority of articles dealt with two thematic blocks, problems and solutions in the CIS field. The majority of the 2016 CIS candidate papers and all four best papers could be assigned to these two thematic blocks.

CONCLUSIONS

We identified two main tracks among the CIS candidate and best papers as well as in CIS research activities in general: problems and solutions. A never ending cycle of continuous improvement.

Findings from the Clinical Information Systems Perspective

OBJECTIVE

To summarize recent research and to propose a selection of best papers published in 2014 in the field of Clinical Information Systems (CIS).

METHOD

A query with search terms from the Medical Subject Headings (MeSH) catalog as well as additional free text search terms was designed to identify relevant publications in the field of clinical information systems from PubMed and Web of Science®. The retrieved articles were then categorized in a multi-pass review carried out separately by the section editors. The final selection of 15 candidate papers was then peerreviewed by Yearbook editors and external reviewers. Based on the review results the four best papers were then selected at the best papers selection meeting with the IMIA Yearbook editorial board.

RESULTS

The query was carried out in mid-January 2015, yielding a combined result set of 1525 articles which were published in 722 different journals. Among these articles two main thematic sections were identified: i) Interoperability from a syntactical and semantic point of view as well as from a longterm preservation and organizational/legal point of view and ii) secondary use of existing health data in all its shades. Here, patient safety was a major scope of application.

CONCLUSIONS

CIS have become mature over the last years. The focus has now moved beyond data acquisition for just supporting the local care workflows. Actual research efforts in the CIS domain comprise the breakdown of information silos, the reduction of barriers between different systems of different care providers and secondary use of accumulated health data for multiple purposes.

Computerized Clinical Decision Support: Contributions from 2014

OBJECTIVE

To summarize recent research and propose a selection of best papers published in 2014 in the field of computerized clinical decision support for the Decision Support section of the IMIA yearbook.

METHOD

A literature review was performed by searching two bibliographic databases for papers related to clinical decision support systems (CDSSs) and computerized provider order entry systems in order to select a list of candidate best papers to be then peer-reviewed by external reviewers. A consensus meeting between the two section editors and the editorial team was finally organized to conclude on the selection of best papers.

RESULTS

Among the 1,254 returned papers published in 2014, the full review process selected four best papers. The first one is an experimental contribution to a better understanding of unintended uses of CDSSs. The second paper describes the effective use of previously collected data to tailor and adapt a CDSS. The third paper presents an innovative application that uses pharmacogenomic information to support personalized medicine. The fourth paper reports on the long-term effect of the routine use of a CDSS for antibiotic therapy.

CONCLUSIONS

As health information technologies spread more and more meaningfully, CDSSs are improving to answer users' needs more accurately. The exploitation of previously collected data and the use of genomic data for decision support has started to materialize. However, more work is still needed to address issues related to the correct usage of such technologies, and to assess their effective impact in the long term.

Public Health and Epidemiology Informatics: Recent Research and Trends in the United States

OBJECTIVES

To survey advances in public health and epidemiology informatics over the past three years.

METHODS

We conducted a review of English-language research works conducted in the domain of public health informatics (PHI), and published in MEDLINE between January 2012 and December 2014, where information and communication technology (ICT) was a primary subject, or a main component of the study methodology. Selected articles were synthesized using a thematic analysis using the Essential Services of Public Health as a typology.

RESULTS

Based on themes that emerged, we organized the advances into a model where applications that support the Essential Services are, in turn, supported by a socio-technical infrastructure that relies on government policies and ethical principles. That infrastructure, in turn, depends upon education and training of the public health workforce, development that creates novel or adapts existing infrastructure, and research that evaluates the success of the infrastructure. Finally, the persistence and growth of infrastructure depends on financial sustainability.

CONCLUSIONS

Public health informatics is a field that is growing in breadth, depth, and complexity. Several Essential Services have benefited from informatics, notably, "Monitor Health," "Diagnose & Investigate," and "Evaluate." Yet many Essential Services still have not yet benefited from advances such as maturing electronic health record systems, interoperability amongst health information systems, analytics for population health management, use of social media among consumers, and educational certification in clinical informatics. There is much work to be done to further advance the science of PHI as well as its impact on public health practice.

What's Past is Prologue: A Scoping Review of Recent Public Health and Global Health Informatics Literature

OBJECTIVE

To categorize and describe the public health informatics (PHI) and global health informatics (GHI) literature between 2012 and 2014.

METHODS

We conducted a semi-systematic review of articles published between January 2012 and September 2014 where information and communications technologies (ICT) was a primary subject of the study or a main component of the study methodology. Additional inclusion and exclusion criteria were used to filter PHI and GHI articles from the larger biomedical informatics domain. Articles were identified using MEDLINE as well as personal bibliographies from members of the American Medical Informatics Association PHI and GHI working groups.

RESULTS

A total of 85 PHI articles and 282 GHI articles were identified. While systems in PHI continue to support surveillance activities, we identified a shift towards support for prevention, environmental health, and public health care services. Furthermore, articles from the U.S. reveal a shift towards PHI applications at state and local levels. GHI articles focused on telemedicine, mHealth and eHealth applications. The development of adequate infrastructure to support ICT remains a challenge, although we identified a small but growing set of articles that measure the impact of ICT on clinical outcomes.

DISCUSSION

There is evidence of growth with respect to both implementation of information systems within the public health enterprise as well as a widening of scope within each informatics discipline. Yet the articles also illuminate the need for more primary research studies on what works and what does not as both searches yielded small numbers of primary, empirical articles.

CONCLUSION

While the body of knowledge around PHI and GHI continues to mature, additional studies of higher quality are needed to generate the robust evidence base needed to support continued investment in ICT by governmental health agencies.