Sharma B, Willis VC, Huettner CS, Beaty K, Snowdon JL, Xue S, South BR, Jackson GP, Weeraratne D, Michelini V. Predictive article recommendation using natural language processing and machine learning to support evidence updates in domain-specific knowledge graphs.
JAMIA Open 2020;
3:332-337. [PMID:
33215067 PMCID:
PMC7660962 DOI:
10.1093/jamiaopen/ooaa028]
[Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/15/2020] [Revised: 05/26/2020] [Accepted: 06/19/2020] [Indexed: 11/14/2022] Open
Abstract
Objectives
Describe an augmented intelligence approach to facilitate the update of evidence for associations in knowledge graphs.
Methods
New publications are filtered through multiple machine learning study classifiers, and filtered publications are combined with articles already included as evidence in the knowledge graph. The corpus is then subjected to named entity recognition, semantic dictionary mapping, term vector space modeling, pairwise similarity, and focal entity match to identify highly related publications. Subject matter experts review recommended articles to assess inclusion in the knowledge graph; discrepancies are resolved by consensus.
Results
Study classifiers achieved F-scores from 0.88 to 0.94, and similarity thresholds for each study type were determined by experimentation. Our approach reduces human literature review load by 99%, and over the past 12 months, 41% of recommendations were accepted to update the knowledge graph.
Conclusion
Integrated search and recommendation exploiting current evidence in a knowledge graph is useful for reducing human cognition load.
Collapse