Hanging protocol optimization of lumbar spine radiographs with machine learning

Artificial Intelligence in Gastrointestinal Imaging: Advances and Applications

While artificial intelligence (AI) has shown considerable progress in many areas of medical imaging, applications in abdominal imaging, particularly for the gastrointestinal (GI) system, have notably lagged behind advancements in other body regions. This article reviews foundational concepts in AI and highlights examples of AI applications in GI tract imaging. The discussion on AI applications includes acute & emergent GI imaging, inflammatory bowel disease, oncology, and other miscellaneous applications. It concludes with a discussion of important considerations for implementing AI tools in clinical practice, and steps we can take to accelerate future developments in the field.

AI in radiology: From promise to practice - A guide to effective integration

While Artificial Intelligence (AI) has the potential to transform the field of diagnostic radiology, important obstacles still inhibit its integration into clinical environments. Foremost among them is the inability to integrate clinical information and prior and concurrent imaging examinations, which can lead to diagnostic errors that could irreversibly alter patient care. For AI to succeed in modern clinical practice, model training and algorithm development need to account for relevant background information that may influence the presentation of the patient in question. While AI is often remarkably accurate in distinguishing binary outcomes-hemorrhage vs. no hemorrhage; fracture vs. no fracture-the narrow scope of current training datasets prevents AI from examining the entire clinical context of the image in question. In this article, we provide an overview of the ways in which failure to account for clinical data and prior imaging can adversely affect AI interpretation of imaging studies. We then showcase how emerging techniques such as multimodal fusion and combined neural networks can take advantage of both clinical and imaging data, as well as how development strategies like domain adaptation can ensure greater generalizability of AI algorithms across diverse and dynamic clinical environments.

Pitfalls in Interpretive Applications of Artificial Intelligence in Radiology

Interpretive artificial intelligence (AI) tools are poised to change the future of radiology. However, certain pitfalls may pose particular challenges for optimal AI interpretative performance. These include anatomic variants, age-related changes, postoperative changes, medical devices, image artifacts, lack of integration of prior and concurrent imaging examinations and clinical information, and the satisfaction-of-search effect. Model training and development should account for such pitfalls to minimize errors and optimize interpretation accuracy. More broadly, AI algorithms should be exposed to diverse and complex training datasets to yield a holistic interpretation that considers all relevant information beyond the individual examination. Successful clinical deployment of AI tools will require that radiologist end users recognize these pitfalls and other limitations of the available models. Furthermore, developers should incorporate explainable AI techniques (e.g., heat maps) into their tools, to improve radiologists' understanding of model outputs and to enable radiologists to provide feedback for guiding continuous learning and iterative refinement. In this article, we provide an overview of common pitfalls that radiologists may encounter when using interpretive AI products in daily practice. We present how such pitfalls lead to AI errors and offer potential strategies that AI developers may use for their mitigation.

A Survey of Medical Visualization Through the Lens of Metaphors

We provide an overview of metaphors that were used in medical visualization and related user interfaces. Metaphors are employed to translate concepts from a source domain to a target domain. The survey is grounded in a discussion of metaphor-based design involving the identification and reflection of candidate metaphors. We consider metaphors that have a source domain in one branch of medicine, e.g., the virtual mirror that solves problems in orthopedics and laparoscopy with a mirror that resembles the dentist's mirror. Other metaphors employ the physical world as the source domain, such as crepuscular rays that inspire a solution for access planning in tumor therapy. Aviation is another source of inspiration, leading to metaphors, such as surgical cockpits, surgical control towers, and surgery navigation according to an instrument flight. This paper should raise awareness for metaphors and their potential to focus the design of computer-assisted systems on useful features and a positive user experience. Limitations and potential drawbacks of a metaphor-based user interface design for medical applications are also considered.

Automated selection of abdominal MRI series using a DICOM metadata classifier and selective use of a pixel-based classifier

Accurate, automated MRI series identification is important for many applications, including display ("hanging") protocols, machine learning, and radiomics. The use of the series description or a pixel-based classifier each has limitations. We demonstrate a combined approach utilizing a DICOM metadata-based classifier and selective use of a pixel-based classifier to identify abdominal MRI series. The metadata classifier was assessed alone as Group metadata and combined with selective use of the pixel-based classifier for predictions with less than 70% certainty (Group combined). The overall accuracy (mean and 95% confidence intervals) for Groups metadata and combined on the test dataset were 0.870 CI (0.824,0.912) and 0.930 CI (0.893,0.963), respectively. With this combined metadata and pixel-based approach, we demonstrate accurate classification of 95% or greater for all pre-contrast MRI series and improved performance for some post-contrast series.

AI applications in musculoskeletal imaging: a narrative review

This narrative review focuses on clinical applications of artificial intelligence (AI) in musculoskeletal imaging. A range of musculoskeletal disorders are discussed using a clinical-based approach, including trauma, bone age estimation, osteoarthritis, bone and soft-tissue tumors, and orthopedic implant-related pathology. Several AI algorithms have been applied to fracture detection and classification, which are potentially helpful tools for radiologists and clinicians. In bone age assessment, AI methods have been applied to assist radiologists by automatizing workflow, thus reducing workload and inter-observer variability. AI may potentially aid radiologists in identifying and grading abnormal findings of osteoarthritis as well as predicting the onset or progression of this disease. Either alone or combined with radiomics, AI algorithms may potentially improve diagnosis and outcome prediction of bone and soft-tissue tumors. Finally, information regarding appropriate positioning of orthopedic implants and related complications may be obtained using AI algorithms. In conclusion, rather than replacing radiologists, the use of AI should instead help them to optimize workflow, augment diagnostic performance, and keep up with ever-increasing workload.Relevance statement This narrative review provides an overview of AI applications in musculoskeletal imaging. As the number of AI technologies continues to increase, it will be crucial for radiologists to play a role in their selection and application as well as to fully understand their potential value in clinical practice. Key points • AI may potentially assist musculoskeletal radiologists in several interpretative tasks.• AI applications to trauma, age estimation, osteoarthritis, tumors, and orthopedic implants are discussed.• AI should help radiologists to optimize workflow and augment diagnostic performance.

Machine Learning Classification of Body Part, Imaging Axis, and Intravenous Contrast Enhancement on CT Imaging

Purpose: The development and evaluation of machine learning models that automatically identify the body part(s) imaged, axis of imaging, and the presence of intravenous contrast material of a CT series of images. Methods: This retrospective study included 6955 series from 1198 studies (501 female, 697 males, mean age 56.5 years) obtained between January 2010 and September 2021. Each series was annotated by a trained board-certified radiologist with labels consisting of 16 body parts, 3 imaging axes, and whether an intravenous contrast agent was used. The studies were randomly assigned to the training, validation and testing sets with a proportion of 70%, 20% and 10%, respectively, to develop a 3D deep neural network for each classification task. External validation was conducted with a total of 35,272 series from 7 publicly available datasets. The classification accuracy for each series was independently assessed for each task to evaluate model performance. Results: The accuracies for identifying the body parts, imaging axes, and the presence of intravenous contrast were 96.0% (95% CI: 94.6%, 97.2%), 99.2% (95% CI: 98.5%, 99.7%), and 97.5% (95% CI: 96.4%, 98.5%) respectively. The generalizability of the models was demonstrated through external validation with accuracies of 89.7 - 97.8%, 98.6 - 100%, and 87.8 - 98.6% for the same tasks. Conclusions: The developed models demonstrated high performance on both internal and external testing in identifying key aspects of a CT series.

The use of deep learning in medical imaging to improve spine care: A scoping review of current literature and clinical applications

Background

Artificial intelligence is a revolutionary technology that promises to assist clinicians in improving patient care. In radiology, deep learning (DL) is widely used in clinical decision aids due to its ability to analyze complex patterns and images. It allows for rapid, enhanced data, and imaging analysis, from diagnosis to outcome prediction. The purpose of this study was to evaluate the current literature and clinical utilization of DL in spine imaging.

Methods

This study is a scoping review and utilized the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) methodology to review the scientific literature from 2012 to 2021. A search in PubMed, Web of Science, Embased, and IEEE Xplore databases with syntax specific for DL and medical imaging in spine care applications was conducted to collect all original publications on the subject. Specific data was extracted from the available literature, including algorithm application, algorithms tested, database type and size, algorithm training method, and outcome of interest.

Results

A total of 365 studies (total sample of 232,394 patients) were included and grouped into 4 general applications: diagnostic tools, clinical decision support tools, automated clinical/instrumentation assessment, and clinical outcome prediction. Notable disparities exist in the selected algorithms and the training across multiple disparate databases. The most frequently used algorithms were U-Net and ResNet. A DL model was developed and validated in 92% of included studies, while a pre-existing DL model was investigated in 8%. Of all developed models, only 15% of them have been externally validated.

Conclusions

Based on this scoping review, DL in spine imaging is used in a broad range of clinical applications, particularly for diagnosing spinal conditions. There is a wide variety of DL algorithms, database characteristics, and training methods. Future studies should focus on external validation of existing models before bringing them into clinical use.

The promise and limitations of artificial intelligence in musculoskeletal imaging

With the recent developments in deep learning and the rapid growth of convolutional neural networks, artificial intelligence has shown promise as a tool that can transform several aspects of the musculoskeletal imaging cycle. Its applications can involve both interpretive and non-interpretive tasks such as the ordering of imaging, scheduling, protocoling, image acquisition, report generation and communication of findings. However, artificial intelligence tools still face a number of challenges that can hinder effective implementation into clinical practice. The purpose of this review is to explore both the successes and limitations of artificial intelligence applications throughout the muscuskeletal imaging cycle and to highlight how these applications can help enhance the service radiologists deliver to their patients, resulting in increased efficiency as well as improved patient and provider satisfaction.

Use of artificial intelligence in emergency radiology: An overview of current applications, challenges, and opportunities

The value of artificial intelligence (AI) in healthcare has become evident, especially in the field of medical imaging. The accelerated pace and acuity of care in the Emergency Department (ED) has made it a popular target for artificial intelligence-driven solutions. Software that helps better detect, report, and appropriately guide management can ensure high quality patient care while enabling emergency radiologists to better meet the demands of quick turnaround times. Beyond diagnostic applications, AI-based algorithms also have the potential to optimize other important steps within the ED imaging workflow. This review will highlight the different types of AI-based applications currently available for use in the ED, as well as the challenges and opportunities associated with their implementation.

AI musculoskeletal clinical applications: how can AI increase my day-to-day efficiency?

Artificial intelligence (AI) is expected to bring greater efficiency in radiology by performing tasks that would otherwise require human intelligence, also at a much faster rate than human performance. In recent years, milestone deep learning models with unprecedented low error rates and high computational efficiency have shown remarkable performance for lesion detection, classification, and segmentation tasks. However, the growing field of AI has significant implications for radiology that are not limited to visual tasks. These are essential applications for optimizing imaging workflows and improving noninterpretive tasks. This article offers an overview of the recent literature on AI, focusing on the musculoskeletal imaging chain, including initial patient scheduling, optimized protocoling, magnetic resonance imaging reconstruction, image enhancement, medical image-to-image translation, and AI-aided image interpretation. The substantial developments of advanced algorithms, the emergence of massive quantities of medical data, and the interest of researchers and clinicians reveal the potential for the growing applications of AI to augment the day-to-day efficiency of musculoskeletal radiologists.

AI MSK clinical applications: orthopedic implants

Artificial intelligence (AI) and deep learning have multiple potential uses in aiding the musculoskeletal radiologist in the radiological evaluation of orthopedic implants. These include identification of implants, characterization of implants according to anatomic type, identification of specific implant models, and evaluation of implants for positioning and complications. In addition, natural language processing (NLP) can aid in the acquisition of clinical information from the medical record that can help with tasks like prepopulating radiology reports. Several proof-of-concept works have been published in the literature describing the application of deep learning toward these various tasks, with performance comparable to that of expert musculoskeletal radiologists. Although much work remains to bring these proof-of-concept algorithms into clinical deployment, AI has tremendous potential toward automating these tasks, thereby augmenting the musculoskeletal radiologist.