1
|
Bajaj S, Bala M, Angurala M. A comparative analysis of different augmentations for brain images. Med Biol Eng Comput 2024:10.1007/s11517-024-03127-7. [PMID: 38782880 DOI: 10.1007/s11517-024-03127-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/25/2023] [Accepted: 05/10/2024] [Indexed: 05/25/2024]
Abstract
Deep learning (DL) requires a large amount of training data to improve performance and prevent overfitting. To overcome these difficulties, we need to increase the size of the training dataset. This can be done by augmentation on a small dataset. The augmentation approaches must enhance the model's performance during the learning period. There are several types of transformations that can be applied to medical images. These transformations can be applied to the entire dataset or to a subset of the data, depending on the desired outcome. In this study, we categorize data augmentation methods into four groups: Absent augmentation, where no modifications are made; basic augmentation, which includes brightness and contrast adjustments; intermediate augmentation, encompassing a wider array of transformations like rotation, flipping, and shifting in addition to brightness and contrast adjustments; and advanced augmentation, where all transformation layers are employed. We plan to conduct a comprehensive analysis to determine which group performs best when applied to brain CT images. This evaluation aims to identify the augmentation group that produces the most favorable results in terms of improving model accuracy, minimizing diagnostic errors, and ensuring the robustness of the model in the context of brain CT image analysis.
Collapse
Affiliation(s)
- Shilpa Bajaj
- Applied Sciences (Computer Applications), I.K. Gujral Punjab Technical University, Jalandhar, Kapurthala, India.
| | - Manju Bala
- Department of Computer Science and Engineering, Khalsa College of Engineering and Technology, Amritsar, India
| | - Mohit Angurala
- Apex Institute of Technology (CSE), Chandigarh University, Gharuan, Mohali, Punjab, India
| |
Collapse
|
2
|
Wang Y, Rahman A, Duggar WN, Thomas TV, Roberts PR, Vijayakumar S, Jiao Z, Bian L, Wang H. A gradient mapping guided explainable deep neural network for extracapsular extension identification in 3D head and neck cancer computed tomography images. Med Phys 2024; 51:2007-2019. [PMID: 37643447 DOI: 10.1002/mp.16680] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/09/2022] [Revised: 07/13/2023] [Accepted: 08/03/2023] [Indexed: 08/31/2023] Open
Abstract
BACKGROUND Diagnosis and treatment management for head and neck squamous cell carcinoma (HNSCC) is guided by routine diagnostic head and neck computed tomography (CT) scans to identify tumor and lymph node features. The extracapsular extension (ECE) is a strong predictor of patients' survival outcomes with HNSCC. It is essential to detect the occurrence of ECE as it changes staging and treatment planning for patients. Current clinical ECE detection relies on visual identification and pathologic confirmation conducted by clinicians. However, manual annotation of the lymph node region is a required data preprocessing step in most of the current machine learning-based ECE diagnosis studies. PURPOSE In this paper, we propose a Gradient Mapping Guided Explainable Network (GMGENet) framework to perform ECE identification automatically without requiring annotated lymph node region information. METHODS The gradient-weighted class activation mapping (Grad-CAM) technique is applied to guide the deep learning algorithm to focus on the regions that are highly related to ECE. The proposed framework includes an extractor and a classifier. In a joint training process, informative volumes of interest (VOIs) are extracted by the extractor without labeled lymph node region information, and the classifier learns the pattern to classify the extracted VOIs into ECE positive and negative. RESULTS In evaluation, the proposed methods are well-trained and tested using cross-validation. GMGENet achieved test accuracy and area under the curve (AUC) of 92.2% and 89.3%, respectively. GMGENetV2 achieved 90.3% accuracy and 91.7% AUC in the test. The results were compared with different existing models and further confirmed and explained by generating ECE probability heatmaps via a Grad-CAM technique. The presence or absence of ECE has been analyzed and correlated with ground truth histopathological findings. CONCLUSIONS The proposed deep network can learn meaningful patterns to identify ECE without providing lymph node contours. The introduced ECE heatmaps will contribute to the clinical implementations of the proposed model and reveal unknown features to radiologists. The outcome of this study is expected to promote the implementation of explainable artificial intelligence-assiste ECE detection.
Collapse
Affiliation(s)
- Yibin Wang
- Department of Industrial and Systems Engineering, Mississippi State University, Mississippi State, Mississippi, USA
| | - Abdur Rahman
- Department of Industrial and Systems Engineering, Mississippi State University, Mississippi State, Mississippi, USA
| | - William Neil Duggar
- Department of Radiation Oncology, University of Mississippi Medical Center, Jackson, Mississippi, USA
| | - Toms V Thomas
- Department of Radiation Oncology, University of Mississippi Medical Center, Jackson, Mississippi, USA
| | - Paul Russell Roberts
- Department of Radiation Oncology, University of Mississippi Medical Center, Jackson, Mississippi, USA
| | - Srinivasan Vijayakumar
- Department of Radiation Oncology, University of Mississippi Medical Center, Jackson, Mississippi, USA
| | - Zhicheng Jiao
- Warren Alpert Medical School, Brown University, Providence, Rhode Island, USA
| | - Linkan Bian
- Department of Industrial and Systems Engineering, Mississippi State University, Mississippi State, Mississippi, USA
| | - Haifeng Wang
- Department of Industrial and Systems Engineering, Mississippi State University, Mississippi State, Mississippi, USA
- Department of Radiation Oncology, University of Mississippi Medical Center, Jackson, Mississippi, USA
| |
Collapse
|
3
|
Case NP, Callaway CW, Elmer J, Coppler PJ. Simple approach to quantify hypoxic-ischemic brain injury severity from computed tomography imaging files after cardiac arrest. Resuscitation 2024; 195:110050. [PMID: 37977348 PMCID: PMC10922650 DOI: 10.1016/j.resuscitation.2023.110050] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/02/2023] [Revised: 11/08/2023] [Accepted: 11/09/2023] [Indexed: 11/19/2023]
Abstract
BACKGROUND Grey-white ratio (GWR) can estimate severity of cytotoxic cerebral edema secondary to hypoxic-ischemic brain injury after cardiac arrest and predict progression to death by neurologic criteria (DNC). Current approaches to calculating GWR are not standardized and have variable interrater reliability. We tested if measures of variance of brain density on early computed tomographic (CT) imaging after cardiac arrest could predict DNC. METHODS We performed a retrospective cohort study, identifying post-arrest patients treated between 2011 and 2020 at our single center. We extracted demographic data from our registry and Digital Imaging and Communication in Medicine (DICOM) files for each patient's first brain CT. We analyzed slices 15-20 of each DICOM, corresponding to the level of the basal ganglia while accommodating differences in patient anatomy. We extracted pixel arrays and converted the radiodensities to Hounsfield units (HU). To focus on brain tissue densities, we excluded HU > 60 and < 10. We calculated the variance of each patient's HU distribution and the difference between the means of a two-group Gaussian finite mixture model. We compared these novel metrics to existing measures of cerebral edema, then randomly divided our data into 80% training and 20% test sets and used logistic regression to predict DNC. RESULTS Of 1,133 included subjects, 457 (40%) were female, mean (standard deviation) age was 58 (16) years, and 115 (10%) progressed to DNC. CTs were obtained a median [interquartile range] of 4.2 [2.8-5.7] hours post-arrest. Our novel measures correlated weakly with GWR. HU variance, but not difference between mixture model means, differed significantly between subjects with and without sulcal or cistern effacement. GWR outperformed our novel measures in predicting progression to DNC with an area under the receiver operating characteristic curve (AUC) of 0.82, compared to HU variance (AUC = 0.73) and the difference between mixture model means (AUC = 0.56). CONCLUSION There are differences in the distribution of HU on post-arrest CT in patients with qualitative measures of cerebral edema. Current methods to quantify cerebral edema outperform simple measures of attenuation variance on early brain CT. Further analyses could investigate if these measures of variance, or other distributional characteristics of brain density, have improved predictive performance on brain CTs obtained later in the clinical course or derived from discrete regions of anatomical interest.
Collapse
Affiliation(s)
- Nicholas P Case
- Department of Emergency Medicine, University of Pittsburgh, Pittsburgh, PA, USA
| | - Clifton W Callaway
- Department of Emergency Medicine, University of Pittsburgh, Pittsburgh, PA, USA
| | - Jonathan Elmer
- Department of Emergency Medicine, University of Pittsburgh, Pittsburgh, PA, USA; Department of Critical Care Medicine, University of Pittsburgh, Pittsburgh, PA, USA; Department of Neurology, University of Pittsburgh, Pittsburgh, PA, USA
| | - Patrick J Coppler
- Department of Emergency Medicine, University of Pittsburgh, Pittsburgh, PA, USA.
| |
Collapse
|
4
|
Marcus A, Bentley P, Rueckert D. Concurrent Ischemic Lesion Age Estimation and Segmentation of CT Brain Using a Transformer-Based Network. IEEE TRANSACTIONS ON MEDICAL IMAGING 2023; 42:3464-3473. [PMID: 37335797 DOI: 10.1109/tmi.2023.3287361] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/21/2023]
Abstract
The cornerstone of stroke care is expedient management that varies depending on the time since stroke onset. Consequently, clinical decision making is centered on accurate knowledge of timing and often requires a radiologist to interpret Computed Tomography (CT) of the brain to confirm the occurrence and age of an event. These tasks are particularly challenging due to the subtle expression of acute ischemic lesions and the dynamic nature of their appearance. Automation efforts have not yet applied deep learning to estimate lesion age and treated these two tasks independently, so, have overlooked their inherent complementary relationship. To leverage this, we propose a novel end-to-end multi-task transformer-based network optimized for concurrent segmentation and age estimation of cerebral ischemic lesions. By utilizing gated positional self-attention and CT-specific data augmentation, the proposed method can capture long-range spatial dependencies while maintaining its ability to be trained from scratch under low-data regimes commonly found in medical imaging. Furthermore, to better combine multiple predictions, we incorporate uncertainty by utilizing quantile loss to facilitate estimating a probability density function of lesion age. The effectiveness of our model is then extensively evaluated on a clinical dataset consisting of 776 CT images from two medical centers. Experimental results demonstrate that our method obtains promising performance, with an area under the curve (AUC) of 0.933 for classifying lesion ages ≤ 4.5 hours compared to 0.858 using a conventional approach, and outperforms task-specific state-of-the-art algorithms.
Collapse
|
5
|
Patel R, Provenzano D, Loew M. Anonymization and validation of three-dimensional volumetric renderings of computed tomography data using commercially available T1-weighted magnetic resonance imaging-based algorithms. J Med Imaging (Bellingham) 2023; 10:066501. [PMID: 38074629 PMCID: PMC10704182 DOI: 10.1117/1.jmi.10.6.066501] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/14/2023] [Revised: 11/03/2023] [Accepted: 11/07/2023] [Indexed: 02/12/2024] Open
Abstract
Purpose Previous studies have demonstrated that three-dimensional (3D) volumetric renderings of magnetic resonance imaging (MRI) brain data can be used to identify patients using facial recognition. We have shown that facial features can be identified on simulation-computed tomography (CT) images for radiation oncology and mapped to face images from a database. We aim to determine whether CT images can be anonymized using anonymization software that was designed for T1-weighted MRI data. Approach Our study examines (1) the ability of off-the-shelf anonymization algorithms to anonymize CT data and (2) the ability of facial recognition algorithms to identify whether faces could be detected from a database of facial images. Our study generated 3D renderings from 57 head CT scans from The Cancer Imaging Archive database. Data were anonymized using AFNI (deface, reface, and 3Dskullstrip) and FSL's BET. Anonymized data were compared to the original renderings and passed through facial recognition algorithms (VGG-Face, FaceNet, DLib, and SFace) using a facial database (labeled faces in the wild) to determine what matches could be found. Results Our study found that all modules were able to process CT data and that AFNI's 3Dskullstrip and FSL's BET data consistently showed lower reidentification rates compared to the original. Conclusions The results from this study highlight the potential usage of anonymization algorithms as a clinical standard for deidentifying brain CT data. Our study demonstrates the importance of continued vigilance for patient privacy in publicly shared datasets and the importance of continued evaluation of anonymization methods for CT data.
Collapse
Affiliation(s)
- Rahil Patel
- George Washington University School of Engineering and Applied Science, Department of Biomedical Engineering, Washington, District of Columbia, United States
| | - Destie Provenzano
- George Washington University School of Engineering and Applied Science, Department of Biomedical Engineering, Washington, District of Columbia, United States
| | - Murray Loew
- George Washington University School of Engineering and Applied Science, Department of Biomedical Engineering, Washington, District of Columbia, United States
| |
Collapse
|
6
|
Lo M, Mariconti E, Nakhaeizadeh S, Morgan RM. Preparing computed tomography images for machine learning in forensic and virtual anthropology. Forensic Sci Int Synerg 2023; 6:100319. [PMID: 36852172 PMCID: PMC9958428 DOI: 10.1016/j.fsisyn.2023.100319] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/22/2022] [Revised: 02/02/2023] [Accepted: 02/06/2023] [Indexed: 02/11/2023]
Affiliation(s)
- Martin Lo
- UCL Department of Security and Crime Science, University College London, 35 Tavistock Square, London, WC1H 9EZ, UK,UCL Centre for the Forensic Sciences, University College London, 35 Tavistock Square, London, WC1H 9EZ, UK,Corresponding author. UCL Department of Security and Crime Science, University College London, 35 Tavistock Square, London, WC1H 9EZ, UK.
| | - Enrico Mariconti
- UCL Department of Security and Crime Science, University College London, 35 Tavistock Square, London, WC1H 9EZ, UK
| | - Sherry Nakhaeizadeh
- UCL Department of Security and Crime Science, University College London, 35 Tavistock Square, London, WC1H 9EZ, UK,UCL Centre for the Forensic Sciences, University College London, 35 Tavistock Square, London, WC1H 9EZ, UK
| | - Ruth M. Morgan
- UCL Department of Security and Crime Science, University College London, 35 Tavistock Square, London, WC1H 9EZ, UK,UCL Centre for the Forensic Sciences, University College London, 35 Tavistock Square, London, WC1H 9EZ, UK
| |
Collapse
|
7
|
Sahlsten J, Wahid KA, Glerean E, Jaskari J, Naser MA, He R, Kann BH, Mäkitie A, Fuller CD, Kaski K. Segmentation stability of human head and neck cancer medical images for radiotherapy applications under de-identification conditions: Benchmarking data sharing and artificial intelligence use-cases. Front Oncol 2023; 13:1120392. [PMID: 36925936 PMCID: PMC10011442 DOI: 10.3389/fonc.2023.1120392] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/09/2022] [Accepted: 02/13/2023] [Indexed: 03/08/2023] Open
Abstract
Background Demand for head and neck cancer (HNC) radiotherapy data in algorithmic development has prompted increased image dataset sharing. Medical images must comply with data protection requirements so that re-use is enabled without disclosing patient identifiers. Defacing, i.e., the removal of facial features from images, is often considered a reasonable compromise between data protection and re-usability for neuroimaging data. While defacing tools have been developed by the neuroimaging community, their acceptability for radiotherapy applications have not been explored. Therefore, this study systematically investigated the impact of available defacing algorithms on HNC organs at risk (OARs). Methods A publicly available dataset of magnetic resonance imaging scans for 55 HNC patients with eight segmented OARs (bilateral submandibular glands, parotid glands, level II neck lymph nodes, level III neck lymph nodes) was utilized. Eight publicly available defacing algorithms were investigated: afni_refacer, DeepDefacer, defacer, fsl_deface, mask_face, mri_deface, pydeface, and quickshear. Using a subset of scans where defacing succeeded (N=29), a 5-fold cross-validation 3D U-net based OAR auto-segmentation model was utilized to perform two main experiments: 1.) comparing original and defaced data for training when evaluated on original data; 2.) using original data for training and comparing the model evaluation on original and defaced data. Models were primarily assessed using the Dice similarity coefficient (DSC). Results Most defacing methods were unable to produce any usable images for evaluation, while mask_face, fsl_deface, and pydeface were unable to remove the face for 29%, 18%, and 24% of subjects, respectively. When using the original data for evaluation, the composite OAR DSC was statistically higher (p ≤ 0.05) for the model trained with the original data with a DSC of 0.760 compared to the mask_face, fsl_deface, and pydeface models with DSCs of 0.742, 0.736, and 0.449, respectively. Moreover, the model trained with original data had decreased performance (p ≤ 0.05) when evaluated on the defaced data with DSCs of 0.673, 0.693, and 0.406 for mask_face, fsl_deface, and pydeface, respectively. Conclusion Defacing algorithms may have a significant impact on HNC OAR auto-segmentation model training and testing. This work highlights the need for further development of HNC-specific image anonymization methods.
Collapse
Affiliation(s)
- Jaakko Sahlsten
- Department of Computer Science, Aalto University School of Science, Espoo, Finland
| | - Kareem A. Wahid
- Department of Radiation Oncology, The University of Texas MD Anderson Cancer Center, Houston, TX, United States
| | - Enrico Glerean
- Department of Neuroscience and Biomedical Engineering, Aalto University, Espoo, Finland
| | - Joel Jaskari
- Department of Computer Science, Aalto University School of Science, Espoo, Finland
| | - Mohamed A. Naser
- Department of Radiation Oncology, The University of Texas MD Anderson Cancer Center, Houston, TX, United States
| | - Renjie He
- Department of Radiation Oncology, The University of Texas MD Anderson Cancer Center, Houston, TX, United States
| | - Benjamin H. Kann
- Artificial Intelligence in Medicine Program, Brigham and Women’s Hospital, Dana-Farber Cancer Institute, Harvard Medical School, Boston, MA, United States
| | - Antti Mäkitie
- Department of Otorhinolaryngology, Head and Neck Surgery, University of Helsinki and Helsinki University Hospital, Helsinki, Finland
| | - Clifton D. Fuller
- Department of Radiation Oncology, The University of Texas MD Anderson Cancer Center, Houston, TX, United States
- *Correspondence: Clifton D. Fuller, ; Kimmo Kaski,
| | - Kimmo Kaski
- Department of Computer Science, Aalto University School of Science, Espoo, Finland
- *Correspondence: Clifton D. Fuller, ; Kimmo Kaski,
| |
Collapse
|
8
|
Seong H, Yun D, Yoon KS, Kwak JS, Koh JC. Development of pre-procedure virtual simulation for challenging interventional procedures: an experimental study with clinical application. Korean J Pain 2022; 35:403-412. [PMID: 36175339 PMCID: PMC9530692 DOI: 10.3344/kjp.2022.35.4.403] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/13/2022] [Revised: 06/24/2022] [Accepted: 07/12/2022] [Indexed: 11/30/2022] Open
Abstract
Background Most pain management techniques for challenging procedures are still performed under the guidance of the C-arm fluoroscope although it is sometimes difficult for even experienced clinicians to understand the modified three-dimensional anatomy as a two-dimensional X-ray image. To overcome these difficulties, the development of a virtual simulator may be helpful. Therefore, in this study, the authors developed a virtual simulator and presented its clinical application cases. Methods We developed a computer program to simulate the actual environment of the procedure. Computed tomography (CT) Digital Imaging and Communications in Medicine (DICOM) data were used for the simulations. Virtual needle placement was simulated at the most appropriate position for a successful block. Using a virtual C-arm, the authors searched for the position of the C-arm at which the needle was visualized as a point. The positional relationships between the anatomy of the patient and the needle were identified. Results For the simulations, the CT DICOM data of patients who visited the outpatient clinic was used. When the patients revisited the clinic, images similar to the simulated images were obtained by manipulating the C-arm. Transforaminal epidural injection, which was difficult to perform due to severe spinal deformity, and the challenging procedures of the superior hypogastric plexus block and Gasserian ganglion block, were successfully performed with the help of the simulation. Conclusions We created a pre-procedural virtual simulation and demonstrated its successful application in patients who are expected to undergo challenging procedures.
Collapse
Affiliation(s)
- Hyunyoung Seong
- Department of Anesthesiology and Pain Medicine, Korea University Anam Hospital, Seoul, Korea
| | - Daehun Yun
- Department of Anesthesiology and Pain Medicine, Korea University Anam Hospital, Seoul, Korea
| | - Kyung Seob Yoon
- Department of Anesthesiology and Pain Medicine, Korea University Anam Hospital, Seoul, Korea
| | - Ji Soo Kwak
- Department of Anesthesiology and Pain Medicine, Korea University Anam Hospital, Seoul, Korea
| | - Jae Chul Koh
- Department of Anesthesiology and Pain Medicine, Korea University Anam Hospital, Seoul, Korea
| |
Collapse
|
9
|
Ruwanpathirana GP, Williams RC, Masters CL, Rowe CC, Johnston LA, Davey CE. Mapping the association between tau-PET and Aβ-amyloid-PET using deep learning. Sci Rep 2022; 12:14797. [PMID: 36042256 PMCID: PMC9427855 DOI: 10.1038/s41598-022-18963-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/04/2022] [Accepted: 08/23/2022] [Indexed: 11/26/2022] Open
Abstract
In Alzheimer’s disease, the molecular pathogenesis of the extracellular Aβ-amyloid (Aβ) instigation of intracellular tau accumulation is poorly understood. We employed a high-resolution PET scanner, with low detection thresholds, to examine the Aβ-tau association using a convolutional neural network (CNN), and compared results to a standard voxel-wise linear analysis. The full range of Aβ Centiloid values was highly predicted by the tau topography using the CNN (training R2 = 0.86, validation R2 = 0.75, testing R2 = 0.72). Linear models based on tau-SUVR identified widespread positive correlations between tau accumulation and Aβ burden throughout the brain. In contrast, CNN analysis identified focal clusters in the bilateral medial temporal lobes, frontal lobes, precuneus, postcentral gyrus and middle cingulate. At low Aβ levels, information from the middle cingulate, frontal lobe and precuneus regions was more predictive of Aβ burden, while at high Aβ levels, the medial temporal regions were more predictive of Aβ burden. The data-driven CNN approach revealed new associations between tau topography and Aβ burden.
Collapse
Affiliation(s)
- Gihan P Ruwanpathirana
- Department of Biomedical Engineering, The University of Melbourne, Melbourne, VIC, Australia.,Melbourne Brain Centre Imaging Unit, The University of Melbourne, Melbourne, VIC, Australia
| | - Robert C Williams
- Melbourne Brain Centre Imaging Unit, The University of Melbourne, Melbourne, VIC, Australia
| | - Colin L Masters
- Florey Institute of Neuroscience and Mental Health, Melbourne, VIC, Australia.,Florey Department of Neuroscience and Mental Health, The University of Melbourne, Melbourne, VIC, Australia
| | - Christopher C Rowe
- Department of Molecular Imaging and Therapy, Austin Health, Melbourne, VIC, Australia.,Florey Institute of Neuroscience and Mental Health, Melbourne, VIC, Australia.,Florey Department of Neuroscience and Mental Health, The University of Melbourne, Melbourne, VIC, Australia
| | - Leigh A Johnston
- Department of Biomedical Engineering, The University of Melbourne, Melbourne, VIC, Australia.,Melbourne Brain Centre Imaging Unit, The University of Melbourne, Melbourne, VIC, Australia
| | - Catherine E Davey
- Department of Biomedical Engineering, The University of Melbourne, Melbourne, VIC, Australia. .,Melbourne Brain Centre Imaging Unit, The University of Melbourne, Melbourne, VIC, Australia.
| |
Collapse
|
10
|
Wardlaw JM, Mair G, von Kummer R, Williams MC, Li W, Storkey AJ, Trucco E, Liebeskind DS, Farrall A, Bath PM, White P. Accuracy of Automated Computer-Aided Diagnosis for Stroke Imaging: A Critical Evaluation of Current Evidence. Stroke 2022; 53:2393-2403. [PMID: 35440170 DOI: 10.1161/strokeaha.121.036204] [Citation(s) in RCA: 13] [Impact Index Per Article: 6.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
There is increasing interest in computer applications, using artificial intelligence methodologies, to perform health care tasks previously performed by humans, particularly in medical imaging for diagnosis. In stroke, there are now commercial artificial intelligence software for use with computed tomography or MR imaging to identify acute ischemic brain tissue pathology, arterial obstruction on computed tomography angiography or as hyperattenuated arteries on computed tomography, brain hemorrhage, or size of perfusion defects. A rapid, accurate diagnosis may aid treatment decisions for individual patients and could improve outcome if it leads to effective and safe treatment; or conversely, to disaster if a delayed or incorrect diagnosis results in inappropriate treatment. Despite this potential clinical impact, diagnostic tools including artificial intelligence methods are not subjected to the same clinical evaluation standards as are mandatory for drugs. Here, we provide an evidence-based review of the pros and cons of commercially available automated methods for medical imaging diagnosis, including those based on artificial intelligence, to diagnose acute brain pathology on computed tomography or magnetic resonance imaging in patients with stroke.
Collapse
Affiliation(s)
- Joanna M Wardlaw
- Centre for Clinical Brain Sciences, UK Dementia Research Institute Centre at the University of Edinburgh, Little France, United Kingdom (J.M.W., G.M., W.L., A.F.)
| | - Grant Mair
- Centre for Clinical Brain Sciences, UK Dementia Research Institute Centre at the University of Edinburgh, Little France, United Kingdom (J.M.W., G.M., W.L., A.F.)
| | - Rüdiger von Kummer
- Institute of Diagnostic and Interventional Neuroradiology, Universitätsklinikum Carl Gustav Carus, Dresden, Germany (R.v.K.)
| | - Michelle C Williams
- Centre for Cardiovascular Science, University of Edinburgh, Little France, United Kingdom (M.C.W.)
| | - Wenwen Li
- Centre for Clinical Brain Sciences, UK Dementia Research Institute Centre at the University of Edinburgh, Little France, United Kingdom (J.M.W., G.M., W.L., A.F.)
| | | | - Emanuel Trucco
- VAMPIRE project, Computing, School of Science and Engineering, University of Dundee (E.T.)
| | | | - Andrew Farrall
- Centre for Clinical Brain Sciences, UK Dementia Research Institute Centre at the University of Edinburgh, Little France, United Kingdom (J.M.W., G.M., W.L., A.F.)
| | - Philip M Bath
- Stroke Trials Unit, Mental Health & Clinical Neuroscience, University of Nottingham, Queen's Medical Centre campus, United Kingdom (P.M.B.)
| | - Philip White
- Translational and Clinical Research Institute, Newcastle University, Newcastle upon Tyne and Newcastle upon Tyne Hospitals NHS Trust, United Kingdom (P.W.)
| |
Collapse
|
11
|
Das S, Dholam K, Gurav S, Bendale K, Ingle A, Mohanty B, Chaudhari P, Bellare JR. X-ray computed microtomography datasets for osteogenic nanofibrous coated titanium implants. Sci Data 2022; 9:348. [PMID: 35717538 PMCID: PMC9206670 DOI: 10.1038/s41597-022-01400-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/24/2021] [Accepted: 05/17/2022] [Indexed: 11/24/2022] Open
Abstract
Surface modifications of titanium implant influences the quality of osseointegration and are associated with favourable treatment prognosis in orthopaedic and cranio-maxillofacial cases. Hence, unlike previous works, the peri-implant region details of our novel osteogenic nanofibrous coated implants placed in rabbits (n = 6 + 1) were recorded over a 12-week period using a micro-CT imaging system. In this unique contribution, we have created a computed tomography (CT) library of rabbit’s tibiae anatomy with osteogenic nanofibrous coated/uncoated implants and are introductory useful assets for investigating the correlation between osteogenic nanofibers coated implants and its effect on improved osseointegration. Apart from using this CT dataset to conduct serial 2D image studies, three-dimensional (3D) reconstructions, assessing segmentation algorithms and developing adequate image quantitation tools, there may be positive applications of these in comparative investigations of similar or related preclinical as well as future clinical studies, further design planning, development etc. required for evolution of implants beyond the present state of art. Measurement(s) | Bone microstructure and quality | Technology Type(s) | High-resolution imaging technology | Factor Type(s) | Osseointegration | Sample Characteristic - Organism | Oryctolagus cuniculus | Sample Characteristic - Environment | Sterile Environment | Sample Characteristic - Location | India |
Collapse
Affiliation(s)
- Siddhartha Das
- Department of Biosciences and Bioengineering, Indian Institute of Technology Bombay, Mumbai, 400076, Maharashtra, India.,Department of Chemical Engineering, Indian Institute of Technology Bombay, Mumbai, 400076, Maharashtra, India
| | - Kanchan Dholam
- Department of Dental and Prosthetic Surgery, Tata Memorial Centre, HBNI, Mumbai, 400 012, Maharashtra, India
| | - Sandeep Gurav
- Department of Dental and Prosthetic Surgery, Tata Memorial Centre, HBNI, Mumbai, 400 012, Maharashtra, India
| | - Kiran Bendale
- Advanced Centre for Treatment, Research and Education in Cancer, Navi Mumbai, 410 210, Maharashtra, India
| | - Arvind Ingle
- Advanced Centre for Treatment, Research and Education in Cancer, Navi Mumbai, 410 210, Maharashtra, India.,Homi Bhabha National Institute (HBNI), Training School Complex, Anushakti Nagar, Mumbai, 400085, India
| | - Bhabani Mohanty
- Advanced Centre for Treatment, Research and Education in Cancer, Navi Mumbai, 410 210, Maharashtra, India
| | - Pradip Chaudhari
- Advanced Centre for Treatment, Research and Education in Cancer, Navi Mumbai, 410 210, Maharashtra, India. .,Homi Bhabha National Institute (HBNI), Training School Complex, Anushakti Nagar, Mumbai, 400085, India.
| | - Jayesh R Bellare
- Department of Chemical Engineering, Indian Institute of Technology Bombay, Mumbai, 400076, Maharashtra, India. .,Wadhwani Research Centre for Bioengineering, Indian Institute of Technology Bombay, Mumbai, 400076, Maharashtra, India.
| |
Collapse
|
12
|
Samak ZA, Clatworthy P, Mirmehdi M. FeMA: Feature matching auto-encoder for predicting ischaemic stroke evolution and treatment outcome. Comput Med Imaging Graph 2022; 99:102089. [PMID: 35738186 DOI: 10.1016/j.compmedimag.2022.102089] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/17/2021] [Revised: 05/04/2022] [Accepted: 06/03/2022] [Indexed: 01/05/2023]
Abstract
Although, predicting ischaemic stroke evolution and treatment outcome provide important information one step towards individual treatment planning, classifying functional outcome and modelling the brain tissue evolution remains a challenge due to data complexity and visually subtle changes in the brain. We propose a novel deep learning approach, Feature Matching Auto-encoder (FeMA) that consists of two stages, predicting ischaemic stroke evolution at one week without voxel-wise annotation and predicting ischaemic stroke treatment outcome at 90 days from a baseline scan. In the first stage, we introduce feature similarity and consistency objective, and in the second stage, we show that adding stroke evolution information increase the performance of functional outcome prediction. Comparative experiments demonstrate that our proposed method is more effective to extract representative follow-up features and achieves the best results for functional outcome of stroke treatment.
Collapse
Affiliation(s)
- Zeynel A Samak
- Department of Computer Science, University of Bristol, Bristol, UK.
| | - Philip Clatworthy
- Translational Health Sciences, University of Bristol, Bristol, UK; Stroke Neurology, Southmead Hospital, North Bristol NHS Trust, Bristol, UK.
| | - Majid Mirmehdi
- Department of Computer Science, University of Bristol, Bristol, UK.
| |
Collapse
|
13
|
Shahid A, Bazargani MH, Banahan P, Mac Namee B, Kechadi T, Treacy C, Regan G, MacMahon P. A Two-Stage De-Identification Process for Privacy-Preserving Medical Image Analysis. Healthcare (Basel) 2022; 10:755. [PMID: 35627892 PMCID: PMC9141493 DOI: 10.3390/healthcare10050755] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/22/2022] [Revised: 04/12/2022] [Accepted: 04/14/2022] [Indexed: 11/17/2022] Open
Abstract
Identification and re-identification are two major security and privacy threats to medical imaging data. De-identification in DICOM medical data is essential to preserve the privacy of patients' Personally Identifiable Information (PII) and requires a systematic approach. However, there is a lack of sufficient detail regarding the de-identification process of DICOM attributes, for example, what needs to be considered before removing a DICOM attribute. In this paper, we first highlight and review the key challenges in the medical image data de-identification process. In this paper, we develop a two-stage de-identification process for CT scan images available in DICOM file format. In the first stage of the de-identification process, the patient's PII-including name, date of birth, etc., are removed at the hospital facility using the export process available in their Picture Archiving and Communication System (PACS). The second stage employs the proposed DICOM de-identification tool for an exhaustive attribute-level investigation to further de-identify and ensure that all PII has been removed. Finally, we provide a roadmap for future considerations to build a semi-automated or automated tool for the DICOM datasets de-identification.
Collapse
Affiliation(s)
- Arsalan Shahid
- School of Computer Science, University College Dublin, D04 V1W8 Dublin, Ireland; (M.H.B.); (B.M.N.); (T.K.)
| | - Mehran H. Bazargani
- School of Computer Science, University College Dublin, D04 V1W8 Dublin, Ireland; (M.H.B.); (B.M.N.); (T.K.)
| | - Paul Banahan
- Department of Radiology, Mater Misericordiae University Hospital, D07 R2WY Dublin, Ireland; (P.B.); (P.M.)
| | - Brian Mac Namee
- School of Computer Science, University College Dublin, D04 V1W8 Dublin, Ireland; (M.H.B.); (B.M.N.); (T.K.)
| | - Tahar Kechadi
- School of Computer Science, University College Dublin, D04 V1W8 Dublin, Ireland; (M.H.B.); (B.M.N.); (T.K.)
| | - Ceara Treacy
- Regulated Software Research Centre, Dundalk Institute of Technology, A91 K584 Dundalk, Ireland; (C.T.); (G.R.)
| | - Gilbert Regan
- Regulated Software Research Centre, Dundalk Institute of Technology, A91 K584 Dundalk, Ireland; (C.T.); (G.R.)
| | - Peter MacMahon
- Department of Radiology, Mater Misericordiae University Hospital, D07 R2WY Dublin, Ireland; (P.B.); (P.M.)
| |
Collapse
|
14
|
Ji H, You SK, Lee JE, Lee SM, Cho HH, Ohm JY. Feasibility of Pediatric Low-Dose Facial CT Reconstructed with Filtered Back Projection Using Adequate Kernels. JOURNAL OF THE KOREAN SOCIETY OF RADIOLOGY 2022; 83:669-679. [PMID: 36238515 PMCID: PMC9514522 DOI: 10.3348/jksr.2021.0003] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 01/04/2021] [Revised: 05/04/2021] [Accepted: 06/30/2021] [Indexed: 11/15/2022]
Abstract
Purpose Materials and Methods Results Conclusion
Collapse
Affiliation(s)
- Hye Ji
- Department of Radiology, Chungnam National University Hospital, Daejeon, Korea
| | - Sun Kyoung You
- Department of Radiology, Chungnam National University Hospital, Chungnam National University College of Medicine, Daejeon, Korea
| | - Jeong Eun Lee
- Department of Radiology, Chungnam National University Hospital, Chungnam National University College of Medicine, Daejeon, Korea
| | - So Mi Lee
- Department of Radiology, School of Medicine, Kyungpook National University, Kyungpook National University Chilgok Hospital, Daegu, Korea
| | - Hyun-Hae Cho
- Department of Radiology, Ewha Womans University Mokdong Hospital, Seoul, Korea
| | - Joon Young Ohm
- Department of Radiology, Chungnam National University Hospital, Daejeon, Korea
| |
Collapse
|
15
|
Uchiyama Y, Domen K, Koyama T. Outcome Prediction of Patients with Intracerebral Hemorrhage by Measurement of Lesion Volume in the Corticospinal Tract on Computed Tomography. Prog Rehabil Med 2021; 6:20210050. [PMID: 34963905 PMCID: PMC8652345 DOI: 10.2490/prm.20210050] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/15/2021] [Accepted: 11/10/2021] [Indexed: 12/03/2022] Open
Abstract
Objective: This study investigated the potential utility of computed tomography for outcome prediction in patients with intracerebral hemorrhage. Methods: Patients with putaminal and/or thalamic hemorrhage for whom computed tomography images were acquired in our hospital emergency room soon after onset were retrospectively enrolled. Outcome measurements were obtained at discharge from the convalescent rehabilitation ward of our affiliated hospital. Hemiparesis was evaluated using the total score of the motor component of the Stroke Impairment Assessment Set (SIAS-motor; null to full, 0 to 25), the motor component of the Functional Independence Measure (FIM-motor; null to full, 13 to 91), and the total length of hospital stay. After registration of the computed tomography images to the standard brain, the volumes of the hematoma lesions located in the corticospinal tract were calculated. The correlation between the corticospinal tract lesion volumes and the outcome measurements was assessed using Spearman’s rank correlation test. Results: Thirty patients were entered into the final analytical database. Corticospinal tract lesion volumes ranged from 0.002 to 4.302 ml (median, 1.478). SIAS-motor scores ranged from 0 to 25 (median, 20), FIM-motor scores ranged from 15 to 91 (median, 80.5), and the total length of hospital stay ranged from 31 to 194 days (median, 106.5). All correlation tests were statistically significant (P <0.01). The strongest correlation was for SIAS-motor total (R=–0.710), followed by FIM-motor (R=–0.604) and LOS (R=0.493). Conclusions: These findings suggest that conventional computed tomography images may be useful for outcome prediction in patients with intracerebral hemorrhage.
Collapse
Affiliation(s)
- Yuki Uchiyama
- Department of Rehabilitation Medicine, Hyogo College of Medicine, Nishinomiya, Japan
| | - Kazuhisa Domen
- Department of Rehabilitation Medicine, Hyogo College of Medicine, Nishinomiya, Japan
| | - Tetsuo Koyama
- Department of Rehabilitation Medicine, Hyogo College of Medicine, Nishinomiya, Japan.,Department of Rehabilitation Medicine, Nishinomiya Kyoritsu Neurosurgical Hospital, Nishinomiya, Japan
| |
Collapse
|
16
|
Mohammadian Foroushani H, Dhar R, Chen Y, Gurney J, Hamzehloo A, Lee JM, Marcus DS. The Stroke Neuro-Imaging Phenotype Repository: An Open Data Science Platform for Stroke Research. Front Neuroinform 2021; 15:597708. [PMID: 34248529 PMCID: PMC8264586 DOI: 10.3389/fninf.2021.597708] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/21/2020] [Accepted: 05/24/2021] [Indexed: 11/13/2022] Open
Abstract
Stroke is one of the leading causes of death and disability worldwide. Reducing this disease burden through drug discovery and evaluation of stroke patient outcomes requires broader characterization of stroke pathophysiology, yet the underlying biologic and genetic factors contributing to outcomes are largely unknown. Remedying this critical knowledge gap requires deeper phenotyping, including large-scale integration of demographic, clinical, genomic, and imaging features. Such big data approaches will be facilitated by developing and running processing pipelines to extract stroke-related phenotypes at large scale. Millions of stroke patients undergo routine brain imaging each year, capturing a rich set of data on stroke-related injury and outcomes. The Stroke Neuroimaging Phenotype Repository (SNIPR) was developed as a multi-center centralized imaging repository of clinical computed tomography (CT) and magnetic resonance imaging (MRI) scans from stroke patients worldwide, based on the open source XNAT imaging informatics platform. The aims of this repository are to: (i) store, manage, process, and facilitate sharing of high-value stroke imaging data sets, (ii) implement containerized automated computational methods to extract image characteristics and disease-specific features from contributed images, (iii) facilitate integration of imaging, genomic, and clinical data to perform large-scale analysis of complications after stroke; and (iv) develop SNIPR as a collaborative platform aimed at both data scientists and clinical investigators. Currently, SNIPR hosts research projects encompassing ischemic and hemorrhagic stroke, with data from 2,246 subjects, and 6,149 imaging sessions from Washington University's clinical image archive as well as contributions from collaborators in different countries, including Finland, Poland, and Spain. Moreover, we have extended the XNAT data model to include relevant clinical features, including subject demographics, stroke severity (NIH Stroke Scale), stroke subtype (using TOAST classification), and outcome [modified Rankin Scale (mRS)]. Image processing pipelines are deployed on SNIPR using containerized modules, which facilitate replicability at a large scale. The first such pipeline identifies axial brain CT scans from DICOM header data and image data using a meta deep learning scan classifier, registers serial scans to an atlas, segments tissue compartments, and calculates CSF volume. The resulting volume can be used to quantify the progression of cerebral edema after ischemic stroke. SNIPR thus enables the development and validation of pipelines to automatically extract imaging phenotypes and couple them with clinical data with the overarching aim of enabling a broad understanding of stroke progression and outcomes.
Collapse
Affiliation(s)
- Hossein Mohammadian Foroushani
- Department of Electrical and System Engineering, School of Engineering, Washington University in St. Louis, St. Louis, MO, United States
| | - Rajat Dhar
- Division of Neurocritical Care, Department of Neurology, Washington University School of Medicine, St. Louis, MO, United States
| | - Yasheng Chen
- Division of Cerebrovascular Disease, Department of Neurology, Washington University School of Medicine, St. Louis, MO, United States
| | - Jenny Gurney
- Department of Radiology, Washington University School of Medicine, St. Louis, MO, United States
| | - Ali Hamzehloo
- Division of Neurocritical Care, Department of Neurology, Washington University School of Medicine, St. Louis, MO, United States
| | - Jin-Moo Lee
- Division of Cerebrovascular Disease, Department of Neurology, Washington University School of Medicine, St. Louis, MO, United States
| | - Daniel S Marcus
- Department of Radiology, Washington University School of Medicine, St. Louis, MO, United States
| |
Collapse
|
17
|
Arrarte Terreros N, Bruggeman AAE, Swijnenburg ISJ, van Meenen LCC, Groot AE, Coutinho JM, Roos YBWEM, Emmer BJ, Beenen LFM, van Bavel E, Marquering HA, Majoie CBLM. Early recanalization in large-vessel occlusion stroke patients transferred for endovascular treatment. J Neurointerv Surg 2021; 14:neurintsurg-2021-017441. [PMID: 33986112 PMCID: PMC9016237 DOI: 10.1136/neurintsurg-2021-017441] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/19/2021] [Revised: 04/24/2021] [Accepted: 04/29/2021] [Indexed: 11/25/2022]
Abstract
Background We performed an exploratory analysis to identify patient and thrombus characteristics associated with early recanalization in large-vessel occlusion (LVO) stroke patients transferred for endovascular treatment (EVT) from a primary (PSC) to a comprehensive stroke center (CSC). Methods We included patients with an LVO stroke of the anterior circulation who were transferred to our hospital for EVT and underwent repeated imaging between January 2016 and June 2019. We compared patient characteristics, workflow time metrics, functional outcome (modified Rankin Scale at 90 days), and baseline thrombus imaging characteristics, which included: occlusion location, thrombus length, attenuation, perviousness, distance from terminus of intracranial carotid artery to the thrombus (DT), and clot burden score (CBS), between early-recanalized LVO (ER-LVO), and non-early-recanalized LVO (NER-LVO) patients. Results One hundred and forty-nine patients were included in the analysis. Early recanalization occurred in 32% of patients. ER-LVO patients less often had a medical history of hypertension (31% vs 49%, P=0.04), and more often had clinical improvement between PSC and CSC (ΔNIHSS −5 vs 3, P<0.01), compared with NER-LVO patients. Thrombolysis administration was similar in both groups (88% vs 78%, P=0.18). ER-LVO patients had no ICA occlusions (0% vs 27%, P<0.01), more often an M2 occlusion (35% vs 17%, P=0.01), longer DT (27 mm vs 12 mm, P<0.01), shorter thrombi (17 mm vs 27 mm, P<0.01), and higher CBS (8 vs 6, P<0.01) at baseline imaging. ER-LVO patients had lower mRS scores (1 vs 3, P=0.02). Conclusions Early recanalization is associated with clinical improvement between PSC and CSC admission, more distal occlusions and shorter thrombi at baseline imaging, and better functional outcome.
Collapse
Affiliation(s)
- Nerea Arrarte Terreros
- Department of Biomedical Engineering and Physics, Amsterdam UMC, location AMC, Amsterdam, the Netherlands .,Department of Radiology and Nuclear Medicine, Amsterdam UMC, location AMC, Amsterdam, the Netherlands
| | - Agnetha A E Bruggeman
- Department of Radiology and Nuclear Medicine, Amsterdam UMC, location AMC, Amsterdam, the Netherlands
| | - Isabella S J Swijnenburg
- Department of Biomedical Engineering and Physics, Amsterdam UMC, location AMC, Amsterdam, the Netherlands.,Department of Radiology and Nuclear Medicine, Amsterdam UMC, location AMC, Amsterdam, the Netherlands
| | - Laura C C van Meenen
- Department of Neurology, Amsterdam UMC, location AMC, Amsterdam, the Netherlands
| | - Adrien E Groot
- Department of Neurology, Amsterdam UMC, location AMC, Amsterdam, the Netherlands
| | - Jonathan M Coutinho
- Department of Neurology, Amsterdam UMC, location AMC, Amsterdam, the Netherlands
| | - Yvo B W E M Roos
- Department of Neurology, Amsterdam UMC, location AMC, Amsterdam, the Netherlands
| | - Bart J Emmer
- Department of Radiology and Nuclear Medicine, Amsterdam UMC, location AMC, Amsterdam, the Netherlands
| | - Ludo F M Beenen
- Department of Radiology and Nuclear Medicine, Amsterdam UMC, location AMC, Amsterdam, the Netherlands
| | - Ed van Bavel
- Department of Biomedical Engineering and Physics, Amsterdam UMC, location AMC, Amsterdam, the Netherlands
| | - Henk A Marquering
- Department of Biomedical Engineering and Physics, Amsterdam UMC, location AMC, Amsterdam, the Netherlands.,Department of Radiology and Nuclear Medicine, Amsterdam UMC, location AMC, Amsterdam, the Netherlands
| | - Charles B L M Majoie
- Department of Radiology and Nuclear Medicine, Amsterdam UMC, location AMC, Amsterdam, the Netherlands
| |
Collapse
|
18
|
Praveen K, Sasikala M, Janani A, Shajil N, Nishanthi V H. A simplified framework for the detection of intracranial hemorrhage in CT brain images using deep learning. Curr Med Imaging 2021; 17:1226-1236. [PMID: 33602101 DOI: 10.2174/1573405617666210218100641] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/28/2020] [Revised: 12/24/2020] [Accepted: 12/29/2020] [Indexed: 11/22/2022]
Abstract
BACKGROUND The need for accurate and timely detection of Intracranial hemorrhage (ICH) is utmost important to avoid untoward incidents that may even lead to death.Hence, this presented work leverages the ability of a pretrained deep convolutional neural network (CNN) for the detection of ICH in computed tomography (CT) brain images. METHODS Different frameworks have been analyzed for their effectiveness for the classification of CT brain images into hemorrhage or non-hemorrhage conditions. All these frameworks were investigated on CQ500 dataset. Furthermore, an exclusive preprocessing pipeline was designed for both normal and ICH CT images. Firstly, a framework involving the pretrained deep CNN, AlexNet, has been exploited for both feature extraction and classification using the transfer learning method, secondly, a modified AlexNet-Support vector machine (SVM) classifier is explored and finally, a feature selection method, Principal Component Analysis (PCA) has been introduced in the AlexNet-SVM classifier model and its efficacy is explored.These models were trained and tested on two different sets of CT images, one containing the original images without preprocessing and another set consisting of preprocessed images. RESULTS The modified AlexNet-SVM classifier has shown an improved performance in comparison to the other investigated frameworks and has achieved a classification accuracy of 99.86%, sensitivity and specificity of 0.9986 for the detection of ICH in brain CT images. CONCLUSION This research has given an overview of a simple and efficient framework for the classification of hemorrhage and non-hemorrhage images. Also, the proposed simplified deep learning framework manifests its ability as a screening tool to assist the radiological trainees for the accurate detection of ICH.
Collapse
Affiliation(s)
- Praveen K
- Department of Electronics and Communication Engineering, College of Engineering, Guindy, Anna University, Sardar Patel Road, Chennai-600 025. India
| | - Sasikala M
- Department of Electronics and Communication Engineering, College of Engineering, Guindy, Anna University, Sardar Patel Road, Chennai-600 025. India
| | - Janani A
- Department of Electronics and Communication Engineering, College of Engineering, Guindy, Anna University, Sardar Patel Road, Chennai-600 025. India
| | - Nijisha Shajil
- Department of Electronics and Communication Engineering, College of Engineering, Guindy, Anna University, Sardar Patel Road, Chennai-600 025. India
| | - Hari Nishanthi V
- Department of Electronics and Communication Engineering, College of Engineering, Guindy, Anna University, Sardar Patel Road, Chennai-600 025. India
| |
Collapse
|
19
|
Nind T, Sutherland J, McAllister G, Hardy D, Hume A, MacLeod R, Caldwell J, Krueger S, Tramma L, Teviotdale R, Abdelatif M, Gillen K, Ward J, Scobbie D, Baillie I, Brooks A, Prodan B, Kerr W, Sloan-Murphy D, Herrera JFR, McManus D, Morris C, Sinclair C, Baxter R, Parsons M, Morris A, Jefferson E. An extensible big data software architecture managing a research resource of real-world clinical radiology data linked to other health data from the whole Scottish population. Gigascience 2020; 9:giaa095. [PMID: 32990744 PMCID: PMC7523405 DOI: 10.1093/gigascience/giaa095] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/13/2020] [Revised: 07/28/2020] [Accepted: 08/26/2020] [Indexed: 02/06/2023] Open
Abstract
AIM To enable a world-leading research dataset of routinely collected clinical images linked to other routinely collected data from the whole Scottish national population. This includes more than 30 million different radiological examinations from a population of 5.4 million and >2 PB of data collected since 2010. METHODS Scotland has a central archive of radiological data used to directly provide clinical care to patients. We have developed an architecture and platform to securely extract a copy of those data, link it to other clinical or social datasets, remove personal data to protect privacy, and make the resulting data available to researchers in a controlled Safe Haven environment. RESULTS An extensive software platform has been developed to host, extract, and link data from cohorts to answer research questions. The platform has been tested on 5 different test cases and is currently being further enhanced to support 3 exemplar research projects. CONCLUSIONS The data available are from a range of radiological modalities and scanner types and were collected under different environmental conditions. These real-world, heterogenous data are valuable for training algorithms to support clinical decision making, especially for deep learning where large data volumes are required. The resource is now available for international research access. The platform and data can support new health research using artificial intelligence and machine learning technologies, as well as enabling discovery science.
Collapse
Affiliation(s)
- Thomas Nind
- Health Informatics Centre (HIC), School of Medicine, University of Dundee, (Main level 5 corridor), Second Floor, Level 7, Mailbox 15, Ninewells Hospital & Medical School, Dundee DD1 9SY2, UK
| | - James Sutherland
- Health Informatics Centre (HIC), School of Medicine, University of Dundee, (Main level 5 corridor), Second Floor, Level 7, Mailbox 15, Ninewells Hospital & Medical School, Dundee DD1 9SY2, UK
| | - Gordon McAllister
- Health Informatics Centre (HIC), School of Medicine, University of Dundee, (Main level 5 corridor), Second Floor, Level 7, Mailbox 15, Ninewells Hospital & Medical School, Dundee DD1 9SY2, UK
| | - Douglas Hardy
- Health Informatics Centre (HIC), School of Medicine, University of Dundee, (Main level 5 corridor), Second Floor, Level 7, Mailbox 15, Ninewells Hospital & Medical School, Dundee DD1 9SY2, UK
| | - Ally Hume
- Edinburgh Parallel Computing Centre (EPCC), Edinburgh University, Bayes Centre, 47 Potterrow, Edinburgh EH8 9BT, UK
| | - Ruairidh MacLeod
- Edinburgh Parallel Computing Centre (EPCC), Edinburgh University, Bayes Centre, 47 Potterrow, Edinburgh EH8 9BT, UK
| | - Jacqueline Caldwell
- Electronic Data Research and Innovation Service (eDRIS), Public Health Scotland (PHS), Nine, Edinburgh Bioquarter, Little France Road, Edinburgh EH16 4UX, UK
| | - Susan Krueger
- Health Informatics Centre (HIC), School of Medicine, University of Dundee, (Main level 5 corridor), Second Floor, Level 7, Mailbox 15, Ninewells Hospital & Medical School, Dundee DD1 9SY2, UK
| | - Leandro Tramma
- Health Informatics Centre (HIC), School of Medicine, University of Dundee, (Main level 5 corridor), Second Floor, Level 7, Mailbox 15, Ninewells Hospital & Medical School, Dundee DD1 9SY2, UK
| | - Ross Teviotdale
- Health Informatics Centre (HIC), School of Medicine, University of Dundee, (Main level 5 corridor), Second Floor, Level 7, Mailbox 15, Ninewells Hospital & Medical School, Dundee DD1 9SY2, UK
| | - Mohammed Abdelatif
- Health Informatics Centre (HIC), School of Medicine, University of Dundee, (Main level 5 corridor), Second Floor, Level 7, Mailbox 15, Ninewells Hospital & Medical School, Dundee DD1 9SY2, UK
| | - Kenny Gillen
- Health Informatics Centre (HIC), School of Medicine, University of Dundee, (Main level 5 corridor), Second Floor, Level 7, Mailbox 15, Ninewells Hospital & Medical School, Dundee DD1 9SY2, UK
| | - Joe Ward
- Health Informatics Centre (HIC), School of Medicine, University of Dundee, (Main level 5 corridor), Second Floor, Level 7, Mailbox 15, Ninewells Hospital & Medical School, Dundee DD1 9SY2, UK
| | - Donald Scobbie
- Edinburgh Parallel Computing Centre (EPCC), Edinburgh University, Bayes Centre, 47 Potterrow, Edinburgh EH8 9BT, UK
| | - Ian Baillie
- Electronic Data Research and Innovation Service (eDRIS), Public Health Scotland (PHS), Nine, Edinburgh Bioquarter, Little France Road, Edinburgh EH16 4UX, UK
| | - Andrew Brooks
- Edinburgh Parallel Computing Centre (EPCC), Edinburgh University, Bayes Centre, 47 Potterrow, Edinburgh EH8 9BT, UK
| | - Bianca Prodan
- Edinburgh Parallel Computing Centre (EPCC), Edinburgh University, Bayes Centre, 47 Potterrow, Edinburgh EH8 9BT, UK
| | - William Kerr
- Edinburgh Parallel Computing Centre (EPCC), Edinburgh University, Bayes Centre, 47 Potterrow, Edinburgh EH8 9BT, UK
| | - Dominic Sloan-Murphy
- Edinburgh Parallel Computing Centre (EPCC), Edinburgh University, Bayes Centre, 47 Potterrow, Edinburgh EH8 9BT, UK
| | - Juan F R Herrera
- Edinburgh Parallel Computing Centre (EPCC), Edinburgh University, Bayes Centre, 47 Potterrow, Edinburgh EH8 9BT, UK
| | - Dan McManus
- Edinburgh Parallel Computing Centre (EPCC), Edinburgh University, Bayes Centre, 47 Potterrow, Edinburgh EH8 9BT, UK
| | - Carole Morris
- Electronic Data Research and Innovation Service (eDRIS), Public Health Scotland (PHS), Nine, Edinburgh Bioquarter, Little France Road, Edinburgh EH16 4UX, UK
| | - Carol Sinclair
- Data Driven Innovation, Public Health Scotland (PHS), Gyle Square, 1 South Gyle Crescent, Edinburgh EH12 9EB, UK
| | - Rob Baxter
- Edinburgh Parallel Computing Centre (EPCC), Edinburgh University, Bayes Centre, 47 Potterrow, Edinburgh EH8 9BT, UK
| | - Mark Parsons
- Edinburgh Parallel Computing Centre (EPCC), Edinburgh University, Bayes Centre, 47 Potterrow, Edinburgh EH8 9BT, UK
| | - Andrew Morris
- Health Data Research (HDR) UK, Gibbs Building, 215 Euston Road, London NW1 2BE, UK
| | - Emily Jefferson
- Health Informatics Centre (HIC), School of Medicine, University of Dundee, (Main level 5 corridor), Second Floor, Level 7, Mailbox 15, Ninewells Hospital & Medical School, Dundee DD1 9SY2, UK
| |
Collapse
|
20
|
Kundu S, Chakraborty S, Chatterjee S, Das S, Achari RB, Mukhopadhyay J, Das PP, Mallick I, Arunsingh M, Bhattacharyyaa T, Ray S. De-Identification of Radiomics Data Retaining Longitudinal Temporal Information. J Med Syst 2020; 44:99. [PMID: 32240368 DOI: 10.1007/s10916-020-01563-0] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/27/2019] [Accepted: 03/17/2020] [Indexed: 11/30/2022]
Abstract
We propose a de-identification system which runs in a standalone mode. The system takes care of the de-identification of radiation oncology patient's clinical and annotated imaging data including RTSTRUCT, RTPLAN, and RTDOSE. The clinical data consists of diagnosis, stages, outcome, and treatment information of the patient. The imaging data could be the diagnostic, therapy planning, and verification images. Archival of the longitudinal radiation oncology verification images like cone beam CT scans along with the initial imaging and clinical data are preserved in the process. During the de-identification, the system keeps the reference of original data identity in encrypted form. These could be useful for the re-identification if necessary.
Collapse
Affiliation(s)
| | | | - Sanjoy Chatterjee
- CSE, IIT Kharagpur, Kharagpur, India.,Tata Medical Center, Kolkata, India
| | - Syamantak Das
- CSE, IIT Kharagpur, Kharagpur, India.,Tata Medical Center, Kolkata, India
| | - Rimpa Basu Achari
- CSE, IIT Kharagpur, Kharagpur, India.,Tata Medical Center, Kolkata, India
| | | | - Partha Pratim Das
- CSE, IIT Kharagpur, Kharagpur, India.,Tata Medical Center, Kolkata, India
| | - Indranil Mallick
- CSE, IIT Kharagpur, Kharagpur, India.,Tata Medical Center, Kolkata, India
| | - Moses Arunsingh
- CSE, IIT Kharagpur, Kharagpur, India.,Tata Medical Center, Kolkata, India
| | | | - Soumendranath Ray
- CSE, IIT Kharagpur, Kharagpur, India.,Tata Medical Center, Kolkata, India
| |
Collapse
|
21
|
Holmes RB, Negus IS, Wiltshire SJ, Thorne GC, Young P. Creation of an anthropomorphic CT head phantom for verification of image segmentation. Med Phys 2020; 47:2380-2391. [PMID: 32160322 PMCID: PMC7383927 DOI: 10.1002/mp.14127] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/10/2019] [Revised: 02/21/2020] [Accepted: 02/21/2020] [Indexed: 12/25/2022] Open
Abstract
Purpose Many methods are available to segment structural magnetic resonance (MR) images of the brain into different tissue types. These have generally been developed for research purposes but there is some clinical use in the diagnosis of neurodegenerative diseases such as dementia. The potential exists for computed tomography (CT) segmentation to be used in place of MRI segmentation, but this will require a method to verify the accuracy of CT processing, particularly if algorithms developed for MR are used, as MR has notably greater tissue contrast. Methods To investigate these issues we have created a three‐dimensional (3D) printed brain with realistic Hounsfield unit (HU) values based on tissue maps segmented directly from an individual T1 MRI scan of a normal subject. Several T1 MRI scans of normal subjects from the ADNI database were segmented using SPM12 and used to create stereolithography files of different tissues for 3D printing. The attenuation properties of several material blends were investigated, and three suitable formulations were used to print an object expected to have realistic geometry and attenuation properties. A skull was simulated by coating the object with plaster of Paris impregnated bandages. Using two CT scanners, the realism of the phantom was assessed by the measurement of HU values, SPM12 segmentation and comparison with the source data used to create the phantom. Results Realistic relative HU values were measured although a subtraction of 60 was required to obtain equivalence with the expected values (gray matter 32.9–35.8 phantom, 29.9–34.2 literature). Segmentation of images acquired at different kVps/mAs showed excellent agreement with the source data (Dice Similarity Coefficient 0.79 for gray matter). The performance of two scanners with two segmentation methods was compared, with the scanners found to have similar performance and with one segmentation method clearly superior to the other. Conclusion The ability to use 3D printing to create a realistic (in terms of geometry and attenuation properties) head phantom has been demonstrated and used in an initial assessment of CT segmentation accuracy using freely available software developed for MRI.
Collapse
Affiliation(s)
- Robin B Holmes
- Department of Medical Physics and Bioengineering, University Hospitals Bristol NHS Foundation Trust, Bristol, BS28HW, UK
| | - Ian S Negus
- Department of Medical Physics and Bioengineering, University Hospitals Bristol NHS Foundation Trust, Bristol, BS28HW, UK
| | - Sophie J Wiltshire
- Department of Medical Physics and Bioengineering, University Hospitals Bristol NHS Foundation Trust, Bristol, BS28HW, UK
| | - Gareth C Thorne
- Department of Medical Physics and Bioengineering, University Hospitals Bristol NHS Foundation Trust, Bristol, BS28HW, UK
| | - Peter Young
- Umea Functional Brain Imaging Center, Umea University, 901 87, Umea, Sweden
| | | |
Collapse
|