Shape recovery algorithms using level sets in 2-D/3-D medical imagery: a state-of-the-art review

Recommended implementation of quantitative susceptibility mapping for clinical research in the brain: A consensus of the ISMRM electro-magnetic tissue properties study group

This article provides recommendations for implementing QSM for clinical brain research. It is a consensus of the International Society of Magnetic Resonance in Medicine, Electro-Magnetic Tissue Properties Study Group. While QSM technical development continues to advance rapidly, the current QSM methods have been demonstrated to be repeatable and reproducible for generating quantitative tissue magnetic susceptibility maps in the brain. However, the many QSM approaches available have generated a need in the neuroimaging community for guidelines on implementation. This article outlines considerations and implementation recommendations for QSM data acquisition, processing, analysis, and publication. We recommend that data be acquired using a monopolar 3D multi-echo gradient echo (GRE) sequence and that phase images be saved and exported in Digital Imaging and Communications in Medicine (DICOM) format and unwrapped using an exact unwrapping approach. Multi-echo images should be combined before background field removal, and a brain mask created using a brain extraction tool with the incorporation of phase-quality-based masking. Background fields within the brain mask should be removed using a technique based on SHARP or PDF, and the optimization approach to dipole inversion should be employed with a sparsity-based regularization. Susceptibility values should be measured relative to a specified reference, including the common reference region of the whole brain as a region of interest in the analysis. The minimum acquisition and processing details required when reporting QSM results are also provided. These recommendations should facilitate clinical QSM research and promote harmonized data acquisition, analysis, and reporting.

A user-friendly deep learning application for accurate lung cancer diagnosis

BACKGROUND

Accurate diagnosis and subsequent delineated treatment planning require the experience of clinicians in the handling of their case numbers. However, applying deep learning in image processing is useful in creating tools that promise faster high-quality diagnoses, but the accuracy and precision of 3-D image processing from 2-D data may be limited by factors such as superposition of organs, distortion and magnification, and detection of new pathologies. The purpose of this research is to use radiomics and deep learning to develop a tool for lung cancer diagnosis.

METHODS

This study applies radiomics and deep learning in the diagnosis of lung cancer to help clinicians accurately analyze the images and thereby provide the appropriate treatment planning. 86 patients were recruited from Bach Mai Hospital, and 1012 patients were collected from an open-source database. First, deep learning has been applied in the process of segmentation by U-NET and cancer classification via the use of the DenseNet model. Second, the radiomics were applied for measuring and calculating diameter, surface area, and volume. Finally, the hardware also was designed by connecting between Arduino Nano and MFRC522 module for reading data from the tag. In addition, the displayed interface was created on a web platform using Python through Streamlit.

RESULTS

The applied segmentation model yielded a validation loss of 0.498, a train loss of 0.27, a cancer classification validation loss of 0.78, and a training accuracy of 0.98. The outcomes of the diagnostic capabilities of lung cancer (recognition and classification of lung cancer from chest CT scans) were quite successful.

CONCLUSIONS

The model provided means for storing and updating patients' data directly on the interface which allowed the results to be readily available for the health care providers. The developed system will improve clinical communication and information exchange. Moreover, it can manage efforts by generating correlated and coherent summaries of cancer diagnoses.

DermAI 1.0: A Robust, Generalized, and Novel Attention-Enabled Ensemble-Based Transfer Learning Paradigm for Multiclass Classification of Skin Lesion Images

Skin lesion classification plays a crucial role in dermatology, aiding in the early detection, diagnosis, and management of life-threatening malignant lesions. However, standalone transfer learning (TL) models failed to deliver optimal performance. In this study, we present an attention-enabled ensemble-based deep learning technique, a powerful, novel, and generalized method for extracting features for the classification of skin lesions. This technique holds significant promise in enhancing diagnostic accuracy by using seven pre-trained TL models for classification. Six ensemble-based DL (EBDL) models were created using stacking, softmax voting, and weighted average techniques. Furthermore, we investigated the attention mechanism as an effective paradigm and created seven attention-enabled transfer learning (aeTL) models before branching out to construct three attention-enabled ensemble-based DL (aeEBDL) models to create a reliable, adaptive, and generalized paradigm. The mean accuracy of the TL models is 95.30%, and the use of an ensemble-based paradigm increased it by 4.22%, to 99.52%. The aeTL models' performance was superior to the TL models in accuracy by 3.01%, and aeEBDL models outperformed aeTL models by 1.29%. Statistical tests show significant p-value and Kappa coefficient along with a 99.6% reliability index for the aeEBDL models. The approach is highly effective and generalized for the classification of skin lesions.

Deep Learning Hybrid Techniques for Brain Tumor Segmentation

Medical images play an important role in medical diagnosis and treatment. Oncologists analyze images to determine the different characteristics of deadly diseases, plan the therapy, and observe the evolution of the disease. The objective of this paper is to propose a method for the detection of brain tumors. Brain tumors are identified from Magnetic Resonance (MR) images by performing suitable segmentation procedures. The latest technical literature concerning radiographic images of the brain shows that deep learning methods can be implemented to extract specific features of brain tumors, aiding clinical diagnosis. For this reason, most data scientists and AI researchers work on Machine Learning methods for designing automatic screening procedures. Indeed, an automated method would result in quicker segmentation findings, providing a robust output with respect to possible differences in data sources, mostly due to different procedures in data recording and storing, resulting in a more consistent identification of brain tumors. To improve the performance of the segmentation procedure, new architectures are proposed and tested in this paper. We propose deep neural networks for the detection of brain tumors, trained on the MRI scans of patients' brains. The proposed architectures are based on convolutional neural networks and inception modules for brain tumor segmentation. A comparison of these proposed architectures with the baseline reference ones shows very interesting results. MI-Unet showed a performance increase in comparison to baseline Unet architecture by 7.5% in dice score, 23.91% insensitivity, and 7.09% in specificity. Depth-wise separable MI-Unet showed a performance increase by 10.83% in dice score, 2.97% in sensitivity, and 12.72% in specificity as compared to the baseline Unet architecture. Hybrid Unet architecture achieved performance improvement of 9.71% in dice score, 3.56% in sensitivity, and 12.6% in specificity. Whereas the depth-wise separable hybrid Unet architecture outperformed the baseline architecture by 15.45% in dice score, 20.56% in sensitivity, and 12.22% in specificity.

Attention-Based UNet Deep Learning Model for Plaque Segmentation in Carotid Ultrasound for Stroke Risk Stratification: An Artificial Intelligence Paradigm

Stroke and cardiovascular diseases (CVD) significantly affect the world population. The early detection of such events may prevent the burden of death and costly surgery. Conventional methods are neither automated nor clinically accurate. Artificial Intelligence-based methods of automatically detecting and predicting the severity of CVD and stroke in their early stages are of prime importance. This study proposes an attention-channel-based UNet deep learning (DL) model that identifies the carotid plaques in the internal carotid artery (ICA) and common carotid artery (CCA) images. Our experiments consist of 970 ICA images from the UK, 379 CCA images from diabetic Japanese patients, and 300 CCA images from post-menopausal women from Hong Kong. We combined both CCA images to form an integrated database of 679 images. A rotation transformation technique was applied to 679 CCA images, doubling the database for the experiments. The cross-validation K5 (80% training: 20% testing) protocol was applied for accuracy determination. The results of the Attention-UNet model are benchmarked against UNet, UNet++, and UNet3P models. Visual plaque segmentation showed improvement in the Attention-UNet results compared to the other three models. The correlation coefficient (CC) value for Attention-UNet is 0.96, compared to 0.93, 0.96, and 0.92 for UNet, UNet++, and UNet3P models. Similarly, the AUC value for Attention-UNet is 0.97, compared to 0.964, 0.966, and 0.965 for other models. Conclusively, the Attention-UNet model is beneficial in segmenting very bright and fuzzy plaque images that are hard to diagnose using other methods. Further, we present a multi-ethnic, multi-center, racial bias-free study of stroke risk assessment.

Multicenter Study on COVID-19 Lung Computed Tomography Segmentation with varying Glass Ground Opacities using Unseen Deep Learning Artificial Intelligence Paradigms: COVLIAS 1.0 Validation

Variations in COVID-19 lesions such as glass ground opacities (GGO), consolidations, and crazy paving can compromise the ability of solo-deep learning (SDL) or hybrid-deep learning (HDL) artificial intelligence (AI) models in predicting automated COVID-19 lung segmentation in Computed Tomography (CT) from unseen data leading to poor clinical manifestations. As the first study of its kind, "COVLIAS 1.0-Unseen" proves two hypotheses, (i) contrast adjustment is vital for AI, and (ii) HDL is superior to SDL. In a multicenter study, 10,000 CT slices were collected from 72 Italian (ITA) patients with low-GGO, and 80 Croatian (CRO) patients with high-GGO. Hounsfield Units (HU) were automatically adjusted to train the AI models and predict from test data, leading to four combinations-two Unseen sets: (i) train-CRO:test-ITA, (ii) train-ITA:test-CRO, and two Seen sets: (iii) train-CRO:test-CRO, (iv) train-ITA:test-ITA. COVILAS used three SDL models: PSPNet, SegNet, UNet and six HDL models: VGG-PSPNet, VGG-SegNet, VGG-UNet, ResNet-PSPNet, ResNet-SegNet, and ResNet-UNet. Two trained, blinded senior radiologists conducted ground truth annotations. Five types of performance metrics were used to validate COVLIAS 1.0-Unseen which was further benchmarked against MedSeg, an open-source web-based system. After HU adjustment for DS and JI, HDL (Unseen AI) > SDL (Unseen AI) by 4% and 5%, respectively. For CC, HDL (Unseen AI) > SDL (Unseen AI) by 6%. The COVLIAS-MedSeg difference was < 5%, meeting regulatory guidelines.Unseen AI was successfully demonstrated using automated HU adjustment. HDL was found to be superior to SDL.

Eight pruning deep learning models for low storage and high-speed COVID-19 computed tomography lung segmentation and heatmap-based lesion localization: A multicenter study using COVLIAS 2.0

BACKGROUND

COVLIAS 1.0: an automated lung segmentation was designed for COVID-19 diagnosis. It has issues related to storage space and speed. This study shows that COVLIAS 2.0 uses pruned AI (PAI) networks for improving both storage and speed, wiliest high performance on lung segmentation and lesion localization.

METHOD

ology: The proposed study uses multicenter ∼9,000 CT slices from two different nations, namely, CroMed from Croatia (80 patients, experimental data), and NovMed from Italy (72 patients, validation data). We hypothesize that by using pruning and evolutionary optimization algorithms, the size of the AI models can be reduced significantly, ensuring optimal performance. Eight different pruning techniques (i) differential evolution (DE), (ii) genetic algorithm (GA), (iii) particle swarm optimization algorithm (PSO), and (iv) whale optimization algorithm (WO) in two deep learning frameworks (i) Fully connected network (FCN) and (ii) SegNet were designed. COVLIAS 2.0 was validated using "Unseen NovMed" and benchmarked against MedSeg. Statistical tests for stability and reliability were also conducted.

RESULTS

Pruning algorithms (i) FCN-DE, (ii) FCN-GA, (iii) FCN-PSO, and (iv) FCN-WO showed improvement in storage by 92.4%, 95.3%, 98.7%, and 99.8% respectively when compared against solo FCN, and (v) SegNet-DE, (vi) SegNet-GA, (vii) SegNet-PSO, and (viii) SegNet-WO showed improvement by 97.1%, 97.9%, 98.8%, and 99.2% respectively when compared against solo SegNet. AUC > 0.94 (p < 0.0001) on CroMed and > 0.86 (p < 0.0001) on NovMed data set for all eight EA model. PAI <0.25 s per image. DenseNet-121-based Grad-CAM heatmaps showed validation on glass ground opacity lesions.

CONCLUSIONS

Eight PAI networks that were successfully validated are five times faster, storage efficient, and could be used in clinical settings.

An artificial intelligence framework and its bias for brain tumor segmentation: A narrative review

BACKGROUND

Artificial intelligence (AI) has become a prominent technique for medical diagnosis and represents an essential role in detecting brain tumors. Although AI-based models are widely used in brain lesion segmentation (BLS), understanding their effectiveness is challenging due to their complexity and diversity. Several reviews on brain tumor segmentation are available, but none of them describe a link between the threats due to risk-of-bias (RoB) in AI and its architectures. In our review, we focused on linking RoB and different AI-based architectural Cluster in popular DL framework. Further, due to variance in these designs and input data types in medical imaging, it is necessary to present a narrative review considering all facets of BLS.

APPROACH

The proposed study uses a PRISMA strategy based on 75 relevant studies found by searching PubMed, Scopus, and Google Scholar. Based on the architectural evolution, DL studies were subsequently categorized into four classes: convolutional neural network (CNN)-based, encoder-decoder (ED)-based, transfer learning (TL)-based, and hybrid DL (HDL)-based architectures. These studies were then analyzed considering 32 AI attributes, with clusters including AI architecture, imaging modalities, hyper-parameters, performance evaluation metrics, and clinical evaluation. Then, after these studies were scored for all attributes, a composite score was computed, normalized, and ranked. Thereafter, a bias cutoff (AP(ai)Bias 1.0, AtheroPoint, Roseville, CA, USA) was established to detect low-, moderate- and high-bias studies.

CONCLUSION

The four classes of architectures, from best-to worst-performing, are TL > ED > CNN > HDL. ED-based models had the lowest AI bias for BLS. This study presents a set of three primary and six secondary recommendations for lowering the RoB.

Human activity recognition in artificial intelligence framework: a narrative review

Human activity recognition (HAR) has multifaceted applications due to its worldly usage of acquisition devices such as smartphones, video cameras, and its ability to capture human activity data. While electronic devices and their applications are steadily growing, the advances in Artificial intelligence (AI) have revolutionized the ability to extract deep hidden information for accurate detection and its interpretation. This yields a better understanding of rapidly growing acquisition devices, AI, and applications, the three pillars of HAR under one roof. There are many review articles published on the general characteristics of HAR, a few have compared all the HAR devices at the same time, and few have explored the impact of evolving AI architecture. In our proposed review, a detailed narration on the three pillars of HAR is presented covering the period from 2011 to 2021. Further, the review presents the recommendations for an improved HAR design, its reliability, and stability. Five major findings were: (1) HAR constitutes three major pillars such as devices, AI and applications; (2) HAR has dominated the healthcare industry; (3) Hybrid AI models are in their infancy stage and needs considerable work for providing the stable and reliable design. Further, these trained models need solid prediction, high accuracy, generalization, and finally, meeting the objectives of the applications without bias; (4) little work was observed in abnormality detection during actions; and (5) almost no work has been done in forecasting actions. We conclude that: (a) HAR industry will evolve in terms of the three pillars of electronic devices, applications and the type of AI. (b) AI will provide a powerful impetus to the HAR industry in future.

Supplementary Information

The online version contains supplementary material available at 10.1007/s10462-021-10116-x.

COVLIAS 1.0 vs. MedSeg: Artificial Intelligence-Based Comparative Study for Automated COVID-19 Computed Tomography Lung Segmentation in Italian and Croatian Cohorts

(1) Background: COVID-19 computed tomography (CT) lung segmentation is critical for COVID lung severity diagnosis. Earlier proposed approaches during 2020-2021 were semiautomated or automated but not accurate, user-friendly, and industry-standard benchmarked. The proposed study compared the COVID Lung Image Analysis System, COVLIAS 1.0 (GBTI, Inc., and AtheroPointTM, Roseville, CA, USA, referred to as COVLIAS), against MedSeg, a web-based Artificial Intelligence (AI) segmentation tool, where COVLIAS uses hybrid deep learning (HDL) models for CT lung segmentation. (2) Materials and Methods: The proposed study used 5000 ITALIAN COVID-19 positive CT lung images collected from 72 patients (experimental data) that confirmed the reverse transcription-polymerase chain reaction (RT-PCR) test. Two hybrid AI models from the COVLIAS system, namely, VGG-SegNet (HDL 1) and ResNet-SegNet (HDL 2), were used to segment the CT lungs. As part of the results, we compared both COVLIAS and MedSeg against two manual delineations (MD 1 and MD 2) using (i) Bland-Altman plots, (ii) Correlation coefficient (CC) plots, (iii) Receiver operating characteristic curve, and (iv) Figure of Merit and (v) visual overlays. A cohort of 500 CROATIA COVID-19 positive CT lung images (validation data) was used. A previously trained COVLIAS model was directly applied to the validation data (as part of Unseen-AI) to segment the CT lungs and compare them against MedSeg. (3) Result: For the experimental data, the four CCs between COVLIAS (HDL 1) vs. MD 1, COVLIAS (HDL 1) vs. MD 2, COVLIAS (HDL 2) vs. MD 1, and COVLIAS (HDL 2) vs. MD 2 were 0.96, 0.96, 0.96, and 0.96, respectively. The mean value of the COVLIAS system for the above four readings was 0.96. CC between MedSeg vs. MD 1 and MedSeg vs. MD 2 was 0.98 and 0.98, respectively. Both had a mean value of 0.98. On the validation data, the CC between COVLIAS (HDL 1) vs. MedSeg and COVLIAS (HDL 2) vs. MedSeg was 0.98 and 0.99, respectively. For the experimental data, the difference between the mean values for COVLIAS and MedSeg showed a difference of <2.5%, meeting the standard of equivalence. The average running times for COVLIAS and MedSeg on a single lung CT slice were ~4 s and ~10 s, respectively. (4) Conclusions: The performances of COVLIAS and MedSeg were similar. However, COVLIAS showed improved computing time over MedSeg.

Unseen Artificial Intelligence-Deep Learning Paradigm for Segmentation of Low Atherosclerotic Plaque in Carotid Ultrasound: A Multicenter Cardiovascular Study

BACKGROUND

The early detection of carotid wall plaque is recommended in the prevention of cardiovascular disease (CVD) in moderate-risk patients. Previous techniques for B-mode carotid atherosclerotic wall plaque segmentation used artificial intelligence (AI) methods on monoethnic databases, where training and testing are from the "same" ethnic group ("Seen AI"). Therefore, the versatility of the system is questionable. This is the first study of its kind that uses the "Unseen AI" paradigm where training and testing are from "different" ethnic groups. We hypothesized that deep learning (DL) models should perform in 10% proximity between "Unseen AI" and "Seen AI".

METHODOLOGY

Two cohorts from multi-ethnic groups (330 Japanese and 300 Hong Kong (HK)) were used for the validation of our hypothesis. We used a four-layered UNet architecture for the segmentation of the atherosclerotic wall with low plaque. "Unseen AI" (training: Japanese, testing: HK or vice versa) and "Seen AI" experiments (single ethnicity or mixed ethnicity) were performed. Evaluation was conducted by measuring the wall plaque area. Statistical tests were conducted for its stability and reliability.

RESULTS

When using the UNet DL architecture, the "Unseen AI" pair one (Training: 330 Japanese and Testing: 300 HK), the mean accuracy, dice-similarity, and correlation-coefficient were 98.55, 78.38, and 0.80 (p < 0.0001), respectively, while for "Unseen AI" pair two (Training: 300 HK and Testing: 330 Japanese), these were 98.67, 82.49, and 0.87 (p < 0.0001), respectively. Using "Seen AI", the same parameters were 99.01, 86.89 and 0.92 (p < 0.0001), respectively.

CONCLUSION

We demonstrated that "Unseen AI" was in close proximity (<10%) to "Seen AI", validating our DL model for low atherosclerotic wall plaque segmentation. The online system runs < 1 s.

Inter-Variability Study of COVLIAS 1.0: Hybrid Deep Learning Models for COVID-19 Lung Segmentation in Computed Tomography

Background: For COVID-19 lung severity, segmentation of lungs on computed tomography (CT) is the first crucial step. Current deep learning (DL)-based Artificial Intelligence (AI) models have a bias in the training stage of segmentation because only one set of ground truth (GT) annotations are evaluated. We propose a robust and stable inter-variability analysis of CT lung segmentation in COVID-19 to avoid the effect of bias. Methodology: The proposed inter-variability study consists of two GT tracers for lung segmentation on chest CT. Three AI models, PSP Net, VGG-SegNet, and ResNet-SegNet, were trained using GT annotations. We hypothesized that if AI models are trained on the GT tracings from multiple experience levels, and if the AI performance on the test data between these AI models is within the 5% range, one can consider such an AI model robust and unbiased. The K5 protocol (training to testing: 80%:20%) was adapted. Ten kinds of metrics were used for performance evaluation. Results: The database consisted of 5000 CT chest images from 72 COVID-19-infected patients. By computing the coefficient of correlations (CC) between the output of the two AI models trained corresponding to the two GT tracers, computing their differences in their CC, and repeating the process for all three AI-models, we show the differences as 0%, 0.51%, and 2.04% (all < 5%), thereby validating the hypothesis. The performance was comparable; however, it had the following order: ResNet-SegNet > PSP Net > VGG-SegNet. Conclusions: The AI models were clinically robust and stable during the inter-variability analysis on the CT lung segmentation on COVID-19 patients.

Recent Advancements in Fuzzy C-means Based Techniques for Brain MRI Segmentation

BACKGROUND

Variations of image segmentation techniques, particularly those used for Brain MRI segmentation, vary in complexity from basic standard Fuzzy C-means (FCM) to more complex and enhanced FCM techniques.

OBJECTIVE

In this paper, a comprehensive review is presented on all thirteen variations of FCM segmentation techniques. In the review process, the concentration is on the use of FCM segmentation techniques for brain tumors. Brain tumor segmentation is a vital step in the process of automatically diagnosing brain tumors. Unlike segmentation of other types of images, brain tumor segmentation is a very challenging task due to the variations in brain anatomy. The low contrast of brain images further complicates this process. Early diagnosis of brain tumors is indeed beneficial to patients, doctors, and medical providers.

RESULTS

FCM segmentation works on images obtained from magnetic resonance imaging (MRI) scanners, requiring minor modifications to hospital operations to early diagnose tumors as most, if not all, hospitals rely on MRI machines for brain imaging.

CONCLUSION

In this paper, we critically review and summarize FCM based techniques for brain MRI segmentation.

A Review on Joint Carotid Intima-Media Thickness and Plaque Area Measurement in Ultrasound for Cardiovascular/Stroke Risk Monitoring: Artificial Intelligence Framework

Cardiovascular diseases (CVDs) are the top ten leading causes of death worldwide. Atherosclerosis disease in the arteries is the main cause of the CVD, leading to myocardial infarction and stroke. The two primary image-based phenotypes used for monitoring the atherosclerosis burden is carotid intima-media thickness (cIMT) and plaque area (PA). Earlier segmentation and measurement methods were based on ad hoc conventional and semi-automated digital imaging solutions, which are unreliable, tedious, slow, and not robust. This study reviews the modern and automated methods such as artificial intelligence (AI)-based. Machine learning (ML) and deep learning (DL) can provide automated techniques in the detection and measurement of cIMT and PA from carotid vascular images. Both ML and DL techniques are examples of supervised learning, i.e., learn from "ground truth" images and transformation of test images that are not part of the training. This review summarizes (1) the evolution and impact of the fast-changing AI technology on cIMT/PA measurement, (2) the mathematical representations of ML/DL methods, and (3) segmentation approaches for cIMT/PA regions in carotid scans based for (a) region-of-interest detection and (b) lumen-intima and media-adventitia interface detection using ML/DL frameworks. AI-based methods for cIMT/PA segmentation have emerged for CVD/stroke risk monitoring and may expand to the recommended parameters for atherosclerosis assessment by carotid ultrasound.

Integration of cardiovascular risk assessment with COVID-19 using artificial intelligence

Artificial Intelligence (AI), in general, refers to the machines (or computers) that mimic "cognitive" functions that we associate with our mind, such as "learning" and "solving problem". New biomarkers derived from medical imaging are being discovered and are then fused with non-imaging biomarkers (such as office, laboratory, physiological, genetic, epidemiological, and clinical-based biomarkers) in a big data framework, to develop AI systems. These systems can support risk prediction and monitoring. This perspective narrative shows the powerful methods of AI for tracking cardiovascular risks. We conclude that AI could potentially become an integral part of the COVID-19 disease management system. Countries, large and small, should join hands with the WHO in building biobanks for scientists around the world to build AI-based platforms for tracking the cardiovascular risk assessment during COVID-19 times and long-term follow-up of the survivors.

Artificial intelligence framework for predictive cardiovascular and stroke risk assessment models: A narrative review of integrated approaches using carotid ultrasound

RECENT FINDINGS

Cardiovascular disease (CVD) is the leading cause of mortality and poses challenges for healthcare providers globally. Risk-based approaches for the management of CVD are becoming popular for recommending treatment plans for asymptomatic individuals. Several conventional predictive CVD risk models based do not provide an accurate CVD risk assessment for patients with different baseline risk profiles. Artificial intelligence (AI) algorithms have changed the landscape of CVD risk assessment and demonstrated a better performance when compared against conventional models, mainly due to its ability to handle the input nonlinear variations. Further, it has the flexibility to add risk factors derived from medical imaging modalities that image the morphology of the plaque. The integration of noninvasive carotid ultrasound image-based phenotypes with conventional risk factors in the AI framework has further provided stronger power for CVD risk prediction, so-called "integrated predictive CVD risk models."

PURPOSE

of the review: The objective of this review is (i) to understand several aspects in the development of predictive CVD risk models, (ii) to explore current conventional predictive risk models and their successes and challenges, and (iii) to refine the search for predictive CVD risk models using noninvasive carotid ultrasound as an exemplar in the artificial intelligence-based framework.

CONCLUSION

Conventional predictive CVD risk models are suboptimal and could be improved. This review examines the potential to include more noninvasive image-based phenotypes in the CVD risk assessment using powerful AI-based strategies.

Matlab® toolbox for semi-automatic segmentation of the human nasal cavity based on active shape modeling

The nose is a complex and important organ with a multitude of functions. Computational fluid dynamics (CFD) has been shown to be a valuable tool to obtain a better understanding of the functioning of the nose. CFD simulations require a surface geometry, which is constructed from tomographic data. This can be a very time-consuming task when one chooses to exclude the sinuses from the simulation domain, which in general keeps the size of the CFD model more manageable. In this work, an approach for the semi-automatic construction of the human nasal cavity is presented. In the first part, limited manual interaction is needed to create a coarse surface model. In the next part, this result is further refined based on the combination of active shape modeling with elastic surface deformation. The different steps are bundled in a Matlab toolbox with a graphical interface which guides the user. This interface allows easy manipulation of the data during intermediate steps, and also allows manual adjustments of the reconstructed nasal surface at the end. Two results are shown, and the approach and its precision are discussed. These results demonstrated that the followed approach can be used for the semi-automatic segmentation of a human nasal cavity from tomographic data, substantially reducing the amount of operator time.

Deep learning fully convolution network for lumen characterization in diabetic patients using carotid ultrasound: a tool for stroke risk

Manual ultrasound (US)-based methods are adapted for lumen diameter (LD) measurement to estimate the risk of stroke but they are tedious, error prone, and subjective causing variability. We propose an automated deep learning (DL)-based system for lumen detection. The system consists of a combination of two DL systems: encoder and decoder for lumen segmentation. The encoder employs a 13-layer convolution neural network model (CNN) for rich feature extraction. The decoder employs three up-sample layers of fully convolution network (FCN) for lumen segmentation. Three sets of manual tracings were used during the training paradigm leading to the design of three DL systems. Cross-validation protocol was implemented for all three DL systems. Using the polyline distance metric, the precision of merit for three DL systems over 407 US scans was 99.61%, 97.75%, and 99.89%, respectively. The Jaccard index and Dice similarity of DL lumen segmented region against three ground truth (GT) regions were 0.94, 0.94, and 0.93 and 0.97, 0.97, and 0.97, respectively. The corresponding AUC for three DL systems was 0.95, 0.91, and 0.93. The experimental results demonstrated superior performance of proposed deep learning system over conventional methods in literature. Graphical abstract ᅟ.

State-of-the-art review on automated lumen and adventitial border delineation and its measurements in carotid ultrasound

BACKGROUND AND OBJECTIVE

Accurate, reliable, efficient, and precise measurements of the lumen geometry of the common carotid artery (CCA) are important for (a) managing the progression/regression of atherosclerotic build-up and (b) the risk of stroke. The image-based degree of stenosis in the carotid artery and the plaque burden can be predicted using the automated carotid lumen diameter (LD)/inter-adventitial diameter (IAD) measurements from B-mode ultrasound images. The objective of this review is to present the state-of-the-art methods and systems for the measurement of LD/IAD in CCA based on automated or semi-automated strategies. Further, the performance of these systems is compared based on various metrics for its measurements.

METHODS

The automated algorithms proposed for the segmentation of carotid lumen are broadly classified into two different categories as: region-based and boundary-based. These techniques are discussed in detail specifying their pros and cons. Further, we discuss the challenges encountered in the segmentation process along with its quantitative assessment. Lastly, we present stenosis quantification and risk stratification strategies.

RESULTS

Even though, we have found more boundary-based approaches compared to region-based approaches in the literature, however, the region-based strategy yield more satisfactory performance. Novel risk stratification strategies are presented. On a patient database containing 203 patients, 9 patients are identified as high risk patients, whereas 27 patients are identified as medium risk patients.

CONCLUSIONS

We have presented different techniques for the lumen segmentation of the common carotid artery from B-mode ultrasound images and measurement of lumen diameter and inter-adventitial diameter. We believe that the issue regarding boundary-based techniques can be compensated by taking regional statistics embedded with boundary-based information.

Histological coherent Raman imaging: a prognostic review

Histopathology plays a central role in diagnosis of many diseases including solid cancers. Efforts are underway to transform this subjective art to an objective and quantitative science. Coherent Raman imaging (CRI), a label-free imaging modality with sub-cellular spatial resolution and molecule-specific contrast possesses characteristics which could support the qualitative-to-quantitative transition of histopathology. In this work we briefly survey major themes related to modernization of histopathology, review applications of CRI to histopathology and, finally, discuss potential roles for CRI in the transformation of histopathology that is already underway.

Adaptive Estimation of Active Contour Parameters Using Convolutional Neural Networks and Texture Analysis

In this paper, we propose a generalization of the level set segmentation approach by supplying a novel method for adaptive estimation of active contour parameters. The presented segmentation method is fully automatic once the lesion has been detected. First, the location of the level set contour relative to the lesion is estimated using a convolutional neural network (CNN). The CNN has two convolutional layers for feature extraction, which lead into dense layers for classification. Second, the output CNN probabilities are then used to adaptively calculate the parameters of the active contour functional during the segmentation process. Finally, the adaptive window size surrounding each contour point is re-estimated by an iterative process that considers lesion size and spatial texture. We demonstrate the capabilities of our method on a dataset of 164 MRI and 112 CT images of liver lesions that includes low contrast and heterogeneous lesions as well as noisy images. To illustrate the strength of our method, we evaluated it against state of the art CNN-based and active contour techniques. For all cases, our method, as assessed by Dice similarity coefficients, performed significantly better than currently available methods. An average Dice improvement of 0.27 was found across the entire dataset over all comparisons. We also analyzed two challenging subsets of lesions and obtained a significant Dice improvement of 0.24 with our method (p <;0.001, Wilcoxon).

Accurate lumen diameter measurement in curved vessels in carotid ultrasound: an iterative scale-space and spatial transformation approach

Monitoring of cerebrovascular diseases via carotid ultrasound has started to become a routine. The measurement of image-based lumen diameter (LD) or inter-adventitial diameter (IAD) is a promising approach for quantification of the degree of stenosis. The manual measurements of LD/IAD are not reliable, subjective and slow. The curvature associated with the vessels along with non-uniformity in the plaque growth poses further challenges. This study uses a novel and generalized approach for automated LD and IAD measurement based on a combination of spatial transformation and scale-space. In this iterative procedure, the scale-space is first used to get the lumen axis which is then used with spatial image transformation paradigm to get a transformed image. The scale-space is then reapplied to retrieve the lumen region and boundary in the transformed framework. Then, inverse transformation is applied to display the results in original image framework. Two hundred and two patients' left and right common carotid artery (404 carotid images) B-mode ultrasound images were retrospectively analyzed. The validation of our algorithm has done against the two manual expert tracings. The coefficient of correlation between the two manual tracings for LD was 0.98 (p < 0.0001) and 0.99 (p < 0.0001), respectively. The precision of merit between the manual expert tracings and the automated system was 97.7 and 98.7%, respectively. The experimental analysis demonstrated superior performance of the proposed method over conventional approaches. Several statistical tests demonstrated the stability and reliability of the automated system.

Lung nodule malignancy classification using only radiologist-quantified image features as inputs to statistical learning algorithms: probing the Lung Image Database Consortium dataset with two statistical learning methods

In the assessment of nodules in CT scans of the lungs, a number of image-derived features are diagnostically relevant. Currently, many of these features are defined only qualitatively, so they are difficult to quantify from first principles. Nevertheless, these features (through their qualitative definitions and interpretations thereof) are often quantified via a variety of mathematical methods for the purpose of computer-aided diagnosis (CAD). To determine the potential usefulness of quantified diagnostic image features as inputs to a CAD system, we investigate the predictive capability of statistical learning methods for classifying nodule malignancy. We utilize the Lung Image Database Consortium dataset and only employ the radiologist-assigned diagnostic feature values for the lung nodules therein, as well as our derived estimates of the diameter and volume of the nodules from the radiologists' annotations. We calculate theoretical upper bounds on the classification accuracy that are achievable by an ideal classifier that only uses the radiologist-assigned feature values, and we obtain an accuracy of 85.74 [Formula: see text], which is, on average, 4.43% below the theoretical maximum of 90.17%. The corresponding area-under-the-curve (AUC) score is 0.932 ([Formula: see text]), which increases to 0.949 ([Formula: see text]) when diameter and volume features are included and has an accuracy of 88.08 [Formula: see text]. Our results are comparable to those in the literature that use algorithmically derived image-based features, which supports our hypothesis that lung nodules can be classified as malignant or benign using only quantified, diagnostic image features, and indicates the competitiveness of this approach. We also analyze how the classification accuracy depends on specific features and feature subsets, and we rank the features according to their predictive power, statistically demonstrating the top four to be spiculation, lobulation, subtlety, and calcification.

Image Quality Assessment via Segmentation of Breast Lesion in X-ray and Ultrasound Phantom Images from Fischer's Full Field Digital Mammography and Ultrasound (FFDMUS) System

Fischer has been developing a fused full-field digital mammography and ultrasound (FFDMUS) system funded by the National Institute of Health (NIH). In FFDMUS, two sets of acquisitions are performed: 2-D X-ray and 3-D ultrasound. The segmentation of acquired lesions in phantom images is important: (i) to assess the image quality of X-ray and ultrasound images; (ii) to register multi-modality images; and (iii) to establish an automatic lesion detection methodology to assist the radiologist.

In this paper we developed lesion segmentation strategies for ultrasound and X-ray images acquired using FFDMUS. For ultrasound lesion segmentation, a signal-to-noise (SNR)-based method was adapted. For X-ray segmentation, we used gradient vector flow (GVF)-based deformable model. The performance of these segmentation algorithms was evaluated. We also performed partial volume correction (PVC) analysis on the segmentation of ultrasound images. For X-ray lesion segmentation, we also studied the effect of PDE smoothing on GVF's ability to segment the lesion.

We conclude that ultrasound image qualities from FFDMUS and Hand-Held ultrasound (HHUS) are comparable. The mean percentage error with PVC was 4.56% (4.31%) and 6.63% (5.89%) for 5 mm lesion and 3 mm lesion respectively. The mean average error from the segmented X-ray images with PDE yielded an average error of 9.61%. We also tested our program on synthetic datasets. The system was developed for Linux workstation using C/C++.

Two Automated Techniques for Carotid Lumen Diameter Measurement: Regional versus Boundary Approaches

The degree of stenosis in the carotid artery can be predicted using automated carotid lumen diameter (LD) measured from B-mode ultrasound images. Systolic velocity-based methods for measurement of LD are subjective. With the advancement of high resolution imaging, image-based methods have started to emerge. However, they require robust image analysis for accurate LD measurement. This paper presents two different algorithms for automated segmentation of the lumen borders in carotid ultrasound images. Both algorithms are modeled as a two stage process. Stage one consists of a global-based model using scale-space framework for the extraction of the region of interest. This stage is common to both algorithms. Stage two is modeled using a local-based strategy that extracts the lumen interfaces. At this stage, the algorithm-1 is modeled as a region-based strategy using a classification framework, whereas the algorithm-2 is modeled as a boundary-based approach that uses the level set framework. Two sets of databases (DB), Japan DB (JDB) (202 patients, 404 images) and Hong Kong DB (HKDB) (50 patients, 300 images) were used in this study. Two trained neuroradiologists performed manual LD tracings. The mean automated LD measured was 6.35 ± 0.95 mm for JDB and 6.20 ± 1.35 mm for HKDB. The precision-of-merit was: 97.4 % and 98.0 % w.r.t to two manual tracings for JDB and 99.7 % and 97.9 % w.r.t to two manual tracings for HKDB. Statistical tests such as ANOVA, Chi-Squared, T-test, and Mann-Whitney test were conducted to show the stability and reliability of the automated techniques.

Measuring the Effect of Filters on Segmentation of Developmental Dysplasia of the Hip

Background

Developmental dysplasia of the hip (DDH) can be detected with ultrasonography (USG) images. However, the accuracy of this method is dependent on the skill of the radiologist. Radiologists measure the hip joint angles without computer-based diagnostic systems. This causes mistakes in the diagnosis of DDH.

Objectives

In this study, we aimed to automate segmentation of DDH ultrasound images in order to make it convenient for radiologic diagnosis by this recommended system.

Materials and Methods

This experiment consisted of several steps, in which pure DDH and various noise-added images were formed. Then, seven different filters (mean, median, Gaussian, Wiener, Perona and Malik, Lee, and Frost) were applied to the images, and the output images were evaluated. The study initially evaluated the filter implementations on the pure DDH images. Then, three different noise functions, speckle, salt and pepper, and Gaussian, were applied to the images and the noisy images were filtered. In the last part, the peak signal to noise ratio (PSNR) and mean square error (MSE) values of the filtered images were evaluated. PSNR and MSE distortion measurements were applied to determine the image qualities of the original image and the output image. As a result, the differences in the results of different noise removal filters were observed.

Results

The best results of PSNR values obtained in filtering were: Wiener (43.49), Perona and Malik (27.68), median (40.60) and Lee (35.35) for the noise functions of raw images, Gaussian noise added, salt and pepper noise added and speckle noise added images, respectively. After the segmentation process, it was seen that applying filtering to DDH USG images had low influence. We correctly segmented the ilium zone with the active contour model.

Conclusion

Various filters are needed to improve the image quality. In this study, seven different filters were implemented and investigated on both noisy and noise-free images.

Level set method coupled with Energy Image features for brain MR image segmentation

Up until now, the noise and intensity inhomogeneity are considered one of the major drawbacks in the field of brain magnetic resonance (MR) image segmentation. This paper introduces the energy image feature approach for intensity inhomogeneity correction. Our approach of segmentation takes the advantage of image features and preserves the advantages of the level set methods in region-based active contours framework. The energy image feature represents a new image obtained from the original image when the pixels' values are replaced by local energy values computed in the 3×3 mask size. The performance and utility of the energy image features were tested and compared through two different variants of level set methods: one as the encompassed local and global intensity fitting method and the other as the selective binary and Gaussian filtering regularized level set method. The reported results demonstrate the flexibility of the energy image feature to adapt to level set segmentation framework and to perform the challenging task of brain lesion segmentation in a rather robust way.

Methods for nuclei detection, segmentation, and classification in digital histopathology: a review-current status and future potential

Digital pathology represents one of the major evolutions in modern medicine. Pathological examinations constitute the gold standard in many medical protocols, and also play a critical and legal role in the diagnosis process. In the conventional cancer diagnosis, pathologists analyze biopsies to make diagnostic and prognostic assessments, mainly based on the cell morphology and architecture distribution. Recently, computerized methods have been rapidly evolving in the area of digital pathology, with growing applications related to nuclei detection, segmentation, and classification. In cancer research, these approaches have played, and will continue to play a key (often bottleneck) role in minimizing human intervention, consolidating pertinent second opinions, and providing traceable clinical information. Pathological studies have been conducted for numerous cancer detection and grading applications, including brain, breast, cervix, lung, and prostate cancer grading. Our study presents, discusses, and extracts the major trends from an exhaustive overview of various nuclei detection, segmentation, feature computation, and classification techniques used in histopathology imagery, specifically in hematoxylin-eosin and immunohistochemical staining protocols. This study also enables us to measure the challenges that remain, in order to reach robust analysis of whole slide images, essential high content imaging with diagnostic biomarkers and prognosis support in digital pathology.

Detection and Reconstruction of an Implicit Boundary Surface by Adaptively Expanding A Small Surface Patch in a 3D Image

In this paper we propose a novel and easy to use 3D reconstruction method. With the method, users only need to specify a small boundary surface patch in a 2D section image, and then an entire continuous implicit boundary surface (CIBS) can be automatically reconstructed from a 3D image. In the method, a hierarchical tracing strategy is used to grow the known boundary surface patch gradually in the 3D image. An adaptive detection technique is applied to detect boundary surface patches from different local regions. The technique is based on both context dependence and adaptive contrast detection as in the human vision system. A recognition technique is used to distinguish true boundary surface patches from the false ones in different cubes. By integrating these different approaches, a high-resolution CIBS model can be automatically reconstructed by adaptively expanding the small boundary surface patch in the 3D image. The effectiveness of our method is demonstrated by its applications to a variety of real 3D images, where the CIBS with complex shapes/branches and with varying gray values/gradient magnitudes can be well reconstructed. Our method is easy to use, which provides a valuable tool for 3D image visualization and analysis as needed in many applications.

Parallelized seeded region growing using CUDA

This paper presents a novel method for parallelizing the seeded region growing (SRG) algorithm using Compute Unified Device Architecture (CUDA) technology, with intention to overcome the theoretical weakness of SRG algorithm of its computation time being directly proportional to the size of a segmented region. The segmentation performance of the proposed CUDA-based SRG is compared with SRG implementations on single-core CPUs, quad-core CPUs, and shader language programming, using synthetic datasets and 20 body CT scans. Based on the experimental results, the CUDA-based SRG outperforms the other three implementations, advocating that it can substantially assist the segmentation during massive CT screening tests.

A method for automatic segmentation of nuclei in phase-contrast images based on intensity, convexity and texture

This paper presents a method for automatic segmentation of nuclei in phase-contrast images using the intensity, convexity and texture of the nuclei. The proposed method consists of three main stages: preprocessing, h-maxima transformation-based marker controlled watershed segmentation ( h-TMC), and texture analysis. In the preprocessing stage, a top-hat filter is used to increase the contrast and suppress the non-uniform illumination, shading, and other imaging artifacts in the input image. The nuclei segmentation stage consists of a distance transformation, h-maxima transformation and watershed segmentation. These transformations utilize the intensity information and the convexity property of the nucleus for the purpose of detecting a single marker in every nucleus; these markers are then used in the h-TMC watershed algorithm to obtain segments of the nuclei. However, dust particles, imaging artifacts, or prolonged cell cytoplasm may falsely be segmented as nuclei at this stage, and thus may lead to an inaccurate analysis of the cell image. In order to identify and remove these non-nuclei segments, in the third stage a texture analysis is performed, that uses six of the Haralick measures along with the AdaBoost algorithm. The novelty of the proposed method is that it introduces a systematic framework that utilizes intensity, convexity, and texture information to achieve a high accuracy for automatic segmentation of nuclei in the phase-contrast images. Extensive experiments are performed demonstrating the superior performance ( precision = 0.948; recall = 0.924; F1-measure = 0.936; validation based on  ∼ 4850 manually-labeled nuclei) of the proposed method.

Development of a new generation of high-resolution anatomical models for medical device evaluation: the Virtual Population 3.0

The Virtual Family computational whole-body anatomical human models were originally developed for electromagnetic (EM) exposure evaluations, in particular to study how absorption of radiofrequency radiation from external sources depends on anatomy. However, the models immediately garnered much broader interest and are now applied by over 300 research groups, many from medical applications research fields. In a first step, the Virtual Family was expanded to the Virtual Population to provide considerably broader population coverage with the inclusion of models of both sexes ranging in age from 5 to 84 years old. Although these models have proven to be invaluable for EM dosimetry, it became evident that significantly enhanced models are needed for reliable effectiveness and safety evaluations of diagnostic and therapeutic applications, including medical implants safety. This paper describes the research and development performed to obtain anatomical models that meet the requirements necessary for medical implant safety assessment applications. These include implementation of quality control procedures, re-segmentation at higher resolution, more-consistent tissue assignments, enhanced surface processing and numerous anatomical refinements. Several tools were developed to enhance the functionality of the models, including discretization tools, posing tools to expand the posture space covered, and multiple morphing tools, e.g., to develop pathological models or variations of existing ones. A comprehensive tissue properties database was compiled to complement the library of models. The results are a set of anatomically independent, accurate, and detailed models with smooth, yet feature-rich and topologically conforming surfaces. The models are therefore suited for the creation of unstructured meshes, and the possible applications of the models are extended to a wider range of solvers and physics. The impact of these improvements is shown for the MRI exposure of an adult woman with an orthopedic spinal implant. Future developments include the functionalization of the models for specific physical and physiological modeling tasks.

A hybrid method based on fuzzy clustering and local region-based level set for segmentation of inhomogeneous medical images

medical images are more affected by intensity inhomogeneity rather than noise and outliers. This has a great impact on the efficiency of region-based image segmentation methods, because they rely on homogeneity of intensities in the regions of interest. Meanwhile, initialization and configuration of controlling parameters affect the performance of level set segmentation. To address these problems, this paper proposes a new hybrid method that integrates a local region-based level set method with a variation of fuzzy clustering. Specifically it takes an information fusion approach based on a coarse-to-fine framework that seamlessly fuses local spatial information and gray level information with the information of the local region-based level set method. Also, the controlling parameters of level set are directly computed from fuzzy clustering result. This approach has valuable benefits such as automation, no need to prior knowledge about the region of interest (ROI), robustness on intensity inhomogeneity, automatic adjustment of controlling parameters, insensitivity to initialization, and satisfactory accuracy. So, the contribution of this paper is to provide these advantages together which have not been proposed yet for inhomogeneous medical images. Proposed method was tested on several medical images from different modalities for performance evaluation. Experimental results approve its effectiveness in segmenting medical images in comparison with similar methods.

Semiautomated analysis of carotid artery wall thickness in MRI

PURPOSE

To develop a semiautomatic method based on level set method (LSM) for carotid arterial wall thickness (CAWT) measurement.

MATERIALS AND METHODS

Magnetic resonance imaging (MRI) of diseased carotid arteries was acquired from 10 patients. Ground truth (GT) data for arterial wall segmentation was collected from three experienced vascular clinicians. The semiautomatic variational LSM was employed to segment lumen and arterial wall outer boundaries on 102 MR images. Two computer-based measurements, arterial wall thickness (WT) and arterial wall area (AWA), were computed and compared with GT. Linear regression, Bland-Altman, and bias correlation analysis on WT and AWA were applied for evaluating the performance of the semiautomatic method.

RESULTS

Arterial wall thickness measured by radial distance measure (RDM) and polyline distance measure (PDM) correlated well between GT and variational LSM (r = 0.83 for RDM and r = 0.64 for PDM, P < 0.05). The absolute arterial wall area bias between LSM and three observers is less than 10%, suggesting LSM can segment arterial wall well compared with manual tracings. The Jaccard Similarity (Js ) analysis showed a good agreement for the segmentation results between proposed method and GT (Js 0.71 ± 0.08), the mean curve distance for lumen boundary is 0.34 ± 0.2 mm between the proposed method and GT, and 0.47 ± 0.2 mm for outer wall boundary.

CONCLUSION

The proposed LSM can generate reasonably accurate lumen and outer wall boundaries compared to manual segmentation, and can work similar to a human reader. However, it tends to overestimate CAWT and AWA compared to the manual segmentation for arterial wall with small area.

A Nonlinear Adaptive Level Set for Image Segmentation

In this paper, we present a novel level set method (LSM) for image segmentation. By utilizing the Bayesian rule, we design a nonlinear adaptive velocity and a probability-weighted stopping force to implement a robust segmentation for objects with weak boundaries. The proposed method is featured by the following three properties: 1) it automatically determines the curve to shrink or expand by utilizing the Bayesian rule to involve the regional features of images; 2) it drives the curve evolve with an appropriate speed to avoid the leakage at weak boundaries; and 3) it reduces the influence of false boundaries, i.e., edges far away from objects of interest. We applied the proposed segmentation method to artificial images, medical images and the BSD-300 image dataset for qualitative and quantitative evaluations. The comparison results show the proposed method performs competitively, compared with the LSM and its representative variants.

A new kernel-based fuzzy level set method for automated segmentation of medical images in the presence of intensity inhomogeneity

Researchers recently apply an integrative approach to automate medical image segmentation for benefiting available methods and eliminating their disadvantages. Intensity inhomogeneity is a challenging and open problem in this area, which has received less attention by this approach. It has considerable effects on segmentation accuracy. This paper proposes a new kernel-based fuzzy level set algorithm by an integrative approach to deal with this problem. It can directly evolve from the initial level set obtained by Gaussian Kernel-Based Fuzzy C-Means (GKFCM). The controlling parameters of level set evolution are also estimated from the results of GKFCM. Moreover the proposed algorithm is enhanced with locally regularized evolution based on an image model that describes the composition of real-world images, in which intensity inhomogeneity is assumed as a component of an image. Such improvements make level set manipulation easier and lead to more robust segmentation in intensity inhomogeneity. The proposed algorithm has valuable benefits including automation, invariant of intensity inhomogeneity, and high accuracy. Performance evaluation of the proposed algorithm was carried on medical images from different modalities. The results confirm its effectiveness for medical image segmentation.

3D Reconstruction of virtual colon structures from colonoscopy images

This paper presents the first fully automated reconstruction technique of 3D virtual colon segments from individual colonoscopy images. It is the basis of new software applications that may offer great benefits for improving quality of care for colonoscopy patients. For example, a 3D map of the areas inspected and uninspected during colonoscopy can be shown on request of the endoscopist during the procedure. The endoscopist may revisit the suggested uninspected areas to reduce the chance of missing polyps that reside in these areas. The percentage of the colon surface seen by the endoscopist can be used as a coarse objective indicator of the quality of the procedure. The derived virtual colon models can be stored for post-procedure training of new endoscopists to teach navigation techniques that result in a higher level of procedure quality. Our technique does not require a prior CT scan of the colon or any global positioning device. Our experiments on endoscopy images of an Olympus synthetic colon model reveal encouraging results with small average reconstruction errors (4.1 mm for the fold depths and 12.1 mm for the fold circumferences).

A 3D visualization method for bladder filling examination based on EIT

As the researches of electric impedance tomography (EIT) applications in medical examinations deepen, we attempt to produce the visualization of 3D images of human bladder. In this paper, a planar electrode array system will be introduced as the measuring platform and a series of feasible methods are proposed to evaluate the simulated volume of bladder to avoid overfilling. The combined regularization algorithm enhances the spatial resolution and presents distinguishable sketch of disturbances from the background, which provides us with reliable data from inverse problem to carry on to the three-dimensional reconstruction. By detecting the edge elements and tracking down the lost information, we extract quantitative morphological features of the object from the noises and background. Preliminary measurements were conducted and the results showed that the proposed algorithm overcomes the defects of holes, protrusions, and debris in reconstruction. In addition, the targets' location in space and roughly volume could be calculated according to the grid of finite element of the model, and this feature was never achievable for the previous 2D imaging.

Maximal curvature-based segmentation of 3D vessel contours

The segmentation of three-dimensional vascular trees is an important topic in medical image processing. Although it may seem to be an easy task, many different techniques have been proposed in the literature during the last decade and many difficulties remain. One can wonder why the human eye is usually able to understand the connectivity and the topology of the different structures while most algorithms fail to do so. In this paper, we propose an original approach that classifies the different contours by applying a geodesic distance transform on the contours of the vessels, where the evolution speed depends directly on the maximal curvature of the contours. This proposition comes from the observation that the maximal curvature on a standard vessel is usually positive and almost constant while it approaches zero or becomes negative on the contour at the contact with other structures. We describe our method in details and present promising results on synthetic and real images, where the method has been able to detect complex vascular structures without leaking into bones or mixing different vascular networks.

A fully automated trabecular bone structural analysis tool based on T2* -weighted magnetic resonance imaging

One major source affecting the precision of bone structure analysis in quantitative magnetic resonance imaging (qMRI) is inter- and intraoperator variability, inherent in delineating and tracing regions of interest along longitudinal studies. In this paper an automated analysis tool, featuring bone marrow segmentation, region of interest generation, and characterization of cancellous bone of articular joints is presented. In evaluation studies conducted at the knee joint the novel analysis tool significantly decreased the standard error of measurement and improved the sensitivity in detecting minor structural changes. It further eliminated the need of time-consuming user interaction, and thereby increasing reproducibility.