Weighted Level Set Evolution Based on Local Edge Features for Medical Image Segmentation

AS2LS: Adaptive Anatomical Structure-Based Two-Layer Level Set Framework for Medical Image Segmentation

Medical images often exhibit intricate structures, inhomogeneous intensity, significant noise and blurred edges, presenting challenges for medical image segmentation. Several segmentation algorithms grounded in mathematics, computer science, and medical domains have been proposed to address this matter; nevertheless, there is still considerable scope for improvement. This paper proposes a novel adaptive anatomical structure-based two-layer level set framework (AS2LS) for segmenting organs with concentric structures, such as the left ventricle and the fundus. By adaptive fitting region and edge intensity information, the AS2LS achieves high accuracy in segmenting complex medical images characterized by inhomogeneous intensity, blurred boundaries and interference from surrounding organs. Moreover, we introduce a novel two-layer level set representation based on anatomical structures, coupled with a two-stage level set evolution algorithm. Experimental results demonstrate the superior accuracy of AS2LS in comparison to representative level set methods and deep learning methods.

An efficient segment anything model for the segmentation of medical images

This paper introduces the efficient medical-images-aimed segment anything model (EMedSAM), addressing the high computational demands and limited adaptability of using SAM for medical image segmentation tasks. We present a novel, compact image encoder, DD-TinyViT, designed to enhance segmentation efficiency through an innovative parameter tuning method called med-adapter. The lightweight DD-TinyViT encoder is derived from the well-known ViT-H using a decoupled distillation approach.The segmentation and recognition capabilities of EMedSAM for specific structures are improved by med-adapter, which dynamically adjusts the model parameters specifically for medical imaging. We conducted extensive testing on EMedSAM using the public FLARE 2022 dataset and datasets from the First Hospital of Zhejiang University School of Medicine. The results demonstrate that our model outperforms existing state-of-the-art models in both multi-organ and lung segmentation tasks.

Semi-Supervised Medical Image Segmentation Using Cross-Style Consistency With Shape-Aware and Local Context Constraints

Despite the remarkable progress in semi-supervised medical image segmentation methods based on deep learning, their application to real-life clinical scenarios still faces considerable challenges. For example, insufficient labeled data often makes it difficult for networks to capture the complexity and variability of the anatomical regions to be segmented. To address these problems, we design a new semi-supervised segmentation framework that aspires to produce anatomically plausible predictions. Our framework comprises two parallel networks: shape-agnostic and shape-aware networks. These networks learn from each other, enabling effective utilization of unlabeled data. Our shape-aware network implicitly introduces shape guidance to capture shape fine-grained information. Meanwhile, shape-agnostic networks employ uncertainty estimation to further obtain reliable pseudo-labels for the counterpart. We also employ a cross-style consistency strategy to enhance the network's utilization of unlabeled data. It enriches the dataset to prevent overfitting and further eases the coupling of the two networks that learn from each other. Our proposed architecture also incorporates a novel loss term that facilitates the learning of the local context of segmentation by the network, thereby enhancing the overall accuracy of prediction. Experiments on three different datasets of medical images show that our method outperforms many excellent semi-supervised segmentation methods and outperforms them in perceiving shape. The code can be seen at https://github.com/igip-liu/SLC-Net.

DBNet-SI: Dual branch network of shift window attention and inception structure for skin lesion segmentation

The U-shaped convolutional neural network (CNN) has attained remarkable achievements in the segmentation of skin lesion. However, given the inherent locality of convolution, this architecture cannot capture long-range pixel dependencies and multiscale global contextual information effectively. Moreover, repeated convolutions and downsampling operations can readily result in the omission of intricate local fine-grained details. In this paper, we proposed a U-shaped network (DBNet-SI) equipped with a dual-branch module that combines shift window attention and inception structures. First, we proposed a dual-branch module that combines shift window attention and inception structures (MSI) to better capture multiscale global contextual information and long-range pixel dependencies. Specifically, we have devised a cross-branch bidirectional interaction module within the MSI module to enable information complementarity between the two branches in the channel and spatial dimensions. Therefore, MSI is capable of extracting distinguishing and comprehensive features to accurately identify the skin lesion boundaries. Second, we have devised a progressive feature enhancement and information compensation module (PFEIC), which progressively compensates for fine-grained features through reconstructed skip connections and integrated global context attention modules. The results of the experiment show the superior segmentation performance of DBNet-SI compared with other deep learning models for skin lesion segmentation in the ISIC2017 and ISIC2018 datasets. Ablation studies demonstrate that our model can effectively extract rich multiscale global contextual information and compensate for the loss of local details.

A New Medical Analytical Framework for Automated Detection of MRI Brain Tumor Using Evolutionary Quantum Inspired Level Set Technique

Segmenting brain tumors in 3D magnetic resonance imaging (3D-MRI) accurately is critical for easing the diagnostic and treatment processes. In the field of energy functional theory-based methods for image segmentation and analysis, level set methods have emerged as a potent computational approach that has greatly aided in the advancement of the geometric active contour model. An important factor in reducing segmentation error and the number of required iterations when using the level set technique is the choice of the initial contour points, both of which are important when dealing with the wide range of sizes, shapes, and structures that brain tumors may take. To define the velocity function, conventional methods simply use the image gradient, edge strength, and region intensity. This article suggests a clustering method influenced by the Quantum Inspired Dragonfly Algorithm (QDA), a metaheuristic optimizer inspired by the swarming behaviors of dragonflies, to accurately extract initial contour points. The proposed model employs a quantum-inspired computing paradigm to stabilize the trade-off between exploitation and exploration, thereby compensating for any shortcomings of the conventional DA-based clustering method, such as slow convergence or falling into a local optimum. To begin, the quantum rotation gate concept can be used to relocate a colony of agents to a location where they can better achieve the optimum value. The main technique is then given a robust local search capacity by adopting a mutation procedure to enhance the swarm's mutation and realize its variety. After a preliminary phase in which the cranium is disembodied from the brain, tumor contours (edges) are determined with the help of QDA. An initial contour for the MRI series will be derived from these extracted edges. The final step is to use a level set segmentation technique to isolate the tumor area across all volume segments. When applied to 3D-MRI images from the BraTS' 2019 dataset, the proposed technique outperformed state-of-the-art approaches to brain tumor segmentation, as shown by the obtained results.

Level Set Image Feature Detection and Application in COVID-19 Image Feature Knowledge Detection

Artificial intelligence (AI) scholars and mediciners have reported AI systems that accurately detect medical imaging and COVID-19 in chest images. However, the robustness of these models remains unclear for the segmentation of images with nonuniform density distribution or the multiphase target. The most representative one is the Chan-Vese (CV) image segmentation model. In this paper, we demonstrate that the recent level set (LV) model has excellent performance on the detection of target characteristics from medical imaging relying on the filtering variational method based on the global medical pathology facture. We observe that the capability of the filtering variational method to obtain image feature quality is better than other LV models. This research reveals a far-reaching problem in medical-imaging AI knowledge detection. In addition, from the analysis of experimental results, the algorithm proposed in this paper has a good effect on detecting the lung region feature information of COVID-19 images and also proves that the algorithm has good adaptability in processing different images. These findings demonstrate that the proposed LV method should be seen as an effective clinically adjunctive method using machine-learning healthcare models.

FSNet: Focus Scanning Network for Camouflaged Object Detection

Camouflaged object detection (COD) aims to discover objects that blend in with the background due to similar colors or textures, etc. Existing deep learning methods do not systematically illustrate the key tasks in COD, which seriously hinders the improvement of its performance. In this paper, we introduce the concept of focus areas that represent some regions containing discernable colors or textures, and develop a two-stage focus scanning network for camouflaged object detection. Specifically, a novel encoder-decoder module is first designed to determine a region where the focus areas may appear. In this process, a multi-layer Swin transformer is deployed to encode global context information between the object and the background, and a novel cross-connection decoder is proposed to fuse cross-layer textures or semantics. Then, we utilize the multi-scale dilated convolution to obtain discriminative features with different scales in focus areas. Meanwhile, the dynamic difficulty aware loss is designed to guide the network paying more attention to structural details. Extensive experimental results on the benchmarks, including CAMO, CHAMELEON, COD10K, and NC4K, illustrate that the proposed method performs favorably against other state-of-the-art methods.

Automatic 3D joint erosion detection for the diagnosis and monitoring of rheumatoid arthritis using hand HR-pQCT images

Rheumatoid arthritis (RA) is a chronic inflammatory disease. It leads to bone erosion in joints and other complications, which severely affect patients' quality of life. To accurately diagnose and monitor the progression of RA, quantitative imaging and analysis tools are desirable. High-resolution peripheral quantitative computed tomography (HR-pQCT) is such a promising tool for monitoring disease progression in RA. However, automatic erosion detection tools using HR-pQCT images are not yet available. Inspired by the consensus among radiologists on the erosions in HR-pQCT images, in this paper we define erosion as the significant concave regions on the cortical layer, and develop a model-based 3D automatic erosion detection method. It mainly consists of two steps: constructing closed cortical surface, and detecting erosion regions on the surface. In the first step, we propose an initialization-robust region competition methods for joint segmentation, and then fill the surface gaps by using joint bone separation and curvature-based surface alignment. In the second step, we analyze the curvature information of each voxel, and then aggregate the candidate voxels into concave surface regions and use the shape information of the regions to detect the erosions. We perform qualitative assessments of the new method using 59 well-annotated joint volumes. Our method has shown satisfactory and consistent performance compared with the annotations provided by medical experts.

An attention-guided network for surgical instrument segmentation from endoscopic images

Accurate surgical instrument segmentation can provide the precise location and pose information to the surgeons, assisting the surgeon to accurately judge the follow-up operation during the robot-assisted surgery procedures. Due to strong context extraction ability, there have been significant advances in research of automatic surgical instrument segmentation, especially U-Net and its variant networks. However, there are still some problems to affect segmentation accuracy, like insufficient processing of local features, class imbalance issue, etc. To deal with these problems, with the typical encoder-decoder structure, an effective surgical instrument segmentation network is proposed for providing an end-to-end detection scheme. Specifically, aimed at the problem of insufficient processing of local features, the residual path is introduced for the full feature extraction to strengthen the backward propagation of low-level features. Further, to achieve feature enhancement of local feature maps, a non-local attention block is introduced to insert into the bottleneck layer to acquire global contexts. Besides, to highlight the pixel areas of the surgical instruments, a dual-attention module (DAM) is introduced to make full use of the high-level features extracted from decoder unit and the low-level features delivered by the encoder unit to acquire the attention features and suppress the irrelevant features. To prove the effectiveness and superiority of the proposed segmentation model, experiments are conducted on two public surgical instrument segmentation data sets, including Kvasir-instrument set and Endovis2017 set, which could acquire a 95.77% Dice score and 92.13% mIOU value on Kvasir-instrument set, and simultaneously reach 95.60% Dice score and 92.74% mIOU value on Endovis2017 set respectively. Experimental results show that the proposed segmentation model realizes a superior performance on surgical instruments in comparison to other advanced models, which could provide a good reference for further development of intelligent surgical robots. The source code is provided at https://github.com/lyangucas92/Surg_Net.

An Efficient Blood-Cell Segmentation for the Detection of Hematological Disorders

The automatic segmentation of blood cells for detecting hematological disorders is a crucial job. It has a vital role in diagnosis, treatment planning, and output evaluation. The existing methods suffer from the issues like noise, improper seed-point detection, and oversegmentation problems, which are solved here using a Laplacian-of-Gaussian (LoG)-based modified highboosting operation, bounded opening followed by fast radial symmetry (BOFRS)-based seed-point detection, and hybrid ellipse fitting (EF), respectively. This article proposes a novel hybrid EF-based blood-cell segmentation approach, which may be used for detecting various hematological disorders. Our prime contributions are: 1) more accurate seed-point detection based on BO-FRS; 2) a novel least-squares (LS)-based geometric EF approach; and 3) an improved segmentation performance by employing a hybridized version of geometric and algebraic EF techniques retaining the benefits of both approaches. It is a computationally efficient approach since it hybridizes noniterative-geometric and algebraic methods. Moreover, we propose to estimate the minor and major axes based on the residue and residue offset factors. The residue offset parameter, proposed here, yields more accurate segmentation with proper EF. Our method is compared with the state-of-the-art methods. It outperforms the existing EF techniques in terms of dice similarity, Jaccard score, precision, and F1 score. It may be useful for other medical and cybernetics applications.

A New Active Contour Medical Image Segmentation Method Based on Fractional Varying-Order Differential

Image segmentation technology is dedicated to the segmentation of intensity inhomogeneous at present. In this paper, we propose a new method that incorporates fractional varying-order differential and local fitting energy to construct a new variational level set active contour model. The energy functions in this paper mainly include three parts: the local term, the regular term and the penalty term. The local term combined with fractional varying-order differential can obtain more details of the image. The regular term is used to regularize the image contour length. The penalty term is used to keep the evolution curve smooth. True positive (TP) rate, false positive (FP) rate, precision (P) rate, Jaccard similarity coefficient (JSC), and Dice similarity coefficient (DSC) are employed as the comparative measures for the segmentation results. Experimental results for both synthetic and real images show that our method has more accurate segmentation results than other models, and it is robust to intensity inhomogeneous or noises.

Unified Focal loss: Generalising Dice and cross entropy-based losses to handle class imbalanced medical image segmentation

Automatic segmentation methods are an important advancement in medical image analysis. Machine learning techniques, and deep neural networks in particular, are the state-of-the-art for most medical image segmentation tasks. Issues with class imbalance pose a significant challenge in medical datasets, with lesions often occupying a considerably smaller volume relative to the background. Loss functions used in the training of deep learning algorithms differ in their robustness to class imbalance, with direct consequences for model convergence. The most commonly used loss functions for segmentation are based on either the cross entropy loss, Dice loss or a combination of the two. We propose the Unified Focal loss, a new hierarchical framework that generalises Dice and cross entropy-based losses for handling class imbalance. We evaluate our proposed loss function on five publicly available, class imbalanced medical imaging datasets: CVC-ClinicDB, Digital Retinal Images for Vessel Extraction (DRIVE), Breast Ultrasound 2017 (BUS2017), Brain Tumour Segmentation 2020 (BraTS20) and Kidney Tumour Segmentation 2019 (KiTS19). We compare our loss function performance against six Dice or cross entropy-based loss functions, across 2D binary, 3D binary and 3D multiclass segmentation tasks, demonstrating that our proposed loss function is robust to class imbalance and consistently outperforms the other loss functions. Source code is available at: https://github.com/mlyg/unified-focal-loss.

•

Loss function choice is crucial for class-imbalanced medical imaging datasets.

•

Understanding the relationship between loss functions is key to inform choice.

•

Unified Focal loss generalises Dice and cross-entropy based loss functions.

•

Unified Focal loss outperforms various Dice and cross-entropy based loss functions.

Automatic segmentation of organs at risk and tumors in CT images of lung cancer from partially labelled datasets with a semi-supervised conditional nnU-Net

BACKGROUND AND OBJECTIVE

Accurately and reliably defining organs at risk (OARs) and tumors are the cornerstone of radiation therapy (RT) treatment planning for lung cancer. Almost all segmentation networks based on deep learning techniques rely on fully annotated data with strong supervision. However, existing public imaging datasets encountered in the RT domain frequently include singly labelled tumors or partially labelled organs because annotating full OARs and tumors in CT images is both rigorous and tedious. To utilize labelled data from different sources, we proposed a dual-path semi-supervised conditional nnU-Net for OARs and tumor segmentation that is trained on a union of partially labelled datasets.

METHODS

The framework employs the nnU-Net as the base model and introduces a conditioning strategy by incorporating auxiliary information as an additional input layer into the decoder. The conditional nnU-Net efficiently leverages prior conditional information to classify the target class at the pixelwise level. Specifically, we employ the uncertainty-aware mean teacher (UA-MT) framework to assist in OARs segmentation, which can effectively leverage unlabelled data (images from a tumor labelled dataset) by encouraging consistent predictions of the same input under different perturbations. Furthermore, we individually design different combinations of loss functions to optimize the segmentation of OARs (Dice loss and cross-entropy loss) and tumors (Dice loss and focal loss) in a dual path.

RESULTS

The proposed method is evaluated on two publicly available datasets of the spinal cord, left and right lung, heart, esophagus, and lung tumor, in which satisfactory segmentation performance has been achieved in term of both the region-based Dice similarity coefficient (DSC) and the boundary-based Hausdorff distance (HD).

CONCLUSIONS

The proposed semi-supervised conditional nnU-Net breaks down the barriers between nonoverlapping labelled datasets and further alleviates the problem of "data hunger" and "data waste" in multi-class segmentation. The method has the potential to help radiologists with RT treatment planning in clinical practice.

A Study on Weak Edge Detection of COVID-19's CT Images Based on Histogram Equalization and Improved Canny Algorithm

The coronavirus disease 2019 (COVID-19) is a substantial threat to people's lives and health due to its high infectivity and rapid spread. Computed tomography (CT) scan is one of the important auxiliary methods for the clinical diagnosis of COVID-19. However, CT image lesion edge is normally affected by pixels with uneven grayscale and isolated noise, which makes weak edge detection of the COVID-19 lesion more complicated. In order to solve this problem, an edge detection method is proposed, which combines the histogram equalization and the improved Canny algorithm. Specifically, the histogram equalization is applied to enhance image contrast. In the improved Canny algorithm, the median filter, instead of the Gaussian filter, is used to remove the isolated noise points. The K-means algorithm is applied to separate the image background and edge. And the Canny algorithm is improved continuously by combining the mathematical morphology and the maximum between class variance method (OTSU). On selecting four types of lesion images from COVID-CT date set, MSE, MAE, SNR, and the running time are applied to evaluate the performance of the proposed method. The average values of these evaluation indicators are 1.7322, 7.9010, 57.1241, and 5.4887, respectively. Compared with other three methods, these values indicate that the proposed method achieves better result. The experimental results prove that the proposed algorithm can effectively detect the weak edge of the lesion, which is helpful for the diagnosis of COVID-19.

A bibliometric of publication trends in medical image segmentation: Quantitative and qualitative analysis

PURPOSE

Medical images are important in diagnosing disease and treatment planning. Computer algorithms that describe anatomical structures that highlight regions of interest and remove unnecessary information are collectively known as medical image segmentation algorithms. The quality of these algorithms will directly affect the performance of the following processing steps. There are many studies about the algorithms of medical image segmentation and their applications, but none involved a bibliometric of medical image segmentation.

METHODS

This bibliometric work investigated the academic publication trends in medical image segmentation technology. These data were collected from the Web of Science (WoS) Core Collection and the Scopus. In the quantitative analysis stage, important visual maps were produced to show publication trends from five different perspectives including annual publications, countries, top authors, publication sources, and keywords. In the qualitative analysis stage, the frequently used methods and research trends in the medical image segmentation field were analyzed from 49 publications with the top annual citation rates.

RESULTS

The analysis results showed that the number of publications had increased rapidly by year. The top related countries include the Chinese mainland, the United States, and India. Most of these publications were conference papers, besides there are also some top journals. The research hotspot in this field was deep learning-based medical image segmentation algorithms based on keyword analysis. These publications were divided into three categories: reviews, segmentation algorithm publications, and other relevant publications. Among these three categories, segmentation algorithm publications occupied the vast majority, and deep learning neural network-based algorithm was the research hotspots and frontiers.

CONCLUSIONS

Through this bibliometric research work, the research hotspot in the medical image segmentation field is uncovered and can point to future research in the field. It can be expected that more researchers will focus their work on deep learning neural network-based medical image segmentation.

Magnetic Resonance Imaging Segmentation via Weighted Level Set Model Based on Local Kernel Metric and Spatial Constraint

Magnetic resonance imaging (MRI) segmentation is a fundamental and significant task since it can guide subsequent clinic diagnosis and treatment. However, images are often corrupted by defects such as low-contrast, noise, intensity inhomogeneity, and so on. Therefore, a weighted level set model (WLSM) is proposed in this study to segment inhomogeneous intensity MRI destroyed by noise and weak boundaries. First, in order to segment the intertwined regions of brain tissue accurately, a weighted neighborhood information measure scheme based on local multi information and kernel function is designed. Then, the membership function of fuzzy c-means clustering is used as the spatial constraint of level set model to overcome the sensitivity of level set to initialization, and the evolution of level set function can be adaptively changed according to different tissue information. Finally, the distance regularization term in level set function is replaced by a double potential function to ensure the stability of the energy function in the evolution process. Both real and synthetic MRI images can show the effectiveness and performance of WLSM. In addition, compared with several state-of-the-art models, segmentation accuracy and Jaccard similarity coefficient obtained by WLSM are increased by 0.0586, 0.0362 and 0.1087, 0.0703, respectively.

A weighted region-based level set method for image segmentation with intensity inhomogeneity

Image segmentation is a fundamental task in image processing and is still a challenging problem when processing images with high noise, low resolution and intensity inhomogeneity. In this paper, a weighted region-based level set method, which is based on the techniques of local statistical theory, level set theory and curve evolution, is proposed. Specifically, a new weighted pressure force function (WPF) is first presented to flexibly drive the closed contour to shrink or expand outside and inside of the object. Second, a faster and smoother regularization term is added to ensure the stability of the curve evolution and that there is no need for initialization in curve evolution. Third, the WPF is integrated into the region-based level set framework to accelerate the speed of the curve evolution and improve the accuracy of image segmentation. Experimental results on medical and natural images demonstrate that the proposed segmentation model is more efficient and robust to noise than other state-of-the-art models.

Direct 3D model extraction method for color volume images

BACKGROUND:

There is a great demand for the extraction of organ models from three-dimensional (3D) medical images in clinical medicine diagnosis and treatment.

OBJECTIVE:

We aimed to aid doctors in seeing the real shape of human organs more clearly and vividly.

METHODS:

The method uses the minimum eigenvectors of Laplacian matrix to automatically calculate a group of basic matting components that can properly define the volume image. These matting components can then be used to build foreground images with the help of a few user marks.

RESULTS:

We propose a direct 3D model segmentation method for volume images. This is a process of extracting foreground objects from volume images and estimating the opacity of the voxels covered by the objects.

CONCLUSIONS:

The results of segmentation experiments on different parts of human body prove the applicability of this method.

Computed Tomography Image Segmentation Using Edge Correction Algorithm for Refractory Mycoplasma Pneumonia in Children

Objective. It is to study the application of edge correction algorithm (ECA) in computed tomography (CT) medical image segmentation, explore its guiding significance in the analysis of clinical characteristics of children with refractory mycoplasma pneumoniae (RMPP), and discuss the therapeutic value of fiberoptic bronchoscopy bronchoalveolar lavage (BAL) for RMPP. Methods. The accuracy of ECA in CT medical image segmentation of children with RMPP was compared with that of the watershed segmentation algorithm (WSA) and swarm intelligence optimization algorithm (SIOA). The clinical characteristics and the imaging characteristics of 80 children with RMPP admitted to hospital from January 2018 to January 2020 were retrospectively analyzed based on the ECA. All children were divided into a lavage group (BAL group, n = 69) and a nonlavage group (non-BAL group, n = 11) according to whether fiberoptic bronchoscopy and BAL were performed. Bronchoscopy was adopted to analyze the cytological characteristics of BAL fluid (BALF) in children, and the recovery rate and the total effective rate of the two groups of children were observed and compared. Results. The overall accuracies (OAs) of the three ECAs (Roberts operator (RO), Sobel operator (SO), and Prewitt operator (PO)) were higher than that of WSA and SIOA, their false negative rate (FNR) and false positive rate (FPR) were small, and their denoising performance was superior to that of WSA and SIOA. The main clinical manifestations of all children were high fever, irritating dry cough, and few early signs. The results of chest CT examination were mainly manifested as patchy or large-scale consolidation, two lung mesh or small nodular shadows, and atelectasis. 69 cases with fiberoptic bronchoscopy showed swelling and congestion of the bronchial mucosa at the lesion site with visible viscous secretions, which was consistent with the imaging changes. The total number of cells in the BALF of children increased ( $P<0.05$ ), which mainly represented the increase of neutrophils ( $P<0.05$ ). The recovery rate of children with lavage (81.16%) was higher dramatically than that of the nonlavage group (45.45%). Conclusion. The ECA had good accuracy and denoising performance in lung CT image segmentation. The clinical characteristics, imaging characteristics, and cytological components of children had changed when they suffered from the RMPP, and fiberoptic bronchoscopy lavage had a therapeutic effect on it.

Visualization of Pterygomaxillary Fissure Structure and Shape in CT Image via Non-Linear Perspective Projection

The neurologist analyses the brain images to diagnose disease via structure and shape of the part in scanned Medical images such as CT, MRI, and PET. The Medical image segmentation performs less in the regions where no or little contrast, artifacts over the different boundary regions. The manual process of segmentation shows poor boundary differentiation due to discernibility in shape and location, intra and inter observer reliability. In this paper, we propose dyadic CAT optimization (DCO) algorithm to segment the regions in the brain from CT and MRI image via Non-linear perspective Foreground and Back Ground projection. The DCO algorithm removes the artifacts in the boundary regions and provide the exact structure and shape of the brain regions. The DCO algorithm shows the region boundary for pterygomaxillary fissure, occipital lobe, vaginal process zygomatic arch, maxilla and piriform aperture in brain image with high visibility in the regions of inadequately visible boundary and distinguishes the deformable shape. The DCO algorithm applies on 50 images and eight images with complex bone and muscle mass structure for performance evaluation. The DCO algorithm shows the increased Structural similarity index (SSIM) with 90% accuracy.

AW-SDRLSE: Adaptive Weighting and Scalable Distance Regularized Level Set Evolution for Lymphoma Segmentation on PET Images

Accurate lymphoma segmentation on Positron Emission Tomography (PET) images is of great importance for medical diagnoses, such as for distinguishing benign and malignant. To this end, this paper proposes an adaptive weighting and scalable distance regularized level set evolution (AW-SDRLSE) method for delineating lymphoma boundaries on 2D PET slices. There are three important characteristics with respect to AW-SDRLSE: 1) A scalable distance regularization term is proposed and a parameter q can control the contour's convergence rate and precision in theory. 2) A novel dynamic annular mask is proposed to calculate mean intensities of local interior and exterior regions and further define the region energy term. 3) As the level set method is sensitive to parameters, we thus propose an adaptive weighting strategy for the length and area energy terms using local region intensity and boundary direction information. AW-SDRLSE is evaluated on 90 cases of real PET data with a mean Dice coefficient of 0.8796. Comparative results demonstrate the accuracy and robustness of AW-SDRLSE as well as its performance advantages as compared with related level set methods. In addition, experimental results indicate that AW-SDRLSE can be a fine segmentation method for improving the lymphoma segmentation results obtained by deep learning (DL) methods significantly.

A fast technique for hyper-echoic region separation from brain ultrasound images using patch based thresholding and cubic B-spline based contour smoothing

Ultrasound image guided brain surgery (UGBS) requires an automatic and fast image segmentation method. The level-set and active contour based algorithms have been found to be useful for obtaining topology-independent boundaries between different image regions. But slow convergence limits their use in online US image segmentation. The performance of these algorithms deteriorates on US images because of the intensity inhomogeneity. This paper proposes an effective region-driven method for the segmentation of hyper-echoic (HE) regions suppressing the hypo-echoic and anechoic regions in brain US images. An automatic threshold estimation scheme is developed with a modified Niblack's approach. The separation of the hyper-echoic and non-hyper-echoic (NHE) regions is performed by successively applying patch based intensity thresholding and boundary smoothing. First, a patch based segmentation is performed, which separates roughly the two regions. The patch based approach in this process reduces the effect of intensity heterogeneity within an HE region. An iterative boundary correction step with reducing patch size improves further the regional topology and refines the boundary regions. For avoiding the slope and curvature discontinuities and obtaining distinct boundaries between HE and NHE regions, a cubic B-spline model of curve smoothing is applied. The proposed method is 50-100 times faster than the other level-set based image segmentation algorithms. The segmentation performance and the convergence speed of the proposed method are compared with four other competing level-set based algorithms. The computational results show that the proposed segmentation approach outperforms other level-set based techniques both subjectively and objectively.

Learning Geodesic Active Contours for Embedding Object Global Information in Segmentation CNNs

Most existing CNNs-based segmentation methods rely on local appearances learned on the regular image grid, without consideration of the object global information. This article aims to embed the object global geometric information into a learning framework via the classical geodesic active contours (GAC). We propose a level set function (LSF) regression network, supervised by the segmentation ground truth, LSF ground truth and geodesic active contours, to not only generate the segmentation probabilistic map but also directly minimize the GAC energy functional in an end-to-end manner. With the help of geodesic active contours, the segmentation contour, embedded in the level set function, can be globally driven towards the image boundary to obtain lower energy, and the geodesic constraint can lead the segmentation result to have fewer outliers. Extensive experiments on four public datasets show that (1) compared with state-of-the-art (SOTA) learning active contour methods, our method can achieve significantly better performance; (2) compared with recent SOTA methods that are designed for reducing boundary errors, our method also outperforms them with more accurate boundaries; (3) compared with SOTA methods on two popular multi-class segmentation challenge datasets, our method can still obtain superior or competitive results in both organ and tumor segmentation tasks. Our study demonstrates that introducing global information by GAC can significantly improve segmentation performance, especially on reducing the boundary errors and outliers, which is very useful in applications such as organ transplantation surgical planning and multi-modality image registration where boundary errors can be very harmful.

Confidence-Controlled Local Isosurfacing

This article presents a novel framework that can generate a high-fidelity isosurface model of X-ray computed tomography (CT) data. CT surfaces with subvoxel precision and smoothness can be simply modeled via isosurfacing, where a single CT value represents an isosurface. However, this inevitably results in geometric distortion of the CT data containing CT artifacts. An alternative is to treat this challenge as a segmentation problem. However, in general, segmentation techniques are not robust against noisy data and require heavy computation to handle the artifacts that occur in three-dimensional CT data. Furthermore, the surfaces generated from segmentation results may contain jagged, overly smooth, or distorted geometries. We present a novel local isosurfacing framework that can address these issues simultaneously. The proposed framework exploits two primary techniques: 1) Canny edge approach for obtaining surface candidate boundary points and evaluating their confidence and 2) screened Poisson optimization for fitting a surface to the boundary points in which the confidence term is incorporated. This combination facilitates local isosurfacing that can produce high-fidelity surface models. We also implement an intuitive user interface to alleviate the burden of selecting the appropriate confidence computing parameters. Our experimental results demonstrate the effectiveness of the proposed framework.

Glass-cutting medical images via a mechanical image segmentation method based on crack propagation

Medical image segmentation is crucial in diagnosing and treating diseases, but automatic segmentation of complex images is very challenging. Here we present a method, called the crack propagation method (CPM), based on the principles of fracture mechanics. This unique method converts the image segmentation problem into a mechanical one, extracting the boundary information of the target area by tracing the crack propagation on a thin plate with grooves corresponding to the area edge. The greatest advantage of CPM is in segmenting images involving blurred or even discontinuous boundaries, a task difficult to achieve by existing auto-segmentation methods. The segmentation results for synthesized images and real medical images show that CPM has high accuracy in segmenting complex boundaries. With increasing demand for medical imaging in clinical practice and research, this method will show its unique potential.

Automatic segmentation of complex medical images is challenging. Here, the authors present a crack propagation method based on the principles of fracture mechanics: extracting the boundary information of the target area by tracing the crack propagation on a thin plate with grooves corresponding to the area edge.

An Improved Level Set Method on the Multiscale Edges

The level set method can segment symmetrical or asymmetrical objects in real images according to image features. However, the segmentation performance varies with feature scale. In order to improve the segmentation effect, we propose an improved level set method on the multiscale edges, which combines the level set method with image multi-scale decomposition to form a unified model. In this model, the segmentation relies on multiscale edges, and the multiscale edges depend on multiscale decomposition. A novel total variation regularization is proposed in multiscale decomposition to preserve edges. The multiscale edges obtained by the multiscale decomposition are integrated into the segmentation process, and the object can be easily extracted from a proper scale. Experimental results indicate that this method has superior performance in precision, recall and F-measure, compared with relative edge-based segmentation methods, and is insensitive to noise and inhomogeneous sub-regions.

Vessel Segmentation of X-Ray Coronary Angiographic Image Sequence

OBJECTIVE

To facilitate the analysis and diagnosis of X-ray coronary angiography in interventional surgery, it is necessary to extract vessel from X-ray coronary angiography. However, vessel images of angiography suffer from low quality with large artefacts, which challenges the existing vascular technology.

METHODS

In this paper, we propose a ávessel framework to detect vessels and segment vessels in angiographic vessel data. In this framework, we develop a new matrix decomposition model with gradient sparse in the tensor representation. Then, the energy function with the input of the hierarchical vessel is used in vessel detection and vessel segmentation.

RESULTS

Through experiments conducted on angiographic data, we have demonstrated the good performance of the proposed method in removing background structure.

CONCLUSION

We evaluated our method for vessel detection and segmentation in different clinical settings, including LAO/RAO with cranial and caudal angulation, and showed its competitive results compared with eight state-of-the-art methods in terms of extensive qualitative and quantitative evaluation.

SIGNIFICANCE

Our method can remove a large number of background artefacts and obtain a better vascular structure, which has contributed to the clinical diagnosis of coronary artery diseases.

RESLS: Region and Edge Synergetic Level Set Framework for Image Segmentation

The active contour models with level set evolution have been visited with a vast number of methods for image segmentation. They can be mainly classified into region-based and edge-based models, and it has been validated that the hybrid variants combining both region and edge information can improve the segmentation performance. However, to the best of our knowledge, the theoretical foundation of collaboration mechanism between the region and the edge information is limited. Specifically, most existing hybrid models are just combining all the energy terms together, resulting in great challenges of choosing an appropriate weight coefficient for each term and accommodating different modalities of imaging. To overcome these difficulties, this paper proposes a region and edge synergetic level set framework named RESLS. It provides an approach to construct new hybrid level set models using a normalized intensity indicator function that allows the region information easily embedding into the edge-based model. In this case, the energy weights of region and edge terms can be constrained by the global optimization condition deduced from the framework. Some representative as well as state-of-the-art models are taken as examples to demonstrate the generality of our method. The experiments validate that under the guidance of the optimization condition, the weighting parameter of each term can be reliably chosen. Meanwhile, the segmentation accuracy, robustness, and computational efficiency of RESLS can be improved compared with its component models.

Automatic Global Level Set Approach for Lumbar Vertebrae CT Image Segmentation

Vertebrae computed tomography (CT) image automatic segmentation is an essential step for Image-guided minimally invasive spine surgery. However, most of state-of-the-art methods still require human intervention due to the inherent limitations of vertebrae CT image, such as topological variation, irregular boundaries (double boundary, weak boundary), and image noise. Therefore, this paper intentionally designed an automatic global level set approach (AGLSA), which is capable of dealing with these issues for lumbar vertebrae CT image segmentation. Unlike the traditional level set methods, we firstly propose an automatically initialized level set function (AILSF) that comprises hybrid morphological filter (HMF) and Gaussian mixture model (GMM) to automatically generate a smooth initial contour which is precisely adjacent to the object boundary. Secondly, a regularized level set formulation is introduced to overcome the weak boundary leaking problem, which utilizes the region correlation of histograms inside and outside the level set contour as a global term. Ultimately, a gradient vector flow (GVF) based edge-stopping function is employed to guarantee a fast convergence rate of the level set evolution and to avoid level set function oversegmentation at the same time. Our proposed approach has been tested on 115 vertebrae CT volumes of various patients. Quantitative comparisons validate that our proposed AGLSA is more accurate in segmenting lumbar vertebrae CT images with irregular boundaries and more robust to various levels of salt-and-pepper noise.

Simultaneous Cell Detection and Classification in Bone Marrow Histology Images

Recently, deep learning frameworks have been shown to be successful and efficient in processing digital histology images for various detection and classification tasks. Among these tasks, cell detection and classification are key steps in many computer-assisted diagnosis systems. Traditionally, cell detection and classification is performed as a sequence of two consecutive steps by using two separate deep learning networks: one for detection and the other for classification. This strategy inevitably increases the computational complexity of the training stage. In this paper, we propose a synchronized deep autoencoder network for simultaneous detection and classification of cells in bone marrow histology images. The proposed network uses a single architecture to detect the positions of cells and classify the detected cells, in parallel. It uses a curve-support Gaussian model to compute probability maps that allow detecting irregularly shape cells precisely. Moreover, the network includes a novel neighborhood selection mechanism to boost the classification accuracy. We show that the performance of the proposed network is superior than traditional deep learning detection methods and very competitive compared to traditional deep learning classification networks. Runtime comparison also shows that our network requires less time to be trained.