MSGAN: Multi-Stage Generative Adversarial Networks for Cross-Modality Domain Adaptation

PCNet: Prior Category Network for CT Universal Segmentation Model

Accurate segmentation of anatomical structures in Computed Tomography (CT) images is crucial for clinical diagnosis, treatment planning, and disease monitoring. The present deep learning segmentation methods are hindered by factors such as data scale and model size. Inspired by how doctors identify tissues, we propose a novel approach, the Prior Category Network (PCNet), that boosts segmentation performance by leveraging prior knowledge between different categories of anatomical structures. Our PCNet comprises three key components: prior category prompt (PCP), hierarchy category system (HCS), and hierarchy category loss (HCL). PCP utilizes Contrastive Language-Image Pretraining (CLIP), along with attention modules, to systematically define the relationships between anatomical categories as identified by clinicians. HCS guides the segmentation model in distinguishing between specific organs, anatomical structures, and functional systems through hierarchical relationships. HCL serves as a consistency constraint, fortifying the directional guidance provided by HCS to enhance the segmentation model's accuracy and robustness. We conducted extensive experiments to validate the effectiveness of our approach, and the results indicate that PCNet can generate a high-performance, universal model for CT segmentation. The PCNet framework also demonstrates a significant transferability on multiple downstream tasks. The ablation experiments show that the methodology employed in constructing the HCS is of critical importance. The prompt and HCS can be accessed at https://github.com/PKU-MIPET/PCNet.

Rethinking Disentanglement in Unsupervised Domain Adaptation for Medical Image Segmentation

Domain adaptation has become an important topic because the trained neural networks from the source domain generally perform poorly in the target domain due to domain shifts, especially for medical image analysis. Previous DA methods mainly focus on disentangling domain features. However, it is based on feature independence, which often can not be guaranteed in reality. In this work, we present a new DA approach called Dimension-based Disentangled Dilated Domain Adaptation (D4A) to disentangle the storage locations between the features to tackle the problem of domain shift for medical image segmentation tasks without the annotations of the target domain. We use Adaptive Instance Normalization (AdaIN) to encourage the content information to be stored in the spatial dimension, and the style information to be stored in the channel dimension. In addition, we apply dilated convolution to preserve anatomical information avoiding the loss of information due to downsampling. We validate the proposed method for cross-modality medical image segmentation tasks on two public datasets, and the comparison experiments and ablation studies demonstrate the effectiveness of our method, which outperforms the state-of-the-art methods.

Improved Multi-Head Self-Attention Classification Network for Multi-View Fetal Echocardiography Recognition

The accurate acquisition of multiview fetal cardiac ultrasound images is very important for the diagnosis of fetal congenital heart disease (FCHD). However, these manual clinical procedures have drawbacks, e.g., varying technical capabilities and inefficiency. Therefore, exploring automatic recognition method for multiview images of fetal heart ultrasound scans is highly desirable to improve prenatal diagnosis efficiency and accuracy. In this work, we propose an improved multi-head self-attention mechanism called IMSA combined with residual networks to stably solve the problem of multiview identification and anatomical structure localization. In details, IMSA can capture short- and long-range dependencies from different subspaces and merge them to extract more precise features, thus making use of the correlation between fetal heart structures to make view recognition more focused on anatomical structures rather than disturbing regions, such as artifacts and speckle noises. We validate our proposed method on fetal cardiac ultrasound imaging datasets from a single center and 38 multicenter studies and the results outperform other state-of-the-art networks by 3%-15% of F1 scores in fetal heart six standard view recognition.Clinical Relevance- This technology has great potential in assisting cardiologists to complete the automatic acquisition of multi-section fetal echocardiography images.