Pairwise attention-enhanced adversarial model for automatic bone segmentation in CT images

Robot-assisted percutaneous scaphoid fixation: patient-reported outcomes and learning curve at two centres

This study describes patient-reported outcomes of robot-assisted percutaneous scaphoid fracture fixation of 62 patients from two medical centres and the learning curve of this new technique. One attempt to place the guidewire was sufficient in 97% of cases. All fractures achieved radiographic union at a mean of 9 weeks. There were no complications observed. At a mean follow-up of 36 months (range 12-68 months), the mean patient-rated wrist evaluation (PRWE) was 2 (range 0-22) and the mean Mayo Wrist Score was 96 (range 70-100). After the initial ten to 20 cases, the learning phase was reasonably surmountable with a marked reduction of operative duration and improvement of the screw accuracy.Level of evidence: IV.

Multi-label segmentation of carpal bones in MRI using expansion transfer learning

Objective.The purpose of this study was to develop a robust deep learning approach trained with a smallin-vivoMRI dataset for multi-label segmentation of all eight carpal bones for therapy planning and wrist dynamic analysis.Approach.A small dataset of 15 3.0-T MRI scans from five health subjects was employed within this study. The MRI data was variable with respect to the field of view (FOV), wide range of image intensity, and joint pose. Atwo-stagesegmentation pipeline using modified 3D U-Net was proposed. In thefirst stage, a novel architecture, introduced as expansion transfer learning (ETL), cascades the use of a focused region of interest (ROI) cropped around ground truth for pretraining and a subsequent transfer by an expansion to the original FOV for a primary prediction. The bounding box around the ROI generated was utilized in thesecond stagefor high-accuracy, labeled segmentations of eight carpal bones. Different metrics including dice similarity coefficient (DSC), average surface distance (ASD) and hausdorff distance (HD) were used to evaluate performance between proposed and four state-of-the-art approaches.Main results.With an average DSC of 87.8 %, an ASD of 0.46 mm, an average HD of 2.42 mm in all datasets (96.1 %, 0.16 mm, 1.38 mm in 12 datasets after exclusion criteria, respectively), the proposed approach showed an overall strongest performance than comparisons.Significance.To our best knowledge, this is the first CNN-based multi-label segmentation approach for MRI human carpal bones. The ETL introduced in this work improved the ability to localize a small ROI in a large FOV. Overall, the interplay of atwo-stageapproach and ETL culminated in convincingly accurate segmentation scores despite a very small amount of image data.

Context-Aware Dual-Task Deep Network for Concurrent Bone Segmentation and Clinical Assessment to Enhance Shoulder Arthroplasty Preoperative planning

Goal: Effective preoperative planning for shoulder joint replacement requires accurate glenohumeral joint (GH) digital surfaces and reliable clinical staging. Methods: xCEL-UNet was designed as a dual-task deep network for humerus and scapula bone reconstruction in CT scans, and assessment of three GH joint clinical conditions, namely osteophyte size (OS), joint space reduction (JS), and humeroscapular alignment (HSA). Results: Trained on a dataset of 571 patients, the model optimized segmentation and classification through transfer learning. It achieved median root mean squared errors of 0.31 and 0.24 mm, and Hausdorff distances of 2.35 and 3.28 mm for the humerus and scapula, respectively. Classification accuracy was 91 for OS, 93 for JS, and 85% for HSA. GradCAM-based activation maps validated the network's interpretability. Conclusions: this framework delivers accurate 3D bone surface reconstructions and dependable clinical assessments of the GH joint, offering robust support for therapeutic decision-making in shoulder arthroplasty.

Multi-objective constraints for path planning in screw fixation of scaphoid fractures

PURPOSE

Scaphoid fractures, a common type of clinical fracture, often require screw placement surgery to achieve optimal therapeutic outcomes. Path planning algorithms can avoid more risks and have vital potential for developing precise and automatic surgeries. Despite the success of surgical path planning algorithms, automatic path planning for scaphoid fractures remains challenging owing to the complex bone structure and individual variations.

METHODS

Thus, we propose a Multi-objective constrained Path planning Algorithm (MPA) for fracture screw placement, which includes the identification of the center of the fracture surface. Further, three constraint conditions were introduced to eliminate infeasible paths, followed by adding three objectives to the remaining paths for more accurate planning. Finally, the Nondominated Sorting Genetic Algorithms (NSGA)-II algorithm was used to optimize the surgical paths.

RESULTS

We defined the vertical compression distance (VCD), a common observation index in clinics. The experiments show that the average VCD of the MPA paths is measured at 23.88 mm, outperforming the clinical planning paths by 21.71 mm. Ablation experiments demonstrated that all three objectives (distance, length, and angle) effectively optimized the path planning. Additionally, we also used finite element analysis to compare and analyze the MPA path and clinical path. The experimental results showed that the MPA path always outperformed the clinical path in terms of scaphoid strain and screw stress.

CONCLUSION

This study presents a solution for the path planning of scaphoid fractures. Our future research will attempt to enhance the model's performance and extend its application to a broader range of fracture types.

A temporal enhanced semi-supervised training framework for needle segmentation in 3D ultrasound images

Objective.Automated biopsy needle segmentation in 3D ultrasound images can be used for biopsy navigation, but it is quite challenging due to the low ultrasound image resolution and interference similar to the needle appearance. For 3D medical image segmentation, such deep learning networks as convolutional neural network and transformer have been investigated. However, these segmentation methods require numerous labeled data for training, have difficulty in meeting the real-time segmentation requirement and involve high memory consumption.Approach.In this paper, we have proposed the temporal information-based semi-supervised training framework for fast and accurate needle segmentation. Firstly, a novel circle transformer module based on the static and dynamic features has been designed after the encoders for extracting and fusing the temporal information. Then, the consistency constraints of the outputs before and after combining temporal information are proposed to provide the semi-supervision for the unlabeled volume. Finally, the model is trained using the loss function which combines the cross-entropy and Dice similarity coefficient (DSC) based segmentation loss with mean square error based consistency loss. The trained model with the single ultrasound volume input is applied to realize the needle segmentation in ultrasound volume.Main results.Experimental results on three needle ultrasound datasets acquired during the beagle biopsy show that our approach is superior to the most competitive mainstream temporal segmentation model and semi-supervised method by providing higher DSC (77.1% versus 76.5%), smaller needle tip position (1.28 mm versus 1.87 mm) and length (1.78 mm versus 2.19 mm) errors on the kidney dataset as well as DSC (78.5% versus 76.9%), needle tip position (0.86 mm versus 1.12 mm) and length (1.01 mm versus 1.26 mm) errors on the prostate dataset.Significance.The proposed method can significantly enhance needle segmentation accuracy by training with sequential images at no additional cost. This enhancement may further improve the effectiveness of biopsy navigation systems.

Linear semantic transformation for semi-supervised medical image segmentation

Medical image segmentation is a focus research and foundation in developing intelligent medical systems. Recently, deep learning for medical image segmentation has become a standard process and succeeded significantly, promoting the development of reconstruction, and surgical planning of disease diagnosis. However, semantic learning is often inefficient owing to the lack of supervision of feature maps, resulting in that high-quality segmentation models always rely on numerous and accurate data annotations. Learning robust semantic representation in latent spaces remains a challenge. In this paper, we propose a novel semi-supervised learning framework to learn vital attributes in medical images, which constructs generalized representation from diverse semantics to realize medical image segmentation. We first build a self-supervised learning part that achieves context recovery by reconstructing space and intensity of medical images, which conduct semantic representation for feature maps. Subsequently, we combine semantic-rich feature maps and utilize simple linear semantic transformation to convert them into image segmentation. The proposed framework was tested using five medical segmentation datasets. Quantitative assessments indicate the highest scores of our method on IXI (73.78%), ScaF (47.50%), COVID-19-Seg (50.72%), PC-Seg (65.06%), and Brain-MR (72.63%) datasets. Finally, we compared our method with the latest semi-supervised learning methods and obtained 77.15% and 75.22% DSC values, respectively, ranking first on two representative datasets. The experimental results not only proved that the proposed linear semantic transformation was effectively applied to medical image segmentation, but also presented its simplicity and ease-of-use to pursue robust segmentation in semi-supervised learning. Our code is now open at: https://github.com/QingYunA/Linear-Semantic-Transformation-for-Semi-Supervised-Medical-Image-Segmentation.

Automated Prediction of Osteoarthritis Level in Human Osteochondral Tissue Using Histopathological Images

Osteoarthritis (OA) is the most common arthritis and the leading cause of lower extremity disability in older adults. Understanding OA progression is important in the development of patient-specific therapeutic techniques at the early stage of OA rather than at the end stage. Histopathology scoring systems are usually used to evaluate OA progress and the mechanisms involved in the development of OA. This study aims to classify the histopathological images of cartilage specimens automatically, using artificial intelligence algorithms. Hematoxylin and eosin (HE)- and safranin O and fast green (SafO)-stained images of human cartilage specimens were divided into early, mild, moderate, and severe OA. Five pre-trained convolutional networks (DarkNet-19, MobileNet, ResNet-101, NasNet) were utilized to extract the twenty features from the last fully connected layers for both scenarios of SafO and HE. Principal component analysis (PCA) and ant lion optimization (ALO) were utilized to obtain the best-weighted features. The support vector machine classifier was trained and tested based on the selected descriptors to achieve the highest accuracies of 98.04% and 97.03% in HE and SafO, respectively. Using the ALO algorithm, the F1 scores were 0.97, 0.991, 1, and 1 for the HE images and 1, 0.991, 0.97, and 1 for the SafO images for the early, mild, moderate, and severe classes, respectively. This algorithm may be a useful tool for researchers to evaluate the histopathological images of OA without the need for experts in histopathology scoring systems or the need to train new experts. Incorporating automated deep features could help to improve the characterization and understanding of OA progression and development.

A learnable Gabor Convolution kernel for vessel segmentation

Vessel segmentation is significant for characterizing vascular diseases, receiving wide attention of researchers. The common vessel segmentation methods are mainly based on convolutional neural networks (CNNs), which have excellent feature learning capabilities. Owing to inability to predict learning direction, CNNs generate large channels or sufficient depth to obtain sufficient features. It may engender redundant parameters. Drawing on performance ability of Gabor filters in vessel enhancement, we built Gabor convolution kernel and designed its optimization. Unlike traditional filter using and common modulation, its parameters are automatically updated using gradients in the back propagation. Since the structural shape of Gabor convolution kernels is the same as that of regular convolution kernels, it can be integrated into any CNNs architecture. We built Gabor ConvNet using Gabor convolution kernels and tested it using three vessel datasets. It scored 85.06%, 70.52% and 67.11%, respectively, ranking first on three datasets. Results shows that our method outperforms advanced models in vessel segmentation. Ablations also proved that Gabor kernel has better vessel extraction ability than the regular convolution kernel.