3D deformable registration of longitudinal abdominopelvic CT images using unsupervised deep learning

Development of a Subtraction Processing Technology for Assistance in the Comparative Interpretation of Mammograms

A comparative interpretation of mammograms has become increasingly important, and it is crucial to develop subtraction processing and registration methods for mammograms. However, nonrigid image registration has seldom been applied to subjects constructed with soft tissue only, such as mammograms. We examined whether subtraction processing for the comparative interpretation of mammograms can be performed using nonrigid image registration. As a preliminary study, we evaluated the results of subtraction processing by applying nonrigid image registration to normal mammograms, assuming a comparative interpretation between the left and right breasts. Mediolateral-oblique-view mammograms were taken from noncancer patients and divided into 1000 cases for training, 100 cases for validation, and 500 cases for testing. Nonrigid image registration was applied to align the horizontally flipped left-breast mammogram with the right one. We compared the sum of absolute differences (SAD) of the difference of bilateral images (Difference Image) with and without the application of nonrigid image registration. Statistically, the average SAD was significantly lower with the application of nonrigid image registration than without it (without: 0.0692; with: 0.0549 (p < 0.001)). In four subgroups using the breast area, breast density, compressed breast thickness, and Difference Image without nonrigid image registration, the average SAD of the Difference Image was also significantly lower with nonrigid image registration than without it (p < 0.001). Nonrigid image registration was found to be sufficiently useful in aligning bilateral mammograms, and it is expected to be an important tool in the development of a support system for the comparative interpretation of mammograms.

Contour-guided deep learning based deformable image registration for dose monitoring during CBCT-guided radiotherapy of prostate cancer

PURPOSE

To evaluate deep learning (DL)-based deformable image registration (DIR) for dose accumulation during radiotherapy of prostate cancer patients.

METHODS AND MATERIALS

Data including 341 CBCTs (209 daily, 132 weekly) and 23 planning CTs from 23 patients was retrospectively analyzed. Anatomical deformation during treatment was estimated using free-form deformation (FFD) method from Elastix and DL-based VoxelMorph approaches. The VoxelMorph method was investigated using anatomical scans (VMorph_Sc) or label images (VMorph_Msk), or the combination of both (VMorph_Sc_Msk). Accumulated doses were compared with the planning dose.

RESULTS

The DSC ranges, averaged for prostate, rectum and bladder, were 0.60-0.71, 0.67-0.79, 0.93-0.98, and 0.89-0.96 for the FFD, VMorph_Sc, VMorph_Msk, and VMorph_Sc_Msk methods, respectively. When including both anatomical and label images, VoxelMorph estimated more complex deformations resulting in heterogeneous determinant of Jacobian and higher percentage of deformation vector field (DVF) folding (up to a mean value of 1.90% in the prostate). Large differences were observed between DL-based methods regarding estimation of the accumulated dose, showing systematic overdosage and underdosage of the bladder and rectum, respectively. The difference between planned mean dose and accumulated mean dose with VMorph_Sc_Msk reached a median value of +6.3 Gy for the bladder and -5.1 Gy for the rectum.

CONCLUSION

The estimation of the deformations using DL-based approach is feasible for male pelvic anatomy but requires the inclusion of anatomical contours to improve organ correspondence. High variability in the estimation of the accumulated dose depending on the deformable strategy suggests further investigation of DL-based techniques before clinical deployment.

Machine Learning System for Lung Neoplasms Distinguished Based on Scleral Data

Lung cancer remains the most commonly diagnosed cancer and the leading cause of death from cancer. Recent research shows that the human eye can provide useful information about one's health status, but few studies have revealed that the eye's features are associated with the risk of cancer. The aims of this paper are to explore the association between scleral features and lung neoplasms and develop a non-invasive artificial intelligence (AI) method for detecting lung neoplasms based on scleral images. A novel instrument was specially developed to take the reflection-free scleral images. Then, various algorithms and different strategies were applied to find the most effective deep learning algorithm. Ultimately, the detection method based on scleral images and the multi-instance learning (MIL) model was developed to predict benign or malignant lung neoplasms. From March 2017 to January 2019, 3923 subjects were recruited for the experiment. Using the pathological diagnosis of bronchoscopy as the gold standard, 95 participants were enrolled to take scleral image screens, and 950 scleral images were fed to AI analysis. Our non-invasive AI method had an AUC of 0.897 ± 0.041(95% CI), a sensitivity of 0.836 ± 0.048 (95% CI), and a specificity of 0.828 ± 0.095 (95% CI) for distinguishing between benign and malignant lung nodules. This study suggested that scleral features such as blood vessels may be associated with lung cancer, and the non-invasive AI method based on scleral images can assist in lung neoplasm detection. This technique may hold promise for evaluating the risk of lung cancer in an asymptomatic population in areas with a shortage of medical resources and as a cost-effective adjunctive tool for LDCT screening at hospitals.

A review of advances in image-guided orthopedic surgery

Orthopedic surgery remains technically demanding due to the complex anatomical structures and cumbersome surgical procedures. The introduction of image-guided orthopedic surgery (IGOS) has significantly decreased the surgical risk and improved the operation results. This review focuses on the application of recent advances in artificial intelligence (AI), deep learning (DL), augmented reality (AR) and robotics in image-guided spine surgery, joint arthroplasty, fracture reduction and bone tumor resection. For the pre-operative stage, key technologies of AI and DL based medical image segmentation, 3D visualization and surgical planning procedures are systematically reviewed. For the intra-operative stage, the development of novel image registration, surgical tool calibration and real-time navigation are reviewed. Furthermore, the combination of the surgical navigation system with AR and robotic technology is also discussed. Finally, the current issues and prospects of the IGOS system are discussed, with the goal of establishing a reference and providing guidance for surgeons, engineers, and researchers involved in the research and development of this area.

Evaluation of DIR algorithm performance in real patients for radiotherapy treatments: A systematic review of operator-dependent strategies

PURPOSE

The performance of deformable medical image registration (DIR) algorithms has become a major concern.

METHODS

We aimed to obtain updated information on DIR algorithm performance quantification through a literature review of articles published between 2010 and 2022. We focused only on studies using operator-based methods to treat real patients. The PubMed, Google Scholar and Embase databases were searched following PRISMA guidelines.

RESULTS

One hundred and seven articles were identified. The mean number of patients and registrations per publication was 20 and 63, respectively. We found 23 different geometric metrics appearing at least twice, and the dosimetric impact of DIR was quantified in 32 articles. Forty-eight different at-risk organs were described, and target volumes were studied in 43 publications. Prostate, head-and-neck and thoracic locations represented more than ¾ of the studied locations. We summarized the type of DIR and the images used, and other key elements. Intra/interobserver variability, threshold values and the correlation between metrics were also discussed.

CONCLUSIONS

This literature review covers the past decade and should facilitate the implementation of DIR algorithms in clinical practice by providing practical and pertinent information to quantify their performance on real patients.

Prospects of Structural Similarity Index for Medical Image Analysis

An image quality matrix provides a significant principle for objectively observing an image based on an alteration between the original and distorted images. During the past two decades, a novel universal image quality assessment has been developed with the ability of adaptation with human visual perception for measuring the difference of a degraded image from the reference image, namely a structural similarity index. Structural similarity has since been widely used in various sectors, including medical image evaluation. Although numerous studies have reported the use of structural similarity as an evaluation strategy for computer-based medical images, reviews on the prospects of using structural similarity for medical imaging applications have been rare. This paper presents previous studies implementing structural similarity in analyzing medical images from various imaging modalities. In addition, this review describes structural similarity from the perspective of a family’s historical background, as well as progress made from the original to the recent structural similarity, and its strengths and drawbacks. Additionally, potential research directions in applying such similarities related to medical image analyses are described. This review will be beneficial in guiding researchers toward the discovery of potential medical image examination methods that can be improved through structural similarity index.

Additive manufacturing pertaining to bone: Hopes, reality and future challenges for clinical applications

For the past 20 years, the democratization of additive manufacturing (AM) technologies has made many of us dream of: low cost, waste-free, and on-demand production of functional parts; fully customized tools; designs limited by imagination only, etc. As every patient is unique, the potential of AM for the medical field is thought to be considerable: AM would allow the division of dedicated patient-specific healthcare solutions entirely adapted to the patients' clinical needs. Pertinently, this review offers an extensive overview of bone-related clinical applications of AM and ongoing research trends, from 3D anatomical models for patient and student education to ephemeral structures supporting and promoting bone regeneration. Today, AM has undoubtably improved patient care and should facilitate many more improvements in the near future. However, despite extensive research, AM-based strategies for bone regeneration remain the only bone-related field without compelling clinical proof of concept to date. This may be due to a lack of understanding of the biological mechanisms guiding and promoting bone formation and due to the traditional top-down strategies devised to solve clinical issues. Indeed, the integrated holistic approach recommended for the design of regenerative systems (i.e., fixation systems and scaffolds) has remained at the conceptual state. Challenged by these issues, a slower but incremental research dynamic has occurred for the last few years, and recent progress suggests notable improvement in the years to come, with in view the development of safe, robust and standardized patient-specific clinical solutions for the regeneration of large bone defects.