1
|
Hu S, Lu R, Zhu Y, Zhu W, Jiang H, Bi S. Application of Medical Image Navigation Technology in Minimally Invasive Puncture Robot. SENSORS (BASEL, SWITZERLAND) 2023; 23:7196. [PMID: 37631733 PMCID: PMC10459274 DOI: 10.3390/s23167196] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/13/2023] [Revised: 08/11/2023] [Accepted: 08/14/2023] [Indexed: 08/27/2023]
Abstract
Microneedle puncture is a standard minimally invasive treatment and surgical method, which is widely used in extracting blood, tissues, and their secretions for pathological examination, needle-puncture-directed drug therapy, local anaesthesia, microwave ablation needle therapy, radiotherapy, and other procedures. The use of robots for microneedle puncture has become a worldwide research hotspot, and medical imaging navigation technology plays an essential role in preoperative robotic puncture path planning, intraoperative assisted puncture, and surgical efficacy detection. This paper introduces medical imaging technology and minimally invasive puncture robots, reviews the current status of research on the application of medical imaging navigation technology in minimally invasive puncture robots, and points out its future development trends and challenges.
Collapse
Affiliation(s)
| | - Rongjian Lu
- School of Mechanical and Electronic Engineering, Nanjing Forestry University, Nanjing 210037, China; (S.H.)
| | | | | | | | | |
Collapse
|
2
|
Behrouzi Y, Basiri A, Pourgholi R, Kiaei AA. Fusion of medical images using Nabla operator; Objective evaluations and step-by-step statistical comparisons. PLoS One 2023; 18:e0284873. [PMID: 37585476 PMCID: PMC10431637 DOI: 10.1371/journal.pone.0284873] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/24/2022] [Accepted: 04/11/2023] [Indexed: 08/18/2023] Open
Abstract
Since vectors include direction and magnitude, they have more information than scalars. So, converting the scalar images into the vector field leads achieving much information about the images that have been hidden in the spatial domain. In this paper, the proposed method fuses images after transforming the scalar field of images to a vector one. To transform the field, it uses Nabla operator. After that, the inverse transform is implemented to reconstruct the fused medical image. To show the performance of the proposed method and to evaluate it, different experiments and statistical comparisons were accomplished. Comparing the experimental results with the previous works, shows the effectiveness of the proposed method.
Collapse
Affiliation(s)
- Yasin Behrouzi
- School of Mathematics and Computer Science, Damghan University, Damghan, Iran
| | - Abdolali Basiri
- School of Mathematics and Computer Science, Damghan University, Damghan, Iran
| | - Reza Pourgholi
- School of Mathematics and Computer Science, Damghan University, Damghan, Iran
| | - Ali Akbar Kiaei
- Department of Computer Engineering, Bu-ali Sina University, Hamedan, Iran
| |
Collapse
|
3
|
Dinh PH. Medical image fusion based on enhanced three-layer image decomposition and Chameleon swarm algorithm. Biomed Signal Process Control 2023. [DOI: 10.1016/j.bspc.2023.104740] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/26/2023]
|
4
|
Dinh PH. Combining spectral total variation with dynamic threshold neural P systems for medical image fusion. Biomed Signal Process Control 2023. [DOI: 10.1016/j.bspc.2022.104343] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
|
5
|
Yang Y, Cao S, Wan W, Huang S. Multi-modal medical image super-resolution fusion based on detail enhancement and weighted local energy deviation. Biomed Signal Process Control 2023. [DOI: 10.1016/j.bspc.2022.104387] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/13/2022]
|
6
|
|
7
|
Kong W, Li C, Lei Y. Multimodal medical image fusion using convolutional neural network and extreme learning machine. Front Neurorobot 2022; 16:1050981. [PMID: 36467563 PMCID: PMC9708736 DOI: 10.3389/fnbot.2022.1050981] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/22/2022] [Accepted: 10/28/2022] [Indexed: 08/27/2023] Open
Abstract
The emergence of multimodal medical imaging technology greatly increases the accuracy of clinical diagnosis and etiological analysis. Nevertheless, each medical imaging modal unavoidably has its own limitations, so the fusion of multimodal medical images may become an effective solution. In this paper, a novel fusion method on the multimodal medical images exploiting convolutional neural network (CNN) and extreme learning machine (ELM) is proposed. As a typical representative in deep learning, CNN has been gaining more and more popularity in the field of image processing. However, CNN often suffers from several drawbacks, such as high computational costs and intensive human interventions. To this end, the model of convolutional extreme learning machine (CELM) is constructed by incorporating ELM into the traditional CNN model. CELM serves as an important tool to extract and capture the features of the source images from a variety of different angles. The final fused image can be obtained by integrating the significant features together. Experimental results indicate that, the proposed method is not only helpful to enhance the accuracy of the lesion detection and localization, but also superior to the current state-of-the-art ones in terms of both subjective visual performance and objective criteria.
Collapse
Affiliation(s)
- Weiwei Kong
- School of Computer Science and Technology, Xi'an University of Posts and Telecommunications, Xi'an, China
- Shaanxi Key Laboratory of Network Data Analysis and Intelligent Processing, Xi'an, China
- Xi'an Key Laboratory of Big Data and Intelligent Computing, Xi'an, China
| | - Chi Li
- School of Computer Science and Technology, Xi'an University of Posts and Telecommunications, Xi'an, China
- Shaanxi Key Laboratory of Network Data Analysis and Intelligent Processing, Xi'an, China
- Xi'an Key Laboratory of Big Data and Intelligent Computing, Xi'an, China
| | - Yang Lei
- College of Cryptography Engineering, Engineering University of PAP, Xi'an, China
| |
Collapse
|
8
|
Wu X, Zhou H, Yu H, Hu R, Zhang G, Hu J, He T. A Method for Medical Microscopic Images' Sharpness Evaluation Based on NSST and Variance by Combining Time and Frequency Domains. SENSORS (BASEL, SWITZERLAND) 2022; 22:7607. [PMID: 36236707 PMCID: PMC9573709 DOI: 10.3390/s22197607] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 09/15/2022] [Revised: 10/04/2022] [Accepted: 10/06/2022] [Indexed: 06/16/2023]
Abstract
An algorithm for a sharpness evaluation of microscopic images based on non-subsampled shearlet wave transform (NSST) and variance is proposed in the present study for the purpose of improving the noise immunity and accuracy of a microscope's image autofocus. First, images are decomposed with the NSST algorithm; then, the decomposed sub-band images are subjected to variance to obtain the energy of the sub-band coefficients; and finally, the evaluation value is obtained from the ratio of the energy of the high- and low-frequency sub-band coefficients. The experimental results show that the proposed algorithm delivers better noise immunity performance than other methods reviewed by this study while maintaining high sensitivity.
Collapse
Affiliation(s)
- Xuecheng Wu
- School of Mathematics and Computer Science, Zhejiang A & F University, Hangzhou 311300, China
- Zhejiang Provincial Key Laboratory of Forestry Intelligent Monitoring and Information Technology, Hangzhou 311300, China
| | - Houkui Zhou
- School of Mathematics and Computer Science, Zhejiang A & F University, Hangzhou 311300, China
- Zhejiang Provincial Key Laboratory of Forestry Intelligent Monitoring and Information Technology, Hangzhou 311300, China
| | - Huimin Yu
- College of Information Science & Electronic Engineering, Zhejiang University, Hangzhou 310027, China
- State Key Laboratory of CAD & CG, Hangzhou 310027, China
| | - Roland Hu
- College of Information Science & Electronic Engineering, Zhejiang University, Hangzhou 310027, China
| | - Guangqun Zhang
- School of Mathematics and Computer Science, Zhejiang A & F University, Hangzhou 311300, China
- Zhejiang Provincial Key Laboratory of Forestry Intelligent Monitoring and Information Technology, Hangzhou 311300, China
| | - Junguo Hu
- School of Mathematics and Computer Science, Zhejiang A & F University, Hangzhou 311300, China
- Zhejiang Provincial Key Laboratory of Forestry Intelligent Monitoring and Information Technology, Hangzhou 311300, China
| | - Tao He
- School of Mathematics and Computer Science, Zhejiang A & F University, Hangzhou 311300, China
- Zhejiang Provincial Key Laboratory of Forestry Intelligent Monitoring and Information Technology, Hangzhou 311300, China
| |
Collapse
|
9
|
Multimodal medical image fusion with convolution sparse representation and mutual information correlation in NSST domain. COMPLEX INTELL SYST 2022. [DOI: 10.1007/s40747-022-00792-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/17/2022]
Abstract
AbstractMultimodal medical image is an effective method to solve a series of clinical problems, such as clinical diagnosis and postoperative treatment. In this study, a medical image fusion method based on convolutional sparse representation (CSR) and mutual information correlation is proposed. In this method, the source image is decomposed into one high-frequency and one low-frequency sub-band by non-subsampled shearlet transform. For the high-frequency sub-band, CSR is used for high-frequency coefficient fusion. For the low-frequency sub-band, different fusion strategies are used for different regions by mutual information correlation analysis. Analysis of two kinds of medical image fusion problems, namely, CT–MRI and MRI–SPECT, reveals that the performance of this method is robust in terms of five common objective metrics. Compared with the other six advanced medical image fusion methods, the experimental results show that the proposed method achieves better results in subjective vision and objective evaluation metrics.
Collapse
|
10
|
Ullah H, Zhao Y, Abdalla FYO, Wu L. Fast local Laplacian filtering based enhanced medical image fusion using parameter-adaptive PCNN and local features-based fuzzy weighted matrices. APPL INTELL 2022. [DOI: 10.1007/s10489-021-02834-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/20/2022]
|