1
|
Wu K, Li B, Zhang Y, Dai X. Review of research on path planning and control methods of flexible steerable needle puncture robot. Comput Assist Surg (Abingdon) 2022; 27:91-112. [PMID: 36052822 DOI: 10.1080/24699322.2021.2023647] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/14/2022] Open
Abstract
In the field of minimally invasive interventional therapy, the related research on the soft tissue puncture robot and its technology based on the flexible steerable needle as a research hot topic at present, and it has been developed rapidly in the past ten years. In order to better understand the development status of the flexible steerable needle puncture (FSNP) robot and provide reference for its design and improvement in subsequent research, it is necessary to introduce in two aspects of FSNP robot: the puncture path planning and the control methods. First, this article introduced the concept of the FSNP technology, and the necessity of the application of FSNP soft tissue robot in minimally invasive interventional surgery. Second, this article mainly introduced the principle of FSNP, the path planning of FSNP, the navigation and positioning control of the needle tip of the flexible steerable needle, the control method of FSNP system, and the controllable flexible needle. Finally, combined with the above analysis and introduction, it was pointed out that FSNP soft tissue robot and its related technology would be an important development direction in the field of minimally invasive interventional therapy in the future, and the current existing problems were pointed out. Meanwhile, the development trend of FSNP robot control technology was summarized and prospected.
Collapse
Affiliation(s)
- Kaiyu Wu
- Robotics & Its Engineering Research Center, Mechatronic engineering, Harbin University of Science and Technology, Harbin, China
| | - Bing Li
- Robotics & Its Engineering Research Center, Mechatronic engineering, Harbin University of Science and Technology, Harbin, China
| | - Yongde Zhang
- Robotics & Its Engineering Research Center, Mechatronic engineering, Harbin University of Science and Technology, Harbin, China
| | - Xuesong Dai
- Robotics & Its Engineering Research Center, Mechatronic engineering, Harbin University of Science and Technology, Harbin, China
| |
Collapse
|
2
|
Uus A, Zhang T, Jackson LH, Roberts TA, Rutherford MA, Hajnal JV, Deprez M. Deformable Slice-to-Volume Registration for Motion Correction of Fetal Body and Placenta MRI. IEEE TRANSACTIONS ON MEDICAL IMAGING 2020; 39:2750-2759. [PMID: 32086200 PMCID: PMC7116020 DOI: 10.1109/tmi.2020.2974844] [Citation(s) in RCA: 36] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/07/2023]
Abstract
In in-utero MRI, motion correction for fetal body and placenta poses a particular challenge due to the presence of local non-rigid transformations of organs caused by bending and stretching. The existing slice-to-volume registration (SVR) reconstruction methods are widely employed for motion correction of fetal brain that undergoes only rigid transformation. However, for reconstruction of fetal body and placenta, rigid registration cannot resolve the issue of misregistrations due to deformable motion, resulting in degradation of features in the reconstructed volume. We propose a Deformable SVR (DSVR), a novel approach for non-rigid motion correction of fetal MRI based on a hierarchical deformable SVR scheme to allow high resolution reconstruction of the fetal body and placenta. Additionally, a robust scheme for structure-based rejection of outliers minimises the impact of registration errors. The improved performance of DSVR in comparison to SVR and patch-to-volume registration (PVR) methods is quantitatively demonstrated in simulated experiments and 20 fetal MRI datasets from 28-31 weeks gestational age (GA) range with varying degree of motion corruption. In addition, we present qualitative evaluation of 100 fetal body cases from 20-34 weeks GA range.
Collapse
|
3
|
Moving object tracking in clinical scenarios: application to cardiac surgery and cerebral aneurysm clipping. Int J Comput Assist Radiol Surg 2019; 14:2165-2176. [PMID: 31309385 PMCID: PMC6858403 DOI: 10.1007/s11548-019-02030-z] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/28/2019] [Accepted: 07/03/2019] [Indexed: 10/26/2022]
Abstract
BACKGROUND AND OBJECTIVES Surgical procedures such as laparoscopic and robotic surgeries are popular since they are invasive in nature and use miniaturized surgical instruments for small incisions. Tracking of the instruments (graspers, needle drivers) and field of view from the stereoscopic camera during surgery could further help the surgeons to remain focussed and reduce the probability of committing any mistakes. Tracking is usually preferred in computerized video surveillance, traffic monitoring, military surveillance system, and vehicle navigation. Despite the numerous efforts over the last few years, object tracking still remains an open research problem, mainly due to motion blur, image noise, lack of image texture, and occlusion. Most of the existing object tracking methods are time-consuming and less accurate when the input video contains high volume of information and more number of instruments. METHODS This paper presents a variational framework to track the motion of moving objects in surgery videos. The key contributions are as follows: (1) A denoising method using stochastic resonance in maximal overlap discrete wavelet transform is proposed and (2) a robust energy functional based on Bhattacharyya coefficient to match the target region in the first frame of the input sequence with the subsequent frames using a similarity metric is developed. A modified affine transformation-based registration is used to estimate the motion of the features following an active contour-based segmentation method to converge the contour resulted from the registration process. RESULTS AND CONCLUSION The proposed method has been implemented on publicly available databases; the results are found satisfactory. Overlap index (OI) is used to evaluate the tracking performance, and the maximum OI is found to be 76% and 88% on private data and public data sequences.
Collapse
|
4
|
Moreira P, Patel N, Wartenberg M, Li G, Tuncali K, Heffter T, Burdette EC, Iordachita I, Fischer GS, Hata N, Tempany CM, Tokuda J. Evaluation of robot-assisted MRI-guided prostate biopsy: needle path analysis during clinical trials. Phys Med Biol 2018; 63:20NT02. [PMID: 30226214 PMCID: PMC6198326 DOI: 10.1088/1361-6560/aae214] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2022]
Abstract
While the interaction between a needle and the surrounding tissue is known to cause a significant targeting error in prostate biopsy leading to false-negative results, few studies have demonstrated how it impacts in the actual procedure. We performed a pilot study on robot-assisted MRI-guided prostate biopsy with an emphasis on the in-depth analysis of the needle-tissue interaction in vivo. The data were acquired during in-bore transperineal prostate biopsies in patients using a 4 degrees-of-freedom (DoF) MRI-compatible robot. The anatomical structures in the pelvic area and the needle path were reconstructed from MR images, and quantitatively analyzed. We analyzed each structure individually and also proposed a mathematical model to investigate the influence of those structures in the targeting error using the mixed-model regression. The median targeting error in 188 insertions (27 patients) was 6.3 mm. Both the individual anatomical structure analysis and the mixed-model analysis showed that the deviation resulted from the contact between the needle and the skin as the main source of error. On contrary, needle bending inside the tissue (expressed as needle curvature) did not vary among insertions with targeting errors above and below the average. The analysis indicated that insertions crossing the bulbospongiosus presented a targeting error lower than the average. The mixed-model analysis demonstrated that the distance between the needle guide and the patient skin, the deviation at the entry point, and the path length inside the pelvic diaphragm had a statistically significant contribution to the targeting error (p < 0.05). Our results indicate that the errors associated with the elastic contact between the needle and the skin were more prominent than the needle bending along the insertion. Our findings will help to improve the preoperative planning of transperineal prostate biopsies.
Collapse
Affiliation(s)
- Pedro Moreira
- Department of Radiology, Brigham and Women’s Hospital, Harvard Medical School, Boston, MA, USA
| | - Niravkumar Patel
- Laboratory for Computational Sensing and Robotics, Johns Hopkins University, Baltimore, MD, USA
| | - Marek Wartenberg
- Automation and Interventional Medicine Lab, Worcester Polytechnic Institute, Worcester, MA, USA
| | - Gang Li
- Automation and Interventional Medicine Lab, Worcester Polytechnic Institute, Worcester, MA,USA
| | - Kemal Tuncali
- Department of Radiology, Brigham and Women’s Hospital, Harvard Medical School, Boston, MA,USA
| | | | | | - Iulian Iordachita
- Laboratory for Computational Sensing and Robotics, Johns Hopkins University, Baltimore, MD, USA
| | - Gregory S. Fischer
- Automation and Interventional Medicine Lab, Worcester Polytechnic Institute, Worcester, MA, USA
| | - Nobuhiko Hata
- Department of Radiology, Brigham and Women’s Hospital, Harvard Medical School, Boston, MA, USA
| | - Clare M. Tempany
- Department of Radiology, Brigham and Women’s Hospital, Harvard Medical School, Boston, MA, USA
| | - Junichi Tokuda
- Department of Radiology, Brigham and Women’s Hospital, Harvard Medical School, Boston, MA,USA
| |
Collapse
|
5
|
Ferrante E, Paragios N. Slice-to-volume medical image registration: A survey. Med Image Anal 2017; 39:101-123. [DOI: 10.1016/j.media.2017.04.010] [Citation(s) in RCA: 95] [Impact Index Per Article: 13.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/11/2016] [Revised: 04/08/2017] [Accepted: 04/27/2017] [Indexed: 11/25/2022]
|
6
|
Xu H, Lasso A, Fedorov A, Tuncali K, Tempany C, Fichtinger G. Multi-slice-to-volume registration for MRI-guided transperineal prostate biopsy. Int J Comput Assist Radiol Surg 2014; 10:563-72. [PMID: 25193145 DOI: 10.1007/s11548-014-1108-7] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/23/2014] [Accepted: 08/10/2014] [Indexed: 11/25/2022]
Abstract
PURPOSE Prostate needle biopsy is a commonly performed procedure since it is the most definitive form of cancer diagnosis. Magnetic resonance imaging (MRI) allows target-specific biopsies to be performed. However, needle placements are often inaccurate due to intra-operative prostate motion and the lack of motion compensation techniques. This paper detects and determines the extent of tissue displacement during an MRI-guided biopsy so that the needle insertion plan can be adjusted accordingly. METHODS A multi-slice-to-volume registration algorithm was developed to align the pre-operative planning image volume with three intra-operative orthogonal image slices of the prostate acquired immediately before needle insertion. The algorithm consists of an initial rigid transformation followed by a deformable step. RESULTS A total of 14 image sets from 10 patients were studied. Based on prostate contour alignment, the registrations were accurate to within 2 mm. CONCLUSION This algorithm can be used to increase the needle targeting accuracy by alerting the clinician if the biopsy target has moved significantly prior to needle insertion. The proposed method demonstrated feasibility of intra-operative target localization and motion compensation for MRI-guided prostate biopsy.
Collapse
Affiliation(s)
- Helen Xu
- School of Computing, Queen's University, Kingston, Canada,
| | | | | | | | | | | |
Collapse
|
7
|
De Silva T, Cool DW, Romagnoli C, Fenster A, Ward AD. Evaluating the utility of intraprocedural 3D TRUS image information in guiding registration for displacement compensation during prostate biopsy. Med Phys 2014; 41:082901. [DOI: 10.1118/1.4885959] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022] Open
|
8
|
Galassi F, Brujic D, Rea M, Lambert N, Desouza N, Ristic M. Fast and accurate localization of multiple RF markers for tracking in MRI-guided interventions. MAGNETIC RESONANCE MATERIALS IN PHYSICS BIOLOGY AND MEDICINE 2014; 28:33-48. [PMID: 24802620 PMCID: PMC4315881 DOI: 10.1007/s10334-014-0446-3] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 07/24/2013] [Revised: 04/07/2014] [Accepted: 04/07/2014] [Indexed: 11/01/2022]
Abstract
OBJECT A new method for 3D localization of N fiducial markers from 1D projections is presented and analysed. It applies to semi-active markers and active markers using a single receiver channel. MATERIALS AND METHODS The novel algorithm computes candidate points using peaks in three optimally selected projections and removes fictitious points by verifying detected peaks in additional projections. Computational complexity was significantly reduced by avoiding cluster analysis, while higher accuracy was achieved by using optimal projections and by applying Gaussian interpolation in peak detection. Computational time, accuracy and robustness were analysed through Monte Carlo simulations and experiments. The method was employed in a prototype MRI guided prostate biopsy system and used in preclinical experiments. RESULTS The computational time for 6 markers was better than 2 ms, an improvement of up to 100 times, compared to the method by Flask et al. (J Magn Reson Imaging 14(5):617-627, 2001). Experimental maximum localization error was lower than 0.3 mm; standard deviation was 0.06 mm. Targeting error was about 1 mm. Tracking update rate was about 10 Hz. CONCLUSION The proposed method is particularly suitable in systems requiring any of the following: high frame rate, tracking of three or more markers, data filtering or interleaving.
Collapse
Affiliation(s)
- Francesca Galassi
- Mechanical Engineering Department, Imperial College London, London, UK,
| | | | | | | | | | | |
Collapse
|
9
|
Xu H, Lasso A, Guion P, Krieger A, Kaushal A, Singh AK, Pinto PA, Coleman J, Grubb RL, Lattouf JB, Menard C, Whitcomb LL, Fichtinger G. Accuracy analysis in MRI-guided robotic prostate biopsy. Int J Comput Assist Radiol Surg 2013; 8:937-44. [PMID: 23532560 DOI: 10.1007/s11548-013-0831-9] [Citation(s) in RCA: 16] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/10/2013] [Accepted: 03/11/2013] [Indexed: 10/27/2022]
Abstract
PURPOSE To assess retrospectively the clinical accuracy of an magnetic resonance imaging-guided robotic prostate biopsy system that has been used in the US National Cancer Institute for over 6 years. METHODS Series of 2D transverse volumetric MR image slices of the prostate both pre (high-resolution T2-weighted)- and post (low-resolution)- needle insertions were used to evaluate biopsy accuracy. A three-stage registration algorithm consisting of an initial two-step rigid registration followed by a B-spline deformable alignment was developed to capture prostate motion during biopsy. The target displacement (distance between planned and actual biopsy target), needle placement error (distance from planned biopsy target to needle trajectory), and biopsy error (distance from actual biopsy target to needle trajectory) were calculated as accuracy assessment. RESULTS A total of 90 biopsies from 24 patients were studied. The registrations were validated by checking prostate contour alignment using image overlay, and the results were accurate to within 2 mm. The mean target displacement, needle placement error, and clinical biopsy error were 5.2, 2.5, and 4.3 mm, respectively. CONCLUSION The biopsy error reported suggests that quantitative imaging techniques for prostate registration and motion compensation may improve prostate biopsy targeting accuracy.
Collapse
Affiliation(s)
- Helen Xu
- Queen's University, Kingston, ON, Canada,
| | | | | | | | | | | | | | | | | | | | | | | | | |
Collapse
|
10
|
Local property characterization of prostate glands using inhomogeneous modeling based on tumor volume and location analysis. Med Biol Eng Comput 2012; 51:197-205. [DOI: 10.1007/s11517-012-0984-7] [Citation(s) in RCA: 10] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/19/2012] [Accepted: 10/29/2012] [Indexed: 10/27/2022]
|