1
|
Wang X, Liu T, Mai S. Respiratory motion tracking of the thoracoabdominal surface based on defect-aware point cloud registration. Biomed Eng Lett 2024; 14:1057-1068. [PMID: 39220029 PMCID: PMC11362397 DOI: 10.1007/s13534-024-00390-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/27/2023] [Revised: 04/22/2024] [Accepted: 05/05/2024] [Indexed: 09/04/2024] Open
Abstract
The performance of conventional lung puncture surgery is a complex undertaking due to the surgeon's reliance on visual assessment of respiratory conditions and the manual execution of the technique while the patient maintains breath-holding. However, the failure to correctly perform a puncture technique can lead to negative outcomes, such as the development of sores and pneumothorax. In this work, we proposed a novel approach for monitoring respiratory motion by utilizing defect-aware point cloud registration and descriptor computation. Through a thorough examination of the attributes of the inputs, we suggest the incorporation of a defect detection branch into the registration network. Additionally, we developed two modules with the aim of augmenting the quality of the extracted features. A coarse-to-fine respiratory phase recognition approach based on descriptor computation is devised for the respiratory motion tracking. The efficacy of the suggested registration method is demonstrated through experimental findings conducted on both publicly accessible datasets and thoracoabdominal point cloud datasets. We obtained state-of-the-art registration results on ModelNet40 datasets, with 1.584∘ on rotation mean absolute error and 0.016 mm on translation mean absolute error, respectively. The experimental findings conducted on a thoracoabdominal point cloud dataset indicate that our method exhibits efficacy and efficiency, achieving a frame matching rate of 2 frames per second and a phase recognition accuracy of 96.3%. This allows identifying matching frames from template point clouds that display different parts of a patient's thoracoabdominal surface while breathing regularly to distinguish breathing stages and track breathing.
Collapse
Affiliation(s)
- Xiaoyu Wang
- Shenzhen International Graduate School, Tsinghua University, Shenzhen, 518071 Guangdong China
| | - Tianbo Liu
- Shenzhen International Graduate School, Tsinghua University, Shenzhen, 518071 Guangdong China
| | - Songping Mai
- Shenzhen International Graduate School, Tsinghua University, Shenzhen, 518071 Guangdong China
| |
Collapse
|
2
|
Wang C, Guo L, Zhu J, Zhu L, Li C, Zhu H, Song A, Lu L, Teng GJ, Navab N, Jiang Z. Review of robotic systems for thoracoabdominal puncture interventional surgery. APL Bioeng 2024; 8:021501. [PMID: 38572313 PMCID: PMC10987197 DOI: 10.1063/5.0180494] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/10/2023] [Accepted: 03/11/2024] [Indexed: 04/05/2024] Open
Abstract
Cancer, with high morbidity and high mortality, is one of the major burdens threatening human health globally. Intervention procedures via percutaneous puncture have been widely used by physicians due to its minimally invasive surgical approach. However, traditional manual puncture intervention depends on personal experience and faces challenges in terms of precisely puncture, learning-curve, safety and efficacy. The development of puncture interventional surgery robotic (PISR) systems could alleviate the aforementioned problems to a certain extent. This paper attempts to review the current status and prospective of PISR systems for thoracic and abdominal application. In this review, the key technologies related to the robotics, including spatial registration, positioning navigation, puncture guidance feedback, respiratory motion compensation, and motion control, are discussed in detail.
Collapse
Affiliation(s)
- Cheng Wang
- Hanglok-Tech Co. Ltd., Hengqin 519000, People's Republic of China
| | - Li Guo
- Hanglok-Tech Co. Ltd., Hengqin 519000, People's Republic of China
| | | | - Lifeng Zhu
- State Key Laboratory of Digital Medical Engineering, Jiangsu Key Lab of Remote Measurement and Control, School of Instrument Science and Engineering, Southeast University, Nanjing 210096, People's Republic of China
| | - Chichi Li
- School of Computer Science and Engineering, Macau University of Science and Technology, Macau, 999078, People's Republic of China
| | - Haidong Zhu
- Center of Interventional Radiology and Vascular Surgery, Department of Radiology, Zhongda Hospital, Medical School, Southeast University, Nanjing 210009, People's Republic of China
| | - Aiguo Song
- State Key Laboratory of Digital Medical Engineering, Jiangsu Key Lab of Remote Measurement and Control, School of Instrument Science and Engineering, Southeast University, Nanjing 210096, People's Republic of China
| | | | - Gao-Jun Teng
- Center of Interventional Radiology and Vascular Surgery, Department of Radiology, Zhongda Hospital, Medical School, Southeast University, Nanjing 210009, People's Republic of China
| | | | - Zhongliang Jiang
- Computer Aided Medical Procedures, Technical University of Munich, Munich 80333, Germany
| |
Collapse
|
3
|
Liu L, Chen W, Chen Z, Zhou W, Wei R, Liu Y. Realization and Control of Robotic Injection Prototype With Instantaneous Remote Center of Motion Mechanism. IEEE Trans Biomed Eng 2024; 71:433-445. [PMID: 37594869 DOI: 10.1109/tbme.2023.3306555] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 08/20/2023]
Abstract
OBJECTIVE Although there have been studies conducted on the instantaneous remote center of motion (RCM) mechanism, the general closed-loop control method has not been studied. Thus, this article fills that gap and employs the advantages of this mechanism to develop a novel injection system. METHODS The injection prototype involves the instantaneous RCM mechanism, insertion unit and injection unit. The RCM system is investigated in the presence of time-varying axial stiffness of the screw drive and underactuated case. For safe interaction, compliance control is designed in the insertion system. The stability of all separate systems is investigated with the bounded parameter variation rate. The injection prototype and a robot end-effector were then combined to perform injection. RESULTS Our RCM prototype can achieve a large workspace, and its control effectiveness was verified by multiple frameworks and comparison with previous studies. Compliance-controlled insertion can achieve accurate depth regulation and zero-impedance control for manually operating the needle. With the help of three-dimensional reconstruction and hand/eye calibration, the manipulator can guide the injection prototype to a proper pose for injection of a face model. CONCLUSION The injection prototype was successfully designed. The effectiveness of the whole control system was verified by simulations and experiments. The particular robotic injection task can be performed by the prototype. SIGNIFICANCE This article provides alternative schemes for developing an instantaneous RCM system, screw drive-based surgical tool, and robotic insertion with small needles.
Collapse
|
4
|
Zheng L, Zhang Z, Wang Z, Bao K, Yang L, Yan B, Yan Z, Ye W, Yang R. A multiple closed-loops robotic calibration for accurate surgical puncture. Int J Med Robot 2021; 17:e2242. [PMID: 33591646 DOI: 10.1002/rcs.2242] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/06/2020] [Revised: 02/04/2021] [Accepted: 02/08/2021] [Indexed: 12/23/2022]
Abstract
BACKGROUND Robotic puncture system increasingly demands stringent standard in target location accuracy. The positional and orientational transformation relationships among all components of the system are supposed to be calibrated and identified preoperatively. AIMS The target location performance is directly determined by the calibration result. Therefore, a multiple closed-loops calibration approach is proposed to achieve high-level calibration accuracy in robotic puncture system. MATERIALS & METHODS: This method takes as input the three-dimensional position information of the retro-reflective markers mounted on the surgical tool, which is detected by the optical tracking system in real time during robotic movement. There is less complicated mathematical derivation and calculation in the presented algorithm by applying the closed-loop principle. RESULTS Experimental results validate that it can achieve accurate robotic target location with less input data and computation-cost, satisfying the clinical puncture requirements. DISCUSSION The spatial calibration between robotic arm and optical tracking system efficiently realised by the presented approach present an alternative which can be safely applied to the robotic puncture system for accurate insertion. CONCLUSION Overall, a multiple closed-loops calibration approach is proposed in this work, which may increase surgical efficiency.
Collapse
Affiliation(s)
- Lingxiang Zheng
- School of Materials Science and Engineering, South China University of Technology, Guangzhou, China
| | - Zhesi Zhang
- School of Materials Science and Engineering, South China University of Technology, Guangzhou, China
| | | | - Kaiyang Bao
- School of Materials Science and Engineering, South China University of Technology, Guangzhou, China
| | - Lin Yang
- Department of Radiology, Guangdong General Hospital, Guangzhou, China
| | - Biao Yan
- School of Materials Science and Engineering, South China University of Technology, Guangzhou, China
| | - Zeping Yan
- School of Mathematics, University of Edinburgh, Edinburgh, UK
| | - Weitao Ye
- Department of Radiology, Guangdong General Hospital, Guangzhou, China
| | - Rongqian Yang
- School of Materials Science and Engineering, South China University of Technology, Guangzhou, China
| |
Collapse
|
5
|
A CT-guided robotic needle puncture method for lung tumours with respiratory motion. Phys Med 2020; 73:48-56. [PMID: 32315807 DOI: 10.1016/j.ejmp.2020.04.003] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 11/11/2019] [Revised: 03/14/2020] [Accepted: 04/02/2020] [Indexed: 01/16/2023] Open
Abstract
PURPOSE Percutaneous interventions rely on needle puncture to deliver medical devices into lesions. For lung tumours, respiratory motion makes effective puncture procedures difficult to achieve. To address this issue, a needle puncture method considering respiration is proposed to improve the accuracy of lung puncture. METHODS The accuracy of puncture is ensured by visualization and needle guidance. Dynamic visualization of the respiratory motion is developed for needle path planning based on four-dimensional computed tomography (4DCT) images. The rendered image is synchronized with the actual breathing by using respiratory signals. A robotic needle insertion strategy for velocity adjustment based on these respiratory signals is designed to guide the needle towards the moving tumour. RESULTS The dynamic visualization was tested on multiple 4DCT datasets and achieved a frame rate of over 32 frames per second (FPS). A computer simulation was carried out to verify the feasibility of the needle insertion strategy. Needle puncture was performed on a phantom, and a mean accuracy of 1.34±0.18 mm was achieved. CONCLUSIONS In this paper, an efficient and robust method is proposed to improve the visualization and targeting of lung puncture, which reduces the impact of respiratory motion on the accuracy.
Collapse
|
6
|
Ahmed A. An algorithm for accurate needle orientation. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2017; 2016:5095-5098. [PMID: 28269414 DOI: 10.1109/embc.2016.7591873] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
Abstract
For the early diagnosis and treatment, a needle insertion for biopsy and treatment is a common and important means. To solve the low accuracy and high probability of repeat surgery in traditional surgical procedures, a computer-assisted system is an effective solution. In such a system, how to acquire the accurate orientation of the surgical needle is one of the most important factors. This paper proposes a "Center Point Method" for needle axis extraction with high accuracy. The method makes full use of edge points from two sides of the needle in image and creates center points through which an accurate axis is extracted. Experiments show that the proposed method improves needle orientation accuracy by approximately 70% compared to related work in binocular stereovision system.
Collapse
|
7
|
Bour G, Martel F, Goffin L, Bayle B, Gangloff J, Aprahamian M, Marescaux J, Egly JM. Design and development of a robotized system coupled to µCT imaging for intratumoral drug evaluation in a HCC mouse model. PLoS One 2014; 9:e106675. [PMID: 25203629 PMCID: PMC4159281 DOI: 10.1371/journal.pone.0106675] [Citation(s) in RCA: 10] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/30/2014] [Accepted: 08/01/2014] [Indexed: 12/19/2022] Open
Abstract
Hepatocellular carcinoma (HCC) is one of the most common cancer related deaths worldwide. One of the main challenges in cancer treatment is drug delivery to target cancer cells specifically. Preclinical evaluation of intratumoral drugs in orthotopic liver cancer mouse models is difficult, as percutaneous injection hardly can be precisely performed manually. In the present study we have characterized a hepatoma model developing a single tumor nodule by implantation of Hep55.1C cells in the liver of syngeneic C57BL/6J mice. Tumor evolution was followed up by µCT imaging, and at the histological and molecular levels. This orthotopic, poorly differentiated mouse HCC model expressing fibrosis, inflammation and cancer markers was used to assess the efficacy of drugs. We took advantage of the high precision of a previously developed robotized system for automated, image-guided intratumoral needle insertion, to administer every week in the tumor of the Hep55.1C mouse model. A significant tumor growth inhibition was observed using our robotized system, whereas manual intraperitoneal administration had no effect, by comparison to untreated control mice.
Collapse
Affiliation(s)
- Gaétan Bour
- Institut de Recherche contre les Cancers de l′Appareil Digestif (IRCAD), Strasbourg, France
| | - Fernand Martel
- IGBMC, Department of Functional Genomics and Cancer, CNRS/INSERM/Université de Strasbourg, BP 163, Illkirch, C. U. Strasbourg, Strasbourg, France
| | - Laurent Goffin
- ICube laboratory UMR, CNRS 7357, University of Strasbourg, Strasbourg, France
| | - Bernard Bayle
- ICube laboratory UMR, CNRS 7357, University of Strasbourg, Strasbourg, France
| | - Jacques Gangloff
- ICube laboratory UMR, CNRS 7357, University of Strasbourg, Strasbourg, France
| | - Marc Aprahamian
- Institut de Recherche contre les Cancers de l′Appareil Digestif (IRCAD), Strasbourg, France
| | - Jacques Marescaux
- Institut de Recherche contre les Cancers de l′Appareil Digestif (IRCAD), Strasbourg, France
| | - Jean-Marc Egly
- Institut de Recherche contre les Cancers de l′Appareil Digestif (IRCAD), Strasbourg, France
- IGBMC, Department of Functional Genomics and Cancer, CNRS/INSERM/Université de Strasbourg, BP 163, Illkirch, C. U. Strasbourg, Strasbourg, France
| |
Collapse
|