1
|
Zhang Y, Jin J, Zhu Y. Incremental shape measurement with fiber Bragg gratings in a multi-core fiber for three-dimensional paths. Opt Lett 2023; 48:5595-5598. [PMID: 37910711 DOI: 10.1364/ol.501799] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/28/2023] [Accepted: 10/04/2023] [Indexed: 11/03/2023]
Abstract
A multi-core fiber (MCF) provides a compact solution for three-dimensional (3D) shape measurement. In this Letter, an incremental shape measurement method for 3D paths is proposed, using an MCF based on fiber Bragg gratings (FBGs). A few FBG sets can iteratively provide plenty of strain information about the 3D path during navigation. The overall continuities of the curvature and torsion are improved based on intensive strain calculations. Meanwhile, the transformation matrix algorithm is used to reconstruct the shape of 3D paths. Dynamic measurement experiments of a seven-core fiber with two FBG sets are carried out to verify the incremental shape measurement method. This method shows a great performance of the different paths, with a maximum incremental position error of 4.68%.
Collapse
|
2
|
Peng W, Wu W, Zhang J, Xie H, Zhang S, Gu L. An automatic framework for estimating the pose of the catheter distal section using a coarse-to-fine network. Comput Methods Programs Biomed 2022; 225:107036. [PMID: 35905696 DOI: 10.1016/j.cmpb.2022.107036] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/27/2022] [Revised: 06/22/2022] [Accepted: 07/20/2022] [Indexed: 06/15/2023]
Abstract
BACKGROUND AND OBJECTIVE During percutaneous coronary intervention procedures, generally only 2D X-ray images are provided. The consequent lack of depth perception makes it difficult for interventionists to visually estimate the pose of medical tools inside the vasculature, especially for novices. Although some automatic methods have been developed to aid interventionists, it is still a challenging task to obtain stable and accurate pose estimation. In this paper, we describe a learning-based framework for estimating the pose of the catheter distal section (CDS). The main innovation of this framework is the proposal of a coarse-to-fine fusion network (CFF-Net) which can achieve the shape and orientation estimation for the CDS. METHODS By adopting a two-step fusion, CFF-Net progressively solves the shape and orientation ambiguities. The first step is the early fusion where the 2D projection image fuses with the shape prior before input, which makes the estimated result own a specific catheter distal shape. The second step is the late fusion where CFF-Net fuse feature maps and the orientation data from Electromagnetic (EM) sensors to confirm the overall orientation of the CDS. Finally, the estimated pose in the EM space will be obtained after we combine the estimated shape and orientation from CFF-Net with the position information from the EM sensor. RESULTS The effectiveness of CFF-Net has been verified in a simulated environment where RMSE of CFF-Net is 0.706 ± 0.121 mm. This approach was further transferred from simulation to reality using the real-world data, where RMSE of CFF-Net is 1.121 ± 0.124 mm and RMSE of the whole proposed framework is 1.577 ± 0.144 mm. CONCLUSION In simulated and real-world experiments, our proposed approach has been proven to achieve high accuracy while ensuring real-time processing for estimating the pose of the CDS.
Collapse
Affiliation(s)
- Wenjia Peng
- School of Biomedical Engineering and Institute of Medical Robotics, Shanghai Jiao Tong University, Shanghai, China
| | - Wei Wu
- School of Biomedical Engineering and Institute of Medical Robotics, Shanghai Jiao Tong University, Shanghai, China
| | - Jingyang Zhang
- School of Biomedical Engineering and Institute of Medical Robotics, Shanghai Jiao Tong University, Shanghai, China
| | - Hongzhi Xie
- Department of Cardiology, Peking Union Medical College Hospital, Peking, China.
| | - Shuyang Zhang
- Department of Cardiology, Peking Union Medical College Hospital, Peking, China
| | - Lixu Gu
- School of Biomedical Engineering and Institute of Medical Robotics, Shanghai Jiao Tong University, Shanghai, China.
| |
Collapse
|
3
|
Sahu SK, Sozer C, Rosa B, Tamadon I, Renaud P, Menciassi A. Shape Reconstruction Processes for Interventional Application Devices: State of the Art, Progress, and Future Directions. Front Robot AI 2021; 8:758411. [PMID: 34869615 PMCID: PMC8640970 DOI: 10.3389/frobt.2021.758411] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/13/2021] [Accepted: 10/11/2021] [Indexed: 01/02/2023] Open
Abstract
Soft and continuum robots are transforming medical interventions thanks to their flexibility, miniaturization, and multidirectional movement abilities. Although flexibility enables reaching targets in unstructured and dynamic environments, it also creates challenges for control, especially due to interactions with the anatomy. Thus, in recent years lots of efforts have been devoted for the development of shape reconstruction methods, with the advancement of different kinematic models, sensors, and imaging techniques. These methods can increase the performance of the control action as well as provide the tip position of robotic manipulators relative to the anatomy. Each method, however, has its advantages and disadvantages and can be worthwhile in different situations. For example, electromagnetic (EM) and Fiber Bragg Grating (FBG) sensor-based shape reconstruction methods can be used in small-scale robots due to their advantages thanks to miniaturization, fast response, and high sensitivity. Yet, the problem of electromagnetic interference in the case of EM sensors, and poor response to high strains in the case of FBG sensors need to be considered. To help the reader make a suitable choice, this paper presents a review of recent progress on shape reconstruction methods, based on a systematic literature search, excluding pure kinematic models. Methods are classified into two categories. First, sensor-based techniques are presented that discuss the use of various sensors such as FBG, EM, and passive stretchable sensors for reconstructing the shape of the robots. Second, imaging-based methods are discussed that utilize images from different imaging systems such as fluoroscopy, endoscopy cameras, and ultrasound for the shape reconstruction process. The applicability, benefits, and limitations of each method are discussed. Finally, the paper draws some future promising directions for the enhancement of the shape reconstruction methods by discussing open questions and alternative methods.
Collapse
Affiliation(s)
- Sujit Kumar Sahu
- The BioRobotics Institute, Scuola Superiore Sant’Anna, Pisa, Italy
- Department of Excellence in Robotics & AI, Scuola Superiore Sant’Anna, Pisa, Italy
- ICube, CNRS, INSA Strasbourg, University of Strasbourg, Strasbourg, France
| | - Canberk Sozer
- The BioRobotics Institute, Scuola Superiore Sant’Anna, Pisa, Italy
- Department of Excellence in Robotics & AI, Scuola Superiore Sant’Anna, Pisa, Italy
| | - Benoit Rosa
- ICube, CNRS, INSA Strasbourg, University of Strasbourg, Strasbourg, France
| | - Izadyar Tamadon
- The BioRobotics Institute, Scuola Superiore Sant’Anna, Pisa, Italy
- Department of Excellence in Robotics & AI, Scuola Superiore Sant’Anna, Pisa, Italy
| | - Pierre Renaud
- ICube, CNRS, INSA Strasbourg, University of Strasbourg, Strasbourg, France
| | - Arianna Menciassi
- The BioRobotics Institute, Scuola Superiore Sant’Anna, Pisa, Italy
- Department of Excellence in Robotics & AI, Scuola Superiore Sant’Anna, Pisa, Italy
| |
Collapse
|