1
|
He W, Zhao B, Zhou Y, Wu R, Wu G, Li Y, Lu M, Zhu L, Gao Y. Freehand 3D Ultrasound Imaging Based on Probe-mounted Vision and IMU System. ULTRASOUND IN MEDICINE & BIOLOGY 2024; 50:1143-1154. [PMID: 38702284 DOI: 10.1016/j.ultrasmedbio.2024.03.021] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/08/2023] [Revised: 03/24/2024] [Accepted: 03/31/2024] [Indexed: 05/06/2024]
Abstract
OBJECTIVES Freehand three-dimensional (3D) ultrasound (US) is of great significance for clinical diagnosis and treatment, it is often achieved with the aid of external devices (optical and/or electromagnetic, etc.) that monitor the location and orientation of the US probe. However, this external monitoring is often impacted by imaging environment such as optical occlusions and/or electromagnetic (EM) interference. METHODS To address the above issues, we integrated a binocular camera and an inertial measurement unit (IMU) on a US probe. Subsequently, we built a tight coupling model utilizing the unscented Kalman algorithm based on Lie groups (UKF-LG), combining vision and inertial information to infer the probe's movement, through which the position and orientation of the US image frame are calculated. Finally, the volume data was reconstructed with the voxel-based hole-filling method. RESULTS The experiments including calibration experiments, tracking performance evaluation, phantom scans, and real scenarios scans have been conducted. The results show that the proposed system achieved the accumulated frame position error of 3.78 mm and the orientation error of 0.36° and reconstructed 3D US images with high quality in both phantom and real scenarios. CONCLUSIONS The proposed method has been demonstrated to enhance the robustness and effectiveness of freehand 3D US. Follow-up research will focus on improving the accuracy and stability of multi-sensor fusion to make the system more practical in clinical environments.
Collapse
Affiliation(s)
- Weizhen He
- School of Biomedical Engineering, Shenzhen University Medical School, Shenzhen University, Shenzhen, China
| | - Bingshuai Zhao
- School of Biomedical Engineering, Shenzhen University Medical School, Shenzhen University, Shenzhen, China
| | - Yongjin Zhou
- Guangdong Key Laboratory of Biomedical Measurements and Ultrasound Imaging, School of Biomedical Engineering, Shenzhen University Medical School, Shenzhen University, Shenzhen, China
| | - Ruodai Wu
- Department of Radiology, Shenzhen University General Hospital, Shenzhen University, Shenzhen, China
| | - Guangyao Wu
- Department of Radiology, Shenzhen University General Hospital, Shenzhen University, Shenzhen, China
| | - Ye Li
- Lauterbur Research Center for Biomedical Imaging, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen. China
| | - Minhua Lu
- Guangdong Key Laboratory of Biomedical Measurements and Ultrasound Imaging, School of Biomedical Engineering, Shenzhen University Medical School, Shenzhen University, Shenzhen, China; National-Regional Key Technology Engineering Laboratory for Medical Ultrasound, Guangdong Key Laboratory of Biomedical Measurements and Ultrasound Imaging, School of Biomedical Engineering, Shenzhen University Medical School, Shenzhen University, Shenzhen, China
| | | | - Yi Gao
- School of Biomedical Engineering, Shenzhen University Medical School, Shenzhen University, Shenzhen, China; Guangdong Key Laboratory of Biomedical Measurements and Ultrasound Imaging, School of Biomedical Engineering, Shenzhen University Medical School, Shenzhen University, Shenzhen, China; Shenzhen Key Laboratory of Precision Medicine for Hematological Malignancies, Shenzhen, China; Marshall Laboratory of Biomedical Engineering, Shenzhen, China.
| |
Collapse
|
2
|
Peng C, Cai Q, Chen M, Jiang X. Recent Advances in Tracking Devices for Biomedical Ultrasound Imaging Applications. MICROMACHINES 2022; 13:mi13111855. [PMID: 36363876 PMCID: PMC9695235 DOI: 10.3390/mi13111855] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/08/2022] [Revised: 10/26/2022] [Accepted: 10/27/2022] [Indexed: 05/27/2023]
Abstract
With the rapid advancement of tracking technologies, the applications of tracking systems in ultrasound imaging have expanded across a wide range of fields. In this review article, we discuss the basic tracking principles, system components, performance analyses, as well as the main sources of error for popular tracking technologies that are utilized in ultrasound imaging. In light of the growing demand for object tracking, this article explores both the potential and challenges associated with different tracking technologies applied to various ultrasound imaging applications, including freehand 3D ultrasound imaging, ultrasound image fusion, ultrasound-guided intervention and treatment. Recent development in tracking technology has led to increased accuracy and intuitiveness of ultrasound imaging and navigation with less reliance on operator skills, thereby benefiting the medical diagnosis and treatment. Although commercially available tracking systems are capable of achieving sub-millimeter resolution for positional tracking and sub-degree resolution for orientational tracking, such systems are subject to a number of disadvantages, including high costs and time-consuming calibration procedures. While some emerging tracking technologies are still in the research stage, their potentials have been demonstrated in terms of the compactness, light weight, and easy integration with existing standard or portable ultrasound machines.
Collapse
Affiliation(s)
- Chang Peng
- School of Biomedical Engineering, ShanghaiTech University, Shanghai 201210, China
| | - Qianqian Cai
- Department of Mechanical and Aerospace Engineering, North Carolina State University, Raleigh, NC 27695, USA
| | - Mengyue Chen
- Department of Mechanical and Aerospace Engineering, North Carolina State University, Raleigh, NC 27695, USA
| | - Xiaoning Jiang
- Department of Mechanical and Aerospace Engineering, North Carolina State University, Raleigh, NC 27695, USA
| |
Collapse
|