1
|
Bengs M, Sprenger J, Gerlach S, Neidhardt M, Schlaefer A. Real-Time Motion Analysis With 4D Deep Learning for Ultrasound-Guided Radiotherapy. IEEE Trans Biomed Eng 2023; 70:2690-2699. [PMID: 37030809 DOI: 10.1109/tbme.2023.3262422] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/30/2023]
Abstract
Motion compensation in radiation therapy is a challenging scenario that requires estimating and forecasting motion of tissue structures to deliver the target dose. Ultrasound offers direct imaging of tissue in real-time and is considered for image guidance in radiation therapy. Recently, fast volumetric ultrasound has gained traction, but motion analysis with such high-dimensional data remains difficult. While deep learning could bring many advantages, such as fast data processing and high performance, it remains unclear how to process sequences of hundreds of image volumes efficiently and effectively. We present a 4D deep learning approach for real-time motion estimation and forecasting using long-term 4D ultrasound data. Using motion traces acquired during radiation therapy combined with various tissue types, our results demonstrate that long-term motion estimation can be performed markerless with a tracking error of 0.35±0.2 mm and with an inference time of less than 5 ms. Also, we demonstrate forecasting directly from the image data up to 900 ms into the future. Overall, our findings highlight that 4D deep learning is a promising approach for motion analysis during radiotherapy.
Collapse
|
2
|
Rose C, Ebert MA, Mukwada G, Skorska M, Gill S. Intrafraction motion during CyberKnife® prostate SBRT: impact of imaging frequency and patient factors. Phys Eng Sci Med 2023; 46:669-685. [DOI: 10.1007/s13246-023-01242-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/15/2022] [Accepted: 03/06/2023] [Indexed: 03/29/2023]
|
3
|
Seitz PK, Karger CP, Bendl R, Schwahofer A. Strategy for automatic ultrasound (US) probe positioning in robot-assisted ultrasound guided radiation therapy. Phys Med Biol 2023; 68. [PMID: 36584398 DOI: 10.1088/1361-6560/acaf46] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/26/2022] [Accepted: 12/30/2022] [Indexed: 12/31/2022]
Abstract
Objective. As part of image-guided radiotherapy, ultrasound-guided radiotherapy is currently already in use and under investigation for robot assisted systems Ipsen 2021. It promises a real-time tumor localization during irradiation (intrafractional) without extra dose. The ultrasound probe is held and guided by a robot. However, there is a lack of basic safety mechanisms and interaction strategies to enable a safe clinical procedure. In this study we investigate potential positioning strategies with safety mechanisms for a safe robot-human-interaction.Approach. A compact setup of ultrasound device, lightweight robot, tracking camera, force sensor and control computer were integrated in a software application to represent a potential USgRT setup. For the realization of a clinical procedure, positioning strategies for the ultrasound head with the help of the robot were developed, implemented, and tested. In addition, basic safety mechanisms for the robot have been implemented, using the integrated force sensor, and have been tested by intentional collisions.Main results. Various positioning methods from manual guidance to completely automated procedures were tested. Robot-guided methods achieved higher positioning accuracy and were faster in execution compared to conventional hand-guided methods. The developed safety mechanisms worked as intended and the detected collision force were below 20 N.Significance. The study demonstrates the feasibility of a new approach for safe robotic ultrasound imaging, with a focus on abdominal usage (liver, prostate, kidney). The safety measures applied here can be extended to other human-robot interactions and present the basic for further studies in medical applications.
Collapse
Affiliation(s)
- Peter Karl Seitz
- Department of Medical Physics in Radiation Oncology, German Cancer Research Center (DKFZ), Heidelberg, Germany.,National Center for Radiation Research in Oncology (NCRO), Heidelberg Institute for Radiation Oncology (HIRO), Heidelberg, Germany.,University of Heidelberg, Faculty of Medicine Heidelberg, Heidelberg, Germany.,Medical Informatics, Heilbronn University, Heilbronn, Germany
| | - Christian P Karger
- Department of Medical Physics in Radiation Oncology, German Cancer Research Center (DKFZ), Heidelberg, Germany.,National Center for Radiation Research in Oncology (NCRO), Heidelberg Institute for Radiation Oncology (HIRO), Heidelberg, Germany
| | - Rolf Bendl
- Medical Informatics, Heilbronn University, Heilbronn, Germany
| | - Andrea Schwahofer
- Department of Medical Physics in Radiation Oncology, German Cancer Research Center (DKFZ), Heidelberg, Germany.,National Center for Radiation Research in Oncology (NCRO), Heidelberg Institute for Radiation Oncology (HIRO), Heidelberg, Germany.,Therapanacea, Paris, France
| |
Collapse
|
4
|
Sprenger J, Bengs M, Gerlach S, Neidhardt M, Schlaefer A. Systematic analysis of volumetric ultrasound parameters for markerless 4D motion tracking. Int J Comput Assist Radiol Surg 2022; 17:2131-2139. [PMID: 35597846 PMCID: PMC9515030 DOI: 10.1007/s11548-022-02665-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/12/2022] [Accepted: 04/27/2022] [Indexed: 11/05/2022]
Abstract
OBJECTIVES Motion compensation is an interesting approach to improve treatments of moving structures. For example, target motion can substantially affect dose delivery in radiation therapy, where methods to detect and mitigate the motion are widely used. Recent advances in fast, volumetric ultrasound have rekindled the interest in ultrasound for motion tracking. We present a setup to evaluate ultrasound based motion tracking and we study the effect of imaging rate and motion artifacts on its performance. METHODS We describe an experimental setup to acquire markerless 4D ultrasound data with precise ground truth from a robot and evaluate different real-world trajectories and system settings toward accurate motion estimation. We analyze motion artifacts in continuously acquired data by comparing to data recorded in a step-and-shoot fashion. Furthermore, we investigate the trade-off between the imaging frequency and resolution. RESULTS The mean tracking errors show that continuously acquired data leads to similar results as data acquired in a step-and-shoot fashion. We report mean tracking errors up to 2.01 mm and 1.36 mm on the continuous data for the lower and higher resolution, respectively, while step-and-shoot data leads to mean tracking errors of 2.52 mm and 0.98 mm. CONCLUSIONS We perform a quantitative analysis of different system settings for motion tracking with 4D ultrasound. We can show that precise tracking is feasible and additional motion in continuously acquired data does not impair the tracking. Moreover, the analysis of the frequency resolution trade-off shows that a high imaging resolution is beneficial in ultrasound tracking.
Collapse
Affiliation(s)
- Johanna Sprenger
- Institute of Medical Technology and Intelligent Systems, Hamburg University of Technology, Hamburg, Germany.
| | - Marcel Bengs
- Institute of Medical Technology and Intelligent Systems, Hamburg University of Technology, Hamburg, Germany
| | - Stefan Gerlach
- Institute of Medical Technology and Intelligent Systems, Hamburg University of Technology, Hamburg, Germany
| | - Maximilian Neidhardt
- Institute of Medical Technology and Intelligent Systems, Hamburg University of Technology, Hamburg, Germany
| | - Alexander Schlaefer
- Institute of Medical Technology and Intelligent Systems, Hamburg University of Technology, Hamburg, Germany
| |
Collapse
|
5
|
Kaschwich M, Dell A, Matysiak F, Bouchagiar J, Bayer A, Scharfschwerdt M, Ernst F, Kleemann M, Horn M. Development of an ultrasound-capable phantom with patient-specific 3D-printed vascular anatomy to simulate peripheral endovascular interventions. Ann Anat 2020; 232:151563. [DOI: 10.1016/j.aanat.2020.151563] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/04/2020] [Revised: 05/26/2020] [Accepted: 05/27/2020] [Indexed: 12/19/2022]
|
6
|
Schluter M, Furweger C, Schlaefer A. Optimizing Configurations for 7-DoF Robotic Ultrasound Guidance in Radiotherapy of the Prostate. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2020; 2019:6983-6986. [PMID: 31947445 DOI: 10.1109/embc.2019.8857245] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
Abstract
Robotic ultrasound guidance is promising for tracking of organ motion during radiotherapy treatments, but the radio-opaque robot and probe interfere with beam delivery. The effect on treatment plan quality can be mitigated by the use of a robot arm with kinematic redundancy, such that the robot is able to elude delivered beams during treatment by changing its configuration. However, these changes require robot motion close to the patient, lead to an increased treatment time, and require coordination with the beam delivery. We propose an optimization workflow which integrates the problem of selecting suitable robot configurations into a linear-programming-based workflow for treatment plan optimization. Starting with a large set of candidate configurations, a minimal subset is determined which provides equivalent plan quality. Our results show that, typically, six configurations are sufficient for this purpose. Furthermore, we show that optimal configurations can be reused for dose planning of subsequent patients.
Collapse
|
7
|
Bian Q, Zhang X, Wang Z, Liu M, Li B, Wu D, Liu G. Virtual surgery system for liver tumor resection. JOURNAL OF INTELLIGENT & FUZZY SYSTEMS 2020. [DOI: 10.3233/jifs-179401] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Affiliation(s)
- Qian Bian
- School of Electronics and Information Engineering, Xi’an Siyuan University, Xi’an, Shanxi, P. R. China
| | - Xuejun Zhang
- School of Computer, Electronics and Information, Guangxi University, Nanning, Guangxi, P. R. China
- Guangxi Key Laboratory of Multimedia Communications and Network Technology, Nanning, Guangxi, China
| | - Zhenduo Wang
- School of Electronics and Information Engineering, Xi’an Siyuan University, Xi’an, Shanxi, P. R. China
| | - Mujun Liu
- School of Computer, Electronics and Information, Guangxi University, Nanning, Guangxi, P. R. China
| | - Bijiang Li
- School of Computer, Electronics and Information, Guangxi University, Nanning, Guangxi, P. R. China
| | - Dongbo Wu
- People’s Hospital of Guangxi Zhuang Nationality Autonomous Region, Nanning, Guangxi, China
| | - Gang Liu
- People’s Hospital of Guangxi Zhuang Nationality Autonomous Region, Nanning, Guangxi, China
| |
Collapse
|
8
|
Seitz PK, Baumann B, Johnen W, Lissek C, Seidel J, Bendl R. Development of a robot-assisted ultrasound-guided radiation therapy (USgRT). Int J Comput Assist Radiol Surg 2019; 15:491-501. [DOI: 10.1007/s11548-019-02104-y] [Citation(s) in RCA: 12] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/13/2019] [Accepted: 12/04/2019] [Indexed: 11/30/2022]
|
9
|
Schlüter M, Fürweger C, Schlaefer A. Optimizing robot motion for robotic ultrasound-guided radiation therapy. ACTA ACUST UNITED AC 2019; 64:195012. [DOI: 10.1088/1361-6560/ab3bfb] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2022]
|
10
|
Analysis and optimization of the robot setup for robotic-ultrasound-guided radiation therapy. Int J Comput Assist Radiol Surg 2019; 14:1379-1387. [DOI: 10.1007/s11548-019-02009-w] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/24/2019] [Accepted: 05/30/2019] [Indexed: 10/26/2022]
|
11
|
The Use of Ultrasound Imaging in the External Beam Radiotherapy Workflow of Prostate Cancer Patients. BIOMED RESEARCH INTERNATIONAL 2018; 2018:7569590. [PMID: 29619375 PMCID: PMC5829356 DOI: 10.1155/2018/7569590] [Citation(s) in RCA: 23] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 10/27/2017] [Revised: 12/13/2017] [Accepted: 12/28/2017] [Indexed: 12/16/2022]
Abstract
External beam radiotherapy (EBRT) is one of the curative treatment options for prostate cancer patients. The aim of this treatment option is to irradiate tumor tissue, while sparing normal tissue as much as possible. Frequent imaging during the course of the treatment (image guided radiotherapy) allows for determination of the location and shape of the prostate (target) and of the organs at risk. This information is used to increase accuracy in radiation dose delivery resulting in better tumor control and lower toxicity. Ultrasound imaging is harmless for the patient, it is cost-effective, and it allows for real-time volumetric organ tracking. For these reasons, it is an ideal technique for image guidance during EBRT workflows. Review papers have been published in which the use of ultrasound imaging in EBRT workflows for different cancer sites (prostate, breast, etc.) was extensively covered. This new review paper aims at providing the readers with an update on the current status for prostate cancer ultrasound guided EBRT treatments.
Collapse
|
12
|
Gerlach S, Kuhlemann I, Ernst F, Fürweger C, Schlaefer A. Impact of robotic ultrasound image guidance on plan quality in SBRT of the prostate. Br J Radiol 2017; 90:20160926. [PMID: 28749165 DOI: 10.1259/bjr.20160926] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/05/2022] Open
Abstract
OBJECTIVE Ultrasound provides good image quality, fast volumetric imaging and is established for abdominal image guidance. Robotic transducer placement may facilitate intrafractional motion compensation in radiation therapy. We consider integration with the CyberKnife and study whether the kinematic redundancy of a seven-degrees-of-freedom robot allows for acceptable plan quality for prostate treatments. METHODS Reference treatment plans were generated for 10 prostate cancer cases previously treated with the CyberKnife. Considering transducer and prostate motion by different safety margins, 10 different robot poses, and 3 different elbow configurations, we removed all beams colliding with robot or transducer. For each combination, plans were generated using the same strict dose constraints and the objective to maximize the target coverage. Additionally, plans for the union of all unblocked beams were generated. RESULTS In 9 cases the planning target coverage with the ultrasound robot was within 1.1 percentage points of the reference coverage. It was 1.7 percentage points for one large prostate. For one preferable robot position, kinematic redundancy decreased the average number of blocked beam directions from 23.1 to 14.5. CONCLUSION The impact of beam blocking can largely be offset by treatment planning and using a kinematically redundant robot. Plan quality can be maintained by carefully choosing the ultrasound robot position and pose. For smaller planning target volumes the difference in coverage is negligible for safety margins of up to 35 mm. Advances in knowledge: Integrating a robot for online intrafractional image guidance based on ultrasound can be realized while maintaining acceptable plan quality for prostate cancer treatments with the CyberKnife.
Collapse
Affiliation(s)
- Stefan Gerlach
- 1 Institute of Medical Technology, Hamburg University of Technology, Hamburg, Germany
| | - Ivo Kuhlemann
- 2 Institute for Robotics and Cognitive Systems, Universität zu Lübeck, Lübeck, Germany
| | - Floris Ernst
- 2 Institute for Robotics and Cognitive Systems, Universität zu Lübeck, Lübeck, Germany
| | | | - Alexander Schlaefer
- 1 Institute of Medical Technology, Hamburg University of Technology, Hamburg, Germany
| |
Collapse
|