1
|
Singh GD, Singh M. Virtual Surgical Planning: Modeling from the Present to the Future. J Clin Med 2021; 10:jcm10235655. [PMID: 34884359 PMCID: PMC8658225 DOI: 10.3390/jcm10235655] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/27/2021] [Revised: 10/19/2021] [Accepted: 11/23/2021] [Indexed: 11/16/2022] Open
Abstract
Virtual surgery planning is a non-invasive procedure, which uses digital clinical data for diagnostic, procedure selection and treatment planning purposes, including the forecast of potential outcomes. The technique begins with 3D data acquisition, using various methods, which may or may not utilize ionizing radiation, such as 3D stereophotogrammetry, 3D cone-beam CT scans, etc. Regardless of the imaging technique selected, landmark selection, whether it is manual or automated, is the key to transforming clinical data into objects that can be interrogated in virtual space. As a prerequisite, the data require alignment and correspondence such that pre- and post-operative configurations can be compared in real and statistical shape space. In addition, these data permit predictive modeling, using either model-based, data-based or hybrid modeling. These approaches provide perspectives for the development of customized surgical procedures and medical devices with accuracy, precision and intelligence. Therefore, this review briefly summarizes the current state of virtual surgery planning.
Collapse
Affiliation(s)
- G. Dave Singh
- Virtual Craniofacial Laboratory, Stanford University, Stanford, CA 94301, USA
- Correspondence: ; Tel.: +1-720-924-9929
| | | |
Collapse
|
2
|
Guo Z, Tai Y, Du J, Chen Z, Li Q, Shi J. Automatically Addressing System for Ultrasound-Guided Renal Biopsy Training Based on Augmented Reality. IEEE J Biomed Health Inform 2021; 25:1495-1507. [PMID: 33684049 DOI: 10.1109/jbhi.2021.3064308] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
Chronic kidney disease has become one of the diseases with the highest morbidity and mortality in kidney diseases, and there are still some problems in surgery. During the operation, the surgeon can only operate on two-dimensional ultrasound images and cannot determine the spatial position relationship between the lesion and the medical puncture needle in real-time. The average number of punctures per patient will reach 3 to 4, Increasing the incidence of complications after a puncture. This article starts with ultrasound-guided renal biopsy navigation training, optimizes puncture path planning, and puncture training assistance. The augmented reality technology, combined with renal puncture surgery training was studied. This paper develops a prototype ultrasound-guided renal biopsy surgery training system, which improves the accuracy and reliability of the system training. The system is compared with the VR training system. The results show that the augmented reality training platform is more suitable as a surgical training platform. Because it takes a short time and has a good training effect.
Collapse
|
3
|
Zeng H, Yuan-Liang S, Xie G, Lu F, Fu R. Three-dimensional printing of facial contour based on preoperative computer simulation and its clinical application. Medicine (Baltimore) 2019; 98:e12919. [PMID: 30633150 PMCID: PMC6336557 DOI: 10.1097/md.0000000000012919] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/04/2022] Open
Abstract
Facial contouring is a complex procedure performed to alter tissue contents and restore facial appearance. However, it is difficult to measure the amount of the tissue volume that is needed. This study demonstrated the use of preoperative computer simulation (PCS) and 3-dimensional (3D) printing in contouring procedure to maximize outcomes.Three-dimensional surface imaging (3DSI) or computed tomography imaging (CTI) data were reconstructed into a 3D model by Mimics software. PCS was performed by simulating the changes in bone and soft tissue. The stimulating volume change was calculated by Boolean operations. Finally, the virtual model was exported into 3D printer to produce physical templates to guide surgical plan. PCS and actual postoperative results were compared using objective rating scales and by cephalometrical measurements.With the direct guidance of PCS and 3D templates, contouring procedure was performed accurately. Satisfactory facial contouring was achieved with less operative time. As the plastic surgery panel rated, 45.8% of the 3DSI results and 41.7% of the CTI results were identical with the actual outcome, and 0% of them was poor. There were no significant differences in patient satisfaction between the PCS of 3DSI and CTI.Preoperative computer simulation is an accurate method for designing contour adjustment plans, and can be an efficient and reliable predictor of outcomes with customized templates.
Collapse
Affiliation(s)
- Hui Zeng
- Department of Infectious Disease, Sichuan Provincial People's Hospital, Chengdu, Sichuan
| | - Shih Yuan-Liang
- Department of Plastic and Cosmetic Surgery, Nanfang Hospital, Southern Medical University, Guangzhou, Guangdong
| | - Gan Xie
- Department of Plastic and Cosmetic Surgery, Nanfang Hospital, Southern Medical University, Guangzhou, Guangdong
| | - Feng Lu
- Department of Plastic and Cosmetic Surgery, Nanfang Hospital, Southern Medical University, Guangzhou, Guangdong
| | - Rong Fu
- Department of Plastic Surgery, Chengdu Jinniu District People's Hospital, Chengdu, Sichuan, P.R. China
| |
Collapse
|
4
|
Xu L, Lu Y, Liu Q. Integrating viscoelastic mass spring dampers into position-based dynamics to simulate soft tissue deformation in real time. ROYAL SOCIETY OPEN SCIENCE 2018; 5:171587. [PMID: 29515870 PMCID: PMC5830759 DOI: 10.1098/rsos.171587] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/09/2017] [Accepted: 01/02/2018] [Indexed: 05/13/2023]
Abstract
We propose a novel method to simulate soft tissue deformation for virtual surgery applications. The method considers the mechanical properties of soft tissue, such as its viscoelasticity, nonlinearity and incompressibility; its speed, stability and accuracy also meet the requirements for a surgery simulator. Modifying the traditional equation for mass spring dampers (MSD) introduces nonlinearity and viscoelasticity into the calculation of elastic force. Then, the elastic force is used in the constraint projection step for naturally reducing constraint potential. The node position is enforced by the combined spring force and constraint conservative force through Newton's second law. We conduct a comparison study of conventional MSD and position-based dynamics for our new integrating method. Our approach enables stable, fast and large step simulation by freely controlling visual effects based on nonlinearity, viscoelasticity and incompressibility. We implement a laparoscopic cholecystectomy simulator to demonstrate the practicality of our method, in which liver and gallbladder deformation can be simulated in real time. Our method is an appropriate choice for the development of real-time virtual surgery applications.
Collapse
Affiliation(s)
- Lang Xu
- Britton Chance Center for Biomedical Photonics, School of Engineering Sciences, Wuhan National Laboratory for Optoelectronics-Huazhong University of Science and Technology, Hubei, Wuhan 430074, People's Republic of China
- Key Laboratory for Biomedical Photonics, Huazhong University of Science and Technology, Ministry of Education, 1037 Luoyu Road, Hubei, Wuhan 430074, People's Republic of China
| | - Yuhua Lu
- Britton Chance Center for Biomedical Photonics, School of Engineering Sciences, Wuhan National Laboratory for Optoelectronics-Huazhong University of Science and Technology, Hubei, Wuhan 430074, People's Republic of China
- Key Laboratory for Biomedical Photonics, Huazhong University of Science and Technology, Ministry of Education, 1037 Luoyu Road, Hubei, Wuhan 430074, People's Republic of China
| | - Qian Liu
- Britton Chance Center for Biomedical Photonics, School of Engineering Sciences, Wuhan National Laboratory for Optoelectronics-Huazhong University of Science and Technology, Hubei, Wuhan 430074, People's Republic of China
- Key Laboratory for Biomedical Photonics, Huazhong University of Science and Technology, Ministry of Education, 1037 Luoyu Road, Hubei, Wuhan 430074, People's Republic of China
| |
Collapse
|
5
|
Zhou J, Luo Z, Li C, Deng M. Real-time deformation of human soft tissues: A radial basis meshless 3D model based on Marquardt's algorithm. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2018; 153:237-252. [PMID: 29157456 DOI: 10.1016/j.cmpb.2017.09.008] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/21/2017] [Revised: 08/18/2017] [Accepted: 09/12/2017] [Indexed: 06/07/2023]
Abstract
BACKGROUND When the meshless method is used to establish the mathematical-mechanical model of human soft tissues, it is necessary to define the space occupied by human tissues as the problem domain and the boundary of the domain as the surface of those tissues. Nodes should be distributed in both the problem domain and on the boundaries. Under external force, the displacement of the node is computed by the meshless method to represent the deformation of biological soft tissues. However, computation by the meshless method consumes too much time, which will affect the simulation of real-time deformation of human tissues in virtual surgery. METHODS In this article, the Marquardt's Algorithm is proposed to fit the nodal displacement at the problem domain's boundary and obtain the relationship between surface deformation and force. When different external forces are applied, the deformation of soft tissues can be quickly obtained based on this relationship. RESULTS AND CONCLUSIONS The analysis and discussion show that the improved model equations with Marquardt's Algorithm not only can simulate the deformation in real-time but also preserve the authenticity of the deformation model's physical properties.
Collapse
Affiliation(s)
- Jianyong Zhou
- School of Mechatronic Engineering, Nanchang University, Jiangxi, China.
| | - Zu Luo
- School of Information Engineering, Nanchang University, Jiangxi, China.
| | - Chunquan Li
- School of Information Engineering, Nanchang University, Jiangxi, China.
| | - Mi Deng
- Department of Mathematical Sciences, New Mexico State University, Las Cruces, NM, 88003, USA.
| |
Collapse
|
6
|
A machine learning approach for real-time modelling of tissue deformation in image-guided neurosurgery. Artif Intell Med 2017; 80:39-47. [DOI: 10.1016/j.artmed.2017.07.004] [Citation(s) in RCA: 42] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/03/2016] [Revised: 05/19/2017] [Accepted: 07/06/2017] [Indexed: 12/21/2022]
|
7
|
Pan B, Zhang G, Xia JJ, Yuan P, Ip HHS, He Q, Lee PKM, Chow B, Zhou X. Prediction of soft tissue deformations after CMF surgery with incremental kernel ridge regression. Comput Biol Med 2016; 75:1-9. [PMID: 27213920 DOI: 10.1016/j.compbiomed.2016.04.020] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/20/2016] [Revised: 04/27/2016] [Accepted: 04/28/2016] [Indexed: 10/21/2022]
Abstract
Facial soft tissue deformation following osteotomy is associated with the corresponding biomechanical characteristics of bone and soft tissues. However, none of the methods devised to predict soft tissue deformation after osteotomy incorporates population-based statistical data. The aim of this study is to establish a statistical model to describe the relationship between biomechanical characteristics and soft tissue deformation after osteotomy. We proposed an incremental kernel ridge regression (IKRR) model to accomplish this goal. The input of the model is the biomechanical information computed by the Finite Element Method (FEM). The output is the soft tissue deformation generated from the paired pre-operative and post-operative 3D images. The model is adjusted incrementally with each new patient's biomechanical information. Therefore, the IKRR model enables us to predict potential soft tissue deformations for new patient by using both biomechanical and statistical information. The integration of these two types of data is critically important for accurate simulations of soft-tissue changes after surgery. The proposed method was evaluated by leave-one-out cross-validation using data from 11 patients. The average prediction error of our model (0.9103mm) was lower than some state-of-the-art algorithms. This model is promising as a reliable way to prevent the risk of facial distortion after craniomaxillofacial surgery.
Collapse
Affiliation(s)
- Binbin Pan
- College of Mathematics and Statistics, Shenzhen University, Shenzhen 518060, China; The Methodist Hospital Research Institute, Houston, TX 77030, USA
| | - Guangming Zhang
- Department of Radiology, Wake Forest University School of Medicine, Winston-Salem, NC 27157, USA
| | - James J Xia
- The Methodist Hospital Research Institute, Houston, TX 77030, USA
| | - Peng Yuan
- The Methodist Hospital Research Institute, Houston, TX 77030, USA
| | - Horace H S Ip
- Department of Computer Science, City University of Hong Kong, Hong Kong, China
| | - Qizhen He
- Department of Computer Science, City University of Hong Kong, Hong Kong, China
| | - Philip K M Lee
- Hong Kong Dental Implant & Maxillofacial Centre, Hong Kong, China
| | - Ben Chow
- Hong Kong Dental Implant & Maxillofacial Centre, Hong Kong, China
| | - Xiaobo Zhou
- Department of Radiology, Wake Forest University School of Medicine, Winston-Salem, NC 27157, USA.
| |
Collapse
|
8
|
3D Heart Modeling with Cellular Automata, Mass-Spring System and CUDA. LECTURE NOTES IN COMPUTER SCIENCE 2013. [DOI: 10.1007/978-3-642-39958-9_28] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/02/2022]
|
9
|
Abate A, Vincent S, Dobbe R, Silletti A, Master N, Axelrod JD, Tomlin CJ. A mathematical model to study the dynamics of epithelial cellular networks. IEEE/ACM TRANSACTIONS ON COMPUTATIONAL BIOLOGY AND BIOINFORMATICS 2012; 9:1607-1620. [PMID: 23221083 PMCID: PMC3558995 DOI: 10.1109/tcbb.2012.126] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/01/2023]
Abstract
Epithelia are sheets of connected cells that are essential across the animal kingdom. Experimental observations suggest that the dynamical behavior of many single-layered epithelial tissues has strong analogies with that of specific mechanical systems, namely large networks consisting of point masses connected through spring-damper elements and undergoing the influence of active and dissipating forces. Based on this analogy, this work develops a modeling framework to enable the study of the mechanical properties and of the dynamic behavior of large epithelial cellular networks. The model is built first by creating a network topology that is extracted from the actual cellular geometry as obtained from experiments, then by associating a mechanical structure and dynamics to the network via spring-damper elements. This scalable approach enables running simulations of large network dynamics: the derived modeling framework in particular is predisposed to be tailored to study general dynamics (for example, morphogenesis) of various classes of single-layered epithelial cellular networks. In this contribution, we test the model on a case study of the dorsal epithelium of the Drosophila melanogaster embryo during early dorsal closure (and, less conspicuously, germband retraction).
Collapse
Affiliation(s)
- Alessandro Abate
- Delft Center for Systems and Control, TU Delft, Delft, The Netherlands
| | | | - Roel Dobbe
- Delft Center for Systems and Control, TU Delft, Delft, The Netherlands
| | - Alberto Silletti
- Department of Information Engineering, University of Padova, Padova, Italy
| | - Neal Master
- Department of Electrical Engineering and Computer Sciences, University of California at Berkeley, Berkeley, CA, USA
| | - Jeffrey D. Axelrod
- Department of Pathology, Stanford University School of Medicine, Stanford, CA, USA
| | - Claire J. Tomlin
- Department of Electrical Engineering and Computer Sciences, University of California at Berkeley, Berkeley, CA, USA
| |
Collapse
|
10
|
Kim SY, Kyung KU, Park J, Kwon DS. Real-time area-based haptic rendering and the augmented tactile display device for a palpation simulator. Adv Robot 2012. [DOI: 10.1163/156855307781035619] [Citation(s) in RCA: 43] [Impact Index Per Article: 3.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/19/2022]
Affiliation(s)
- Sang-Youn Kim
- a Interactive Virtual Reality Laboratory, School of Internet Media Engineering, Korea University of Technology and Education, Gajeonri 307, Byeong cheon-myeon, Cheon-an, Chungnam, South Korea
| | - Ki-Uk Kyung
- b Electronics and Telecommunication Research Institute, Gajeongno, Yuseung-gu, Daejeon, 305-700, South Korea
| | - Jinah Park
- c Computer Graphics & Visualization Laboratory, School of Engineering, ICU, Munjiro 119, Yuseong-gu, Daejeon, 305-714, South Korea
| | - Dong-Soo Kwon
- d Telerobotics & Control Laboratory, Dept. of Mechanical Engineering, KAIST, Guseong-Dong 373-1, Yuseung-gu, Daejeon, 305-701, South Korea
| |
Collapse
|
11
|
Schendel SA, Duncan KS, Lane C. Image fusion in preoperative planning. Facial Plast Surg Clin North Am 2012; 19:577-90, vii. [PMID: 22004853 DOI: 10.1016/j.fsc.2011.07.002] [Citation(s) in RCA: 9] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/16/2022]
Abstract
This article presents a comprehensive overview of generating a digital Patient-Specific Anatomic Reconstruction (PSAR) model of the craniofacial complex as the foundation for a more objective surgical planning platform. The technique explores fusing the patient's 3D radiograph with the corresponding high-precision 3D surface image within a biomechanical context. As taking 3D radiographs has been common practice for many years, this article describes various approaches to 3D surface imaging and the importance of achieving high-precision anatomical results to simulate surgical outcomes that can be measured and quantified. With the PSAR model readily available for facial assessment and virtual surgery, the advantages of this surgical planning technique are discussed.
Collapse
|
12
|
Patient-Specific Modeling of Breast Biomechanics with Applications to Breast Cancer Detection and Treatment. PATIENT-SPECIFIC MODELING IN TOMORROW'S MEDICINE 2011. [DOI: 10.1007/8415_2011_92] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/20/2023]
|
13
|
Colombo G, Filippi S, Rizzi C, Rotini F. A new design paradigm for the development of custom-fit soft sockets for lower limb prostheses. COMPUT IND 2010. [DOI: 10.1016/j.compind.2010.03.008] [Citation(s) in RCA: 57] [Impact Index Per Article: 4.1] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/28/2022]
|
14
|
GPU-based physical cut in interactive haptic simulations. Int J Comput Assist Radiol Surg 2010; 6:265-72. [PMID: 20567949 DOI: 10.1007/s11548-010-0505-9] [Citation(s) in RCA: 8] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/15/2010] [Accepted: 06/05/2010] [Indexed: 10/19/2022]
Abstract
PURPOSE Interactive, physics based, simulations of deformable bodies are a growing research area with possible applications to computer-aided surgery. Their aim is to create virtual environments where surgeons are free to practice. To ensure the needed realism, the simulations must be performed with deformable bodies. The goal of this paper is to describe the approach to the development of a physics-based surgical simulator with haptic feedback. METHOD The main development issue is the representation of the organ behavior at the high rates required by haptic realism. Since even high-end computers have inadequate performance, our approach exploits the parallelism of modern Graphics Processing Units (GPU). Particular attention is paid to the simulation of cuts because of their great importance in the surgical practice and the difficulty in handling topological changes in real time. RESULTS To prove the correctness of our approach, we simulated an interactive, physically based, virtual abdomen. The simulation allows the user to interact with deformable models. Deformable models are updated in real time, thus allowing the rendering of force feedback to the user. The method is optimized to handle high quality scenes: we report results of interactive simulation of two virtual tools interacting with a complex model. CONCLUSIONS The integration of physics-based deformable models in simulations greatly increases the realism of the virtual environment, taking into account real tissue properties and allowing the user to feel the actual forces exerted by organs on virtual tools. Our method proves the feasibility of exploiting GPU to simulate deformable models in interactive virtual environments.
Collapse
|
15
|
Very fast soft tissue predictions with mass tensor model for maxillofacial surgery planning systems. ACTA ACUST UNITED AC 2005. [DOI: 10.1016/j.ics.2005.03.048] [Citation(s) in RCA: 15] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022]
|
16
|
|