1
|
3D US-CT/MRI registration for percutaneous focal liver tumor ablations. Int J Comput Assist Radiol Surg 2023:10.1007/s11548-023-02915-0. [PMID: 37162735 DOI: 10.1007/s11548-023-02915-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/10/2023] [Accepted: 04/10/2023] [Indexed: 05/11/2023]
Abstract
PURPOSE US-guided percutaneous focal liver tumor ablations have been considered promising curative treatment techniques. To address cases with invisible or poorly visible tumors, registration of 3D US with CT or MRI is a critical step. By taking advantage of deep learning techniques to efficiently detect representative features in both modalities, we aim to develop a 3D US-CT/MRI registration approach for liver tumor ablations. METHODS Facilitated by our nnUNet-based 3D US vessel segmentation approach, we propose a coarse-to-fine 3D US-CT/MRI image registration pipeline based on the liver vessel surface and centerlines. Then, phantom, healthy volunteer and patient studies are performed to demonstrate the effectiveness of our proposed registration approach. RESULTS Our nnUNet-based vessel segmentation model achieved a Dice score of 0.69. In healthy volunteer study, 11 out of 12 3D US-MRI image pairs were successfully registered with an overall centerline distance of 4.03±2.68 mm. Two patient cases achieved target registration errors (TRE) of 4.16 mm and 5.22 mm. CONCLUSION We proposed a coarse-to-fine 3D US-CT/MRI registration pipeline based on nnUNet vessel segmentation models. Experiments based on healthy volunteers and patient trials demonstrated the effectiveness of our registration workflow. Our code and example data are publicly available in this r epository.
Collapse
|
2
|
Development and evaluation of an open-source virtual reality C-Arm simulator. COMPUTER METHODS IN BIOMECHANICS AND BIOMEDICAL ENGINEERING: IMAGING & VISUALIZATION 2022. [DOI: 10.1080/21681163.2022.2152374] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/04/2022]
|
3
|
3D US-Based Evaluation and Optimization of Tumor Coverage for US-Guided Percutaneous Liver Thermal Ablation. IEEE TRANSACTIONS ON MEDICAL IMAGING 2022; 41:3344-3356. [PMID: 35724283 DOI: 10.1109/tmi.2022.3184334] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/15/2023]
Abstract
Complete tumor coverage by the thermal ablation zone and with a safety margin (5 or 10 mm) is required to achieve the entire tumor eradication in liver tumor ablation procedures. However, 2D ultrasound (US) imaging has limitations in evaluating the tumor coverage by imaging only one or multiple planes, particularly for cases with multiple inserted applicators or irregular tumor shapes. In this paper, we evaluate the intra-procedural tumor coverage using 3D US imaging and investigate whether it can provide clinically needed information. Using data from 14 cases, we employed surface- and volume-based evaluation metrics to provide information on any uncovered tumor region. For cases with incomplete tumor coverage or uneven ablation margin distribution, we also proposed a novel margin uniformity -based approach to provide quantitative applicator adjustment information for optimization of tumor coverage. Both the surface- and volume-based metrics showed that 5 of 14 cases had incomplete tumor coverage according to the estimated ablation zone. After applying our proposed applicator adjustment approach, the simulated results showed that 92.9% (13 of 14) cases achieved 100% tumor coverage and the remaining case can benefit by increasing the ablation time or power. Our proposed method can evaluate the intra-procedural tumor coverage and intuitively provide applicator adjustment information for the physician. Our 3D US-based method is compatible with the constraints of conventional US-guided ablation procedures and can be easily integrated into the clinical workflow.
Collapse
|
4
|
Toward Fluoro-Free Interventions: Using Radial Intracardiac Ultrasound for Vascular Navigation. ULTRASOUND IN MEDICINE & BIOLOGY 2022; 48:1290-1298. [PMID: 35487839 DOI: 10.1016/j.ultrasmedbio.2022.02.025] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/19/2021] [Revised: 12/23/2021] [Accepted: 02/28/2022] [Indexed: 06/14/2023]
Abstract
Transcatheter cardiovascular interventions have the advantage of patient safety, reduced surgery time and minimal trauma to the patient's body. Transcathether interventions, which are performed percutaneously, are limited by the lack of direct line of sight with the procedural tools and the patient anatomy. Therefore, such interventional procedures rely heavily on image guidance for navigating toward and delivering therapy at the target site. Vascular navigation via the inferior vena cava, from the groin to the heart, is an imperative part of most transcatheter cardiovascular interventions including heart valve repair surgeries and ablation therapy. Traditionally, the inferior vena cava is navigated using fluoroscopic techniques such as venography and computed tomography venography. These X-ray-based techniques can have detrimental effects on the patient as well as the surgical team, causing increased radiation exposure, leading to risk of cancer, fetal defects and eye cataracts. The use of a heavy lead apron has also been reported to cause back pain and spine issues, thus leading to interventionalist's disc disease. We propose the use of a catheter-based ultrasound augmented with electromagnetic tracking technology to generate a vascular roadmap in real time and perform navigation without harmful radiation. In this pilot study, we used spatially tracked intracardiac echocardiography to reconstruct a vessel from a phantom in a 3-D virtual environment. We illustrate how the proposed ultrasound-based navigation will appear in a virtual environment, by navigating a tracked guidewire within the vessels in the phantom without any radiation-based imaging. The geometric accuracy is assessed using a computed tomography scan of the phantom, with a Dice coefficient of 0.79. The average distance between the surfaces of the two models comes out to be 1.7 ± 1.12 mm.
Collapse
|
5
|
A Robust Edge-Preserving Stereo Matching Method for Laparoscopic Images. IEEE TRANSACTIONS ON MEDICAL IMAGING 2022; 41:1651-1664. [PMID: 35085075 DOI: 10.1109/tmi.2022.3147414] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/14/2023]
Abstract
Stereo matching has become an active area of research in the field of computer vision. In minimally invasive surgery, stereo matching provides depth information to surgeons, with the potential to increase the safety of surgical procedures, particularly those performed laparoscopically. Many stereo matching methods have been reported to perform well for natural images, but for images acquired during a laparoscopic procedure, they are limited by image characteristics including illumination differences, weak texture content, specular highlights, and occlusions. To overcome these limitations, we propose a robust edge-preserving stereo matching method for laparoscopic images, comprising an efficient sparse-dense feature matching step, left and right image illumination equalization, and refined disparity optimization. We validated the proposed method using both benchmark biological phantoms and surgical stereoscopic data. Experimental results illustrated that, in the presence of heavy illumination differences between image pairs, texture and textureless surfaces, specular highlights and occlusions, our proposed approach consistently obtains a more accurate estimate of the disparity map than state-of-the-art stereo matching methods in terms of robustness and boundary preservation.
Collapse
|
6
|
Planning System for the Optimization of Electric Field Delivery using Implanted Electrodes for Brain Tumor Control. Med Phys 2022; 49:6055-6067. [PMID: 35754362 DOI: 10.1002/mp.15825] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/03/2022] [Revised: 06/06/2022] [Accepted: 06/17/2022] [Indexed: 11/07/2022] Open
Abstract
BACKGROUND The use of non-ionizing electric fields from low intensity voltage sources (<10 V) to control malignant tumor growth is showing increasing potential as a cancer treatment modality. A method of applying these low intensity electric fields using multiple implanted electrodes within or adjacent to tumor volumes has been termed as intratumoral modulation therapy (IMT). PURPOSE This study explores advancements in the previously established IMT optimization algorithm, and the development of a custom treatment planning system for patient specific IMT. The practicality of the treatment planning system is demonstrated by implementing the full optimization pipeline on a brain phantom with robotic electrode implantation, post-operative imaging, and treatment stimulation. METHODS The integrated planning pipeline in 3D Slicer begins with importing and segmenting patient magnetic resonance images (MRI) or computed tomography (CT) images. The segmentation process is manual, followed by a semi-automatic smoothing step that allows the segmented brain and tumor mesh volumes to be smoothed and simplified by applying selected filters. Electrode trajectories are planned manually on the patient MRI or CT by selecting insertion and tip coordinates for a chosen number of electrodes. The electrode tip positions, and stimulation parameters (phase shift and voltage) can then be optimized with the custom semi-automatic IMT optimization algorithm where users can select the prescription electric field, voltage amplitude limit, tissue electrical properties, nearby organs at risk, optimization parameters (electrode tip location, individual contact phase shift and voltage), desired field coverage percent, and field conformity optimization. Tables of optimization results are displayed, and the resulting electric field is visualized as a field-map superimposed on the MR or CT image, with 3D renderings of the brain, tumor, and electrodes. Optimized electrode coordinates are transferred to robotic electrode implantation software to enable planning and subsequent implantation of the electrodes at the desired trajectories. RESULTS An IMT treatment planning system was developed that incorporates patient specific MRI or CT, segmentation, volume smoothing, electrode trajectory planning, electrode tip location and stimulation parameter optimization, and results visualization. All previous manual pipeline steps operating on diverse software platforms were coalesced into a single semi-automated 3D Slicer based user interface. Brain phantom validation of the full system implementation was successful in pre-operative planning, robotic electrode implantation, and post-operative treatment planning to adjust stimulation parameters based on actual implant locations. Voltage measurements were obtained in the brain phantom to determine the electrical parameters of the phantom and validate the simulated electric field distribution. CONCLUSIONS A custom treatment planning and implantation system for IMT has been developed in this study, and validated on a phantom brain model, providing an essential step in advancing IMT technology towards future clinical safety and efficacy investigations. This article is protected by copyright. All rights reserved.
Collapse
|
7
|
Towards a First-Person Perspective Mixed Reality Guidance System for Needle Interventions. J Imaging 2022; 8:jimaging8010007. [PMID: 35049848 PMCID: PMC8778355 DOI: 10.3390/jimaging8010007] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/05/2021] [Revised: 12/20/2021] [Accepted: 12/24/2021] [Indexed: 12/23/2022] Open
Abstract
While ultrasound (US) guidance has been used during central venous catheterization to reduce complications, including the puncturing of arteries, the rate of such problems remains non-negligible. To further reduce complication rates, mixed-reality systems have been proposed as part of the user interface for such procedures. We demonstrate the use of a surgical navigation system that renders a calibrated US image, and the needle and its trajectory, in a common frame of reference. We compare the effectiveness of this system, whereby images are rendered on a planar monitor and within a head-mounted display (HMD), to the standard-of-care US-only approach, via a phantom-based user study that recruited 31 expert clinicians and 20 medical students. These users performed needle-insertions into a phantom under the three modes of visualization. The success rates were significantly improved under HMD-guidance as compared to US-guidance, for both expert clinicians (94% vs. 70%) and medical students (70% vs. 25%). Users more consistently positioned their needle closer to the center of the vessel’s lumen under HMD-guidance compared to US-guidance. The performance of the clinicians when interacting with this monitor system was comparable to using US-only guidance, with no significant difference being observed across any metrics. The results suggest that the use of an HMD to align the clinician’s visual and motor fields promotes successful needle guidance, highlighting the importance of continued HMD-guidance research.
Collapse
|
8
|
Application of the anatomical fiducials framework to a clinical dataset of patients with Parkinson's disease. Brain Struct Funct 2022; 227:393-405. [PMID: 34687354 PMCID: PMC8741686 DOI: 10.1007/s00429-021-02408-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/18/2021] [Accepted: 10/04/2021] [Indexed: 11/24/2022]
Abstract
Establishing spatial correspondence between subject and template images is necessary in neuroimaging research and clinical applications such as brain mapping and stereotactic neurosurgery. Our anatomical fiducial (AFID) framework has recently been validated to serve as a quantitative measure of image registration based on salient anatomical features. In this study, we sought to apply the AFIDs protocol to the clinic, focusing on structural magnetic resonance images obtained from patients with Parkinson's disease (PD). We confirmed AFIDs could be placed to millimetric accuracy in the PD dataset with results comparable to those in normal control subjects. We evaluated subject-to-template registration using this framework by aligning the clinical scans to standard template space using a robust open preprocessing workflow. We found that registration errors measured using AFIDs were higher than previously reported, suggesting the need for optimization of image processing pipelines for clinical grade datasets. Finally, we examined the utility of using point-to-point distances between AFIDs as a morphometric biomarker of PD, finding evidence of reduced distances between AFIDs that circumscribe regions known to be affected in PD including the substantia nigra. Overall, we provide evidence that AFIDs can be successfully applied in a clinical setting and utilized to provide localized and quantitative measures of registration error. AFIDs provide clinicians and researchers with a common, open framework for quality control and validation of spatial correspondence and the location of anatomical structures, facilitating aggregation of imaging datasets and comparisons between various neurological conditions.
Collapse
|
9
|
Statistical morphological analysis reveals characteristic paraspinal muscle asymmetry in unilateral lumbar disc herniation. Sci Rep 2021; 11:15576. [PMID: 34341427 PMCID: PMC8329062 DOI: 10.1038/s41598-021-95149-6] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/11/2021] [Accepted: 07/21/2021] [Indexed: 12/19/2022] Open
Abstract
Growing evidence suggests an association of lumbar paraspinal muscle morphology with low back pain (LBP) and lumbar pathologies. Unilateral spinal disorders provide unique models to study this association, with implications for diagnosis, prognosis, and management. Statistical shape analysis is a technique that can identify signature shape variations related to phenotypes but has never been employed in studying paraspinal muscle morphology. We present the first investigation using this technique to reveal disease-related paraspinal muscle asymmetry, using MRIs of patients with a single posterolateral disc herniation at the L5-S1 spinal level and unilateral leg pain. Statistical shape analysis was conducted to reveal disease- and phenotype-related morphological variations in the multifidus and erector spinae muscles at the level of herniation and the one below. With the analysis, shape variations associated with disc herniation were identified in the multifidus on the painful side at the level below the pathology while no pathology-related asymmetry in cross-sectional area (CSA) and fatty infiltration was found in either muscle. The results demonstrate higher sensitivity and spatial specificity for the technique than typical CSA and fatty infiltration measures. Statistical shape analysis holds promise in studying paraspinal muscle morphology to improve our understanding of LBP and various lumbar pathologies.
Collapse
|
10
|
Ultra-High Field 7-Tesla Magnetic Resonance Imaging and Electroencephalography Findings in Epilepsy. Can Assoc Radiol J 2021; 73:396-402. [PMID: 34328021 DOI: 10.1177/08465371211031802] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022] Open
Abstract
PURPOSE Assessment of patients for temporal lobe epilepsy (TLE) surgery requires multimodality input, including EEG recordings to ensure optimal surgical planning. Often EEG demonstrates abnormal foci not detected on 1.5T MRI. Ultra-high field MRI at 7T provides improved resolution of the brain. We investigated the utility of 7T MRI to detect potential anatomical abnormalities associated with EEG changes. METHODS Ultra-high field data were acquired on a 7T MRI scanner for 13 patients with history of drug resistant TLE who had had EEG telemetry recordings. Qualitative evaluation of 7T imaging for presence of focal abnormalities detected on EEG was performed. Correlation of 7T MRI findings with EEG recordings of focal slowing or interictal epileptic spikes (IEDs), and seizures was performed. RESULTS Assessment of 7T MRI demonstrated concordance with TLE as determined by the multidisciplinary team in 61.5% of cases (n = 8). Among these, 3 patients exhibited supportive abnormal 7T MRI abnormalities not detected by 1.5T MRI. In patients who underwent surgery, 72.7% had concordant histopathology findings with 7T MRI findings (n = 8). However, qualitative assessment of 7T images revealed focal anatomical abnormalities to account for EEG findings in only 15.4% of patients (n = 2). Other regions that were found to have localized IEDs in addition to the lesional temporal lobe, included the contralateral temporal lobe (n = 5), frontal lobe (n = 3), and parieto-occipital lobe (n = 2). CONCLUSION Ultra-high field 7T MRI findings show concordance with clinical data. However, 7T MRI did not reveal anatomical findings to account for abnormalities detected by EEG.
Collapse
|
11
|
Characterizing white matter alterations subject to clinical laterality in drug-naïve de novo Parkinson's disease. Hum Brain Mapp 2021; 42:4465-4477. [PMID: 34106502 PMCID: PMC8410564 DOI: 10.1002/hbm.25558] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/15/2021] [Revised: 05/18/2021] [Accepted: 06/01/2021] [Indexed: 01/18/2023] Open
Abstract
Parkinson's disease (PD) is a progressive neurodegenerative disorder that is characterized by a range of motor and nonmotor symptoms, often with the motor dysfunction initiated unilaterally. Knowledge regarding disease‐related alterations in white matter pathways can effectively help improve the understanding of the disease and propose targeted treatment strategies. Microstructural imaging techniques, including diffusion tensor imaging (DTI), allows inspection of white matter integrity to study the pathogenesis of various neurological conditions. Previous voxel‐based analyses with DTI measures, such as fractional anisotropy and mean diffusivity have uncovered changes in brain regions that are associated with PD, but the conclusions were inconsistent, partially due to small patient cohorts and the lack of consideration for clinical laterality onset, particularly in early PD. Fixel‐based analysis (FBA) is a recent framework that offers tract‐specific insights regarding white matter health, but very few FBA studies on PD exist. We present a study that reveals strengthened and weakened white matter integrity that is subject to symptom laterality in a large drug‐naïve de novo PD cohort using complementary DTI and FBA measures. The findings suggest that the disease gives rise to tissue degeneration and potential re‐organization in the early stage.
Collapse
|
12
|
Corrections to "Image Guidance in Deep Brain Stimulation Surgery to Treat Parkinson's Disease: A Comprehensive Review". IEEE Trans Biomed Eng 2021; 68:1748. [PMID: 33881987 DOI: 10.1109/tbme.2021.3070666] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
|
13
|
Comparison of Droplet Size, Coverage, and Drift Potential from UAV Application Methods and Ground Application Methods on Row Crops. TRANSACTIONS OF THE ASABE 2021; 64:819-828. [PMID: 37667776 PMCID: PMC10476208 DOI: 10.13031/trans.14121] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 09/06/2023]
Abstract
Worldwide, the use of uncrewed aerial vehicles (UAVs) for pesticide application has grown tremendously in the past decade. Their adoption has been slower for Midwestern row crops. This study compared droplet size, coverage, and drift potential of sprays from UAV application methods to those from ground (implement) sprayer methods on corn in the Midwest. Droplet sizes measured during UAV spray trials [geometric mean diameters of 179 and 112 μm for UAV (boom) and UAV (no boom), respectively] were substantially smaller than those deposited during implement spray trials [mean diameters of 303 and 423 μm for implement (regular) and implement (pulse)]. Droplet coverage was high and localized in the middle swath of the field for the UAV with boom (10 to 30 droplets cm-2) and with no boom (60 droplets cm-2). Droplet coverage was broader, covering the entire field width for the implement methods (10 to 40 droplets cm-2). Vertical coverage of droplets was more uniform for UAV methods than implement methods. Although the UAVs produced smaller droplets than the implement methods, we still observed greater potential for downwind pesticide drift during the implement spray trials. Because localized application may be beneficial for pest control and drift reduction, the findings indicate a strong potential for "spot" or "band" spray coverage using UAV methods. This is likely due to the smaller size, reduced spray volumes, and increased agility of UAVs as compared to more conventional methods.
Collapse
|
14
|
Optimization of multi-electrode implant configurations and programming for the delivery of non-ablative electric fields in intratumoral modulation therapy. Med Phys 2020; 47:5441-5454. [PMID: 32978963 DOI: 10.1002/mp.14496] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/12/2020] [Revised: 09/10/2020] [Accepted: 09/12/2020] [Indexed: 12/22/2022] Open
Abstract
PURPOSE Application of low intensity electric fields to interfere with tumor growth is being increasingly recognized as a promising new cancer treatment modality. Intratumoral modulation therapy (IMT) is a developing technology that uses multiple electrodes implanted within or adjacent tumor regions to deliver electric fields to treat cancer. In this study, the determination of optimal IMT parameters was cast as a mathematical optimization problem, and electrode configurations, programming, optimization, and maximum treatable tumor size were evaluated in the simplest and easiest to understand spherical tumor model. The establishment of electrode placement and programming rules to maximize electric field tumor coverage designed specifically for IMT is the first step in developing an effective IMT treatment planning system. METHODS Finite element method electric field computer simulations for tumor models with 2 to 7 implanted electrodes were performed to quantify the electric field over time with various parameters, including number of electrodes (2 to 7), number of contacts per electrode (1 to 3), location within tumor volume, and input waveform with relative phase shift between 0 and 2π radians. Homogeneous tissue specific conductivity and dielectric values were assigned to the spherical tumor and surrounding tissue volume. In order to achieve the goal of covering the tumor volume with a uniform threshold of 1 V/cm electric field, a custom least square objective function was used to maximize the tumor volume covered by 1 V/cm time averaged field, while maximizing the electric field in voxels receiving less than this threshold. An additional term in the objective function was investigated with a weighted tissue sparing term, to minimize the field to surrounding tissues. The positions of the electrodes were also optimized to maximize target coverage with the fewest number of electrodes. The complexity of this optimization problem including its non-convexity, the presence of many local minima, and the computational load associated with these stochastic based optimizations led to the use of a custom pattern search algorithm. Optimization parameters were bounded between 0 and 2π radians for phase shift, and anywhere within the tumor volume for location. The robustness of the pattern search method was then evaluated with 50 random initial parameter values. RESULTS The optimization algorithm was successfully implemented, and for 2 to 4 electrodes, equally spaced relative phase shifts and electrodes placed equidistant from each other was optimal. For 5 electrodes, up to 2.5 cm diameter tumors with 2.0 V, and 4.1 cm with 4.0 V could be treated with the optimal configuration of a centrally placed electrode and 4 surrounding electrodes. The use of 7 electrodes allow for 3.4 cm diameter coverage at 2.0 V and 5.5 cm at 4.0 V. The evaluation of the optimization method using 50 random initial parameter values found the method to be robust in finding the optimal solution. CONCLUSIONS This study has established a robust optimization method for temporally optimizing electric field tumor coverage for IMT, with the adaptability to optimize a variety of parameters including geometrical and relative phase shift configurations.
Collapse
|
15
|
Automatic segmentation of the carotid artery and internal jugular vein from 2D ultrasound images for 3D vascular reconstruction. Int J Comput Assist Radiol Surg 2020; 15:1835-1846. [DOI: 10.1007/s11548-020-02248-2] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/18/2019] [Accepted: 08/14/2020] [Indexed: 02/02/2023]
|
16
|
Image Guidance in Deep Brain Stimulation Surgery to Treat Parkinson's Disease: A Comprehensive Review. IEEE Trans Biomed Eng 2020; 68:1024-1033. [PMID: 32746050 DOI: 10.1109/tbme.2020.3006765] [Citation(s) in RCA: 16] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
Deep brain stimulation (DBS) is an effective therapy as an alternative to pharmaceutical treatments for Parkinson's disease (PD). Aside from factors such as instrumentation, treatment plans, and surgical protocols, the success of the procedure depends heavily on the accurate placement of the electrode within the optimal therapeutic targets while avoiding vital structures that can cause surgical complications and adverse neurologic effects. Although specific surgical techniques for DBS can vary, interventional guidance with medical imaging has greatly contributed to the development, outcomes, and safety of the procedure. With rapid development in novel imaging techniques, computational methods, and surgical navigation software, as well as growing insights into the disease and mechanism of action of DBS, modern image guidance is expected to further enhance the capacity and efficacy of the procedure in treating PD. This article surveys the state-of-the-art techniques in image-guided DBS surgery to treat PD, and discusses their benefits and drawbacks, as well as future directions on the topic.
Collapse
|
17
|
Direct visualization and characterization of the human zona incerta and surrounding structures. Hum Brain Mapp 2020; 41:4500-4517. [PMID: 32677751 PMCID: PMC7555067 DOI: 10.1002/hbm.25137] [Citation(s) in RCA: 17] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/28/2020] [Revised: 05/31/2020] [Accepted: 07/02/2020] [Indexed: 12/11/2022] Open
Abstract
The zona incerta (ZI) is a small gray matter region of the deep brain first identified in the 19th century, yet direct in vivo visualization and characterization has remained elusive. Noninvasive detection of the ZI and surrounding region could be critical to further our understanding of this widely connected but poorly understood deep brain region and could contribute to the development and optimization of neuromodulatory therapies. We demonstrate that high resolution (submillimetric) longitudinal (T1) relaxometry measurements at high magnetic field strength (7 T) can be used to delineate the ZI from surrounding white matter structures, specifically the fasciculus cerebellothalamicus, fields of Forel (fasciculus lenticularis, fasciculus thalamicus, and field H), and medial lemniscus. Using this approach, we successfully derived in vivo estimates of the size, shape, location, and tissue characteristics of substructures in the ZI region, confirming observations only previously possible through histological evaluation that this region is not just a space between structures but contains distinct morphological entities that should be considered separately. Our findings pave the way for increasingly detailed in vivo study and provide a structural foundation for precise functional and neuromodulatory investigation.
Collapse
|
18
|
A simple, realistic walled phantom for intravascular and intracardiac applications. Int J Comput Assist Radiol Surg 2020; 15:1513-1523. [PMID: 32524216 PMCID: PMC7419379 DOI: 10.1007/s11548-020-02201-3] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/13/2020] [Accepted: 05/18/2020] [Indexed: 11/29/2022]
Abstract
PURPOSE This work aims to develop a simple, anatomically and haptically realistic vascular phantom, compatible with intravascular and intracardiac ultrasound. The low-cost, dual-layered phantom bridges the gap between traditional wall-only and wall-less phantoms by showing both the vessel wall and surrounding tissue in ultrasound imaging. This phantom can better assist clinical tool training, testing of intravascular devices, blood flow studies, and validation of algorithms for intravascular and intracardiac surgical systems. METHODS Polyvinyl alcohol cryogel (PVA-c) incorporating a scattering agent was used to obtain vessel and tissue-mimicking materials. Our specific design targeted the inferior vena cava and renal bifurcations which were modelled using CAD software. A custom mould and container were 3D-printed for shaping the desired vessel wall. Three phantoms were prepared by varying both the concentrations of scattering agent as well as the number of freeze-thaw cycles to which the phantom layers were subjected during the manufacturing process. Each phantom was evaluated using ultrasound imaging using the Foresight™ ICE probe. Geometrical validation was provided by comparing CAD design to a CT scan of the phantom. RESULTS The desired vascular phantom was constructed using 2.5% and 0.05% scattering agent concentration in the vessel and tissue-mimicking layers, respectively. Imaging of the three phantoms showed that increasing the number of freeze-thaw cycles did not significantly enhance the image contrast. Comparison of the US images with their CT equivalents resulted in an average error of 0.9[Formula: see text] for the lumen diameter. CONCLUSION The phantom is anatomically realistic when imaged with intracardiac ultrasound and provides a smooth lumen for the ultrasound probe and catheter to manoeuvre. The vascular phantom enables validation of intravascular and intracardiac image guidance systems. The simple construction technique also provides a workflow for designing complex, multi-layered arterial phantoms.
Collapse
|
19
|
Augmented reality simulator for ultrasound-guided percutaneous renal access. Int J Comput Assist Radiol Surg 2020; 15:749-757. [DOI: 10.1007/s11548-020-02142-x] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/14/2019] [Accepted: 03/26/2020] [Indexed: 12/27/2022]
|
20
|
Deep learning approach for automatic out-of-plane needle localisation for semi-automatic ultrasound probe calibration. Healthc Technol Lett 2019; 6:204-209. [PMID: 32038858 PMCID: PMC6952243 DOI: 10.1049/htl.2019.0075] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/17/2019] [Accepted: 10/02/2019] [Indexed: 12/25/2022] Open
Abstract
The authors present a deep learning algorithm for the automatic centroid localisation of out-of-plane US needle reflections to produce a semi-automatic ultrasound (US) probe calibration algorithm. A convolutional neural network was trained on a dataset of 3825 images at a 6 cm imaging depth to predict the position of the centroid of a needle reflection. Applying the automatic centroid localisation algorithm to a test set of 614 annotated images produced a root mean squared error of 0.62 and 0.74 mm (6.08 and 7.62 pixels) in the axial and lateral directions, respectively. The mean absolute errors associated with the test set were 0.50 ± 0.40 mm and 0.51 ± 0.54 mm (4.9 ± 3.96 pixels and 5.24 ± 5.52 pixels) for the axial and lateral directions, respectively. The trained model was able to produce visually validated US probe calibrations at imaging depths on the range of 4–8 cm, despite being solely trained at 6 cm. This work has automated the pixel localisation required for the guided-US calibration algorithm producing a semi-automatic implementation available open-source through 3D Slicer. The automatic needle centroid localisation improves the usability of the algorithm and has the potential to decrease the fiducial localisation and target registration errors associated with the guided-US calibration method.
Collapse
|
21
|
Endoscopic Vision Augmentation Using Multiscale Bilateral-Weighted Retinex for Robotic Surgery. IEEE TRANSACTIONS ON MEDICAL IMAGING 2019; 38:2863-2874. [PMID: 31094684 DOI: 10.1109/tmi.2019.2916101] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/09/2023]
Abstract
Endoscopic vision plays a significant role in minimally invasive surgical procedures. The visibility and maintenance of such direct in situ vision is paramount not only for safety by preventing inadvertent injury but also to improve precision and reduce operating time. Unfortunately, the endoscopic vision is unavoidably degraded due to the illumination variations during surgery. This paper aims to restore or augment such degraded visualization and quantitatively evaluate it during robotic surgery. A multiscale bilateral-weighted retinex method is proposed to remove non-uniform and highly directional illumination and enhance surgical vision, while an objective no-reference image visibility assessment method is defined in terms of sharpness, naturalness, and contrast, to quantitatively and objectively evaluate the endoscopic visualization on surgical video sequences. The methods were validated on surgical data, with the experimental results showing that our method outperforms existent retinex approaches. In particular, the combined visibility was improved from 0.81 to 1.06, while three surgeons generally agreed that the results were restored with much better visibility.
Collapse
|
22
|
A framework for evaluating correspondence between brain images using anatomical fiducials. Hum Brain Mapp 2019; 40:4163-4179. [PMID: 31175816 DOI: 10.1002/hbm.24693] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/05/2018] [Revised: 05/24/2019] [Accepted: 05/29/2019] [Indexed: 12/26/2022] Open
Abstract
Accurate spatial correspondence between template and subject images is a crucial step in neuroimaging studies and clinical applications like stereotactic neurosurgery. In the absence of a robust quantitative approach, we sought to propose and validate a set of point landmarks, anatomical fiducials (AFIDs), that could be quickly, accurately, and reliably placed on magnetic resonance images of the human brain. Using several publicly available brain templates and individual participant datasets, novice users could be trained to place a set of 32 AFIDs with millimetric accuracy. Furthermore, the utility of the AFIDs protocol is demonstrated for evaluating subject-to-template and template-to-template registration. Specifically, we found that commonly used voxel overlap metrics were relatively insensitive to focal misregistrations compared to AFID point-based measures. Our entire protocol and study framework leverages open resources and tools, and has been developed with full transparency in mind so that others may freely use, adopt, and modify. This protocol holds value for a broad number of applications including alignment of brain images and teaching neuroanatomy.
Collapse
|
23
|
Cover Image. Hum Brain Mapp 2019. [DOI: 10.1002/hbm.24293] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022] Open
|
24
|
Development and Evaluation of an Augmented Reality Ultrasound Guidance System for Spinal Anesthesia: Preliminary Results. ULTRASOUND IN MEDICINE & BIOLOGY 2019; 45:2736-2746. [PMID: 31281009 DOI: 10.1016/j.ultrasmedbio.2019.04.026] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/01/2019] [Revised: 04/23/2019] [Accepted: 04/30/2019] [Indexed: 06/09/2023]
Abstract
Applications of ultrasound guidance for epidural injections are hindered by poor needle and epidural space visualization. This work presents an augmented reality (AR) ultrasound guidance system that addresses challenges in both needle visualization during navigation and epidural space identification for needle positioning. In this system, (i) B-mode ultrasound and the needle are visualized in a 3-D AR environment for improved navigation, and (ii) A-mode ultrasound, obtained from a custom-made single-element transducer housed at the needle tip, is used to identify the epidural space for improved needle positioning. Performance of the system was evaluated against ultrasound-only guidance in a phantom study with novice operators and an expert anesthesiologist. The procedure success rate was higher with the AR system (100%) than ultrasound-only guidance (57%). The AR system has the potential to improve procedure outcomes in terms of success rate, time, needle path-length and usability.
Collapse
|
25
|
The Effects of Positioning on the Volume/Location of the Internal Jugular Vein Using 2-Dimensional Tracked Ultrasound. J Cardiothorac Vasc Anesth 2019; 34:920-925. [PMID: 31563461 DOI: 10.1053/j.jvca.2019.08.049] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/08/2019] [Revised: 08/27/2019] [Accepted: 08/29/2019] [Indexed: 02/05/2023]
Abstract
OBJECTIVE To investigate the effects of different positioning on the volume/location of the internal jugular vein (IJV) using 2-dimensional (2D) tracked ultrasound. DESIGN This was a prospective, observational study. SETTING Local research institute. PARTICIPANTS Healthy volunteers. INTERVENTIONS Twenty healthy volunteers were scanned in the following 6 positions: (1) supine with head neutral, rotated 15 and 30 degrees to the left and (2) 5-, 10-, and 15-degree Trendelenburg position with head neutral. In each position the volunteer's neck was scanned using a 2D ultrasound probe tracked with a magnetic tracker. These spatially tracked 2D images were collected and reconstructed into a 3D volume of the IJV and carotid artery. This 3D ultrasound volume then was segmented to obtain a 3D surface on which measurements and calculations were performed. MEASUREMENTS AND MAIN RESULTS The measurements included average cross-section area (CSA), CSA along the length of IJV, and average overlap rate. CSA (mm2) in the supine and 5-, 10-, and 15-degree Trendelenburg positions were as follows: 86.7 ± 44.8, 104.3 ± 54.5, 119.1 ± 58.6, and 133.7 ± 53.3 (p < 0.0001). CSA enlarged with the increase of Trendelenburg degree. Neither Trendelenburg position nor head rotation showed a correlation with overlap rate. CONCLUSIONS Trendelenburg position significantly increased the CSA of the IJV, thus facilitating IJV cannulation. This new 3D reconstruction method permits the creation of a 3D volume through a tracked 2D ultrasound scanning system with image acquisition and integration and may prove useful in providing the user with a "road map" of the vascular anatomy of a patient's neck or other anatomic structures.
Collapse
|
26
|
Dynamic, patient-specific mitral valve modelling for planning transcatheter repairs. Int J Comput Assist Radiol Surg 2019; 14:1227-1235. [PMID: 31115756 DOI: 10.1007/s11548-019-01998-y] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/12/2019] [Accepted: 05/14/2019] [Indexed: 01/14/2023]
Abstract
PURPOSE Transcatheter, beating heart repair techniques for mitral valve regurgitation is a very active area of development. However, it is difficult to both simulate and predict the clinical outcomes of mitral repairs, owing to the complexity of mitral valve geometry and the influence of hemodynamics. We aim to produce a workflow for manufacturing dynamic patient-specific models to simulate the mitral valve for transcatheter repair applications. METHODS In this paper, we present technology and associated workflow, for using transesophageal echocardiography to generate dynamic physical replicas of patient valves. We validate our workflow using six patient datasets representing patients with unique or particularly challenging pathologies as selected by a cardiologist. The dynamic component of the models and their resultant potential as procedure planning tools is due to a dynamic pulse duplicator that permits the evaluation of the valve models experiencing realistic hemodynamics. RESULTS Early results indicate the workflow has excellent anatomical accuracy and the ability to replicate regurgitation pathologies, as shown by colour Doppler ultrasound and anatomical measurements comparing patients and models. Analysis of all measurements successfully resulted in t critical two-tail > t stat and p values > 0.05, thus demonstrating no statistical difference between the patients and models, owing to high fidelity morphological replication. CONCLUSIONS Due to the combination of a dynamic environment and patient-specific modelling, this workflow demonstrates a promising technology for simulating the complete morphology of mitral valves undergoing transcatheter repairs.
Collapse
|
27
|
Robust, Intrinsic Tracking of a Laparoscopic Ultrasound Probe for Ultrasound-Augmented Laparoscopy. IEEE TRANSACTIONS ON MEDICAL IMAGING 2019; 38:460-469. [PMID: 30130182 DOI: 10.1109/tmi.2018.2866183] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/08/2023]
Abstract
In situ visualization of laparoscopic ultrasound in both conventional and robot-assisted laparoscopic surgery requires robust and efficient computation of the pose of the laparoscopic ultrasound probe with respect to the laparoscopic camera. Image-based intrinsic methods of computing this relative pose need to overcome challenges due to irregular illumination, partial feature occlusion, and clutter that are unavoidable in practical laparoscopic surgery. In this paper, we propose an accurate image-based method that is robust to partial occlusion of the fiducials and outliers. The method is extended to multi-view imaging model with applications in stereoscopic laparoscopy and robot-assisted surgery. Rather than treating the model-to-image correspondence and pose computation as separate problems, we solve them jointly using the Kalman Filter-based framework that demonstrates video rate running time (~24fps). By keeping the optical tracking measurements as a reference, we demonstrate that the proposed methods result in clinically acceptable tracking accuracy, reaching target registration errors well below 1.5mm on average. In addition, our multi-view tracking method is compared to a conventional stereo triangulation-based pose estimation scheme that commercial optical tracking systems are based on, to experimentally demonstrate its superiority in terms of accuracy. Finally, we qualitatively demonstrate the suitability of our methods for practical laparoscopic applications by conducting a phantom-based experiment.
Collapse
|
28
|
Erratum to 'Quantitative Analysis of Needle Navigation under Ultrasound Guidance in a Simulated Central Venous Line Procedure'[Ultrasound Med Biol 44 (2018) 1891-1900]. ULTRASOUND IN MEDICINE & BIOLOGY 2019; 45:264. [PMID: 30336965 DOI: 10.1016/j.ultrasmedbio.2018.10.001] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/08/2023]
|
29
|
Interactive-Automatic Segmentation and Modelling of the Mitral Valve. FUNCTIONAL IMAGING AND MODELING OF THE HEART 2019. [DOI: 10.1007/978-3-030-21949-9_43] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/28/2023]
|
30
|
Quantitative Analysis of Needle Navigation under Ultrasound Guidance in a Simulated Central Venous Line Procedure. ULTRASOUND IN MEDICINE & BIOLOGY 2018; 44:1891-1900. [PMID: 29858126 DOI: 10.1016/j.ultrasmedbio.2018.05.004] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/16/2018] [Revised: 04/20/2018] [Accepted: 05/01/2018] [Indexed: 06/08/2023]
Abstract
Complications in ultrasound-guided central line insertions are associated with the expertise level of the operator. However, a lack of standards for teaching, training and evaluation of ultrasound guidance results in various levels of competency during training. To address such shortcomings, there has been a paradigm shift in medical education toward competency-based training, promoting the use of simulators and quantitative skills assessment. It is therefore necessary to develop reliable quantitative metrics to establish standards for the attainment and maintenance of competence. This work identifies such a metric for simulated central line procedures. The distance between the needle tip and ultrasound image plane was quantified as a metric of efficacy in ultrasound guidance implementation. In a simulated procedure, performed by experienced physicians, this distance was significantly greater in unsuccessful procedures (p = 0.04). The use of this metric has the potential to enhance the teaching, training and skills assessment of ultrasound-guided central line insertions.
Collapse
|
31
|
Dual-hormone artificial pancreas: benefits and limitations compared with single-hormone systems. Diabet Med 2018; 35:450-459. [PMID: 29337384 DOI: 10.1111/dme.13581] [Citation(s) in RCA: 43] [Impact Index Per Article: 7.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Accepted: 01/10/2018] [Indexed: 12/17/2022]
Abstract
Technological advances have made the artificial pancreas a reality. This has the potential to improve the lives of individuals with Type 1 diabetes by reducing the risk of hypoglycaemia, achieving better overall glucose control, and enhancing quality of life. Both single-hormone (insulin-only) and dual-hormone (insulin and glucagon) systems have been developed; however, a focused review of the relative benefits of each artificial pancreas system is needed. We reviewed studies that directly compared single- and dual-hormone systems to evaluate the efficacy of each system for preventing hypoglycaemia and maintaining glycaemic control, as well as their utility in specific situations including during exercise, overnight and during the prandial period. We observed additional benefits with the dual-hormone artificial pancreas for reducing the risk of hypoglycaemic events overall and during exercise over the study duration. The single-hormone artificial pancreas was sufficient for maintenance of euglycaemia in the overnight period and for preventing late-onset post-exercise hypoglycaemia. Future comparative studies of longer duration are required to determine whether one system is superior for improving mean glucose control, eliminating severe hypoglycaemia, or improving quality of life.
Collapse
|
32
|
Signal dropout correction-based ultrasound segmentation for diastolic mitral valve modeling. J Med Imaging (Bellingham) 2018; 5:021214. [PMID: 29487886 PMCID: PMC5806032 DOI: 10.1117/1.jmi.5.2.021214] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/28/2017] [Accepted: 01/04/2018] [Indexed: 11/14/2022] Open
Abstract
Three-dimensional ultrasound segmentation of mitral valve (MV) at diastole is helpful for duplicating geometry and pathology in a patient-specific dynamic phantom. The major challenge is the signal dropout at leaflet regions in transesophageal echocardiography image data. Conventional segmentation approaches suffer from missing sonographic data leading to inaccurate MV modeling at leaflet regions. This paper proposes a signal dropout correction-based ultrasound segmentation method for diastolic MV modeling. The proposed method combines signal dropout correction, image fusion, continuous max-flow segmentation, and active contour segmentation techniques. The signal dropout correction approach is developed to recover the missing segmentation information. Once the signal dropout regions of TEE image data are recovered, the MV model can be accurately duplicated. Compared with other methods in current literature, the proposed algorithm exhibits lower computational cost. The experimental results show that the proposed algorithm gives competitive results for diastolic MV modeling compared with conventional segmentation algorithms, evaluated in terms of accuracy and efficiency.
Collapse
|
33
|
Abstract
Interventional endoscopy (e.g., bronchoscopy, colonoscopy, laparoscopy, cystoscopy) is a widely performed procedure that involves either diagnosis of suspicious lesions or guidance for minimally invasive surgery in a variety of organs within the body cavity. Endoscopy may also be used to guide the introduction of certain items (e.g., stents) into the body. Endoscopic navigation systems seek to integrate big data with multimodal information (e.g., computed tomography, magnetic resonance images, endoscopic video sequences, ultrasound images, external trackers) relative to the patient's anatomy, control the movement of medical endoscopes and surgical tools, and guide the surgeon's actions during endoscopic interventions. Nevertheless, it remains challenging to realize the next generation of context-aware navigated endoscopy. This review presents a broad survey of various aspects of endoscopic navigation, particularly with respect to the development of endoscopic navigation techniques. First, we investigate big data with multimodal information involved in endoscopic navigation. Next, we focus on numerous methodologies used for endoscopic navigation. We then review different endoscopic procedures in clinical applications. Finally, we discuss novel techniques and promising directions for the development of endoscopic navigation.
Collapse
|
34
|
Cyclic Continuous Max-Flow: A Third Paradigm in Generating Local Phase Shift Maps in MRI. IEEE TRANSACTIONS ON MEDICAL IMAGING 2018; 37:568-579. [PMID: 29408785 DOI: 10.1109/tmi.2017.2766922] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/07/2023]
Abstract
Sensitivity to phase deviations in MRI forms the basis of a variety of techniques, including magnetic susceptibility weighted imaging and chemical shift imaging. Current phase processing techniques fall into two families: those which process the complex image data with magnitude and phase coupled, and phase unwrapping-based techniques that first linearize the phase topology across the image. However, issues, such as low signal and the existence of phase poles, can lead both methods to experience error. Cyclic continuous max-flow (CCMF) phase processing uses primal-dual-variational optimization over a cylindrical manifold, which represent the inherent topology of phase images, increasing its robustness to these issues. CCMF represents a third distinct paradigm in phase processing, being the only technique equipped with the inherent topology of phase. CCMF is robust and efficient with at least comparable accuracy as the prior paradigms.
Collapse
|
35
|
Dynamic Patient-Specific Three-Dimensional Simulation of Mitral Repair. INNOVATIONS-TECHNOLOGY AND TECHNIQUES IN CARDIOTHORACIC AND VASCULAR SURGERY 2018. [DOI: 10.1177/155698451801300103] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
|
36
|
Excess psychosocial burden in women with diabetes and premature acute coronary syndrome. Diabet Med 2017; 34:1568-1574. [PMID: 28799212 DOI: 10.1111/dme.13452] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Accepted: 08/08/2017] [Indexed: 11/28/2022]
Abstract
AIM Diabetes is a stronger risk factor for acute coronary syndrome for women than men. We investigate whether behavioural and psychosocial factors contribute to the disparity in acute coronary syndrome risk and outcomes among women with diabetes relative to women without diabetes and men. METHODS Among 939 participants in the GENESIS-PRAXY cohort study of premature acute coronary syndrome (age ≤ 55 years), we compared the prevalence of traditional and non-traditional factors by sex and Type 2 diabetes status. In a case-only analysis, we used generalized logit models to investigate the influence of traditional and non-traditional factors on the interaction of sex and diabetes. RESULTS In 287 women (14.3% with diabetes) and 652 men (10.4% with diabetes), women and men with diabetes showed a heavier burden of traditional cardiac risk factors compared with individuals without diabetes. Women with diabetes were more likely to be the primary earner and have more anxiety relative to women without diabetes, and reported worse perceived health compared with women without diabetes and men with diabetes. The interaction term for sex and diabetes (odds ratio (OR) 1.40, 95% confidence intervals (95% CI) 0.83-2.36) was diminished after additional adjustment for non-traditional factors (OR 1.12, 95% CI 0.54-2.32), but not traditional factors alone (OR 1.41, 95% CI 0.84-2.36). CONCLUSIONS We observed trends toward a more adverse psychosocial profile among women with diabetes and incident acute coronary syndrome compared with women without diabetes and men with diabetes, which may explain the increased risk of acute coronary syndrome in women with diabetes and may also contribute to worse outcomes.
Collapse
|
37
|
Abstract
Fogged surgical field visualization that is a common and potentially harmful problem can lead to inappropriate device use and incorrectly targeted tissue and increase surgical risks in endoscopic surgery. This paper aims to remove fog or smoke on endoscopic video sequences to augment and maintain a direct and clear visualization of the operating field. A new visibility-driven fusion defogging framework is proposed for surgical endoscopic video processing. This framework first recovers the visibility and enhances the contrast of hazy images. To address the color infidelity problem introduced by the visibility recovery, the luminances of the recovered and enhanced images are fused in the gradient domain, and the fused luminance is reconstructed by solving the Poisson equation in the frequency domain. The proposed method is evaluated on clinical videos that were collected from prostate cancer surgery. The experimental results demonstrate that the proposed framework defogs endoscopic images more robustly than currently available methods. Additionally, our method also provides an effective way to improve the visual quality of medical or high-dynamic range images.
Collapse
|
38
|
Abstract
Patients with intractable temporal lobe epilepsy (TLE) undergo surgical resection of the anterior temporal lobe. Preoperative assessment of TLE patients involves a multidisciplinary assessment and may involve the use of invasive electroencephalogram (EEG) recording for lateralization of seizure focus in ambiguous cases. Understanding the white matter fibre tracts affected in TLE may assist in preoperative lateralization and planning. We studied pre- and postoperative white matter fibre tract changes in six patients with TLE who underwent surgical resection. Our results indicate that changes in the corpus callosum are highly specific, with the ability to lateralize the epileptogenic side in 100% of our patients (six of six). Contralateral changes were found in all patients with variable involvement of white matter tracts. Postoperatively, most patients (five of six) exhibited further changes to the tracts on the ipsilateral side, with three patients showing contralateral abnormalities. We provide a detailed assessment of pre- and postoperative white matter fibre tracts in patients with TLE and confirm that abnormalities in the ipsilateral corpus callosum may aid in preoperative lateralization and obviate the need for invasive EEG monitoring.
Collapse
|
39
|
Hand-eye calibration using a target registration error model. Healthc Technol Lett 2017; 4:157-162. [PMID: 29184657 PMCID: PMC5683221 DOI: 10.1049/htl.2017.0072] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/29/2017] [Accepted: 08/01/2017] [Indexed: 11/19/2022] Open
Abstract
Surgical cameras are prevalent in modern operating theatres and are often used as a surrogate for direct vision. Visualisation techniques (e.g. image fusion) made possible by tracking the camera require accurate hand-eye calibration between the camera and the tracking system. The authors introduce the concept of 'guided hand-eye calibration', where calibration measurements are facilitated by a target registration error (TRE) model. They formulate hand-eye calibration as a registration problem between homologous point-line pairs. For each measurement, the position of a monochromatic ball-tip stylus (a point) and its projection onto the image (a line) is recorded, and the TRE of the resulting calibration is predicted using a TRE model. The TRE model is then used to guide the placement of the calibration tool, so that the subsequent measurement minimises the predicted TRE. Assessing TRE after each measurement produces accurate calibration using a minimal number of measurements. As a proof of principle, they evaluated guided calibration using a webcam and an endoscopic camera. Their endoscopic camera results suggest that millimetre TRE is achievable when at least 15 measurements are acquired with the tracker sensor ∼80 cm away on the laparoscope handle for a target ∼20 cm away from the camera.
Collapse
|
40
|
Mixed reality ultrasound guidance system: a case study in system development and a cautionary tale. Int J Comput Assist Radiol Surg 2017; 13:495-505. [DOI: 10.1007/s11548-017-1665-7] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/20/2017] [Accepted: 08/22/2017] [Indexed: 11/24/2022]
|
41
|
Hand-eye calibration for surgical cameras: a Procrustean Perspective-n-Point solution. Int J Comput Assist Radiol Surg 2017; 12:1141-1149. [PMID: 28425030 DOI: 10.1007/s11548-017-1590-9] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/30/2017] [Accepted: 04/10/2017] [Indexed: 11/30/2022]
Abstract
PURPOSE Surgical cameras are prevalent in modern operating theatres often used as surrogates for direct vision. A surgical navigational system is a useful adjunct, but requires an accurate "hand-eye" calibration to determine the geometrical relationship between the surgical camera and tracking markers. METHODS Using a tracked ball-tip stylus, we formulated hand-eye calibration as a Perspective-n-Point problem, which can be solved efficiently and accurately using as few as 15 measurements. RESULTS The proposed hand-eye calibration algorithm was applied to three types of camera and validated against five other widely used methods. Using projection error as the accuracy metric, our proposed algorithm compared favourably with existing methods. CONCLUSION We present a fully automated hand-eye calibration technique, based on Procrustean point-to-line registration, which provides superior results for calibrating surgical cameras when compared to existing methods.
Collapse
|
42
|
Ultra-High Field Template-Assisted Target Selection for Deep Brain Stimulation Surgery. World Neurosurg 2017; 103:531-537. [PMID: 28427973 DOI: 10.1016/j.wneu.2017.04.043] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/03/2017] [Revised: 04/03/2017] [Accepted: 04/06/2017] [Indexed: 11/29/2022]
Abstract
BACKGROUND Template and atlas guidance are fundamental aspects of stereotactic neurosurgery. The recent availability of ultra-high field (7 Tesla) magnetic resonance imaging has enabled in vivo visualization at the submillimeter scale. In this Doing More with Less article, we describe our experiences with integrating ultra-high field template data into the clinical workflow to assist with target selection in deep brain stimulation (DBS) surgical planning. METHODS The creation of a high-resolution 7T template is described, generated from group data acquired at our center. A computational workflow was developed for spatially aligning the 7T template with standard clinical data and furthermore, integrating the derived imaging volumes into the surgical planning workstation. RESULTS We demonstrate that our methodology can be effective for assisting with target selection in 2 cases: unilateral internal pallidum DBS for painful dystonia and bilateral subthalamic nucleus DBS for Parkinson's disease. CONCLUSIONS In this article, we have described a workflow for the integration of high-resolution in vivo ultra-high field templates into the surgical navigation system as a means to assist with DBS planning. The method does not require any additional cost or time to the patient. Future work will include prospectively evaluating different templates and their impact on target selection.
Collapse
|
43
|
Contact-less stylus for surgical navigation: registration without digitization. Int J Comput Assist Radiol Surg 2017; 12:1231-1241. [PMID: 28386757 DOI: 10.1007/s11548-017-1576-7] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/30/2017] [Accepted: 03/21/2017] [Indexed: 11/28/2022]
Abstract
PURPOSE We present a laser-based, contact-less, stylus for the purpose of fiducial registration and digitization in the context of surgical navigation. METHODS We augmented a laser pointer with a spatial measurement device and used the laser beam as a means to locate a fiducial in 3D space. We developed a method for calibrating the orientation of the laser beam with respect to its attached tracking target. Digitization of a fiducial was formulated as a line intersection problem, and registration was formulated as a point-to-line registration problem. RESULTS We achieved an RMS fiducial localization error of 0.63 mm for 151 measurements of 12 fiducial markers. Mean TRE values of less than 1.5 mm over the entire surface of a lumbar vertebra were achievable using 4 fiducial markers. We found that contact-based rigid registration performed carefully under near-ideal conditions outperforms contact-less registration in terms of TRE. CONCLUSION An inexpensive contact-less stylus can be used to obtain accurate fiducial registration, which can be performed without explicit fiducial digitization.
Collapse
|
44
|
Effects of line fiducial parameters and beamforming on ultrasound calibration. J Med Imaging (Bellingham) 2017; 4:015002. [PMID: 28331886 DOI: 10.1117/1.jmi.4.1.015002] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/05/2016] [Accepted: 02/08/2017] [Indexed: 11/14/2022] Open
Abstract
Ultrasound (US)-guided interventions are often enhanced via integration with an augmented reality environment, a necessary component of which is US calibration. Calibration requires the segmentation of fiducials, i.e., a phantom, in US images. Fiducial localization error (FLE) can decrease US calibration accuracy, which fundamentally affects the total accuracy of the interventional guidance system. Here, we investigate the effects of US image reconstruction techniques as well as phantom material and geometry on US calibration. It was shown that the FLE was reduced by 29% with synthetic transmit aperture imaging compared with conventional B-mode imaging in a Z-bar calibration, resulting in a 10% reduction of calibration error. In addition, an evaluation of a variety of calibration phantoms with different geometrical and material properties was performed. The phantoms included braided wire, plastic straws, and polyvinyl alcohol cryogel tubes with different diameters. It was shown that these properties have a significant effect on calibration error, which is a variable based on US beamforming techniques. These results would have important implications for calibration procedures and their feasibility in the context of image-guided procedures.
Collapse
|
45
|
Directed Acyclic Graph Continuous Max-Flow Image Segmentation for Unconstrained Label Orderings. Int J Comput Vis 2017. [DOI: 10.1007/s11263-017-0994-x] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022]
|
46
|
Augmented Reality System for Ultrasound Guidance of Transcatheter Aortic Valve Implantation. INNOVATIONS-TECHNOLOGY AND TECHNIQUES IN CARDIOTHORACIC AND VASCULAR SURGERY 2017; 11:31-9; discussion 39. [PMID: 26938173 DOI: 10.1097/imi.0000000000000235] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/25/2022]
Abstract
OBJECTIVE Transcatheter aortic valve implantation (TAVI) relies on fluoroscopy and nephrotoxic contrast medium for valve deployment. We propose an alternative guidance system using augmented reality (AR) and transesophageal echocardiography (TEE) to guide TAVI deployment. The goals of this study were to determine how consistently the aortic valve annulus is defined from TEE using different aortic valve landmarks and to compare AR guidance with fluoroscopic guidance of TAVI deployment in an aortic root model. METHODS Magnetic tracking sensors were integrated into the TAVI catheter and TEE probe, allowing these tools to be displayed in an AR environment. Variability in identifying aortic valve commissures and cuspal nadirs was assessed using TEE aortic root images. To compare AR guidance of TAVI deployment with fluoroscopic guidance, a TAVI stent was deployed 10 times in the aortic root model using each of the two guidance systems. RESULTS Commissures and nadirs were both investigated as features for defining the valve annulus in the AR guidance system. The commissures were identified more consistently than the nadirs, with intraobserver variability of 2.2 and 3.8 mm, respectively, and interobserver variability of 3.3 and 4.7 mm, respectively. The precision of TAVI deployment using fluoroscopic guidance was 3.4 mm, whereas the precision of AR guidance was 2.9 mm, and its overall accuracy was 3.4 mm. This indicates that both have similar performance. CONCLUSIONS Aortic valve commissures can be identified more reliably than cuspal nadirs from TEE. The AR guidance system achieved similar deployment accuracy to that of fluoroscopy while eliminating the use and consequences of nephrotoxic contrast and radiation.
Collapse
|
47
|
Quantification of local geometric distortion in structural magnetic resonance images: Application to ultra-high fields. Neuroimage 2017; 168:141-151. [PMID: 28069539 DOI: 10.1016/j.neuroimage.2016.12.066] [Citation(s) in RCA: 12] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/29/2016] [Revised: 12/20/2016] [Accepted: 12/22/2016] [Indexed: 12/13/2022] Open
Abstract
Ultra-high field magnetic resonance imaging (MRI) provides superior visualization of brain structures compared to lower fields, but images may be prone to severe geometric inhomogeneity. We propose to quantify local geometric distortion at ultra-high fields in in vivo datasets of human subjects scanned at both ultra-high field and lower fields. By using the displacement field derived from nonlinear image registration between images of the same subject, focal areas of spatial uncertainty are quantified. Through group and subject-specific analysis, we were able to identify regions systematically affected by geometric distortion at air-tissue interfaces prone to magnetic susceptibility, where the gradient coil non-linearity occurs in the occipital and suboccipital regions, as well as with distance from image isocenter. The derived displacement maps, quantified in millimeters, can be used to prospectively evaluate subject-specific local spatial uncertainty that should be taken into account in neuroimaging studies, and also for clinical applications like stereotactic neurosurgery where accuracy is critical. Validation with manual fiducial displacement demonstrated excellent correlation and agreement. Our results point to the need for site-specific calibration of geometric inhomogeneity. Our methodology provides a framework to permit prospective evaluation of the effect of MRI sequences, distortion correction techniques, and scanner hardware/software upgrades on geometric distortion.
Collapse
|
48
|
Shape complexes: the intersection of label orderings and star convexity constraints in continuous max-flow medical image segmentation. J Med Imaging (Bellingham) 2016; 3:044005. [PMID: 28018937 DOI: 10.1117/1.jmi.3.4.044005] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/02/2016] [Accepted: 11/28/2016] [Indexed: 11/14/2022] Open
Abstract
Optimization-based segmentation approaches deriving from discrete graph-cuts and continuous max-flow have become increasingly nuanced, allowing for topological and geometric constraints on the resulting segmentation while retaining global optimality. However, these two considerations, topological and geometric, have yet to be combined in a unified manner. The concept of "shape complexes," which combine geodesic star convexity with extendable continuous max-flow solvers, is presented. These shape complexes allow more complicated shapes to be created through the use of multiple labels and super-labels, with geodesic star convexity governed by a topological ordering. These problems can be optimized using extendable continuous max-flow solvers. Previous approaches required computationally expensive coordinate system warping, which are ill-defined and ambiguous in the general case. These shape complexes are demonstrated in a set of synthetic images as well as vessel segmentation in ultrasound, valve segmentation in ultrasound, and atrial wall segmentation from contrast-enhanced CT. Shape complexes represent an extendable tool alongside other continuous max-flow methods that may be suitable for a wide range of medical image segmentation problems.
Collapse
|
49
|
Electrostatic dust collectors compared to inhalable samplers for measuring endotoxin concentrations in farm homes. INDOOR AIR 2016; 26:724-33. [PMID: 26296624 PMCID: PMC4850132 DOI: 10.1111/ina.12243] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/15/2015] [Accepted: 08/17/2015] [Indexed: 05/02/2023]
Abstract
Paired electrostatic dust collectors (EDCs) and daily, inhalable button samplers (BS) were used concurrently to sample endotoxin in 10 farm homes during 7-day periods in summer and winter. Winter sampling included an optical particle counter (OPC) to measure PM2.5 and PM2.5-10 . Electrostatic dust collectors and BS filters were analyzed for endotoxin using the kinetic chromogenic Limulus amebocyte lysate assay. Optical particle counter particulate matter (PM) data were divided into two PM categories. In summer, geometric mean (geometric standard deviation) endotoxin concentrations were 0.82 EU/m(3) (2.7) measured with the BS and 737 EU/m(2) (1.9) measured with the EDC. Winter values were 0.52 EU/m(3) (3.1) for BS and 538 EU/m(2) (3.0) for EDCs. Seven-day endotoxin values of EDCs were highly correlated with the 7-day BS sampling averages (r = 0.70; P < 0.001). Analysis of variance indicated a 2.4-fold increase in EDC endotoxin concentrations for each unit increase of the ratio of PM2.5 to PM2.5-10 . There was also a significant correlation between BS and EDCs endotoxin concentrations for winter (r = 0.67; P < 0.05) and summer (r = 0.75; P < 0.05). Thus, EDCs sample comparable endotoxin concentrations to BS, making EDCs a feasible, easy to use alternative to BS for endotoxin sampling.
Collapse
|
50
|
Investigation of hippocampal substructures in focal temporal lobe epilepsy with and without hippocampal sclerosis at 7T. J Magn Reson Imaging 2016; 45:1359-1370. [PMID: 27564217 DOI: 10.1002/jmri.25447] [Citation(s) in RCA: 31] [Impact Index Per Article: 3.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/15/2016] [Accepted: 08/11/2016] [Indexed: 11/10/2022] Open
Abstract
PURPOSE To provide a more detailed investigation of hippocampal subfields using 7T magnetic resonance imaging (MRI) for the identification of hippocampal sclerosis in temporal lobe epilepsy (TLE). MATERIALS AND METHODS Patients (n = 13) with drug-resistant TLE previously identified by conventional imaging as having hippocampal sclerosis (HS) or not (nine without HS, four HS) and 20 age-matched healthy controls were scanned and compared using a 7T MRI protocol. Using a manual segmentation scheme to delineate hippocampal subfields, subfield-specific volume changes and apparent transverse relaxation rate ( R2*) were studied between the two groups. In addition, qualitative assessment at 7T and clinical outcomes were correlated with measured subfield changes. RESULTS Volumetry of the hippocampus at 7T in HS patients revealed significant ipsilateral subfield atrophy in CA1 (P = 0.001) and CA4+DG (P < 0.001). Volumetry also uncovered subfield atrophy in 33% of patients without HS, which had not been detected using conventional imaging. R2* was significantly lower in the CA4+DG subfields (P = 0.001) and the whole hippocampus (P = 0.029) of HS patients compared to controls but not significantly lower than the group without HS (P = 0.077, P = 0.109). No correlation was found between quantitative volumetry and qualitative assessment as well as surgical outcomes (Sub, P = 0.495, P = 0.567, P = 0.528; CA1, P = 0.104 ± 0.171, P = 0.273, P = 0.554; CA2+CA3, P = 0.517, P = 0.952, P = 0.130 ± 0.256; CA4+DG, P = 0.052 ± 0.173, P = 0.212, P = 0.124 ± 0.204; WholeHipp, P = 0.187, P = 0.132 ± 0.197, P = 0.628). CONCLUSION These preliminary findings indicate that hippocampal subfield volumetry assessed at 7T is capable of identifying characteristic patterns of hippocampal atrophy in HS patients; however, difficulty remains in using imaging to identify hippocampal pathologies in cases without HS. LEVEL OF EVIDENCE 2 J. MAGN. RESON. IMAGING 2017;45:1359-1370.
Collapse
|