1
|
Maguluri G, Grimble J, Caron A, Zhu G, Krishnamurthy S, McWatters A, Beamer G, Lee SY, Iftimia N. Core Needle Biopsy Guidance Based on Tissue Morphology Assessment with AI-OCT Imaging. Diagnostics (Basel) 2023; 13:2276. [PMID: 37443670 DOI: 10.3390/diagnostics13132276] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/05/2023] [Revised: 06/26/2023] [Accepted: 07/03/2023] [Indexed: 07/15/2023] Open
Abstract
This paper presents a combined optical imaging/artificial intelligence (OI/AI) technique for the real-time analysis of tissue morphology at the tip of the biopsy needle, prior to collecting a biopsy specimen. This is an important clinical problem as up to 40% of collected biopsy cores provide low diagnostic value due to high adipose or necrotic content. Micron-scale-resolution optical coherence tomography (OCT) images can be collected with a minimally invasive needle probe and automatically analyzed using a computer neural network (CNN)-based AI software. The results can be conveyed to the clinician in real time and used to select the biopsy location more adequately. This technology was evaluated on a rabbit model of cancer. OCT images were collected with a hand-held custom-made OCT probe. Annotated OCT images were used as ground truth for AI algorithm training. The overall performance of the AI model was very close to that of the humans performing the same classification tasks. Specifically, tissue segmentation was excellent (~99% accuracy) and provided segmentation that closely mimicked the ground truth provided by the human annotations, while over 84% correlation accuracy was obtained for tumor and non-tumor classification.
Collapse
Affiliation(s)
| | | | | | - Ge Zhu
- Physical Sciences Inc., Andover, MA 01810, USA
| | | | | | | | | | | |
Collapse
|
2
|
Marques MJ, Hughes MR, Uceda AF, Gelikonov G, Bradu A, Podoleanu A. Endoscopic en-face optical coherence tomography and fluorescence imaging using correlation-based probe tracking. BIOMEDICAL OPTICS EXPRESS 2022; 13:761-776. [PMID: 35284172 PMCID: PMC8884237 DOI: 10.1364/boe.444170] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/20/2021] [Revised: 12/20/2021] [Accepted: 12/21/2021] [Indexed: 05/25/2023]
Abstract
Forward-viewing endoscopic optical coherence tomography (OCT) provides 3D imaging in vivo, and can be combined with widefield fluorescence imaging by use of a double-clad fiber. However, it is technically challenging to build a high-performance miniaturized 2D scanning system with a large field-of-view. In this paper we demonstrate how a 1D scanning probe, which produces cross-sectional OCT images (B-scans) and 1D fluorescence T-scans, can be transformed into a 2D scanning probe by manual scanning along the second axis. OCT volumes are assembled from the B-scans using speckle decorrelation measurements to estimate the out-of-plane motion along the manual scan direction. Motion within the plane of the B-scans is corrected using image registration by normalized cross correlation. En-face OCT slices and fluorescence images, corrected for probe motion in 3D, can be displayed in real-time during the scan. For a B-scan frame rate of 250 Hz, and an OCT lateral resolution of approximately 20 μ m , the approach can handle out-of-plane motion at speeds of up to 4 mm/s.
Collapse
Affiliation(s)
- Manuel J. Marques
- Applied Optics Group, Physics and Astronomy, Division of Natural Sciences, University of Kent, Canterbury CT2 7NH, United Kingdom
- Both authors contributed equally to this publication
| | - Michael R. Hughes
- Applied Optics Group, Physics and Astronomy, Division of Natural Sciences, University of Kent, Canterbury CT2 7NH, United Kingdom
- Both authors contributed equally to this publication
| | - Adrián F. Uceda
- Applied Optics Group, Physics and Astronomy, Division of Natural Sciences, University of Kent, Canterbury CT2 7NH, United Kingdom
| | | | - Adrian Bradu
- Applied Optics Group, Physics and Astronomy, Division of Natural Sciences, University of Kent, Canterbury CT2 7NH, United Kingdom
| | - Adrian Podoleanu
- Applied Optics Group, Physics and Astronomy, Division of Natural Sciences, University of Kent, Canterbury CT2 7NH, United Kingdom
| |
Collapse
|
3
|
Lee AMD, MacAulay C, Lane P. Depth-multiplexed optical coherence tomography dual-beam manually-actuated distortion-corrected imaging (DMDI) with a micromotor catheter. BIOMEDICAL OPTICS EXPRESS 2018; 9:5678-5690. [PMID: 30460155 PMCID: PMC6238937 DOI: 10.1364/boe.9.005678] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/22/2018] [Revised: 10/03/2018] [Accepted: 10/03/2018] [Indexed: 06/09/2023]
Abstract
We present a new micromotor catheter implementation of dual-beam manually-actuated distortion-corrected imaging (DMDI). The new catheter called a depth-multiplexed dual-beam micromotor catheter, or mDBMC, maintains the primary advantage of unlimited field-of-view distortion-corrected imaging along the catheter axis. The mDBMC uses a polarization beam splitter and cube mirror to create two beams that scan circularly with approximately constant separation at the catheter surface. This arrangement also multiplexes both imaging channels into a single optical coherence tomography channel by offsetting them in depth, requiring half the data bandwidth compared to previous DMDI demonstrations that used two parallel image acquisition systems. Furthermore, the relatively simple scanning pattern of the two beams enables a straightforward automated distortion correction algorithm. We demonstrate the imaging capabilities of this catheter with a printed paper phantom and in a section of dragon fruit.
Collapse
|
4
|
Harlow M, MacAulay C, Lane P, Lee AMD. Dual-beam manually actuated distortion-corrected imaging (DMDI): two dimensional scanning with a single-axis galvanometer. OPTICS EXPRESS 2018; 26:18758-18772. [PMID: 30114048 DOI: 10.1364/oe.26.018758] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/13/2023]
Abstract
We recently demonstrated a new two-dimensional imaging paradigm called dual-beam manually actuated distortion-corrected imaging (DMDI). This technique uses a single mechanical scanner and two spatially separated beams to determine relative sample velocity and simultaneously corrects image distortions due to manual actuation. DMDI was first demonstrated using a rotating dual-beam micromotor catheter. Here, we present a new implementation of DMDI using a single axis galvanometer to scan a pair of beams in approximately parallel lines onto a sample. Furthermore, we present a method for automated distortion correction based on frame co-registration between images acquired by the two beams. Distortion correction is possible for manually actuated motion both perpendicular and parallel to the galvanometer-scanned lines. Using en face OCT as the imaging modality, we demonstrate DMDI and the automated distortion correction algorithm for imaging a printed paper phantom, a dragon fruit, and a fingerprint.
Collapse
|
5
|
Lee AMD, Hohert G, Angkiriwang PT, MacAulay C, Lane P. Dual-beam manually-actuated distortion-corrected imaging (DMDI) with micromotor catheters. OPTICS EXPRESS 2017; 25:22164-22177. [PMID: 29041505 DOI: 10.1364/oe.25.022164] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/19/2017] [Accepted: 08/18/2017] [Indexed: 05/23/2023]
Abstract
We present a new paradigm for performing two-dimensional scanning called dual-beam manually-actuated distortion-corrected imaging (DMDI). DMDI operates by imaging the same object with two spatially-separated beams that are being mechanically scanned rapidly in one dimension with slower manual actuation along a second dimension. Registration of common features between the two imaging channels allows remapping of the images to correct for distortions due to manual actuation. We demonstrate DMDI using a 4.7 mm OD rotationally scanning dual-beam micromotor catheter (DBMC). The DBMC requires a simple, one-time calibration of the beam paths by imaging a patterned phantom. DMDI allows for distortion correction of non-uniform axial speed and rotational motion of the DBMC. We show the utility of this technique by demonstrating en face OCT image distortion correction of a manually-scanned checkerboard phantom and fingerprint scan.
Collapse
|
6
|
Pande P, Shelton RL, Monroy GL, Nolan RM, Boppart SA. Low-cost hand-held probe for depth-resolved low-coherence interferometry. BIOMEDICAL OPTICS EXPRESS 2017; 8:338-348. [PMID: 28101422 PMCID: PMC5231303 DOI: 10.1364/boe.8.000338] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/24/2016] [Revised: 12/07/2016] [Accepted: 12/08/2016] [Indexed: 05/20/2023]
Abstract
We report on the development of a low-cost hand-held low-coherence interferometric imaging system based on the principle of linear optical coherence tomography (Linear OCT), a technique which was first proposed in the early 2000s as a simpler alternative to the conventional time-domain and Fourier-domain OCT. A bench-top implementation of the proposed technique is first presented and validated. The axial resolution, SNR, and sensitivity roll-of of the system was estimated to be 5.2 μm and 80 dB, and 3.7 dB over a depth of 0.15 mm, respectively. After validating the bench-top system, two hand-held probe implementations for contact-based imaging and in vivo human tympanic membrane imaging are presented. The performance of the proposed system was compared with a research-grade state-of-the-art Fourier-domain low coherence interferometry (LCI) system by imaging several biological and non-biological samples. The results of this study suggest that the proposed system might be a suitable choice for applications where imaging depth and SNR can be traded for lower cost and simpler optical design.
Collapse
Affiliation(s)
- Paritosh Pande
- Beckman Institute for Advanced Science and Technology, University of Illinois at Urbana-Champaign, Urbana, Illinois,
USA
| | - Ryan L. Shelton
- Beckman Institute for Advanced Science and Technology, University of Illinois at Urbana-Champaign, Urbana, Illinois,
USA
| | - Guillermo L. Monroy
- Beckman Institute for Advanced Science and Technology, University of Illinois at Urbana-Champaign, Urbana, Illinois,
USA
- Department of Bioengineering, University of Illinois at Urbana-Champaign, Urbana, Illinois,
USA
| | - Ryan M. Nolan
- Beckman Institute for Advanced Science and Technology, University of Illinois at Urbana-Champaign, Urbana, Illinois,
USA
| | - Stephen A. Boppart
- Beckman Institute for Advanced Science and Technology, University of Illinois at Urbana-Champaign, Urbana, Illinois,
USA
- Department of Bioengineering, University of Illinois at Urbana-Champaign, Urbana, Illinois,
USA
- Department of Electrical and Computer Engineering, University of Illinois at Urbana-Champaign, Urbana, Illinois,
USA
- Department of Internal Medicine, University of Illinois at Urbana-Champaign, Urbana, Illinois,
USA
| |
Collapse
|
7
|
Pande P, Monroy GL, Nolan RM, Shelton RL, Boppart SA. Sensor-Based Technique for Manually Scanned Hand-Held Optical Coherence Tomography Imaging. JOURNAL OF SENSORS 2016; 2016:8154809. [PMID: 29033983 PMCID: PMC5636012 DOI: 10.1155/2016/8154809] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/03/2023]
Abstract
Hand-held optical coherence tomography (OCT) imaging probes offer flexibility to image sites that are otherwise challenging to access. While the majority of hand-held imaging probes utilize galvanometer- or MEMS-scanning mirrors to transversely scan the imaging beam, these probes are commonly limited to lateral fields-of-view (FOV) of only a few millimeters. The use of a freehand manually scanned probe can significantly increase the lateral FOV. However, using the traditional fixed-rate triggering scheme for data acquisition in a manually scanned probe results in imaging artifacts due to variations in the scan velocity of the imaging probe. These artifacts result in a structurally inaccurate image of the sample. In this paper, we present a sensor-based manual scanning technique for OCT imaging, where real-time feedback from an optical motion sensor is used to trigger data acquisition. This technique is able to circumvent the problem of motion artifacts during manual scanning by adaptively altering the trigger rate based on the instantaneous scan velocity, enabling OCT imaging over a large lateral FOV. The feasibility of the proposed technique is demonstrated by imaging several biological and nonbiological samples.
Collapse
Affiliation(s)
- Paritosh Pande
- Beckman Institute for Advanced Science and Technology, University of Illinois at Urbana-Champaign, Urbana, IL 61801, USA
| | - Guillermo L. Monroy
- Beckman Institute for Advanced Science and Technology, University of Illinois at Urbana-Champaign, Urbana, IL 61801, USA
- Department of Bioengineering, University of Illinois at Urbana-Champaign, Urbana, IL 61801, USA
| | - Ryan M. Nolan
- Beckman Institute for Advanced Science and Technology, University of Illinois at Urbana-Champaign, Urbana, IL 61801, USA
| | - Ryan L. Shelton
- Beckman Institute for Advanced Science and Technology, University of Illinois at Urbana-Champaign, Urbana, IL 61801, USA
- Department of Electrical and Computer Engineering, University of Illinois at Urbana-Champaign, Urbana, IL 61801, USA
| | - Stephen A. Boppart
- Beckman Institute for Advanced Science and Technology, University of Illinois at Urbana-Champaign, Urbana, IL 61801, USA
- Department of Bioengineering, University of Illinois at Urbana-Champaign, Urbana, IL 61801, USA
- Department of Electrical and Computer Engineering, University of Illinois at Urbana-Champaign, Urbana, IL 61801, USA
- Department of Internal Medicine, University of Illinois at Urbana-Champaign, Urbana, IL 61801, USA
| |
Collapse
|