1
|
Fang N, Wu Z, Su X, Chen R, Shi L, Feng Y, Huang Y, Zhang X, Li L, Zheng L, Hu L, Kang D, Wang X, Chen J. Computer-Aided Multiphoton Microscopy Diagnosis of 5 Different Primary Architecture Subtypes of Meningiomas. J Transl Med 2024; 104:100324. [PMID: 38220044 DOI: 10.1016/j.labinv.2024.100324] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/01/2023] [Revised: 12/19/2023] [Accepted: 01/02/2024] [Indexed: 01/16/2024] Open
Abstract
Meningiomas rank among the most common intracranial tumors, and surgery stands as the primary treatment modality for meningiomas. The precise subtyping and diagnosis of meningiomas, both before and during surgery, play a pivotal role in enabling neurosurgeons choose the optimal surgical program. In this study, we utilized multiphoton microscopy (MPM) based on 2-photon excited fluorescence and second-harmonic generation to identify 5 common meningioma subtypes. The morphological features of these subtypes were depicted using the MPM multichannel mode. Additionally, we developed 2 distinct programs to quantify collagen content and blood vessel density. Furthermore, the lambda mode of the MPM characterized architectural and spectral features, from which 3 quantitative indicators were extracted. Moreover, we employed machine learning to differentiate meningioma subtypes automatically, achieving high classification accuracy. These findings demonstrate the potential of MPM as a noninvasive diagnostic tool for meningioma subtyping and diagnosis, offering improved accuracy and resolution compared with traditional methods.
Collapse
Affiliation(s)
- Na Fang
- School of Medical Technology and Engineering, Fujian Medical University, Fuzhou, China
| | - Zanyi Wu
- Department of Neurosurgery, First Affiliated Hospital of Fujian Medical University, Fuzhou, China
| | - Xiaoli Su
- Department of Pathology, the First Affiliated Hospital of Fujian Medical University, Fuzhou, China
| | - Rong Chen
- School of Medical Technology and Engineering, Fujian Medical University, Fuzhou, China
| | - Linjing Shi
- School of Medical Technology and Engineering, Fujian Medical University, Fuzhou, China
| | - Yanzhen Feng
- School of Medical Technology and Engineering, Fujian Medical University, Fuzhou, China
| | - Yuqing Huang
- School of Medical Technology and Engineering, Fujian Medical University, Fuzhou, China
| | - Xinlei Zhang
- School of Medical Technology and Engineering, Fujian Medical University, Fuzhou, China
| | - Lianhuang Li
- Key Laboratory of OptoElectronic Science and Technology for Medicine of Ministry of Education, Fujian Provincial Key Laboratory of Photonics Technology, Fujian Normal University, Fuzhou, China
| | - Liqin Zheng
- Key Laboratory of OptoElectronic Science and Technology for Medicine of Ministry of Education, Fujian Provincial Key Laboratory of Photonics Technology, Fujian Normal University, Fuzhou, China
| | - Liwen Hu
- Department of Pathology, the First Affiliated Hospital of Fujian Medical University, Fuzhou, China
| | - Dezhi Kang
- Department of Neurosurgery, First Affiliated Hospital of Fujian Medical University, Fuzhou, China.
| | - Xingfu Wang
- Department of Pathology, the First Affiliated Hospital of Fujian Medical University, Fuzhou, China.
| | - Jianxin Chen
- Key Laboratory of OptoElectronic Science and Technology for Medicine of Ministry of Education, Fujian Provincial Key Laboratory of Photonics Technology, Fujian Normal University, Fuzhou, China.
| |
Collapse
|
2
|
Abraham TM, Levenson R. Current Landscape of Advanced Imaging Tools for Pathology Diagnostics. Mod Pathol 2024; 37:100443. [PMID: 38311312 DOI: 10.1016/j.modpat.2024.100443] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/25/2023] [Revised: 12/13/2023] [Accepted: 01/26/2024] [Indexed: 02/10/2024]
Abstract
Histopathology relies on century-old workflows of formalin fixation, paraffin embedding, sectioning, and staining tissue specimens on glass slides. Despite being robust, this conventional process is slow, labor-intensive, and limited to providing two-dimensional views. Emerging technologies promise to enhance and accelerate histopathology. Slide-free microscopy allows rapid imaging of fresh, unsectioned specimens, overcoming slide preparation delays. Methods such as fluorescence confocal microscopy, multiphoton microscopy, along with more recent innovations including microscopy with UV surface excitation and fluorescence-imitating brightfield imaging can generate images resembling conventional histology directly from the surface of tissue specimens. Slide-free microscopy enable applications such as rapid intraoperative margin assessment and, with appropriate technology, three-dimensional histopathology. Multiomics profiling techniques, including imaging mass spectrometry and Raman spectroscopy, provide highly multiplexed molecular maps of tissues, although clinical translation remains challenging. Artificial intelligence is aiding the adoption of new imaging modalities via virtual staining, which converts methods such as slide-free microscopy into synthetic brightfield-like or even molecularly informed images. Although not yet commonplace, these emerging technologies collectively demonstrate the potential to modernize histopathology. Artificial intelligence-assisted workflows will ease the transition to new imaging modalities. With further validation, these advances may transform the century-old conventional histopathology pipeline to better serve 21st-century medicine. This review provides an overview of these enabling technology platforms and discusses their potential impact.
Collapse
Affiliation(s)
- Tanishq Mathew Abraham
- Department of Biomedical Engineering, University of California, Davis, Davis, California
| | - Richard Levenson
- Department of Pathology and Laboratory Medicine, UC Davis Health, Sacramento, California.
| |
Collapse
|
3
|
Crossley RM, Johnson S, Tsingos E, Bell Z, Berardi M, Botticelli M, Braat QJS, Metzcar J, Ruscone M, Yin Y, Shuttleworth R. Modeling the extracellular matrix in cell migration and morphogenesis: a guide for the curious biologist. Front Cell Dev Biol 2024; 12:1354132. [PMID: 38495620 PMCID: PMC10940354 DOI: 10.3389/fcell.2024.1354132] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/11/2023] [Accepted: 02/12/2024] [Indexed: 03/19/2024] Open
Abstract
The extracellular matrix (ECM) is a highly complex structure through which biochemical and mechanical signals are transmitted. In processes of cell migration, the ECM also acts as a scaffold, providing structural support to cells as well as points of potential attachment. Although the ECM is a well-studied structure, its role in many biological processes remains difficult to investigate comprehensively due to its complexity and structural variation within an organism. In tandem with experiments, mathematical models are helpful in refining and testing hypotheses, generating predictions, and exploring conditions outside the scope of experiments. Such models can be combined and calibrated with in vivo and in vitro data to identify critical cell-ECM interactions that drive developmental and homeostatic processes, or the progression of diseases. In this review, we focus on mathematical and computational models of the ECM in processes such as cell migration including cancer metastasis, and in tissue structure and morphogenesis. By highlighting the predictive power of these models, we aim to help bridge the gap between experimental and computational approaches to studying the ECM and to provide guidance on selecting an appropriate model framework to complement corresponding experimental studies.
Collapse
Affiliation(s)
- Rebecca M. Crossley
- Wolfson Centre for Mathematical Biology, Mathematical Institute, University of Oxford, Oxford, United Kingdom
| | - Samuel Johnson
- Wolfson Centre for Mathematical Biology, Mathematical Institute, University of Oxford, Oxford, United Kingdom
| | - Erika Tsingos
- Computational Developmental Biology Group, Institute of Biodynamics and Biocomplexity, Utrecht University, Utrecht, Netherlands
| | - Zoe Bell
- Northern Institute for Cancer Research, Newcastle University, Newcastle upon Tyne, United Kingdom
| | - Massimiliano Berardi
- LaserLab, Department of Physics and Astronomy, Vrije Universiteit Amsterdam, Amsterdam, Netherlands
- Optics11 life, Amsterdam, Netherlands
| | | | - Quirine J. S. Braat
- Department of Applied Physics and Science Education, Eindhoven University of Technology, Eindhoven, Netherlands
| | - John Metzcar
- Department of Intelligent Systems Engineering, Indiana University, Bloomington, IN, United States
- Department of Informatics, Indiana University, Bloomington, IN, United States
| | | | - Yuan Yin
- Wolfson Centre for Mathematical Biology, Mathematical Institute, University of Oxford, Oxford, United Kingdom
| | | |
Collapse
|
4
|
Kok SD, Schaap PMR, van Dommelen L, van Huizen LMG, Dickhoff C, Dijkum EMNV, Engelsman AF, van der Valk P, Groot ML. Compact portable higher harmonic generation microscopy for the real time assessment of unprocessed thyroid tissue. J Biophotonics 2024; 17:e202300079. [PMID: 37725434 DOI: 10.1002/jbio.202300079] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/09/2023] [Revised: 09/12/2023] [Accepted: 09/15/2023] [Indexed: 09/21/2023]
Abstract
During thyroid surgery fast and reliable intra-operative pathological feedback has the potential to avoid a two-stage procedure and significantly reduce health care costs in patients undergoing a diagnostic hemithyroidectomy (HT). We explored higher harmonic generation (HHG) microscopy, which combines second harmonic generation (SHG), third harmonic generation (THG), and multiphoton excited autofluorescence (MPEF) for this purpose. With a compact, portable HHG microscope, images of freshly excised healthy tissue, benign nodules (follicular adenoma) and malignant tissue (papillary carcinoma, follicular carcinoma and spindle cell carcinoma) were recorded. The images were generated on unprocessed tissue within minutes and show relevant morphological thyroid structures in good accordance with the histology images. The thyroid follicle architecture, cells, cell nuclei (THG), collagen organization (SHG) and the distribution of thyroglobulin and/or thyroid hormones T3 or T4 (MPEF) could be visualized. We conclude that SHG/THG/MPEF imaging is a promising tool for clinical intraoperative assessment of thyroid tissue.
Collapse
Affiliation(s)
- S D Kok
- Vrije Universiteit Amsterdam, Faculty of Science, Department of Physics, LaserLab, Amsterdam, The Netherlands
| | - P M Rodriguez Schaap
- Department of Surgery, Amsterdam UMC, location VUmc, Amsterdam, The Netherlands
- Cancer Center Amsterdam, Amsterdam UMC, Amsterdam, The Netherlands
| | - L van Dommelen
- Department of Surgery, Amsterdam UMC, location VUmc, Amsterdam, The Netherlands
| | - L M G van Huizen
- Vrije Universiteit Amsterdam, Faculty of Science, Department of Physics, LaserLab, Amsterdam, The Netherlands
| | - C Dickhoff
- Department of Surgery, Amsterdam UMC, location VUmc, Amsterdam, The Netherlands
- Cancer Center Amsterdam, Amsterdam UMC, Amsterdam, The Netherlands
- Department of Cardiothoracic Surgery, Amsterdam UMC, location VUmc, Amsterdam, The Netherlands
| | - E M Nieveen-van Dijkum
- Department of Surgery, Amsterdam UMC, location VUmc, Amsterdam, The Netherlands
- Cancer Center Amsterdam, Amsterdam UMC, Amsterdam, The Netherlands
| | - A F Engelsman
- Department of Surgery, Amsterdam UMC, location VUmc, Amsterdam, The Netherlands
- Cancer Center Amsterdam, Amsterdam UMC, Amsterdam, The Netherlands
| | - P van der Valk
- Department of Pathology, Amsterdam UMC, location VUmc, Amsterdam, The Netherlands
| | - M L Groot
- Vrije Universiteit Amsterdam, Faculty of Science, Department of Physics, LaserLab, Amsterdam, The Netherlands
| |
Collapse
|
5
|
Xi G, Huang C, Lin J, Luo T, Kang B, Xu M, Xu H, Li X, Chen J, Qiu L, Zhuo S. Rapid label-free detection of early-stage lung adenocarcinoma and tumor boundary via multiphoton microscopy. Journal of Biophotonics 2023; 16:e202300172. [PMID: 37596245 DOI: 10.1002/jbio.202300172] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/12/2023] [Revised: 07/08/2023] [Accepted: 08/15/2023] [Indexed: 08/20/2023]
Abstract
Lung cancer is the most commonly diagnosed cancer and the leading cause of cancer-related deaths in China. Rapid and precise evaluation of tumor tissue during lung cancer surgery can reduce operative time and improve negative-margin assessment, thus increasing disease-free and overall survival rates. This study aimed to explore the potential of label-free multiphoton microscopy (MPM) for imaging adenocarcinoma tissues, detecting histopathological features, and distinguishing between normal and cancerous lung tissues. We showed that second harmonic generation (SHG) signals exhibit significant specificity for collagen fibers, enabling the quantification of collagen features in lung adenocarcinomas. In addition, we developed a collagen score that could be used to distinguish between normal and tumor areas at the tumor boundary, showing good classification performance. Our findings demonstrate that MPM imaging technology combined with an image-based collagen feature extraction method can rapidly and accurately detect early-stage lung adenocarcinoma tissues.
Collapse
Affiliation(s)
- Gangqin Xi
- School of Science, Jimei University, Xiamen, China
| | - Chen Huang
- Shengli Clinical College of Fujian Medical University, Department of Thoracic Surgery, Fujian Provincial Hospital, Fuzhou, China
| | - Jie Lin
- Shengli Clinical College of Fujian Medical University, Department of Pathology, Fujian Provincial Hospital, Fuzhou, China
| | - Tianyi Luo
- School of Science, Jimei University, Xiamen, China
| | - Bingzi Kang
- School of Science, Jimei University, Xiamen, China
| | - Mingyu Xu
- School of Science, Jimei University, Xiamen, China
| | - Huizhen Xu
- School of Science, Jimei University, Xiamen, China
| | - Xiaolu Li
- School of Science, Jimei University, Xiamen, China
| | - Jianxin Chen
- Key Laboratory of OptoElectronic Science and Technology for Medicine of the Ministry of Education, Fujian Provincial Key Laboratory of Photonics Technology, College of Photonic and Electronic Engineering, Fujian Normal University, Fuzhou, China
| | - Lida Qiu
- College of Physics and Electronic Information Engineering, Minjiang University, Fuzhou, China
| | | |
Collapse
|
6
|
Tehrani KF, Park J, Chaney EJ, Tu H, Boppart SA. Nonlinear Imaging Histopathology: A Pipeline to Correlate Gold-Standard Hematoxylin and Eosin Staining With Modern Nonlinear Microscopy. IEEE J Sel Top Quantum Electron 2023; 29:6800608. [PMID: 37193134 PMCID: PMC10174331 DOI: 10.1109/jstqe.2022.3233523] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/18/2023]
Abstract
Hematoxylin and eosin (H&E) staining, the century-old technique, has been the gold standard tool for pathologists to detect anomalies in tissues and diseases such as cancer. H&E staining is a cumbersome, time-consuming process that delays and wastes precious minutes during an intraoperative diagnosis. However, even in the modern era, real-time label-free imaging techniques such as simultaneous label-free autofluorescence multiharmonic (SLAM) microscopy have delivered several more layers of information to characterize a tissue with high precision. Still, they have yet to translate to the clinic. The slow translation rate can be attributed to the lack of direct comparisons between the old and new techniques. Our approach to solving this problem is to: 1) reduce dimensions by pre-sectioning the tissue in 500 μm slices, and 2) produce fiducial laser markings which appear in both SLAM and histological imaging. High peak-power femtosecond laser pulses enable ablation in a controlled and contained manner. We perform laser marking on a grid of points encompassing the SLAM region of interest. We optimize laser power, numerical aperture, and timing to produce axially extended marking, hence multilayered fiducial markers, with minimal damage to the surrounding tissues. We performed this co-registration over an area of 3 × 3 mm2 of freshly excised mouse kidney and intestine, followed by standard H&E staining. Reduced dimensionality and the use of laser markings provided a comparison of the old and new techniques, giving a wealth of correlative information and elevating the potential of translating nonlinear microscopy to the clinic for rapid pathological assessment.
Collapse
Affiliation(s)
- Kayvan Forouhesh Tehrani
- Beckman Institute for Advanced Science and Technology, University of Illinois Urbana-Champaign, Urbana, IL 61801-3028 USA
| | - Jaena Park
- Beckman Institute for Advanced Science and Technology, University of Illinois Urbana-Champaign, Urbana, IL 61801-3028 USA, and also with the Department of Bioengineering, University of Illinois Urbana-Champaign, Urbana, IL 61801-3028 USA
| | - Eric J Chaney
- Beckman Institute for Advanced Science and Technology, University of Illinois Urbana-Champaign, Urbana, IL 61801-3028 USA
| | - Haohua Tu
- Beckman Institute for Advanced Science and Technology, University of Illinois Urbana-Champaign, Urbana, IL 61801-3028 USA, and also with the Department of Electrical and Computer Engineering, University of Illinois Urbana-Champaign, Urbana, IL 61801-3028 USA
| | - Stephen A Boppart
- Beckman Institute for Advanced Science and Technology, Department of Electrical and Computer Engineering, Department of Bioengineering, Carle Illinois College of Medicine, and Cancer Center at Illinois, University of Illinois Urbana-Champaign, Urbana, IL 61801-3028 USA
| |
Collapse
|
7
|
Clark MG, Gonzalez GA, Zhang C. Pulse-Picking Multimodal Nonlinear Optical Microscopy. Anal Chem 2022; 94:15405-15414. [DOI: 10.1021/acs.analchem.2c03284] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/28/2022]
Affiliation(s)
- Matthew G. Clark
- Department of Chemistry, Purdue University, 560 Oval Drive, West Lafayette, Indiana47907, United States
| | - Gil A. Gonzalez
- Department of Chemistry, Purdue University, 560 Oval Drive, West Lafayette, Indiana47907, United States
| | - Chi Zhang
- Department of Chemistry, Purdue University, 560 Oval Drive, West Lafayette, Indiana47907, United States
- Purdue Center for Cancer Research, 201 S University Street, West Lafayette, Indiana47907, United States
- Purdue Institute of Inflammation, Immunology, and Infectious Disease, 207 S Martin Jischke Drive, West Lafayette, Indiana47907, United States
| |
Collapse
|
8
|
Wang J, Zhen Z, Wang Y, Wu R, Hu Y, Fu Q, Li Y, Xin B, Song J, Li J, Ren Y, Feng L, Cheng H, Wang A, Hu L, Ling S, Li Y. Non-Invasive Skin Imaging Assessment of Human Stress During Head-Down Bed Rest Using a Portable Handheld Two-Photon Microscope. Front Physiol 2022; 13:899830. [PMID: 35957987 PMCID: PMC9358145 DOI: 10.3389/fphys.2022.899830] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/19/2022] [Accepted: 05/06/2022] [Indexed: 11/13/2022] Open
Abstract
Spaceflight presents a series of physiological and pathological challenges to astronauts resulting from ionizing radiation, microgravity, isolation, and other spaceflight hazards. These risks cause a series of aging-related diseases associated with increased oxidative stress and mitochondria dysfunction. The skin contains many autofluorescent substances, such as nicotinamide adenine dinucleotide phosphate (NAD(P)H), keratin, melanin, elastin, and collagen, which reflect physiological and pathological changes in vivo. In this study, we used a portable handheld two-photon microscope to conduct high-resolution in vivo skin imaging on volunteers during 15 days of head-down bed rest. The two-photon microscope, equipped with a flexible handheld scanning head, was used to measure two-photon excited fluorescence (TPEF) and second harmonic generation (SHG) images of the left forearm, left front chest, and forehead of volunteers. Changes in TPEF, SHG, and the extended SHG-to-AF(TPEF) aging index of the dermis (SAAID) were measured. It was found that TPEF intensity increased during bed rest and was restored to normal levels after recovery. Meanwhile, SHG increased slightly during bed rest, and the skin aging index increased. Moreover, we found the skin TPEF signals of the left forearm were significantly negatively associated with the oxidative stress marker malondialdehyde (MDA) and DNA damage marker 8-hydroxy-2′-desoxyguanosine (8-OHdG) values of subjects during head-down bed rest. Meanwhile, the SHG signals were also significantly negatively correlated with MDA and 8-OHDG. A significant negative correlation between the extended SAAID of the left chest and serum antioxidant superoxide dismutase (SOD) levels was also found. These results demonstrate that skin autofluorescence signals can reflect changes in human oxidant status. This study provides evidence for in-orbit monitoring of changes in human stress using a portable handheld two-photon microscope for skin imaging.
Collapse
Affiliation(s)
- Junjie Wang
- College of Future Technology, Peking University, Beijing, China
| | - Zhen Zhen
- State Key Lab of Space Medicine Fundamentals and Application, China Astronaut Research and Training Center, Beijing, China
- Department of Environment and Life, Beijing University of Technology, Beijing, China
| | - Yanqing Wang
- State Key Lab of Space Medicine Fundamentals and Application, China Astronaut Research and Training Center, Beijing, China
| | - Runlong Wu
- College of Future Technology, Peking University, Beijing, China
| | - Yanhui Hu
- Beijing Transcend Vivoscope Bio-Technology Co. Ltd., Beijing, China
| | - Qiang Fu
- Beijing Transcend Vivoscope Bio-Technology Co. Ltd., Beijing, China
| | - Yongzhi Li
- State Key Lab of Space Medicine Fundamentals and Application, China Astronaut Research and Training Center, Beijing, China
| | - Bingmu Xin
- Engineering Research Center of Human Circadian Rhythm and Sleep, Space Science and Technology Institute, Shenzhen, China
| | - Jinping Song
- State Key Lab of Space Medicine Fundamentals and Application, China Astronaut Research and Training Center, Beijing, China
| | - Jianwei Li
- State Key Lab of Space Medicine Fundamentals and Application, China Astronaut Research and Training Center, Beijing, China
| | - Yafei Ren
- State Key Lab of Space Medicine Fundamentals and Application, China Astronaut Research and Training Center, Beijing, China
| | - Lishuang Feng
- School of Instrumentation Science and Opto-Electronics Engineering, Beihang University, Beijing, China
| | - Heping Cheng
- College of Future Technology, Peking University, Beijing, China
| | - Aimin Wang
- School of Electronics, Peking University, Beijing, China
| | - Liming Hu
- Department of Environment and Life, Beijing University of Technology, Beijing, China
- *Correspondence: Liming Hu, ; Shukuan Ling, ; Yingxian Li,
| | - Shukuan Ling
- State Key Lab of Space Medicine Fundamentals and Application, China Astronaut Research and Training Center, Beijing, China
- *Correspondence: Liming Hu, ; Shukuan Ling, ; Yingxian Li,
| | - Yingxian Li
- State Key Lab of Space Medicine Fundamentals and Application, China Astronaut Research and Training Center, Beijing, China
- *Correspondence: Liming Hu, ; Shukuan Ling, ; Yingxian Li,
| |
Collapse
|
9
|
Blokker M, Hamer PCDW, Wesseling P, Groot ML, Veta M. Fast intraoperative histology-based diagnosis of gliomas with third harmonic generation microscopy and deep learning. Sci Rep 2022; 12:11334. [PMID: 35790792 PMCID: PMC9256596 DOI: 10.1038/s41598-022-15423-z] [Citation(s) in RCA: 7] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/24/2021] [Accepted: 06/23/2022] [Indexed: 11/09/2022] Open
Abstract
Management of gliomas requires an invasive treatment strategy, including extensive surgical resection. The objective of the neurosurgeon is to maximize tumor removal while preserving healthy brain tissue. However, the lack of a clear tumor boundary hampers the neurosurgeon's ability to accurately detect and resect infiltrating tumor tissue. Nonlinear multiphoton microscopy, in particular higher harmonic generation, enables label-free imaging of excised brain tissue, revealing histological hallmarks within seconds. Here, we demonstrate a real-time deep learning-based pipeline for automated glioma image analysis, matching video-rate image acquisition. We used a custom noise detection scheme, and a fully-convolutional classification network, to achieve on average 79% binary accuracy, 0.77 AUC and 0.83 mean average precision compared to the consensus of three pathologists, on a preliminary dataset. We conclude that the combination of real-time imaging and image analysis shows great potential for intraoperative assessment of brain tissue during tumor surgery.
Collapse
Affiliation(s)
- Max Blokker
- Department of Physics and Astronomy, Vrije Universiteit Amsterdam, Amsterdam, The Netherlands.
| | - Philip C de Witt Hamer
- Department of Neurosurgery, Amsterdam UMC location VU University Medical Center, Amsterdam, The Netherlands
| | - Pieter Wesseling
- Department of Pathology, Amsterdam UMC location VU University Medical Center, Amsterdam, The Netherlands
| | - Marie Louise Groot
- Department of Physics and Astronomy, Vrije Universiteit Amsterdam, Amsterdam, The Netherlands
| | - Mitko Veta
- Medical Image Analysis Group (IMAG/e), Department of Biomedical Engineering, Eindhoven University of Technology, Eindhoven, The Netherlands
| |
Collapse
|
10
|
Freymüller C, Ströbl S, Aumiller M, Eisel M, Sroka R, Rühm A. Development of a microstructured tissue phantom with adaptable optical properties for use with microscopes and fluorescence lifetime imaging systems. Lasers Surg Med 2022; 54:1010-1026. [PMID: 35753039 DOI: 10.1002/lsm.23556] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/28/2021] [Revised: 04/22/2022] [Accepted: 04/24/2022] [Indexed: 11/08/2022]
Abstract
OBJECTIVES For the development and validation of diagnostic procedures based on microscopic methods, knowledge about the imaging depth and achievable resolution in tissue is crucial. This poses the challenge to develop a microscopic artificial phantom focused on the microscopic instead of the macroscopic optical tissue characteristics. METHODS As existing artificial tissue phantoms designed for image forming systems are primarily targeted at wide field applications, they are unsuited for reaching the formulated objective. Therefore, a microscopy- and microendoscopy-suited artificial tissue phantom was developed and characterized. It is based on a microstructured glass surface coated with fluorescent beads at known depths covered by a scattering agent with modifiable optical properties. The phantom was examined with different kinds of microscopy systems in order to characterize its quality and stability and to demonstrate its usefulness for instrument comparison, for example, regarding structural as well as fluorescence lifetime analysis. RESULTS The analysis of the manufactured microstructured glass surfaces showed high regularity in their physical dimensions in accordance with the specifications. Measurements of the optical parameters of the scattering medium were consistent with simulations. The fluorescent beads coating proved to be stable for a respectable period of time (about a week). The developed artificial tissue phantom was successfully used to detect differences in image quality between a research microscope and an endoscopy based system. Plausible causes for the observed differences could be derived based on the well known microstructure of the phantom. CONCLUSIONS The artificial tissue phantom is well suited for the intended use with microscopic and microendoscopic systems. Due to its configurable design, it can be adapted to a wide range of applications. It is especially targeted at the characterization and calibration of clinical imaging systems that often lack extensive positioning capabilities such as an intrinsic z-stage.
Collapse
Affiliation(s)
- Christian Freymüller
- Laser-Forschungslabor, LIFE Center, Department of Urology, University Hospital, LMU Munich, Munich, Germany.,Department of Urology, University Hospital, LMU Munich, Munich, Germany
| | - Stephan Ströbl
- Laser-Forschungslabor, LIFE Center, Department of Urology, University Hospital, LMU Munich, Munich, Germany.,Department of Urology, University Hospital, LMU Munich, Munich, Germany.,Research Center for Microtechnology, FH Vorarlberg, Dornbirn, Vorarlberg, Austria
| | - Maximilian Aumiller
- Laser-Forschungslabor, LIFE Center, Department of Urology, University Hospital, LMU Munich, Munich, Germany.,Department of Urology, University Hospital, LMU Munich, Munich, Germany
| | - Maximilian Eisel
- Laser-Forschungslabor, LIFE Center, Department of Urology, University Hospital, LMU Munich, Munich, Germany.,Department of Urology, University Hospital, LMU Munich, Munich, Germany
| | - Ronald Sroka
- Laser-Forschungslabor, LIFE Center, Department of Urology, University Hospital, LMU Munich, Munich, Germany.,Department of Urology, University Hospital, LMU Munich, Munich, Germany
| | - Adrian Rühm
- Laser-Forschungslabor, LIFE Center, Department of Urology, University Hospital, LMU Munich, Munich, Germany.,Department of Urology, University Hospital, LMU Munich, Munich, Germany
| |
Collapse
|
11
|
Freymüller C, Kalinina S, Rück A, Sroka R, Rühm A. Quenched coumarin derivatives as fluorescence lifetime phantoms for NADH and FAD. J Biophotonics 2021; 14:e202100024. [PMID: 33749988 DOI: 10.1002/jbio.202100024] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/15/2021] [Revised: 02/22/2021] [Accepted: 03/12/2021] [Indexed: 06/12/2023]
Abstract
Two-photon fluorescence lifetime imaging is a versatile laboratory technique in the field of biophotonics and its importance is also growing in the field of in vivo diagnostics for medical purposes. After years of experience in dermatology, endoscopic implementations of the technique are now posing new technical challenges. To develop, test, and compare instrumental solutions for this purpose suitable reference samples have been devised and tested. These reference samples can serve as reliable NADH- and FAD-mimicking optical phantoms for 2-photon fluorescence lifetime imaging, as they can be prepared relatively easily with reproducible and stable characteristics for this quite relevant diagnostic technique. The reference samples (mixtures of coumarin 1 and coumarin 6 in ethanol with suitable amounts of 4-hydroxy-TEMPO) have been tuned to exhibit spectral and temporal fluorescence characteristics very similar to those of NADH and FAD, the two molecules most frequently utilized to characterize cell metabolism.
Collapse
Affiliation(s)
- Christian Freymüller
- Laser-Forschungslabor, LIFE Center, University Hospital, LMU Munich, Planegg, Germany
- Department of Urology, University Hospital, LMU Munich, Munich, Germany
| | - Sviatlana Kalinina
- Core Facility Confocal and Multiphoton Microscopy N24, University of Ulm, Ulm, Germany
| | - Angelika Rück
- Core Facility Confocal and Multiphoton Microscopy N24, University of Ulm, Ulm, Germany
| | - Ronald Sroka
- Laser-Forschungslabor, LIFE Center, University Hospital, LMU Munich, Planegg, Germany
- Department of Urology, University Hospital, LMU Munich, Munich, Germany
| | - Adrian Rühm
- Laser-Forschungslabor, LIFE Center, University Hospital, LMU Munich, Planegg, Germany
- Department of Urology, University Hospital, LMU Munich, Munich, Germany
| |
Collapse
|