1
|
Tabata K, Kawagoe H, Taylor JN, Mochizuki K, Kubo T, Clement JE, Kumamoto Y, Harada Y, Nakamura A, Fujita K, Komatsuzaki T. On-the-fly Raman microscopy guaranteeing the accuracy of discrimination. Proc Natl Acad Sci U S A 2024; 121:e2304866121. [PMID: 38483992 PMCID: PMC10962959 DOI: 10.1073/pnas.2304866121] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/03/2023] [Accepted: 12/15/2023] [Indexed: 03/19/2024] Open
Abstract
Accelerating the measurement for discrimination of samples, such as classification of cell phenotype, is crucial when faced with significant time and cost constraints. Spontaneous Raman microscopy offers label-free, rich chemical information but suffers from long acquisition time due to extremely small scattering cross-sections. One possible approach to accelerate the measurement is by measuring necessary parts with a suitable number of illumination points. However, how to design these points during measurement remains a challenge. To address this, we developed an imaging technique based on a reinforcement learning in machine learning (ML). This ML approach adaptively feeds back "optimal" illumination pattern during the measurement to detect the existence of specific characteristics of interest, allowing faster measurements while guaranteeing discrimination accuracy. Using a set of Raman images of human follicular thyroid and follicular thyroid carcinoma cells, we showed that our technique requires 3,333 to 31,683 times smaller number of illuminations for discriminating the phenotypes than raster scanning. To quantitatively evaluate the number of illuminations depending on the requisite discrimination accuracy, we prepared a set of polymer bead mixture samples to model anomalous and normal tissues. We then applied a home-built programmable-illumination microscope equipped with our algorithm, and confirmed that the system can discriminate the sample conditions with 104 to 4,350 times smaller number of illuminations compared to standard point illumination Raman microscopy. The proposed algorithm can be applied to other types of microscopy that can control measurement condition on the fly, offering an approach for the acceleration of accurate measurements in various applications including medical diagnosis.
Collapse
Affiliation(s)
- Koji Tabata
- Research Center of Mathematics for Social Creativity, Research Institute for Electronic Science, Hokkaido University, Sapporo001–0020, Hokkaido, Japan
- Institute for Chemical Reaction Design and Discovery, Hokkaido University, Sapporo001–0021, Hokkaido, Japan
| | - Hiroyuki Kawagoe
- Department of Applied Physics, Osaka University, Suita565–0871, Osaka, Japan
| | - J. Nicholas Taylor
- Research Center of Mathematics for Social Creativity, Research Institute for Electronic Science, Hokkaido University, Sapporo001–0020, Hokkaido, Japan
| | - Kentaro Mochizuki
- Department of Pathology and Cell Regulation, Graduate School of Medical Science, Kyoto Prefectural University of Medicine, Kyoto602–8566, Kyoto, Japan
| | - Toshiki Kubo
- Department of Applied Physics, Osaka University, Suita565–0871, Osaka, Japan
| | - Jean-Emmanuel Clement
- Institute for Chemical Reaction Design and Discovery, Hokkaido University, Sapporo001–0021, Hokkaido, Japan
| | - Yasuaki Kumamoto
- Department of Applied Physics, Osaka University, Suita565–0871, Osaka, Japan
- Institute for Open and Transdisciplinary Research Initiatives, Osaka University, Suita565–0871, Osaka, Japan
| | - Yoshinori Harada
- Department of Pathology and Cell Regulation, Graduate School of Medical Science, Kyoto Prefectural University of Medicine, Kyoto602–8566, Kyoto, Japan
| | - Atsuyoshi Nakamura
- Graduate School of Information Science and Technology, Hokkaido University, Sapporo060–0814, Hokkaido, Japan
| | - Katsumasa Fujita
- Department of Applied Physics, Osaka University, Suita565–0871, Osaka, Japan
- Institute for Open and Transdisciplinary Research Initiatives, Osaka University, Suita565–0871, Osaka, Japan
- Advanced Photonics and Biosensing Open Innovation Laboratory, AIST-Osaka University, Suita565–0871, Osaka, Japan
| | - Tamiki Komatsuzaki
- Research Center of Mathematics for Social Creativity, Research Institute for Electronic Science, Hokkaido University, Sapporo001–0020, Hokkaido, Japan
- Institute for Chemical Reaction Design and Discovery, Hokkaido University, Sapporo001–0021, Hokkaido, Japan
- Institute for Open and Transdisciplinary Research Initiatives, Osaka University, Suita565–0871, Osaka, Japan
- Graduate School of Chemical Sciences and Engineering Materials Chemistry, and Engineering Course, Hokkaido University, Sapporo060–0812, Hokkaido, Japan
- The Institute of Scientific and Industrial Research, Osaka University, Ibaraki567-0047, Osaka, Japan
| |
Collapse
|