1
|
Campbell JM, Gosnell M, Agha A, Handley S, Knab A, Anwer AG, Bhargava A, Goldys EM. Label-Free Assessment of Key Biological Autofluorophores: Material Characteristics and Opportunities for Clinical Applications. ADVANCED MATERIALS (DEERFIELD BEACH, FLA.) 2024; 36:e2403761. [PMID: 38775184 DOI: 10.1002/adma.202403761] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/13/2024] [Revised: 05/04/2024] [Indexed: 06/13/2024]
Abstract
Autofluorophores are endogenous fluorescent compounds that naturally occur in the intra and extracellular spaces of all tissues and organs. Most have vital biological functions - like the metabolic cofactors NAD(P)H and FAD+, as well as the structural protein collagen. Others are considered to be waste products - like lipofuscin and advanced glycation end products - which accumulate with age and are associated with cellular dysfunction. Due to their natural fluorescence, these materials have great utility for enabling non-invasive, label-free assays with direct ties to biological function. Numerous technologies, with different advantages and drawbacks, are applied to their assessment, including fluorescence lifetime imaging microscopy, hyperspectral microscopy, and flow cytometry. Here, the applications of label-free autofluorophore assessment are reviewed for clinical and health-research applications, with specific attention to biomaterials, disease detection, surgical guidance, treatment monitoring, and tissue assessment - fields that greatly benefit from non-invasive methodologies capable of continuous, in vivo characterization.
Collapse
Affiliation(s)
- Jared M Campbell
- Australian Research Council Centre of Excellence for Nanoscale BioPhotonics, Graduate School of Biomedical Engineering, University of New South Wales, Sydney, NSW, 2033, Australia
| | | | - Adnan Agha
- Australian Research Council Centre of Excellence for Nanoscale BioPhotonics, Graduate School of Biomedical Engineering, University of New South Wales, Sydney, NSW, 2033, Australia
| | - Shannon Handley
- Australian Research Council Centre of Excellence for Nanoscale BioPhotonics, Graduate School of Biomedical Engineering, University of New South Wales, Sydney, NSW, 2033, Australia
| | - Aline Knab
- Australian Research Council Centre of Excellence for Nanoscale BioPhotonics, Graduate School of Biomedical Engineering, University of New South Wales, Sydney, NSW, 2033, Australia
| | - Ayad G Anwer
- Australian Research Council Centre of Excellence for Nanoscale BioPhotonics, Graduate School of Biomedical Engineering, University of New South Wales, Sydney, NSW, 2033, Australia
| | - Akanksha Bhargava
- Australian Research Council Centre of Excellence for Nanoscale BioPhotonics, Graduate School of Biomedical Engineering, University of New South Wales, Sydney, NSW, 2033, Australia
| | - Ewa M Goldys
- Australian Research Council Centre of Excellence for Nanoscale BioPhotonics, Graduate School of Biomedical Engineering, University of New South Wales, Sydney, NSW, 2033, Australia
| |
Collapse
|
2
|
Wang YP, Karmakar R, Mukundan A, Tsao YM, Sung TC, Lu CL, Wang HC. Spectrum aided vision enhancer enhances mucosal visualization by hyperspectral imaging in capsule endoscopy. Sci Rep 2024; 14:22243. [PMID: 39333620 PMCID: PMC11436966 DOI: 10.1038/s41598-024-73387-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/06/2024] [Accepted: 09/17/2024] [Indexed: 09/29/2024] Open
Abstract
Narrow-band imaging (NBI) is more efficient in detecting early gastrointestinal cancer than white light imaging (WLI). NBI technology is available only in conventional endoscopy, but unavailable in magnetic-assisted capsule endoscopy (MACE) systems due to MACE's small size and obstacles in image processing issues. MACE is an easy, safe, and convenient tool for both patients and physicians to avoid the disadvantages of conventional endoscopy. Enabling NBI technology in MACE is mandatory. We developed a novel method to improve mucosal visualization using hyperspectral imaging (HSI) known as Spectrum Aided Visual Enhancer (SAVE, Transfer N, Hitspectra Intelligent Technology Co., Kaohsiung, Taiwan). The technique was developed by converting the WLI image captured by MACE to enhance SAVE images. The structural similarity index metric (SSIM) between the WLI MACE images and the enhanced SAVE images was 91%, while the entropy difference between the WLI MACE images and the enhanced SAVE images was only 0.47%. SAVE algorithm can identify the mucosal break on the esophagogastric junction in patients with gastroesophageal reflux disorder. We successfully developed a novel image-enhancing technique, SAVE, in the MACE system, showing close similarity to the NBI from the conventional endoscopy system. The future application of this novel technology in the MACE system can be promising.
Collapse
Affiliation(s)
- Yen-Po Wang
- Endoscopy Center for Diagnosis and Treatment, Taipei Veterans General Hospital, No.201, Sec. 2, Shipai Rd., Beitou District, Taipei City, 11217, Taiwan
- Institute of Brain Sciences, National Yang Ming Chiao Tung University, 155, Li-Nong St., Sec.2, Peitou, Taipei City, 11217, Taiwan
| | - Riya Karmakar
- Department of Mechanical Engineering, National Chung Cheng University, 168, University Rd., Min Hsiung, Chia Yi, 62102, Taiwan
| | - Arvind Mukundan
- Department of Mechanical Engineering, National Chung Cheng University, 168, University Rd., Min Hsiung, Chia Yi, 62102, Taiwan
| | - Yu-Ming Tsao
- Department of Mechanical Engineering, National Chung Cheng University, 168, University Rd., Min Hsiung, Chia Yi, 62102, Taiwan
| | - Te-Chin Sung
- Insight Medical Solutions Inc., No. 1, Lixing 6th Rd., East Dist., Hsinchu City, 300096, Taiwan
| | - Ching-Liang Lu
- Endoscopy Center for Diagnosis and Treatment, Taipei Veterans General Hospital, No.201, Sec. 2, Shipai Rd., Beitou District, Taipei City, 11217, Taiwan.
- Institute of Brain Sciences, National Yang Ming Chiao Tung University, 155, Li-Nong St., Sec.2, Peitou, Taipei City, 11217, Taiwan.
| | - Hsiang-Chen Wang
- Department of Mechanical Engineering, National Chung Cheng University, 168, University Rd., Min Hsiung, Chia Yi, 62102, Taiwan.
- Department of Medical Research, Dalin Tzu Chi Hospital, Buddhist Tzu Chi Medical Foundation, No. 2, Minsheng Road, Dalin, Chiayi, 62247, Taiwan.
- Hitspectra Intelligent Technology Co., Ltd., 8F.11-1, No. 25, Chenggong 2nd Rd., Kaohsiung, 80661, Taiwan.
| |
Collapse
|
3
|
Campbell JM, Mahbub SB, Habibalahi A, Agha A, Handley S, Anwer AG, Goldys EM. Clinical applications of non-invasive multi and hyperspectral imaging of cell and tissue autofluorescence beyond oncology. JOURNAL OF BIOPHOTONICS 2023; 16:e202200264. [PMID: 36602432 DOI: 10.1002/jbio.202200264] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/23/2022] [Revised: 12/20/2022] [Accepted: 12/24/2022] [Indexed: 06/17/2023]
Abstract
Hyperspectral and multispectral imaging of cell and tissue autofluorescence employs fluorescence imaging, without exogenous fluorophores, across multiple excitation/emission combinations (spectral channels). This produces an image stack where each pixel (matched by location) contains unique information about the sample's spectral properties. Analysis of this data enables access to a rich, molecularly specific data set from a broad range of cell-native fluorophores (autofluorophores) directly reflective of biochemical status, without use of fixation or stains. This non-invasive, non-destructive technology has great potential to spare the collection of biopsies from sensitive regions. As both staining and biopsy may be impossible, or undesirable, depending on the context, this technology great diagnostic potential for clinical decision making. The main research focus has been on the identification of neoplastic tissues. However, advances have been made in diverse applications-including ophthalmology, cardiovascular health, neurology, infection, assisted reproduction technology and organ transplantation.
Collapse
Affiliation(s)
- Jared M Campbell
- Graduate School of Biomedical Engineering, University of New South Wales, Sydney, New South Wales, Australia
- Australian Research Council Centre of Excellence for Nanoscale BioPhotonics, Sydney, Australia
| | - Saabah B Mahbub
- Graduate School of Biomedical Engineering, University of New South Wales, Sydney, New South Wales, Australia
- Australian Research Council Centre of Excellence for Nanoscale BioPhotonics, Sydney, Australia
| | - Abbas Habibalahi
- Graduate School of Biomedical Engineering, University of New South Wales, Sydney, New South Wales, Australia
- Australian Research Council Centre of Excellence for Nanoscale BioPhotonics, Sydney, Australia
| | - Adnan Agha
- Graduate School of Biomedical Engineering, University of New South Wales, Sydney, New South Wales, Australia
- Australian Research Council Centre of Excellence for Nanoscale BioPhotonics, Sydney, Australia
| | - Shannon Handley
- Graduate School of Biomedical Engineering, University of New South Wales, Sydney, New South Wales, Australia
- Australian Research Council Centre of Excellence for Nanoscale BioPhotonics, Sydney, Australia
| | - Ayad G Anwer
- Graduate School of Biomedical Engineering, University of New South Wales, Sydney, New South Wales, Australia
- Australian Research Council Centre of Excellence for Nanoscale BioPhotonics, Sydney, Australia
| | - Ewa M Goldys
- Graduate School of Biomedical Engineering, University of New South Wales, Sydney, New South Wales, Australia
- Australian Research Council Centre of Excellence for Nanoscale BioPhotonics, Sydney, Australia
| |
Collapse
|
4
|
Wang C, Zhang R, Wei X, Wang L, Wu P, Yao Q. Deep learning and sub-band fluorescence imaging-based method for caries and calculus diagnosis embeddable on different smartphones. BIOMEDICAL OPTICS EXPRESS 2023; 14:866-882. [PMID: 36874478 PMCID: PMC9979668 DOI: 10.1364/boe.479818] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/04/2022] [Revised: 12/28/2022] [Accepted: 01/13/2023] [Indexed: 06/18/2023]
Abstract
Popularizing community and home early caries screening is essential for caries prevention and treatment. However, a high-precision, low-cost, and portable automated screening tool is currently lacking. This study constructed an automated diagnosis model for dental caries and calculus using fluorescence sub-band imaging combined with deep learning. The proposed method is divided into two stages: the first stage collects imaging information of dental caries in different fluorescence spectral bands and obtains six-channel fluorescence images. The second stage employs a 2-D-3-D hybrid convolutional neural network combined with the attention mechanism for classification and diagnosis. The experiments demonstrate that the method has competitive performance compared to existing methods. In addition, the feasibility of transferring this approach to different smartphones is discussed. This highly accurate, low-cost, portable method has potential applications in community and at-home caries detection.
Collapse
Affiliation(s)
- Cheng Wang
- Department of Optical Science and Engineering, Academy for Engineering and Technology, Fudan University, Shanghai 200433, China
- State Key Laboratory of Applied Optics, Changchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences, Changchun 130033, China
| | - Rongjun Zhang
- Department of Optical Science and Engineering, Academy for Engineering and Technology, Fudan University, Shanghai 200433, China
| | - Xiaoling Wei
- Department of Endodontics, Shanghai Stomatological Hospital, Shanghai Key Laboratory of Craniomaxillofacial Development and Diseases, Fudan University, Shanghai 200001, China
| | - Le Wang
- Department of Optical Science and Engineering, Academy for Engineering and Technology, Fudan University, Shanghai 200433, China
| | - Peiyu Wu
- Department of Optical Science and Engineering, Academy for Engineering and Technology, Fudan University, Shanghai 200433, China
- State Key Laboratory of Applied Optics, Changchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences, Changchun 130033, China
| | - Qi Yao
- Department of Optical Science and Engineering, Academy for Engineering and Technology, Fudan University, Shanghai 200433, China
- State Key Laboratory of Applied Optics, Changchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences, Changchun 130033, China
| |
Collapse
|
5
|
Machine learning-based automatic identification and diagnosis of dental caries and calculus using hyperspectral fluorescence imaging. Photodiagnosis Photodyn Ther 2022; 41:103217. [PMID: 36462702 DOI: 10.1016/j.pdpdt.2022.103217] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/08/2022] [Revised: 11/07/2022] [Accepted: 11/29/2022] [Indexed: 12/05/2022]
Abstract
PURPOSE Precise diagnosis and identification of early dental caries facilitates timely intervention and reverses the progression of the disease. Developing an objective, accurate and rapid caries and calculus automatic identification method advances clinical application and facilitates the promotion and screening of oral health in the community and family. METHODS In this study, based on 122 dental surfaces labeled by professional dentists, hyperspectral fluorescence imaging combined with machine learning algorithms was employed to construct a model for simultaneously diagnosing dental caries and calculus. Model trained by fusion features based on spectra, textures, and colors with the integrated learning algorithm has better performance and stronger generalization capabilities. RESULTS The experimental results showed that the diagnostic model's accuracy, sensitivity, and specificity for identifying four different caries stages and calculus were 98.6%, 98.4%, and 99.6%, respectively. CONCLUSIONS The proposed method can evaluate the whole tooth surface at the pixel level and provides discrimination enhancement and a quantitative parameter, which is expected to be a new approach for early caries diagnosis.
Collapse
|
6
|
Fluorescence spectrometry based chromaticity mapping, characterization, and quantitative assessment of dental caries. Photodiagnosis Photodyn Ther 2022; 37:102711. [PMID: 34986426 DOI: 10.1016/j.pdpdt.2021.102711] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/22/2021] [Revised: 12/29/2021] [Accepted: 12/30/2021] [Indexed: 10/19/2022]
Abstract
PURPOSE Dental caries detection, especially the accurate detection of early caries, facilitates prompt interventions. It is reasonably common to use fluorescence imaging for classification and evaluation of caries, but lacks a quantitative, precise and easy-to-use characterization for practical applications. In this study a quantitative approach for caries stage detection by correlating caries spectral and chromatic features was examined. METHODS A 405 nm LED light source was used as the excitation source. A hyperspectral imaging camera is employed to collect 336 spectral data of different caries stages. Four critical intervals for different stages of caries were extracted by fluorescence spectral features. The mapping relationship between caries spectral and chromatic features was established by Fast Formula Fitting (FFF) and Neural Network Fitting (NNF) methods. RESULTS The 470-780 nm spectral power distribution was proved to be the best matching color waveband guiding the selection of filters in future instrument development. The correlation coefficients for the two fitting methods were 0.990 and 0.999, respectively. Both methods achieved caries stage prediction at the pixel level with high accuracy using color information. The visualization region in the chromaticity diagram was created. CONCLUSIONS This quantitative method enables accurate prediction of caries on the entire tooth surface and facilitates the development of portable and low-cost caries detection instruments.
Collapse
|
7
|
Zhang B, Gao S, Jia F, Liu X, Li X. Categorization and authentication of Beijing‐you chicken from four breeds of chickens using near‐infrared hyperspectral imaging combined with chemometrics. J FOOD PROCESS ENG 2020. [DOI: 10.1111/jfpe.13553] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/27/2022]
Affiliation(s)
- Binhui Zhang
- College of Food Science and Nutritional Engineering, China Agricultural University Beijing China
| | - Song Gao
- College of Food Science and Nutritional Engineering, China Agricultural University Beijing China
| | - Fei Jia
- College of Food Science and Nutritional Engineering, China Agricultural University Beijing China
| | - Xue Liu
- College of Information and Electrical Engineering China Agricultural University Beijing China
| | - Xingmin Li
- College of Food Science and Nutritional Engineering, China Agricultural University Beijing China
| |
Collapse
|