1
|
Kaderuppan SS, Sharma A, Saifuddin MR, Wong WLE, Woo WL. Θ-Net: A Deep Neural Network Architecture for the Resolution Enhancement of Phase-Modulated Optical Micrographs In Silico. SENSORS (BASEL, SWITZERLAND) 2024; 24:6248. [PMID: 39409287 PMCID: PMC11478931 DOI: 10.3390/s24196248] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 08/30/2024] [Revised: 09/23/2024] [Accepted: 09/23/2024] [Indexed: 10/20/2024]
Abstract
Optical microscopy is widely regarded to be an indispensable tool in healthcare and manufacturing quality control processes, although its inability to resolve structures separated by a lateral distance under ~200 nm has culminated in the emergence of a new field named fluorescence nanoscopy, while this too is prone to several caveats (namely phototoxicity, interference caused by exogenous probes and cost). In this regard, we present a triplet string of concatenated O-Net ('bead') architectures (termed 'Θ-Net' in the present study) as a cost-efficient and non-invasive approach to enhancing the resolution of non-fluorescent phase-modulated optical microscopical images in silico. The quality of the afore-mentioned enhanced resolution (ER) images was compared with that obtained via other popular frameworks (such as ANNA-PALM, BSRGAN and 3D RCAN), with the Θ-Net-generated ER images depicting an increased level of detail (unlike previous DNNs). In addition, the use of cross-domain (transfer) learning to enhance the capabilities of models trained on differential interference contrast (DIC) datasets [where phasic variations are not as prominently manifested as amplitude/intensity differences in the individual pixels unlike phase-contrast microscopy (PCM)] has resulted in the Θ-Net-generated images closely approximating that of the expected (ground truth) images for both the DIC and PCM datasets. This thus demonstrates the viability of our current Θ-Net architecture in attaining highly resolved images under poor signal-to-noise ratios while eliminating the need for a priori PSF and OTF information, thereby potentially impacting several engineering fronts (particularly biomedical imaging and sensing, precision engineering and optical metrology).
Collapse
Affiliation(s)
- Shiraz S. Kaderuppan
- Faculty of Science, Agriculture & Engineering (SAgE), Newcastle University, Newcastle upon Tyne NE1 7RU, UK; (A.S.); (M.R.S.)
| | - Anurag Sharma
- Faculty of Science, Agriculture & Engineering (SAgE), Newcastle University, Newcastle upon Tyne NE1 7RU, UK; (A.S.); (M.R.S.)
| | - Muhammad Ramadan Saifuddin
- Faculty of Science, Agriculture & Engineering (SAgE), Newcastle University, Newcastle upon Tyne NE1 7RU, UK; (A.S.); (M.R.S.)
| | - Wai Leong Eugene Wong
- Engineering Cluster, Singapore Institute of Technology, 10 Dover Drive, Singapore 138683, Singapore;
| | - Wai Lok Woo
- Computer and Information Sciences, Sutherland Building, Northumbria University, Northumberland Road, Newcastle upon Tyne NE1 8ST, UK;
| |
Collapse
|
2
|
Sun C, Wang Y, Jin X, Ni B, Xu B, Hou JJ, Zhong C, Liu J, Wu Y, Song L, Hou L, Yi M, Liu X, Xiong J. Observing perineuronal nets like structures via coaxial scattering quantitative interference imaging at multiple wavelengths. OPTICS EXPRESS 2024; 32:18150-18160. [PMID: 38858978 DOI: 10.1364/oe.521510] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/12/2024] [Accepted: 04/02/2024] [Indexed: 06/12/2024]
Abstract
Perineuronal nets (PNNs) are important functional structures on the surface of nerve cells. Observation of PNNs usually requires dyeing or fluorescent labeling. As a network structure with a micron grid and sub-wavelength thickness but no special optical properties, quantitative phase imaging (QPI) is the only purely optical method for high-resolution imaging of PNNs. We proposed a Scattering Quantitative Interference Imaging (SQII) method which measures the geometric rather than transmission or reflection phase during the scattering process to visualize PNNs. Different from QIP methods, SQII method is sensitive to scattering and not affected by wavelength changes. Via geometric phase shifting method, we simplify the phase shift operation. The SQII method not only focuses on interference phase, but also on the interference contrast. The singularity points and phase lines of the scattering geometric phase depict the edges of the network structure and can be found at the valley area of the interference contrast parameter SINDR under different wavelengths. Our SQII method has its unique imaging properties, is very simple and easy to implement and has more worth for promotion.
Collapse
|
3
|
Wu D, Xie L, Han X, Zhou C, Bu Z, Liu S, Zhong L, Lu X. Convenient dual-wavelength digital holography based on orthogonal polarization strategy with a Wollaston prism. APPLIED OPTICS 2024; 63:B70-B75. [PMID: 38437257 DOI: 10.1364/ao.507354] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/02/2023] [Accepted: 12/02/2023] [Indexed: 03/06/2024]
Abstract
Dual-wavelength digital holography effectively expands the measurement range of digital holography, but it increases the complexity of optical system due to non-common-path of two wavelengths. Here, by using orthogonal polarization strategy, we present a dual-wavelength digital holography based on a Wollaston prism (DWDH-WP) to separate the reference beams of two wavelengths and realize the common-path of two wavelengths. A Wollaston prism is inset into the reference beam path of the off-axis digital holography system, so two orthogonal-polarized reference beams of two different wavelengths separated at different directions are generated. Then a dual-wavelength multiplexed interferogram with orthogonal interference fringes is captured by using a monochrome camera, in which both the polarization orientations and the interference fringe orientations of two wavelengths are orthogonal, so the spectral crosstalk of two wavelengths with arbitrary wavelength difference can be avoided. Compared with the existing DWDH method, the proposed DWDH-WP method can conveniently realize the common-path of the reference beams of two wavelengths, so it reveals obvious advantages in spectral separation, spectral crosstalk, system simplification, and adjustment flexibility. Both effectiveness and flexibility of the proposed DWDH-WP method are demonstrated by the phase measurement of the HeLa cell and vortex phase plate.
Collapse
|
4
|
Liu Y, Wu X, Kang Q, Gao J, Jiao M, Xing J, Wang X, Li H. Speckle suppression in holographic phase fringe patterns with different level noises based on FFDNet. APPLIED OPTICS 2024; 63:77-84. [PMID: 38175011 DOI: 10.1364/ao.502343] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/09/2023] [Accepted: 11/27/2023] [Indexed: 01/05/2024]
Abstract
In this paper, an ANLVENet speckle suppression method in holographic phase fringe patterns with different level noises is proposed based on FFDNet, combined with asymmetric pyramid non-local block with a verge extraction module. The experimental results are compared to three network models and several representative algorithms. It is shown that the ANLVENet method not only has better superiority in the speckle suppression with different noise levels, but also preserves more details of the image edge. In addition, another speckle noise model is applied in the phase fringe patterns to prove the stronger generalization of the ANLVENet algorithm. The proposed method is suitable for suppressing the speckle with different levels in a large noise range under complex environmental conditions.
Collapse
|
5
|
Kim JH, Jang SH, Kim YJ. Photolithographic patterning on multi-wavelength quantum dot film of the improved conversion efficiency for digital holography. OPTICS EXPRESS 2023; 31:34667-34676. [PMID: 37859217 DOI: 10.1364/oe.498121] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/19/2023] [Accepted: 09/22/2023] [Indexed: 10/21/2023]
Abstract
A triple-wavelength patterned quantum dot film was fabricated for the light source of digital holography to improve both the axial measurement range and noise reduction. The patterned quantum dot film was fabricated after optimizing the photolithography process condition based on the UV-curable quantum dot solution, which was capable of multiple patterning processes. In addition, an optimized pattern structure was developed by adding TiO2 nanoparticles to both the quantum dot and bank layers to increase the scattering effect for the improved photoluminescence intensity. Finally, the newly developed light source with the balanced spectral distribution was applied to the digital holography, rendering it applicable as an improved light source.
Collapse
|
6
|
Liu W, Tao S, Cheng F, Yang Z, Wang W, Kong M. Phase compensation algorithm based on image segmentation in dual-wavelength holographic microscopy. APPLIED OPTICS 2023; 62:5815-5821. [PMID: 37707201 DOI: 10.1364/ao.485295] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/07/2023] [Accepted: 06/14/2023] [Indexed: 09/15/2023]
Abstract
In order to solve the problem of phase compensation errors in the traditional 2π phase compensation method caused by a rough surface and complex structure of objects in dual-wavelength digital holographic microscopy, a phase compensation algorithm based on image segmentation was proposed. First, the phase less than zero in the phase obtained by an equivalent wavelength is compensated for by adding 2π initially. Then the phase after the initial compensation is binarized, and the small connected areas in the binarized graph are removed, so as to obtain a new binarized graph. Finally, according to the two binarized graphs, the phase of the object after the initial 2π phase compensation is recompensated for in different regions, so as to obtain the continuous phase distribution of the object. Based on the dual-wavelength digital holographic microscopy experimental system with an adjustable equivalent wavelength, the proposed algorithm is used to perform three-dimensional imaging of the channel of the microfluidic chip. The experimental results show that the proposed method can effectively obtain the continuous real phase of the object when the structure of the object is known, so as to obtain a more accurate and reliable three-dimensional topography of the object. The above results provide a new idea for the high-quality three-dimensional imaging of the microfluidic system.
Collapse
|
7
|
Ebrahimi S, Moreno-Pescador G, Persson S, Jauffred L, Bendix PM. Label-free optical interferometric microscopy to characterize morphodynamics in living plants. FRONTIERS IN PLANT SCIENCE 2023; 14:1156478. [PMID: 37284726 PMCID: PMC10239806 DOI: 10.3389/fpls.2023.1156478] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 02/01/2023] [Accepted: 04/04/2023] [Indexed: 06/08/2023]
Abstract
During the last century, fluorescence microscopy has played a pivotal role in a range of scientific discoveries. The success of fluorescence microscopy has prevailed despite several shortcomings like measurement time, photobleaching, temporal resolution, and specific sample preparation. To bypass these obstacles, label-free interferometric methods have been developed. Interferometry exploits the full wavefront information of laser light after interaction with biological material to yield interference patterns that contain information about structure and activity. Here, we review recent studies in interferometric imaging of plant cells and tissues, using techniques such as biospeckle imaging, optical coherence tomography, and digital holography. These methods enable quantification of cell morphology and dynamic intracellular measurements over extended periods of time. Recent investigations have showcased the potential of interferometric techniques for precise identification of seed viability and germination, plant diseases, plant growth and cell texture, intracellular activity and cytoplasmic transport. We envision that further developments of these label-free approaches, will allow for high-resolution, dynamic imaging of plants and their organelles, ranging in scales from sub-cellular to tissue and from milliseconds to hours.
Collapse
Affiliation(s)
- Samira Ebrahimi
- Copenhagen Plant Science Center, Department of Plant and Environmental Sciences, University of Copenhagen, Frederiksberg, Denmark
- Biocomplexity, Niels Bohr Institute, University of Copenhagen, Copenhagen, Denmark
| | - Guillermo Moreno-Pescador
- Copenhagen Plant Science Center, Department of Plant and Environmental Sciences, University of Copenhagen, Frederiksberg, Denmark
- Biocomplexity, Niels Bohr Institute, University of Copenhagen, Copenhagen, Denmark
| | - Staffan Persson
- Copenhagen Plant Science Center, Department of Plant and Environmental Sciences, University of Copenhagen, Frederiksberg, Denmark
- Joint International Research Laboratory of Metabolic and Developmental Sciences, State Key Laboratory of Hybrid Rice, School of Life Sciences and Biotechnology, Shanghai Jiao Tong University, Shanghai, China
| | - Liselotte Jauffred
- Biocomplexity, Niels Bohr Institute, University of Copenhagen, Copenhagen, Denmark
| | - Poul Martin Bendix
- Biocomplexity, Niels Bohr Institute, University of Copenhagen, Copenhagen, Denmark
| |
Collapse
|
8
|
Munera N, Trujillo C, Garcia-Sucerquia J. High-speed measurement of mechanical micro-deformations with an extended phase range using dual-wavelength digital holographic interferometry. APPLIED OPTICS 2022; 61:B279-B286. [PMID: 35201150 DOI: 10.1364/ao.443857] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/21/2021] [Accepted: 12/12/2021] [Indexed: 06/14/2023]
Abstract
The implementation of a digital holographic interferometry setup for high-speed micro-deformation measurement is presented. This proposal uses a dual-wavelength recording strategy to reconstruct micro-deformations up to 4.85 µm with no phase wrapping. The numerical processing required to recover the phase maps containing the information of micro-deformations is carried out in a general-purpose computing on graphics processing unit environment to boost its performance. The method completely processes recorded holograms of 1024×1024pixels in 48 ms, i.e., 21 frames per second (FPS) for a single-wavelength acquisition and 96 ms or 11 FPS for dual-wavelength recordings. The method is experimentally evaluated measuring deformations ranging from 0.033 µm to 4.85 µm with no need for phase unwrapping algorithms for an 8 cm diameter aluminum plate in a 110cm2 field of view.
Collapse
|
9
|
Jang SH, Kim KB, Jung J, Kim YJ. Enhancement of image sharpness and height measurement using a low-speckle light source based on a patterned quantum dot film in dual-wavelength digital holography. OPTICS EXPRESS 2021; 29:34220-34228. [PMID: 34809217 DOI: 10.1364/oe.440158] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/11/2021] [Accepted: 09/24/2021] [Indexed: 06/13/2023]
Abstract
A dual-wavelength single light source based on a patterned quantum dot (QD) film was developed with a 405nm LED and bandpass filters to increase color conversion efficiency as well as to decouple the two peaks of dual-wavelength emitted from the QD film. A QD film was patterned laterally with two different sizes of QDs and was combined with bandpass filters to produce a high efficiency and low-speckle dual-wavelength light source. The experimental results showed that the developed dual-wavelength light source can decrease speckle noise to improve the reconstructed image sharpness and the accuracy on height measurement in dual-wavelength digital holography.
Collapse
|