1
|
Yusoh NA, Gill MR, Tian X. Advancing super-resolution microscopy with metal complexes: functional imaging agents for nanoscale visualization. Chem Soc Rev 2025; 54:3616-3646. [PMID: 39981712 DOI: 10.1039/d4cs01193g] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/22/2025]
Abstract
Super-resolution microscopy (SRM) has transformed biological imaging by overcoming the diffraction limit, offering nanoscale visualization of cellular structures and processes. However, the widespread use of organic fluorescent probes is often hindered by limitations such as photobleaching, short photostability, and inadequate performance in deep-tissue imaging. Metal complexes, with their superior photophysical properties, including exceptional photostability, tuneable luminescence, and extended excited-state lifetimes, address these challenges, enabling precise subcellular targeting and long-term imaging. Beyond imaging, their theranostic potential unlocks real-time diagnostics and treatments for diseases such as cancer and bacterial infections. This review explores recent advancements in applying metal complexes for SRM, focusing on their utility in visualizing intricate subcellular structures, capturing temporal dynamics in live cells and elucidating in vivo spatial organization. We emphasize how rational design strategies optimize biocompatibility, organelle specificity, and deep-tissue penetration, expanding their applicability in multiplexed imaging. Furthermore, we discuss the design of various metal nanoparticles (NPs) for SRM, along with emerging hybrid nanoscale probes that integrate metal complexes with gold (Au) scaffolds, offering promising avenues for overcoming current limitations. By highlighting both established successes and potential frontiers, this review provides a roadmap for leveraging metal complexes as versatile tools in advancing SRM applications.
Collapse
Affiliation(s)
- Nur Aininie Yusoh
- Department of Radiology, Huaxi MR Research Center (HMRRC), Institution of Radiology and Medical Imaging, West China Hospital of Sichuan University, Sichuan University, Chengdu, Sichuan, China.
| | - Martin R Gill
- Department of Chemistry, Faculty of Science and Engineering, Swansea University, Swansea, UK.
| | - Xiaohe Tian
- Department of Radiology, Huaxi MR Research Center (HMRRC), Institution of Radiology and Medical Imaging, West China Hospital of Sichuan University, Sichuan University, Chengdu, Sichuan, China.
| |
Collapse
|
2
|
Ward EN, Scheeder A, Barysevich M, Kaminski CF. Self-Driving Microscopes: AI Meets Super-Resolution Microscopy. SMALL METHODS 2025:e2401757. [PMID: 39797467 DOI: 10.1002/smtd.202401757] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/17/2024] [Revised: 12/01/2024] [Indexed: 01/13/2025]
Abstract
The integration of Machine Learning (ML) with super-resolution microscopy represents a transformative advancement in biomedical research. Recent advances in ML, particularly deep learning (DL), have significantly enhanced image processing tasks, such as denoising and reconstruction. This review explores the growing potential of automation in super-resolution microscopy, focusing on how DL can enable autonomous imaging tasks. Overcoming the challenges of automation, particularly in adapting to dynamic biological processes and minimizing manual intervention, is crucial for the future of microscopy. Whilst still in its infancy, automation in super-resolution can revolutionize drug discovery and disease phenotyping leading to similar breakthroughs as have been recognized in this year's Nobel Prizes for Physics and Chemistry.
Collapse
Affiliation(s)
- Edward N Ward
- Dept. Chemical Engineering and Biotechnology, University of Cambridge, Cambridge, CB3 0AS, UK
| | - Anna Scheeder
- Dept. Chemical Engineering and Biotechnology, University of Cambridge, Cambridge, CB3 0AS, UK
| | - Max Barysevich
- Dept. Chemical Engineering and Biotechnology, University of Cambridge, Cambridge, CB3 0AS, UK
| | - Clemens F Kaminski
- Dept. Chemical Engineering and Biotechnology, University of Cambridge, Cambridge, CB3 0AS, UK
| |
Collapse
|
3
|
Fan W, Qian G, Wang Y, Xu CR, Chen Z, Liu X, Li W, Liu X, Liu F, Xu X, Wang DW, Yakovlev V. Deep learning enhanced quantum holography with undetected photons. PHOTONIX 2024; 5:40. [PMID: 39711807 PMCID: PMC11655614 DOI: 10.1186/s43074-024-00155-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 09/26/2024] [Revised: 11/03/2024] [Accepted: 11/22/2024] [Indexed: 12/24/2024]
Abstract
Holography is an essential technique of generating three-dimensional images. Recently, quantum holography with undetected photons (QHUP) has emerged as a groundbreaking method capable of capturing complex amplitude images. Despite its potential, the practical application of QHUP has been limited by susceptibility to phase disturbances, low interference visibility, and limited spatial resolution. Deep learning, recognized for its ability in processing complex data, holds significant promise in addressing these challenges. In this report, we present an ample advancement in QHUP achieved by harnessing the power of deep learning to extract images from single-shot holograms, resulting in vastly reduced noise and distortion, alongside a notable enhancement in spatial resolution. The proposed and demonstrated deep learning QHUP (DL-QHUP) methodology offers a transformative solution by delivering high-speed imaging, improved spatial resolution, and superior noise resilience, making it suitable for diverse applications across an array of research fields stretching from biomedical imaging to remote sensing. DL-QHUP signifies a crucial leap forward in the realm of holography, demonstrating its immense potential to revolutionize imaging capabilities and pave the way for advancements in various scientific disciplines. The integration of DL-QHUP promises to unlock new possibilities in imaging applications, transcending existing limitations and offering unparalleled performance in challenging environments. Supplementary Information The online version contains supplementary material available at 10.1186/s43074-024-00155-2.
Collapse
Affiliation(s)
- Weiru Fan
- Zhejiang Province Key Laboratory of Quantum Technology and Device, School of Physics, and State Key Laboratory for Extreme Photonics and Instrumentation, Zhejiang University, Hangzhou, 310027 Zhejiang Province China
| | - Gewei Qian
- Zhejiang Province Key Laboratory of Quantum Technology and Device, School of Physics, and State Key Laboratory for Extreme Photonics and Instrumentation, Zhejiang University, Hangzhou, 310027 Zhejiang Province China
| | - Yutong Wang
- College of Information Science and Electronic Engineering, Zhejiang University, Hangzhou, 310027 Zhejiang Province China
| | - Chen-Ran Xu
- Zhejiang Province Key Laboratory of Quantum Technology and Device, School of Physics, and State Key Laboratory for Extreme Photonics and Instrumentation, Zhejiang University, Hangzhou, 310027 Zhejiang Province China
| | - Ziyang Chen
- College of Information Science and Engineering, Fujian Key Laboratory of Light Propagation and Transformation, Huaqiao University, Xiamen, 361021 Fujian Province China
| | - Xun Liu
- Beijing Institute of Space and Electricity, China Academy of Space Technology, Beijing, 100094 China
| | - Wei Li
- Beijing Institute of Space and Electricity, China Academy of Space Technology, Beijing, 100094 China
| | - Xu Liu
- College of Optical Science and Engineering, Zhejiang University, Hangzhou, 310027 Zhejiang Province China
| | - Feng Liu
- College of Information Science and Electronic Engineering, Zhejiang University, Hangzhou, 310027 Zhejiang Province China
| | - Xingqi Xu
- Zhejiang Province Key Laboratory of Quantum Technology and Device, School of Physics, and State Key Laboratory for Extreme Photonics and Instrumentation, Zhejiang University, Hangzhou, 310027 Zhejiang Province China
| | - Da-Wei Wang
- Zhejiang Province Key Laboratory of Quantum Technology and Device, School of Physics, and State Key Laboratory for Extreme Photonics and Instrumentation, Zhejiang University, Hangzhou, 310027 Zhejiang Province China
- College of Optical Science and Engineering, Zhejiang University, Hangzhou, 310027 Zhejiang Province China
- Hefei National Laboratory, Hefei, 230088 Anhui province China
| | - Vladislav V. Yakovlev
- Department of Biomedical Engineering, Texas A&M University, College Station, 77843 TX USA
| |
Collapse
|
4
|
Jang H, Wu S, Li Y, Li Z, Shi L. Metabolic nanoscopy enhanced by experimental and computational approaches. NPJ IMAGING 2024; 2:55. [PMID: 39677560 PMCID: PMC11638068 DOI: 10.1038/s44303-024-00062-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 08/18/2024] [Accepted: 12/02/2024] [Indexed: 12/17/2024]
Abstract
The advances in microscopy techniques have led to new findings in biology. The recent advances in super-resolution microscopy technologies revealed precise molecular distribution. The techniques to visualize the distributions of multiple molecules in biological samples from experimental techniques to computational approaches are reviewed. By summarizing the techniques, the future direction of collaborative research of the techniques is highlighted to show the nanoscopic chemical details of biological samples.
Collapse
Affiliation(s)
- Hongje Jang
- Shu Chien - Gene Lay Department of Bioengineering, University of California San Diego, La Jolla, CA USA
| | - Shuang Wu
- Shu Chien - Gene Lay Department of Bioengineering, University of California San Diego, La Jolla, CA USA
| | - Yajuan Li
- Shu Chien - Gene Lay Department of Bioengineering, University of California San Diego, La Jolla, CA USA
| | - Zhi Li
- Shu Chien - Gene Lay Department of Bioengineering, University of California San Diego, La Jolla, CA USA
| | - Lingyan Shi
- Shu Chien - Gene Lay Department of Bioengineering, University of California San Diego, La Jolla, CA USA
| |
Collapse
|
5
|
Bilodeau A, Michaud-Gagnon A, Chabbert J, Turcotte B, Heine J, Durand A, Lavoie-Cardinal F. Development of AI-assisted microscopy frameworks through realistic simulation with pySTED. NAT MACH INTELL 2024; 6:1197-1215. [PMID: 39440349 PMCID: PMC11491398 DOI: 10.1038/s42256-024-00903-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/25/2024] [Accepted: 08/20/2024] [Indexed: 10/25/2024]
Abstract
The integration of artificial intelligence into microscopy systems significantly enhances performance, optimizing both image acquisition and analysis phases. Development of artificial intelligence-assisted super-resolution microscopy is often limited by access to large biological datasets, as well as by difficulties to benchmark and compare approaches on heterogeneous samples. We demonstrate the benefits of a realistic stimulated emission depletion microscopy simulation platform, pySTED, for the development and deployment of artificial intelligence strategies for super-resolution microscopy. pySTED integrates theoretically and empirically validated models for photobleaching and point spread function generation in stimulated emission depletion microscopy, as well as simulating realistic point-scanning dynamics and using a deep learning model to replicate the underlying structures of real images. This simulation environment can be used for data augmentation to train deep neural networks, for the development of online optimization strategies and to train reinforcement learning models. Using pySTED as a training environment allows the reinforcement learning models to bridge the gap between simulation and reality, as showcased by its successful deployment on a real microscope system without fine tuning.
Collapse
Affiliation(s)
- Anthony Bilodeau
- CERVO Brain Research Center, Québec, Québec Canada
- Institute for Intelligence and Data, Québec, Québec Canada
| | - Albert Michaud-Gagnon
- CERVO Brain Research Center, Québec, Québec Canada
- Institute for Intelligence and Data, Québec, Québec Canada
| | | | - Benoit Turcotte
- CERVO Brain Research Center, Québec, Québec Canada
- Institute for Intelligence and Data, Québec, Québec Canada
| | - Jörn Heine
- Abberior Instruments GmbH, Göttingen, Germany
| | - Audrey Durand
- Institute for Intelligence and Data, Québec, Québec Canada
- Department of Computer Science and Software Engineering, Université Laval, Québec, Québec Canada
- Department of Electrical and Computer Engineering, Université Laval, Québec, Québec Canada
- Canada CIFAR AI Chair, Mila, Québec Canada
| | - Flavie Lavoie-Cardinal
- CERVO Brain Research Center, Québec, Québec Canada
- Institute for Intelligence and Data, Québec, Québec Canada
- Department of Psychiatry and Neuroscience, Université Laval, Québec, Québec Canada
| |
Collapse
|
6
|
Shroff H, Testa I, Jug F, Manley S. Live-cell imaging powered by computation. Nat Rev Mol Cell Biol 2024; 25:443-463. [PMID: 38378991 DOI: 10.1038/s41580-024-00702-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 01/10/2024] [Indexed: 02/22/2024]
Abstract
The proliferation of microscopy methods for live-cell imaging offers many new possibilities for users but can also be challenging to navigate. The prevailing challenge in live-cell fluorescence microscopy is capturing intra-cellular dynamics while preserving cell viability. Computational methods can help to address this challenge and are now shifting the boundaries of what is possible to capture in living systems. In this Review, we discuss these computational methods focusing on artificial intelligence-based approaches that can be layered on top of commonly used existing microscopies as well as hybrid methods that integrate computation and microscope hardware. We specifically discuss how computational approaches can improve the signal-to-noise ratio, spatial resolution, temporal resolution and multi-colour capacity of live-cell imaging.
Collapse
Affiliation(s)
- Hari Shroff
- Janelia Research Campus, Howard Hughes Medical Institute (HHMI), Ashburn, VA, USA
| | - Ilaria Testa
- Department of Applied Physics and Science for Life Laboratory, KTH Royal Institute of Technology, Stockholm, Sweden
| | - Florian Jug
- Fondazione Human Technopole (HT), Milan, Italy
| | - Suliana Manley
- Institute of Physics, School of Basic Sciences, Swiss Federal Institute of Technology Lausanne (EPFL), Lausanne, Switzerland.
| |
Collapse
|
7
|
Flynn CD, Chang D. Artificial Intelligence in Point-of-Care Biosensing: Challenges and Opportunities. Diagnostics (Basel) 2024; 14:1100. [PMID: 38893627 PMCID: PMC11172335 DOI: 10.3390/diagnostics14111100] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/05/2024] [Revised: 05/22/2024] [Accepted: 05/24/2024] [Indexed: 06/21/2024] Open
Abstract
The integration of artificial intelligence (AI) into point-of-care (POC) biosensing has the potential to revolutionize diagnostic methodologies by offering rapid, accurate, and accessible health assessment directly at the patient level. This review paper explores the transformative impact of AI technologies on POC biosensing, emphasizing recent computational advancements, ongoing challenges, and future prospects in the field. We provide an overview of core biosensing technologies and their use at the POC, highlighting ongoing issues and challenges that may be solved with AI. We follow with an overview of AI methodologies that can be applied to biosensing, including machine learning algorithms, neural networks, and data processing frameworks that facilitate real-time analytical decision-making. We explore the applications of AI at each stage of the biosensor development process, highlighting the diverse opportunities beyond simple data analysis procedures. We include a thorough analysis of outstanding challenges in the field of AI-assisted biosensing, focusing on the technical and ethical challenges regarding the widespread adoption of these technologies, such as data security, algorithmic bias, and regulatory compliance. Through this review, we aim to emphasize the role of AI in advancing POC biosensing and inform researchers, clinicians, and policymakers about the potential of these technologies in reshaping global healthcare landscapes.
Collapse
Affiliation(s)
- Connor D. Flynn
- Department of Chemistry, Weinberg College of Arts & Sciences, Northwestern University, Evanston, IL 60208, USA
| | - Dingran Chang
- Department of Biomedical Engineering, McCormick School of Engineering, Northwestern University, Evanston, IL 60208, USA
| |
Collapse
|
8
|
Doney E, Bernatchez R, Clavet-Fournier V, Dudek KA, Dion-Albert L, Lavoie-Cardinal F, Menard C. Characterizing the blood-brain barrier and gut barrier with super-resolution imaging: opportunities and challenges. NEUROPHOTONICS 2023; 10:044410. [PMID: 37799760 PMCID: PMC10548114 DOI: 10.1117/1.nph.10.4.044410] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 05/09/2023] [Revised: 09/21/2023] [Accepted: 09/25/2023] [Indexed: 10/07/2023]
Abstract
Brain and gut barriers have been receiving increasing attention in health and diseases including in psychiatry. Recent studies have highlighted changes in the blood-brain barrier and gut barrier structural properties, notably a loss of tight junctions, leading to hyperpermeability, passage of inflammatory mediators, stress vulnerability, and the development of depressive behaviors. To decipher the cellular processes actively contributing to brain and gut barrier function in health and disease, scientists can take advantage of neurophotonic tools and recent advances in super-resolution microscopy techniques to complement traditional imaging approaches like confocal and electron microscopy. Here, we summarize the challenges, pros, and cons of these innovative approaches, hoping that a growing number of scientists will integrate them in their study design exploring barrier-related properties and mechanisms.
Collapse
Affiliation(s)
- Ellen Doney
- Université Laval, Department of Psychiatry and Neuroscience, Faculty of Medicine, Quebec City, Québec, Canada
- CERVO Brain Research Center, Québec City, Québec, Canada
| | - Renaud Bernatchez
- CERVO Brain Research Center, Québec City, Québec, Canada
- Institute for Intelligence and Data, Québec City, Québec, Canada
| | | | - Katarzyna A. Dudek
- Université Laval, Department of Psychiatry and Neuroscience, Faculty of Medicine, Quebec City, Québec, Canada
- CERVO Brain Research Center, Québec City, Québec, Canada
| | - Laurence Dion-Albert
- Université Laval, Department of Psychiatry and Neuroscience, Faculty of Medicine, Quebec City, Québec, Canada
- CERVO Brain Research Center, Québec City, Québec, Canada
| | - Flavie Lavoie-Cardinal
- Université Laval, Department of Psychiatry and Neuroscience, Faculty of Medicine, Quebec City, Québec, Canada
- CERVO Brain Research Center, Québec City, Québec, Canada
- Institute for Intelligence and Data, Québec City, Québec, Canada
| | - Caroline Menard
- Université Laval, Department of Psychiatry and Neuroscience, Faculty of Medicine, Quebec City, Québec, Canada
- CERVO Brain Research Center, Québec City, Québec, Canada
| |
Collapse
|
9
|
Bouchard C, Wiesner T, Deschênes A, Bilodeau A, Turcotte B, Gagné C, Lavoie-Cardinal F. Resolution enhancement with a task-assisted GAN to guide optical nanoscopy image analysis and acquisition. NAT MACH INTELL 2023; 5:830-844. [PMID: 37615032 PMCID: PMC10442226 DOI: 10.1038/s42256-023-00689-3] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/10/2022] [Accepted: 06/12/2023] [Indexed: 08/25/2023]
Abstract
Super-resolution fluorescence microscopy methods enable the characterization of nanostructures in living and fixed biological tissues. However, they require the adjustment of multiple imaging parameters while attempting to satisfy conflicting objectives, such as maximizing spatial and temporal resolution while minimizing light exposure. To overcome the limitations imposed by these trade-offs, post-acquisition algorithmic approaches have been proposed for resolution enhancement and image-quality improvement. Here we introduce the task-assisted generative adversarial network (TA-GAN), which incorporates an auxiliary task (for example, segmentation, localization) closely related to the observed biological nanostructure characterization. We evaluate how the TA-GAN improves generative accuracy over unassisted methods, using images acquired with different modalities such as confocal, bright-field, stimulated emission depletion and structured illumination microscopy. The TA-GAN is incorporated directly into the acquisition pipeline of the microscope to predict the nanometric content of the field of view without requiring the acquisition of a super-resolved image. This information is used to automatically select the imaging modality and regions of interest, optimizing the acquisition sequence by reducing light exposure. Data-driven microscopy methods like the TA-GAN will enable the observation of dynamic molecular processes with spatial and temporal resolutions that surpass the limits currently imposed by the trade-offs constraining super-resolution microscopy.
Collapse
Affiliation(s)
- Catherine Bouchard
- Institute Intelligence and Data (IID), Université Laval, Quebec City, Quebec Canada
- CERVO Brain Research Center, Quebec City, Quebec Canada
| | - Theresa Wiesner
- Institute Intelligence and Data (IID), Université Laval, Quebec City, Quebec Canada
- CERVO Brain Research Center, Quebec City, Quebec Canada
| | | | - Anthony Bilodeau
- Institute Intelligence and Data (IID), Université Laval, Quebec City, Quebec Canada
- CERVO Brain Research Center, Quebec City, Quebec Canada
| | - Benoît Turcotte
- Institute Intelligence and Data (IID), Université Laval, Quebec City, Quebec Canada
- CERVO Brain Research Center, Quebec City, Quebec Canada
| | - Christian Gagné
- Institute Intelligence and Data (IID), Université Laval, Quebec City, Quebec Canada
- Département de génie électrique et de génie informatique, Université Laval, Quebec City, Quebec Canada
| | - Flavie Lavoie-Cardinal
- Institute Intelligence and Data (IID), Université Laval, Quebec City, Quebec Canada
- CERVO Brain Research Center, Quebec City, Quebec Canada
- Département de psychiatrie et de neurosciences, Université Laval, Quebec City, Quebec Canada
| |
Collapse
|
10
|
Sanders LM, Scott RT, Yang JH, Qutub AA, Garcia Martin H, Berrios DC, Hastings JJA, Rask J, Mackintosh G, Hoarfrost AL, Chalk S, Kalantari J, Khezeli K, Antonsen EL, Babdor J, Barker R, Baranzini SE, Beheshti A, Delgado-Aparicio GM, Glicksberg BS, Greene CS, Haendel M, Hamid AA, Heller P, Jamieson D, Jarvis KJ, Komarova SV, Komorowski M, Kothiyal P, Mahabal A, Manor U, Mason CE, Matar M, Mias GI, Miller J, Myers JG, Nelson C, Oribello J, Park SM, Parsons-Wingerter P, Prabhu RK, Reynolds RJ, Saravia-Butler A, Saria S, Sawyer A, Singh NK, Snyder M, Soboczenski F, Soman K, Theriot CA, Van Valen D, Venkateswaran K, Warren L, Worthey L, Zitnik M, Costes SV. Biological research and self-driving labs in deep space supported by artificial intelligence. NAT MACH INTELL 2023. [DOI: 10.1038/s42256-023-00618-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/28/2023]
|
11
|
Botifoll M, Pinto-Huguet I, Arbiol J. Machine learning in electron microscopy for advanced nanocharacterization: current developments, available tools and future outlook. NANOSCALE HORIZONS 2022; 7:1427-1477. [PMID: 36239693 DOI: 10.1039/d2nh00377e] [Citation(s) in RCA: 18] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/16/2023]
Abstract
In the last few years, electron microscopy has experienced a new methodological paradigm aimed to fix the bottlenecks and overcome the challenges of its analytical workflow. Machine learning and artificial intelligence are answering this call providing powerful resources towards automation, exploration, and development. In this review, we evaluate the state-of-the-art of machine learning applied to electron microscopy (and obliquely, to materials and nano-sciences). We start from the traditional imaging techniques to reach the newest higher-dimensionality ones, also covering the recent advances in spectroscopy and tomography. Additionally, the present review provides a practical guide for microscopists, and in general for material scientists, but not necessarily advanced machine learning practitioners, to straightforwardly apply the offered set of tools to their own research. To conclude, we explore the state-of-the-art of other disciplines with a broader experience in applying artificial intelligence methods to their research (e.g., high-energy physics, astronomy, Earth sciences, and even robotics, videogames, or marketing and finances), in order to narrow down the incoming future of electron microscopy, its challenges and outlook.
Collapse
Affiliation(s)
- Marc Botifoll
- Catalan Institute of Nanoscience and Nanotechnology (ICN2), CSIC and BIST, Campus UAB, Bellaterra, 08193 Barcelona, Catalonia, Spain.
| | - Ivan Pinto-Huguet
- Catalan Institute of Nanoscience and Nanotechnology (ICN2), CSIC and BIST, Campus UAB, Bellaterra, 08193 Barcelona, Catalonia, Spain.
| | - Jordi Arbiol
- Catalan Institute of Nanoscience and Nanotechnology (ICN2), CSIC and BIST, Campus UAB, Bellaterra, 08193 Barcelona, Catalonia, Spain.
- ICREA, Pg. Lluís Companys 23, 08010 Barcelona, Catalonia, Spain
| |
Collapse
|
12
|
Event-driven acquisition for content-enriched microscopy. Nat Methods 2022; 19:1262-1267. [PMID: 36076039 PMCID: PMC7613693 DOI: 10.1038/s41592-022-01589-x] [Citation(s) in RCA: 43] [Impact Index Per Article: 14.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/26/2021] [Accepted: 07/14/2022] [Indexed: 01/15/2023]
Abstract
A common goal of fluorescence microscopy is to collect data on specific biological events. Yet, the event-specific content that can be collected from a sample is limited, especially for rare or stochastic processes. This is due in part to photobleaching and phototoxicity, which constrain imaging speed and duration. We developed an event-driven acquisition framework, in which neural-network-based recognition of specific biological events triggers real-time control in an instant structured illumination microscope. Our setup adapts acquisitions on-the-fly by switching between a slow imaging rate while detecting the onset of events, and a fast imaging rate during their progression. Thus, we capture mitochondrial and bacterial divisions at imaging rates that match their dynamic timescales, while extending overall imaging durations. Because event-driven acquisition allows the microscope to respond specifically to complex biological events, it acquires data enriched in relevant content.
Collapse
|
13
|
Rickert CA, Lieleg O. Machine learning approaches for biomolecular, biophysical, and biomaterials research. BIOPHYSICS REVIEWS 2022; 3:021306. [PMID: 38505413 PMCID: PMC10914139 DOI: 10.1063/5.0082179] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/13/2021] [Accepted: 05/12/2022] [Indexed: 03/21/2024]
Abstract
A fluent conversation with a virtual assistant, person-tailored news feeds, and deep-fake images created within seconds-all those things that have been unthinkable for a long time are now a part of our everyday lives. What these examples have in common is that they are realized by different means of machine learning (ML), a technology that has fundamentally changed many aspects of the modern world. The possibility to process enormous amount of data in multi-hierarchical, digital constructs has paved the way not only for creating intelligent systems but also for obtaining surprising new insight into many scientific problems. However, in the different areas of biosciences, which typically rely heavily on the collection of time-consuming experimental data, applying ML methods is a bit more challenging: Here, difficulties can arise from small datasets and the inherent, broad variability, and complexity associated with studying biological objects and phenomena. In this Review, we give an overview of commonly used ML algorithms (which are often referred to as "machines") and learning strategies as well as their applications in different bio-disciplines such as molecular biology, drug development, biophysics, and biomaterials science. We highlight how selected research questions from those fields were successfully translated into machine readable formats, discuss typical problems that can arise in this context, and provide an overview of how to resolve those encountered difficulties.
Collapse
|
14
|
Dhiman S, Andrian T, Gonzalez BS, Tholen MME, Wang Y, Albertazzi L. Can super-resolution microscopy become a standard characterization technique for materials chemistry? Chem Sci 2022; 13:2152-2166. [PMID: 35310478 PMCID: PMC8864713 DOI: 10.1039/d1sc05506b] [Citation(s) in RCA: 21] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/06/2021] [Accepted: 12/01/2021] [Indexed: 12/20/2022] Open
Abstract
The characterization of newly synthesized materials is a cornerstone of all chemistry and nanotechnology laboratories. For this purpose, a wide array of analytical techniques have been standardized and are used routinely by laboratories across the globe. With these methods we can understand the structure, dynamics and function of novel molecular architectures and their relations with the desired performance, guiding the development of the next generation of materials. Moreover, one of the challenges in materials chemistry is the lack of reproducibility due to improper publishing of the sample preparation protocol. In this context, the recent adoption of the reporting standard MIRIBEL (Minimum Information Reporting in Bio-Nano Experimental Literature) for material characterization and details of experimental protocols aims to provide complete, reproducible and reliable sample preparation for the scientific community. Thus, MIRIBEL should be immediately adopted in publications by scientific journals to overcome this challenge. Besides current standard spectroscopy and microscopy techniques, there is a constant development of novel technologies that aim to help chemists unveil the structure of complex materials. Among them super-resolution microscopy (SRM), an optical technique that bypasses the diffraction limit of light, has facilitated the study of synthetic materials with multicolor ability and minimal invasiveness at nanometric resolution. Although still in its infancy, the potential of SRM to unveil the structure, dynamics and function of complex synthetic architectures has been highlighted in pioneering reports during the last few years. Currently, SRM is a sophisticated technique with many challenges in sample preparation, data analysis, environmental control and automation, and moreover the instrumentation is still expensive. Therefore, SRM is currently limited to expert users and is not implemented in characterization routines. This perspective discusses the potential of SRM to transition from a niche technique to a standard routine method for material characterization. We propose a roadmap for the necessary developments required for this purpose based on a collaborative effort from scientists and engineers across disciplines.
Collapse
Affiliation(s)
- Shikha Dhiman
- Laboratory of Macromolecular and Organic Chemistry, Eindhoven University of Technology P. O. Box 513 5600 MB Eindhoven The Netherlands
- Institute for Complex Molecular Systems, Eindhoven University of Technology P. O. Box 513 5600 MB Eindhoven The Netherlands
| | - Teodora Andrian
- Institute of Bioengineering of Catalonia (IBEC), Barcelona Institute of Science and Technology Barcelona Spain
| | - Beatriz Santiago Gonzalez
- Department of Biomedical Engineering, Institute of Complex Molecular Systems, Eindhoven University of Technology Eindhoven The Netherlands
| | - Marrit M E Tholen
- Department of Biomedical Engineering, Institute of Complex Molecular Systems, Eindhoven University of Technology Eindhoven The Netherlands
| | - Yuyang Wang
- Institute for Complex Molecular Systems, Eindhoven University of Technology P. O. Box 513 5600 MB Eindhoven The Netherlands
- Department of Applied Physics, Eindhoven University of Technology Postbus 513 5600 MB Eindhoven The Netherlands
| | - Lorenzo Albertazzi
- Institute of Bioengineering of Catalonia (IBEC), Barcelona Institute of Science and Technology Barcelona Spain
- Department of Biomedical Engineering, Institute of Complex Molecular Systems, Eindhoven University of Technology Eindhoven The Netherlands
| |
Collapse
|
15
|
Pursuit of precision medicine: Systems biology approaches in Alzheimer's disease mouse models. Neurobiol Dis 2021; 161:105558. [PMID: 34767943 PMCID: PMC10112395 DOI: 10.1016/j.nbd.2021.105558] [Citation(s) in RCA: 9] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/31/2021] [Revised: 11/05/2021] [Accepted: 11/08/2021] [Indexed: 12/12/2022] Open
Abstract
Alzheimer's disease (AD) is a complex disease that is mediated by numerous factors and manifests in various forms. A systems biology approach to studying AD involves analyses of various body systems, biological scales, environmental elements, and clinical outcomes to understand the genotype to phenotype relationship that potentially drives AD development. Currently, there are many research investigations probing how modifiable and nonmodifiable factors impact AD symptom presentation. This review specifically focuses on how imaging modalities can be integrated into systems biology approaches using model mouse populations to link brain level functional and structural changes to disease onset and progression. Combining imaging and omics data promotes the classification of AD into subtypes and paves the way for precision medicine solutions to prevent and treat AD.
Collapse
|
16
|
Saguy A, Jünger F, Peleg A, Ferdman B, Nehme E, Rohrbach A, Shechtman Y. Deep-ROCS: from speckle patterns to superior-resolved images by deep learning in rotating coherent scattering microscopy. OPTICS EXPRESS 2021; 29:23877-23887. [PMID: 34614644 DOI: 10.1364/oe.424730] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/10/2021] [Accepted: 07/02/2021] [Indexed: 06/13/2023]
Abstract
Rotating coherent scattering (ROCS) microscopy is a label-free imaging technique that overcomes the optical diffraction limit by adding up the scattered laser light from a sample obliquely illuminated from different angles. Although ROCS imaging achieves 150 nm spatial and 10 ms temporal resolution, simply summing different speckle patterns may cause loss of sample information. In this paper we present Deep-ROCS, a neural network-based technique that generates a superior-resolved image by efficient numerical combination of a set of differently illuminated images. We show that Deep-ROCS can reconstruct super-resolved images more accurately than conventional ROCS microscopy, retrieving high-frequency information from a small number (6) of speckle images. We demonstrate the performance of Deep-ROCS experimentally on 200 nm beads and by computer simulations, where we show its potential for even more complex structures such as a filament network.
Collapse
|
17
|
Liu Z, Jin L, Chen J, Fang Q, Ablameyko S, Yin Z, Xu Y. A survey on applications of deep learning in microscopy image analysis. Comput Biol Med 2021; 134:104523. [PMID: 34091383 DOI: 10.1016/j.compbiomed.2021.104523] [Citation(s) in RCA: 65] [Impact Index Per Article: 16.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/17/2021] [Revised: 05/13/2021] [Accepted: 05/17/2021] [Indexed: 01/12/2023]
Abstract
Advanced microscopy enables us to acquire quantities of time-lapse images to visualize the dynamic characteristics of tissues, cells or molecules. Microscopy images typically vary in signal-to-noise ratios and include a wealth of information which require multiple parameters and time-consuming iterative algorithms for processing. Precise analysis and statistical quantification are often needed for the understanding of the biological mechanisms underlying these dynamic image sequences, which has become a big challenge in the field. As deep learning technologies develop quickly, they have been applied in bioimage processing more and more frequently. Novel deep learning models based on convolution neural networks have been developed and illustrated to achieve inspiring outcomes. This review article introduces the applications of deep learning algorithms in microscopy image analysis, which include image classification, region segmentation, object tracking and super-resolution reconstruction. We also discuss the drawbacks of existing deep learning-based methods, especially on the challenges of training datasets acquisition and evaluation, and propose the potential solutions. Furthermore, the latest development of augmented intelligent microscopy that based on deep learning technology may lead to revolution in biomedical research.
Collapse
Affiliation(s)
- Zhichao Liu
- Department of Biomedical Engineering, MOE Key Laboratory of Biomedical Engineering, State Key Laboratory of Modern Optical Instrumentation, Zhejiang Provincial Key Laboratory of Cardio-Cerebral Vascular Detection Technology and Medicinal Effectiveness Appraisal, Zhejiang University, Hangzhou, 310027, China; Alibaba-Zhejiang University Joint Research Center of Future Digital Healthcare, Hangzhou, 310058, China
| | - Luhong Jin
- Department of Biomedical Engineering, MOE Key Laboratory of Biomedical Engineering, State Key Laboratory of Modern Optical Instrumentation, Zhejiang Provincial Key Laboratory of Cardio-Cerebral Vascular Detection Technology and Medicinal Effectiveness Appraisal, Zhejiang University, Hangzhou, 310027, China; Alibaba-Zhejiang University Joint Research Center of Future Digital Healthcare, Hangzhou, 310058, China
| | - Jincheng Chen
- Department of Biomedical Engineering, MOE Key Laboratory of Biomedical Engineering, State Key Laboratory of Modern Optical Instrumentation, Zhejiang Provincial Key Laboratory of Cardio-Cerebral Vascular Detection Technology and Medicinal Effectiveness Appraisal, Zhejiang University, Hangzhou, 310027, China; Alibaba-Zhejiang University Joint Research Center of Future Digital Healthcare, Hangzhou, 310058, China
| | - Qiuyu Fang
- Department of Biomedical Engineering, MOE Key Laboratory of Biomedical Engineering, State Key Laboratory of Modern Optical Instrumentation, Zhejiang Provincial Key Laboratory of Cardio-Cerebral Vascular Detection Technology and Medicinal Effectiveness Appraisal, Zhejiang University, Hangzhou, 310027, China
| | - Sergey Ablameyko
- National Academy of Sciences, United Institute of Informatics Problems, Belarusian State University, Minsk, 220012, Belarus
| | - Zhaozheng Yin
- AI Institute, Department of Biomedical Informatics and Department of Computer Science, Stony Brook University, Stony Brook, NY, 11794, USA
| | - Yingke Xu
- Department of Biomedical Engineering, MOE Key Laboratory of Biomedical Engineering, State Key Laboratory of Modern Optical Instrumentation, Zhejiang Provincial Key Laboratory of Cardio-Cerebral Vascular Detection Technology and Medicinal Effectiveness Appraisal, Zhejiang University, Hangzhou, 310027, China; Department of Endocrinology, The Affiliated Sir Run Run Shaw Hospital, Zhejiang University School of Medicine, Hangzhou, 310016, China; Alibaba-Zhejiang University Joint Research Center of Future Digital Healthcare, Hangzhou, 310058, China.
| |
Collapse
|
18
|
Hellmuth KH, Sammaljärvi J, Siitari-Kauppi M, Robinet JC, Sardini P. STED nanoscopy - A novel way to image the pore space of geological materials. J Microsc 2021; 283:151-165. [PMID: 33895997 DOI: 10.1111/jmi.13016] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/11/2020] [Revised: 04/19/2021] [Accepted: 04/20/2021] [Indexed: 11/30/2022]
Abstract
STED nanoscopy (Stimulated Emission Depletion). which can resolve details far below the diffraction barrier has been applied hitherto preferentially to life sciences. The method is however also ideal for the investigation of geological matrices containing transparent minerals, an application tested here, to our knowledge, for the first time. The measurements on altered granitic rock and sedimentary clay rock, both containing very fine-grained phases, were conducted successfully. The STED fluorophore was dissolved in C-14-labelled methylmethacrylate (C-14-MMA) monomer which was polymerised within the rock matrix, thereby labelling the pore space in the geomaterials. Double labelling provided by the C-14-labelled MMA enables autoradiography and scanning electron microscopy (SEM), providing necessary complementary information for characterisation and quantification of porosity distributions and mineral and structure identification. Promising perspectives for further investigations of geological matrices by using different fluorophores and the optimisation of measuring procedures or even higher resolution are discussed. The combination of these different methods enlarges the observation scale of porosity from nanometre to centimetre scale.
Collapse
Affiliation(s)
| | | | | | | | - Paul Sardini
- IC2MP UMR CNRS 7285, HYDRASA, University of Poitiers, Poitiers, France
| |
Collapse
|
19
|
Dankovich TM, Rizzoli SO. Challenges facing quantitative large-scale optical super-resolution, and some simple solutions. iScience 2021; 24:102134. [PMID: 33665555 PMCID: PMC7898072 DOI: 10.1016/j.isci.2021.102134] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/16/2022] Open
Abstract
Optical super-resolution microscopy (SRM) has enabled biologists to visualize cellular structures with near-molecular resolution, giving unprecedented access to details about the amounts, sizes, and spatial distributions of macromolecules in the cell. Precisely quantifying these molecular details requires large datasets of high-quality, reproducible SRM images. In this review, we discuss the unique set of challenges facing quantitative SRM, giving particular attention to the shortcomings of conventional specimen preparation techniques and the necessity for optimal labeling of molecular targets. We further discuss the obstacles to scaling SRM methods, such as lengthy image acquisition and complex SRM data analysis. For each of these challenges, we review the recent advances in the field that circumvent these pitfalls and provide practical advice to biologists for optimizing SRM experiments.
Collapse
Affiliation(s)
- Tal M. Dankovich
- University Medical Center Göttingen, Institute for Neuro- and Sensory Physiology, Göttingen 37073, Germany
- International Max Planck Research School for Neuroscience, Göttingen, Germany
| | - Silvio O. Rizzoli
- University Medical Center Göttingen, Institute for Neuro- and Sensory Physiology, Göttingen 37073, Germany
- Biostructural Imaging of Neurodegeneration (BIN) Center & Multiscale Bioimaging Excellence Center, Göttingen 37075, Germany
| |
Collapse
|
20
|
Han Y, Tang B, Wang L, Bao H, Lu Y, Guan C, Zhang L, Le M, Liu Z, Wu M. Machine-Learning-Driven Synthesis of Carbon Dots with Enhanced Quantum Yields. ACS NANO 2020; 14:14761-14768. [PMID: 32960048 DOI: 10.1021/acsnano.0c01899] [Citation(s) in RCA: 86] [Impact Index Per Article: 17.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/27/2023]
Abstract
Knowing the correlation of reaction parameters in the preparation process of carbon dots (CDs) is essential for optimizing the synthesis strategy, exploring exotic properties, and exploiting potential applications. However, the integrated screening experimental data on the synthesis of CDs are huge and noisy. Machine learning (ML) has recently been successfully used for the screening of high-performance materials. Here, we demonstrate how ML-based techniques can offer insight into the successful prediction, optimization, and acceleration of CDs' synthesis process. A regression ML model on hydrothermal-synthesized CDs is established capable of revealing the relationship between various synthesis parameters and experimental outcomes as well as enhancing the process-related properties such as the fluorescent quantum yield (QY). CDs exhibiting a strong green emission with QY up to 39.3% are obtained through the combined ML guidance and experimental verification. The mass of precursors and the volume of alkaline catalysts are identified as the most important features in the synthesis of high-QY CDs by the trained ML model. The CDs are applied as an ultrasensitive fluorescence probe for monitoring the Fe3+ ion because of their superior optical behaviors. The probe exhibits the linear response to the Fe3+ ion with a wide concentration range (0-150 μM), and its detection limit is 0.039 μM. Our findings demonstrate the great capability of ML to guide the synthesis of high-quality CDs, accelerating the development of intelligent material.
Collapse
Affiliation(s)
- Yu Han
- Institute of Nanochemistry and Nanobiology, School of Environmental and Chemical Engineering, Shanghai University, 99 Shangda Road, BaoShan District, Shanghai 200444, P.R. China
| | - Bijun Tang
- School of Materials Science and Engineering, Nanyang Technological University, 50 Nanyang Avenue, Singapore 639798, Singapore
| | - Liang Wang
- Institute of Nanochemistry and Nanobiology, School of Environmental and Chemical Engineering, Shanghai University, 99 Shangda Road, BaoShan District, Shanghai 200444, P.R. China
| | - Hong Bao
- Institute of Nanochemistry and Nanobiology, School of Environmental and Chemical Engineering, Shanghai University, 99 Shangda Road, BaoShan District, Shanghai 200444, P.R. China
| | - Yuhao Lu
- School of Computer Science and Engineering, Nanyang Technological University, 50 Nanyang Avenue, Singapore 639798, Singapore
| | - Cuntai Guan
- School of Computer Science and Engineering, Nanyang Technological University, 50 Nanyang Avenue, Singapore 639798, Singapore
| | - Liang Zhang
- Institute of Nanochemistry and Nanobiology, School of Environmental and Chemical Engineering, Shanghai University, 99 Shangda Road, BaoShan District, Shanghai 200444, P.R. China
| | - Mengying Le
- Institute of Nanochemistry and Nanobiology, School of Environmental and Chemical Engineering, Shanghai University, 99 Shangda Road, BaoShan District, Shanghai 200444, P.R. China
| | - Zheng Liu
- School of Materials Science and Engineering, Nanyang Technological University, 50 Nanyang Avenue, Singapore 639798, Singapore
| | - Minghong Wu
- Shanghai Applied Radiation Institute, Shanghai University, 333 Nanchen Road, BaoShan District, Shanghai 200444, P.R. China
| |
Collapse
|
21
|
Eisenstein M. Smart solutions for automated imaging. Nat Methods 2020. [PMID: 33077968 DOI: 10.15932/j.0253-9713.2020.11.008] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/24/2023]
|
22
|
|
23
|
Wiesner T, Bilodeau A, Bernatchez R, Deschênes A, Raulier B, De Koninck P, Lavoie-Cardinal F. Activity-Dependent Remodeling of Synaptic Protein Organization Revealed by High Throughput Analysis of STED Nanoscopy Images. Front Neural Circuits 2020; 14:57. [PMID: 33177994 PMCID: PMC7594516 DOI: 10.3389/fncir.2020.00057] [Citation(s) in RCA: 13] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/15/2020] [Accepted: 07/29/2020] [Indexed: 01/03/2023] Open
Abstract
The organization of proteins in the apposed nanodomains of pre- and postsynaptic compartments is thought to play a pivotal role in synaptic strength and plasticity. As such, the alignment between pre- and postsynaptic proteins may regulate, for example, the rate of presynaptic release or the strength of postsynaptic signaling. However, the analysis of these structures has mainly been restricted to subsets of synapses, providing a limited view of the diversity of synaptic protein cluster remodeling during synaptic plasticity. To characterize changes in the organization of synaptic nanodomains during synaptic plasticity over a large population of synapses, we combined STimulated Emission Depletion (STED) nanoscopy with a Python-based statistical object distance analysis (pySODA), in dissociated cultured hippocampal circuits exposed to treatments driving different forms of synaptic plasticity. The nanoscale organization, characterized in terms of coupling properties, of presynaptic (Bassoon, RIM1/2) and postsynaptic (PSD95, Homer1c) scaffold proteins was differently altered in response to plasticity-inducing stimuli. For the Bassoon - PSD95 pair, treatments driving synaptic potentiation caused an increase in their coupling probability, whereas a stimulus driving synaptic depression had an opposite effect. To enrich the characterization of the synaptic cluster remodeling at the population level, we applied unsupervised machine learning approaches to include selected morphological features into a multidimensional analysis. This combined analysis revealed a large diversity of synaptic protein cluster subtypes exhibiting differential activity-dependent remodeling, yet with common features depending on the expected direction of plasticity. The expanded palette of synaptic features revealed by our unbiased approach should provide a basis to further explore the widely diverse molecular mechanisms of synaptic plasticity.
Collapse
Affiliation(s)
| | | | | | | | | | - Paul De Koninck
- CERVO Brain Research Centre, Québec, QC, Canada.,Department of Biochemistry, Microbiology and Bioinformatics, Université Laval, Québec, QC, Canada
| | - Flavie Lavoie-Cardinal
- CERVO Brain Research Centre, Québec, QC, Canada.,Department of Psychiatry and Neuroscience, Université Laval, Québec, QC, Canada
| |
Collapse
|
24
|
Xue Y, Davison IG, Boas DA, Tian L. Single-shot 3D wide-field fluorescence imaging with a Computational Miniature Mesoscope. SCIENCE ADVANCES 2020; 6:eabb7508. [PMID: 33087364 PMCID: PMC7577725 DOI: 10.1126/sciadv.abb7508] [Citation(s) in RCA: 39] [Impact Index Per Article: 7.8] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/26/2020] [Accepted: 09/09/2020] [Indexed: 05/20/2023]
Abstract
Fluorescence microscopes are indispensable to biology and neuroscience. The need for recording in freely behaving animals has further driven the development in miniaturized microscopes (miniscopes). However, conventional microscopes/miniscopes are inherently constrained by their limited space-bandwidth product, shallow depth of field (DOF), and inability to resolve three-dimensional (3D) distributed emitters. Here, we present a Computational Miniature Mesoscope (CM2) that overcomes these bottlenecks and enables single-shot 3D imaging across an 8 mm by 7 mm field of view and 2.5-mm DOF, achieving 7-μm lateral resolution and better than 200-μm axial resolution. The CM2 features a compact lightweight design that integrates a microlens array for imaging and a light-emitting diode array for excitation. Its expanded imaging capability is enabled by computational imaging that augments the optics by algorithms. We experimentally validate the mesoscopic imaging capability on 3D fluorescent samples. We further quantify the effects of scattering and background fluorescence on phantom experiments.
Collapse
Affiliation(s)
- Yujia Xue
- Department of Electrical and Computer Engineering, Boston University, MA 02215, USA
| | - Ian G Davison
- Department of Biology, Boston University, MA 02215, USA
- Neurophotonics Center, Boston University, MA 02215, USA
| | - David A Boas
- Department of Electrical and Computer Engineering, Boston University, MA 02215, USA
- Neurophotonics Center, Boston University, MA 02215, USA
- Department of Biomedical Engineering, Boston University, MA 02215, USA
| | - Lei Tian
- Department of Electrical and Computer Engineering, Boston University, MA 02215, USA.
- Neurophotonics Center, Boston University, MA 02215, USA
| |
Collapse
|
25
|
Neuronal activity remodels the F-actin based submembrane lattice in dendrites but not axons of hippocampal neurons. Sci Rep 2020; 10:11960. [PMID: 32686703 PMCID: PMC7371643 DOI: 10.1038/s41598-020-68180-2] [Citation(s) in RCA: 26] [Impact Index Per Article: 5.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/20/2019] [Accepted: 06/17/2020] [Indexed: 12/29/2022] Open
Abstract
The nanoscale organization of the F-actin cytoskeleton in neurons comprises membrane-associated periodical rings, bundles, and longitudinal fibers. The F-actin rings have been observed predominantly in axons but only sporadically in dendrites, where fluorescence nanoscopy reveals various patterns of F-actin arranged in mixed patches. These complex dendritic F-actin patterns pose a challenge for investigating quantitatively their regulatory mechanisms. We developed here a weakly supervised deep learning segmentation approach of fluorescence nanoscopy images of F-actin in cultured hippocampal neurons. This approach enabled the quantitative assessment of F-actin remodeling, revealing the disappearance of the rings during neuronal activity in dendrites, but not in axons. The dendritic F-actin cytoskeleton of activated neurons remodeled into longitudinal fibers. We show that this activity-dependent remodeling involves \documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\text {Ca}^{2+}$$\end{document}Ca2+ and NMDA receptor-dependent mechanisms. This highly dynamic restructuring of dendritic F-actin based submembrane lattice into longitudinal fibers may serve to support activity-dependent membrane remodeling, protein trafficking and neuronal plasticity.
Collapse
|
26
|
Li M, Tian T, Zeng Y, Zhu S, Lu J, Yang J, Li C, Yin Y, Li G. Individual Cloud-Based Fingerprint Operation Platform for Latent Fingerprint Identification Using Perovskite Nanocrystals as Eikonogen. ACS APPLIED MATERIALS & INTERFACES 2020; 12:13494-13502. [PMID: 32093476 DOI: 10.1021/acsami.9b22251] [Citation(s) in RCA: 17] [Impact Index Per Article: 3.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/10/2023]
Abstract
Fingerprint formed through lifted papillary ridges is considered the best reference for personal identification. However, the currently available latent fingerprint (LFP) images often suffer from poor resolution, have a low degree of information, and require multifarious steps for identification. Herein, an individual Cloud-based fingerprint operation platform has been designed and fabricated to achieve high-definition LFPs analysis by using CsPbBr3 perovskite nanocrystals (NCs) as eikonogen. Moreover, since CsPbBr3 NCs have a special response to some fingerprint-associated amino acids, the proposed platform can be further used to detect metabolites on LFPs. Consequently, in virtue of Cloud computing and artificial intelligence (AI), this study has demonstrated a champion platform to realize the whole LFP identification analysis. In a double-blind simulative crime game, the enhanced LFP images can be easily obtained and used to lock the suspect accurately within one second on a smartphone, which can help investigators track the criminal clue and handle cases efficiently.
Collapse
Affiliation(s)
- Menglu Li
- State Key Laboratory of Pharmaceutical Biotechnology, School of Life Sciences, Nanjing University, Nanjing 210023, P. R. China
| | - Tian Tian
- State Key Laboratory of Pharmaceutical Biotechnology, School of Life Sciences, Nanjing University, Nanjing 210023, P. R. China
| | - Yujing Zeng
- State Key Laboratory of Pharmaceutical Biotechnology, School of Life Sciences, Nanjing University, Nanjing 210023, P. R. China
| | - Sha Zhu
- Department of Oncology, The First Affiliated Hospital of Nanjing Medical University, Nanjing 210029, P. R. China
| | - Jianyang Lu
- State Key Laboratory of Pharmaceutical Biotechnology, School of Life Sciences, Nanjing University, Nanjing 210023, P. R. China
| | - Jie Yang
- State Key Laboratory of Pharmaceutical Biotechnology, School of Life Sciences, Nanjing University, Nanjing 210023, P. R. China
| | - Chao Li
- School of Food and Biological Engineering, Hefei University of Technology, Hefei 230009, P. R. China
| | - Yongmei Yin
- Department of Oncology, The First Affiliated Hospital of Nanjing Medical University, Nanjing 210029, P. R. China
| | - Genxi Li
- State Key Laboratory of Pharmaceutical Biotechnology, School of Life Sciences, Nanjing University, Nanjing 210023, P. R. China
- Center for Molecular Recognition and Biosensing, School of Life Sciences, Shanghai University, Shanghai 200444, P. R. China
| |
Collapse
|
27
|
Lorenzo LE, Godin AG, Ferrini F, Bachand K, Plasencia-Fernandez I, Labrecque S, Girard AA, Boudreau D, Kianicka I, Gagnon M, Doyon N, Ribeiro-da-Silva A, De Koninck Y. Enhancing neuronal chloride extrusion rescues α2/α3 GABA A-mediated analgesia in neuropathic pain. Nat Commun 2020; 11:869. [PMID: 32054836 PMCID: PMC7018745 DOI: 10.1038/s41467-019-14154-6] [Citation(s) in RCA: 45] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/09/2018] [Accepted: 12/16/2019] [Indexed: 02/06/2023] Open
Abstract
Spinal disinhibition has been hypothesized to underlie pain hypersensitivity in neuropathic pain. Apparently contradictory mechanisms have been reported, raising questions on the best target to produce analgesia. Here, we show that nerve injury is associated with a reduction in the number of inhibitory synapses in the spinal dorsal horn. Paradoxically, this is accompanied by a BDNF-TrkB-mediated upregulation of synaptic GABAARs and by an α1-to-α2GABAAR subunit switch, providing a mechanistic rationale for the analgesic action of the α2,3GABAAR benzodiazepine-site ligand L838,417 after nerve injury. Yet, we demonstrate that impaired Cl- extrusion underlies the failure of L838,417 to induce analgesia at high doses due to a resulting collapse in Cl- gradient, dramatically limiting the benzodiazepine therapeutic window. In turn, enhancing KCC2 activity not only potentiated L838,417-induced analgesia, it rescued its analgesic potential at high doses, revealing a novel strategy for analgesia in pathological pain, by combined targeting of the appropriate GABAAR-subtypes and restoring Cl- homeostasis.
Collapse
Affiliation(s)
- Louis-Etienne Lorenzo
- CERVO Brain Research Centre, Quebec Mental Health Institute, Québec, QC, Canada
- Department of Pharmacology & Therapeutics, McGill University, Montreal, QC, Canada
| | - Antoine G Godin
- CERVO Brain Research Centre, Quebec Mental Health Institute, Québec, QC, Canada
- Department of Psychiatry & Neuroscience, Université Laval, Québec, QC, Canada
- Graduate program in Neuroscience, Université Laval, Québec, QC, Canada
| | - Francesco Ferrini
- CERVO Brain Research Centre, Quebec Mental Health Institute, Québec, QC, Canada
- Department of Psychiatry & Neuroscience, Université Laval, Québec, QC, Canada
- Graduate program in Neuroscience, Université Laval, Québec, QC, Canada
- Department of Veterinary Sciences, University of Turin, Turin, Italy
| | - Karine Bachand
- CERVO Brain Research Centre, Quebec Mental Health Institute, Québec, QC, Canada
| | - Isabel Plasencia-Fernandez
- CERVO Brain Research Centre, Quebec Mental Health Institute, Québec, QC, Canada
- Graduate program in Neuroscience, Université Laval, Québec, QC, Canada
| | - Simon Labrecque
- CERVO Brain Research Centre, Quebec Mental Health Institute, Québec, QC, Canada
| | - Alexandre A Girard
- CERVO Brain Research Centre, Quebec Mental Health Institute, Québec, QC, Canada
- Ecole Polytechnique, IP Paris, Palaiseau, France
| | - Dominic Boudreau
- CERVO Brain Research Centre, Quebec Mental Health Institute, Québec, QC, Canada
- Graduate program in Neuroscience, Université Laval, Québec, QC, Canada
| | - Irenej Kianicka
- Chlorion Pharma, Laval, Québec, QC, Canada
- Laurent Pharmaceuticals Inc., Montreal, QC, Canada
| | - Martin Gagnon
- CERVO Brain Research Centre, Quebec Mental Health Institute, Québec, QC, Canada
- Centre for Innovation, University of Otago, Dunedin, New Zealand
| | - Nicolas Doyon
- CERVO Brain Research Centre, Quebec Mental Health Institute, Québec, QC, Canada
- Finite Element Interdisciplinary Research Group (GIREF), Université Laval, Québec, QC, Canada
| | - Alfredo Ribeiro-da-Silva
- Department of Pharmacology & Therapeutics, McGill University, Montreal, QC, Canada
- Department of Anatomy & Cell Biology, McGill University, Montreal, QC, Canada
- Alan Edwards Centre for Research on Pain, McGill University, Montreal, QC, Canada
| | - Yves De Koninck
- CERVO Brain Research Centre, Quebec Mental Health Institute, Québec, QC, Canada.
- Department of Pharmacology & Therapeutics, McGill University, Montreal, QC, Canada.
- Department of Psychiatry & Neuroscience, Université Laval, Québec, QC, Canada.
- Graduate program in Neuroscience, Université Laval, Québec, QC, Canada.
- Alan Edwards Centre for Research on Pain, McGill University, Montreal, QC, Canada.
| |
Collapse
|
28
|
Nakamura I, Kanemura A, Nakaso T, Yamamoto R, Fukuhara T. Non-standard trajectories found by machine learning for evaporative cooling of 87Rb atoms. OPTICS EXPRESS 2019; 27:20435-20443. [PMID: 31510137 DOI: 10.1364/oe.27.020435] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/18/2019] [Accepted: 06/12/2019] [Indexed: 06/10/2023]
Abstract
We present a machine-learning experiment involving evaporative cooling of gaseous 87Rb atoms. The evaporation trajectory was optimized to maximize the number of atoms cooled down to a Bose-Einstein condensate using Bayesian optimization. After 300 trials within 3 hours, Bayesian optimization discovered trajectories that achieved atom numbers comparable with those of manual tuning by a human expert. Analysis of the machine-learned trajectories revealed minimum requirements for successful evaporative cooling. We found that the manually obtained curve and the machine-learned trajectories were quite similar in terms of evaporation efficiency, although the manual and machine-learned evaporation ramps were significantly different.
Collapse
|
29
|
Chasing Uptake: Super-Resolution Microscopy in Endocytosis and Phagocytosis. Trends Cell Biol 2019; 29:727-739. [PMID: 31227311 DOI: 10.1016/j.tcb.2019.05.006] [Citation(s) in RCA: 20] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/08/2019] [Revised: 05/14/2019] [Accepted: 05/23/2019] [Indexed: 11/21/2022]
Abstract
Since their invention about two decades ago, super-resolution microscopes have become a method of choice in cell biology. Owing to a spatial resolution below 50 nm, smaller than the size of most organelles, and an order of magnitude better than the diffraction limit of conventional light microscopes, super-resolution microscopy is a powerful technique for resolving intracellular trafficking. In this review we discuss discoveries in endocytosis and phagocytosis that have been made possible by super-resolution microscopy - from uptake at the plasma membrane, endocytic coat formation, and cytoskeletal rearrangements to endosomal maturation. The detailed visualization of the diverse molecular assemblies that mediate endocytic uptake will provide a better understanding of how cells ingest extracellular material.
Collapse
|