Real-Time 3D Tracking of Multi-Particle in the Wide-Field Illumination Based on Deep Learning

In diverse realms of research, such as holographic optical tweezer mechanical measurements, colloidal particle motion state examinations, cell tracking, and drug delivery, the localization and analysis of particle motion command paramount significance. Algorithms ranging from conventional numerical methods to advanced deep-learning networks mark substantial strides in the sphere of particle orientation analysis. However, the need for datasets has hindered the application of deep learning in particle tracking. In this work, we elucidated an efficacious methodology pivoted toward generating synthetic datasets conducive to this domain that resonates with robustness and precision when applied to real-world data of tracking 3D particles. We developed a 3D real-time particle positioning network based on the CenterNet network. After conducting experiments, our network has achieved a horizontal positioning error of 0.0478 μm and a z-axis positioning error of 0.1990 μm. It shows the capability to handle real-time tracking of particles, diverse in dimensions, near the focal plane with high precision. In addition, we have rendered all datasets cultivated during this investigation accessible.

A Method for Detecting and Analyzing Facial Features of People with Drug Use Disorders

Drug use disorders caused by illicit drug use are significant contributors to the global burden of disease, and it is vital to conduct early detection of people with drug use disorders (PDUD). However, the primary care clinics and emergency departments lack simple and effective tools for screening PDUD. This study proposes a novel method to detect PDUD using facial images. Various experiments are designed to obtain the convolutional neural network (CNN) model by transfer learning based on a large-scale dataset (9870 images from PDUD and 19,567 images from GP (the general population)). Our results show that the model achieved 84.68%, 87.93%, and 83.01% in accuracy, sensitivity, and specificity in the dataset, respectively. To verify its effectiveness, the model is evaluated on external datasets based on real scenarios, and we found it still achieved high performance (accuracy > 83.69%, specificity > 90.10%, sensitivity > 80.00%). Our results also show differences between PDUD and GP in different facial areas. Compared with GP, the facial features of PDUD were mainly concentrated in the left cheek, right cheek, and nose areas (p < 0.001), which also reveals the potential relationship between mechanisms of drugs action and changes in facial tissues. This is the first study to apply the CNN model to screen PDUD in clinical practice and is also the first attempt to quantitatively analyze the facial features of PDUD. This model could be quickly integrated into the existing clinical workflow and medical care to provide capabilities.

Polishing entire stems and roots using sandpaper under water: An alternative method for macroscopic analyses

PREMISE

Polishing entire stem and root samples is an effective method for studying their anatomy; however, polishing fresh samples to preserve woods with soft tissues or barks is challenging given that soft tissues shrink when dried. We propose sanding fresh or liquid-preserved samples under water as an alternative, given that it preserves all tissues in an intact and clear state.

METHODS AND RESULTS

By manually grinding the surface of the samples under water using three ascending grits of waterproof sandpapers, an excellent polished sanded surface is obtained. The wood swarf goes into the water without clogging the cell lumina, rendering the surfaces adequate for cell visualization and description. We show results in palms, liana stems, roots, and wood blocks.

CONCLUSIONS

Using this simple, inexpensive, rapid technique, it is possible to polish either fresh, dry, or liquid-preserved woody plant samples, preserving the integrity of both the soft and hard tissues and allowing for detailed observations of the stems and roots.

Trace Identification and Visualization of Multiple Benzimidazole Pesticide Residues on Toona sinensis Leaves Using Terahertz Imaging Combined with Deep Learning

Molecular spectroscopy has been widely used to identify pesticides. The main limitation of this approach is the difficulty of identifying pesticides with similar molecular structures. When these pesticide residues are in trace and mixed states in plants, it poses great challenges for practical identification. This study proposed a state-of-the-art method for the rapid identification of trace (10 mg·L⁻¹) and multiple similar benzimidazole pesticide residues on the surface of Toona sinensis leaves, mainly including benzoyl (BNL), carbendazim (BCM), thiabendazole (TBZ), and their mixtures. The new method combines high-throughput terahertz (THz) imaging technology with a deep learning framework. To further improve the model reliability beyond the THz fingerprint peaks (BNL: 0.70, 1.07, 2.20 THz; BCM: 1.16, 1.35, 2.32 THz; TBZ: 0.92, 1.24, 1.66, 1.95, 2.58 THz), we extracted the absorption spectra in frequencies of 0.2–2.2 THz from images as the input to the deep convolution neural network (DCNN). Compared with fuzzy Sammon clustering and four back-propagation neural network (BPNN) models (TrainCGB, TrainCGF, TrainCGP, and TrainRP), DCNN achieved the highest prediction accuracies of 100%, 94.51%, 96.26%, 94.64%, 98.81%, 94.90%, 96.17%, and 96.99% for the control check group, BNL, BCM, TBZ, BNL + BCM, BNL + TBZ, BCM + TBZ, and BNL + BCM + TBZ, respectively. Taking advantage of THz imaging and DCNN, the image visualization of pesticide distribution and residue types on leaves was realized simultaneously. The results demonstrated that THz imaging and deep learning can be potentially adopted for rapid-sensing detection of trace multi-residues on leaf surfaces, which is of great significance for agriculture and food safety.

AI in Medical Imaging Informatics: Current Challenges and Future Directions

This paper reviews state-of-the-art research solutions across the spectrum of medical imaging informatics, discusses clinical translation, and provides future directions for advancing clinical practice. More specifically, it summarizes advances in medical imaging acquisition technologies for different modalities, highlighting the necessity for efficient medical data management strategies in the context of AI in big healthcare data analytics. It then provides a synopsis of contemporary and emerging algorithmic methods for disease classification and organ/ tissue segmentation, focusing on AI and deep learning architectures that have already become the de facto approach. The clinical benefits of in-silico modelling advances linked with evolving 3D reconstruction and visualization applications are further documented. Concluding, integrative analytics approaches driven by associate research branches highlighted in this study promise to revolutionize imaging informatics as known today across the healthcare continuum for both radiology and digital pathology applications. The latter, is projected to enable informed, more accurate diagnosis, timely prognosis, and effective treatment planning, underpinning precision medicine.

A dynamic model-based approach to motion and deformation tracking of prosthetic valves from biplane x-ray images

PURPOSE

Transcatheter aortic valve replacement (TAVR) is a minimally invasive procedure in which a prosthetic heart valve is placed and expanded within a defective aortic valve. The device placement is commonly performed using two-dimensional (2D) fluoroscopic imaging. Within this work, we propose a novel technique to track the motion and deformation of the prosthetic valve in three dimensions based on biplane fluoroscopic image sequences.

METHODS

The tracking approach uses a parameterized point cloud model of the valve stent which can undergo rigid three-dimensional (3D) transformation and different modes of expansion. Rigid elements of the model are individually rotated and translated in three dimensions to approximate the motions of the stent. Tracking is performed using an iterative 2D-3D registration procedure which estimates the model parameters by minimizing the mean-squared image values at the positions of the forward-projected model points. Additionally, an initialization technique is proposed, which locates clusters of salient features to determine the initial position and orientation of the model.

RESULTS

The proposed algorithms were evaluated based on simulations using a digital 4D CT phantom as well as experimentally acquired images of a prosthetic valve inside a chest phantom with anatomical background features. The target registration error was 0.12 ± 0.04 mm in the simulations and 0.64 ± 0.09 mm in the experimental data.

CONCLUSIONS

The proposed algorithm could be used to generate 3D visualization of the prosthetic valve from two projections. In combination with soft-tissue sensitive-imaging techniques like transesophageal echocardiography, this technique could enable 3D image guidance during TAVR procedures.

Synchrotron microCT imaging of soft tissue in juvenile zebrafish reveals retinotectal projections

Biomedical research and clinical diagnosis would benefit greatly from full volume determinations of anatomical phenotype. Comprehensive tools for morphological phenotyping are central for the emerging field of phenomics, which requires high-throughput, systematic, accurate, and reproducible data collection from organisms affected by genetic, disease, or environmental variables. Theoretically, complete anatomical phenotyping requires the assessment of every cell type in the whole organism, but this ideal is presently untenable due to the lack of an unbiased 3D imaging method that allows histopathological assessment of any cell type despite optical opacity. Histopathology, the current clinical standard for diagnostic phenotyping, involves the microscopic study of tissue sections to assess qualitative aspects of tissue architecture, disease mechanisms, and physiological state. However, quantitative features of tissue architecture such as cellular composition and cell counting in tissue volumes can only be approximated due to characteristics of tissue sectioning, including incomplete sampling and the constraints of 2D imaging of 5 micron thick tissue slabs. We have used a small, vertebrate organism, the zebrafish, to test the potential of microCT for systematic macroscopic and microscopic morphological phenotyping. While cell resolution is routinely achieved using methods such as light sheet fluorescence microscopy and optical tomography, these methods do not provide the pancellular perspective characteristic of histology, and are constrained by the limited penetration of visible light through pigmented and opaque specimens, as characterizes zebrafish juveniles. Here, we provide an example of neuroanatomy that can be studied by microCT of stained soft tissue at 1.43 micron isotropic voxel resolution. We conclude that synchrotron microCT is a form of 3D imaging that may potentially be adopted towards more reproducible, large-scale, morphological phenotyping of optically opaque tissues. Further development of soft tissue microCT, visualization and quantitative tools will enhance its utility.

Quantifying Modes of 3D Cell Migration

Although it is widely appreciated that cells migrate in a variety of diverse environments in vivo, we are only now beginning to use experimental workflows that yield images with sufficient spatiotemporal resolution to study the molecular processes governing cell migration in 3D environments. Since cell migration is a dynamic process, it is usually studied via microscopy, but 3D movies of 3D processes are difficult to interpret by visual inspection. In this review, we discuss the technologies required to study the diversity of 3D cell migration modes with a focus on the visualization and computational analysis tools needed to study cell migration quantitatively at a level comparable to the analyses performed today on cells crawling on flat substrates.

A survey of GPU-based medical image computing techniques

Medical imaging currently plays a crucial role throughout the entire clinical applications from medical scientific research to diagnostics and treatment planning. However, medical imaging procedures are often computationally demanding due to the large three-dimensional (3D) medical datasets to process in practical clinical applications. With the rapidly enhancing performances of graphics processors, improved programming support, and excellent price-to-performance ratio, the graphics processing unit (GPU) has emerged as a competitive parallel computing platform for computationally expensive and demanding tasks in a wide range of medical image applications. The major purpose of this survey is to provide a comprehensive reference source for the starters or researchers involved in GPU-based medical image processing. Within this survey, the continuous advancement of GPU computing is reviewed and the existing traditional applications in three areas of medical image processing, namely, segmentation, registration and visualization, are surveyed. The potential advantages and associated challenges of current GPU-based medical imaging are also discussed to inspire future applications in medicine.