4D dual-mode staring hyperspectral-depth imager for simultaneous spectral sensing and surface shape measurement

A 4D dual-mode staring hyperspectral-depth imager (DSHI), which acquire reflectance spectra, fluorescence spectra, and 3D structural information by combining a staring hyperspectral scanner and a binocular line laser stereo vision system, is introduced. A 405 nm laser line generated by a focal laser line generation module is used for both fluorescence excitation and binocular stereo matching of the irradiated line region. Under the configuration, the two kinds of hyperspectral data collected by the hyperspectral scanner can be merged into the corresponding points in the 3D model, forming a dual-mode 4D model. The DSHI shows excellent performance with spectral resolution of 3 nm, depth accuracy of 26.2 µm. Sample experiments on a fluorescent figurine, real and plastic sunflowers and a clam are presented to demonstrate system's with potential within a broad range of applications such as, e.g., digital documentation, plant phenotyping, and biological analysis.

Machine learning classification of origins and varieties of Tetrastigma hemsleyanum using a dual-mode microscopic hyperspectral imager

A dual-mode microscopic hyperspectral imager (DMHI) combined with a machine learning algorithm for the purpose of classifying origins and varieties of Tetrastigma hemsleyanum (T. hemsleyanum) was developed. By switching the illumination source, the DMHI can operate in reflection imaging and fluorescence detection modes. The DMHI system has excellent performance with spatial and spectral resolutions of 27.8 μm and 3 nm, respectively. To verify the capability of the DMHI system, a series of classification experiments of T. hemsleyanum were conducted. Captured hyperspectral datasets were analyzed using principal component analysis (PCA) for dimensional reduction, and a support vector machine (SVM) model was used for classification. In reflection microscopic hyperspectral imaging (RMHI) mode, the classification accuracies of T. hemsleyanum origins and varieties were 96.3% and 97.3%, respectively, while in fluorescence microscopic hyperspectral imaging (FMHI) mode, the classification accuracies were 97.3% and 100%, respectively. Combining datasets in dual mode, excellent predictions of origin and variety were realized by the trained model, both with a 97.5% accuracy on a newly measured test set. The results show that the DMHI system is capable of T. hemsleyanum origin and variety classification, and has the potential for non-invasive detection and rapid quality assessment of various kinds of medicinal herbs.

Confocal hyperspectral microscopic imager for the detection and classification of individual microalgae

We propose a confocal hyperspectral microscopic imager (CHMI) that can measure both transmission and fluorescent spectra of individual microalgae, as well as obtain classical transmission images and corresponding fluorescent hyperspectral images with a high signal-to-noise ratio. Thus, the system can realize precise identification, classification, and location of microalgae in a free or symbiosis state. The CHMI works in a staring state, with two imaging modes, a confocal fluorescence hyperspectral imaging (CFHI) mode and a transmission hyperspectral imaging (THI) mode. The imaging modes share the main light path, and thus obtained fluorescence and transmission hyperspectral images have point-to-point correspondence. In the CFHI mode, a confocal technology to eliminate image blurring caused by interference of axial points is included. The CHMI has excellent performance with spectral and spatial resolutions of 3 nm and 2 µm, respectively (using a 10× microscope objective magnification). To demonstrate the capacity and versatility of the CHMI, we report on demonstration experiments on four species of microalgae in free form as well as three species of jellyfish with symbiotic microalgae. In the microalgae species classification experiments, transmission and fluorescence spectra collected by the CHMI were preprocessed using principal component analysis (PCA), and a support vector machine (SVM) model or deep learning was then used for classification. The accuracy of the SVM model and deep learning method to distinguish one species of individual microalgae from another was found to be 96.25% and 98.34%, respectively. Also, the ability of the CHMI to analyze the concentration, species, and distribution differences of symbiotic microalgae in symbionts is furthermore demonstrated.

Inelastic hyperspectral Scheimpflug lidar for microalgae classification and quantification

An inelastic hyperspectral Scheimpflug lidar system was developed for microalgae classification and quantification. The correction for the refraction at the air-glass-water interface was established, making our system suitable for aquatic environments. The fluorescence spectrum of microalgae was extracted by principal component analysis, and seven species of microalgae from different phyla have been classified. It was verified that when the cell density of Phaeocystis globosa was in the range of ${{1}}{{{0}}^4}\sim{{1}}{{{0}}^6}\;{\rm{cell}}\;{\rm{m}}{{\rm{L}}^{- 1}}$, the cell density had a linear relationship with the fluorescence intensity. The experimental results show our system can identify and quantify microalgae, with application prospects for microalgae monitoring in the field environment and early warning of red tides or algal blooms.

4D surface shape measurement system with high spectral resolution and great depth accuracy

A 4D surface shape measurement system that combines spectral detection and 3D surface morphology measurements is proposed, which can realize high spectral resolution and great depth accuracy (HSDA system). A starring hyperspectral imager system based on a grating generates precise spectral data, while a structured light stereovision system reconstructs target morphology as a 3D point cloud. The systems are coupled using a double light path module, which realize point-to-point correspondence of the systems' image planes. The spectral and 3D coordinate data are fused and transformed into a 4D data set. The HSDA system has excellent performance with a spectral resolution of 3 nm and depth accuracy of 27.5 μm. A range of 4D imaging experiments are presented to demonstrate the capabilities and versatility of the HSDA system, which show that it can be used in broad range of application areas, such as fluorescence detection, face anti-spoofing, physical health state assessment and green plant growth condition monitoring.

Rotational hyperspectral scanner and related image reconstruction algorithm

We design and implement a compact and lightweight hyperspectral scanner. Based on this, a novel rotational hyperspectral scanner was demonstrated. Different from translational scanning, rotational scanning is a moveless and stable scanning method. We also designed a relevant image algorithm to reconstruct the image from an angular recorded hyperspectral data cube. The algorithm works well even with uncertain radial and tangential offset, which is caused by mechanical misalignment. The system shown a spectral resolution of 5 nm after calibration. Finally, spatial accuracy and spectral precision were discussed, based on some additional experiments.