1
|
Mai C, Xie D, Zeng L, Li Z, Li Z, Qiao Z, Qu Y, Liu G, Li L. Laser Sensing and Vision Sensing Smart Blind Cane: A Review. Sensors (Basel) 2023; 23:s23020869. [PMID: 36679665 PMCID: PMC9864660 DOI: 10.3390/s23020869] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/16/2022] [Revised: 01/09/2023] [Accepted: 01/10/2023] [Indexed: 05/14/2023]
Abstract
Laser sensing and vision sensing smart canes can improve the convenience of travel for the visually impaired, but for the present, most of the system functions of laser sensing and vision sensing smart canes are still defective. Guide equipment and smart blind canes are introduced and classified first, and the smart blind canes based on vision sensing, laser sensing and laser vision sensing are investigated, respectively, and the research status of laser vision sensing smart blind canes is sorted out. The advantages and disadvantages of various laser vision sensing smart blind canes are summarized, especially the research development of laser vision fusion as the core of new smart canes. The future development prospects of laser vision sensing smart blind cane are overviewed, to boost the development of laser vision sensing smart blind cane, to provide safe and efficient travel guarantee for the visually impaired.
Collapse
Affiliation(s)
- Chunming Mai
- College of Physics and Eletronic Engineering, Hainan Normal University, Haikou 571158, China
| | - Dongliang Xie
- College of Physics and Eletronic Engineering, Hainan Normal University, Haikou 571158, China
| | - Lina Zeng
- College of Physics and Eletronic Engineering, Hainan Normal University, Haikou 571158, China
- Key Laboratory of Laser Technology and Optoelectronic Functional Materials of Hainan Province, Hainan Normal University, Haikou 571158, China
| | - Zaijin Li
- College of Physics and Eletronic Engineering, Hainan Normal University, Haikou 571158, China
- Key Laboratory of Laser Technology and Optoelectronic Functional Materials of Hainan Province, Hainan Normal University, Haikou 571158, China
| | - Zhibo Li
- College of Physics and Eletronic Engineering, Hainan Normal University, Haikou 571158, China
- Key Laboratory of Laser Technology and Optoelectronic Functional Materials of Hainan Province, Hainan Normal University, Haikou 571158, China
| | - Zhongliang Qiao
- College of Physics and Eletronic Engineering, Hainan Normal University, Haikou 571158, China
- Key Laboratory of Laser Technology and Optoelectronic Functional Materials of Hainan Province, Hainan Normal University, Haikou 571158, China
| | - Yi Qu
- College of Physics and Eletronic Engineering, Hainan Normal University, Haikou 571158, China
- Key Laboratory of Laser Technology and Optoelectronic Functional Materials of Hainan Province, Hainan Normal University, Haikou 571158, China
| | - Guojun Liu
- College of Physics and Eletronic Engineering, Hainan Normal University, Haikou 571158, China
- Key Laboratory of Laser Technology and Optoelectronic Functional Materials of Hainan Province, Hainan Normal University, Haikou 571158, China
| | - Lin Li
- College of Physics and Eletronic Engineering, Hainan Normal University, Haikou 571158, China
- Key Laboratory of Laser Technology and Optoelectronic Functional Materials of Hainan Province, Hainan Normal University, Haikou 571158, China
- Correspondence:
| |
Collapse
|
2
|
Siddiqui AA, Zabit U, Bernal OD. Fringe Detection and Displacement Sensing for Variable Optical Feedback-Based Self-Mixing Interferometry by Using Deep Neural Networks. Sensors (Basel) 2022; 22:9831. [PMID: 36560198 PMCID: PMC9785218 DOI: 10.3390/s22249831] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 10/12/2022] [Revised: 11/17/2022] [Accepted: 12/09/2022] [Indexed: 06/17/2023]
Abstract
Laser feedback-based self-mixing interferometry (SMI) is a promising technique for displacement sensing. However, commercial deployment of such sensors is being held back due to reduced performance in case of variable optical feedback which invariably happens due to optical speckle encountered when sensing the motion of non-cooperative remote target surfaces. In this work, deep neural networks have been trained under variable optical feedback conditions so that interferometric fringe detection and corresponding displacement measurement can be achieved. We have also proposed a method for automatic labelling of SMI fringes under variable optical feedback to facilitate the generation of a large training dataset. Specifically, we have trained two deep neural network models, namely Yolov5 and EfficientDet, and analysed the performance of these networks on various experimental SMI signals acquired by using different laser-diode-based sensors operating under different noise and speckle conditions. The performance has been quantified in terms of fringe detection accuracy, signal to noise ratio, depth of modulation, and execution time parameters. The impact of network architecture on real-time sensing is also discussed.
Collapse
Affiliation(s)
- Asra Abid Siddiqui
- School of Electrical Engineering and Computer Science, National University of Sciences and Technology (NUST), Islamabad 44000, Pakistan
| | - Usman Zabit
- School of Electrical Engineering and Computer Science, National University of Sciences and Technology (NUST), Islamabad 44000, Pakistan
| | - Olivier D. Bernal
- LAAS-CNRS, University of Toulouse, INP-ENSEEIHT, 31000 Toulouse, France
| |
Collapse
|
3
|
Abstract
Multi-spectral laser imaging is a technique that can offer a combination of the laser capability of accurate spectral sensing with the desirable features of passive multispectral imaging. The technique can be used for detection, discrimination, and identification of objects by their spectral signature. This article describes and reviews the development and evaluation of semiconductor multi-spectral laser imaging systems. Although the method is certainly not specific to any laser technology, the use of semiconductor lasers is significant with respect to practicality and affordability. More relevantly, semiconductor lasers have their own characteristics; they offer excellent wavelength diversity but usually with modest power. Thus, system design and engineering issues are analyzed for approaches and trade-offs that can make the best use of semiconductor laser capabilities in multispectral imaging. A few systems were developed and the technique was tested and evaluated on a variety of natural and man-made objects. It was shown capable of high spectral resolution imaging which, unlike non-imaging point sensing, allows detecting and discriminating objects of interest even without a priori spectroscopic knowledge of the targets. Examples include material and chemical discrimination. It was also shown capable of dealing with the complexity of interpreting diffuse scattered spectral images and produced results that could otherwise be ambiguous with conventional imaging. Examples with glucose and spectral imaging of drug pills were discussed. Lastly, the technique was shown with conventional laser spectroscopy such as wavelength modulation spectroscopy to image a gas (CO). These results suggest the versatility and power of multi-spectral laser imaging, which can be practical with the use of semiconductor lasers.
Collapse
Affiliation(s)
- Han Q. Le
- Photonic Device and System Lab, Department of Electrical and Computer Engineering, D2-N318, University of Houston, 4800 Calhoun, Houston, TX 77204-4005, USA
- Author to whom correspondence should be addressed; E-Mail: ; Tel.: +1-713-743-4465; Fax: +1-713-743-4444
| | - Yang Wang
- Photonic Device and System Lab, Department of Electrical and Computer Engineering, D2-N318, University of Houston, 4800 Calhoun, Houston, TX 77204-4005, USA
- Labsphere, Inc. 231 Shaker Street, North Sutton, NH 03260, USA; E-Mail:
| |
Collapse
|