1
|
Kiarashi Y, Saghafi S, Das B, Hegde C, Madala VSK, Nakum A, Singh R, Tweedy R, Doiron M, Rodriguez AD, Levey AI, Clifford GD, Kwon H. Graph Trilateration for Indoor Localization in Sparsely Distributed Edge Computing Devices in Complex Environments Using Bluetooth Technology. SENSORS (BASEL, SWITZERLAND) 2023; 23:9517. [PMID: 38067890 PMCID: PMC10708633 DOI: 10.3390/s23239517] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 10/09/2023] [Revised: 11/16/2023] [Accepted: 11/17/2023] [Indexed: 12/18/2023]
Abstract
Spatial navigation patterns in indoor space usage can reveal important cues about the cognitive health of participants. In this work, we present a low-cost, scalable, open-source edge computing system using Bluetooth low energy (BLE) beacons for tracking indoor movements in a large, 1700 m2 facility used to carry out therapeutic activities for participants with mild cognitive impairment (MCI). The facility is instrumented with 39 edge computing systems, along with an on-premise fog server. The participants carry a BLE beacon, in which BLE signals are received and analyzed by the edge computing systems. Edge computing systems are sparsely distributed in the wide, complex indoor space, challenging the standard trilateration technique for localizing subjects, which assumes a dense installation of BLE beacons. We propose a graph trilateration approach that considers the temporal density of hits from the BLE beacon to surrounding edge devices to handle the inconsistent coverage of edge devices. This proposed method helps us tackle the varying signal strength, which leads to intermittent detection of beacons. The proposed method can pinpoint the positions of multiple participants with an average error of 4.4 m and over 85% accuracy in region-level localization across the entire study area. Our experimental results, evaluated in a clinical environment, suggest that an ordinary medical facility can be transformed into a smart space that enables automatic assessment of individuals' movements, which may reflect health status or response to treatment.
Collapse
Affiliation(s)
- Yashar Kiarashi
- Department of Biomedical Informatics, School of Medicine, Emory University, Atlanta, GA 30322, USA; (Y.K.); (S.S.); (H.K.)
| | - Soheil Saghafi
- Department of Biomedical Informatics, School of Medicine, Emory University, Atlanta, GA 30322, USA; (Y.K.); (S.S.); (H.K.)
| | - Barun Das
- Department of Biomedical Informatics, School of Medicine, Emory University, Atlanta, GA 30322, USA; (Y.K.); (S.S.); (H.K.)
| | - Chaitra Hegde
- School of Electrical and Computer Engineering, Georgia Institute of Technology, Atlanta, GA 30332, USA
| | | | - ArjunSinh Nakum
- School of Electrical and Computer Engineering, Georgia Institute of Technology, Atlanta, GA 30332, USA
| | - Ratan Singh
- School of Electrical and Computer Engineering, Georgia Institute of Technology, Atlanta, GA 30332, USA
| | - Robert Tweedy
- Department of Biomedical Informatics, School of Medicine, Emory University, Atlanta, GA 30322, USA; (Y.K.); (S.S.); (H.K.)
| | - Matthew Doiron
- Department of Neurology, School of Medicine, Emory University, Atlanta, GA 30322, USA (A.D.R.); (A.I.L.)
| | - Amy D. Rodriguez
- Department of Neurology, School of Medicine, Emory University, Atlanta, GA 30322, USA (A.D.R.); (A.I.L.)
| | - Allan I. Levey
- Department of Neurology, School of Medicine, Emory University, Atlanta, GA 30322, USA (A.D.R.); (A.I.L.)
| | - Gari D. Clifford
- Department of Biomedical Informatics, School of Medicine, Emory University, Atlanta, GA 30322, USA; (Y.K.); (S.S.); (H.K.)
- Department of Biomedical Engineering, Georgia Institute of Technology and Emory University, Atlanta, GA 30322, USA
| | - Hyeokhyen Kwon
- Department of Biomedical Informatics, School of Medicine, Emory University, Atlanta, GA 30322, USA; (Y.K.); (S.S.); (H.K.)
| |
Collapse
|
2
|
Gao F, Ma J. Indoor Location Technology with High Accuracy Using Simple Visual Tags. SENSORS (BASEL, SWITZERLAND) 2023; 23:1597. [PMID: 36772637 PMCID: PMC9921903 DOI: 10.3390/s23031597] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 01/02/2023] [Revised: 01/19/2023] [Accepted: 01/30/2023] [Indexed: 06/18/2023]
Abstract
To achieve low-cost and robustness, an indoor location system using simple visual tags is designed by comprehensively considering accuracy and computation complexity. Only the color and shape features are used for tag detection, by which both algorithm complexity and data storage requirement are reduced. To manage the nonunique problem caused by the simple tag features, a fast query and matching method is further presented by using the view field of the camera and the tag azimuth. Then, based on the relationship analysis between the spatial distribution of tags and location error, a pose and position estimation method using the weighted least square algorithm is designed and works together with the interactive algorithm by the designed switching strategy. By using the techniques presented, a favorable balance is achieved between the algorithm complexity and the location accuracy. The simulation and experiment results show that the proposed method can manage the singular problem of the overdetermined equations effectively and attenuate the negative effect of unfavorable label groups. Compared with the ultrawide band technology, the location error is reduced by more than 62%.
Collapse
Affiliation(s)
- Feng Gao
- Correspondence: ; Tel.: +86-189-9618-8196
| | | |
Collapse
|
3
|
Avellaneda D, Mendez D, Fortino G. A TinyML Deep Learning Approach for Indoor Tracking of Assets. SENSORS (BASEL, SWITZERLAND) 2023; 23:1542. [PMID: 36772582 PMCID: PMC9921810 DOI: 10.3390/s23031542] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 01/06/2023] [Revised: 01/19/2023] [Accepted: 01/24/2023] [Indexed: 06/18/2023]
Abstract
Positioning systems have gained paramount importance for many different productive sector; however, traditional systems such as Global Positioning System (GPS) have failed to offer accurate and scalable solutions for indoor positioning requirements. Nowadays, alternative solutions such as fingerprinting allow the recognition of the characteristic signature of a location based on RF signal acquisition. In this work, a machine learning (ML) approach has been considered in order to classify the RSSI information acquired by multiple scanning stations from TAG broadcasting messages. TinyML has been considered for this project, as it is a rapidly growing technological paradigm that aims to assist the design and implementation of ML mechanisms in resource-constrained embedded devices. Hence, this paper presents the design, implementation, and deployment of embedded devices capable of communicating and sending information to a central system that determines the location of objects in a defined environment. A neural network (deep learning) is trained and deployed on the edge, allowing the multiple external error factors that affect the accuracy of traditional position estimation algorithms to be considered. Edge Impulse is selected as the main platform for data standardization, pre-processing, model training, evaluation, and deployment. The final deployed system is capable of classifying real data from the installed TAGs, achieving a classification accuracy of 88%, which can be increased to 94% when a post-processing stage is implemented.
Collapse
Affiliation(s)
- Diego Avellaneda
- School of Engineering, Electronics Engineering Department, Pontificia Universidad Javeriana, Bogotá 110231, Colombia
| | - Diego Mendez
- School of Engineering, Electronics Engineering Department, Pontificia Universidad Javeriana, Bogotá 110231, Colombia
| | - Giancarlo Fortino
- Department of Informatics, Modeling, Electronics and Systems, University of Calabria, 87036 Rende, Italy
| |
Collapse
|
4
|
Applications of Nondominated Sorting Genetic Algorithm II Combined with WKNN Online Matching Algorithm in Building Indoor Optimization Design. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE 2022; 2022:7509659. [PMID: 35222634 PMCID: PMC8865983 DOI: 10.1155/2022/7509659] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/20/2021] [Accepted: 01/26/2022] [Indexed: 11/17/2022]
Abstract
The present work aims to improve the comfort of architectural interior design and reduce indoor energy consumption. The Weight K-Nearest Neighborhood (WKNN) algorithm and Nondominated Sorting Genetic algorithm are proposed to locate and analyze the spatial location of indoor personnel and optimize the indoor energy consumption in combination with residential behavior. Firstly, the indoor human behavior data and energy-saving problems are analyzed based on residential behavior theory and architectural physics. The indoor positioning algorithm is proposed to identify the personnel activities to realize the optimization of indoor energy distribution. Secondly, mean filtering and cluster analysis are adopted to optimize sampling points' data and fingerprint database to eliminate data noise. Besides, the WKNN algorithm is used for Wireless Fidelity (Wi-Fi) indoor location fingerprint location. Then, aiming at the multiobjective optimization problem of building indoor energy consumption, the Nondominated Sorting Genetic algorithm obtains the optimal solution of the model. Combined with the indoor location information of personnel, the indoor heating and cooling system is monitored and distributed to reduce the energy consumption in the building while ensuring the living comfort of personnel. The test and simulation results demonstrate that the mean filtering algorithm can solve the room's fluctuation problem of Wi-Fi signals. The cluster analysis algorithm can eliminate the data noise of the fingerprint database and improve the positioning accuracy of the positioning algorithm. Moreover, the location result is independent of the number of nodes; the number of sampling points does not affect the location result. The positioning accuracy of the WKNN algorithm is 2 m, and the positioning error rate within 2 m is about 60%. Compared with other algorithms, the WKNN algorithm has better positioning accuracy and positioning stability. Therefore, the location algorithm designed here can be applied to indoor location optimization. This study provides a reference for optimizing buildings' indoor positioning and energy consumption.
Collapse
|
5
|
Fu W, Zhang H, Huang F. Internet-based supply chain financing-oriented risk assessment using BP neural network and SVM. PLoS One 2022; 17:e0262222. [PMID: 35061798 PMCID: PMC8782329 DOI: 10.1371/journal.pone.0262222] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/15/2021] [Accepted: 12/19/2021] [Indexed: 11/19/2022] Open
Abstract
To better prevent the potential risks in Internet-based Supply Chain Financing (SCF) products, this paper optimizes and evaluates the Internet-based SCF-oriented Credit Risk Evaluation (CRE) method. Firstly, this paper summarizes 12 risk factors of SCF business, establishes a Risk Assessment Index System (RAIS) with good consistency and stability; then, the principles of Backpropagation (BP) Neural Network (NN) is expounded together with Support Vector Machines (SVM) and Genetic Algorithm (GA) model. Consequently, a CRE model is implemented by the NN tools in MATLAB based on the collection of multiple groups of SCF-oriented risk assessment samples. Subsequently, the assessment samples are trained and tested. Finally, the SCF-oriented CRE model is proposed and verified. The results show that the BP-GA model has presented high prediction consistency with the actual classification. According to the comparison of classification results of SVM, BP model, and BP-GA model, the classification accuracy of test samples of the proposed Internet-based SCF-oriented CRE system using BP-GA model reaches 97.19%; the Type I and Type II error rate of the CRE system based on BP-GA model is 7.2% and 14.21%, respectively. Therefore, a suitable SCF-oriented CRE method is put forward for China's commercial banks along with scientific and feasible suggestions to manage SCF-oriented credit risks more reasonably and effectively.
Collapse
Affiliation(s)
- Weiqiong Fu
- School of Economics and Management, Huizhou University, Huizhou, China
| | - Hanxiao Zhang
- School of Accounting, Guangzhou Huashang College, Guangzhou, China
| | - Fu Huang
- School of Economics and Management, Huizhou University, Huizhou, China
| |
Collapse
|
6
|
Indoor Positioning Algorithm Based on Reconstructed Observation Model and Particle Filter. ISPRS INTERNATIONAL JOURNAL OF GEO-INFORMATION 2022. [DOI: 10.3390/ijgi11010071] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
In a complex indoor environment, wireless signals are affected by multiple factors such as reflection, scattering or diffuse reflection of electromagnetic waves from indoor walls and other objects, and the signal strength will fluctuate significantly. For the signal strength and the distance between the unknown nodes and the known nodes are a typical nonlinear estimation problem, and the unknown nodes cannot receive all Access Points (APs) signal strength data, this paper proposes a Particle Filter (PF) indoor position algorithm based on the Kernel Extreme Learning Machine (KELM) reconstruction observation model. Firstly, on the basis of establishing a fingerprint database of wireless signal strength and unknown node position, we use KELM to convert the fingerprint location problem into a machine learning problem and establish the mapping relationship between the location of the unknown node and the wireless signal strength, thereby refocusing construct an observation model of the indoor positioning system. Secondly, according to the measured values obtained by KELM, PF algorithm is adopted to obtain the predicted value of the unknown nodes. Thirdly, the predicted value is fused with the measured value obtained by KELM to locate the position of the unknown nodes. Moreover, a novel control strategy is proposed by introducing a reception factor to deal with the situation that unknown nodes in the system cannot receive all of the AP data, i.e., data loss occurs. This indoor positioning experimental results show that the accuracy of the method is significantly improved contrasted with commonly used PF, GP-PF and other positioning algorithms.
Collapse
|
7
|
Outdoor Localization Using BLE RSSI and Accessible Pedestrian Signals for the Visually Impaired at Intersections. SENSORS 2022; 22:s22010371. [PMID: 35009910 PMCID: PMC8749544 DOI: 10.3390/s22010371] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 11/17/2021] [Revised: 12/16/2021] [Accepted: 12/28/2021] [Indexed: 11/17/2022]
Abstract
One of the major challenges for blind and visually impaired (BVI) people is traveling safely to cross intersections on foot. Many countries are now generating audible signals at crossings for visually impaired people to help with this problem. However, these accessible pedestrian signals can result in confusion for visually impaired people as they do not know which signal must be interpreted for traveling multiple crosses in complex road architecture. To solve this problem, we propose an assistive system called CAS (Crossing Assistance System) which extends the principle of the BLE (Bluetooth Low Energy) RSSI (Received Signal Strength Indicator) signal for outdoor and indoor location tracking and overcomes the intrinsic limitation of outdoor noise to enable us to locate the user effectively. We installed the system on a real-world intersection and collected a set of data for demonstrating the feasibility of outdoor RSSI tracking in a series of two studies. In the first study, our goal was to show the feasibility of using outdoor RSSI on the localization of four zones. We used a k-nearest neighbors (kNN) method and showed it led to 99.8% accuracy. In the second study, we extended our work to a more complex setup with nine zones, evaluated both the kNN and an additional method, a Support Vector Machine (SVM) with various RSSI features for classification. We found that the SVM performed best using the RSSI average, standard deviation, median, interquartile range (IQR) of the RSSI over a 5 s window. The best method can localize people with 97.7% accuracy. We conclude this paper by discussing how our system can impact navigation for BVI users in outdoor and indoor setups and what are the implications of these findings on the design of both wearable and traffic assistive technology for blind pedestrian navigation.
Collapse
|
8
|
Fingerprint Feature Extraction for Indoor Localization. SENSORS 2021; 21:s21165434. [PMID: 34450876 PMCID: PMC8399203 DOI: 10.3390/s21165434] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 07/12/2021] [Revised: 08/08/2021] [Accepted: 08/09/2021] [Indexed: 01/20/2023]
Abstract
This paper proposes a fingerprint-based indoor localization method, named FPFE (fingerprint feature extraction), to locate a target device (TD) whose location is unknown. Bluetooth low energy (BLE) beacon nodes (BNs) are deployed in the localization area to emit beacon packets periodically. The received signal strength indication (RSSI) values of beacon packets sent by various BNs are measured at different reference points (RPs) and saved as RPs’ fingerprints in a database. For the purpose of localization, the TD also obtains its fingerprint by measuring the beacon packet RSSI values for various BNs. FPFE then applies either the autoencoder (AE) or principal component analysis (PCA) to extract fingerprint features. It then measures the similarity between the features of PRs and the TD with the Minkowski distance. Afterwards, k RPs associated with the k smallest Minkowski distances are selected to estimate the TD’s location. Experiments are conducted to evaluate the localization error of FPFE. The experimental results show that FPFE achieves an average error of 0.68 m, which is better than those of other related BLE fingerprint-based indoor localization methods.
Collapse
|
9
|
Hatem E, Fortes S, Colin E, Abou-Chakra S, Laheurte JM, El-Hassan B. Accurate and Low-Complexity Auto-Fingerprinting for Enhanced Reliability of Indoor Localization Systems. SENSORS 2021; 21:s21165346. [PMID: 34450788 PMCID: PMC8400805 DOI: 10.3390/s21165346] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 07/05/2021] [Revised: 08/02/2021] [Accepted: 08/06/2021] [Indexed: 02/05/2023]
Abstract
Indoor localization is one of the most important topics in wireless navigation systems. The large number of applications that rely on indoor positioning makes advancements in this field important. Fingerprinting is a popular technique that is widely adopted and induces many important localization approaches. Recently, fingerprinting based on mobile robots has received increasing attention. This work focuses on presenting a simple, cost-effective and accurate auto-fingerprinting method for an indoor localization system based on Radio Frequency Identification (RFID) technology and using a two-wheeled robot. With this objective, an assessment of the robot’s navigation is performed in order to investigate its displacement errors and elaborate the required corrections. The latter are integrated in our proposed localization system, which is divided into two stages. From there, the auto-fingerprinting method is implemented while modeling the tag-reader link by the Dual One Slope with Second Order propagation Model (DOSSOM) for environmental calibration, within the offline stage. During the online stage, the robot’s position is estimated by applying DOSSOM followed by multilateration. Experimental localization results show that the proposed method provides a positioning error of 1.22 m at the cumulative distribution function of 90%, while operating with only four RFID active tags and an architecture with reduced complexity.
Collapse
Affiliation(s)
- Elias Hatem
- School of Engineering, EFREI Paris, 94800 Villejuif, France;
- Faculty of Technology, Lebanese University, Aabey 1501, Lebanon;
- Faculty of Engineering, Lebanese University, Tripoli 1300, Lebanon;
- Electronics, Communication Systems and Microsystems Laboratory (ESYCOM), Université Gustave Eiffel, 77420 Champs-sur-Marne, France;
- Correspondence:
| | - Sergio Fortes
- Instituto de Telecomunicación (TELMA), Universidad de Málaga, CEI Andalucía TECH, E.T.S. Ingeniería de Telecomunicación, Bulevar Louis Pasteur 35, 29010 Málaga, Spain;
| | - Elizabeth Colin
- School of Engineering, EFREI Paris, 94800 Villejuif, France;
| | - Sara Abou-Chakra
- Faculty of Technology, Lebanese University, Aabey 1501, Lebanon;
| | - Jean-Marc Laheurte
- Electronics, Communication Systems and Microsystems Laboratory (ESYCOM), Université Gustave Eiffel, 77420 Champs-sur-Marne, France;
| | - Bachar El-Hassan
- Faculty of Engineering, Lebanese University, Tripoli 1300, Lebanon;
| |
Collapse
|
10
|
A Rapid and High-Precision Mountain Vertex Extraction Method Based on Hotspot Analysis Clustering and Improved Eight-Connected Extraction Algorithms for Digital Elevation Models. REMOTE SENSING 2020. [DOI: 10.3390/rs13010081] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
Digital Elevation Model (DEM)-based mountain vertex extraction is one of the most useful DEM applications, providing important information to properly characterize topographic features. Current vertex-extraction techniques have considerable limitations, such as yielding low-accuracy results and generating false mountain vertices. To overcome these limitations, a new approach is proposed that combines Hotspot Analysis Clustering and the Improved Eight-Connected Extraction algorithms that would quickly and accurately provide the location and elevation of mountain vertices. The use of the elevation-based Hotspot Analysis Clustering Algorithm allows the fast partitioning of the mountain vertex area, which significantly reduces data and considerably improves the efficiency of mountain vertex extraction. The algorithm also minimizes false mountain vertices, which can be problematic in valleys, ridges, and other rugged terrains. The Eight-Connected Extraction Algorithm also hastens the precise determination of vertex location and elevation, providing a better balance between accuracy and efficiency in vertex extraction. The proposed approach was used and tested on seven different datasets and was compared against traditional vertex extraction methods. The results of the quantitative evaluation show that the proposed approach yielded higher efficiency, considerably minimized the occurrence of invalid points, and generated higher vertex extraction accuracy compared to other traditional methods.
Collapse
|
11
|
Zempo K, Arai T, Aoki T, Okada Y. Sensing Framework for the Internet of Actors in the Value Co-Creation Process with a Beacon-Attachable Indoor Positioning System. SENSORS 2020; 21:s21010083. [PMID: 33375596 PMCID: PMC7795509 DOI: 10.3390/s21010083] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 11/17/2020] [Revised: 12/19/2020] [Accepted: 12/22/2020] [Indexed: 01/10/2023]
Abstract
To evaluate and improve the value of a service, it is important to measure not only the outcomes, but also the process of the service. Value co-creation (VCC) is not limited to outcomes, especially in interpersonal services based on interactions between actors. In this paper, a sensing framework for a VCC process in retail stores is proposed by improving an environment recognition based indoor positioning system with high positioning performance in a metal shelf environment. The conventional indoor positioning systems use radio waves; therefore, errors are caused by reflection, absorption, and interference from metal shelves. An improvement in positioning performance was achieved in the proposed method by using an IR (infrared) slit and IR light, which avoids such errors. The system was designed to recognize many and unspecified people based on the environment recognition method that the receivers had installed, in the service environment. In addition, sensor networking was also conducted by adding a function to transmit payload and identification simultaneously to the beacons that were attached to positioning objects. The effectiveness of the proposed method was verified by installing it not only in an experimental environment with ideal conditions, but posteriorly, the system was tested in real conditions, in a retail store. In our experimental setup, in a comparison with equal element numbers, positioning identification was possible within an error of 96.2 mm in a static environment in contrast to the radio wave based method where an average positioning error of approximately 648 mm was measured using the radio wave based method (Bluetooth low-energy fingerprinting technique). Moreover, when multiple beacons were used simultaneously in our system within the measurement range of one receiver, the appropriate setting of the pulse interval and jitter rate was implemented by simulation. Additionally, it was confirmed that, in a real scenario, it is possible to measure the changes in movement and positional relationships between people. This result shows the feasibility of measuring and evaluating the VCC process in retail stores, although it was difficult to measure the interaction between actors.
Collapse
Affiliation(s)
- Keiichi Zempo
- Faculty of Engineering, Information and Systems, University of Tsukuba, Tsukuba 305-8573, Ibaraki, Japan;
- Correspondence:
| | - Taiga Arai
- Graduate School of Systems and Information Engineering, University of Tsukuba, Tsukuba 305-8573, Ibaraki, Japan; (T.A.); (T.A.)
| | - Takuya Aoki
- Graduate School of Systems and Information Engineering, University of Tsukuba, Tsukuba 305-8573, Ibaraki, Japan; (T.A.); (T.A.)
| | - Yukihiko Okada
- Faculty of Engineering, Information and Systems, University of Tsukuba, Tsukuba 305-8573, Ibaraki, Japan;
| |
Collapse
|
12
|
Zhang T, Hu X, Xiao J, Zhang G. A Machine Learning Method for Vision-Based Unmanned Aerial Vehicle Systems to Understand Unknown Environments. SENSORS (BASEL, SWITZERLAND) 2020; 20:E3245. [PMID: 32517309 PMCID: PMC7308845 DOI: 10.3390/s20113245] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 05/11/2020] [Revised: 06/02/2020] [Accepted: 06/04/2020] [Indexed: 11/17/2022]
Abstract
What makes unmanned aerial vehicles (UAVs) intelligent is their capability of sensing and understanding new unknown environments. Some studies utilize computer vision algorithms like Visual Simultaneous Localization and Mapping (VSLAM) and Visual Odometry (VO) to sense the environment for pose estimation, obstacles avoidance and visual servoing. However, understanding the new environment (i.e., make the UAV recognize generic objects) is still an essential scientific problem that lacks a solution. Therefore, this paper takes a step to understand the items in an unknown environment. The aim of this research is to enable the UAV with basic understanding capability for a high-level UAV flock application in the future. Specially, firstly, the proposed understanding method combines machine learning and traditional algorithm to understand the unknown environment through RGB images; secondly, the You Only Look Once (YOLO) object detection system is integrated (based on TensorFlow) in a smartphone to perceive the position and category of 80 classes of objects in the images; thirdly, the method makes the UAV more intelligent and liberates the operator from labor; fourthly, detection accuracy and latency in working condition are quantitatively evaluated, and properties of generality (can be used in various platforms), transportability (easily deployed from one platform to another) and scalability (easily updated and maintained) for UAV flocks are qualitatively discussed. The experiments suggest that the method has enough accuracy to recognize various objects with high computational speed, and excellent properties of generality, transportability and scalability.
Collapse
Affiliation(s)
- Tianyao Zhang
- School of Automation Science and Electrical Engineering, Beihang University, Beijing 100191, China; (T.Z.); (X.H.); (G.Z.)
- ShenYuan Honors College of Beihang University, Beihang University, Beijing 100191, China
| | - Xiaoguang Hu
- School of Automation Science and Electrical Engineering, Beihang University, Beijing 100191, China; (T.Z.); (X.H.); (G.Z.)
| | - Jin Xiao
- School of Automation Science and Electrical Engineering, Beihang University, Beijing 100191, China; (T.Z.); (X.H.); (G.Z.)
| | - Guofeng Zhang
- School of Automation Science and Electrical Engineering, Beihang University, Beijing 100191, China; (T.Z.); (X.H.); (G.Z.)
| |
Collapse
|