Comprehensive mPoint: A Method for 3D Point Cloud Generation of Human Bodies Utilizing FMCW MIMO mm-Wave Radar

An adaptive algorithm for generating 3D point clouds of the human body based on 4D millimeter-wave radar

The traditional algorithms for generating 3D human point clouds often face challenges in dealing with issues such as phantom targets and target classification caused by electromagnetic multipath effects, resulting in a lack of accuracy in the generated point clouds and requiring manual labeling of the position of the human body. To address these problems, this paper proposes an adaptive method for generating 3D human point clouds based on 4D millimeter-wave radar (Self-Adaptive mPoint, SA-mPoint). This method estimates the rough human point cloud by considering micro-motion and respiration characteristics while combining the echo dynamic with static information. Furthermore, it enhances the density of point cloud generation. It reduces interference from multipath noise through multi-frame dynamic fusion and an adaptive density-based clustering algorithm based on the center points of humans. The effectiveness of the SA-mPoint algorithm is verified through experiments conducted using the TI Millimeter Wave Cascade Imaging Radar Radio Frequency Evaluation Module 77G 4D cascade radar to collect challenging raw data consisting of single-target and multi-target human poses in an open classroom setting. Experimental results demonstrate that the proposed algorithm achieves an average accuracy rate of 97.94% for generating point clouds. Compared to the popular TI-mPoint algorithm, it generates a higher number of point clouds on average (increased by 87.94%), improves the average accuracy rate for generating point clouds (increased by 78.3%), and reduces the running time on average (reduced by 11.41%). This approach exhibits high practicality and promising application prospects.

Machine Learning-Based Human Posture Identification from Point Cloud Data Acquisitioned by FMCW Millimetre-Wave Radar

Human posture recognition technology is widely used in the fields of healthcare, human-computer interaction, and sports. The use of a Frequency-Modulated Continuous Wave (FMCW) millimetre-wave (MMW) radar sensor in measuring human posture characteristics data is of great significance because of its robust and strong recognition capabilities. This paper demonstrates how human posture characteristics data are measured, classified, and identified using FMCW techniques. First of all, the characteristics data of human posture is measured with the MMW radar sensors. Secondly, the point cloud data for human posture is generated, considering both the dynamic and static features of the reflected signal from the human body, which not only greatly reduces the environmental noise but also strengthens the reflection of the detected target. Lastly, six different machine learning models are applied for posture classification based on the generated point cloud data. To comparatively evaluate the proper model for point cloud data classification procedure-in addition to using the traditional index-the Kappa index was introduced to eliminate the effect due to the uncontrollable imbalance of the sampling data. These results support our conclusion that among the six machine learning algorithms implemented in this paper, the multi-layer perceptron (MLP) method is regarded as the most promising classifier.

mm-TPG: Traffic Policemen Gesture Recognition Based on Millimeter Wave Radar Point Cloud

Automatic driving technology refers to equipment such as vehicle-mounted sensors and computers that are used to navigate and control vehicles autonomously by acquiring external environmental information. To achieve automatic driving, vehicles must be able to perceive the surrounding environment and recognize and understand traffic signs, traffic signals, pedestrians, and other traffic participants, as well as accurately plan and control their path. Recognition of traffic signs and signals is an essential part of automatic driving technology, and gesture recognition is a crucial aspect of traffic-signal recognition. This article introduces mm-TPG, a traffic-police gesture recognition system based on a millimeter-wave point cloud. The system uses a 60 GHz frequency-modulated continuous-wave (FMCW) millimeter-wave radar as a sensor to achieve high-precision recognition of traffic-police gestures. Initially, a double-threshold filtering algorithm is used to denoise the millimeter-wave raw data, followed by multi-frame synthesis processing of the generated point cloud data and feature extraction using a ResNet18 network. Finally, gated recurrent units are used for classification to enable the recognition of different traffic-police gestures. Experimental results demonstrate that the mm-TPG system has high accuracy and robustness and can effectively recognize traffic-police gestures in complex environments such as varying lighting and weather conditions, providing strong support for traffic safety.

Millimeter-Wave Radar Localization Using Indoor Multipath Effect

The positioning of indoor electronic devices is an essential part of human-computer interaction, and the accuracy of positioning affects the level of user experience. Most existing methods for RF-based device localization choose to ignore or remove the impact of multipath effects. However, exploiting the multipath effect caused by the complex indoor environment helps to improve the model's localization accuracy. In response to this question, this paper proposes a multipath-assisted localization (MAL) model based on millimeter-wave radar to achieve the localization of indoor electronic devices. The model fully considers the help of the multipath effect when describing the characteristics of the reflected signal and precisely locates the target position by using the MAL area formed by the reflected signal. At the same time, for the situation where the radar in the traditional Single-Input Single-Output (SISO) mode cannot obtain the 3D spatial position information of the target, the advantage of the MAL model is that the 3D information of the target can be obtained after the mining process of the multipath effect. Furthermore, based on the original hardware, it can achieve a breakthrough in angular resolution. Experiments show that our proposed MAL model enables the millimeter-wave multipath positioning model to achieve a 3D positioning error within 15 cm.