Cyber surveillance for flood disasters

Automatic Monitoring Alarm Method of Dammed Lake Based on Hybrid Segmentation Algorithm

Mountainous regions are prone to dammed lake disasters due to their rough topography, scant vegetation, and high summer rainfall. By measuring water level variation, monitoring systems can detect dammed lake events when mudslides block rivers or boost water level. Therefore, an automatic monitoring alarm method based on a hybrid segmentation algorithm is proposed. The algorithm uses the k-means clustering algorithm to segment the picture scene in the RGB color space and the region growing algorithm on the image green channel to select the river target from the segmented scene. The pixel water level variation is used to trigger an alarm for the dammed lake event after the water level has been retrieved. In the Yarlung Tsangpo River basin of the Tibet Autonomous Region of China, the proposed automatic lake monitoring system was installed. We pick up data from April to November 2021, during which the river experienced low, high, and low water levels. Unlike conventional region growing algorithms, the algorithm does not rely on engineering knowledge to pick seed point parameters. Using our method, the accuracy rate is 89.29% and the miss rate is 11.76%, which is 29.12% higher and 17.65% lower than the traditional region growing algorithm, respectively. The monitoring results indicate that the proposed method is a highly adaptable and accurate unmanned dammed lake monitoring system.

A Low-Power High-Accuracy Urban Waterlogging Depth Sensor Based on Millimeter-Wave FMCW Radar

The method of making precise measurements of remote water depth using mmWave technology has great potential for preventing urban waterlogging. To achieve waterlogging prevention, the mmWave system needs to measure the water depth change accurately with a short acquisition time. This paper demonstrates a new accurate mmWave water depth measurement system based on Frequency Modulated Continuous Wave (FMCW) Radar with a center frequency of 77 GHz. To improve distance resolution and lower acquisition time, the Swept Frequency-Cross Correlation (SFCC) algorithm is proposed for the first time to improve the distance computation resolution by 9× and lower time complexity from O(n·logn) to O(n) compared to traditional FFT-based FMCW radar distance computation. A prototype system equipped with a humidity sensor, a processor module and TI’s FMCW radar module is designed for monitoring urban floods in cities. Using the prototype system with the proposed SFCC, the depth measurement error is reduced from 4.5 cm to less than 5 mm, compared to the default radar post-processing algorithm embedded in the radar module.

Drone-Based Water Level Detection in Flood Disasters

Japan was hit by typhoon Hagibis, which came with torrential rains submerging almost eight-thousand buildings. For fast alleviation of and recovery from flood damage, a quick, broad, and accurate assessment of the damage situation is required. Image analysis provides a much more feasible alternative than on-site sensors due to their installation and maintenance costs. Nevertheless, most state-of-art research relies on only ground-level images that are inevitably limited in their field of vision. This paper presents a water level detection system based on aerial drone-based image recognition. The system applies the R-CNN learning model together with a novel labeling method on the reference objects, including houses and cars. The proposed system tackles the challenges of the limited and wild data set of flood images from the top view with data augmentation and transfer-learning overlaying Mask R-CNN for the object recognition model. Additionally, the VGG16 network is employed for water level detection purposes. We evaluated the proposed system on realistic images captured at disaster time. Preliminary results show that the system can achieve a detection accuracy of submerged objects of 73.42% with as low as only 21.43 cm error in estimating the water level.

Image Processing of UAV Imagery for River Feature Recognition of Kerian River, Malaysia

The impact of floods is the most severe among the natural calamities occurring in Malaysia. The knock of floods is consistent and annually forces thousands of Malaysians to relocate. The lack of information from the Ministry of Environment and Water, Malaysia is the foremost obstacle in upgrading the flood mapping. With the expeditious evolution of computer techniques, processing of satellite and unmanned aerial vehicle (UAV) images for river hydromorphological feature detection and flood management have gathered pace in the last two decades. Different image processing algorithms—structure from motion (SfM), multi-view stereo (MVS), gradient vector flow (GVF) snake algorithm, etc.—and artificial neural networks are implemented for the monitoring and classification of river features. This paper presents the application of the k-means algorithm along with image thresholding to quantify variation in river surface flow areas and vegetation growth along Kerian River, Malaysia. The river characteristic recognition directly or indirectly assists in studying river behavior and flood monitoring. Dice similarity coefficient and Jaccard index are numerated between thresholded images that are clustered using the k-means algorithm and manually segmented images. Based on quantitative evaluation, a dice similarity coefficient and Jaccard index of up to 97.86% and 94.36% were yielded for flow area and vegetation calculation. Thus, the present technique is functional in evaluating river characteristics with reduced errors. With minimum errors, the present technique can be utilized for quantifying agricultural areas and urban areas around the river basin.

Automated Flood Depth Estimates from Online Traffic Sign Images: Explorations of a Convolutional Neural Network-Based Method

Flood depth monitoring is crucial for flood warning systems and damage control, especially in the event of an urban flood. Existing gauge station data and remote sensing data still has limited spatial and temporal resolution and coverage. Therefore, to expand flood depth data source taking use of online image resources in an efficient manner, an automated, low-cost, and real-time working frame called FloodMask was developed to obtain flood depth from online images containing flooded traffic signs. The method was built on the deep learning framework of Mask R-CNN (regional convolutional neural network), trained by collected and manually annotated traffic sign images. Following further the proposed image processing frame, flood depth data were retrieved more efficiently than manual estimations. As the main results, the flood depth estimates from images (without any mirror reflection and other inference problems) have an average error of 0.11 m, when compared to human visual inspection measurements. This developed method can be further coupled with street CCTV cameras, social media photos, and on-board vehicle cameras to facilitate the development of a smart city with a prompt and efficient flood monitoring system. In future studies, distortion and mirror reflection should be tackled properly to increase the quality of the flood depth estimates.

The Artificial Intelligence of Things Sensing System of Real-Time Bridge Scour Monitoring for Early Warning during Floods

Scour around bridge piers remains the leading cause of bridge failure induced in flood. Floods and torrential rains erode riverbeds and damage cross-river structures, causing bridge collapse and a severe threat to property and life. Reductions in bridge-safety capacity need to be monitored during flood periods to protect the traveling public. In the present study, a scour monitoring system designed with vibration-based arrayed sensors consisting of a combination of Internet of Things (IoT) and artificial intelligence (AI) is developed and implemented to obtain real-time scour depth measurements. These vibration-based micro-electro-mechanical systems (MEMS) sensors are packaged in a waterproof stainless steel ball within a rebar cage to resist a harsh environment in floods. The floodwater-level changes around the bridge pier are performed using real-time CCTV images by the Mask R-CNN deep learning model. The scour-depth evolution is simulated using the hydrodynamic model with the selected local scour formulas and the sediment transport equation. The laboratory and field measurement results demonstrated the success of the early warning system for monitoring the real-time bridge scour-depth evolution.

Assessment of an Ultrasonic Water Stage Monitoring Sensor Operating in an Urban Stream

The monitoring of the water stage in streams and rivers is essential for the sustainable management of water resources, particularly for the estimation of river discharges, the protection against floods and the design of hydraulic works. The Institute of Marine Biological Resources and Inland Waters of the Hellenic Centre for Marine Research (HCMR) has developed and operates automatic stations in rivers of Greece, which, apart from their monitoring role, offer opportunities for testing new monitoring equipment. This paper compares the performance of a new ultrasonic sensor, a non-contact water stage monitoring instrument, against a pressure transducer, both installed at the same location in an urban stream of the metropolitan area of Athens. The statistical and graph analysis of the almost one-year concurrent measurements from the two sensors revealed that stage differences never exceeded 7%, while the ultrasonic measurements were most of the time higher than the respective pressure transducer ones during the low flow conditions of the dry period and lower during the wet period of the year, when high flow events occurred. It is also remarkable that diurnal air temperature variations under stable hydrologic conditions had an impact on the measured stage from the ultrasonic sensor, which varied its stage measurements within a small but non-negligible range, while the pressure transducer did not practically fluctuate. Despite a slightly increased sensitivity of the ultrasonic sensor to meteorological conditions, the paper concludes that non-contact sensors for the monitoring of the water stage in rivers can be useful, especially where danger for possible damage of submersible instruments is increased.

Energy-Efficient Ultrasonic Water Level Detection System with Dual-Target Monitoring

This study presents a developed ultrasonic water level detection (UWLD) system with an energy-efficient design and dual-target monitoring. The water level monitoring system with a non-contact sensor is one of the suitable methods since it is not directly exposed to water. In addition, a web-based monitoring system using a cloud computing platform is a well-known technique to provide real-time water level monitoring. However, the long-term stable operation of remotely communicating units is an issue for real-time water level monitoring. Therefore, this paper proposes a UWLD unit using a low-power consumption design for renewable energy harvesting (e.g., solar) by controlling the unit with dual microcontrollers (MCUs) to improve the energy efficiency of the system. In addition, dual targeting to the pavement and streamside is uniquely designed to monitor both the urban inundation and stream overflow. The real-time water level monitoring data obtained from the proposed UWLD system is analyzed with water level changing rate (WLCR) and water level index. The quantified WLCR and water level index with various sampling rates present a different sensitivity to heavy rain.

Segmentation of Vegetation and Flood from Aerial Images Based on Decision Fusion of Neural Networks

The detection and evaluation of flood damage in rural zones are of great importance for farmers, local authorities, and insurance companies. To this end, the paper proposes an efficient system based on five neural networks to assess the degree of flooding and the remaining vegetation. After a previous analysis the following neural networks were selected as primary classifiers: you only look once network (YOLO), generative adversarial network (GAN), AlexNet, LeNet, and residual network (ResNet). Their outputs were connected in a decision fusion scheme, as a new convolutional layer, considering two sets of components: (a) the weights, corresponding to the proven accuracy of the primary neural networks in the validation phase, and (b) the probabilities generated by the neural networks as primary classification results in the operational (testing) phase. Thus, a subjective behavior (individual interpretation of single neural networks) was transformed into a more objective behavior (interpretation based on fusion of information). The images, difficult to be segmented, were obtained from an unmanned aerial vehicle photogrammetry flight after a moderate flood in a rural region of Romania and make up our database. For segmentation and evaluation of the flooded zones and vegetation, the images were first decomposed in patches and, after classification the resulting marked patches were re-composed in segmented images. From the performance analysis point of view, better results were obtained with the proposed system than the neural networks taken separately and with respect to some works from the references.

Image Segmentation Methods for Flood Monitoring System

Flood disasters are considered annual disasters in Malaysia due to their consistent occurrence. They are among the most dangerous disasters in the country. Lack of data during flood events is the main constraint to improving flood monitoring systems. With the rapid development of information technology, flood monitoring systems using a computer vision approach have gained attention over the last decade. Computer vision requires an image segmentation technique to understand the content of the image and to facilitate analysis. Various segmentation algorithms have been developed to improve results. This paper presents a comparative study of image segmentation techniques used in extracting water information from digital images. The segmentation methods were evaluated visually and statistically. To evaluate the segmentation methods statistically, the dice similarity coefficient and the Jaccard index were calculated to measure the similarity between the segmentation results and the ground truth images. Based on the experimental results, the hybrid technique obtained the highest values among the three methods, yielding an average of 97.70% for the dice score and 95.51% for the Jaccard index. Therefore, we concluded that the hybrid technique is a promising segmentation method compared to the others in extracting water features from digital images.

Computer Vision and IoT-Based Sensors in Flood Monitoring and Mapping: A Systematic Review

Floods are amongst the most common and devastating of all natural hazards. The alarming number of flood-related deaths and financial losses suffered annually across the world call for improved response to flood risks. Interestingly, the last decade has presented great opportunities with a series of scholarly activities exploring how camera images and wireless sensor data from Internet-of-Things (IoT) networks can improve flood management. This paper presents a systematic review of the literature regarding IoT-based sensors and computer vision applications in flood monitoring and mapping. The paper contributes by highlighting the main computer vision techniques and IoT sensor approaches utilised in the literature for real-time flood monitoring, flood modelling, mapping and early warning systems including the estimation of water level. The paper further contributes by providing recommendations for future research. In particular, the study recommends ways in which computer vision and IoT sensor techniques can be harnessed to better monitor and manage coastal lagoons-an aspect that is under-explored in the literature.

A New Water Level Measurement Method Combining Infrared Sensors and Floats for Applications on Laboratory Scale Channel under Unsteady Flow Regime

In this paper, we studied water transport under an unsteady flow regime in an experimental channel (4 m in length; 3 cm in width). Our experiments implicated some measuring requirements, specifically, a water level (WL) detection technique that is able to measure WL in a range of 2 cm with a precision of 1 mm. The existing WL detection techniques could not meet our measurement requirements. Therefore, we propose a new measurement method that combines two approaches: An "old" water contact technique (float) with a "new" remote non-contact technique (infrared sensor). We used an extruded polystyrene (XPS Foam) that needed some adequate treatment before using it as float in experimental measurements. The combination of IR-sensors with treated float foam lead to a sensitive measurement method that is able to detect flat and sharp flow signals, as well as highly dynamic variations of water surface level. Based on the experimental measurements of WL and outflow at the channel output, we deduced a loop rating curve that is suitable with a power law adjustment. The new measurement method could be extended to larger scale applications like rivers and more complicated cross section geometry of irregular shape.

RiverCore: IoT Device for River Water Level Monitoring over Cellular Communications

Flooding is one of the most frequent and costly natural disasters affecting mankind. However, implementing Internet of Things (IoT) technology to monitor river behavior may help mitigate or prevent future disasters. This article outlines the hardware development of an IoT system (RiverCore) and defines an application scenario in a specific hydrological region of the state of Colima (Mexico), highlighting the characteristics of data acquisition and data processing used. Both fixed position and moving drifter node systems are described along with web-based data acquisition platform developments integrated with IoT techniques to retrieve data through 3G cellular networks. The developed architecture uses the Message Queuing Telemetry Transport (MQTT) protocol, along with encryption and security mechanisms, to send real-time data packages from fixed nodes to a server that stores retrieved data in a non-relational database. From this, data can be accessed and displayed through different customizable queries and graphical representations, allowing future use in flood analysis and prediction systems. All of these features are presented along with graphical evidence of the deployment of the different devices and of several cellular communication and on-site data acquisition tests.

Inundated Areas Extraction Based on Raindrop Photometric Model (RPM) in Surveillance Video

Monitoring and assessing urban flood disasters is the key to reducing the damage of this hazard. The urban surveillance video, with the advantages of flexibility and low cost, has been used as an effective real-time data source to monitor urban flooding. The paper presents an inundated area extraction method based on raindrop photometric model. The proposed method operates on the video and divides the task into two steps: (1) extracting water surface, followed by (2) refining inundated areas. At the first step in the process, the water covered areas are extracted from the variation of video in time series. This procedure was an improved version of the raindrop photometric model. Constrained information, especially road ranges, was obtained from video background image which has eliminated interference factors. Then inundated areas can be refined with the constraint information. Experiments performed on different locations show that the proposed method can provide more reliable results than the traditional method based on spectral features.

Unmanned Aerial Vehicle Systems for Remote Estimation of Flooded Areas Based on Complex Image Processing

Floods are natural disasters which cause the most economic damage at the global level. Therefore, flood monitoring and damage estimation are very important for the population, authorities and insurance companies. The paper proposes an original solution, based on a hybrid network and complex image processing, to this problem. As first novelty, a multilevel system, with two components, terrestrial and aerial, was proposed and designed by the authors as support for image acquisition from a delimited region. The terrestrial component contains a Ground Control Station, as a coordinator at distance, which communicates via the internet with more Ground Data Terminals, as a fixed nodes network for data acquisition and communication. The aerial component contains mobile nodes—fixed wing type UAVs. In order to evaluate flood damage, two tasks must be accomplished by the network: area coverage and image processing. The second novelty of the paper consists of texture analysis in a deep neural network, taking into account new criteria for feature selection and patch classification. Color and spatial information extracted from chromatic co-occurrence matrix and mass fractal dimension were used as well. Finally, the experimental results in a real mission demonstrate the validity of the proposed methodologies and the performances of the algorithms.

An Improved Mobility-Based Control Protocol for Tolerating Clone Failures in Wireless Sensor Networks

Nowadays, with the ubiquitous presence of the Internet of Things industry, the application of emerging sensor networks has become a focus of public attention. Unattended sensor nodes can be comprised and cloned to destroy the network topology. This paper proposes a novel distributed protocol and management technique for the detection of mobile replicas to tolerate node failures. In our scheme, sensors' location claims are forwarded to obtain samples only when the corresponding witnesses meet. Meanwhile, sequential tests of statistical hypotheses are applied to further detect the cloned node by witnesses. The combination of randomized detection based on encountering and sequential tests drastically reduces the routing overhead and false positive/negative rate for detection. Theoretical analysis and simulation results show the detection efficiency and reasonable overhead of the proposed method.

Uncertainty Comparison of Visual Sensing in Adverse Weather Conditions

This paper focuses on flood-region detection using monitoring images. However, adverse weather affects the outcome of image segmentation methods. In this paper, we present an experimental comparison of an outdoor visual sensing system using region-growing methods with two different growing rules—namely, GrowCut and RegGro. For each growing rule, several tests on adverse weather and lens-stained scenes were performed, taking into account and analyzing different weather conditions with the outdoor visual sensing system. The influence of several weather conditions was analyzed, highlighting their effect on the outdoor visual sensing system with different growing rules. Furthermore, experimental errors and uncertainties obtained with the growing rules were compared. The segmentation accuracy of flood regions yielded by the GrowCut, RegGro, and hybrid methods was 75%, 85%, and 87.7%, respectively.