An integrated logit model for contamination event detection in water distribution systems

Automation of on-site microbial water quality monitoring from source to tap: Challenges and perspectives

Ensuring the provision of safe drinking water necessitates thorough monitoring of microbial water quality. While traditional culture-based enumeration of bacterial indicators has served as the gold standard in compliance monitoring since the late 19th century, recent advancements in microbial sensor technology, driven by automation and digitalization, are revolutionizing on-site monitoring capabilities. These innovations offer unparalleled potential for automated, high temporal frequency monitoring with remote, real-time data transmission. With regulatory frameworks increasingly favouring risk-based approaches to microbial risk management throughout the drinking water supply chain, we are witnessing a paradigm shift towards the adoption of microbial sensors. This review offers a comprehensive examination of the latest developments and accomplishments in automated on-site monitoring of microbial water quality. Beginning with an elucidation of key terminology and an overview of available sensor technologies, we explore how these cutting-edge tools can enhance our understanding of microbial dynamics in the sourcing, treatment, and distribution of drinking water, and how this knowledge can be translated into operational management. Despite the promise of microbial sensors, significant challenges remain. Drawing from insights gathered from an international online survey targeting drinking water utilities, we discuss the analytical, economic, and legal barriers that must be overcome for the implementation of automated on-site monitoring of microbial water quality. This review serves as a vital resource for researchers, utilities, and policymakers operating in water microbiology and sensor technology. While it is addressing drinking water more specifically, the presented concepts and tools can be extrapolated to recreational waters or wastewater management, with the shared goal to ensure sustainable management of water resources and protection of public health.

An improved CNN model in image classification application on water turbidity

Water turbidity is an important indicator for evaluating water clarity and plays an important role in environmental protection and ecological balance. Due to the subtle changes in water turbidity images, the differences captured are often too subtle to be classified. Convolutional neural networks (CNN) are widely used in image classification and perform well in feature extraction and classification. This study explored the application of convolutional neural networks in water turbidity classification. The innovation lies in applying CNN to water turbidity images, focusing on optimizing the CNN model to improve prediction accuracy and efficiency. The study proposed four CNN models for water turbidity classification based on artificial intelligence, and adjusted the number of model layers to improve prediction accuracy. Experiments were conducted on noise-free and noisy datasets to evaluate the accuracy and running time of the models. The results show that the CNN-10 model with a dropout layer has a classification accuracy of 96.5% under noisy conditions. This study has opened up new applications of CNN in fine-grained image classification, and further demonstrated the effectiveness of convolutional neural networks in water turbidity image classification through experiments.

The significant impact of MPs in the industrial/municipal effluents on the MPs abundance in the Nakdong River, South Korea

Owing to extensive plastic consumption, wastewater from households, business establishments, and industrial activities have been recognised as a significant contributor to microplastics (MPs) in aquatic environments. This case study represents the first investigation of MPs in the Nakdong River, Republic of Korea, that traverses through the largest industrial complex midstream and densely populated cities of Daegu and Busan downstream before flowing into the sea. Monitoring of MP abundance in effluents discharged from three municipal, two industrial, and one livestock wastewater treatment plant (WWTP) into the Nakdong River was conducted over four seasons from August 2022 to April 2023. Identification and quantification of MPs were performed using micro-Fourier transform infrared spectrometry. Seasonal variation in MPs in the Nakdong River was found to be strongly influenced by the nearest upstream WWTPs and rivers, exhibiting a linear relationship that decreased gradually with increasing distance from the WWTPs. The average concentrations of MPs in the six effluent sources ranged from 101 ± 13 to 490 ± 240 particles/L during the yearly monitoring period, while MP concentrations in the river ranged between 79 ± 25 and 120 ± 43 particles/L. Industrial effluents contained higher amounts of discharged MPs (314 ± 78 particles/L) than municipal sources (201 ± 61 particles/L). Notably, two municipal WWTPs, located in the highly densely populated city, discharged the highest total MP amounts per day and released the greatest volumes of effluents. This study provides valuable insights into the monitoring and impact of effluents on MPs in rivers, which could inform MP treatment and management strategies for in river and marine environments.

Real-time water quality prediction in water distribution networks using graph neural networks with sparse monitoring data

Ensuring the safety and reliability of drinking water supply requires accurate prediction of water quality in water distribution networks (WDNs). However, existing hydraulic model-based approaches for system state prediction face challenges in model calibration with limited sensor data and intensive computing requirements, while current machine learning models are lack of capacity to predict the system states at sites that are not monitored or included in model training. To address these gaps, this study proposes a novel gated graph neural network (GGNN) model for real-time water quality prediction in WDNs. The GGNN model integrates hydraulic flow directions and water quality data to represent the topology and system dynamics, and employs a masking operation for training to enhance prediction accuracy. Evaluation results from a real-world WDN demonstrate that the GGNN model is capable to achieve accurate water quality prediction across the entire WDN. Despite being trained with water quality data from a limited number of sensor sites, the model can achieve high predictive accuracies (Mean Absolute Error = 0.07 mg L-1 and Mean Absolute Percentage Error = 10.0 %) across the entire network including those unmonitored sites. Furthermore, water quality-based sensor placement significantly improves predictive accuracy, emphasizing the importance of careful sensor location selection. This research advances water quality prediction in WDNs by offering a practical and effective machine learning solution to address challenges related to limited sensor data and network complexity. This study provides a first step towards developing machine learning models to replace hydraulic models in WDN modelling.

Gated graph neural networks for identifying contamination sources in water distribution systems

Contamination events in water distribution networks (WDN) pose significant threats to water supply and public health. Rapid and accurate contamination source identification (CSI) can facilitate the development of remedial measures to reduce impacts. Though many machine learning (ML) methods have been proposed for fast detection, there is a critical need for approaches capturing complex spatial dynamics in WDNs to enhance prediction accuracy. This study proposes a gated graph neural network (GGNN) for CSI in the WDN, incorporating both spatiotemporal water quality data and flow directionality between network nodes. Evaluated across various contamination scenarios, the GGNN demonstrates high prediction accuracy even with limited sensor coverage. Notably, directional connections significantly enhance the GGNN CSI accuracy, underscoring the importance of network topology and flow dynamics in ML-based WDN CSI approaches. Specifically, the method achieves a 92.27% accuracy in narrowing the contamination source to 5 points using just 2 h of sensor data. The GGNN showcases resilience under model and measurement uncertainties, reaffirming its potential for real-time implementation in practice. Moreover, our findings highlight the impact of sensor sampling frequency and measurement accuracy on CSI accuracy, offering practical insights for ML methods in water network applications.

Integrating remote sensing and machine learning to detect turbidity anomalies in hydroelectric reservoirs

Monitoring water quality in reservoirs is essential for the maintenance of aquatic ecosystems and socioeconomic services. In this scenario, the observation of abrupt elevations of physicochemical parameters, such as turbidity and other indicators, can signal anomalies associated with the occurrence of critical events, requiring operational actions and planning to mitigate negative environmental impacts on water resources. This work aims to integrate Machine Learning methods specialized in anomaly detection with data obtained from remote sensing images to identify with high turbidity events in the surface water of the Três Marias Hydroelectric Reservoir. Four distinct threshold-based scenarios were evaluated, in which the overall performance, based on F1-score, showed decreasing trends as the thresholds became more restrictive. In general, the anomaly identification maps generated through the models ratified the applicability of the methods in the diagnosis of surface water in reservoirs in distinct hydrological contexts (dry and wet), effectively identifying locations with anomalous turbidity values.

Advances and applications of machine learning and deep learning in environmental ecology and health

Machine learning (ML) and deep learning (DL) possess excellent advantages in data analysis (e.g., feature extraction, clustering, classification, regression, image recognition and prediction) and risk assessment and management in environmental ecology and health (EEH). Considering the rapid growth and increasing complexity of data in EEH, it is of significance to summarize recent advances and applications of ML and DL in EEH. This review summarized the basic processes and fundamental algorithms of the ML and DL modeling, and indicated the urgent needs of ML and DL in EEH. Recent research hotspots such as environmental ecology and restoration, environmental fate of new pollutants, chemical exposures and risks, chemical hazard identification and control were highlighted. Various applications of ML and DL in EEH demonstrate their versatility and technological revolution, and present some challenges. The perspective of ML and DL in EEH were further outlined to promote the innovative analysis and cultivation of the ML-driven research paradigm.

Generative adversarial networks for detecting contamination events in water distribution systems using multi-parameter, multi-site water quality monitoring

Contamination events in water distribution networks (WDNs) can have a huge impact on water supply and public health; increasingly, online water quality sensors are deployed for real-time detection of contamination events. Machine learning has been used to integrate multivariate time series water quality data at multiple stations for contamination detection; however, accurate extraction of spatial features in water quality signals remains challenging. This study proposed a contamination detection method based on generative adversarial networks (GANs). The GAN model was constructed to simultaneously consider the spatial correlation between sensor locations and temporal information of water quality indicators. The model consists of two networks-a generator and a discriminator-the outputs of which are used to measure the degree of abnormality of water quality data at each time step, referred to as the anomaly score. Bayesian sequential analysis is used to update the likelihood of event occurrence based on the anomaly scores. Alarms are then generated from the fusion of single-site and multi-site models. The proposed method was tested on a WDN for various contamination events with different characteristics. Results showed high detection performance by the proposed GAN method compared with the minimum volume ellipsoid benchmark method for various contamination amplitudes. Additionally, the GAN method achieved high accuracy for various contamination events with different amplitudes and numbers of anomalous water quality parameters, and water quality data from different sensor stations, highlighting its robustness and potential for practical application to real-time contamination events.

Identifying the acute toxicity of contaminated sediments using machine learning models

Ecological risk assessment of contaminated sediment has become a fundamental component of water quality management programs, supporting decision-making for management actions or prompting additional investigations. In this study, we proposed a machine learning (ML)-based approach to assess the ecological risk of contaminated sediment as an alternative to existing index-based methods and costly toxicity testing. The performance of three widely used index-based methods (the pollution load index, potential ecological risk index, and mean probable effect concentration) and three ML algorithms (random forest, support vector machine, and extreme gradient boosting [XGB]) were compared in their prediction of sediment toxicity using 327 nationwide data sets from Korea consisting of 14 sediment quality parameters and sediment toxicity testing data. We also compared the performances of classifiers and regressors in predicting the toxicity for each of RF, SVM, and XGB algorithms. For all algorithms, the classifiers poorly classified toxic and non-toxic samples due to limited information on the sediment composition and the small training dataset. The regressors with a given classification threshold provided better classification, with the XGB regressor outperforming the other models in the classification. A permutation feature importance analysis revealed that Cr, Cu, Pb, and Zn were major contributors to toxicity prediction. The ML-based approach has the potential to be even more useful in the future with the expected increase in available sediment data.

Developing stacking ensemble models for multivariate contamination detection in water distribution systems

This study presents a new stacking ensemble model for contamination event detection using multiple water quality parameters. The stacking model consists of a number of machine learning base predictors and a meta-predictor, and it is trained using cross-validation to capture different features in multiple water quality parameters and then used for water quality predictions. For each water quality parameter, the residuals between predicted and measured data are classified to identify anomalies with thresholds derived from the sequential model-based optimization method and detection probabilities updated using Bayesian analysis. Alarms derived from individual water quality parameters are fused to enhance the anomaly signals and improve the detection accuracy. The proposed stacking-based method is evaluated using a data set of six water quality parameters from a real water distribution system with randomly simulated events. The stacking-based method could detect 2496 events out of a total 2500 events without a false alarm. The results show that the stacking method outperforms an artificial neural network (ANN) benchmark method in contamination event detection. The stacking method has a higher true positive rate, lower false positive rate and higher F1 score than the ANN method. This implies that the stacking method has great promise of detecting contamination events in the water distribution system.

Machine Learning: New Ideas and Tools in Environmental Science and Engineering

The rapid increase in both the quantity and complexity of data that are being generated daily in the field of environmental science and engineering (ESE) demands accompanied advancement in data analytics. Advanced data analysis approaches, such as machine learning (ML), have become indispensable tools for revealing hidden patterns or deducing correlations for which conventional analytical methods face limitations or challenges. However, ML concepts and practices have not been widely utilized by researchers in ESE. This feature explores the potential of ML to revolutionize data analysis and modeling in the ESE field, and covers the essential knowledge needed for such applications. First, we use five examples to illustrate how ML addresses complex ESE problems. We then summarize four major types of applications of ML in ESE: making predictions; extracting feature importance; detecting anomalies; and discovering new materials or chemicals. Next, we introduce the essential knowledge required and current shortcomings in ML applications in ESE, with a focus on three important but often overlooked components when applying ML: correct model development, proper model interpretation, and sound applicability analysis. Finally, we discuss challenges and future opportunities in the application of ML tools in ESE to highlight the potential of ML in this field.

Review of Modeling Methodologies for Managing Water Distribution Security

Water distribution systems are vulnerable to hazards that threaten water delivery, water quality, and physical and cybernetic infrastructure. Water utilities and managers are responsible for assessing and preparing for these hazards, and researchers have developed a range of computational frameworks to explore and identify strategies for what-if scenarios. This manuscript conducts a review of the literature to report on the state of the art in modeling methodologies that have been developed to support the security of water distribution systems. First, the major activities outlined in the emergency management framework are reviewed; the activities include risk assessment, mitigation, emergency preparedness, response, and recovery. Simulation approaches and prototype software tools are reviewed that have been developed by government agencies and researchers for assessing and mitigating four threat modes, including contamination events, physical destruction, interconnected infrastructure cascading failures, and cybernetic attacks. Modeling tools are mapped to emergency management activities, and an analysis of the research is conducted to group studies based on methodologies that are used and developed to support emergency management activities. Recommendations are made for research needs that will contribute to the enhancement of the security of water distribution systems.

Faster and safer: Research priorities in water and health

The United Nations' Sustainable Development Goals initiated in 2016 reiterated the need for safe water and healthy lives across the globe. The tenth anniversary meeting of the International Water and Health Seminar in 2018 brought together experts, students, and practitioners, setting the stage for development of an inclusive and evidence-based research agenda on water and health. Data collection relied on a nominal group technique gathering perceived research priorities as well as underlying drivers and adaptation needs. Under a common driver of public health protection, primary research priorities included the socioeconomy of water, risk assessment and management, and improved monitoring methods and intelligence. Adaptations stemming from these drivers included translating existing knowledge to providing safe and timely services to support the diversity of human water needs. Our findings present a comprehensive agenda of topics at the forefront of water and health research. This information can frame and inform collective efforts of water and health researchers over the coming decades, contributing to improved water services, public health, and socioeconomic outcomes.

Solving Management Problems in Water Distribution Networks: A Survey of Approaches and Mathematical Models

Modern water distribution networks (WDNs) are complex and difficult to manage due to increased level of urbanization, varying consumer demands, ageing infrastructure, operational costs, and inadequate water resources. The management problems in such complex networks may be classified into short-term, medium-term, and long-term, depending on the duration at which the problems are solved or considered. To address the management problems associated with WDNs, mathematical models facilitate analysis and improvement of the performance of water infrastructure at minimum operational cost, and have been used by researchers, water utility managers, and operators. This paper presents a detailed review of the management problems and essential mathematical models that are used to address these problems at various phases of WDNs. In addition, it also discusses the main approaches to address these management problems to meet customer demands at the required pressure in terms of adequate water quantity and quality. Key challenges that are associated with the management of WDNs are discussed. Also, new directions for future research studies are suggested to enable water utility managers and researchers to improve the performance of water distribution networks.

Health Risk Assessment of Household Drinking Water in a District in the UAE

The quality of household drinking water in a community of 30 houses in a district in Abu Dhabi, United Arab Emirates (UAE) was assessed over a period of one year (January to November 2015). Standard analytical techniques were used to screen for water quality parameters and contaminants of concern. Water quality was evaluated in the 30 households at four sampling points: kitchen faucet, bathroom faucet, household water tank, and main water pipe. The sampling points were chosen to help identify the source when an elevated level of a particular contaminant is observed. Water quality data was interpreted by utilizing two main techniques: spatial variation analysis and multivariate statistical techniques. Initial analysis showed that many households had As, Cd, and Pb concentrations that were higher than the maximum allowable level set by UAE drinking water standards. In addition, the water main samples had the highest concentration of the heavy metals compared to other sampling points. Health risk assessment results indicated that approximately 30%, 55%, and 15% of the houses studied had a high, moderate, and low risk from the prolonged exposure to heavy metals, respectively. The analysis can help with planning a spatially focused sampling plan to confirm the study findings and set an appropriate course of action.

Model-based approach for cyber-physical attack detection in water distribution systems

Modern Water Distribution Systems (WDSs) are often controlled by Supervisory Control and Data Acquisition (SCADA) systems and Programmable Logic Controllers (PLCs) which manage their operation and maintain a reliable water supply. As such, and with the cyber layer becoming a central component of WDS operations, these systems are at a greater risk of being subjected to cyberattacks. This paper offers a model-based methodology based on a detailed hydraulic understanding of WDSs combined with an anomaly detection algorithm for the identification of complex cyberattacks that cannot be fully identified by hydraulically based rules alone. The results show that the proposed algorithm is capable of achieving the best-known performance when tested on the data published in the BATtle of the Attack Detection ALgorithms (BATADAL) competition (http://www.batadal.net).

Detection of contaminants in water supply: A review on state-of-the-art monitoring technologies and their applications

Water monitoring technologies are widely used for contaminants detection in wide variety of water ecology applications such as water treatment plant and water distribution system. A tremendous amount of research has been conducted over the past decades to develop robust and efficient techniques of contaminants detection with minimum operating cost and energy. Recent developments in spectroscopic techniques and biosensor approach have improved the detection sensitivities, quantitatively and qualitatively. The availability of in-situ measurements and multiple detection analyses has expanded the water monitoring applications in various advanced techniques including successful establishment in hand-held sensing devices which improves portability in real-time basis for the detection of contaminant, such as microorganisms, pesticides, heavy metal ions, inorganic and organic components. This paper intends to review the developments in water quality monitoring technologies for the detection of biological and chemical contaminants in accordance with instrumental limitations. Particularly, this review focuses on the most recently developed techniques for water contaminant detection applications. Several recommendations and prospective views on the developments in water quality assessments will also be included.

Integrating physically based simulators with Event Detection Systems: Multi-site detection approach

The Fault Detection (FD) Problem in control theory concerns of monitoring a system to identify when a fault has occurred. Two approaches can be distinguished for the FD: Signal processing based FD and Model-based FD. The former concerns of developing algorithms to directly infer faults from sensors' readings, while the latter uses a simulation model of the real-system to analyze the discrepancy between sensors' readings and expected values from the simulation model. Most contamination Event Detection Systems (EDSs) for water distribution systems have followed the signal processing based FD, which relies on analyzing the signals from monitoring stations independently of each other, rather than evaluating all stations simultaneously within an integrated network. In this study, we show that a model-based EDS which utilizes a physically based water quality and hydraulics simulation models, can outperform the signal processing based EDS. We also show that the model-based EDS can facilitate the development of a Multi-Site EDS (MSEDS), which analyzes the data from all the monitoring stations simultaneously within an integrated network. The advantage of the joint analysis in the MSEDS is expressed by increased detection accuracy (higher true positive alarms and fewer false alarms) and shorter detection time.

A canonical correlation analysis based method for contamination event detection in water sources

In this study, a general framework integrating a data-driven estimation model is employed for contamination event detection in water sources. Sequential canonical correlation coefficients are updated in the model using multivariate water quality time series. The proposed method utilizes canonical correlation analysis for studying the interplay between two sets of water quality parameters. The model is assessed by precision, recall and F-measure. The proposed method is tested using data from a laboratory contaminant injection experiment. The proposed method could detect a contamination event 1 minute after the introduction of 1.600 mg l(-1) acrylamide solution. With optimized parameter values, the proposed method can correctly detect 97.50% of all contamination events with no false alarms. The robustness of the proposed method can be explained using the Bauer-Fike theorem.