A Novel Energy-Efficient Contention-Based MAC Protocol Used for OA-UWSN

Deep Reinforcement Learning Based Optical and Acoustic Dual Channel Multiple Access in Heterogeneous Underwater Sensor Networks

In this paper, we investigate how to efficiently utilize channel bandwidth in heterogeneous hybrid optical and acoustic underwater sensor networks, where sensor nodes adopt different Media Access Control (MAC) protocols to transmit data packets to a common relay node on optical or acoustic channels. We propose a new MAC protocol based on deep reinforcement learning (DRL), referred to as optical and acoustic dual-channel deep-reinforcement learning multiple access (OA-DLMA), in which the sensor nodes utilizing the OA-DLMA protocol are called agents, and the remainder are non-agents. The agents can learn the transmission patterns of coexisting non-agents and find an optimal channel access strategy without any prior information. Moreover, in order to further enhance network performance, we develop a differentiated reward policy that rewards specific actions over optical and acoustic channels differently, with priority compensation being given to the optical channel to achieve greater data transmission. Furthermore, we have derived the optimal short-term sum throughput and channel utilization analytically and conducted extensive simulations to evaluate the OA-DLMA protocol. Simulation results show that our protocol performs with near-optimal performance and significantly outperforms other existing protocols in terms of short-term sum throughput and channel utilization.

CoSiM-RPO: Cooperative Routing with Sink Mobility for Reliable and Persistent Operation in Underwater Acoustic Wireless Sensor Networks

An efficient algorithm for the persistence operation of data routing is crucial due to the uniqueness and challenges of the aqueous medium of the underwater acoustic wireless sensor networks (UA-WSNs). The existing multi-hop algorithms have a high energy cost, data loss, and less stability due to many forwarders for a single-packet delivery. In order to tackle these constraints and limitations, two algorithms using sink mobility and cooperative technique for UA-WSNs are devised. The first one is sink mobility for reliable and persistence operation (SiM-RPO) in UA-WSNs, and the second is the enhanced version of the SiM-RPO named CoSiM-RPO, which utilizes the cooperative technique for better exchanging of the information and minimizes data loss probability. To cover all of the network through mobile sinks (MSs), the division of the network into small portions is accomplished. The path pattern is determined for MSs in a manner to receive data even from a single node in the network. The MSs pick the data directly from the nodes and check them for the errors. When erroneous data are received at the MS, then the relay cooperates to receive correct data. The proposed algorithm boosts the network lifespan, throughput, delay, and stability more than the existing counterpart schemes.