1
|
Yang X, Fang H, Gao Y, Wang X, Wang K, Liu Z. Computation Offloading and Resource Allocation Based on P-DQN in LEO Satellite Edge Networks. SENSORS (BASEL, SWITZERLAND) 2023; 23:9885. [PMID: 38139731 PMCID: PMC10748271 DOI: 10.3390/s23249885] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/23/2023] [Revised: 12/12/2023] [Accepted: 12/14/2023] [Indexed: 12/24/2023]
Abstract
Traditional low earth orbit (LEO) satellite networks are typically independent of terrestrial networks, which develop relatively slowly due to the on-board capacity limitation. By integrating emerging mobile edge computing (MEC) with LEO satellite networks to form the business-oriented "end-edge-cloud" multi-level computing architecture, some computing-sensitive tasks can be offloaded by ground terminals to satellites, thereby satisfying more tasks in the network. How to make computation offloading and resource allocation decisions in LEO satellite edge networks, nevertheless, indeed poses challenges in tracking network dynamics and handling sophisticated actions. For the discrete-continuous hybrid action space and time-varying networks, this work aims to use the parameterized deep Q-network (P-DQN) for the joint computation offloading and resource allocation. First, the characteristics of time-varying channels are modeled, and then both communication and computation models under three different offloading decisions are constructed. Second, the constraints on task offloading decisions, on remaining available computing resources, and on the power control of LEO satellites as well as the cloud server are formulated, followed by the maximization problem of satisfied task number over the long run. Third, using the parameterized action Markov decision process (PAMDP) and P-DQN, the joint computing offloading, resource allocation, and power control are made in real time, to accommodate dynamics in LEO satellite edge networks and dispose of the discrete-continuous hybrid action space. Simulation results show that the proposed P-DQN method could approach the optimal control, and outperforms other reinforcement learning (RL) methods for merely either discrete or continuous action space, in terms of the long-term rate of satisfied tasks.
Collapse
Affiliation(s)
- Xu Yang
- Xi’an Institute of Space Radio Technology, Xi’an 710100, China; (X.Y.); (H.F.); (Y.G.)
| | - Hai Fang
- Xi’an Institute of Space Radio Technology, Xi’an 710100, China; (X.Y.); (H.F.); (Y.G.)
| | - Yuan Gao
- Xi’an Institute of Space Radio Technology, Xi’an 710100, China; (X.Y.); (H.F.); (Y.G.)
| | - Xingjie Wang
- School of Computer Science and Engineering, Xi’an University of Technology, Xi’an 710048, China; (K.W.); (Z.L.)
| | - Kan Wang
- School of Computer Science and Engineering, Xi’an University of Technology, Xi’an 710048, China; (K.W.); (Z.L.)
| | - Zheng Liu
- School of Computer Science and Engineering, Xi’an University of Technology, Xi’an 710048, China; (K.W.); (Z.L.)
| |
Collapse
|
2
|
Tirmizi SBR, Chen Y, Lakshminarayana S, Feng W, Khuwaja AA. Hybrid Satellite-Terrestrial Networks toward 6G: Key Technologies and Open Issues. SENSORS (BASEL, SWITZERLAND) 2022; 22:8544. [PMID: 36366243 PMCID: PMC9658377 DOI: 10.3390/s22218544] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/31/2022] [Revised: 10/19/2022] [Accepted: 10/28/2022] [Indexed: 05/27/2023]
Abstract
Future wireless networks will be required to provide more wireless services at higher data rates and with global coverage. However, existing homogeneous wireless networks, such as cellular and satellite networks, may not be able to meet such requirements individually, especially in remote terrain, including seas and mountains. One possible solution is to use diversified wireless networks that can exploit the inter-connectivity between satellites, aerial base stations (BSs), and terrestrial BSs over inter-connected space, ground, and aerial networks. Hence, enabling wireless communication in one integrated network has attracted both the industry and the research fraternities. In this work, we provide a comprehensive survey of the most recent work on hybrid satellite-terrestrial networks (HSTNs), focusing on system architecture, performance analysis, design optimization, and secure communication schemes for different cooperative and cognitive HSTN network architectures. Different key technologies are compared. Based on this comparison, several open issues for future research are discussed.
Collapse
Affiliation(s)
- Syed Bilal Raza Tirmizi
- School of Engineering, University of Warwick, Coventry CV4 7AL, UK
- Department of Electrical Engineering, Sukkur IBA University, Sukkur 65200, Pakistan
| | - Yunfei Chen
- School of Engineering, University of Warwick, Coventry CV4 7AL, UK
| | | | - Wei Feng
- Department of Electronic Engineering, Tsinghua University, Beijing 100084, China
| | - Aziz A. Khuwaja
- Department of Electrical Engineering, Sukkur IBA University, Sukkur 65200, Pakistan
| |
Collapse
|
3
|
Performance Evaluation of a Full-Duplex Relaying-Enabled Satellite Sensor Network. SENSORS 2019; 19:s19245453. [PMID: 31835681 PMCID: PMC6960568 DOI: 10.3390/s19245453] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 11/02/2019] [Revised: 11/22/2019] [Accepted: 12/03/2019] [Indexed: 11/17/2022]
Abstract
This paper investigates the performance of a full-duplex (FD) relaying-enabled satellite sensor network under residual loop interference, where the satellite uplink and the downlink transmissions simultaneously occur over the same frequency band. Specifically, the closed-form expressions for the outage probability and ergodic capacity of the FD relaying satellite sensor network are derived by considering residual loop interference, channel statistical property, propagation loss, geometric satellite antenna pattern, and terminal elevation angle. Simulation results show the achieved performance gains of a full-duplex relaying satellite sensor network over traditional half-duplex relaying, and highlight the impact of key system parameters on the performance of the considered FD relaying satellite sensor network.
Collapse
|
4
|
Hu J, Li G, Bian D, Tang J, Shi S. Sensing-Based Dynamic Spectrum Sharing in Integrated Wireless Sensor and Cognitive Satellite Terrestrial Networks. SENSORS (BASEL, SWITZERLAND) 2019; 19:s19235290. [PMID: 31805632 PMCID: PMC6928961 DOI: 10.3390/s19235290] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/24/2019] [Revised: 11/25/2019] [Accepted: 11/27/2019] [Indexed: 06/01/2023]
Abstract
This paper presents a cognitive satellite communication based wireless sensor network, which combines the wireless sensor network and the cognitive satellite terrestrial network. To address the conflict between the continuously increasing demand and the spectrum scarcity in the space network, the cognitive satellite terrestrial network becomes a promising candidate for future hybrid wireless networks. With the higher transmit capacity demand in satellite networks, explicit concerns on efficient resource allocation in the cognitive network have gained more attention. In this background, we propose a sensing-based dynamic spectrum sharing scheme for the cognitive satellite user, which is able to maximize the ergodic capacity of the satellite user with the interference of the primary terrestrial user below an acceptable average level. Firstly, the cognitive satellite user monitors the channel allocated to the terrestrial user through the wireless sensor network; then, it adjusts the transmit power based on the sensing results. If a terrestrial user is busy, the satellite user can access the channel with constrained power to avoid deteriorating the communication quality of the terrestrial user. Otherwise, if the terrestrial user is idle, the satellite user allocates the transmit power based on its benefit to enhance the capacity. Since the sensing-based dynamic spectrum sharing optimization problem can be modified into a nonlinear fraction programming problem in perfect/imperfect sensing conditions, respectively, we solve them by the Lagrange duality method. Computer simulations have shown that, compared with the opportunistic spectrum access, the proposed method can increase the channel capacity more than 20 % for P a v = 10 dB in a perfect sensing scenario. In an imperfect sensing scenario, P a v = 15 dB and Q a v = 5 dB, the optimal sensing time achieving the highest ergodic capacity is about 2.34 ms when the frame duration is 10 ms.
Collapse
Affiliation(s)
- Jing Hu
- College of Communications Engineering, People Liberation Army Engineering University, No. 2 Biaoying, Qinhuai District, Nanjing 210007, China; (J.H.); (G.L.); (D.B.); (J.T.)
| | - Guangxia Li
- College of Communications Engineering, People Liberation Army Engineering University, No. 2 Biaoying, Qinhuai District, Nanjing 210007, China; (J.H.); (G.L.); (D.B.); (J.T.)
| | - Dongming Bian
- College of Communications Engineering, People Liberation Army Engineering University, No. 2 Biaoying, Qinhuai District, Nanjing 210007, China; (J.H.); (G.L.); (D.B.); (J.T.)
| | - Jingyu Tang
- College of Communications Engineering, People Liberation Army Engineering University, No. 2 Biaoying, Qinhuai District, Nanjing 210007, China; (J.H.); (G.L.); (D.B.); (J.T.)
| | - Shengchao Shi
- Beijing Institute of Information Technology, Beijing 100094, China
| |
Collapse
|
5
|
Zhang X, Zhang B, An K, Chen Z, Guo D. Auction-Based Secondary Relay Selection on Overlay Spectrum Sharing in Hybrid Satellite-Terrestrial Sensor Networks. SENSORS 2019; 19:s19225039. [PMID: 31752294 PMCID: PMC6891412 DOI: 10.3390/s19225039] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 10/20/2019] [Revised: 11/07/2019] [Accepted: 11/15/2019] [Indexed: 11/24/2022]
Abstract
In this paper, we investigate the auction-based secondary relay selection on overlay spectrum sharing in hybrid satellite–terrestrial sensor networks (HSTSNs), where both the decode-and-forward (DF) and amplify-and-forward (AF) relay protocols are analyzed based on time division multiple access (TDMA). As both the primary and secondary networks are rational, honest but with incomplete network information, they prefer to obtain maximum possibility payoffs by the cooperation between the primary and secondary networks, and the competition among secondary networks. Hence, Vickery auction is introduced to achieve the effective and efficient secondary relay selection by distinct sub-time slot allocation for one shot in terms of a distributed manner. Finally, numerical simulations are provided to validate the effectiveness of the auction mechanism on cooperative spectrum sharing in HSTSNs for secondary relay selection. Besides, the effect of key factors on the performance of the auction mechanism are analyzed in details.
Collapse
Affiliation(s)
- Xiaokai Zhang
- College of Communications Engineering, Army Engineering University, Nanjing 210007, China; (X.Z.); (B.Z.); (Z.C.)
| | - Bangning Zhang
- College of Communications Engineering, Army Engineering University, Nanjing 210007, China; (X.Z.); (B.Z.); (Z.C.)
| | - Kang An
- The Sixty-Third Research Institute, National University of Defense Technology, Nanjing 210007, China;
| | - Zhuyun Chen
- College of Communications Engineering, Army Engineering University, Nanjing 210007, China; (X.Z.); (B.Z.); (Z.C.)
| | - Daoxing Guo
- College of Communications Engineering, Army Engineering University, Nanjing 210007, China; (X.Z.); (B.Z.); (Z.C.)
- Correspondence:
| |
Collapse
|
6
|
Wang C, Bian D, Zhang G, Cheng J, Li Y. A Novel Dynamic Spectrum-Sharing Method for Integrated Wireless Multimedia Sensors and Cognitive Satellite Networks. SENSORS 2018; 18:s18113904. [PMID: 30424583 PMCID: PMC6264101 DOI: 10.3390/s18113904] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 10/16/2018] [Revised: 11/03/2018] [Accepted: 11/10/2018] [Indexed: 12/04/2022]
Abstract
With the growing demand, Wireless Multimedia Sensor Networks (WMSNs) play an increasingly important role, which enhances the capacity of typical Wireless Sensor Networks (WSNs). Additionally, integrating satellite systems into WMSNs brings about the beneficial synergy, especially in rural and sparsely populated areas. However, the available spectrum resource is scarce, which contradicts the high-speed content required for multimedia. Cognitive radio is a promising solution to address the conflict. In this context, we propose a novel spectrum-sharing method for the integrated wireless multimedia sensor and cognitive satellite network based on the dynamic frequency allocation. Specifically, the Low Earth Orbit (LEO) satellite system plays the role of the auxiliary to connect sensor nodes and the remote control host, and it shares the same frequency with the Geostationary Earth Orbit (GEO) system in the downlink. Because the altitudes of GEO and LEO satellites differ greatly, the beam size of GEO is much larger than that of LEO, which provides the opportunity for LEO beam to reuse the frequency that was allocated to the GEO beam. A keep-out region is defined to guarantee the spectral coexistence based on the interference analysis in the worst case. In addition, a dynamic frequency allocation algorithm is presented to deal with the dynamic configuration caused by the satellite motion. Numerical results demonstrate that the dynamic spectrum-sharing method can improve the throughput.
Collapse
Affiliation(s)
- Chuang Wang
- College of Communications Engineering, Army Engineering University of PLA, Nanjing 210007, China.
| | - Dongming Bian
- College of Communications Engineering, Army Engineering University of PLA, Nanjing 210007, China.
| | - Gengxin Zhang
- College of Telecommunications and Information Engineering, Nangjing University of Posts and Telecommunications, Nanjing 210003, China.
| | - Jian Cheng
- College of Communications Engineering, Army Engineering University of PLA, Nanjing 210007, China.
| | - Yongqiang Li
- College of Communications Engineering, Army Engineering University of PLA, Nanjing 210007, China.
| |
Collapse
|
7
|
Guo K, An K, Zhang B, Huang Y, Guo D. On the Performance of Cognitive Satellite-Terrestrial Relay Networks with Channel Estimation Error and Hardware Impairments. SENSORS 2018; 18:s18103292. [PMID: 30274373 PMCID: PMC6210555 DOI: 10.3390/s18103292] [Citation(s) in RCA: 15] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 08/26/2018] [Revised: 09/20/2018] [Accepted: 09/28/2018] [Indexed: 11/21/2022]
Abstract
This paper investigates the joint impact of channel estimation errors (CEEs) and hardware impairments (HIs) on the performance of a cognitive satellite-terrestrial relay network (CSTRN), where the terrestrial and satellite links are considered following Rayleigh fading and shadowed Rician (SR) fading distributions, respectively. Besides, the terrestrial relay is working in half-duplex decode-and-forward (DF) mode. By employing a general and practical model to account for both the CEEs and HIs at each link, the end-to-end signal-to-noise-plus-distortion-and-error ratio (SNDER) is first obtained for the CSTRN. Then, closed-form expressions for the outage probability (OP) and throughput of the CSTRN are obtained, which allows us to demonstrate the aggregate impact of CEEs and HIs. In order to gain insightful findings, we further elaborate on the asymptotic OP and throughput at the high signal-to-noise-ratio (SNR) condition and quantitatively determine the fundamental performance ceiling. Finally, Monte Carlo (MC) computer simulations are provided to verify the correctness of the analytical results. Besides, with representative numerical analysis’s help, interesting findings are presented.
Collapse
Affiliation(s)
- Kefeng Guo
- College of Communication Engineering, Army Engineering University of PLA(Its Old Name Is PLA University of Science and Technology), Nanjing 210007, China.
| | - Kang An
- National University of Defense Technology, Nanjing 210016, China.
| | - Bangning Zhang
- College of Communication Engineering, Army Engineering University of PLA(Its Old Name Is PLA University of Science and Technology), Nanjing 210007, China.
| | - Yuzhen Huang
- Artificial Intelligence Research Center, National Innovation Institute of Defense Technology, Beijing 100091, China.
| | - Daoxing Guo
- College of Communication Engineering, Army Engineering University of PLA(Its Old Name Is PLA University of Science and Technology), Nanjing 210007, China.
| |
Collapse
|
8
|
Performance Analysis of Two-Way Satellite Multi-Terrestrial Relay Networks with Hardware Impairments. SENSORS 2018; 18:s18051574. [PMID: 29762518 PMCID: PMC5982951 DOI: 10.3390/s18051574] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/18/2018] [Revised: 05/02/2018] [Accepted: 05/12/2018] [Indexed: 11/17/2022]
Abstract
In this paper, we investigate the performance of a two-way hybrid satellite multi-terrestrial cooperative network with hardware impairments (HIs). Particularly, opportunistic relay selection scheme is employed in the considered network, which can substantially enhance the spectral efficiency and spatial diversity gain. By considering both the amplify-and-forward (AF) and decode-and-forward (DF) relay protocols, the closed-form expressions of the outage probability (OP) and throughput for the system are derived. Furthermore, in order to observe the effects of HIs level and the number of terrestrial relays on the system performance at high signal-to-noise ratios (SNRs), the asymptotic expressions of the system performance are also derived. Finally, computer results are presented to reveal the correctness of the analytical results.
Collapse
|