journal article·2022-05-11Open access

Deep Reinforcement Learning-Based Relay Selection Algorithm in Free-Space Optical Cooperative Communications

Shi-Jie Gao, Ya-Tian Li, Tian-Wen Geng

Applied Sciences· Volume 12· Issue 10

Abstract

Relay-aided free-space optical (FSO) communication systems have the ability of mitigating the adverse effects of link disruption by dividing a long link into several short links. In order to solve the relay selection (RS) problem in a decode and forward (DF) relay-aided FSO system, we model the relay selection scheme as a Markov decision process (MDP). Based on a dueling deep Q-network (DQN), the DQN-RS algorithm is proposed, which aims at maximizing the average capacity. Different from relevant works, the switching loss between relay nodes is considered. Thanks to the advantage of maximizing cumulative rewards by deep reinforcement learning (DRL), our simulation results demonstrate that the proposed DQN-RS algorithm outperforms the traditional greedy method.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Optical Wireless Communication Technologies · Advanced Optical Network Technologies · Advanced Photonic Communication Systems

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Changchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences, Dongnanhu Road 3888, Changchun 130033, China

University of Chinese Academy of Sciences, Beijing 100049, China

Funding

National Natural Science Foundation of China · Funding Program of Innovation Labs by CIOMP

References (23)

Show source-provided references
1. Optical Wireless Communication Channel Measurements and Models10.1109/COMST.2018.2862141 ↗
2. Orbital angular momentum complex spectrum analyzer for vortex light based on the rotational Doppler effect10.1038/lsa.2016.251 ↗
3. Marbel, R., Yozevitch, R., Grinshpoun, T., and Ben-Moshe, B. (2022). Dynamic Network Formation for FSO Satellite Communication. Appl. Sci., 12.10.3390/app12020738 ↗
4. Chauhan, I., and Bhatnagar, M.R. (2022). Performance of Transmit Aperture Selection to Mitigate Jamming. Appl. Sci., 12.10.3390/app12042228 ↗
5. Taher, M.A., Abaza, M., Fedawy, M., and Aly, M.H. (2019). Relay Selection Schemes for FSO Communications over Turbulent Channels. Appl. Sci., 9.10.3390/app9071281 ↗
6. On the performances of relay-aided FSO system over m distribution with pointing errors in presence of various weather conditions10.1016/j.optcom.2016.01.004 ↗
7. SER performance investigation of a MPPM relay-aided FSO system with three decision thresholds over EW fading channel considering pointing errors10.1016/j.optcom.2021.126803 ↗
8. Analyzing selective relaying for multiple-relay–based differential DF-FSO network with pointing errors10.1002/ett.3306 ↗
9. Performance Analysis of All-Optical Amplify and Forward Relaying Over Log-Normal FSO Channels10.1364/JOCN.10.000079 ↗
10. Performance analysis of an asymmetric two-hop amplify-and-forward relaying RF–FSO system in a cognitive radio with partial relay selection10.1016/j.optcom.2021.127478 ↗
11. Joint Relay Selection and Power Allocation for Underwater Cooperative Optical Wireless Networks10.1109/TWC.2019.2943867 ↗
12. Innovative relay selection and optimize power allocation for free space optical communication10.1007/s11082-021-03313-z ↗
13. Impact of relay placement on diversity order in adaptive selective DF relay-assisted FSO communications10.1364/OE.23.002600 ↗
14. QoS and Energy Aware Optimal Resource Allocations in DF Relay-Assisted FSO Networks10.1109/TGCN.2020.2969422 ↗
15. Joint relay selection and link scheduling in cooperative free-space optical system10.1117/1.OE.55.11.111604 ↗
16. Round Robin, Centralized and Distributed Relay Selection for Free Space Optical Communications10.1007/s11277-019-06387-x ↗
17. Abou-Rjeily, C. (2022). Improved Buffer-Aided Selective Relaying for Free Space Optical Cooperative Communications. IEEE Trans. Wirel. Commun.10.1109/TWC.2022.3152852 ↗
18. Combined Relay Selection Enabled by Supervised Machine Learning10.1109/TVT.2021.3065074 ↗
19. Resource Allocation via Model-Free Deep Learning in Free Space Optical Communications10.1109/TCOMM.2021.3129199 ↗
20. Cooperative Communications with Relay Selection based on Deep Reinforcement Learning in Wireless Sensor Networks10.1109/JSEN.2019.2925719 ↗
21. Guo, S., and Zhao, X. (2022). Deep Reinforcement Learning Optimal Transmission Algorithm for Cognitive Internet of Things with RF Energy Harvesting. IEEE Trans. Cogn. Commun. Netw.10.1109/TCCN.2022.3142727 ↗
22. Relay Selection Protocols for relay-assisted Free Space Optical systems10.1364/JOCN.5.000092 ↗
23. Resource optimization for delay-tolerant data in blockchain-enabled IoT with edge computing: A deep reinforcement learning approach10.1109/JIOT.2020.3007869 ↗