Reinforcement Learning for Maritime Communications (Wireless Networks)

✍ Scribed by Liang Xiao, Helin Yang, Weihua Zhuang, Minghui Min

• Publisher: Springer
• Year: 2023
• Tongue: English
• Leaves: 155
• Category: Library

✦ Synopsis

This book demonstrates that the reliable and secure communication performance of maritime communications can be significantly improved by using intelligent reflecting surface (IRS) aided communication, privacy-aware Internet of Things (IoT) communications, intelligent resource management and location privacy protection. In the IRS aided maritime communication system, the reflecting elements of IRS can be intelligently controlled to change the phase of signal, and finally enhance the received signal strength of maritime ships (or sensors) or jam maritime eavesdroppers illustrated in this book.
The power and spectrum resource in maritime communications can be jointly optimized to guarantee the quality of service (i.e., security and reliability requirements), and reinforcement leaning is adopted to smartly choose the resource allocation strategy. Moreover, learning based privacy-aware offloading and location privacy protection are proposed to intelligently guarantee the privacy-preserving requirements of maritime ships or (sensors). Therefore, these communication schemes based on reinforcement learning algorithms can help maritime communication systems to improve the information security, especially in dynamic and complex maritime environments.
This timely book also provides broad coverage of the maritime wireless communication issues, such as reliability, security, resource management, and privacy protection. Reinforcement learning based methods are applied to solve these issues. This book includes four rigorously refereed chapters from prominent international researchers working in this subject area. The material serves as a useful reference for researchers, graduate students. Practitioners seeking solutions to maritime wireless communication and security related issues will benefit from this book as well.

✦ Table of Contents

Preface
Contents
1 Introduction
1.1 Maritime Communications
1.1.1 Related Works
1.1.2 Challenges
1.1.3 Secure Maritime Communications
1.1.4 Reliable Maritime Communications
1.2 Motivation and Objective
1.2.1 Learning-Based Secure Maritime Communications
1.2.2 Learning-Based Reliable Maritime Communications
1.3 Integrated Space-Air-Ground-Ocean Communication Networks
1.3.1 AI-Enabled Intelligent Space-Air-Ground-Ocean Communication Networks
1.3.2 AI Techniques for Maritime Communication Networks
1.4 Major Contributions and Structural Arrangements
References
2 Learning-Based Intelligent Reflecting Surface-Aided Secure Maritime Communications
2.1 Related Work
2.2 System Model and Problem Formulation
2.2.1 System Model
2.2.2 Problem Formulation
2.3 Problem Transformation Based on RL
2.4 Deep PDS-PER Learning-Based Secure Beamforming
2.4.1 Proposed Deep PDS-PER Learning
2.4.2 Secure Beamforming Based on Proposed Deep PDS-PER Learning
2.4.3 Computational Complexity Analysis
2.4.4 Implementation Details of DRL
2.5 Simulation Results and Analysis
2.6 Conclusion
References
3 Learning-Based Privacy-Aware Maritime IoT Communications
3.1 Introduction
3.1.1 Mobile Edge Computing
3.1.2 Energy Harvesting
3.1.3 Privacy in MEC IoTs
3.2 Related Work
3.3 System Model
3.4 Privacy in MEC
3.4.1 Privacy Issues in MEC
3.4.2 Location and Usage Pattern Privacy Protection
3.5 Learning-Based Privacy-Aware Offloading with Energy Harvesting
3.5.1 Privacy-Aware Offloading
3.5.2 Performance Analysis
3.6 Simulation Results
3.7 Conclusion
References
4 Learning-Based Resource Management for Maritime Communications
4.1 Reinforcement Learning Principle
4.2 Related Work
4.3 System Model and Problem Formulation
4.3.1 Network Requirements
4.3.2 Problem Formulation
4.4 Problem Transformation
4.5 Distributed Cooperative Multi-agent RL-Based Massive Access
4.5.1 Training Stage of Multi-agent RL for Massive Access
4.5.2 Distributed Cooperative Implementation of Multi-agent RL for Massive Access
4.5.3 Computational Complexity Analysis
4.6 Simulation Results and Analysis
4.6.1 Convergence Comparisons
4.6.2 Performance Comparisons Under Different Thresholds of Reliability and Latency
4.7 Intelligent Transmission Scheduling in Maritime Communications
4.8 Conclusion
References
5 Learning-Based Maritime Location Privacy Protection
5.1 Introduction
5.1.1 Maritime Location-Based Services and Location Privacy
5.1.2 Inference Attacks
5.1.3 Location Privacy Protection
5.2 Related Work
5.3 System Model
5.3.1 Network Model
5.3.2 Attack Model
5.3.3 Privacy Protection Problem
5.4 Semantic Location Privacy Protection
5.4.1 Learning-Based Semantic Location Perturbation
5.4.2 Deep RL-Based Semantic Location Perturbation
5.5 Simulation Results
5.6 Conclusion
References
6 Conclusions and Future Work
6.1 Conclusions
6.2 Future Work
References