Towards User-Centric Intelligent Network Selection in 5G Heterogeneous Wireless Networks: A Reinforcement Learning Perspective

✍ Scribed by Zhiyong Du, Bin Jiang, Qihui Wu, Yuhua Xu, Kun Xu

Publisher: Springer Singapore
Year: 2020
Tongue: English
Leaves: 142
Edition: 1st ed. 2020
Category: Library

No coin nor oath required. For personal study only.

✦ Synopsis

This book presents reinforcement learning (RL) based solutions for user-centric online network selection optimization. The main content can be divided into three parts. The first part (chapter 2 and 3) focuses on how to learning the best network when QoE is revealed beyond QoS under the framework of multi-armed bandit (MAB). The second part (chapter 4 and 5) focuses on how to meet dynamic user demand in complex and uncertain heterogeneous wireless networks under the framework of markov decision process (MDP). The third part (chapter 6 and 7) focuses on how to meet heterogeneous user demand for multiple users inlarge-scale networks under the framework of game theory. Efficient RL algorithms with practical constraints and considerations are proposed to optimize QoE for realizing intelligent online network selection for future mobile networks. This book is intended as a reference resource for researchers and designers in resource management of 5G networks and beyond.

✦ Table of Contents

Front Matter ....Pages i-xii
Introduction (Zhiyong Du, Bin Jiang, Qihui Wu, Yuhua Xu, Kun Xu)....Pages 1-10
Front Matter ....Pages 11-11
Learning the Optimal Network with Handoff Constraint: MAB RL Based Network Selection (Zhiyong Du, Bin Jiang, Qihui Wu, Yuhua Xu, Kun Xu)....Pages 13-31
Meeting Dynamic User Demand with Transmission Cost Awareness: CT-MAB RL Based Network Selection (Zhiyong Du, Bin Jiang, Qihui Wu, Yuhua Xu, Kun Xu)....Pages 33-52
Front Matter ....Pages 53-53
Meeting Dynamic User Demand with Handoff Cost Awareness: MDP RL Based Network Handoff (Zhiyong Du, Bin Jiang, Qihui Wu, Yuhua Xu, Kun Xu)....Pages 55-64
Learning the Optimal Network with Context Awareness: Transfer RL Based Network Selection (Zhiyong Du, Bin Jiang, Qihui Wu, Yuhua Xu, Kun Xu)....Pages 65-78
Front Matter ....Pages 79-79
Matching Heterogeneous User Demands: Localized Self-organization Game and MARL Based Network Selection (Zhiyong Du, Bin Jiang, Qihui Wu, Yuhua Xu, Kun Xu)....Pages 81-99
Exploiting User Demand Diversity: QoE Game and MARL Based Network Selection (Zhiyong Du, Bin Jiang, Qihui Wu, Yuhua Xu, Kun Xu)....Pages 101-130
Future Work (Zhiyong Du, Bin Jiang, Qihui Wu, Yuhua Xu, Kun Xu)....Pages 131-133
Back Matter ....Pages 135-136

✦ Subjects

Engineering; Wireless and Mobile Communication; Computer Communication Networks; Communications Engineering, Networks; Information and Communication, Circuits

📜 SIMILAR VOLUMES

Towards Wireless Heterogeneity in 6G Net

📁 Towards Wireless Heterogeneity in 6G Networks

✍ Abraham George, G. Ramana Murthy 📂 Library 📅 2024 🏛 CRC Press 🌐 English

The connected world paradigm effectuated through the proliferation of mobile devices, Internet of Things (IoT), and the metaverse will offer novel services in the coming years that need anytime, anywhere, high-speed access. The success of this paradigm will highly depend on the ability of the device

Towards 5G Wireless Networks: A Physical

📁 Towards 5G Wireless Networks: A Physical Layer Perspective

✍ Hossein Khaleghi Bizaki 📂 Library 📅 2016 🏛 ExLi4EvA 🌐 English

This book intends to provide highlights of the current research topics in the field of 5G and to offer a snapshot of the recent advances and major issues faced today by the researchers in the 5G physical layer perspective. Various aspects of 5G system is deeply discussed (in three parts and ten chap

Intelligent Resource Management for Netw

📁 Intelligent Resource Management for Network Slicing in 5G and Beyond (Wireless Networks)

✍ Qiang Ye, Weihua Zhuang 📂 Library 📅 2021 🏛 Springer 🌐 English

This book provides a timely and comprehensive study of developing efficient network slicing frameworks in both 5G wireless and core networks. It also presents protocol stack layer perspectives, which includes virtual network topology design, end-to-end delay modeling, dynamic resource slici

Cooperative Networking in a Heterogeneou

📁 Cooperative Networking in a Heterogeneous Wireless Medium

✍ Muhammad Ismail, Weihua Zhuang (auth.) 📂 Library 📅 2013 🏛 Springer-Verlag New York 🌐 English

This brief focuses on radio resource allocation in a heterogeneous wireless medium. It presents radio resource allocation algorithms with decentralized implementation, which support both single-network and multi-homing services. The brief provides a set of cooperative networking algorithms, which

Deep Reinforcement Learning for Wireless

📁 Deep Reinforcement Learning for Wireless Networks

✍ F. Richard Yu, Ying He 📂 Library 📅 2019 🏛 Springer International Publishing 🌐 English

This Springerbrief presents a deep reinforcement learning approach to wireless systems to improve system performance. Particularly, deep reinforcement learning approach is used in cache-enabled opportunistic interference alignment wireless networks and mobile social networks. Simulation result

Deep Reinforcement Learning for Wireless

📁 Deep Reinforcement Learning for Wireless Networks

✍ F. Richard Yu; Ying He 📂 Library 🌐 English