Reinforcement Learning for Optimal Feedback Control

✍ Scribed by Rushikesh Kamalapurkar, Patrick Walters, Joel Rosenfeld, Warren Dixon

Publisher: Springer International Publishing
Year: 2018
Tongue: English
Leaves: 305
Series: Communications and Control Engineering
Edition: 1st ed.
Category: Library

No coin nor oath required. For personal study only.

✦ Synopsis

Reinforcement Learning for Optimal Feedback Control develops model-based and data-driven reinforcement learning methods for solving optimal control problems in nonlinear deterministic dynamical systems. In order to achieve learning under uncertainty, data-driven methods for identifying system models in real-time are also developed. The book illustrates the advantages gained from the use of a model and the use of previous experience in the form of recorded data through simulations and experiments. The book’s focus on deterministic systems allows for an in-depth Lyapunov-based analysis of the performance of the methods described during the learning phase and during execution.

To yield an approximate optimal controller, the authors focus on theories and methods that fall under the umbrella of actor–critic methods for machine learning. They concentrate on establishing stability during the learning phase and the execution phase, and adaptive model-based and data-driven reinforcement learning, to assist readers in the learning process, which typically relies on instantaneous input-output measurements.

This monograph provides academic researchers with backgrounds in diverse disciplines from aerospace engineering to computer science, who are interested in optimal reinforcement learning functional analysis and functional approximation theory, with a good introduction to the use of model-based methods. The thorough treatment of an advanced treatment to control will also interest practitioners working in the chemical-process and power-supply industry.

✦ Table of Contents

Front Matter ....Pages i-xvi
Optimal Control (Rushikesh Kamalapurkar, Patrick Walters, Joel Rosenfeld, Warren Dixon)....Pages 1-16
Approximate Dynamic Programming (Rushikesh Kamalapurkar, Patrick Walters, Joel Rosenfeld, Warren Dixon)....Pages 17-42
Excitation-Based Online Approximate Optimal Control (Rushikesh Kamalapurkar, Patrick Walters, Joel Rosenfeld, Warren Dixon)....Pages 43-98
Model-Based Reinforcement Learning for Approximate Optimal Control (Rushikesh Kamalapurkar, Patrick Walters, Joel Rosenfeld, Warren Dixon)....Pages 99-148
Differential Graphical Games (Rushikesh Kamalapurkar, Patrick Walters, Joel Rosenfeld, Warren Dixon)....Pages 149-193
Applications (Rushikesh Kamalapurkar, Patrick Walters, Joel Rosenfeld, Warren Dixon)....Pages 195-225
Computational Considerations (Rushikesh Kamalapurkar, Patrick Walters, Joel Rosenfeld, Warren Dixon)....Pages 227-263
Back Matter ....Pages 265-293

✦ Subjects

Engineering; Control; Calculus of Variations and Optimal Control; Optimization; Systems Theory, Control; Communications Engineering, Networks

📜 SIMILAR VOLUMES

Reinforcement Learning Aided Performance

📁 Reinforcement Learning Aided Performance Optimization of Feedback Control Systems

✍ Changsheng Hua 📂 Library 📅 2021 🏛 Springer Vieweg 🌐 English

Changsheng Hua proposes two approaches, an input/output recovery approach and a performance index-based approach for robustness and performance optimization of feedback control systems. For their data-driven implementation in deterministic and stochastic systems, the author develops Q-learning an

Reinforcement Learning Aided Performance

📁 Reinforcement Learning Aided Performance Optimization of Feedback Control Systems

✍ Changsheng Hua 📂 Library 📅 2021 🏛 Springer Vieweg 🌐 English

Changsheng Hua proposes two approaches, an input/output recovery approach and a performance index-based approach for robustness and performance optimization of feedback control systems. For their data-driven implementation in deterministic and stochastic systems, the author develops Q-learn

Reinforcement Learning: Optimal Feedback

📁 Reinforcement Learning: Optimal Feedback Control with Industrial Applications (Advances in Industrial Control)

✍ Jinna Li, Frank L. Lewis, Jialu Fan 📂 Library 📅 2023 🏛 Springer 🌐 English

This book offers a thorough introduction to the basics and scientific and technological innovations involved in the modern study of reinforcement-learning-based feedback control. The authors address a wide variety of systems including work on nonlinear, networked, multi-agent and multi-play

Reinforcement Learning: Optimal Feedback

📁 Reinforcement Learning: Optimal Feedback Control with Industrial Applications (Advances in Industrial Control)

✍ Jinna Li, Frank L. Lewis, Jialu Fan 📂 Library 📅 2023 🏛 Springer 🌐 English

Output Feedback Reinforcement Learning C

📁 Output Feedback Reinforcement Learning Control for Linear Systems

✍ Syed Ali Asad Rizvi, Zongli Lin 📂 Library 📅 2022 🏛 Birkhäuser 🌐 English

This monograph explores the analysis and design of model-free optimal control systems based on reinforcement learning (RL) theory, presenting new methods that overcome recent challenges faced by RL. New developments in the design of sensor data efficient RL algorithms are demonstrated that no

Reinforcement Learning and Approximate D

📁 Reinforcement Learning and Approximate Dynamic Programming for Feedback Control

✍ Frank L. Lewis, Derong Liu 📂 Library 📅 2012 🏛 Wiley-IEEE Press 🌐 English

Reinforcement learning (RL) and adaptive dynamic programming (ADP) has been one of the most critical research fields in science and engineering for modern complex systems. This book describes the latest RL and ADP techniques for decision and control in human engineered systems, covering both single