Self-Learning Optimal Control of Nonlinear Systems : Adaptive Dynamic Programming Approach

✍ Scribed by Li, Benkai; Lin, Xiaofeng; Song, Ruizhuo; Wei, Qinglai

• Tongue: English
• Leaves: 240
• Series: Studies in Systems Decision and Control 103
• Category: Library

✦ Synopsis

This book presents a class of novel, self-learning, optimal control schemes based on adaptive dynamic programming techniques, which quantitatively obtain the optimal control schemes of the systems. It analyzes the properties identified by the programming methods, including the convergence of the iterative value functions and the stability of the system under iterative control laws, helping to guarantee the effectiveness of the methods developed. When the system model is known, self-learning optimal control is designed on the basis of the system model; when the system model is not known, adaptive dynamic programming is implemented according to the system data, effectively making the performance of the system converge to the optimum.

With various real-world examples to complement and substantiate the mathematical analysis, the book is a valuable guide for engineers, researchers, and students in control science and engineering.

✦ Table of Contents

Front Matter....Pages i-xvi
Principle of Adaptive Dynamic Programming....Pages 1-17
An Iterative (\epsilon ) -Optimal Control Scheme for a Class of Discrete-Time Nonlinear Systems with Unfixed Initial State....Pages 19-45
Discrete-Time Optimal Control of Nonlinear Systems via Value Iteration-Based ( Q ) -Learning....Pages 47-84
A Novel Policy Iteration-Based Deterministic Q-Learning for Discrete-Time Nonlinear Systems....Pages 85-109
Nonlinear Neuro-Optimal Tracking Control via Stable Iterative Q-Learning Algorithm....Pages 111-131
Model-Free Multiobjective Adaptive Dynamic Programming for Discrete-Time Nonlinear Systems with General Performance Index Functions....Pages 133-158
Multiobjective Optimal Control for a Class of Unknown Nonlinear Systems Based on Finite-Approximation-Error ADP Algorithm....Pages 159-183
A New Approach for a Class of Continuous-Time Chaotic Systems Optimal Control by Online ADP Algorithm....Pages 185-200
Off-Policy IRL Optimal Tracking Control for Continuous-Time Chaotic Systems....Pages 201-214
ADP-Based Optimal Sensor Scheduling for Target Tracking in Energy Harvesting Wireless Sensor Networks....Pages 215-228
Back Matter....Pages 229-230