𝔖 Scriptorium
✦   LIBER   ✦

πŸ“

Stochastic Averaging and Stochastic Extremum Seeking

✍ Scribed by Shu-Jun Liu, Miroslav Krstic (auth.)


Publisher
Springer-Verlag London
Year
2012
Tongue
English
Leaves
225
Series
Communications and Control Engineering
Edition
1
Category
Library

⬇  Acquire This Volume

No coin nor oath required. For personal study only.

✦ Synopsis


Stochastic Averaging and Extremum Seeking treats methods inspired by attempts to understand the seemingly non-mathematical question of bacterial chemotaxis and their application in other environments. The text presents significant generalizations on existing stochastic averaging theory developed from scratch and necessitated by the need to avoid violation of previous theoretical assumptions by algorithms which are otherwise effective in treating these systems. Coverage is given to four main topics.
Stochastic averaging theorems are developed for the analysis of continuous-time nonlinear systems with random forcing, removing prior restrictions on nonlinearity growth and on the finiteness of the time interval. The new stochastic averaging theorems are usable not only as approximation tools but also for providing stability guarantees.
Stochastic extremum-seeking algorithms are introduced for optimization of systems without available models. Both gradient- and Newton-based algorithms are presented, offering the user the choice between the simplicity of implementation (gradient) and the ability to achieve a known, arbitrary convergence rate (Newton).
The design of algorithms for non-cooperative/adversarial games is described. The analysis of their convergence to Nash equilibria is provided. The algorithms are illustrated on models of economic competition and on problems of the deployment of teams of robotic vehicles.
Bacterial locomotion, such as chemotaxis in E. coli, is explored with the aim of identifying two simple feedback laws for climbing nutrient gradients. Stochastic extremum seeking is shown to be a biologically-plausible interpretation for chemotaxis. For the same chemotaxis-inspired stochastic feedback laws, the book also provides a detailed analysis of convergence for models of nonholonomic robotic vehicles operating in GPS-denied environments.
The book contains block diagrams and several simulation examples, including examples arising from bacterial locomotion, multi-agent robotic systems, and economic market models.
Stochastic Averaging and Extremum Seeking will be informative for control engineers from backgrounds in electrical, mechanical, chemical and aerospace engineering and to applied mathematicians. Economics researchers, biologists, biophysicists and roboticists will find the applications examples instructive.

✦ Table of Contents


Front Matter....Pages I-XI
Introduction to Averaging....Pages 1-10
Introduction to Extremum Seeking....Pages 11-20
Stochastic Averaging for Asymptotic Stability....Pages 21-55
Stochastic Averaging for Practical Stability....Pages 57-78
Single-parameter Stochastic Extremum Seeking....Pages 79-93
Stochastic Source Seeking for Nonholonomic Vehicles....Pages 95-119
Stochastic Source Seeking with Tuning of Forward Velocity....Pages 121-128
Multi-parameter Stochastic Extremum Seeking and Slope Seeking....Pages 129-146
Stochastic Nash Equilibrium Seeking for Games with General Nonlinear Payoffs....Pages 147-159
Nash Equilibrium Seeking for Quadratic Games and Applications to Oligopoly Markets and Vehicle Deployment....Pages 161-179
Newton-Based Stochastic Extremum Seeking....Pages 181-199
Back Matter....Pages 201-224

✦ Subjects


Control; Calculus of Variations and Optimal Control; Optimization; Game Theory/Mathematical Methods; Systems Biology; Robotics and Automation; Systems Theory, Control


πŸ“œ SIMILAR VOLUMES


Product of Random Stochastic Matrices an
✍ Behrouz Touri (auth.) πŸ“‚ Library πŸ“… 2012 πŸ› Springer-Verlag Berlin Heidelberg 🌐 English

<p><p>The thesis deals with averaging dynamics in a multiagent networked system, which is a main mechanism for diffusing the information over such networks. It arises in a wide range of applications in engineered physical networks (such as mobile communication and sensor networks), as well as social

Product of random stochastic matrices an
✍ Behrouz Touri πŸ“‚ Library πŸ“… 2012 πŸ› Springer 🌐 English

Introduction.- Products of Stochastic Matrices and Averaging Dynamics.- Ergodicity of Random Chains.- Infinite Flow Stability.- Implications.- Absolute Infinite Flow Property.- Averaging Dynamics in General State Spaces.- Conclusion and Suggestions for Future Works.- Appendices

Average-Cost Control of Stochastic Manuf
✍ Suresh P. Sethi, Han-Qin Zhang, Qing Zhang πŸ“‚ Library πŸ“… 1992 πŸ› Springer, Berlin 🌐 English

Most manufacturing systems are large, complex, and operate in an environment of uncertainty. It is common practice to manage such systems in a hierarchical fashion. This book articulates a new theory that shows that hierarchical decision making can in fact lead to a near optimization of system goals

Averageβ€”Cost Control of Stochastic Manuf
✍ Suresh P. Sethi, Hanqin Zhang, Qing Zhang (auth.) πŸ“‚ Library πŸ“… 2005 πŸ› Springer-Verlag New York 🌐 English

<p><P>This book is concerned with hierarchical control of manufacturing systems under uncertainty. It focuses on system performance measured in long-run average cost criteria, exploring the relationship between control problems with a discounted cost and that with a long-run average cost in connecti

Sojourns And Extremes of Stochastic Proc
✍ Simeon Berman (Author) πŸ“‚ Library πŸ“… 1992 πŸ› Chapman and Hall/CRC

<p>Sojourns and Extremes of Stochastic Processes is a research monograph in the area of probability theory. During the past thirty years Berman has made many contributions to the theory of the extreme values and sojourn times of the sample functions of broad classes of stochastic processes. These