front cover of Adaptive Sampling with Mobile WSN
Adaptive Sampling with Mobile WSN
Simultaneous robot localisation and mapping of paramagnetic spatio-temporal fields
Koushil Sreenath
The Institution of Engineering and Technology, 2011
Adaptive Sampling with Mobile WSN develops algorithms for optimal estimation of environmental parametric fields. With a single mobile sensor, several approaches are presented to solve the problem of where to sample next to maximally and simultaneously reduce uncertainty in the field estimate and uncertainty in the localisation of the mobile sensor while respecting the dynamics of the time-varying field and the mobile sensor. A case study of mapping a forest fire is presented. Multiple static and mobile sensors are considered next, and distributed algorithms for adaptive sampling are developed resulting in the Distributed Federated Kalman Filter. However, with multiple resources a possibility of deadlock arises and a matrix-based discrete-event controller is used to implement a deadlock avoidance policy. Deadlock prevention in the presence of shared and routing resources is also considered. Finally, a simultaneous and adaptive localisation strategy is developed to simultaneously localise static and mobile sensors in the WSN in an adaptive manner. Experimental validation of several of these algorithms is discussed throughout the book.
[more]

front cover of Optimal Adaptive Control and Differential Games by Reinforcement Learning Principles
Optimal Adaptive Control and Differential Games by Reinforcement Learning Principles
Draguna Vrabie
The Institution of Engineering and Technology, 2012
This book gives an exposition of recently developed approximate dynamic programming (ADP) techniques for decision and control in human engineered systems. ADP is a reinforcement machine learning technique that is motivated by learning mechanisms in biological and animal systems. It is connected from a theoretical point of view with both adaptive control and optimal control methods. The book shows how ADP can be used to design a family of adaptive optimal control algorithms that converge in real-time to optimal control solutions by measuring data along the system trajectories. Generally, in the current literature adaptive controllers and optimal controllers are two distinct methods for the design of automatic control systems. Traditional adaptive controllers learn online in real time how to control systems, but do not yield optimal performance. On the other hand, traditional optimal controllers must be designed offline using full knowledge of the systems dynamics. It is also shown how to use ADP methods to solve multi-player differential games online. Differential games have been shown to be important in H-infinity robust control for disturbance rejection, and in coordinating activities among multiple agents in networked teams. The focus of this book is on continuous-time systems, whose dynamical models can be derived directly from physical principles based on Hamiltonian or Lagrangian dynamics.
[more]


Send via email Share on Facebook Share on Twitter