Rollout Policy Iteration and Distributed Reinforcement Learning is popular PDF and ePub book, written by Dimitri Bertsekas in 2021-08-20, it is a fantastic choice for those who relish reading online the Computers genre. Let's immerse ourselves in this engaging Computers book by exploring the summary and details provided below. Remember, Rollout Policy Iteration and Distributed Reinforcement Learning can be Read Online from any device for your convenience.
Rollout Policy Iteration and Distributed Reinforcement Learning Book PDF Summary
The purpose of this book is to develop in greater depth some of the methods from the author's Reinforcement Learning and Optimal Control recently published textbook (Athena Scientific, 2019). In particular, we present new research, relating to systems involving multiple agents, partitioned architectures, and distributed asynchronous computation. We pay special attention to the contexts of dynamic programming/policy iteration and control theory/model predictive control. We also discuss in some detail the application of the methodology to challenging discrete/combinatorial optimization problems, such as routing, scheduling, assignment, and mixed integer programming, including the use of neural network approximations within these contexts. The book focuses on the fundamental idea of policy iteration, i.e., start from some policy, and successively generate one or more improved policies. If just one improved policy is generated, this is called rollout, which, based on broad and consistent computational experience, appears to be one of the most versatile and reliable of all reinforcement learning methods. In this book, rollout algorithms are developed for both discrete deterministic and stochastic DP problems, and the development of distributed implementations in both multiagent and multiprocessor settings, aiming to take advantage of parallelism. Approximate policy iteration is more ambitious than rollout, but it is a strictly off-line method, and it is generally far more computationally intensive. This motivates the use of parallel and distributed computation. One of the purposes of the monograph is to discuss distributed (possibly asynchronous) methods that relate to rollout and policy iteration, both in the context of an exact and an approximate implementation involving neural networks or other approximation architectures. Much of the new research is inspired by the remarkable AlphaZero chess program, where policy iteration, value and policy networks, approximate lookahead minimization, and parallel computation all play an important role.
Detail Book of Rollout Policy Iteration and Distributed Reinforcement Learning PDF
- Author : Dimitri Bertsekas
- Release : 20 August 2021
- Publisher : Athena Scientific
- ISBN : 9781886529076
- Genre : Computers
- Total Page : 498 pages
- Language : English
- PDF File Size : 10,7 Mb
If you're still pondering over how to secure a PDF or EPUB version of the book Rollout Policy Iteration and Distributed Reinforcement Learning by Dimitri Bertsekas, don't worry! All you have to do is click the 'Get Book' buttons below to kick off your Download or Read Online journey. Just a friendly reminder: we don't upload or host the files ourselves.