Approximate Dynamic Programming von Warren B. Powell | Solving the Curses of Dimensionality | ISBN 9780470182956

Approximate Dynamic Programming

Solving the Curses of Dimensionality

von Warren B. Powell
Buchcover Approximate Dynamic Programming | Warren B. Powell | EAN 9780470182956 | ISBN 0-470-18295-4 | ISBN 978-0-470-18295-6
"Perhaps the most appealing aspect of Professor Powell's bookis the fact that it spans both theory and practice. Problems, deemed intractable a few years ago, are now easily solved by usingthe exhibited techniques in this book. I would stronglyrecommend the book to any practitioner facing complex, dynamicmodels involving constantly changing information streams.„ (IIETransactions-Operations Engineering, 2008)“Focus[es] on the core. of dynamic programming with asimple and clear exposition of the material. while. elevating the standard of the theory.„*(Computing Reviews, May 5, 2008)“Motivated by examples from modern-day operationsresearch, Approximate Dynamic Programming is anaccessible introduction to dynamic modeling and is also a valuableguide for the development of high-quality solutions to problemsthat exist in operations research and engineering. (Mathematical Reviews, 2008)

Approximate Dynamic Programming

Solving the Curses of Dimensionality

von Warren B. Powell
A complete and accessible introduction to the real-worldapplications of approximate dynamic programming
With the growing levels of sophistication in modern-dayoperations, it is vital for practitioners to understand how toapproach, model, and solve complex industrial problems. ApproximateDynamic Programming is a result of the author's decades ofexperience working in large industrial settings to developpractical and high-quality solutions to problems that involvemaking decisions in the presence of uncertainty. Thisgroundbreaking book uniquely integrates four distinctdisciplines--Markov design processes, mathematicalprogramming, simulation, and statistics--to demonstrate how tosuccessfully model and solve a wide range of real-life problemsusing the techniques of approximate dynamic programming (ADP). Thereader is introduced to the three curses of dimensionality thatimpact complex problems and is also shown how the post-decisionstate variable allows for the use of classical algorithmicstrategies from operations research to treat complex stochasticoptimization problems.
Designed as an introduction and assuming no prior training indynamic programming of any form, Approximate Dynamic Programmingcontains dozens of algorithms that are intended to serve as astarting point in the design of practical solutions for realproblems. The book provides detailed coverage of implementationchallenges including: modeling complex sequential decisionprocesses under uncertainty, identifying robust policies, designingand estimating value function approximations, choosing effectivestepsize rules, and resolving convergence issues.
With a focus on modeling and algorithms in conjunction with thelanguage of mainstream operations research, artificialintelligence, and control theory, Approximate DynamicProgramming:
* Models complex, high-dimensional problems in a natural andpractical way, which draws on years of industrial projects * Introduces and emphasizes the power of estimating a valuefunction around the post-decision state, allowing solutionalgorithms to be broken down into three fundamental steps: classical simulation, classical optimization, and classicalstatistics * Presents a thorough discussion of recursive estimation, including fundamental theory and a number of issues that arise inthe development of practical algorithms * Offers a variety of methods for approximating dynamic programsthat have appeared in previous literature, but that have never beenpresented in the coherent format of a book
Motivated by examples from modern-day operations research, Approximate Dynamic Programming is an accessible introduction todynamic modeling and is also a valuable guide for the developmentof high-quality solutions to problems that exist in operationsresearch and engineering. The clear and precise presentation of thematerial makes this an appropriate text for advanced undergraduateand beginning graduate courses, while also serving as a referencefor researchers and practitioners. A companion Web site isavailable for readers, which includes additional exercises, solutions to exercises, and data sets to reinforce the book's mainconcepts.