Markov Decision Processes
13%
off

Markov Decision Processes : Discrete Stochastic Dynamic Programming

4.71 (7 ratings by Goodreads)
By (author) 

Free delivery worldwide

Available. Dispatched from the UK in 3 business days
When will my order arrive?

Description

The Wiley-Interscience Paperback Series consists of selected books that have been made more accessible to consumers in an effort to increase global appeal and general circulation. With these new unabridged softcover volumes, Wiley hopes to extend the lives of these works by making them available to future generations of statisticians, mathematicians, and scientists. "This text is unique in bringing together so many results hitherto found only in part in other texts and papers...The text is fairly self-contained, inclusive of some basic mathematical results needed, and provides a rich diet of examples, applications, and exercises. The bibliographical material at the end of each chapter is excellent, not only from a historical perspective, but because it is valuable for researchers in acquiring a good perspective of the MDP research potential." -Zentralblatt fur Mathematik "...it is of great value to advanced-level students, researchers, and professional practitioners of this field to have now a complete volume (with more than 600 pages) devoted to this topic...Markov Decision Processes: Discrete Stochastic Dynamic Programming represents an up-to-date, unified, and rigorous treatment of theoretical and computational aspects of discrete-time Markov decision processes.
" -Journal of the American Statistical Association
show more

Product details

  • Paperback | 684 pages
  • 163 x 234 x 35mm | 1,048g
  • New York, United States
  • English
  • 1. Auflage
  • 0471727822
  • 9780471727828
  • 792,719

Back cover copy

The Wiley-Interscience Paperback Series consists of selected books that have been made more accessible to consumers in an effort to increase global appeal and general circulation. With these new unabridged softcover volumes, Wiley hopes to extend the lives of these works by making them available to future generations of statisticians, mathematicians, and scientists.

"This text is unique in bringing together so many results hitherto found only in part in other texts and papers. . . . The text is fairly self-contained, inclusive of some basic mathematical results needed, and provides a rich diet of examples, applications, and exercises. The bibliographical material at the end of each chapter is excellent, not only from a historical perspective, but because it is valuable for researchers in acquiring a good perspective of the MDP research potential."
--Zentralblatt fur Mathematik

." . . it is of great value to advanced-level students, researchers, and professional practitioners of this field to have now a complete volume (with more than 600 pages) devoted to this topic. . . . Markov Decision Processes: Discrete Stochastic Dynamic Programming represents an up-to-date, unified, and rigorous treatment of theoretical and computational aspects of discrete-time Markov decision processes."
--Journal of the American Statistical Association
show more

Table of contents

Preface. 1. Introduction. 2. Model Formulation. 3. Examples. 4. Finite-Horizon Markov Decision Processes. 5. Infinite-Horizon Models: Foundations. 6. Discounted Markov Decision Problems. 7. The Expected Total-Reward. Criterion. 8. Average Reward and Related Criteria. 9. The Average Reward Criterion-Multichain and Communicating Models. 10. Sensitive Discount Optimality. 11. Continuous-Time Models. Afterword. Notation. Appendix A. Markov Chains. Appendix B. Semicontinuous Functions. Appendix C. Normed Linear Spaces. Appendix D. Linear Programming. Bibliography. Index.
show more

About Martin L. Puterman

Martin L. Puterman, PhD, is Advisory Board Professor of Operations and Director of the Centre for Operations Excellence at The University of British Columbia in Vancouver, Canada.
show more

Rating details

7 ratings
4.71 out of 5 stars
5 71% (5)
4 29% (2)
3 0% (0)
2 0% (0)
1 0% (0)
Book ratings by Goodreads
Goodreads is the world's largest site for readers with over 50 million reviews. We're featuring millions of their reader ratings on our book pages to help you find your new favourite book. Close X