Perturbations, Optimization, and Statistics

Perturbations, Optimization, and Statistics

Edited by  , Contributions by  , Contributions by  , Contributions by  , Contributions by  , Contributions by  , Contributions by  , Contributions by 

Free delivery worldwide

Available. Expected delivery to the United States in 9-14 business days.


Not ordering to the United States? Click here.

Description

A description of perturbation-based methods developed in machine learning to augment novel optimization methods with strong statistical guarantees.

In nearly all machine learning, decisions must be made given current knowledge. Surprisingly, making what is believed to be the best decision is not always the best strategy, even when learning in a supervised learning setting. An emerging body of work on learning under different rules applies perturbations to decision and learning procedures. These methods provide simple and highly efficient learning rules with improved theoretical guarantees. This book describes perturbation-based methods developed in machine learning to augment novel optimization methods with strong statistical guarantees, offering readers a state-of-the-art overview.

Chapters address recent modeling ideas that have arisen within the perturbations framework, including Perturb & MAP, herding, and the use of neural networks to map generic noise to distribution over highly structured data. They describe new learning procedures for perturbation models, including an improved EM algorithm and a learning algorithm that aims to match moments of model samples to moments of data. They discuss understanding the relation of perturbation models to their traditional counterparts, with one chapter showing that the perturbations viewpoint can lead to new algorithms in the traditional setting. And they consider perturbation-based regularization in neural networks, offering a more complete understanding of dropout and studying perturbations in the context of deep neural networks.
show more

Product details

  • Hardback | 412 pages
  • 203 x 254 x 24mm | 1,020.58g
  • MIT Press
  • Cambridge, United States
  • English
  • 174 b&w illus.; 348 Illustrations, unspecified
  • 0262035642
  • 9780262035644
  • 1,463,871

About Tamir Hazan

Tamir Hazan is Assistant Professor at Technion, Israel Institute of Technology. George Papandreou is a Research Scientist for Google, Inc. Daniel Tarlow is a Researcher at Microsoft Research Cambridge, UK. Alan Yuille is Professor in the Department of Statistics, University of California, Los Angeles. George Papandreou is a Research Scientist for Google, Inc. Daniel Tarlow is a Researcher at Microsoft Research Cambridge, UK. Tamir Hazan is Assistant Professor at Technion, Israel Institute of Technology. Tamir Hazan is Assistant Professor at Technion, Israel Institute of Technology. Tamir Hazan is Assistant Professor at Technion, Israel Institute of Technology. Ian Goodfellow is a Research Scientist at Google. Tamir Hazan is Assistant Professor at Technion, Israel Institute of Technology. George Papandreou is a Research Scientist for Google, Inc. Daniel Tarlow is a Researcher at Microsoft Research Cambridge, UK.
show more