Adaptive Decision Making Using Probabilistic Programming and Stochastic Optimization
Technical Report,01 Nov 2016,01 Aug 2017
Carnegie Mellon University Pittsburgh United States
Pagination or Media Count:
This work seeks to understand the connections between learning and decision making under uncertainty. Specifically, we ask that question when we are going to use learned models within the loop of a larger decision making process, how should we alter the learning procedure or somehow tune the learning to the specific needs of the actual decision making task To answer this question, we developed a theory of task based model learning, learning models tuned not just for predictive accuracy, but to optimize the closed loop performance of a decision making procedure specifically, those based on stochastic optimization that uses these models as an intermediate step. Training such models requires that we differentiate through an optimization problem, for which we developed the theory and implementations. On several tasks, we show that such learning substantially outperforms traditional learning processes, where the learning and decision making stages are separate.
- Statistics and Probability