Accession Number:

ADA052895

Title:

Computation Techniques for Large Scale Undiscounted Markov Decision Processes.

Descriptive Note:

Research rept.,

Corporate Author:

FLORIDA UNIV GAINESVILLE DEPT OF INDUSTRIAL AND SYSTEMS ENGINEERING

Personal Author(s):

Report Date:

1978-03-01

Pagination or Media Count:

28.0

Abstract:

This paper considers computation techniques associated with the optimization of large scale Markov decision processes. Markov decision processes and successive approximation procedures are described. Then a procedure for scaling continuous time and renewal processes so that they are amenable to the second procedure is discussed. The effect of the scale factor value on the convergence rate of the procedure and insights into proper scale factor selection are given. Finally, various methods of achieving computational efficiency during execution of the optimization are considered.

Subject Categories:

  • Statistics and Probability

Distribution Statement:

APPROVED FOR PUBLIC RELEASE