Accession Number:

AD0659726

Title:

SEPARABLE MARKOVIAN DECISION PROCESSES,

Descriptive Note:

Corporate Author:

RAND CORP SANTA MONICA CALIF

Personal Author(s):

Report Date:

1967-10-01

Pagination or Media Count:

28.0

Abstract:

The special structure of a class of Markovian decision problems is exploited to simplify the determination of optimum policies. For certain pairs consisting of a state i and decision k, the cost c subscript i superscript k separates c subscript i superscript k a sub i b sub k, while the transition probabilities p subscript ij superscript k and transition time distributions F subscript ij superscript k are independent of i. Equivalence of a second Markovian decision problem which exploits this structure is demonstrated for the discounted and averaging cases. In addition, streamlined approaches are presented for dealing directly with the original problem and a particular inventory model is further simplified. Author

Subject Categories:

  • Operations Research

Distribution Statement:

APPROVED FOR PUBLIC RELEASE