Accession Number:

ADA470046

Title:

Controlled Stochastic Dynamical Systems

Descriptive Note:

Final rept. 1 Feb 2005-31 Jan 2007

Corporate Author:

IOWA STATE UNIV AMES

Personal Author(s):

Report Date:

2007-04-18

Pagination or Media Count:

17.0

Abstract:

In section 1, we describe our results on optimal control of a long term average cost rate problem. A new method, an Abelian limit approach is developed to solve this singular control problem. Abelian limit relations between three types of value functions are also developed. Results on two singular control problems arising from queueing networks in heavy traffic are described in section 2. There we derive an optimal buffer size for the singular control problem and it will yield asymptotically optimal buffer lengths for the corresponding queueing networks in heavy traffic. In section 3, the results on a combined control and stopping problem is described. Novelty feature here is that the diffusion coefficient is controlled and it is allowed to take the value zero. A martingale characterization is derived. Also, an explicit optimal strategy is obtained when the drift coefficient is linear. A stochastic differential game with degenerate variance control is described.

Subject Categories:

  • Statistics and Probability
  • Operations Research

Distribution Statement:

APPROVED FOR PUBLIC RELEASE