DID YOU KNOW? DTIC has over 3.5 million final reports on DoD funded research, development, test, and evaluation activities available to our registered users. Click
HERE to register or log in.
Accession Number:
AD0656470
Title:
A CLASS OF MODELS FOR ADAPTIVE EXPERIMENTATION AND CONTROL.
Corporate Author:
MASSACHUSETTS INST OF TECH CAMBRIDGE OPERATIONS RESEARCH CENTER
Report Date:
1967-07-01
Abstract:
Solutions are presented for several control problems with discretely dynamic, stochastic, partially observable states in which the amount of experimentation at each stage constitutes an important control decision. Bayesian autoregressive time series models are given, both in general and assuming Normal density functions for the change process, data generator, and statistical description of the state. A general dynamic programming formulation for control of the known first-order process is obtained it is specialized to the case with quadratic cost of error and proportional cost of experimentation. The optimal experimental policy at every stage is found. The form of and numerical values for the steady state policy are presented. A set-up cost of experimentation is introduced, and a two-level experimental policy analogous to the s,S policy in inventory theory is obtained. The assumption of completely known process parameters is relaxed by allowing uncertainty in the precision of change. A three-variable dynamic programming formulation is solved for its optimal experimental policy, which is described by two critical numbers. A simple approximately optimal policy in terms of the earlier numerical results is proposed. Author
Descriptive Note:
Technical rept.,
Pages:
0136
Contract Number:
Nonr-1841(87)
File Size:
0.00MB
