Accession Number : AD0755442

Title :   Approximations, Existence, and Numerical Procedures for Optimal Stochastic Controls.

Descriptive Note : Technical rept.,

Corporate Author : BROWN UNIV PROVIDENCE R I CENTER FOR DYNAMICAL SYSTEMS

Personal Author(s) : Kushner,Harold J. ; Yu,Chen-Fu

Report Date : JAN 1973

Pagination or Media Count : 49

Abstract : In the paper, the authors prove several convergence results for a numerical method in optimal stochastic control, based on finite difference approximations to the non-linear Bellman partial differential equation for the optimal cost. As a very useful by-product to the main development, the authors obtain new existence results for optimal controls, and interesting results on the approximation of a controlled diffusion by a controlled Markov chain. The methods and results are new, and depend on results concerning weak convergence of probability measures. The methods seem to be quite powerful, and have applications to many other problems in approximation and control. (Author)

Descriptors :   (*ADAPTIVE CONTROL SYSTEMS, MATHEMATICAL MODELS), STOCHASTIC PROCESSES, PARTIAL DIFFERENTIAL EQUATIONS, DIFFERENCE EQUATIONS, MEASURE THEORY, APPROXIMATION(MATHEMATICS), NUMERICAL ANALYSIS, OPTIMIZATION

Subject Categories : Statistics and Probability

Distribution Statement : APPROVED FOR PUBLIC RELEASE