Accession Number : AD0629375

Title :   DENUMERABLE STATE MARKOVIAN DECISION PROCESSES: AVERAGE COST CRITERION.

Descriptive Note : Technical rept.,

Corporate Author : STANFORD UNIV CALIF DEPT OF STATISTICS

Personal Author(s) : Derman,Cyrus

Report Date : 28 FEB 1966

Pagination or Media Count : 23

Abstract : Markovian decision processes with a countable number of states and average cost criterion are considered. Counterexamples are presented to show that optimal control rules need not exist or if they do exist they may not be of a deterministic stationary Markovian character. Conditions are presented under which optimal rules do exist and are stationary deterministic. Further conditions are presented under which a policy improvement procedure converges to an optimal rule. (Author)

Descriptors :   (*DECISION THEORY, OPTIMIZATION), (*DYNAMIC PROGRAMMING, DECISION MAKING), COSTS, STATISTICAL PROCESSES, SEQUENTIAL ANALYSIS, MANAGEMENT ENGINEERING

Subject Categories : Administration and Management
      Statistics and Probability

Distribution Statement : APPROVED FOR PUBLIC RELEASE