Accession Number : AD0783010

Title :   Partially Observable Markov Decision Processes with Applications.

Descriptive Note : Technical rept.,

Corporate Author : STANFORD UNIV CALIF DEPT OF OPERATIONS RESEARCH

Personal Author(s) : Hockstra,Dale J.

Report Date : 28 SEP 1973

Pagination or Media Count : 137

Abstract : The study examines a class of partially observable sequential decision models motivated by the process of machine maintenance and corrective action or medical diagnosis and treatment. Emphasis is placed on the dynamics of the state, i.e., the possibility that the machine (disease) state changes during the decision process. This is incorporated in the form of a Markov chain. It is also assumed that the state is only indirectly observable via outputs probabilistically related to the state. The end result is a model which is a discrete time Markov decision process with a continuous state space, a finite action space, and a special transition structure. (Modified author abstract)

Descriptors :   *Decision theory, Stochastic processes, Medical research, Mathematical models, Diagnosis(Medicine), Theorems, Markov processes

Subject Categories : Operations Research

Distribution Statement : APPROVED FOR PUBLIC RELEASE