Accession Number : AD0659726

Title :   SEPARABLE MARKOVIAN DECISION PROCESSES,

Corporate Author : RAND CORP SANTA MONICA CALIF

Personal Author(s) : Denardo,Eric V.

Report Date : OCT 1967

Pagination or Media Count : 28

Abstract : The special structure of a class of Markovian decision problems is exploited to simplify the determination of optimum policies. For certain pairs consisting of a state i and decision k, the cost c subscript i superscript k separates (c subscript i superscript k = a sub i + b sub k), while the transition probabilities p subscript ij superscript k and transition time distributions F subscript ij superscript k are independent of i. Equivalence of a second Markovian decision problem which exploits this structure is demonstrated for the discounted and averaging cases. In addition, streamlined approaches are presented for dealing directly with the original problem and a particular inventory model is further simplified. (Author)

Descriptors :   (*STATISTICAL PROCESSES, OPERATIONS RESEARCH), (*INVENTORY CONTROL, MATHEMATICAL MODELS), (*DECISION THEORY, MANAGEMENT PLANNING AND CONTROL), OPTIMIZATION, MATHEMATICAL PROGRAMMING, MAINTENANCE, LINEAR PROGRAMMING

Subject Categories : Operations Research

Distribution Statement : APPROVED FOR PUBLIC RELEASE