
Accession Number : AD0659726
Title : SEPARABLE MARKOVIAN DECISION PROCESSES,
Corporate Author : RAND CORP SANTA MONICA CALIF
Personal Author(s) : Denardo,Eric V.
Report Date : OCT 1967
Pagination or Media Count : 28
Abstract : The special structure of a class of Markovian decision problems is exploited to simplify the determination of optimum policies. For certain pairs consisting of a state i and decision k, the cost c subscript i superscript k separates (c subscript i superscript k = a sub i + b sub k), while the transition probabilities p subscript ij superscript k and transition time distributions F subscript ij superscript k are independent of i. Equivalence of a second Markovian decision problem which exploits this structure is demonstrated for the discounted and averaging cases. In addition, streamlined approaches are presented for dealing directly with the original problem and a particular inventory model is further simplified. (Author)
Descriptors : (*STATISTICAL PROCESSES, OPERATIONS RESEARCH), (*INVENTORY CONTROL, MATHEMATICAL MODELS), (*DECISION THEORY, MANAGEMENT PLANNING AND CONTROL), OPTIMIZATION, MATHEMATICAL PROGRAMMING, MAINTENANCE, LINEAR PROGRAMMING
Subject Categories : Operations Research
Distribution Statement : APPROVED FOR PUBLIC RELEASE