Accession Number : AD0434242

Title :   SEMI-MARKOVIAN CONTROL SYSTEMS,

Corporate Author : MASSACHUSETTS INST OF TECH CAMBRIDGE

Personal Author(s) : Howard,Ronald A.

Report Date : DEC 1963

Pagination or Media Count : 57

Abstract : A discussion is presented of a statistical model useful in analyzing a wide variety of common problems, problems in the areas of maintenance, replacement, marketing, finance, and inventory control. The basis for the present model is a decision model developed for strictly Markov processes, characterized as processes in which the main interest is on state transitions rather than on the time required for a transition. Other types of transition behavior was encouraged by the development of the semi-Markov process which allowed the time between transitions to be a random variable conditional on the transition made.A semi-Markov process has the same limiting state probabilities as an exponential Markov process with the same mean times for transitions, so the decision model can be extended to the semi-Markov process. Some of the results of this development are pointed out and it is shown how this increase in generality does not exact a computational penalty. (Author)

Descriptors :   (*CONTROL SYSTEMS, STATISTICAL PROCESSES), (*MANAGEMENT ENGINEERING, MATHEMATICAL MODELS), DECISION MAKING, OPTIMIZATION, MAINTENANCE, MONEY, ECONOMICS, OPERATIONS RESEARCH, SCHEDULING, CONTROL SEQUENCES, STOCHASTIC PROCESSES, PROBABILITY

Distribution Statement : APPROVED FOR PUBLIC RELEASE