Accession Number : ADA190247

Title :   Aggregation and Time Scale Analysis of Perturbed Markov Systems.

Descriptive Note : Doctoral thesis,

Corporate Author : MASSACHUSETTS INST OF TECH CAMBRIDGE LAB FOR INFORMATION AND DECISION SYSTEMS

Personal Author(s) : Rohlicek, Jan R. ; Willsky, Alan S.

Report Date : JAN 1987

Pagination or Media Count : 210

Abstract : Analysis of systems with many time scales is important in many engineering applications. This thesis addresses the approximation and decomposition of Markov processes which exhibit such multiple time scales. An algorithm is presented for the decomposition of explicitly perturbed, finite state, continuous time Markov processes. An approximation of the probability transition function which converges uniformly to zero over T greater than or equal to O is obtained. The algorithm extends previous work by providing a straightforward algorithm which has a direct probabilistic interpretation, particularly with respect to the role played by transient states. This result is then extended to consider semi Markov and discrete time Markov processes as well. Decomposition of perturbed positive systems is also addressed. Finally, the Markov process decomposition algorithm is expressed in graphical terms and applied to a problem of determining the multiple time scale structure of a fault-tolerant system model.

Descriptors :   *MARKOV PROCESSES, *PROBABILITY DISTRIBUTION FUNCTIONS, ALGORITHMS, CONTINUOUS PROCESSING, DECOMPOSITION, FAULTS, GRAPHICS, MODELS, PERTURBATIONS, SCALE, TIME, TIME SERIES ANALYSIS, TOLERANCE, TRANSITIONS, THESES.

Subject Categories : Statistics and Probability

Distribution Statement : APPROVED FOR PUBLIC RELEASE