Accession Number : ADA111805

Title :   Row-Continuous Finite Markov Chains, Structure and Algorithms.

Descriptive Note : Scientific rept. no. 3,

Corporate Author : ROCHESTER UNIV NY GRADUATE SCHOOL OF MANAGEMENT

Personal Author(s) : Keilson,J ; Sumita,U ; Zachmann,M

PDF Url : ADA111805

Report Date : Mar 1981

Pagination or Media Count : 46

Abstract : For any finite bivariate Markov chain J(t), N(t) on state space for which row-continuity is present, i.e., N(t) changes by at most one at transitions, the ergodic distribution and mean passage times may be found by a simple algorithm. Related structure will be described. The procedure is based on probabilistic insights associated with semi-Markov processes and birth-death processes. The resulting algorithms enable efficient treatment of chains with as many as 5000 = 50 x 100 states or more. Such bivariate chains are of importance to countless applied models in congestion theory, inventory theory, computer design, etc. The algorithm developed is to be used as a basis for calculating the distribution of the maximum of certain stationary meteorological processes over a specified interval.

Descriptors :   *MARKOV PROCESSES, PROBABILITY DISTRIBUTION FUNCTIONS, BIVARIATE ANALYSIS, BIVARIATE DENSITY FUNCTIONS, TIME, CONTINUITY, ALGORITHMS, MEAN

Subject Categories : Statistics and Probability

Distribution Statement : APPROVED FOR PUBLIC RELEASE