Accession Number : AD0653116

Title :   THE LEARNING BEHAVIOR AND ERGODIC PROPERTY OF FINITE-STATE MARKOV CHAINS.

Descriptive Note : Technical rept. for 1 Jan 66-30 Jun 67,

Corporate Author : OHIO STATE UNIV RESEARCH FOUNDATION COLUMBUS

Personal Author(s) : Tou,J. T. ; Yeh,H. H.

Report Date : JUN 1967

Pagination or Media Count : 38

Abstract : The dynamic behavior of ergodic finite-state homogeneous Markov chains is studied. An ergodicity test of general natural is formulated. From this general test procedure, various test criteria are derived. One criterion is shown to be both necessary and sufficient. The ergodicity is found to be a topological property of the state flow graph of a finite-state homogeneous Markov chain or an equivalent stochastic automation. The dynamic behavior of an ergodic chain can be explained as a contraction mapping in the probability vector space. The norm of the induced transition probability matrix serves as pessimistic estimation of the learning rate.

Descriptors :   (*LEARNING, *BEHAVIOR), (*MEASURE THEORY, PROBABILITY), TOPOLOGY, MAPPING(TRANSFORMATIONS), STATISTICAL ANALYSIS, CONVERGENCE, THEOREMS, SEQUENCES(MATHEMATICS), SET THEORY, TRANSFORMATIONS(MATHEMATICS)

Subject Categories : Psychology
      Statistics and Probability

Distribution Statement : APPROVED FOR PUBLIC RELEASE