
Accession Number : AD0653116
Title : THE LEARNING BEHAVIOR AND ERGODIC PROPERTY OF FINITESTATE MARKOV CHAINS.
Descriptive Note : Technical rept. for 1 Jan 6630 Jun 67,
Corporate Author : OHIO STATE UNIV RESEARCH FOUNDATION COLUMBUS
Personal Author(s) : Tou,J. T. ; Yeh,H. H.
Report Date : JUN 1967
Pagination or Media Count : 38
Abstract : The dynamic behavior of ergodic finitestate homogeneous Markov chains is studied. An ergodicity test of general natural is formulated. From this general test procedure, various test criteria are derived. One criterion is shown to be both necessary and sufficient. The ergodicity is found to be a topological property of the state flow graph of a finitestate homogeneous Markov chain or an equivalent stochastic automation. The dynamic behavior of an ergodic chain can be explained as a contraction mapping in the probability vector space. The norm of the induced transition probability matrix serves as pessimistic estimation of the learning rate.
Descriptors : (*LEARNING, *BEHAVIOR), (*MEASURE THEORY, PROBABILITY), TOPOLOGY, MAPPING(TRANSFORMATIONS), STATISTICAL ANALYSIS, CONVERGENCE, THEOREMS, SEQUENCES(MATHEMATICS), SET THEORY, TRANSFORMATIONS(MATHEMATICS)
Subject Categories : Psychology
Statistics and Probability
Distribution Statement : APPROVED FOR PUBLIC RELEASE