Accession Number : ADA140295

Title :   Simulation Experiments with Goal-Seeking Adaptive Elements.

Descriptive Note : Final rept. Jun 80-Aug 83,

Corporate Author : MASSACHUSETTS UNIV AMHERST DEPT OF COMPUTER AND INFORMATION SCIENCE

Personal Author(s) : Barto,A G

PDF Url : ADA140295

Report Date : Feb 1984

Pagination or Media Count : 165

Abstract : This report describes results obtained from computer simulation experiments designed to systematically develop and evaluate an approach to learning by networks of neuronlike adaptive elements. The characterizing feature of this approach is that the network components, or adaptive elements, are self-interested, goal-seeking agents that implement robust algorithms for furthering their individual interests. These algorithms combine stochastic search and associative learning methods. Results show how these adaptive elements can cooperate as components of layered networks that adaptively create new features by combining existing features. Other simulation experiments are described that systematically examine the performance of individual adaptive elements in tasks that resemble the tasks faced by elements embedded within networks. The performances of a variety of algorithms are compared and contrasted. These results demonstrate the shortcomings of certain algorithms and the effectiveness of others. Experiments examine the effects on learning of delayed reinforcement. We justify the adaptive heuristic critic algorithm for reducing the severity of the temporal credit-assignment problem for tasks with delayed reinforcement. We illustrate the effectiveness of this algorithm in a task requiring the system to learn to control an unstable dynamical system under the influence of low-quality evaluative feedback.

Descriptors :   *COMPUTER LOGIC, *NETWORK FLOWS, *ADAPTIVE SYSTEMS, ARTIFICIAL INTELLIGENCE, LEARNING, ALGORITHMS, COMPUTERIZED SIMULATION, NETWORKS, NETWORK ANALYSIS(MANAGEMENT)

Subject Categories : Computer Systems
      Bionics

Distribution Statement : APPROVED FOR PUBLIC RELEASE