Accession Number : ADA325908

Title :   A Reinforcement Learning Approach to Control.

Descriptive Note : Final rept.,

Corporate Author : AMHERST SYSTEMS INC BUFFALO NY

Personal Author(s) : Bandera, Cesar ; Scott, Peter ; Peng, Jing

PDF Url : ADA325908

Report Date : 31 MAY 1997

Pagination or Media Count : 63

Abstract : Active perception strategies are necessary for goal driven allocation of available resources to improve relevant information acquisition and optimize overall system performance. In addition to being both goal and data driven, these strategies must also account for the fact that information acquisition is inherently a partially observable Markov decision problem. This report describes an efficient, scalable reinforcement learning approach to the control of autonomous active vision that also satisfies the more stringent requirements of foveal machine vision. Foveal vision offers images with both wide field of view, useful for rapid detection, and a high acuity zone, useful for accurate recognition, without the overhead and errors inherent in dynamic registration of data from multiple sensors. However, space variant data acquisition inherent with foveal retinotopologies necessitates deployment of refined intelligent gaze control techniques. This report first lays a theoretical foundation for reinforcement learning. It then introduces the SARSA algorithm in conjunction with history augmentation as an effective learning control method for visual attention. The system is shown to perform well in both high and low SNR ATR environments. Reinforcement learning coupled with history features appears to be both a sound foundation and a practical scalable base for gaze control.

Descriptors :   *ROBOTICS, *ARTIFICIAL INTELLIGENCE, *CONDITIONING(LEARNING), ALGORITHMS, COMPUTERIZED SIMULATION, IMAGE PROCESSING, NEURAL NETS, ADAPTIVE CONTROL SYSTEMS, STOCHASTIC PROCESSES, ELECTROOPTICS, PARALLEL PROCESSING, APPROXIMATION(MATHEMATICS), DATA ACQUISITION, COMPUTER VISION, VISUAL PERCEPTION, MULTISENSORS, MARKOV PROCESSES.

Subject Categories : Cybernetics
      Bionics

Distribution Statement : APPROVED FOR PUBLIC RELEASE