Accession Number : ADA113479

Title :   The Role of the Critic in Learning Systems,

Corporate Author : STANFORD UNIV CA DEPT OF COMPUTER SCIENCE

Personal Author(s) : Dietterich,T G ; Buchanan,B G

PDF Url : ADA113479

Report Date : Dec 1981

Pagination or Media Count : 24

Abstract : Buchanan, Mitchell, Smith, and Johnson (Buchanan 78a) described a general model of learning systems that included a component called the Critic. The task of the Critic was described as threefold: evaluation of the past actions of the performance element of the learning system, localization of credit and blame to particular portions of that performance element and recommendation of possible improvements and modifications in the performance element. This article analyzes these three tasks in detail and surveys the methods that have been employed in existing learning systems to accomplish them. The principle method used to evaluate the performance element is to develop a global performance standard by (a) consulting an external source of knowledge, (b) consulting an internal source of knowledge, or (c) conducting deep search. Credit and blame have been localized by (a) asking an external knowledge source to do the localization, (b) factoring the global performance standard to produce a local performance standard, and (c) conducting controlled experiments on the performance element. Recommendations have been communicated to the learning element using (a) local training instances, (b) correlation coefficients, and (c) partially-instantiated schemata. (Author)

Descriptors :   *Learning, *Decision theory, *Roles(Behavior), *Test and evaluation, *Performance(Human), Models, Modification, Global, Response, Stimuli

Subject Categories : Human Factors Engineering & Man Machine System

Distribution Statement : APPROVED FOR PUBLIC RELEASE