Accession Number : ADA195944

Title :   The Use of Videotape Technology to Train Administrators of Walk-Through Performance Testing.

Descriptive Note : Technical paper Feb 85-Mar 87,

Corporate Author : AIR FORCE HUMAN RESOURCES LAB BROOKS AFB TX

Personal Author(s) : Hedge, Jerry W ; Dickinson, Terry L ; Bierstedt, Sheryl A

PDF Url : ADA195944

Report Date : Jul 1988

Pagination or Media Count : 11

Abstract : When assessing the performance of individuals with work sample tests, it is essential that test administrators observe and rate performance accurately. The present effort used videotapes of work sample test performance with known target scores both as a training device to improve observational and rating skills as well as an evaluation tool to determine level of rater accuracy and identify type and frequency of rating errors. Data were collected from nine test administrators at two workshops held 2 1/2 months apart in a field test conducted in the interim between the two workshops. Rater accuracy and interrater agreement were measured for both workshops; only interrater agreement was measured during the field test. Results indicated high levels of accuracy and interrater agreement for the test administrators. Analyses of types and frequency of rating errors suggested that errors resulted most often from failure to identify correct performance when it occurred. Results are discussed in terms of the training and evaluation benefits of using videotape technology in work sample testing. Keywords: Interrater reliability, Job performance measurement, Performance measurement, Rater accuracy, Rater training, Walk through performance testing. (WTPT). (SDW)

Descriptors :   *PERFORMANCE TESTS, *TRAINING DEVICES, *VIDEO TAPES, ACCURACY, ADMINISTRATIVE PERSONNEL, AGREEMENTS, ERRORS, FIELD TESTS, FREQUENCY, HIGH RATE, JOBS, MEASUREMENT, PERFORMANCE(HUMAN), RATES, RATINGS, SCORING, SKILLS, TARGETS, TEST AND EVALUATION, TRAINING, WORKSHOPS

Subject Categories : Personnel Management and Labor Relations
      Psychology

Distribution Statement : APPROVED FOR PUBLIC RELEASE