Accession Number : ADA317650

Title :   Generalizability Theory as Evidence of the Reliability and Validity of Work Sample Tests and Proficiency Ratings.

Descriptive Note : Interim rept. Sep 93-Jun 95,

Corporate Author : COLORADO UNIV AT DENVER DEPT OF PSYCHOLOGY

Personal Author(s) : Kraiger, Kurt ; Teachout, Mark S.

PDF Url : ADA317650

Report Date : DEC 1995

Pagination or Media Count : 25

Abstract : This paper uses generalizability (G) theory as a framework to investigate the reliability and construct validity of the Air Force Job Performance Measurement System. G theory was a useful technique for examining the psychometric quality of the measurement system because it permits the specification and estimation of multiple sources of measurement error. G theory was applied to newly developed work sample procedures, Walk-Through performance Tests and to a series of job proficiency ratings comprised of four different rating forms collected from three rating sources. The results provided evidence of strong convergent and discriminant validity of these work sample tests, strong convergent validity across rating forms, and moderate discriminant validity of the rating system. However, ratings did not generalize across self, peer and supervisor rating sources. Results are discussed in terms of their practical and theoretical implications.

Descriptors :   *PERFORMANCE(HUMAN), *PSYCHOMETRICS, VALIDATION, PERFORMANCE TESTS, ANALYSIS OF VARIANCE, AIR FORCE PERSONNEL, RELIABILITY, RATINGS, PROFICIENCY, JOB ANALYSIS, MILITARY OCCUPATIONAL SPECIALTIES, DISCRIMINATE ANALYSIS.

Subject Categories : Psychology
      Personnel Management and Labor Relations

Distribution Statement : APPROVED FOR PUBLIC RELEASE