Accession Number : ADA194438

Title :   Effects of Rating Delay and True Halo in Laboratory-Based Performance Evaluations,

Corporate Author : AIR FORCE INST OF TECH WRIGHT-PATTERSON AFB OH

Personal Author(s) : Tallarigo, Richard S

PDF Url : ADA194438

Report Date : Jan 1987

Pagination or Media Count : 52

Abstract : Intervals of rating delay (immediate, one-day, two-day, seven-day) and levels of true halo (i.e., the median intercorrelations among criterion scores on the performance dimensions) were examined for effects on rater errors, raters accuracy, and convergent/discriminant validity. Raters were 293 undergraduates. Relationships among rating outcomes were also examined. Interactions between delay intervals and true halo (TH) were found for Differential Elevation (DEL) accuracy, and the rater errors of Observed Halo (OH) and Restriction of Range (ROR). These interactions suggested that (a) TH was positively correlated with DEL in the one-week delay condition but not in shorter intervals, (b) with increased rating delay, the correlation between TH and OH decreased, and (c) with increased rating delay, the correlation between TH and ROR decreased. Additional analyses indicated that TH was positively correlated with and predicted convergent validity. Relationships among rater error and rater accuracy scores indicated that observed leniency, OH, and ROR were not uniformly related to accuracy in predicted directions. It was concluded that the delay intervals studied had minimal independent influences on rating outcomes and that rater 'error' measures could not in all cases serve as meaningful measures of rating inaccuracy. Levels of true halo in rated performances need to be considered as well.

Descriptors :   *DELAY, *RATINGS, *TIME DEPENDENCE, ACCURACY, CONVERGENCE, DISCRIMINATE ANALYSIS, INTERVALS, VALIDATION, PERFORMANCE(HUMAN), JUDGEMENT(PSYCHOLOGY)

Subject Categories : Psychology

Distribution Statement : APPROVED FOR PUBLIC RELEASE