Accession Number : ADA289480

Title :   Can There Be Reliability Without "Reliability?".

Descriptive Note : Final rept.,

Corporate Author : EDUCATIONAL TESTING SERVICE PRINCETON NJ

Personal Author(s) : Mislevy, Robert J.

PDF Url : ADA289480

Report Date : OCT 1994

Pagination or Media Count : 24

Abstract : A recent article by Pamela Moss asks the title question, 'Can there be validity without reliability?' If by reliability we mean only KR-2O coefficients or inter-rater correlations, the answer is yes. Sometimes these particular indices for evaluating evidence suit the problem we encounter; sometimes they don't. If by reliability we mean credibility of evidence, wehre credibility is defined as 'appropriate to the intended inference, the answer is no, we cannot have validity without reliability. Because 'validity' encompasses the process of reasoning as well as the data, uncritically accepting observations as strong evidence, when they may be incorrect, misleading, unrepresentative, or fraudulent, may lead coincidentally to correct conclusions but not to valid ones. This paper discusses and illustrates a broader conception of 'reliability' in educational assessment, to ground a deeper understanding of the issues raised by Professor Moss's question.

Descriptors :   *EDUCATION, *REASONING, *RELIABILITY, DECISION MAKING, VALIDATION, STUDENTS, CORRELATION, JUDGEMENT(PSYCHOLOGY), LEARNING, REACTION(PSYCHOLOGY).

Subject Categories : Psychology
      Humanities and History

Distribution Statement : APPROVED FOR PUBLIC RELEASE