Accession Number : ADA303681

Title :   Software and Programs for Conducting Meta-Analysis Research: A Monte Carlo Investigation of Potential Differences.

Descriptive Note : Interim technical rept. Sep 91-Dec 94,

Corporate Author : ARMSTRONG LAB BROOKS AFB TX HUMAN RESOURCES DIRECTORATE

Personal Author(s) : Arthur, Winfred, Jr. ; Bennett, Winston, Jr. ; Huffcutt, Allen I.

PDF Url : ADA303681

Report Date : JUN 1995

Pagination or Media Count : 34

Abstract : With the increased popularity of meta-analysis, a number of articles have questioned and highlighted the role that judgment calls play in the implementation and, ultimately, outcomes of studies that use this technique. In the absence of standardized data analyses packages, coupled with the wide range of options available to meta-analysts, the current study investigated the effect of choice of data analysis programs on meta-analysis study outcomes. The objective of this Monte Carlo study was to investigate the extent to which four commonly used Schmidt and Hunter validity generalization-based meta-analysis software programs, all based on the same conceptual and theoretical assumptions, produced identical outcomes when used to analyze the same dataset. The results indicate that while there were some differences in values obtained from the programs, these differences tended to be very small, typically occurring in the fourth and sometimes fifth decimal place, and did not influence the meta- analytic outcomes. Finally, differences in the features and capabilities of each of the programs are presented and discussed.

Descriptors :   *COMPUTER PROGRAMS, *QUANTITATIVE ANALYSIS, *MONTE CARLO METHOD, *STATISTICAL PROCESSES, DATA PROCESSING, TOOLS, VARIATIONS, STANDARDIZATION, JUDGEMENT(PSYCHOLOGY).

Subject Categories : Statistics and Probability
      Computer Programming and Software

Distribution Statement : APPROVED FOR PUBLIC RELEASE