ERIC: Education Resources Information Center Skip main navigation

ED134612 - Effects of Item Characteristics on Test Fairness. Research Report 76-5.

Help Tutorial Help | Tutorial Help | Tutorial Help With This Page Help With This Page
Record Details

Full-Text Availability Options:

PDF ERIC Full Text (797K)

Click on any of the links below to perform a new search
ERIC #:ED134612
Title:Effects of Item Characteristics on Test Fairness. Research Report 76-5.
Authors:Pine, Steven M.; Weiss, David J.
Descriptors:Aptitude Tests; Bias; Computer Programs; Culture Fair Tests; Difficulty Level; Item Analysis; Military Service; Minority Groups; Models; Prediction; Selection; Simulation; Statistical Analysis; Test Bias; Test Construction; Test Items; Test Validity
Source:N/A
More Info:
Help
Peer-Reviewed:
N/A
Publisher:N/A
Publication Date:1976-12-00
Pages:46
Pub Types:Reports - Research
Abstract:This report examines how selection fairness is influenced by the item characteristics of a selection instrument in terms of its distribution of item difficulties, level of item discrimination, and degree of item bias. Computer simulation was used in the administration of conventional ability tests to a hypothetical target population consisting of a minority and a majority subgroup. Fairness was evaluated by three indices which reflect the degree of differential validity, errors in prediction (Cleary's model) and proportion of applicants exceeding a selection cutoff (Thorndike's model). Major findings were: (1) tests with a uniform distribution of difficulties had fairness properties generally superior to tests having a peaked distribution of item difficulties; (2) subgroup validity differences can be expected to occur when test items are biased against one of the subgroups; (3) when differential prediction is used, the Thorndike model reflects varying degrees of unfairness due to item bias and other test characteristics, while the Cleary and validity models do not; and (4) differential prediction provides fairer selection than the use of majority prediction only, regardless of the internal characteristics of the test, although substantial degrees of unfairness still exist under certain test item configurations. It was concluded that the internal characteristics of a selection instrument will affect the fairness of test scores in specific applications and that further research is needed to delineate which testing strategies and/or item characteristics are optimal in reducing unfairness. (Author)
Abstractor:N/A
Reference Count:0

Note:N/A
Identifiers:N/A
Record Type:Non-Journal
Level:1 - Available on microfiche
Institutions:Minnesota Univ., Minneapolis. Dept. of Psychology.
Sponsors:Office of Naval Research, Arlington, VA. Personnel and Training Research Programs Office.
ISBN:N/A
ISSN:N/A
Audiences:N/A
Languages:N/A
Education Level:N/A
 

ERIC Home