Please use this identifier to cite or link to this item: https://hdl.handle.net/10356/99306
Title: Adaptive testing with multidimensional pairwise preference items : improving the efficiency of personality and other noncognitive assessments
Authors: Stark, Stephen E.
Chernyshenko, Oleksandr S.
White, Leonard A.
Drasgow, Fritz
Keywords: DRNTU::Business
Issue Date: 2012
Source: Stark, S., Chernyshenko, O. S., Drasgow, F., & White, L. A. (2012). Adaptive testing with multidimensional pairwise preference items : improving the efficiency of personality and other noncognitive assessments. Organizational Research Methods, 15(3), 463-487.
Series/Report no.: Organizational research methods
Abstract: Assessment of noncognitive constructs in organizational research and practice is challenging because of response biases that can distort test scores. Researchers must also deal with time constraints and the ensuing trade-offs between test length and the number of constructs measured. This article describes a novel way of improving the efficiency of noncognitive assessments using computer adaptive testing (CAT) with multidimensional pairwise preference (MDPP) items. Tests composed of MDPP items are part of a broader family of forced choice measures that ask respondents to choose between two or more equally desirable statements in an effort to combat response distortion. The authors conducted four computer simulations to explore the influences of test design, dimensionality, and the advantages of adaptive item selection for trait score and error estimation with tests involving as many as 25 dimensions. Overall, adaptive MDPP testing produced gains in accuracy over nonadaptive MDPP tests comparable to those observed with traditional unidimensional CATs. In addition, an empirical illustration involving a 15-dimension MDPP CAT administered in a field setting showed patterns of correlations that were consistent with expectations, thus showing construct validity.
URI: https://hdl.handle.net/10356/99306
http://hdl.handle.net/10220/17214
DOI: http://dx.doi.org/10.1177/1094428112444611
Fulltext Permission: none
Fulltext Availability: No Fulltext
Appears in Collections:NBS Journal Articles

Google ScholarTM

Check

Altmetric

Items in DR-NTU are protected by copyright, with all rights reserved, unless otherwise indicated.