Research Seminar
A Cognitive Diagnosis Model for Cogniutively-Based Multiple-Choice OptionsJimmy de la TorreRutgers University, US | |
| Abstract: | Cognitive or skill diagnosis models are discrete latent variable models developed specifically for the purpose of identifying the presence or absence of multiple fine-grained skills. However, applications of these models typically involve dichotomous or dichotomized data, including data from multiple-choice (MC) assessments that are scored as right ot wrong. This approach to the analysis of MC data ignores the potential diagnostic information that can be found in the distractors, and is therefore deemed diagnostically sub-optimal. To maximize the diagnostic value of MC assessments, this paper proposes a framework that prescribes how options of MC items should be constructed and analyzed. In constructing the options, attribute requirements are specified for both the key and some distractors. In analyzing data from such assessments, the MC-DINA model, an extension of the DINA model for coded MC options, is employed. The paper discusses the specification of the MC-DINA model, and estimation of its parameters. In addition, results of a simulation study evaluating the viability of the model and an estimation algorithm are presented. Finally, practical considerations concerning the proposed framework are proposed. |
| Date: | Tue Nov 27, 12:15 pm - 1:15 pm |
| Place: | room 00.60 (Department of Psychology, Tiensestraat 102, 3000 Leuven) |