Multilevel modeling of cognitive diagnostic assessment: The multilevel DINA example

Wen Chung WANG, Xuelan QIU

Research output: Contribution to journalArticle

1 Citation (Scopus)

Abstract

Many multilevel linear and item response theory models have been developed to account for multilevel data structures. However, most existing cognitive diagnostic models (CDMs) are unilevel in nature and become inapplicable when data have a multilevel structure. In this study, using the log-linear CDM as the item-level model, multilevel CDMs were developed based on the latent continuous variable approach and the multivariate Bernoulli distribution approach. In a series of simulations, the newly developed multilevel deterministic input, noisy, and gate (DINA) model was used as an example to evaluate the parameter recovery and consequences of ignoring the multilevel structures. The results indicated that all parameters in the new multilevel DINA were recovered fairly well by using the freeware Just Another Gibbs Sampler (JAGS) and that ignoring multilevel structures by fitting the standard unilevel DINA model resulted in poor estimates for the student-level covariates and underestimated standard errors, as well as led to poor recovery for the latent attribute profiles for individuals. An empirical example using the 2003 Trends in International Mathematics and Science Study eighth-grade mathematical test was provided. Copyright © 2018 The Author(s).
Original languageEnglish
Pages (from-to)34-50
JournalApplied Psychological Measurement
Volume43
Issue number1
Early online dateApr 2018
DOIs
Publication statusPublished - Jan 2019

Fingerprint

Binomial Distribution
Mathematics
diagnostic
Students
mathematics studies
model theory
science studies
simulation
trend

Bibliographical note

Wang, W.-C., & Qiu, X.-L. (2019). Multilevel modeling of cognitive diagnostic assessment: The multilevel DINA example. Applied Psychological Measurement, 43(1), 34-50. doi: 10.1177/0146621618765713

Keywords

  • Cognitive diagnostic assessment
  • Multilevel models
  • Large-scale assessment
  • Bayesian methods