Higher order testlet response models for hierarchical latent traits and testlet-based items

Hung-Yu HUANG, Wen Chung WANG

Research output: Contribution to journalArticle

8 Citations (Scopus)

Abstract

Both testlet design and hierarchical latent traits are fairly common in educational and psychological measurements. This study aimed to develop a new class of higher order testlet response models that consider both local item dependence within testlets and a hierarchy of latent traits. Due to high dimensionality, the authors adopted the Bayesian approach implemented in the WinBUGS freeware for parameter estimation. A series of simulations were conducted to evaluate parameter recovery, consequences of model misspecification, and effectiveness of model–data fit statistics. Results show that the parameters of the new models can be recovered well. Ignoring the testlet effect led to a biased estimation of item parameters, underestimation of factor loadings, and overestimation of test reliability for the first-order latent traits. The Bayesian deviance information criterion and the posterior predictive model checking were helpful for model comparison and model–data fit assessment. Two empirical examples of ability tests and nonability tests are given. Copyright © 2012 The Author(s) .
Original languageEnglish
Pages (from-to)491-511
JournalEducational and Psychological Measurement
Volume73
Issue number3
Early online dateAug 2012
DOIs
Publication statusPublished - Jun 2013

Fingerprint

Educational Measurement
Latent Trait
Bayes Theorem
Higher Order
Psychology
Biased Estimation
WinBUGS
Deviance Information Criterion
Bayesian Information Criterion
Model Misspecification
Model Comparison
Predictive Model
model comparison
Bayesian Approach
Model Checking
Dimensionality
Parameter Estimation
predictive model
Model checking
deviant behavior

Citation

Huang, H.-Y., & Wang, W.-C. (2013). Higher order testlet response models for hierarchical latent traits and testlet-based items. Educational and Psychological Measurement, 73(3), 491–511.

Keywords

  • Item response theory
  • Testlet response theory
  • Higher order models
  • Hierarchical latent trait
  • Bayesian methods