Modeling rapid guessing behaviors in computer-based testlet items

Kuan-Yu JIN, Chia-Ling HSU, Ming Ming CHIU, Po-Hsi CHEN

Research output: Contribution to journalArticlespeer-review

4 Citations (Scopus)


In traditional test models, test items are independent, and test-takers slowly and thoughtfully respond to each test item. However, some test items have a common stimulus (dependent test items in a testlet), and sometimes test-takers lack motivation, knowledge, or time (speededness), so they perform rapid guessing (RG). Ignoring the dependence in responses to testlet items can negatively bias standard errors of measurement, and ignoring RG by fitting a simpler item response theory (IRT) model can bias the results. Because computer-based testing captures response times on testlet responses, we propose a mixture testlet IRT model with item responses and response time to model RG behaviors in computer-based testlet items. Two simulation studies with Markov chain Monte Carlo estimation using the JAGS program showed (a) good recovery of the item and person parameters in this new model and (b) the harmful consequences of ignoring RG (biased parameter estimates: overestimated item difficulties, underestimated time intensities, underestimated respondent latent speed parameters, and overestimated precision of respondent latent estimates). The application of IRT models with and without RG to data from a computer-based language test showed parameter differences resembling those in the simulations. Copyright © 2022 The Author(s).

Original languageEnglish
Pages (from-to)19-33
JournalApplied Psychological Measurement
Issue number1
Early online dateSept 2022
Publication statusPublished - Jan 2023


Jin, K.-Y., Hsu, C.-L., Chiu, M. M., & Chen, P.-H. (2023). Modeling rapid guessing behaviors in computer-based testlet items. Applied Psychological Measurement, 47(1), 19-33. doi: 10.1177/01466216221125177


  • Multidimensional item response theory
  • Mixture model
  • Response time
  • Rapid guessing
  • Testlet


Dive into the research topics of 'Modeling rapid guessing behaviors in computer-based testlet items'. Together they form a unique fingerprint.