Computer-based collaborative problem-solving assessment in Taiwan

Bor-Chen KUO, Chen-Huei LIAO, Kai-Chih PAI, Shu-Chuan SHIH, Cheng-Hsuan LI, Magdalena Mo Ching MOK

Research output: Contribution to journalArticles


The current study explores students' collaboration and problem solving (CPS) abilities using a human-to-agent (H-A) computer-based collaborative problem solving assessment. Five CPS assessment units with 76 conversation-based items were constructed using the PISA 2015 CPS framework. In the experiment, 53,855 ninth and tenth graders in Taiwan were recruited, and a multidimensional item response analysis was used to develop CPS scales and represent the students' collaboration and problem solving performance. The results show that the developed H-A approach is feasible for measuring students' CPS skills, and the CPS scales are also shown to be reliable. In addition, the students' CPS performance scores are further explored and discussed under the PISA CPS framework. Copyright © 2019 Informa UK Limited, trading as Taylor & Francis Group.
Original languageEnglish
JournalEducational Psychology
Early online dateJan 2019
Publication statusE-pub ahead of print - Jan 2019


Kuo, B.-C., Liao, C.-H., Pai, K.-C., Shih, S.-C., Li, C.-H., & Mok, M. M. C. (2019). Computer-based collaborative problem-solving assessment in Taiwan. Educational Psychology. Advance online publication. doi: 10.1080/01443410.2018.1549317


  • Collaborative problem solving (CPS)
  • Computerbased assessment
  • Multidimensional item response theory

Fingerprint Dive into the research topics of 'Computer-based collaborative problem-solving assessment in Taiwan'. Together they form a unique fingerprint.