Fuzzy cognitive diagnosis for modelling examinee performance

Qi LIU, Runze WU, Enhong CHEN, Guandong XU, Yu SU, Zhigang CHEN, Guoping HU

Research output: Contribution to journalArticlespeer-review

109 Citations (Scopus)

Abstract

Recent decades have witnessed the rapid growth of educational data mining (EDM), which aims at automatically extracting valuable information from large repositories of data generated by or related to people's learning activities in educational settings. One of the key EDM tasks is cognitive modelling with examination data, and cognitive modelling tries to profile examinees by discovering their latent knowledge state and cognitive level (e.g. the proficiency of specific skills). However, to the best of our knowledge, the problem of extracting information from both objective and subjective examination problems to achieve more precise and interpretable cognitive analysis remains underexplored. To this end, we propose a fuzzy cognitive diagnosis framework (FuzzyCDF) for examinees' cognitive modelling with both objective and subjective problems. Specifically, to handle the partially correct responses on subjective problems, we first fuzzify the skill proficiency of examinees. Then we combine fuzzy set theory and educational hypotheses to model the examinees' mastery on the problems based on their skill proficiency. Finally, we simulate the generation of examination score on each problem by considering slip and guess factors. In this way, the whole diagnosis framework is built. For further comprehensive verification, we apply our FuzzyCDF to three classical cognitive assessment tasks, i.e., predicting examinee performance, slip and guess detection, and cognitive diagnosis visualization. Extensive experiments on three real-world datasets for these assessment tasks prove that FuzzyCDF can reveal the knowledge states and cognitive level of the examinees effectively and interpretatively. Copyright © 2018 ACM.

Original languageEnglish
Article number48
JournalACM Transactions on Intelligent Systems and Technology
Volume9
Issue number4
Early online dateJan 2018
DOIs
Publication statusPublished - Jul 2018

Citation

Liu, Q., Wu, R., Chen, E., Xu, G., Su, Y., Chen, Z., & Hu, G. (2018). Fuzzy cognitive diagnosis for modelling examinee performance. ACM Transactions on Intelligent Systems and Technology, 9(4), Article 48. https://doi.org/10.1145/3168361

Fingerprint

Dive into the research topics of 'Fuzzy cognitive diagnosis for modelling examinee performance'. Together they form a unique fingerprint.