Predicting behavior change in students with special education needs using multimodal learning analytics

Rosanna Yuen-Yan CHAN, Chun Man Victor WONG, Yen Na Cherry YUM

Research output: Contribution to journalArticlespeer-review

2 Citations (Scopus)

Abstract

The availability of educational data in novel ways and formats brings new opportunities to students with special education needs (SEN), whose behaviour and learning are highly sensitive to their body conditions and surrounding environments. Multimodal learning analytics (MMLA) captures learner and learning environment data in various modalities and analyses them to explain the underlying educational insights. In this work, we applied MMLA to predict SEN students’ behaviour change upon their participation in applied behaviour analysis (ABA) therapies, where ABA therapy is an intervention in special education that aims at treating behavioural problems and fostering positive behaviour changes. Here we show that by inputting multimodal educational data, our machine learning models and deep neural network can predict SEN students’ behaviour change with optimum performance of 98% accuracy and 97% precision. We also demonstrate how environmental, psychological, and motion sensor data can significantly improve the statistical performance of predictive models with only traditional educational data. Our work has been applied to the Integrated Intelligent Intervention Learning (3I Learning) System, enhancing intensive ABA therapies for over 500 SEN students in Hong Kong and Singapore since 2020. Copyright © 2023 IEEE.
Original languageEnglish
Pages (from-to)63238-63251
JournalIEEE Access
Volume11
Early online dateJun 2023
DOIs
Publication statusPublished - 2023

Citation

Chan, R. Y.-Y., Wong, C. M. V., & Yum, Y. N. (2023). Predicting behavior change in students with special education needs using multimodal learning analytics. IEEE Access, 11, 63238-63251. https://doi.org/10.1109/ACCESS.2023.3288695

Keywords

  • Applied behavior analysis (ABA)
  • Multimodal learning analytics (MMLA)
  • Predictive modeling
  • Special education needs (SEN)

Fingerprint

Dive into the research topics of 'Predicting behavior change in students with special education needs using multimodal learning analytics'. Together they form a unique fingerprint.