A holistic visualisation solution to understanding multimodal data in an educational metaverse platform: Learningverse

Yanjie SONG, Jiaxin CAO, Lei TAO, Dragan GAŠEVIĆ

Research output: Chapter in Book/Report/Conference proceedingChapters

Abstract

Traditional digital learning environments faced challenges in obtaining comprehensive user interaction data, often yielding fragmented insights without a cohesive visual representation. The emergence of metaverse platforms has enriched this landscape, enabling detailed user activity representation with multimodal data through avatars. However, how to understand the multimodal data related to teaching, social and cognitive presences underpinned by the 'Community of Inquiry' theoretical framework in the metaverse is a big challenge for educators. This study introduces a holistic visualisation solution to bridge this gap, ensuring a better understanding of avatars’ behaviours in an educational metaverse platform – Learningverse developed by our research team. The solution captures a range of multimodal data in Learningverse, such as avatar location, behaviours, emotions, and conversation. Key visualisation elements include heatmaps, points, and arrows, each with distinct informational value. In the future, integrating the solution with multimodal learning analytics is our next step work to understand teaching, social and cognitive presences. Copyright © 2023 Asia-Pacific Society for Computers in Education.

Original languageEnglish
Title of host publicationProceedings of 31st International Conference on Computers in Education, ICCE 2023
Place of PublicationTaiwan
PublisherAsia-Pacific Society for Computers in Education
Pages1064-1067
VolumeII
ISBN (Electronic)9786269689026
Publication statusPublished - 2023

Citation

Song, Y., Cao, J., Tao, L., & Gašević, D. (2023). A holistic visualisation solution to understanding multimodal data in an educational metaverse platform: Learningverse. In Proceedings of 31st International Conference on Computers in Education, ICCE 2023 (Vol. II, pp. 1064-1067). Asia-Pacific Society for Computers in Education.

Keywords

  • Metaverse
  • Learningverse
  • Holistic visualisation solution
  • Community of Inquiry

Fingerprint

Dive into the research topics of 'A holistic visualisation solution to understanding multimodal data in an educational metaverse platform: Learningverse'. Together they form a unique fingerprint.