Work in progress: An AI-assisted metaverse for computer science education

Kin-Hon HO, Yun HOU, Chun Fai Carlin CHU, Chi-Kong CHAN, Haoyuan PAN, Tse Tin David CHAN

Research output: Chapter in Book/Report/Conference proceedingChapters

3 Citations (Scopus)

Abstract

This paper proposes the use of metaverse for computer science education by leveraging virtual reality (VR) and artificial intelligence (AI) technologies. VR glasses are used to record videos such as presentation slides and classroom lectures in the metaverse. AI technologies automatically generate customized class notes summarized from the video recordings. This education metaverse can accommodate students' digital avatars in different virtual workspaces, including collaboration spaces, laboratories, and classrooms. It consists of practical features that mimic a physical classroom setup, such as real-time voice chat, avatar movement, and shared screen presentations. In the metaverse journey, the AI notes generator module is used to create personalized class notes using technologies including optical character recognition, automatic speech recognition, natural language processing, and text-to-speech. We discuss current progress and future work to prototype an AI-assisted metaverse for proof-of-concept experiments in computer science education. Copyright © 2023 IEEE.
Original languageEnglish
Title of host publicationProceedings of 2023 IEEE World Engineering Education Conference (EDUNINE)
Place of PublicationDanvers, MA
PublisherIEEE
ISBN (Print)9798350320503
DOIs
Publication statusPublished - 2023

Citation

Ho, K.-H., Hou, Y., Chu, C. F. C., Chan, C.-K., Pan, H., & Chan, T.-T. (2023). Work in progress: An AI-assisted metaverse for computer science education. In Proceedings of 2023 IEEE World Engineering Education Conference (EDUNINE). Retrieved from https://doi.org/10.1109/EDUNINE57531.2023.10102819

Fingerprint

Dive into the research topics of 'Work in progress: An AI-assisted metaverse for computer science education'. Together they form a unique fingerprint.