MC2 | AI, Metaverse, and Education

The Center for Metaverse and Computational Creativity (MC2) at HKUST(GZ) and HKUST is at the forefront of integrating cutting-edge technology into education through pioneering projects, exploring AI, Metaverse, and Education. Led by Prof Pan Hui, this initiative encompasses three main components: the Metaverse classroom, AI lecturers, and upcoming interactive AI lecturers. These projects aim to create immersive, cross-campus learning environments, introduce AI-driven teaching methods, and develop real-time interactive AI lecturers, thereby revolutionizing the educational landscape. This blog post delves into each of these groundbreaking initiatives, showcasing how they are reshaping the future of education.

Metaverse Classroom: Bridging Campuses through Immersive Learning

The Metaverse classroom is a revolutionary initiative designed to facilitate cross-campus study between HKUST's Hong Kong and Guangzhou campuses. By harnessing the immersive capabilities of the Metaverse, students from both locations can join and interact in a virtual environment, transcending geographical barriers and fostering collaborative learning. This initiative not only delivers a unique and engaging educational experience but also prepares students for a future where digital and physical worlds increasingly converge. The Metaverse classroom exemplifies how technology can create more inclusive and interactive learning environments, enhancing the overall educational experience.

A Vision of Metaverse Classrooms

MR Metaverse classroom allows students, instructors, and speakers located physically at HKUST(GZ), and HKUST(CWB) campus, or online to interact within the same activity (lecture, tutorial, seminar). Through MR, the virtual classroom enables users to attend a physical lecture on their home campus, while users from other campus and online users are represented through avatars.

Demonstration and Implementation: Capture of Moments

Metaverse classroom was used in EMIA 6500C Metaverse Cross-disciplinary Design Thinking (Fall 2023), showcasing its capabilities to both students and faculty. These sessions have highlighted the ease of use and the immersive nature of the platform, encouraging wider adoption across different courses. The implementation process has been smooth, with technical support provided to ensure seamless integration into the existing curriculum.

Design

Here we introduce the details of our design!

Students Response

Students responded enthusiastically to the Metaverse classroom, appreciating the ability to interact with peers and instructors in a fully immersive environment. This setup has enabled more dynamic and engaging class discussions, as well as collaborative projects that were previously limited by physical distance. Feedback from participants indicates that the Metaverse classroom has significantly enhanced their learning experience, making it more interactive and enjoyable.

Future Prospects

The Metaverse classroom exemplifies how technology can create more inclusive and interactive learning environments, enhancing the overall educational experience. As this initiative continues to evolve, it promises to set new standards for immersive learning, preparing students for a future where digital and physical worlds increasingly converge.

The First “AI Lecturers” in Higher Education: Pioneering AI-Driven Teaching

In Spring 2024, MC2 introduced ten AI lecturers in a cross-campus semester-long postgraduate course, CMAA5022/EMIA6500F Social Media for Creatives. This initiative marks the first instance globally where AI lecturers have taught a regular course for an entire semester.

Demonstration and Implementation: Capture of Moments

The AI lecturers were demonstrated through ten lectures in a semester where students could experience its teaching capabilities firsthand. The implementation involved integrating AI-driven lectures, facilitating discussions, and offering a brand new learning experience, all of which were well-received by the students. We ran research projects along with the course, investigating the key factors affecting teaching and learning experience, students' perception, as well as to explore the future implication

Student Response and Media Coverage

90% of our participants (students in the class, N=26) want to have (and looking forward to) digital teachers in the class and prefer engaging with DHs in more activities. Other than substitutability, our work suggests the media integration elements and digital teachers as complementary roles. The use of AI lecturers and Metaverse Classroom is a new initiative to foster cross-campus study in HK and Guangzhou, recognized by mass media, arousing public attention. The class was being visited, interviewed, and recorded by Cable TV, Agence France-Presse (AFP), Times Higher Education, VIORY, and more media conglomerates. AFP story sparked a new wave of extensive coverage from various corners of the globe. We have discovered over 100 clippings in mainland China, Japan, Singapore, Hong Kong SAR, France, Spain, and more.

Future Prospects

This pioneering effort demonstrates the potential of AI to enhance educational experiences and outcomes, setting a new standard for AI-driven teaching. The success of this initiative has paved the way for broader adoption of AI lecturers in various academic disciplines, promising a future where AI plays a crucial role in education.

[Coming Soon] Interactive AI Lecturers: Real-Time Engagement and Learning

Building on the success of the AI lecturers, MC2 is now developing interactive AI lecturers capable of answering students' questions in real time. This forthcoming innovation aims to further personalize and enhance the learning experience by providing immediate feedback and support, akin to human instructors. The interactive AI lecturers will enable more dynamic and responsive educational interactions, fostering deeper understanding and engagement. This project underscores the center's commitment to pushing the boundaries of educational technology, setting the stage for a new era of AI-driven learning.

Demonstration and Implementation