Topic 3. 

Multimodal Content Creation

10 minutes, that is all it took. 

Have you visited the LiDA center's virtual showcase room? With the support of GenAI, our center staff with a minimal experience/knowledge on virtual space was able to create this space within just 10 minutes. Watch the video to see what it looked like! 

Unleash your creativity with Generative AI


As you could see in our 10-minute virtual space creation, generative AI can be used to create multimodal  contenct (e.g., teaching materials), unlocking a world of possibilities for educators. The AI-powered system can generate images, text, audio, and more, allowing you to quickly create engaging and interactive material for your students. This technology makes it easy to create new and exciting content for your classroom. Here is an excerpt from Bootcamp:

"Generative AI can create engaging and interactive learning materials, such as games, simulations, and virtual reality experiences.

These can provide a more immersive and enjoyable learning experience for students.

Moreover, AI algorithms can analyze student data to optimize the materials for each student’s learning style and preferences. For instance, if a student prefers visual learning, AI can provide more visual aids and examples in the learning materials.

It can increase engagement and motivation among students, leading to better learning outcomes.

Additionally, generative AI can also create adaptive learning materials that adjust to each student’s level of understanding. If a student struggles with a concept, AI can provide additional explanations or examples to help them grasp it. It will help students learn at their own pace and level of understanding.

Overall, generative AI can create engaging and interactive learning materials that cater to each student’s learning style and level of understanding. That can enhance engagement and motivation among students, leading to better learning outcomes."

Multimodality of Generative AI 

The following figure shows how wide and multi-layered Generative AI application landscape is. It describes “the platform layer that will power each category and the potential types of applications that will be built on top”. <From https://www.sequoiacap.com/article/generative-ai-a-creative-new-world/>

Examples of Multimodality

Generative AI can be used to create multimodal teaching material, unlocking a world of possibilities for educators. The AI-powered system can generate images, text, audio, and more, allowing you to quickly create engaging and interactive material for your students. This technology makes it easy to create new and exciting content for your classroom.

Text to Video (Synthesia

Are you tired of recording and re-recording instructional videos? Let the AI do the work for you. GenAI platforms such as Synthesia can generate script, and virtual avatar will say whatever you type. You can also create your own virtual avatar (but this feature will cost money!) 

Take a look at the example in the video on the left side. Fascinating, isn't it?  

Text to Music (Google MusicLM)

Check out this short (less than 10 seconds but long enough to see how text to music works!). You can sign up and join the waitlist. When it is your turn, you will get an email from it.


While waiting, you can see numerous examples (text prompt and its music outcome) HERE

For example, the first example shows a prompt that goes "The main soundtrack of an arcade game. It is fast-paced and upbeat, with a catchy electric guitar riff. The music is repetitive and easy to remember, but with unexpected sounds, like cymbal crashes or drum rolls.". What would the outcome sound like? Check right away! 

Sketch/text to 360° Image (Skybox AI by) Blockade labs

This is similar to Scribble Diffusion, which turns your sketch and text into an image. Skybox AI turns your sketch and text into 360° Image. 

We created a 360 image with it, then created the virtual space you saw at the beginning of this page in less than 10 minutes. No sign-up required, so jump in and try!  

Image to Animated Image (Make-a-video by Meta)

Recent AI does more than create an image out of text, like Make-A-Video by Meta AI. It not only creates a video out of your prompt, but also brings a static image into a life! Check out how this GenAI adds animation to a still image. 

Your favorite platform is embracing GenAI as well

An increasing number of educator-preferred platforms are incorporating GenAI. For example, many K-12 educators use Canva to design and create teaching materials. Now teachers can use Canva Magic Write, its AI-powered teaching assistant (see the video on the right to see how it works!). So, take a moment to explore your favorite platforms and see if they've integrated AI capabilities. 

Additional Resources

Read a full article on the figure we introduced earlier and learn more about the landscape of Generative AI.

MIT created this brilliant module to walk you through the world of digital literacy in the age of deepfakes. Learn why media literacy is critical for our students and all involved!

Ready for the final topic?

So far you have explored the capabilities of the recent generative AI. By now you may have lots of thoughts, both amazed and overwhelmed, and also terrified and concerns on possible misues and other issues related academic honesty, privacy, cybersecurity, and so on. Then now you are ready for our final key topic, "Issues and Concerns" related to GenAI. Let's go!