What would a future in which AI-assisted smart glasses are a daily gadget as common as our smartphones look like? Apple and Meta have recently unveiled AR/VR smart glasses that aim to blend virtual objects and the real world. Our daily activities are sensed through cameras and other sensors. With AI, this up-and-coming device platform promises to transform how we connect with the world and each other.

In this summer bootcamp series, we invite you to join us to explore the future of smart glasses interactions and learn more about core concepts that influence its innovation. You will be led by expert researchers on this topic and joined by up to 50 students from all academic backgrounds and levels across Singapore and around the world. 

What to expect

Over the 6 days, you will explore the topic of Future Interactions using Smart glasses and related wearable devices by:

• Understanding the design needs of lightweight smart glasses as the next-generation wearable devices

• Learning key concepts in Heads-up and Mobile Computing, both of which set the context for a truly exciting vision surrounding smart glasses interactions (see next section)

• Discussing fundamental research methodologies and APIs for supported platforms

• Hands-on ideation sessions with your classmates and facilitators 

• Submitting proposed projects that stem from design ideas will be evaluated as part of a hackathon competition, with attractive prizes offered by SSI.

Vision for Smart Glasses

You will learn to develop your own creative vision around smart-glasses interactions. Here, we share about existing visions (high-level of abstraction) currently being researched and implemented. 

Human-Centered AI Assistance, aka the “Other Me”: Imagine a situated AI assistant residing in your smart glasses. It communicates with you through natural language to understand your goals/preferences and collaborates with you to develop and execute solutions to your daily tasks. It ‘senses’ what you sense from a first-person view to understand your environment and offer useful tips. It also connects with other AI assistants to scale up to complex tasks that require team solutions. Thus, the AI assistant becomes the “Other Me”, an external extension of our individual mind and senses. In the near future, every human will have such an AI assistant as we go about our daily lives and work.

Heads-Up Computing: Heads-up computing aims to provide seamless, just-in-time, and intelligent computing support for humans’ daily activities. The Heads-Up paradigm offers a style of interaction that is compatible with natural human movements by using a head- and hand-piece.

Heads-up computing does not aim to replace physical spaces with virtual reality but rather augment and bridge the physical world with virtual spaces via augmented reality. In doing so, this vision aims to facilitate connections between humans and the digital-physical worlds.

Past BootCamps

• First BootCamp

• Second BootCamp