What would a future in which AI-assisted smart-glasses as a daily gadget as common as our smartphones look like? Meta has recently unveiled AR/VR smart-glasses that aims to blend virtual objects and the real world. Our daily activities are sensed through cameras and other sensors. With AI, this up-and-coming device platform promises to transform the way we connect with the world and each other.

In this summer bootcamp series, we invite you to join us to explore the future of smart-glasses interactions, and learn more about core concepts that influence its innovation. You will be led by expert researchers of this topic, and joined by up to 50 students from all academic backgrounds and levels across Singapore, Hong Kong, China and around the world.

What to expect

Over the 6 days, you will explore the topic of Future Interactions using Smart-glasses and related wearable devices by:

• Understanding the design needs of lightweight smart-glasses as the next generation wearable devices

• Learning key concepts in Heads-Up and Mobile Computing, both of which set the context for a truly exciting vision surrounding smart-glasses interactions (see next section)

• Discussing fundamental research methodologies and APIs for supported platforms

• Hands-on ideation sessions with your classmates and facilitators

• Submitting proposed projects that stem from design ideas, which will be evaluated as part of a hackathon competition, with attractive prizes offered by Huawei.

Vision for Smart-glasses

You will learn to develop your own creative vision around smart-glasses interactions. Here, we share about existing visions (high-level of abstraction) currently being researched and implemented.

Human-Centered AI Assistance, aka the “Other Me”: Imagine a situated AI assistant residing in your smart-glasses. It communicates with you through natural language to understand your goals/preferences, and collaborates with you to develop and execute solutions to your daily tasks. It ‘senses’ what you sense from a first-person view in order to understand your environment and offer useful tips. It also connects with other AI assistants to scale up to complex tasks that require team solutions. Thus, the AI assistant becomes the “Other Me”, an external extension of our individual mind and senses. In the near future, every human will have such an AI assistant as we go about our daily lives and work.

Heads-Up Computing: Heads-Up computing aims to provide seamless, just-in-time, and intelligent computing support for humans’ daily activities. The Heads-Up paradigm offers a style of interaction that is compatible with natural human movements, by using a head- and hand-piece.

Heads-Up computing does not aim to replace physical spaces with virtual reality, but rather, augment and bridge the physical world with virtual spaces via augmented reality. In doing so, this vision aims to facilitate connections between humans and the digital-physical worlds.

The first bootcamp's registration is closed, but you can sign up for the second bootcamp in Zhejiang University, Hang Zhou, China (June 27 - July 2) via this Google form. Or if you are in China, you can sign up using this Tencent form.