Week01

Computational VR

3. Why Move Beyond the Headset?

If you have already developed or experienced a VR project, you have probably encountered some of the limitations of current head-mounted displays.

These are not only subjective complaints.

An ergonomics study comparing office work using a VR headset and a conventional monitor found greater neck and shoulder discomfort, increased neck muscle activity, and greater simulator-sickness symptoms during VR use.

Other studies have identified thermal discomfort as another practical constraint of prolonged VR-headset use. These problems become especially important if head-worn computing is expected to move from short experiences toward continuous everyday use.

The challenge is therefore not simply to produce a more powerful headset.

A future everyday spatial computer must negotiate competing requirements:

• computing capability, visual quality, field of view, sensing, battery life, weight, thermal comfort, social acceptability, interaction, privacy, and appearance.

This is one reason that the emerging smart-glasses market does not have a single design strategy. IEEE Spectrum identifies competing approaches ranging from lightweight AI companions with minimal displays to glasses designed primarily as high-resolution spatial monitors.

The future device may therefore not simply be a smaller VR headset.

It may be a different kind of computer.

4. From Immersion to Context

The emerging industry is increasingly emphasizing another capability: context.

Google describes Android XR as a platform spanning “headsets, glasses and everything in between.” Its 2026 eyewear strategy distinguishes audio-based glasses from display glasses and emphasizes hands-free access to information while users remain engaged with their surroundings.

Snap has taken a more explicitly augmented-reality approach. Its 2026 Specs are designed to overlay information and interactive content directly into the wearer's physical environment. Reuters describes applications including navigation, contextual AI assistance, virtual workspaces, and spatial experiences.

Apple has used a different device design and terminology, introducing Vision Pro as a “spatial computer” intended to blend digital content with physical surroundings through eye, hand, and voice interaction.

These products are different, and corporate announcements should be treated as statements of company strategy rather than neutral predictions of the future. Nevertheless, together they indicate an important shift in how major computing companies are framing XR.

The goal is becoming less about escaping the physical world and increasingly about making computation aware of and responsive to it.

5. Glasses Do Not Automatically Solve the Problem

Moving from headsets to glasses creates new problems as well.

An everyday wearable may continuously encounter information about:

• where the user is,

• what the user sees,

• what the user hears,

• who is nearby,

• what the user is looking at,

• and potentially what the user intends to do.

A review of augmented-reality smart-glasses adoption finds that acceptance depends not only on technological capability but also on utilitarian, personal, social, and risk-related factors.

Privacy becomes especially complicated because wearable cameras and sensors affect not only the person wearing the device but also people nearby. Research on smart-glasses ethics has consequently raised questions about bystander awareness, recording, social interaction, and consent.

These are not peripheral issues.

If spatial computing becomes everyday computing, HCI, social behavior, ethics, and design become as important as graphics and hardware.

6. XR Is Older Than the Current Hype

The idea that physical and virtual worlds form a continuum is not new.

In 1994, Paul Milgram and colleagues described what became known as the Reality-Virtuality Continuum, placing fully physical environments and fully virtual environments at opposite ends, with multiple forms of mixed and augmented reality between them. Their work provides useful conceptual vocabulary for understanding today's XR landscape.

Seen from this perspective, the current transition from VR headsets toward mixed-reality devices and glasses is not necessarily a transition from one unrelated technology to another.

It can instead be understood as movement across different points in a much larger design space.

In this course, we will use currently available XR hardware, including VR headsets, as computational laboratories.

However, the objective of the course is not simply to learn how to make VR applications.

We will study underlying computational ideas that remain relevant as hardware changes:

simulation, spatial data, computational audio, procedural graphics, shaders, embodiment, interaction, multimodality, and Human-Computer Interaction.

The headset available today may not be the interface people use 10 years from now.

The computational principles underneath it are much more durable.

VR taught us how to place people inside digital worlds.

XR asks how computation can become part of the world people already inhabit.