Products

Process

3D Modeling Project

First experiment with AR headset experiences (VR video)

Scene Color Reconstruction

Showing color a mobile device's camera can't see (research paper)

AR MultiPendulum

I spent summer 2021 making an app out of prior research

ARHeadsetKit

The final product: an open-source software framework

Results

AR MultiPendulum (Apple App Store Preview)

Audience: the average person

Overview

AR MultiPendulum allows you to interact with virtual objects directly with your hand instead of tapping their location on a touchscreen. It brings a mesmerizing multi-pendulum simulation into augmented reality. You interact with this simulation through hand movements and modify it through a holographic interface.

Not only does this app bring augmented reality to a pendulum simulation, it is also the first app to simulate more than three pendulums. Additionally, by repurposing a VR headset for AR, this is the first app that gives users an affordable AR headset experience. If you have Google Cardboard, you can turn your iPhone into an AR headset that renders your surroundings in VR, based on images acquired using your device's camera.

ARHeadsetKit

Audience: software developers

Source code: github.com/philipturner/ARHeadsetKit

Overview

Using a $5 Google Cardboard, the average person can now replicate Microsoft Hololens. Apps built with ARHeadsetKit are immersive AR headset experiences, simultaneously providing handheld AR alternatives. In just 30 lines of code, even someone without a background in Swift can work with AR.

Images from the ARHeadsetKit tutorial series

For more on how these products were created, see the literature review and research papers.