Display Prototyping

The prototypes described below are designed to improve environmental awareness and usability for mobile computing devices, especially wearable displays.  Interaction and modalities include clothing-attached input, integrated eye-tracking, and spatial compression/modification.

 IR Corneal Reflections for AR Display Calibration

Plopski, A., Orlosky, J.Itoh, Y., Kiyokawa, K., Klinker, G. (2016, October). Automated Spatial Calibration of HMD Systems with Unconstrained Eye-cameras. Proceedings of ISMAR, 2016. IEEE. 

Automated calibration of AR displays using IR LEDs and corneal imaging.

 A Low Cost, Low Latency DIY Optical See Through HMD

Itoh, Y., Orlosky, J., Kiyokawa, K., Huber, M., Klinker, G. (2016, March). OST Rift: Temporally Consistent Augmented Reality with a Consumer Optical See-Through Head-Mounted Display. Proceedings of IEEEVR, 2016. IEEE. 

Design and testing of a low-latency, low-cost, wide field-of-view optical see-through display.

 ModulAR:  The Vision Augmentation Display
Orlosky, J., Toyama, T., Kiyokawa, K., Sonntag, D. (2015, October). ModulAR: Eye-controlled Vision Augmentations for Head Mounted Displays.  In Visualization and Computer Graphics, IEEE Transactions on (Proc. ISMAR) Vol. 21 (11).  (pp. 1259-1268.) IEEE. 

Joint research with the German Research Center for Artificial Intelligence, with the goal of developing on-demand human vision augmentations.
ISMAR Conference Paper (Pre-print)
Best Paper Nominee


Best Poster @ YRR 2015


Fisheye Vision Display

Orlosky, J., Wu, Q., Kiyokawa, K., Takemura, H., & Nitschke, C. (2014, October). Fisheye vision: peripheral spatial compression for improved field of view in head mounted displays. In Proceedings of the 2nd ACM symposium on Spatial user interaction (pp. 54-61). ACM.

Display prototype using fisheye lenses that can expand a video see-through display's field of view to 180 degrees without sacrificing stereoscopy.
SUI Paper

Video (playing tennis in the display)
Multi-focal Plane Interaction

Toyama, T.,
Orlosky, J., Sonntag, D., Kiyokawa, K. A natural interface for multi-focal plane head mounted displays using 3D gaze. In Proceedings of the working conference on Advanced visual interfaces, May 27-30, 2014. (pp.25-32) ACM.

Natural interaction for automatically removing or dimming text in an HMD using eye tracking and multiple focal plane discretization.

AVI Paper
AVI Presentation Part 1
AVI Presentation Part 2

Mobile Typing With the
Torso Keyboard
オーロスキ ジェーソン,  重野 孝明, 清川 清,  竹村 治雄.  身体装着型QWERTYキーボードのモバイル環境における入力速度評価. VRSJ Vol. 19, No.2, 2014.
Orlosky, J.
, Shigeno, T. Kiyokawa, K. Takemura, H. Text Input Evaluation with a Torso-mounted QWERTY Keyboard in Wearable Computing. To appear in VRSJ Vol. 19, No.2, 2014. (Translation)

Experiments with the Torso keyboard and details of the 2nd prototype. 
VRSJ Journal Paper (Japanese)
Video 1
Video 2

< 2013

Wearable Keyboard
Orlosky, J., Katzakis, N. Kiyokawa, K. Takemura, H. Torso Keyboard: A Wearable Text Entry Device That Can Be Used While Sitting, Standing or Walking. Proceedings of APCHI, Matsue, Japan, August 28-31. pgs. 781-782. [Poster] [Also received Best Research Presentation at Osaka University's FrontierLab Program, 2011-2012]

Prototype of a keyboard used to input text in an HMD while walking.
APCHI (Poster)

Extended Paper
Best Research Presentation

Aquarium Sonification

Walker, B., Godfrey, M., Orlosky, J., Bruce, C., Sanford, J. Aquarium Sonification: Soundscapes for Accessible Dynamic Informal Learning Environments. Proceedings of The 12th International Conference on Auditory Display 2006. pgs. 238-241.

Engine that converts visual stimuli into sound for education and entertainment of the visually impaired.
PDF (Paper)
Video 1
Video 2
Video 3
Video 4
Video 5
Georgia Tech Project Page