LightTouch Gadgets: Extending Interactions on Capacitive Touchscreens by Converting Light Emission to Touch Inputs

We present LightTouch, a 3D-printed passive gadget to enhance touch interactions on unmodified capacitive touchscreens. The LightTouch gadgets simulate finger operations such as tapping, swiping, and multi-touch gestures by means of conductive materials and light-dependent resistors (LDR) embedded in the object. The touchscreen emits visible light and the LDR senses the level of this light, which changes its resistance value. By controlling the screen brightness, it intentionally connects or disconnects the path between the GND and the touchscreen, thus allowing the touch inputs to be controlled. In contrast to conventional physical extensions for touchscreens, our technique requires neither continuous finger contact on the conductive part nor the use of batteries. As such, it opens up new possibilities for touchscreen interactions beyond the simple automation of touch inputs, such as establishing a communication channel between devices, enhancing the trackability of tangibles, and inter-application operations.

静電容量式タッチスクリーン上でのインタラクションを拡張するLightTouch Gadgetを提案する. LightTouch Gadgetはタッチスクリーンの画面発光を検知し, タップやスワイプ, マルチタッチジェスチャなどのタッチ操作に変換する. ガジェット直下領域の画面輝度が変化すると, タッチスクリーンに対向するように配置されたフォトレジスタの抵抗値が変化する. これにより, 画面輝度を制御することで意図的にGNDとタッチスクリーン間の経路を接続/切断し, タッチ入力を発生させることが可能である. LightTouch gadgetは従来のタッチパネルの物理的な拡張とは異なり, 本ガジェットは導電部に指を連続的に接触させる必要はなく, かつパッシブに動作する.

Poster @UIST2020

Tap gadget (STL)

Scroll gadget (STL)

Scroll gadget with a light-shielding plate (STL)

2D touch gadget (STL)

For the 3D printing parameters of the electrodes, please refer to this paper.
CAPath: 3D-Printed Interfaces with Conductive Points in Grid Layout to Extend Capacitive Touch Inputs. Proceedings of the ACM on Human-Computer Interaction (PACM HCI), Vol.4, ISS, Article No.193, (2020) https://dl.acm.org/doi/10.1145/3427321

  1. Kaori Ikematsu, Kunihiro Kato, and Yoshihiro Kawahara. 2021. LightTouch Gadgets: Extending Interactions on Capacitive Touchscreens by Converting Light Emission to Touch Inputs. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (CHI ’21). ACM, New York, NY, USA [DOI]

  2. Kaori Ikematsu, Kunihiro Kato, and Yoshihiro Kawahara. 2020. LightTouch: Passive Gadgets for Extending Interactions on Capacitive Touchscreens by Automating Touch Inputs. In Proceedings of the 33rd Annual Symposium on User Interface Software and Technology (UIST'20 Adjunct). ACM, New York, NY, USA [DOI]