We proposed SoftBit, a teleoperation interface that enhances user awareness through real-time soft robot finger shape visualization in extended reality (XR). The system combines proprioceptive sensing with an XR headset (Meta Quest2) to provide users with intuitive visual feedback about finger deformations during manipulation tasks. SoftBiT’s key innovation is a real-time sim-to-real pipeline that estimates and visualizes soft finger shapes, helping users better understand robot-object interactions even when direct visual feedback is limited.
We introduced TriForce Band, a compact gesture input wristband built from a single triaxial magnetic tactile sensor module. A five-participant, ten-gesture experiment resulted with a classification accuracy of 93.0%.
We introduced Geodiffussr, a flow matching-based pipeline that generates realistic, text prompt-guided texture map while strictly respecting an input Digital Elevation Map (DEM). We fuse geometry into the UNet at coarse-to-fine resolutions with Multi-scale Content Aggregation (MCA), allowing the model to respect global landforms and local ridgelines alike.
Kuma Lab and Google Developer Group on Campus collaborated to host a hands-on workshop on AI. We introduced the basic concepts of AI, through its applications in 3 fields: Computer Vision, Robot Learning, and 3D Reconstruction.
Under Google Developer Group on Campus, we hosted a hands-on workshop on game development with Unity. After introducing the basic concepts of Unity, we recreated Flappy Bird with the audience.
The core members of Kuma Lab hosted a workshop on "Robotic Art", where we explored how the two fields that seem to be far apart: Robotics and Art, can go together to form an interesting topic of research.
During my internship at Tokyo Robotics, I collaborated with a friend to deploy a VLA model onto a humanoid robot. It can now perform pick and place tasks from language instructions.
Made a tabletop size telepresence robot that mimics your movements via a webcam. Won the top award at the GEEK Camp Hackathon.