Abstract : This paper presents HandWind-Sim, a web-based open-source framework that tracks hand gestures via a standard webcam and MediaPipe, converts them into intuitive wind vectors, and applies these vectors to a position-based dynamics (PBD) cloth simulation. With a simple hand movement, the system realistically simulates fluttering cloth as if blown by actual wind in real time. HandWind-Sim enables complex physics-based interactions without the need for specialized hardware, offering high accessibility to researchers and developers in fields such as HCI, virtual prototyping, and interactive art.

[paper]