A web-based framework for real-time pose-driven fluid interaction via harmonic function mapping
Yu-Bin Kwon Oh* Jong-Hyun Kim*
(* : Inha University)
SoftwareX 2026
Yu-Bin Kwon Oh* Jong-Hyun Kim*
(* : Inha University)
SoftwareX 2026
Abstract : This paper presents a Web3D fluid framework that enables real-time fluid interaction in web browser environments by transforming webcam-based user pose (skeleton) input into natural smoke and turbulence flows. Directly injecting skeleton tracking coordinates as external forces in fluid simulation often leads to sharp boundaries and temporally discontinuous motion, which limits the realistic representation of user gestures as fluid phenomena. To address this issue, the proposed software employs Harmonic Function Mapping to generate a smoothly diverging vector field around the skeleton and integrates it into the external force term of a Stable Fluids–based 2D fluid solver. In addition, fine-scale turbulence details are enhanced through dynamic composition with Simplex Noise–based background turbulence while preserving responsiveness to user motion. The proposed system runs entirely in standard web browsers without requiring additional plugins, and achieves stable real-time interaction through Web Worker–based asynchronous pose estimation and a GPU-accelerated (WebGL) solver. The framework provides stable real-time interaction in standard browser environments and can be utilized as an accessible real-time fluid interface for a wide range of applications, including interactive art, education and prototyping, and web-based visual effects production.
[paper]