Multi-Person 3D Pose Tracking with Stereo Fisheye Cameras for Soccer

Hosei O, Taiga Someya, Yugo Matsuo
The University of Tokyo

Overview

Smart Goal is a low-cost 3D motion tracking system that helps soccer goalkeepers analyze and improve their performance. Using only two fisheye cameras mounted on a goal, it reconstructs the goalkeeper’s and ball’s movements in 3D, allowing players to review their plays from any angle through a web-based 3D viewer. 

System Overview

• Easy Setup: Custom magnetic mounts ensure perfect camera placement in seconds. 

• Smart Dock: Automatically uploads, clears, and charges cameras after practice. 

• 3D Reconstruction: Combines AI models (4DHumans + YOLOv8) for pose and ball tracking. 

Impact

• Interactive Review: Players review 3D replays from multiple perspectives—top, side, or first-person—and compare sessions or players.

• Data Insights: Extracts metrics such as movement speed, joint angles, and shot tendencies, helping identify weaknesses and track improvement.

Acknowledgement

Funded and supported by MITOU IT Program