Real-time workout coach on the Nuvoton M55M1
NuvoMotion is a real-time workout coach on the Nuvoton M55M1 MCU that performs pose estimation, analyzes exercise form, and provides immediate feedback without needing the cloud.
The system utilizes Nuvoton’s M55M1 micocontroller with an integrated Ethos-U55 neural processing unit (NPU) to perform high-speed, embedded computation. A parallel-interface RGB camera streams video frames to the M55M1, which runs a lightweight pose estimation network to generate 2D skeletal landmarks.
The firmware processes these landmarks to compute joint angles, detect repetitions, and generate a form score for five selectable exercises. The user interface provides live guidance by overlaying the user's skeleton next to an animated reference model. The primary objective is sustained, low-latency performance at 15 FPS or above, with a median latency below 100 ms. This project delivers a production firmware image, source code, and comprehensive documentation for an edge-optimized exercise analysis platform.
Nuvoton Hardware
The system will consist of the NuMaker M55 with NPU, the parallel RGB camera, and the NuMaker TFT-LCD display.
Pose Overlay
The pose overlay will remain stable with minimal jitter (below 3 pixels RMS at 480p) so that the user can clearly see their posture.
Exercise Detection
At least 5 exercises can be selected and will be recognized at or above 15 FPS with stable latency and clear, repeatable scoring.
Processing
The system will detect the user’s body pose and outputs repetition counts and form scores on the NuMaker M55 LCD display. The display will show a live camera feed, pose overlay, exercise feedback, and more metrics.