Powerful SBC with the ability to run our image tracking model.
Its place in the NVIDIA Jetson family also allows us to use the their modern ML development stack,
Pi Zero/Pi Camera Module 2
In order to get a user-mounted camera angle, we use a similar setup to the data collection rig.
Due to its lower power consumption and wireless capabilities, we can wirelessly stream the video to the SBC running our model (NVIDIA Jetson Orin Nano)
Nucleo STM32L4 Microcontroller
Microcontroller used to interface with additional sensors for procedure tracking
Although the Orin Nano has sensor support, we may have to use the STM32L4 due to the distances between the sensor and Orin Nano.
Econ E-Cam81_CUNX
A wide-angle, high-fidelity camera used to monitor the entirety of the workstation. This allows us to track objects that are not directly in front of the user. In addition, this camera has native support with our SBC used for our object recognition model (Jetson Orin Nano)
ESP-32S
This lightweight, low-power microcontroller allows us to interface with our sensors and stream their data wirelessly to our powerful SBC
MPU-6050
This 6-axis accelerometer/gyroscope sensor allows us to track the movement of tools using translation and rotational data (X,Y,Z, pitch, yaw, roll)