Problem Statement
Our proposed design is the use of two cheap, ordinary webcams, ArUco markers, and an augmented reality headset. Enhancing position tracking, we incorporate open-source fiducial markers as an additional, cost-effective measure. The webcams will record and transmit the video to an image processing software to identify and track the ArUco markers in realtime. The image processing software will be created using Python and OpenCV, a computer vision library. Additionally, two webcams are used instead of one to create a stereoscopic view of the ArUco markers and obtain three-dimensional coordinates of the ArUco markers. After obtaining the markers’ positions, the positional data will be transmitted into Unity to implement the augmented spine model at the correct position. To view the augmented spine model, the Meta Quest 3, an augmented reality headset, will be used. Figure 1 above shows the general design proposed.
Project Summary
Watch this short video to learn about the motivation for our project and the work we did to complete it!