Solution Development

Stage 1: Experimental

1.1 - Display and Viewing Mechanism

The mechanism for viewing the rendered objects will have 4 major components.

1. The Housing

   • A unit to store the components. Includes a backplate to hold the screen (beginning with a smartphone, later to be a raspberry pi LCD

   • angled plate to hold the mirror

   • attachment for lens

   • strap to secure to head

2. Screen

   • This is what will display the components. The program will adjust for positioning and any fish eye effect that may occur

3. Mirror

   • An angled mirror to reflect the light from the screen towards the user

4. Tinted Lens

   • positioned at an angle to capture the reflected light from the mirror

   • Tinted to make the image stand out against potentially bright backgrounds

1.2 - Hand Tracking System

1. Use camera to send data to program

   • Low latency

   • High accuracy

2. Use combinations of Python libraries, Github code, and custom code to track hand location

3. After tracking location, also track the shape and gestures

1.3 - Image Rendering and Modification

The models can be pulled from two sources.

1. Preloaded from SD or USB drive

2. Pulled from SolidWorks or other 3d software

1.4 - User Interface

Two potential user interface options (or a combination of both).

1. Software based using hand tracking for selection

2. Hardware interface like keypad or remote

Stage 2: Prototyping

2.1: Assembly

Take all the components and make the full assembly.

1. Features to focus on

   • Wide viewing angle

   • Non warped imaging

   • Accurate hand tracking

2.2: Optimization

1. Features to improve

   • Speed of hand tracking for fast working

   • Comfort

   • Design

Stage 3: MVP

3.1: Testing and Modifications

1. Gather user feedback and add necessary or desired improvements post prototyping and optimization