Why this solution? How it works?:
Empathy map: Person with Cerebral palsy or motor disorder faced difficulty holding a 3D printed mouse (ABC) & interacting with copilot
Design thinking: First identify the difficulties of the individual. Then recommend appropriate assistive device at virtual shopping.
Idea: AI understands these difficulties with Skeletal tracking. Then helps recommends Assistive tech for holding.
Rapid prototyping:
5A. Cerebral palsy AI Functional prototype #1: Realtime skeletal tracking
5B. Cerebral palsy AI Functional prototype #2: Skeletal tracking of hands of person holding a Assistive makeup brush
Try it: #5: Cerebral palsy Functional AI prototype
Persona: Persons with Cerebral palsy
Try it:
Steps to try
Use Google chrome web browser on a Windows 10/11 laptop with camara
Once you click the URL, the page will load
Immediately, Google chrome web browser will show a notification "Allow permission to turn on camera. YES/NO"
Give permission to turn on camera. Click "YES"
System will check "Do you trust this user?". Click "Yes, Enable"
Stand in front to the camera
Keep your face visible to camera in front of a good lighting in the room
Look at your laptop & just check if the web camera is powering on..
Wait for 1 minute
If page is still loading beyond 1 minute, simply press REFRESH button on your web browser.. And the video feed will turn on in 60 seconds after you pressed Refresh button
Wave your hands gently in front of camera
You will see skeletal tracking as shown in the video
You can try out all 7 modules submitted as part of this single hackathon entry