Why AR?

Thus, we propose a mobile-based AR application to address these problems by facilitating parents to learn the ASL language on demand during a conversation with their deaf children. While designing this project idea, more focus is given to the “hearing parent - deaf children” problem. With our application, during a conversation with William’s children, he can project his smartphone onto the desired object in case he is unaware of the corresponding ASL of that object. Instantly an animated 3D ASL content will be popped up above that particular object. Here the corresponding ASL content is an animated hand. Thus Williams can learn ASL on a demand basis and on the fly. Offline ASL learning is a tedious task. At the same time, until a parent is not proficient at ASL, it can create some communication gaps with the children. That is why on the fly learning is a better option than offline learning. With this approach, the conversation flow will not be fully preserved but it can unburden the parents, as they do not need to find ASL content on their own. A mobile stand will hold the mobile during a conversation. Parents can retrieve the ASL content by tapping the desired object on the mobile screen. Thus this system can offset the cognitive load of parents by discarding their searching effort. With this system parents also can learn the ASL with minimum effort. I am trying to tell the whole story in Figure 1. With the help of computer vision we will detect the available objects that are placed on the table.