Research Motivation

Communication is a fundamental behaviour of humans. Humans use communication for requesting help, to inform others, share attitude, and build bounding. Communication is a bi-direction activity and hence effective communication has been a great part of the interest in the scientific community.

Since the past few years, humans are not only surrounded by other humans or animals but also with the machines. Now, machines are becoming an important part of our daily life. For effective communication with the machines, we need to give some intelligence to the machines. To accomplish this task we first need to understand human-to-human communication and then model this behaviour for machines.

Human communication consists of sending and receiving verbal and non-verbal information. Our brain takes sensory inputs (such as sound and image) and processes these inputs and the output is a single representation in the form of action or language representation. This enforces me to build a MultiModel Neural Network that can process multi-data to get single output representation.