Data-Gloves for sign language learning
This research investigates if a computer, and an alternative input device in the form of sensor gloves can be used in the process of teaching children sign language. The research presented in this paper has been conducted by assembling hardware into sensor gloves, and by designing software capable of: i) filtering out sensor noise, ii) detecting intentionally posed signs, and iii) correctly evaluating signals in signs posed by different children. Findings show that the devised technology can form the basis of a tool that teaches children sign language, and that there is a potential for further research in this area.
The data-gloves were custom built. To ensure that the gloves would have a size suitable for a child, we used a pair of children’s gloves as a base for the sensor gloves. The selected gloves were made up of robust and stretchy lycra material. We selected gloves with this material to ensure that the sensor gloves would be robust enough to withstand wear and tear, and to ensure that they would have enough stretch to fit the hands of different children. 10 flex and 10 tactile sensors were incorporated into the gloves. These sensors were selected because they would make it possible to detect finger flexion and the touch of fingertips, which is sufficient to register a number of different Auslan signs. The sensors were mounted in pockets in the gloves at both the palm and the knuckle side of each finger. The wires from the sensors were then plugged into an I-cube X converter so that sensor signals could be converted from an analogue to a digital format.
Collaborators
Project Lead
- Dr Kirsten Ellis
Project Team
- Dr Jan Carlo Barca
Funding
None
Links
None
Publications
Ellis, K.A., Barca, J.C., 2012, Exploring sensor gloves for teaching children sign language, Advances in Human - Computer Interaction [P], vol 2012, Hindawi Publishing Corporation, New York NY USA, pp. 1-8. View paper