A glove to translate sign language: translate hand movements into words
Git : Sign Glove
Our initial goal was to improve the project previously studied by the former students and to design a glove allowing to translate the sign language, one character at a time (number or letter). Once this is done, we can create a second glove to cover a wider range of characters, and represent the character on a screen.
In order to determine which sign is done, we need sensors to detect when a finger is bent or not,and this for all fingers. We ordered sensors whose resistance changes when they are bent, and we placed some on each phalanx. we placed them on each phalanx. Then, we coded several Arduino codes that detect the values returned by the sensor by the sensor and convert this resistance into a bending angle. These values are then sent back to a PC which will analyze them for other programs.
We printed several physical parts allowing to maintain the various sensors on their corresponding finger. A first version of these parts is printed and used in our first prototype. A second version of these parts is in progress, the difference being that they are longer to prevent the sensor from slipping when bending.
Our results are mainly visualized on Unity, where we can see in real time the folding of each finger. We also have a graphical interface that allows us to make all our internal modifications in a more visual way (database, insertion, deletion...)
We have also condensed all our soldering on a PCB plate to be able to carry all the wiring on the wrist.
We coded a database on SQLite which allows us to keep the values of each sign.
Thanks to this, we can perform a sign and our programs are able to find the sign in this database. We have also implemented a graphical interface PyGames that sends us directly a visualization of the sign performed. This database is filled by performing the gesture with the glove and inserting it into the database.
Post instagram :