GestureInstruct

This dataset includes the gestures and their corresponding use cases that we experiment with.
We use this dataset for testing the reasoning capability of GIRAF. You can download the dataset here.

Gesture Demos

thumbs-up

thumbs-down

ok

stop

beckoning

fist

pick up

release

circling horizontally

circle

measuring with two fingers

pinching

spreading

twisting

pushing

lifting

squeezing

hammering

cutting

screwing

circling vertically

opening a book

openning a door

pointing (object)

pointing (location)

pointing (direction)

pointing (multiple objects)

handover

touching an object

drawing

circling (dynamic pointing)