Human Preference Interface

Here is the interface for anyone to provide preference data over collected videos. The data collection interface is built with Gradio and hosted on Hugging Face server. This is a demo and the videos are not the complete set of videos from the experiments in our paper.

Choose the video on Left or Right as the preferred one. Not sure for a tie. 

The next task to display can also be selected by choosing the task name. Select Random for a random selection over the task set.

Click Next will record your current choice and display the next pair of videos.