Home

This is the webpage for work "Smart Subtitle in Videos", which aims to generate smart subtitles for videos (TV/movie).

Subtitles are usually needed when watching foreign movies that are not dubbed. Traditionally, subtitles usually appear at a fixed position such as the bottom of the screen. As a result, viewers may either miss the flow of visual contents or the subtitles, as it is difficult to focus on both. This work improves the movie viewing experience by better placing the subtitles, so-called dynamic subtitle. Our goal is to place subtitles along with their speakers so that people can watch both video content and subtitles. Furthermore, placing subtitles next to the appropriate speaker removes any doubt about who is speaking.

Figure: Sample results of our system. In a) b) c), black/white bars are the active time (active in black, non-active in white).

Take user study of our work by clicking here.