Super-Resolution Sprite with Foreground Removal

Sprite is an image constructed from video clips and is also a medium for multimedia applications. An automatic sprite generation with foreground removal and super-resolution is proposed in this paper. To remove the foreground objects, each pixel-value on the sprite is iteratively updated by the value with maximum appearance probability on temporal and spatial distribution. By storing the half-pixel, super-resolution sprite has less blurring-defect from source video. In the result, the generated sprite preserves the complete scenes of background and has higher image quality, and it can used to increase the visual quality in current sprite applications and also employed to facilitate video segmentation.

Paper Download

Jui-Hsin Lai, Chieh-Chi Kao and Shao-Yi Chien, “Super-Resolution Sprite with Foreground Removal”, in Proceedings of IEEE International Conference on Multimedia and Expo, ICME 2009, pp.1306-1309.

Download: ICME09_Sprite.pdf (1.8MB)


Proposed Method Applied on User Captured Videos

Proposed Method Applied on Baseball Videos

Proposed Method Applied on Tennis Videos

File Download
Note that all foreground objects had been removed from 
the sprite.

SR Sprites Generated from Baseball Videos

SR Sprites Generated from Tennis Videos