JOTS

JOTS: Joint Online Tracking and Segmentation

Longyin Wen, Dawei Du, Zhen Lei, Stan Z. Li, Ming-Hsuan Yang

Abstract

We present a novel Joint Online Tracking and Segmentation (JOTS) algorithm which integrates the multi-part tracking and segmentation into a unified energy optimization framework to handle the video segmentation task. The multi-part segmentation is posed as a pixel-level label assignment task with regularization according to the estimated part models, and tracking is formulated as estimating the part models based on the pixel labels, which in turn is used to refine the model. The multi-part tracking and segmentation are carried out iteratively to minimize the proposed objective function by a RANSAC-style approach. Extensive

experiments on the SegTrack and SegTrack v2 databases demonstrate that the proposed algorithm performs favorably against the state-of-the-art methods.

Framework

Illustrative Results

Downloads

• SegTrack v2 database collected by Dr. Fuxin Li [Download]

• JOTS method [Codes] [Results].

Citations

If you use the source code, please cite our paper:

• Longyin Wen, Dawei Du, Zhen Lei, Stan Z. Li, Ming-Hsuan Yang, " JOTS: Joint Online Tracking and Segmentation", IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2015. [PDF]