Shape-Tailored Local Descriptors and their Application to Segmentation and Tracking

Naeemullah Khan1, Marei Algarni1, Anthony Yezzi2, and Ganesh Sundaramoorthi1

1King Abdullah University of Science & Technology (KAUST), Saudi Arabia

2 School of Electrical & Computer Engineering, Georgia Institute of Technology, USA

Download PDF

Download Slides

Download Supplementary Material

C++ source code github repository



We propose new dense descriptors for texture segmentation. Given a region of arbitrary shape in an image, these descriptors are formed from shape-dependent scale spaces of oriented gradients. These scale spaces are defined by Poisson-like partial differential equations. A key property of our new descriptors is that they do not aggregate image data across the boundary of the region, in contrast to existing descriptors based on aggregation of oriented gradients. As an example, we show how the descriptor can be incorporated in a Mumford-Shah energy for texture segmentation. We test our method on several challenging datasets for texture segmentation and textured object tracking. Experiments indicate that our descriptors lead to more accurate segmentation than non-shape dependent descriptors and the state-of-the-art in texture segmentation.