See the Difference: Direct Pre-Image Reconstruction and Pose Estimation by Differentiating HOG

Wei-Chen Chiuand Mario Fritz1

International Conference on Computer Vision (ICCV) 2015





Abstract
The Histogram of Oriented Gradient (HOG) descriptor has led to many advances in computer vision over the last decade and is still part of many state of the art approaches. We realize that the associated feature computation is piecewise differentiable and therefore many pipelines which build on HOG can be made differentiable. This lends to advanced introspection as well as opportunities for end-to-end optimization. We present our implementation of ∇HOG based on the auto-differentiation toolbox Chumpy [2] and show applications to pre-image visualization and pose estimation which extends the existing differentiable renderer OpenDR [3] pipeline. Both applications improve on the respective state-of-the-art HOG approaches.

Spotlight video 


References
[1] Wei-Chen Chiu and Mario Fritz, "See the Difference: Direct Pre-Image Reconstruction and Pose Estimation by Differentiating HOG," in IEEE Int’l Conf.  on Computer Vision (ICCV), Santiago, Chile, December 13-16, 2015. [To be appeared]
[2] M. Loper. Chumpy. https://github.com/mattloper/chumpy.
[3] M. M. Loper and M. J. Black. Opendr: An approximate differentiable renderer. In ECCV. 2014.

Bibtex
@inproceedings{walon2015iccv,
  Author = {Chiu, W.C. and Fritz, M.},
  Title = {See the Difference: Direct Pre-Image Reconstruction and Pose Estimation by Differentiating HOG},
  Booktitle = {IEEE International Conference on Computer Vision (ICCV)},
  Year = {2015},
  Location = {Santiago, Chile}
}