Translational Invariance

Takeaways

  1. Networks trained on object recognition have learned translational invariance, especially in the later layers.
  2. Untrained networks do not have translational invariance.
  3. Cells with uniform spatial sensitivity are more translationally invariant.
  4. Making weights more translationally invariant does not by itself cause better performance.
Translational Invariance.pdf