The advent of Deep Learning (DL) in computer vision – since the pioneering work of Hinton [1] in 2012 – changed the perspective of the community, adopting in this way DL as the go-to technique for different computer vision tasks. This emergence is justified by DL’s superior performance on various vision tasks including classification, recognition and image segmentation. However, despite the fact that DL is a powerful tool, there is still a missing gap in understanding its properties, which is not the case with more classical computer vision approaches as they are more tractable, and often offers a clear understanding about how they work.