Suspicious examples identified by EIF -- Generalization errors in test set
Generalization errors in testing set
According to the definitions in paper (Section 5.2) , we divide the generalization errors in testing set into 4 categories:
Type I error agreeable confusion pair: Two inter-class samples confuse with each other and human cannot distinguish them
Type II error disagreeable confusion pair: Two inter-class samples confuse with each other but human can distinguish them
Type III error agreeable mis-similar pair: Two intra-class samples far from with each other and human agree they look very different
Type IV error disagreeable mis-similar pair: Two intra-class samples far from with each other and human think they are visually similar
Based on these definitions, we show some examples from each dataset (model is trained with Proxy-NCA++).
Generalization errors in testing set -- CUB200 Type I error
Left and Middle: A confusion pair belonging to different class. Right: the nearest neighbor for left image within the same class
Generalization errors in testing set -- CUB200 Type II error
Left and Middle: A confusion pair belonging to different class. Right: the nearest neighbor for left image within the same class
Generalization errors in testing set -- CUB200 Type III error
A mis-similar pair belonging to same class
Generalization errors in testing set -- CUB200 Type IV error
A mis-similar pair belonging to same class
Generalization errors in testing set -- CARS196 Type I error
Left and Middle: A confusion pair belonging to different class. Right: the nearest neighbor for left image within the same class
Generalization errors in testing set -- CARS196 Type II error
Left and Middle: A confusion pair belonging to different class. Right: the nearest neighbor for left image within the same class
Generalization errors in testing set -- CARS196 Type III error
A mis-similar pair belonging to same class
Generalization errors in testing set -- CARS196 Type IV error
A mis-similar pair belonging to same class
Generalization errors in testing set -- InShop Type I error
Left and Middle: A confusion pair belonging to different class. Right: the nearest neighbor for left image within the same class
Generalization errors in testing set -- InShop Type II error
Left and Middle: A confusion pair belonging to different class. Right: the nearest neighbor for left image within the same class
Generalization errors in testing set -- InShop Type III error
A mis-similar pair belonging to same class
Generalization errors in testing set -- InShop Type IV error
A mis-similar pair belonging to same class