EIF - Suspicious examples identified by EIF

Suspicious examples identified by EIF -- Generalization errors in test set

Generalization errors in testing set

According to the definitions in paper (Section 5.2) , we divide the generalization errors in testing set into 4 categories:

Type I error agreeable confusion pair: Two inter-class samples confuse with each other and human cannot distinguish them

Type II error disagreeable confusion pair: Two inter-class samples confuse with each other but human can distinguish them

Type III error agreeable mis-similar pair: Two intra-class samples far from with each other and human agree they look very different

Type IV error disagreeable mis-similar pair: Two intra-class samples far from with each other and human think they are visually similar

Based on these definitions, we show some examples from each dataset (model is trained with Proxy-NCA++).

Generalization errors in testing set -- CUB200 Type I error

Left and Middle: A confusion pair belonging to different class. Right: the nearest neighbor for left image within the same class

Generalization errors in testing set -- CUB200 Type II error

Left and Middle: A confusion pair belonging to different class. Right: the nearest neighbor for left image within the same class

Generalization errors in testing set -- CUB200 Type III error

A mis-similar pair belonging to same class

Generalization errors in testing set -- CUB200 Type IV error

A mis-similar pair belonging to same class

Generalization errors in testing set -- CARS196 Type I error

Left and Middle: A confusion pair belonging to different class. Right: the nearest neighbor for left image within the same class

Generalization errors in testing set -- CARS196 Type II error

Left and Middle: A confusion pair belonging to different class. Right: the nearest neighbor for left image within the same class

Generalization errors in testing set -- CARS196 Type III error

A mis-similar pair belonging to same class

Generalization errors in testing set -- CARS196 Type IV error

A mis-similar pair belonging to same class

Generalization errors in testing set -- InShop Type I error

Left and Middle: A confusion pair belonging to different class. Right: the nearest neighbor for left image within the same class

Generalization errors in testing set -- InShop Type II error

Left and Middle: A confusion pair belonging to different class. Right: the nearest neighbor for left image within the same class

Generalization errors in testing set -- InShop Type III error

A mis-similar pair belonging to same class

Generalization errors in testing set -- InShop Type IV error

A mis-similar pair belonging to same class

Page updated

Google Sites

Report abuse