SPECTACLE for AI-CPS

False Discovery Rate for All the Suspiciousness Metrics

In this section, we report FDR plots and AUC_FDR tables for all the suspiciousness metrics, with s ≤ 20% and s ≤ 100%, respectively. We retained the indexs of the figures and tables for the FDR plots and AUC_FDR in the revised version. The letters 'a', 'b', 'c', 'd', and 'e' are used to differentiate five suspiciousness metrics.

FDR Plots with s ≤ 20%

Fig 7-a. Effectiveness of the compared approaches (in terms of false discovery rate (FDR) on the 13 groups of faulty benchmarks (using Tarantula as suspiciousness metric SusMetr.

Fig 7-b. Effectiveness of the compared approaches (in terms of false discovery rate (FDR) on the 13 groups of faulty benchmarks (using Ochiai as suspiciousness metric SusMetr.

Fig 7-c. Effectiveness of the compared approaches (in terms of false discovery rate (FDR) on the 13 groups of faulty benchmarks (using Dstar as suspiciousness metric SusMetr.

Fig 7-d. Effectiveness of the compared approaches (in terms of false discovery rate (FDR) on the 13 groups of faulty benchmarks (using Jaccard as suspiciousness metric SusMetr.

AUC_FDR with s ≤ 20%

Table 8-a. Effectiveness of the compared approaches in terms of AUC_FDR with s ≤ 20%, using Tarantula as suspiciousness metric SusMetr. The higher the value, the better (the best approach and second best approach are highlighted in gray and light gray, respectively)

Table 8-b. Effectiveness of the compared approaches in terms of AUC_FDR with s ≤ 20%, using Ochiai as suspiciousness metric SusMetr. The higher the value, the better (the best approach and second best approach are highlighted in gray and light gray, respectively)

Table 8-c. Effectiveness of the compared approaches in terms of AUC_FDR with s ≤ 20%, using Dstar as suspiciousness metric SusMetr. The higher the value, the better (the best approach and second best approach are highlighted in gray and light gray, respectively)

Table 8-d. Effectiveness of the compared approaches in terms of AUC_FDR with s ≤ 20%, using Jaccard as suspiciousness metric SusMetr. The higher the value, the better (the best approach and second best approach are highlighted in gray and light gray, respectively)

Table 8-e. Effectiveness of the compared approaches in terms of AUC_FDR with s ≤ 20%, using Kulczynski2 as suspiciousness metric SusMetr. The higher the value, the better (the best approach and second best approach are highlighted in gray and light gray, respectively)

Google Sites

Report abuse