SPECTACLE for AI-CPS

Detection Rate for All the Suspiciousness Metrics

In this section, we report detection rate DR plots and AUC_DR tables for all five suspiciousness metrics, with s ≤ 20% and s ≤ 100%, respectively. We retained the indexs of the figures and tables for the DR plots and AUC_DR in the revised version. The letters 'a', 'b', 'c', 'd', and 'e' are used to differentiate five suspiciousness metrics.

DR Plots with s ≤ 20%

Fig 6-a. Effectiveness of the compared approaches (in terms of detection rate DR) on the 13 groups of faulty benchmarks (using Tarantula as suspiciousness metric SusMetr)

Fig 6-b. Effectiveness of the compared approaches (in terms of detection rate DR) on the 13 groups of faulty benchmarks (using Ochiai as suspiciousness metric SusMetr)

Fig 6-c. Effectiveness of the compared approaches (in terms of detection rate DR) on the 13 groups of faulty benchmarks (using Dstar as suspiciousness metric SusMetr)

Fig 6-d. Effectiveness of the compared approaches (in terms of detection rate DR) on the 13 groups of faulty benchmarks (using Jaccard as suspiciousness metric SusMetr)

Fig 6-e. Effectiveness of the compared approaches (in terms of detection rate DR) on the 13 groups of faulty benchmarks (using Kulczynski2 as suspiciousness metric SusMetr)

AUC_DR with s ≤ 20%

Table 7-a. Effectiveness of the compared approaches in terms of AUC_DR with s ≤ 20%, using Tarantula as suspiciousness metric SusMetr. The higher the value, the better (the best approach and second best approach are highlighted in gray and light gray, respectively)

Table 7-b. Effectiveness of the compared approaches in terms of AUC_DR with s ≤ 20%, using Ochiai as suspiciousness metric SusMetr. The higher the value, the better (the best approach and second best approach are highlighted in gray and light gray, respectively)

Table 7-c. Effectiveness of the compared approaches in terms of AUC_DR with s ≤ 20%, using Dstar as suspiciousness metric SusMetr. The higher the value, the better (the best approach and second best approach are highlighted in gray and light gray, respectively)

Table 7-d. Effectiveness of the compared approaches in terms of AUC_DR with s ≤ 20%, using Jaccard as suspiciousness metric SusMetr. The higher the value, the better (the best approach and second best approach are highlighted in gray and light gray, respectively)

Table 7-e. Effectiveness of the compared approaches in terms of AUC_DR with s ≤ 20%, using Kulczynski2 as suspiciousness metric SusMetr. The higher the value, the better (the best approach and second best approach are highlighted in gray and light gray, respectively)

Google Sites

Report abuse