Embedded Files
This website presented our study results about the test oracle for deep learning application
1. Accuracy of Test Oracle
1. Accuracy of Test Oracle
The experiment results showed Oracle's accuracy, which measures the reliable of the Oracle.
SAS & RejDiff
SAS & MajVot
SAS & PlurVot
SAS & WeightVot
SAT & RejDiff
SAT & MajVot
SAT & PlurVot
SAT & WeightVot
DAT & RejDiff
DAT & MajVot
DAT & PlurVot
DAT & WeightVot
AD & RejDiff
AD & MajVot
AD & PlurVot
AD & WeightVot
MM & RejDiff
MM & MajVot
MM & PlurVot
MM & WeightVot
2. Negative Predictive Value(NPV) of Test Oracle
2. Negative Predictive Value(NPV) of Test Oracle
NPV measures how many detected faults are true faults.
3. True Negative Rate(TNR) of Test Oracle
3. True Negative Rate(TNR) of Test Oracle
TNR measures how many faults was detected by the Oracle.
SAS & RejDiff
SAS & MajVot
SAS & PlurVot
SAS & WeightVot
SAT & RejDiff
SAT & MajVot
SAT & PlurVot
SAT & WeightVot
DAT& RejDiff
DAT & MajVot
DAT & PlurVot
DAT & WeightVot
AD & RejDiff
AD & MajVot
AD & PlurVot
AD & WeightVot
MM & RejDiff
MM & MajVot
MM & PlurVot
MM & WeightVot
4. Best performance of different metrics for oracles under different setting
4. Best performance of different metrics for oracles under different setting
This table showed the best automated oracle generation strategy combinations in terms of each metrics and their corresponding performance.
5. Robustness of Differential Testing under Adversarial Attacks
5. Robustness of Differential Testing under Adversarial Attacks
The experiment results in this section showed the impact of different configurations on Oracle's robustness .
SAS & RejDiff
SAS & MajVot
SAS & PlurVot
SAS & WeightVot
SAT & RejDiff
SAT & MajVot
SAT & PlurVot
SAT & WeightVot
DAT & RejDiff
DAT & MajVot
DAT & PlurVot
DAT & WeightVot
AD & RejDiff
AD & MajVot
AD & PlurVot
AD & WeightVot
MM & RejDiff
MM & MajVot
MM & PlurVot
MM & WeightVot
6. How the number of models affect prediction uncertainty
6. How the number of models affect prediction uncertainty
7. The Distribution of the prediction uncertainty
7. The Distribution of the prediction uncertainty
Page updated
Google Sites
Report abuse