In this page we describe the experiments performed to validate our technique for building potentially invalid instances. The classes (took from Korat and extended with builders) can be found in the corresponding package in the folder datastructures/src/main/java/koratstructures/.

Running the experiments

In the case of, for example, singly sorted lists of scope 3, move to the folder datastructures and run the following script:

./experiments/negativesgeneration/validate-negatives-generation-singlylinkedlist-scope3.sh

For the rest of the cases, you can run the corresponding script in the folder datastructures/experiments/negativesgeneration/ depending on the case study and the scope.

The script basically runs Randoop, using the builders that we created to generate positive instances, and then the negatives instances are produced using our approach. For each negative instance, the routine repOKNeg (which is the representation invariant of the current test class) is checked. The total of false negative instances are reported at the end of the execution:

Negatives: 80

False Negatives: 5

False Negatives (%): 6.25

Results

The following table shows the results obtained after running each script with name validate-negatives-generation*.sh .