Imperfect Evaluation

These examples were randomly selected from a group of imperfect predictions by ATLAS. There exists 100 examples, 25 examples from 4 different groups depending on the BLEU score of the prediction (0-25, 25-50, 50-75, 75-100). Each explanation contains the test method and the focal method under test, the ground truth or correct assert statement, the predicted assert statement and an explanation as to the difference between the ground truth and the prediction by ATLAS.