API Summary

As stated in the paper, we selected four CNN-based DNNs (i.e., LeNet-5, ResNet-20, VGG-16, and MobileNet-V2) and three RNN-based DNNs (i.e., SimpleRNN, LSTM, and GRU) as seeds for framework bug testing, which include 20 layer APIs. In addition, we also tested some APIs with similar functions but did not appear in the seed DNNs (e.g., AveragePooling2D and GlobalMaxPooling2D). To sum up, we totally cover 25 popular APIs. Below are the details about the API configurations and containment for the seed DNNs.