Paper: https://cs.gmu.edu/~winglam/publications/2023/LiETAL23Tuscan.pdf
Code for each technique to produce test orders: https://drive.google.com/file/d/192Yt8YVPLURwcYR3hv4gLr10ICBQUhe2 (code.tar.gz)
Inputs to our techniques to produce test orders (e.g., list of tests in each module): https://drive.google.com/file/d/1UYiJ2Ki2-oppV9VvRrmnOPEm5O6I2IL (data.tar.gz)
Test orders produced by the different techniques: https://drive.google.com/file/d/1DkjhitKbRK6X9iBvDh7ubLeWITi-Ybty (orders.tar.gz)
Scripts to reproduce results and the detailed results of Table 2 (e.g., minimal orders and OD tests detected for each ID and technique): https://drive.google.com/file/d/1y-x8db3rqW0HodOx5BAig8jNa5Tq42I9 (stats.tar.gz)
If you use any of this work, please cite our corresponding paper:
@inproceedings{LiETAL2023,
author = "Chengpeng Li and M. Mahdi Khosravi and Wing Lam and August Shi",
title = "Systematically Producing Test-Orders to Detect Order-Dependent Flaky Tests",
booktitle = "ISSTA 2023: Proceedings of the 2023 International Symposium on Software Testing and Analysis",
month = "July",
year = "2023",
address = "Seattle, WA, USA",
}
We would like to acknowledge NSF grant no. CCF-2145774 and Dragon Testing for their software testing research support.
Any opinions, findings and conclusions or recommendations expressed in this material are those of the author(s) and do not necessarily reflect the views of the National Science Foundation (NSF).