TestEvo

Software Testing and Analysis for Software Evolution

[Summary] [People] [Publications] [Presentations] [Software] [Sponsors]

PROJECT SUMMARY

Software programs are created during development, but continue to evolve throughout their (often long) lifetime. Maintaining such evolving programs, which typically involves fixing faults, improving performance, adding new features, and adapting to changes in the environment, is one of the most expensive activities in software development. A considerable percentage of maintenance costs are due to regression testing, which is the activity of retesting a software program after it is modified. To reduce these costs, this project develops novel techniques and tools to generate and augment regression tests of two given versions of a software system to guard against regression faults and help better understand behavioral changes induced by program changes.

PEOPLE

Faculty

Tao Xie (Principal Investigator)

Students

Bellanov Apilli (Undergrad Student)

Justin W. Gorham (Undergrad Student)

Kunal Taneja (PhD Student)

Suresh Thummalapenta (PhD Student)

Collaborators

Alex Orso and Mary Jean Harrold (Georgia Tech)

PUBLICATIONS

1. Dan Hao, Tao Xie, Lu Zhang, Xiaoyin Wang, Jiasu Sun, and Hong Mei. Test Input Reduction for Result Inspection to Facilitate Fault Localization. Automated Software Engineering Journal. Vol. 17, Number 1, pp. 5-31 March 2010. [PDF][BibTeX]
2. Lu Zhang, Shan-Shan Hou, Jun-Jue Hu, Tao Xie, and Hong Mei. Is Operator-Based Mutant Selection Superior to Random Mutant Selection? In Proceedings of the 32nd International Conference on Software Engineering (ICSE 2010), Cape Town, South Africa, May 2010. [BibTeX]
   1. Wei Jin, Alex Orso, and Tao Xie. Automated Behavioral Regression Testing. In Proceedings of the 3rd IEEE International Conference on Software Testing, Verification and Validation (ICST 2010), Paris, France, April 2010. [PDF][BibTeX]
   2. A previous version appeared in Proceedings of WODA 2008.
3. Nuo Li, Tao Xie, Nikolai Tillmann, Jonathan de Halleux, and Wolfram Schulte. Reggae: Automated Test Generation for Programs using Complex Regular Expressions. In Proceedings of the 24th IEEE/ACM International Conference on Automated Software Engineering (ASE 2009), Short Paper, Auckland, New Zealand, November 2009. [PDF][BibTeX]
4. Dan Hao, Lu Zhang, Tao Xie, Hong Mei, Jia-Su Sun. Interactive Fault Localization Using Test Information. Journal of Computer Science and Technology, Volume 24, No. 5, pp. 962-974, September 2009. [PDF][BibTeX]
5. Suresh Thummalapenta, Tao Xie, Nikolai Tillmann, Peli de Halleux, and Wolfram Schulte. MSeqGen: Object-Oriented Unit-Test Generation via Mining Source Code. In Proceedings of the 7th joint meeting of the European Software Engineering Conference and the ACM SIGSOFT Symposium on the Foundations of Software Engineering (ESEC/FSE 2009), Amsterdam, the Netherlands, August 2009. [PDF][BibTeX]
6. Lu Zhang, Shan-Shan Hou, Chao Guo, Tao Xie, and Hong Mei. Time-Aware Test-Case Prioritization using Integer Linear Programming. To appear in Proceedings of International Conference on Software Testing and Analysis (ISSTA 2009), Chicago, July 2009. [BibTeX]
7. Tao Xie, Nikolai Tillmann, Peli de Halleux, and Wolfram Schulte. Fitness-Guided Path Exploration in Dynamic Symbolic Execution. To appear in Proceedings of the 39th Annual IEEE/IFIP International Conference on Dependable Systems and Networks (DSN 2009), Lisbon, Portugal, June-July 2009. [PDF][BibTeX]
8. Lingshuang Shao, Junfeng Zhao, Tao Xie, Lu Zhang, Bing Xie, and Hong Mei. User-Perceived Service Availability: A Metric and an Estimation Approach. To appear in Proceedings of the IEEE International Conference on Web Services (ICWS 2009), Application and Industry Track, Los Angeles, CA, July 2009. [PDF][BibTeX]
9. Wujie Zheng, Michael R. Lyu, and Tao Xie. Test Selection for Result Inspection via Mining Predicate Rules. To appear in Proceedings of the 31st International Conference on Software Engineering (ICSE 2009), New Ideas and Emerging Results, Vancouver, Canada, May 2009. [PDF][BibTeX]
10. Kunal Taneja, Tao Xie, Nikolai Tillmann, Jonathan de Halleux, and Wolfram Schulte. Guided Path Exploration for Regression Test Generation. To appear in Proceedings of the 31st International Conference on Software Engineering (ICSE 2009), New Ideas and Emerging Results, Vancouver, Canada, May 2009. [PDF][BibTeX]
11. Mark Harman, Fayezin Islam, Tao Xie, and Stefan Wappler. Automated Test Data Generation for Aspect-Oriented Programs.In Proceedings of the 8th International Conference on Aspect-Oriented Software Development (AOSD 2009), Charlottesville, Virginia, March 2009. [PDF][BibTeX]
12. Prasanth Anbalagan and Tao Xie. Automated Generation of Pointcut Mutants for Testing Pointcuts in AspectJ Programs. In Proceedings of the 19th IEEE International Conference on Software Reliability Engineering (ISSRE 2008), Seattle, WA, November 2008. [PDF][BibTeX]
13. A previous version appeared in Proceedings of Mutation 2006.
14. Shan-Shan Hou, Lu Zhang, Tao Xie, and Jia-Su Sun. Quota-Constrained Test-Case Prioritization for Regression Testing of Service-Centric Systems. To appear in Proceedings of the 24rd IEEE International Conference on Software Maintenance (ICSM 2008), Beijing, China, October 2008. [BibTeX]
15. Kobi Inkumsah and Tao Xie. Improving Structural Testing of Object-Oriented Programs via Integrating Evolutionary Testing and Symbolic Execution. To appear in Proceedings of the 23rd IEEE/ACM International Conference on Automated Software Engineering (ASE 2008), L'Aquila, Italy, September 2008. [BibTeX]
    1. A previous version appeared in Proceedings of ASE 2007 as a Short Paper.
16. Kunal Taneja and Tao Xie. DiffGen: Automated Regression Unit-Test Generation. To appear in Proceedings of the 23rd IEEE/ACM International Conference on Automated Software Engineering (ASE 2008), Short Paper, L'Aquila, Italy, September 2008. [BibTeX]
17. Lingshuang Shao, Lu Zhang, Tao Xie, Junfeng Zhao, Bing Xie, and Hong Mei. Dynamic Availability Estimation for Service Selection Based on Status Identification. To appear in Proceedings of the IEEE International Conference on Web Services (ICWS 2008), Application Services and Industry Track, Beijing, China, September 2008. [PDF][BibTeX]
18. Alessandro Orso and Tao Xie. BERT: BEhavioral Regression Testing. To appear in Proceedings of the International Workshop on Dynamic Analysis (WODA 2008), Seattle, WA, July 2008. [PDF][BibTeX]
19. Nuo Li, JeeHyun Hwang, and Tao Xie. Multiple-Implementation Testing for XACML Implementations. To appear in Proceedings of the Workshop on Testing, Analysis and Verification of Web Software (TAV-WEB 2008), Seattle, WA, July 2008. [PDF][BibTeX]
20. Tao Xie, Nikolai Tillmann, Jonathan de Halleux, Wolfram Schulte. Method-Sequence Exploration for Automated Unit Testing of Object-Oriented Programs. To appear in Proceedings of the Workshop on State-Space Exploration for Automated Testing (SSEAT 2008), Seattle, WA, July 2008. [PDF][BibTeX]
21. Tao Xie, Mithun Acharya, Suresh Thummalapenta, and Kunal Taneja. Improving Software Reliability and Productivity via Mining Program Source Code. To appear in Proceedings of the NSF Next Generation Software Program Workshop at IPDPS 2008 (NSFNGS 2008), Miami, Florida, April 2008. [PDF][BibTeX]
    1. Kunal Taneja, Danny Dig, and Tao Xie. Automated Detection of API Refactorings in Libraries. In Proceedings of the 22nd IEEE/ACM International Conference on Automated Software Engineering (ASE 2007), Short Paper, Atlanta, Georgia, pp. 377-380, November 2007. [PDF][BibTeX]
    2. Shan-Shan Hou, Lu Zhang, Tao Xie, Hong Mei, and Jia-Su Sun. Applying Interface-Contract Mutation in Regression Testing of Component-Based Software. In Proceedings of the 23rd IEEE International Conference on Software Maintenance (ICSM 2007), Paris, France, pp. 174-183, October 2007. [PDF][BibTeX]
22. Evan Martin, Suranjana Basu, and Tao Xie. Automated Testing and Response Analysis of Web Services. In Proceedings of the IEEE International Conference on Web Services (ICWS 2007), Application Services and Industry Track, Salt Lake City, Utah, pp. 647-654, July 2007. [PDF][BibTeX]
23. Tao Xie, Kunal Taneja, Shreyas Kale, and Darko Marinov. Towards a Framework for Differential Unit Testing of Object-Oriented Programs. In Proceedings of the 2nd International Workshop on Automation of Software Test (AST 2007), Minneapolis, MN, pp. 5-11, May 2007. [PDF][BibTeX]
24. Jianjun Zhao, Tao Xie, and Nan Li. Towards Regression Test Selection for Aspect-Oriented Programs. In Proceedings of the 2nd Workshop on Testing Aspect-Oriented Programs(WTAOP 2006), Portland, Maine, pp. 21-26, July 2006. [PDF][BibTeX]
25. Tao Xie. Augmenting Automatically Generated Unit-Test Suites with Regression Oracle Checking. In Proceedings of the 20th European Conference on Object-Oriented Programming(ECOOP 2006), Nantes, France, pp. 380-403, July 2006. [PDF][BibTeX][Slides]
26. Tao Xie and David Notkin. Checking Inside the Black Box: Regression Testing By Comparing Value Spectra. IEEE Transactions on Software Engineering, Vol. 31, No. 10, pp. 869-883, October 2005. A special issue of selected papers from the ICSM 2004 conference. [PDF][BibTeX]
27. A previous version appeared in Proceedings of ICSM 2004.

PRESENTATIONS

1. Tao Xie. Improving Automation in Developer Testing. Workshop presentation, ISSTA 2008 PC Workshop on State of the Art in Testing and Analysis Day (ISSTA PC WS 2008), Piscataway, NJ, March 2008. [Slides]
2. Kunal Taneja. Automated Detection of API Refactorings in Libraries. Conference poster presentation, the 22nd IEEE/ACM International Conference on Automated Software Engineering (ASE 2007), Short Paper, Atlanta, Georgia, November 2007.
1. Tao Xie. Towards a Framework for Differential Unit Testing of Object-Oriented Programs. Workshop presentation, the 2nd International Workshop on Automation of Software Test (AST 2007), Minneapolis, MN, May 2007.
   1. Tao Xie. Augmenting Automatically Generated Unit-Test Suites with Regression Oracle Checking. Confernece presentation, the 20th European Conference on Object-Oriented Programming (ECOOP 2006), Nantes, France, July 2006. [Slides]
   2. Tao Xie. Checking Inside the Black Box: Regression Testing Based on Value Spectra Differences. Conference Presentation, the 20th IEEE International Conference on Software Maintenance (ICSM 2004), Chicago, September 2004. [Slides]

SOFTWARE

1. Guided Path Exploration for Regression Test Generation
2. Fitnex: Fitness-Guided Path Exploration (project web)
3. Method Sequence Generation based on Static Code Mining
4. DiffGen: Automated Regression Unit-Test Generation
5. Diffut: Differential Unit Testing of Object-Oriented Programs
6. RefacLib: Automated Detection of API Refactorings in Libraries
7. Multiple-Implementation Testing Tool for XACML Implementations

SPONSORS