Testing and Analysis of Evolving Software

Coverage:

An Evaluation of Change-Based Coverage Criteria. Fisher II, Marc and Wloka, Jan and Tip, Frank and Ryder, Barbara G. and Luchansky, Alexander. VT Technical Report 2011.

Test-suite Augmentation for Evolving Software. Raul Santelices, Pavan Kumar Chittimalli, Taweesup Apiwattanapong, Alessandro Orso, and Mary Jean Harrold. ASE 2008. [Slides]
MaTRIX: Maintenance-oriented Testing Requirement Identifier and Examiner. Taweesup Apiwattanapong, Raul Andres Santelices, Pavan Kumar Chittimalli, Alessandro Orso, Mary Jean Harrold. TAIC PART 2006. [Slides]

Symbolic-Execution-Based Test Generation:

AUTOMATED REGRESSION TESTING AND VERIFICATION OF COMPLEX CODE CHANGES. MARCEL BOHME. Dissertation. NUS 2014.
Veriﬁcation-Aided Regression Testing. Fabrizio Pastore, Leonardo Mariani, Antti Hyvarinen, Grigory Fedyukovich, Natasha Sharygina, Stephan Sehestedt, and Ali Muhammad. ISSTA 2014.
COVRIG: A Framework for the Analysis of Code, Test, and Coverage Evolution in Real Software. Paul Marinescu, Petr Hosek, Cristian Cadar. ISSTA 2014.
CoREBench: Studying Complexity of Regression Errors. Marcel Böhme, Abhik Roychoudhury. ISSTA 2014.
Property differencing for incremental checking. Guowei Yang, Sarfraz Khurshid, Suzette Person, and Neha Rungta. ICSE 2014.
Patch verification via multiversion interprocedural control flow graphs. Wei Le and Shannon D. Pattison. ICSE 2014.

Shadow symbolic execution for better testing of evolving software. Cristian Cadar and Hristina Palikareva. ICSE NIER 2014.
Hybrid Directed Test Suite Augmentation: An Interleaving Framework. Y. Kim, Z. Xu, M. Kim, M. B. Cohen, G. Rothermel. ICST 2014.
Regression tests to expose change interaction errors. Marcel Böhme, Bruno C. d. S. Oliveira, and Abhik Roychoudhury. ESEC/FSE 2013.
KATCH: High-Coverage Testing of Software Patches. Paul Dan Marinescu, Cristian Cadar. ESEC/FSE 2013.
- Expressing and checking intended changes via software change contracts. Jooyong Yi, Dawei Qi, Shin Hwei Tan, Abhik Roychoudhury. ISSTA 2013.
Partition-based regression verification. Marcel Böhme, Bruno C. d. S. Oliveira, Abhik Roychoudhury. ICSE 2013.
Safe Software Updates via Multi-version Execution. Petr Hosek, Cristian Cadar. ICSE 2013.
make test-zesti: A Symbolic Execution Solution for Improving Regression Testing. Paul Dan Marinescu, Cristian Cadar. ICSE 2012.
High-Coverage Symbolic Patch Testing. Paul Dan Marinescu, Cristian Cadar. SPIN 2012.
A Hybrid Directed Test Suite Augmentation Technique. Z. Xu, Y. Kim, M. Kim, G. Rothermel. ISSRE 2011.
Path Exploration based on Symbolic Output. Dawei Qi, Hoang D.T. Nguyen, Abhik Roychoudhury. ESEC/FSE 2011.
Directed incremental symbolic execution. Suzette Person, Guowei Yang, Neha Rungta, Sarfraz Khurshid. PLDI 2011.
- eXpress: Guided Path Exploration for Efficient Regression Test Generation. Kunal Taneja, Tao Xie, Nikolai Tillmann, and Jonathan de Halleux. ISSTA 2011.
- Guided Path Exploration for Regression Test Generation. Taneja et al., ICSE NIER'09
- Applying Aggressive Propagation-based Strategies for Testing Changes". Raul Santelices and Mary Jean Harrold. ICST 2011. [Slides]
- Statically Validating Must Summaries for Incremental Compositional Dynamic Test Generation, Patrice Godefroid, Shuvendu K. Lahiri, and Cindy Rubio-Gonzalez. SAS 2011.
- Differential Static Analysis: Opportunities, Applications, and Challenges, Shuvendu K. Lahiri, Kapil Vaswani, and Tony Hoare, FOSER 2010.
Test Generation to Expose Changes in Evolving Programs. Dawei Qi, Abhik Roychoudhury, Zhenkai Liang, ASE 2010.
- Conditional equivalence, Ming Kawaguchi, Shuvendu K. Lahiri, and Henrique Rebelo. no. MSR-TR-2010-119, October 2010
Directed Test Suite Augmentation: Techniques and Tradeoffs, Z. Xu, Y. Kim, M. Kim, G. Rothermel, M. Cohen, FSE 2010
Factors Affecting the Use of Genetic Algorithms in Test Suite Augmentation, Z. Xu, M. Cohen, and G. Rothermel. GECCO 2010.
Has the Bug Really Been Fixed?. Zhongxian Gu, Earl T. Barr, David J. Hamilton, and Zhendong Su. ICSE 2010.
- Exploiting Program Dependencies for Scalable Multiple-path Symbolic Execution. Raul Santelices and Mary Jean Harrold. ACM International Symposium on Software Testing and Analysis (ISSTA 2010). [Slides]
Directed Test Suite Augmentation, Z. Xu and G. Rothermel, APSEC 2009.
Differential Symbolic Executions, Person et al., FSE 2008
DiffGen: Automated Regression Unit-Test Generation. Kunal Taneja and Tao Xie. ASE'08
Demand-Driven Compositional Symbolic Execution. Saswat Anand, Patrice Godefroid, and Nikolai Tillmann. TACAS 2008.
Differential testing: a new approach to change detection. Evans and Savoia. FSE 2007.

Other Test Generation

Automated Behavioral Regression Testing. W. Jin, A. Orso, and T. Xie., ICST 2010
Test data augmentation: generating new test data from existing test data, Shin Yoo and Mark Harman, TR-08-04, 2008.
Regression Model Checking, G. Yang, M. B. Dwyer, and G. Rothermel, ICSM 2009
Model-based regression test suite generation using dependence analysis/. Yanping Chen , Robert L. Probert , Hasan Ural. A-MOST 2007.
Generating regression tests via model checking, Xu, L., Dias, M., and Richardson, D., COMPSAC 2004.

Observability/Test Oracles

Automated Behavioral Regression Testing . W. Jin, A. Orso, and T. Xie., ICST 2010
Has the Bug Really Been Fixed?. Zhongxian Gu, Earl T. Barr, David J. Hamilton, and Zhendong Su, ICSE 2010.
- ReAssert: Suggesting repairs for broken unit tests, B. Daniel, V. Jagannath, D. Dig, and D. Marinov. ASE 2010
- On Test Repair using Symbolic Execution, B. Daniel, T. Gvero, and D. Marinov, ISSTA 2010
Golden Implementation Driven Software Debugging. Ansuman Banerjee, Abhik Roychoudhury, Johannes A. Harlie, and Zhenkai Liang, FSE 2010
Efficient on-line validation with delta execution. Joseph Tucek, Weiwei Xiong, and Yuanyuan Zhou. ASPLOS 2009
Augmenting Automatically Generated Unit-Test Suites with Regression Oracle Checking, Xie, ECOOP 2006.
Checking Inside the Black Box: Regression Testing By Comparing Value Spectra. Tao Xie and David Notkin. TSE 2005.

Debugging

Scaling up automated test generation: Automatically generating maintainable regression unit tests for programs. by Brian Robinson, Michael D. Ernst, Jeff H. Perkins, Vinay Augustine, and Nuo Li. ASE 2011
DARWIN: An Approach for Debugging Evolving Programs Dawei Qi, Abhik Roychoudhury, Zhenkai Liang, Kapil Vaswani, ESEC-FSE 2009.
- Golden Implementation Driven Software Debugging. Ansuman Banerjee, Abhik Roychoudhury, Johannes A. Harlie, and Zhenkai Liang, FSE 2010
- Has the Bug Really Been Fixed?. Zhongxian Gu, Earl T. Barr, David J. Hamilton, and Zhendong Su. ICSE 2010.

Test Repair

ReAssert: Suggesting repairs for broken unit tests, B. Daniel, V. Jagannath, D. Dig, and D. Marinov. ASE 2010
- On Test Repair using Symbolic Execution, B. Daniel, T. Gvero, and D. Marinov, ISSTA 2010
Automated Session Data Repair for Web Application Regression Testing. Nadia Alshahwan and Mark Harman. ICST 2008.
Regression Testing of GUIs. A. Memon and M. L. Soffa, FSE 2003.

Impact Analysis

Chianti: A tool for change impact analysis of Java programs. Xiaoxia Ren, Fenil Shah, Frank Tip, Barbara Ryder, and Ophelia Chesley. OOPSLA 2004.

Incremental Dynamic Impact Analysis for Evolving Software Systems, J. Law and G. Rothermel, ISSRE 2003.
- Whole Program Path-Based Dynamic Impact Analysis, J. Law and G. Rothermel, ICSE 2003.
Incorporating Incremental Validation and Impact Analysis into Spreadsheet Maintenance: An Empirical Study, V. Krishna, C. Cook, D. Keller, J. Cantrell, C. Wallace, M. Burnett, and G. Rothermel, ICSM 2001.
Code Churn: A Measure for Estimating the Impact of Code Change, J.Munson and S. Elbaum. ICSM 1998.

Non-Traditional Regression Testing

Regression Testing in the Presence of Non-code Changes. Agastya Nanda, Senthil Mani, Saurabh Sinha, Mary Jean Harrold, Alessandro Orso. ICST 2011.[Slides]

Concurrency Testing

Analyzing the Impact of Change in Multi-threaded Programs. K. Chatterjee, L. de Alfaro, V. Raman, C. Sanchez. FASE 2010.

Application Specific

Harnessing Web-based Application Similarities to Aid in Regression Testing. Kinga Dobolyi, Westley Weimer. ISSRE 2009.
Syntactic Regression Testing for Tree-Structured Output., Dobolyi et al., WSE 2009.
Configuration-Aware Regression Testing: An Empirical Study of Sampling and Prioritization, X. Qu, M. Cohen, and G. Rothermel, ISSTA 2008, PDF.
Automated Session Data Repair for Web Application Regression Testing. Nadia Alshahwan and Mark Harman. ICST 2008.
- Using Component Metadata to Regression Test Component-Based Software, Orso et al., STVR 2007.
- Pallino: Automation to Support Regression Test Selection for COTS-based Applications, Zheng et al., ASE 2007.
Regression Test Selection for AspectJ Software, Guoqing Xu and Atanas Rountev, ICSE 2007. [Talk ]
- A Framework for Efficient Regression Tests on Database Applications, Haftmann et al., VLDB Journal 06.
Applying Safe Regression Test Selection Techniques to Java Web Services. Lin et al., NWESP 2006.
- Efficient Regression Tests for Database Applications. Florian Haftmannet al. CIDR 05.
- A Safe Regression Test Selection Technique for Database-Driven Applications. Willmor and Embury. ICSM 05.
Regression Testing of GUIs. A. Memon and M. L. Soffa, FSE 2003.

Misc

Automated documentation inference to explain failed tests. Sai Zhang, Cheng Zhang, and Michael D. Ernst. ASE 2011. FailureDoc implementation.
Automatically Documenting Program Changes. Raymond P.L. Buse, Westley Weimer. ASE 2010.

JUnitMX -- A Change-aware Unit Testing Tool. Jan Wloka and Barbara G. Ryder and Frank Tip. ICSE 2009.
"Precisely Detecting Runtime Change Interactions for Evolving Software". Raul Santelices, Mary Jean Harrold, and Alessandro Orso. ICST 2010. [Slides]