Testing and Analysis of Evolving Software

Coverage:

• An Evaluation of Change-Based Coverage Criteria. Fisher II, Marc and Wloka, Jan and Tip, Frank and Ryder, Barbara G. and Luchansky, Alexander. VT Technical Report 2011.
• Test-suite Augmentation for Evolving Software. Raul Santelices, Pavan Kumar Chittimalli, Taweesup Apiwattanapong, Alessandro Orso, and Mary Jean Harrold. ASE 2008. [Slides]
• MaTRIX: Maintenance-oriented Testing Requirement Identifier and Examiner. Taweesup Apiwattanapong, Raul Andres Santelices, Pavan Kumar Chittimalli, Alessandro Orso, Mary Jean Harrold. TAIC PART 2006. [Slides]

Symbolic-Execution-Based Test Generation:

• AUTOMATED REGRESSION TESTING AND VERIFICATION OF COMPLEX CODE CHANGES. MARCEL BOHME. Dissertation. NUS 2014.
• Verification-Aided Regression Testing. Fabrizio Pastore, Leonardo Mariani, Antti Hyvarinen, Grigory Fedyukovich, Natasha Sharygina, Stephan Sehestedt, and Ali Muhammad. ISSTA 2014.
• COVRIG: A Framework for the Analysis of Code, Test, and Coverage Evolution in Real Software. Paul Marinescu, Petr Hosek, Cristian Cadar. ISSTA 2014.
• CoREBench: Studying Complexity of Regression Errors. Marcel Böhme, Abhik Roychoudhury. ISSTA 2014.
• Property differencing for incremental checking. Guowei Yang, Sarfraz Khurshid, Suzette Person, and Neha Rungta. ICSE 2014.
• Patch verification via multiversion interprocedural control flow graphs. Wei Le and Shannon D. Pattison. ICSE 2014.
• Shadow symbolic execution for better testing of evolving software. Cristian Cadar and Hristina Palikareva. ICSE NIER 2014.
• Hybrid Directed Test Suite Augmentation: An Interleaving Framework. Y. Kim, Z. Xu, M. Kim, M. B. Cohen, G. Rothermel. ICST 2014.
• Regression tests to expose change interaction errors. Marcel Böhme, Bruno C. d. S. Oliveira, and Abhik Roychoudhury. ESEC/FSE 2013.
• KATCH: High-Coverage Testing of Software Patches. Paul Dan Marinescu, Cristian Cadar. ESEC/FSE 2013.
  • Expressing and checking intended changes via software change contracts. Jooyong Yi, Dawei Qi, Shin Hwei Tan, Abhik Roychoudhury. ISSTA 2013.
• Partition-based regression verification. Marcel Böhme, Bruno C. d. S. Oliveira, Abhik Roychoudhury. ICSE 2013.
• Safe Software Updates via Multi-version Execution. Petr Hosek, Cristian Cadar. ICSE 2013.
• make test-zesti: A Symbolic Execution Solution for Improving Regression Testing. Paul Dan Marinescu, Cristian Cadar. ICSE 2012.
• High-Coverage Symbolic Patch Testing. Paul Dan Marinescu, Cristian Cadar. SPIN 2012.
• A Hybrid Directed Test Suite Augmentation Technique. Z. Xu, Y. Kim, M. Kim, G. Rothermel. ISSRE 2011.
• Path Exploration based on Symbolic Output. Dawei Qi, Hoang D.T. Nguyen, Abhik Roychoudhury. ESEC/FSE 2011.
• Directed incremental symbolic execution. Suzette Person, Guowei Yang, Neha Rungta, Sarfraz Khurshid. PLDI 2011.
  • eXpress: Guided Path Exploration for Efficient Regression Test Generation. Kunal Taneja, Tao Xie, Nikolai Tillmann, and Jonathan de Halleux. ISSTA 2011.
  • Guided Path Exploration for Regression Test Generation. Taneja et al., ICSE NIER'09
  • Applying Aggressive Propagation-based Strategies for Testing Changes". Raul Santelices and Mary Jean Harrold. ICST 2011. [Slides]
  • Statically Validating Must Summaries for Incremental Compositional Dynamic Test Generation, Patrice Godefroid, Shuvendu K. Lahiri, and Cindy Rubio-Gonzalez. SAS 2011.
  • Differential Static Analysis: Opportunities, Applications, and Challenges, Shuvendu K. Lahiri, Kapil Vaswani, and Tony Hoare, FOSER 2010.
• Test Generation to Expose Changes in Evolving Programs. Dawei Qi, Abhik Roychoudhury, Zhenkai Liang, ASE 2010.
  • Conditional equivalence, Ming Kawaguchi, Shuvendu K. Lahiri, and Henrique Rebelo. no. MSR-TR-2010-119, October 2010
• Directed Test Suite Augmentation: Techniques and Tradeoffs, Z. Xu, Y. Kim, M. Kim, G. Rothermel, M. Cohen, FSE 2010
• Factors Affecting the Use of Genetic Algorithms in Test Suite Augmentation, Z. Xu, M. Cohen, and G. Rothermel. GECCO 2010.
• Has the Bug Really Been Fixed?. Zhongxian Gu, Earl T. Barr, David J. Hamilton, and Zhendong Su. ICSE 2010.
  • Exploiting Program Dependencies for Scalable Multiple-path Symbolic Execution. Raul Santelices and Mary Jean Harrold. ACM International Symposium on Software Testing and Analysis (ISSTA 2010). [Slides]
• Directed Test Suite Augmentation, Z. Xu and G. Rothermel, APSEC 2009.
• Differential Symbolic Executions, Person et al., FSE 2008
• DiffGen: Automated Regression Unit-Test Generation. Kunal Taneja and Tao Xie. ASE'08
• Demand-Driven Compositional Symbolic Execution. Saswat Anand, Patrice Godefroid, and Nikolai Tillmann. TACAS 2008.
• Differential testing: a new approach to change detection. Evans and Savoia. FSE 2007.

Other Test Generation

• Automated Behavioral Regression Testing. W. Jin, A. Orso, and T. Xie., ICST 2010
  • BERT: BEhavioral Regression Testing", Orso and Xie, WODA 2008.
• Test data augmentation: generating new test data from existing test data, Shin Yoo and Mark Harman, TR-08-04, 2008.
• Regression Model Checking, G. Yang, M. B. Dwyer, and G. Rothermel, ICSM 2009
• Model-based regression test suite generation using dependence analysis/. Yanping Chen , Robert L. Probert , Hasan Ural. A-MOST 2007.
• Generating regression tests via model checking, Xu, L., Dias, M., and Richardson, D., COMPSAC 2004.

Observability/Test Oracles

• Automated Behavioral Regression Testing. W. Jin, A. Orso, and T. Xie., ICST 2010
• Has the Bug Really Been Fixed?. Zhongxian Gu, Earl T. Barr, David J. Hamilton, and Zhendong Su, ICSE 2010.
  • ReAssert: Suggesting repairs for broken unit tests, B. Daniel, V. Jagannath, D. Dig, and D. Marinov. ASE 2010
  • On Test Repair using Symbolic Execution, B. Daniel, T. Gvero, and D. Marinov, ISSTA 2010
• Golden Implementation Driven Software Debugging. Ansuman Banerjee, Abhik Roychoudhury, Johannes A. Harlie, and Zhenkai Liang, FSE 2010
• Efficient on-line validation with delta execution. Joseph Tucek, Weiwei Xiong, and Yuanyuan Zhou. ASPLOS 2009
• Augmenting Automatically Generated Unit-Test Suites with Regression Oracle Checking, Xie, ECOOP 2006.
• Checking Inside the Black Box: Regression Testing By Comparing Value Spectra. Tao Xie and David Notkin. TSE 2005.

Debugging

• Scaling up automated test generation: Automatically generating maintainable regression unit tests for programs. by Brian Robinson, Michael D. Ernst, Jeff H. Perkins, Vinay Augustine, and Nuo Li. ASE 2011
• DARWIN: An Approach for Debugging Evolving Programs Dawei Qi, Abhik Roychoudhury, Zhenkai Liang, Kapil Vaswani, ESEC-FSE 2009.
  • Golden Implementation Driven Software Debugging. Ansuman Banerjee, Abhik Roychoudhury, Johannes A. Harlie, and Zhenkai Liang, FSE 2010
  • Has the Bug Really Been Fixed?. Zhongxian Gu, Earl T. Barr, David J. Hamilton, and Zhendong Su. ICSE 2010.

Test Repair

• ReAssert: Suggesting repairs for broken unit tests, B. Daniel, V. Jagannath, D. Dig, and D. Marinov. ASE 2010
  • On Test Repair using Symbolic Execution, B. Daniel, T. Gvero, and D. Marinov, ISSTA 2010
• Automated Session Data Repair for Web Application Regression Testing. Nadia Alshahwan and Mark Harman. ICST 2008.
• Regression Testing of GUIs. A. Memon and M. L. Soffa, FSE 2003.

Impact Analysis

• Chianti: A tool for change impact analysis of Java programs. Xiaoxia Ren, Fenil Shah, Frank Tip, Barbara Ryder, and Ophelia Chesley. OOPSLA 2004.
• Incremental Dynamic Impact Analysis for Evolving Software Systems, J. Law and G. Rothermel, ISSRE 2003.
  • Whole Program Path-Based Dynamic Impact Analysis, J. Law and G. Rothermel, ICSE 2003.
• Incorporating Incremental Validation and Impact Analysis into Spreadsheet Maintenance: An Empirical Study, V. Krishna, C. Cook, D. Keller, J. Cantrell, C. Wallace, M. Burnett, and G. Rothermel, ICSM 2001.
• Code Churn: A Measure for Estimating the Impact of Code Change, J.Munson and S. Elbaum. ICSM 1998.