Founations/Metrics for Software/Security Testing

Events

• NIST Workshop on Metrics and Standards for Software Testing (MaSST)

Theory of Random Testing and Partition Testing

• Marcel Bohme and Soumya Paul. A Probabilistic Analysis of the Efficiency of Automated Software Testing. TSE 2015.
• Andrea Arcuri, Lionel C. Briand: A practical guide for using statistical tests to assess randomized algorithms in software engineering. ICSE 2011
• Andrea Arcuri, Lionel C. Briand: Adaptive random testing: an illusion of effectiveness? ISSTA 2011: 265-275
• Andrea Arcuri. A Theoretical and Empirical Analysis of the Role ofTest Sequence Length in Software Testing for Structural Coverage. TSE 2011.
• Andrea Arcuri, Muhammad Zohaib Z. Iqbal, Lionel C. Briand: Random Testing: Theoretical Results and Practical Implications. TSE 2011.
• Andrea Arcuri, Muhammad Zohaib Z. Iqbal, Lionel C. Briand: Formal analysis of the effectiveness and predictability of random testing. ISSTA 2010: ACM SIGSOFT Distinguished Paper Award
• T. Y. Chen, F.-C. Kuo, R. G. Merkel and T. H. Tse, Adaptive Random Testing: the ART of Test Case Diversity, Journal of Systems and Software 2010
  • Andrea Arcuri: Insight knowledge in search based software testing. GECCO 2009.
  • Andrea Arcuri: Theoretical Analysis of Local Search in Software Testing. SAGA 2009.
  • Tsong Yueh Chen and Robert Merkel. An upper bound on software testing effectiveness. TOSEM 2008.
• T. Y. Chen, T. H. Tse and Y. T. Yu, Proportional Sampling Strategy: A Compendium and Some Insights, Journal of Systems and Software 2001
• T. Y. Chen and Y. T. Yu, On the Expected Number of Failures Detected by Subdomain Testing and Random Testing, TSE 1996
• T. Y. Chen and Y. T. Yu, On the Relationship Between Partition and Random Testing, TSE 1994

Theory of Test Oracles

• H. Liu, F.-C. Kuo, D. Towey and T. Y. Chen, How Effectively does Metamorphic Testing Alleviate the Oracle Problem?, TSE 2014
• Matt Staats, Gregory Gay, Mats Heimdahl. Automated Oracle Creation Support, or: How I Learned to Stop Worrying About Fault Propagation and Love Mutation Testing. ICSE 2012.
  • Matt Staats, Michael W. Whalen, Mats Per Erik Heimdahl: Programs, tests, and oracles: the foundations of testing revisited. ICSE 2011 ACM SIGSOFT Distinguished Paper Award
  • Matt Staats, Michael W. Whalen, Mats Per Erik Heimdahl: Better testing through oracle selection. ICSE 2011
  • Matt Staats, Michael W. Whalen, Mats Per Erik Heimdahl: On Oracle Information and Fault Finding: An Initial Study.
• T. Y. Chen, T. H. Tse and Z.-Q. Zhou, Semi-Proving: An Integrated Method for Program Proving, Testing, and Debugging, TSE 2011
  • Matt Staats: The influence of multiple artifacts on the effectiveness of software testing. ASE 2010
  • Myung-Hwan Park. An Approach for Oracle Data Selection Criterion. Dissertation 2010.
  • Ajitha Rajan, Michael W. Whalen, Mats Per Erik Heimdahl: The effect of program and model structure on mc/dc test adequacy coverage. ICSE 2008. [Slides] ACM SIGSOFT Distinguished Paper Award
  • Michael W. Whalen, Ajitha Rajan, Mats Per Erik Heimdahl, Steven P. Miller: Coverage metrics for requirements-based testing. ISSTA 2006
  • Mats Per Erik Heimdahl, George Devaraj, Robert Weber: Specification Test Coverage Adequacy Criteria = Specification Test Generation Inadequacy Criteria? HASE 2004
  • Public datasets

Theory of Debugging

• X. Xie, T. Y. Chen, F.-C. Kuo and B. Xu, A Theoretical Analysis of the Risk Evaluation Formulas for Spectrum-Based Fault Localization, TOSEM 2013