Workshops

In keeping with the goal of providing an open and collaborative forum for the exchange of research ideas and results in the area of software testing and validation, the companion workshops are a very important part of ICST. 
 
At ICST 2011, the workshops will be one day in duration, either on the day before or the day after the main conference. Workshops will run in parallel with each other but will not have to compete with the main conference, which will be on separate days. All refreshment and lunch breaks will be at the same time for the workshops.

The following workshops are scheduled to appear at ICST 2011:

Schedule by Day

Monday 21st March  Friday 25th March 
AMOST (featuring Scenarios)
Regression
SBST
TESTBEDS
VAST
CSTVA
Mutation
REFTEST
ReVVerT
SECTEST
TAIC PART
TeBug



Advances in Model-Based Testing (AMOST 2011)

Website: AMOST 2011

Day: Monday 21st March

The increasing use of software and the growing system complexity, in size, heterogeneity, autonomy, and physical distribution make focused software system testing a challenging task. Recent years have seen an increasing industrial and academic interest in the use of models for designing and testing software. Success has been reported using a range of types of models using a variety of specification formats, notations and formal languages, such as UML, SDL, B and Z. A-MOST 2011 will bring together researchers and practitioners interested in the topic of Model-Based Testing (MBT).

The goal of the A-MOST workshop is to bring together researchers and practitioners to discuss the current state of the art and practice as well as future prospects for MBT in software engineering.

AMOST will include Scenario-Based Testing (Scenarios 2011) as a special session.

Chairs: Ioannis Parissis and Christof Budnik

Previous workshops: 2010, 2009, 2008, 2007, 2006, 2005


Constraints in Software Testing, Verification and Analysis (CSTVA 2011)

Website: CSTVA 2011

Day: Friday 25th March

Recent years have seen an increasing interest in the application of constraint solving techniques to the testing and analysis of software systems. A significant body of constraint-based techniques have been proposed and investigated in model-based testing, code-based testing, property-oriented testing, statistical testing, etc. Following previous meetings held in 2006 and 2010, the aim of the CSTVA workshop is to bring together researchers and industrial people working in constraint-based testing to investigate future developments in this research field. Authors are invited to submit an extended abstract of no more than 6 pages under the two-column IEEE format, presenting new ideas, new results or new systems in constraint-based testing.

Chairs: Arnaud Gotlieb and Gordon Fraser

Previous workshops: 2010, 2006


Mutation Analysis (Mutation 2011)

Website: Mutation 2011

Day: Friday 25th March

Mutation is acknowledged as an important way to assess the fault-finding effectiveness of tests sets. Mutation testing has mostly been applied at the source code level, but more recently, related ideas have also been used to test artefacts described in a considerable variety of notations and at different levels of abstraction. Mutation ideas are used with requirements, formal specifications, architectural design notations, informal descriptions (e.g. use cases) and hardware. Mutation is now established as a major concept in software and systems V&V and uses of mutation are increasing. The goal of the Mutation workshop is to provide a forum for researchers and practitioners to discuss new and emerging trends in mutation analysis. We invite submissions of both full-length and short-length research papers as well as industry practice papers.

Chairs: Lydie du Bousquet and Mercedes G. Merayo

Previous workshops: 2010, 2009, 2007, 2006, 2000


Refactoring and Testing Analysis (REFTEST 2011)

Website: REFTEST 2011

Day: Friday 25th March

Refactoring and its testing implications/crossover have emerged over recent years to become important inter-related research topics with high industrial resonance. Many issues and problems still remain unexplored in these two highly-related fields incorporating topics such as the theoretical underpinnings of refactoring, TDD, empirical studies, refactoring of test artefacts, code smell analysis and patterns (both design and micro-) to name just a few. Refactoring has also a growing importance in the monitoring of system’s evolution and the propensity of systems to minimize maintenance effort and fault propensity; the over-riding question, still largely unanswered is whether we can quantify the benefits of refactoring. The purpose and goal of REFTEST is to bring together industrial practitioners and academics in a setting where current issues in refactoring and test crossover can be presented, relationships with testing discussed, results from current research in refactoring/testing disseminated and future directions distilled.

Chair: Steve Counsell

This workshop is organized by the REFTEST network, http://www.reftest.org


Regression Testing (Regression 2011)

Website: Regression 2011

Day: Monday 21st March

Regression testing has received significant amount of attention from both academics and practitioners during the last 20 years. Various techniques have been developed, many of which are thought to be mature enough for industrial adoption. However, the advances in cloud computing and web application, combined with new software development paradigm assisted by centralized version control system and distributed testing environment, call for new approaches towards regression testing. Software systems are now highly modular, often written in several programming languages, continuously modified and tested, distributed over a wide range of hardware/software configurations and 'made available' rather than shipped and released. Agile practice increases the need for efficient regression testing process; open source software development affects the working practices for many companies. All of these changes present new and exciting challenges in regression testing. This workshop aims to provide a venue of communication for academics and practitioners working on regression testing so that the answers to these challenges can be formulated with a strong focus on industrial relevance..

Chairs: Per Runeson and Shin Yoo


Requirements and Validation, Verification & Testing (ReVVerT 2011)

Website: ReVVerT 2011

Day: Friday 25th March

Verification and validation are important means to measure and guarantee the quality of systems. There are many existing and upcoming standards (IEC 61508, ISO 26262, DO-178B) that demand high quality of safety- related systems and the proof of it. Alone but also in combination with model-based approaches, this research area attracts a lot of interest in academia and in the industry. All development projects are based on capturing requirements. The quality of the following activities in the development process, like design, verification, implementation, and testing, highly depends on the quality of the requirements (as defined in IEEE 830). Capturing good requirements and integrating them into the development process is an important issue. The goal of this workshop is to discuss and identify the intersections and mutual leverages of both topics. We want to discuss questions like “How can we achieve complete, clear and testable requirements?”, “How to verify requirements?”, “How can we use requirements for validation and verification of systems?”, “How to trace between requirements and other development artifacts?”, etc. We invite both industry and academics to provide novel approaches, experience reports, and discussion proposals.

Chairs: Stephan Weissleder, Baris Güldali and Sebastian Oster


Scenario-Based Software Testing (Scenarios 2011)

Website: Scenarios 2011

Day: Monday 21st March

Nowadays, more and more techniques rely on human intervention so as to ensure the applicability of testing approaches. Indeed, a trade-­‐off has to be found between the relevance of the test cases (requiring strong human intervention) and automation. Scenario-­‐Based Testing addresses this issue by looking for more automation, with human intervention restricted to insightful activities. Over the years, different scenario based testing techniques have been developed to assist the validation engineer, using textual scenarios such as regular expressions, graphical notations such as UML interaction diagrams or test purposes specified as transitions systems. All these techniques represent an efficient solution to the state space explosion problem by restricting the possible executions of the system to a limited, and hopefully more accurate, subset of admissible traces. In addition, they make it possible to capture the human expertise for testing specific situations that can not be targeted by a systematic model coverage approach. This 1st edition of the workshop on Scenario Based Testing aims at gathering ideas and techniques in the area of semi-­‐automated testing. It is intended to assess the effectiveness of available techniques and promote original research ideas that can be concretized into an industrial context.

Scenarios 2011 will feature as a special session of Advances in Model-Based Testing (A-MOST 2011).

Chairs: Frederic Dadeau and Lydie du Bousquet


Search-Based Software Testing (SBST 2011)

Website: SBST 2011

Day: Monday 21st March

Search-based software testing is the use of random or directed search techniques (hill climbing, genetic algorithms etc.) to address problems in the software testing and verification and validation domain. There has been an explosion of activity in the field of late, particularly on test data generation. But recent work also focus on models, bug fixing, real-time testing, interaction testing, testing of service-oriented architectures, test case prioritization and generation of whole tests and test suites. The 4th SBST workshop, SBST '11, will provide: a platform for interaction between search-based researchers and other software testing researchers, an open forum for the discussion of new ideas and future directions, a format giving detailed feedback to researchers in search-based software testing on their latest results. We invite research papers and industry/experience reports. The workshop will have a highly interactive format that encourages discussion about the presented papers and about general themes in search-based software testing.

Chairs: Myra Cohen and Andrea Arcuri

Previous workshops: 2010, 2009, 2008


Security Testing (SECTEST 2011)

Website: SECTEST 2011

Day: Friday 25th March

To improve software security, several techniques, including vulnerability modeling and security testing, have been developed but the problem remains unsolved. On one hand, the workshop tries to answer how vulnerability modeling can help users understand the occurrence of vulnerabilities so to avoid them, and what the advantages and drawbacks of the existing models are to represent vulnerabilities. At the same time, the workshop tries to understand how to solve the challenging security testing problem given that testing the mere functionality of a system alone is already a fundamentally critical task, how security testing is different from and related to classical functional testing, and how to assess the quality of security testing. The objective of this workshop is to share ideas, methods, techniques, and tools about vulnerability modeling and security testing to improve the state of the art.

Chairs: Keqin Li, Wissam Mallouli and Luca Vigano

Previous workshops: This workshop is a follow-up and combination of the First International Workshop on Security Testing (SECTEST 2008) and the First International Workshop on Modeling and Detection of Vulnerabilities (MDV 2010)


Testing: Academic & Industrial Conference: Practice And Research Techniques (TAIC PART 2011)

Website: TAIC PART 2011

Day: Friday 25th March

TAIC PART is a workshop that aims to forge collaboration between industry and academia on the challenging and exciting problem of real-world software testing. It is sponsored by representatives of both industry and academia, bringing together commercial and industrial software developers with academic researchers working on the theory and practice of software testing. The goals of TAIC PART range from the articulation of research questions in the field of software testing and analysis to practical challenges faced by software developers in industry. One aim is also to describe and discuss methods for better collaboration between academia and industry in these areas. TAIC PART is a unique event that strives to combine the important aspects of a software testing conference and workshop.

Chairs: Gordon Fraser, Robert Feldt and Per Runeson


Testing and Debugging (TeBug 2011)

Website: TeBug 2011

Day: Friday 25th March

The 1st International Workshop on Testing & Debugging (TeBug) aims in bringing together researchers and practitioners in the fields of software testing and debugging.  Papers to be submitted for TeBug should either focus on techniques that are relevant for debugging or describe the application of testing for debugging. The latter is of especial interest for the first edition of the workshop because the influence of testing on debugging and vice-versa has not yet been tackled sufficiently. Other topics of interest include static and dynamic program analysis, monitoring of software, and other debugging techniques like algorithmic and automated debugging, delta debugging, debugging based on models, debugging using mutations or genetic programming, or debugging using slicing. For TeBug we are seeking for high quality papers describing original research in the mentioned areas, or tool demonstration papers. Furthermore, we especially welcome industrial experience papers describing either open problems regarding the intersection of testing and debugging or experiences obtained when using debugging tools in practice. For the best papers presented at TeBug, we plan to organize a special issue of a software engineering journal.

Chairs: Franz Wotawa and Rui Abreu


Testing Techniques and Experimentation Benchmarks for Event-Driven Software (TESTBEDS 2011)

Website: TESTBEDS 2011

Day: Monday 21st March

This workshop has two goals. First, is to bring together researchers and practitioners to discuss issues that pertain to testing of event-driven software (EDS). An EDS takes internal/external events (e.g., commands, messages) as input (e.g., from users, other applications), changes its state, and sometimes outputs an event sequence. Common examples of EDS include graphical user interfaces (GUIs), web applications, network protocols, embedded software, software components, and device drivers. The second major goal of this workshop is to promote the development of shared experimentation benchmarks for EDS. Lack of benchmarks for experimentation is one of the biggest obstacles to conducting research in the field of EDS testing. Benchmarks may contain artifacts (EDS subjects and their versions, test cases, coverage-adequate test suites, fault matrices, coverage matrices, bug reports, change requests), tools (test-case generators, test-case replayers, fault seeders, regression testers), and processes (how an experimenter may use the tools and artifacts together).

Chair: Atif Memon

Previous workshops: 2010, 2009



Variability-Intensive Systems Testing, Validation and Verification (VAST 2011)

Website: VAST 2011

Day: Monday 21st March

Driven by rising customer demands, continuously changing context conditions (such as legal or business settings), and the wish to leverage existing development assets, the capability of modern software systems to be configurable or reconfigurable is increasing. This leads to software systems exhibiting a high degree of variability. Over the past years development paradigms that enable engineering and maintaining such high-variability software systems thus have appeared; the most prominent examples being Software Product Lines (SPL), Service-Oriented Architectures (SOA), and Dynamically Adaptive Systems (DAS). Due to the productivity gains those paradigms promise and due to the powerful ways of handling variability that they offer to application developers, they are gaining popularity in a world where tight schedules and ever changing business needs are the rule.

But this coin has a flipside; variability challenges testing, verification and validation techniques. Indeed, combinatorial explosion due to variability is a common problem spanning over all these paradigms. To date, some specific techniques have been developed (such as combinatorial interaction testing or modular checking) to contend with such explosion during the verification & validation process. However the field is still in its infancy and results are scattered amongst several communities.

The aims of this workshop are to provide a forum in which practitioners and researchers can share their ideas and results and to establish a common research agenda for testing, verification and validation of variability-intensive systems.

Chairs: Gilles Perrouin, Patrick Heymans, Andreas Metzger and Yves le Traon.


Comments