Publications
2021
DeepMetis: Augmenting a Deep Learning Test Set to Increase its Mutation Score
Vincenzo Riccio, Humbatova Nargiz, Gunel Jahangirova, Paolo Tonella
ASE 2021
DeepCrime: Mutation Testing of Deep Learning Systems based on Real Faults
Humbatova Nargiz, Gunel Jahangirova, Paolo Tonella
ISSTA 2021
Quality Metrics and Oracles for Autonomous Vehicles Testing
Jahangirova Gunel, Andrea Stocco, and Paolo Tonella
ICST 2021
GAssert: A Fully Automated Tool to Improve Assertion Oracles
Valerio Terragni, Gunel Jahangirova, Paolo Tonella, and Mauro Pezzè
Tool Demo Paper at ICSE 2021
Diversifying Focused Testing for Unit Testing
Hector Menendez, Gunel Jahangirova, Federica Sarro, Paolo Tonella, David Clark
ACM Transactions on Software Engineering and Methodology
2020
Taxonomy of real faults in deep learning systems
Humbatova Nargiz, Gunel Jahangirova, Gabriele Bavota, Vincenzo Riccio, Andrea Stocco, Paolo Tonella
ICSE 2020
An empirical evaluation of mutation operators for deep learning systems
Jahangirova Gunel, Paolo Tonella
ICST 2020
Evolutionary improvement of assertion oracles
Valerio Terragno, Gunel Jahangirova, Paolo Tonella, and Mauro Pezzè
FSE 2020
Testing machine learning based systems: a systematic mapping
Vincenzo Riccio, Jahangirova Gunel, Andrea Stocco, Nargiz Humbatova, Michael Weiss, and Paolo Tonella
Empirical Software Engineering
2019
An Empirical Validation of Oracle Improvement
Gunel Jahangirova, David Clark, Mark Harman, Paolo Tonella
TSE 2019
2018
OASIs: Oracle Assessment and Improvement Tool
Gunel Jahangirova, David Clark, Mark Harman, Paolo Tonella
ISSTA 2018 Tool Demo Track
2017
Oracle Problem in Software Testing
Gunel Jahangirova
ISSTA 2017 Doctoral Symposium
2016
Test Oracle Assessment and Improvement
Gunel Jahangirova, David Clark, Mark Harman, Paolo Tonella
ISSTA 2016