My research focus is to connect software engineering research and AI research to improve software trustworthiness. Most recently, I am working on improving the trustworthiness of machine translation systems (ICSE 2022, ICSE 2020), programming language translation (ICLR 2022), Question answering software (ASE 2022), and the fairness of general ML classifiers (FSE 2022, FSE 2021, ICSE 2021). For an overview of the vision and literatue of software testing techniques for machine learning software, please refer to our survey on Machine Learning Testing (TSE 2020).
Before joining King's College London, I was a research fellow at University College London working with Professor Mark Harman and Professor Federica Sarro. I obtained my PhD degree in Computer Science from Peking University, China. My Phd advisors are Professor Lu Zhang and Professor Dan Hao.
Jan 16th 2023. "Who Judges the Judge: An Empirical Study on Online Judge Tests" (Kaibo Liu, Yudong Han, Jie Zhang, Zhenpeng Chen, Federica Sarro, Mark Harman, Gang Huang, Yun Ma) is accepted by ISSTA 2023.
Jan 11th 2023. "A Comprehensive Empirical Study of Bias Mitigation Methods for Machine Learning Classifiers" (Zhenpeng Chen, Jie M. Zhang, Federica Sarro, Mark Harman) is accepted by ACM TOSEM.
Dec 8th 2022. "Vulnerability Detection with Graph Simplification and Enhanced Graph Representation Learning" (Xin-Cheng Wen, Yupan Chen, Cuiyun Gao, Hongyu Zhang, Jie M. Zhang, Qing Liao) is accepted by ICSE 2023.
Oct 26th 2022. I gave a talk on ML trustworthiness at Royal Holloway.
July 26th 2022. I am invited to give a talk on ML trustworthiness at Data61, CSIRO.
July 20th 2022. Our paper "Natural Test Generation for Precise Testing of Question Answering Software" (by Qingchao Shen, Junjie Chen, Jie M. Zhang, Haoyu Wang, Shuang Liu, Menghan Tian) is accepted by ASE 2022!
June 28th 2022. I am invited to give a talk on Trustworthy Machine Translation at Fudan University.
June 24th 2022. I am invited to give a talk on testing machine learning systems at the University of Bristol.
June 14th 2022. Our paper "MAAT: A Novel Ensemble Approach to Fixing Fairness and Performance Bugs for Machine Learning Software" (by Zhenpeng Chen, Jie M. Zhang, Federica Sarro, Mark Harman) is accepted by FSE 2022!
June 13th 2022. I am invited as a keynote speaker at RACSAD 2022 on Machine Learning Testing.
June 1st 2022. I am excited to start my new journey at King's College London as a lecturer (US Assistant Professor) of Software Engineering. My KCL webpage is here.
March 3rd 2022. "Using Lexical and Semantic Program Features to form Generic Code Representation" (by Wei Ma, Mengjie Zhao, Ezekiel Soremekun, Qiang Hu, Jie Zhang, Mike Papadakis, Maxime Cordy, Xiaofei Xie, Yves Le Traon) is accepted by MSR 2022.
Jan 28th 2022. Our paper "Leveraging Automated Unit Tests for Unsupervised Code Translation" has been selected as a spotlight paper (acceptance rate 5%) in ICLR 2022!
Jan 20th 2022. "Leveraging Automated Unit Tests for Unsupervised Code Translation" (by Baptiste Roziere, Jie M. Zhang, Francois Charton, Mark Harman, Gabriel Synnaeve, Guillaume Lample) is accepted by ICLR 2022.
Dec 10th 2021. Invited talk at Beijing University of Posts and Telecommunications: Fairness in machine learning software.
Dec 2nd, 2021. "Improving Machine Translation Systems via Isotopic Replacement" (by Zeyu Sun, Jie M. Zhang, Yingfei Xiong, Mark Harman, Mike Papadakis, Lu Zhang) is accepted by ICSE 2022.
May 21st, 2021. "Fairea: A Model Behaviour Mutation Approach to Benchmarking Bias Mitigation Methods" (by Max Hort, Jie M. Zhang, Federica Sarro, Mark Harman) is accepted by FSE 2021.
May 10th, 2021. Check Facebook's vision on Cyber–Cyber and Cyber–Physical Digital Twins!
Jan 8th 2021. "'Ignorance and Prejudice' in Software Fairness" (by Jie M. Zhang and Mark Harman) is accepted by ICSE 2021. [Short video]
Mutation 2020 is coming (24th Oct, 2020). More informatio: https://mutation-workshop.github.io/2020/#program Look forward to meeting you there!
Sep 2nd. Invited talk at The Hong Kong University of Science and Technology: Machine Learning Testing.
May 19th. "FrUITeR - A 𝐅𝐫amework for Evaluating 𝐔𝐈 𝐓𝐞st 𝐑euse " (by Yixue Zhao, Justin Chen, Adriana Sejfia, Marcelo Schmitt Laser, Jie M. Zhang, Federica Sarro, Mark Harman, Nenad Medvidović) is accepted to FSE2020.
May 19th. APSEC 2020 is calling for papers, welcome to submit your papers!
May 17th. STVR special issue: Mutation Analysis and Its Industrial Applications is calling for papers! Welcome to submit your papers!
Feb 13th, 2020. Invited talk at Facebook London: Perturbation Validation: A New Heuristic to Validate Machine Learning Models.
Dec 8th, 2019. "Automatic Testing and Improvement of Machine Translation" (by Zeyu Sun, Jie M. Zhang (co-first author), Mark Harman, Mike Papadakis, Lu Zhang) has been accepted by ICSE2020.
Nov 25th, 2019. "Machine Learning Testing: Survey, Landscapes and Horizons" (by Jie M. Zhang, Mark Harman, Lei Ma, Yang Liu) has been fully accepted by TSE (with one round of minor revision).
Oct 10th, 2019. Our paper "A Study of Programming Languages and Their Bug Resolution Characteristics" has been accepted by TSE (with one round of revision).
June 26th, 2019. Our survey Machine Learning Testing: Survey, Landscapes and Horizons is on arXiv. Any comments are welcome!
I am invited to give a talk at Queen Mary University on Machine Learning Testing, on June 26th, 2019 [slides].
Feb 12, 2019. One paper accepted by Mutation19: An Empirical Comparison of Mutant Selection Assessment Metrics, by Jie M. Zhang, Lingming Zhang, Dan Hao, Lu Zhang, Mark Harman
Dec 18, 2018. One paper accepted by ICST 2019: Do Pseudo Test Suites Lead to Inflated Correlation in Measuring Test Effectiveness? by Jie Zhang, Lingming Zhang, Dan Hao, Meng Wang, Lu Zhang.
One paper accepted by FSE 2018 industry track: Automated Refactoring of Nested-IF Formulae in Spreadsheets, by Jie Zhang, Shi Han, Dan Hao, Lu Zhang, Dongmei Zhang
I got the Outstanding PHD Graduate Award at Peking University
Research Fellow | March, 2019 – May, 2022 | CREST, UCL, UK | Supervisor : Prof. Mark Harman and Prof. Federica Sarro
Research Associate | February, 2018 – December, 2018 | CREST, UCL, UK | Supervisor : Prof. Mark Harman and Prof. Earl Barr
PHD student | Sep, 2015 – June, 2018 | GOSTA, Peking University, China | Supervisor : Prof. Lu Zhang and Prof. Dan Hao
Honors and Awards
2018 Outstanding PHD Graduate Award, Peking University
2017 Top-ten Research Excellence Award, EECS, Peking University
2016 Lee Wai Wing Scholarship at Peking University
2015 National Scholarship
2015 Award for Scientific Research
2014 Learning Scholarship at Peking University
2014 Award for Scientific Research
2014 Innovation Award at Peking University
2013 Learning Excellence Award at Peking University