Jie M. Zhang (张洁)
Lecturer (Assistant Professor), King's College London, UK.
Email: jie.zhang@kcl.ac.uk
Links: CV Google Scholar
Office: Bush House, Strand Campus, 30 Aldwych, London, WC2B 4BG, UK
One studentship available supervised by me on Responsible AI, jointly funded by EPSRC and BT through the Industrial Cooperative Awards in Science & Technology scheme. Home applicants only. Application deadlinel April 15th. Contact me if you are interested.
I am the Program co-chair of conference AIware 2024, co-located with FSE 2024. Research track submission DDL: 29th March 2024.
I am the Program co-chair of Internetware 2024. Submission Deadline April 10th 2024.
Research Interest
My research focus is to connect software engineering research and AI research to improve trustworthiness. Most recently, I have been working on improving the trustworthiness of machine translation systems (ICSE 2022, ICSE 2020), programming language translation (ICLR 2022), Question answering software (ASE 2022), and the fairness of general ML classifiers (ICSE 2024, FSE 2022, FSE 2021, ICSE 2021). For an overview of the vision and literature of software testing techniques for machine learning software, please refer to our survey on Machine Learning Testing (TSE 2020). Please also check our recent vision paper for an overview and vision of LLMs for software engineering.
Before joining King's College London, I was a research fellow at University College London working with Professor Mark Harman and Professor Federica Sarro. I obtained my PhD degree in Computer Science from Peking University, China. My Phd advisors are Professor Lu Zhang and Professor Dan Hao.
News
23rd Jan 2024, our paper titled "Stealthy Backdoor Attack for Code Models" (by Zhou Yang, Bowen Xu, Jie M. Zhang, Jin Hong, Jieke Shi, Junda He, David Lo) has been accepted by IEEE Transactions on Software Engineering.
Dec 18th, our paper on machine learning testing got the 2022 Best Paper Award from IEEE Transactions on Software Engineering.
Nov 14th, I got the NMES Enterprise & Engagement Partnerships Fund from King's. I will use the money to organise a one-day event to tackle the gap between industry and academia in LLMs + SE in early 2024.
Oct 25th, our paper "Search-based Automatic Repair for Fairness and Accuracy in Decision-making Software" (by Max Hort, Jie M. Zhang, Federicaf Sarror, Mark Harman) is accepted by Empirical Software Engineering.
Oct 15th, our paper "Fairness Improvement with Multiple Protected Attributes: How Far Are We?" (by Zhenpeng Chen, Jie M. Zhang, Federica Sarro, Mark Harman) is accepted by ICSE 2024.
August 17th, our paper "Dark-Skin Individuals Are at More Risk on the Street: Unmasking Fairness Issues of Autonomous Driving Systems" is reported by New Scientist [link]!
August 15th 2023, our paper on "Mutation Analysis for Evaluating Code Translation" (Giovani Guizzo, Jie M. Zhang, Federica Sarro, Christoph Treude, Mark Harman) is accepted by Empirical Software Engineering!
July 15th 2023, I am on the selection committee for ASE 2023 Most Influential Paper award.
April 18th 2023. I am selected as a new member of the steering committee for ICST. Looking forward to having more opportunities to serve the community!
April 4th 2023. I gave a talk at Huawei on "Automatica Assessing and Improving the Trustworthiness of Code".
March 8th 2023. I am selected as one of the top-fifteen 2023 Chinese Female Young Scholars in AI+X (全球华人女性青年学者榜). The selection is based on academic excellence, academic influence, and academic potential index with big data mining technology and automated evaluation methods.
March 3rd 2023. I am invited as a panelist for seminar "CHATGPT: A CLOSER LOOK AT LARGE LANGUAGE MODELS" organised by CBAIA (Chinese-British Artificial Intelligence Association).
Feb 28th 2023. "Model Validation Using Mutated Training Labels: An Exploratory Study" (Jie M. Zhang, Mark Harman, Benjamin Guedj, Earl Barr, John Shawe-Taylor) is accepted by Neurocomputing.
Feb 14th 2023. I gave a keynote talk on machine translation trustworthiness at PracticalDL in AAAI 2023.
Jan 16th 2023. "Who Judges the Judge: An Empirical Study on Online Judge Tests" (Kaibo Liu, Yudong Han, Jie Zhang, Zhenpeng Chen, Federica Sarro, Mark Harman, Gang Huang, Yun Ma) is accepted by ISSTA 2023.
Jan 11th 2023. "A Comprehensive Empirical Study of Bias Mitigation Methods for Machine Learning Classifiers" (Zhenpeng Chen, Jie M. Zhang, Federica Sarro, Mark Harman) is accepted by ACM TOSEM.
Dec 8th 2022. "Vulnerability Detection with Graph Simplification and Enhanced Graph Representation Learning" (Xin-Cheng Wen, Yupan Chen, Cuiyun Gao, Hongyu Zhang, Jie M. Zhang, Qing Liao) is accepted by ICSE 2023.
Oct 26th 2022. I gave a talk on ML trustworthiness at Royal Holloway.
July 26th 2022. I am invited to give a talk on ML trustworthiness at Data61, CSIRO.
July 20th 2022. Our paper "Natural Test Generation for Precise Testing of Question Answering Software" (by Qingchao Shen, Junjie Chen, Jie M. Zhang, Haoyu Wang, Shuang Liu, Menghan Tian) is accepted by ASE 2022!
June 28th 2022. I am invited to give a talk on Trustworthy Machine Translation at Fudan University.
June 24th 2022. I am invited to give a talk on testing machine learning systems at the University of Bristol.
June 14th 2022. Our paper "MAAT: A Novel Ensemble Approach to Fixing Fairness and Performance Bugs for Machine Learning Software" (by Zhenpeng Chen, Jie M. Zhang, Federica Sarro, Mark Harman) is accepted by FSE 2022!
June 13th 2022. I am invited as a keynote speaker at RACSAD 2022 on Machine Learning Testing.
June 1st 2022. I am excited to start my new journey at King's College London as a lecturer (US Assistant Professor) of Software Engineering. My KCL webpage is here.
March 3rd 2022. "Using Lexical and Semantic Program Features to form Generic Code Representation" (by Wei Ma, Mengjie Zhao, Ezekiel Soremekun, Qiang Hu, Jie Zhang, Mike Papadakis, Maxime Cordy, Xiaofei Xie, Yves Le Traon) is accepted by MSR 2022.
Jan 28th 2022. Our paper "Leveraging Automated Unit Tests for Unsupervised Code Translation" has been selected as a spotlight paper (acceptance rate 5%) in ICLR 2022!
Jan 20th 2022. "Leveraging Automated Unit Tests for Unsupervised Code Translation" (by Baptiste Roziere, Jie M. Zhang, Francois Charton, Mark Harman, Gabriel Synnaeve, Guillaume Lample) is accepted by ICLR 2022.
Dec 10th 2021. Invited talk at Beijing University of Posts and Telecommunications: Fairness in machine learning software.
Dec 2nd, 2021. "Improving Machine Translation Systems via Isotopic Replacement" (by Zeyu Sun, Jie M. Zhang, Yingfei Xiong, Mark Harman, Mike Papadakis, Lu Zhang) is accepted by ICSE 2022.
May 21st, 2021. "Fairea: A Model Behaviour Mutation Approach to Benchmarking Bias Mitigation Methods" (by Max Hort, Jie M. Zhang, Federica Sarro, Mark Harman) is accepted by FSE 2021.
May 10th, 2021. Check Facebook's vision on Cyber–Cyber and Cyber–Physical Digital Twins!
Jan 8th 2021. "'Ignorance and Prejudice' in Software Fairness" (by Jie M. Zhang and Mark Harman) is accepted by ICSE 2021. [Short video]
Mutation 2020 is coming (24th Oct, 2020). More informatio: https://mutation-workshop.github.io/2020/#program Look forward to meeting you there!
Sep 2nd. Invited talk at The Hong Kong University of Science and Technology: Machine Learning Testing.
May 19th. "FrUITeR - A 𝐅𝐫amework for Evaluating 𝐔𝐈 𝐓𝐞st 𝐑euse " (by Yixue Zhao, Justin Chen, Adriana Sejfia, Marcelo Schmitt Laser, Jie M. Zhang, Federica Sarro, Mark Harman, Nenad Medvidović) is accepted to FSE2020.
May 19th. APSEC 2020 is calling for papers, welcome to submit your papers!
May 17th. STVR special issue: Mutation Analysis and Its Industrial Applications is calling for papers! Welcome to submit your papers!
Feb 25th, 2020. I was invited to give a talk at Dagstuhl Seminar SE4ML: Software Testing for Machine Learning.
Feb 13th, 2020. Invited talk at Facebook London: Perturbation Validation: A New Heuristic to Validate Machine Learning Models.
Dec 8th, 2019. "Automatic Testing and Improvement of Machine Translation" (by Zeyu Sun, Jie M. Zhang (co-first author), Mark Harman, Mike Papadakis, Lu Zhang) has been accepted by ICSE2020.
Nov 25th, 2019. "Machine Learning Testing: Survey, Landscapes and Horizons" (by Jie M. Zhang, Mark Harman, Lei Ma, Yang Liu) has been fully accepted by TSE (with one round of minor revision).
Oct 10th, 2019. Our paper "A Study of Programming Languages and Their Bug Resolution Characteristics" has been accepted by TSE (with one round of revision).
June 26th, 2019. Our survey Machine Learning Testing: Survey, Landscapes and Horizons is on arXiv. Any comments are welcome!
I am invited to give a talk at Queen Mary University on Machine Learning Testing, on June 26th, 2019 [slides].
I am invited to give a talk at Ada Workshop co-located with ISSTA 2019 in July [slides].
I am invited to give a talk at SEMLA 2019 about Machine Learning Testing on May 23-24th [slides].
Feb 12, 2019. One paper accepted by Mutation19: An Empirical Comparison of Mutant Selection Assessment Metrics, by Jie M. Zhang, Lingming Zhang, Dan Hao, Lu Zhang, Mark Harman
Dec 18, 2018. One paper accepted by ICST 2019: Do Pseudo Test Suites Lead to Inflated Correlation in Measuring Test Effectiveness? by Jie Zhang, Lingming Zhang, Dan Hao, Meng Wang, Lu Zhang.
One paper accepted by FSE 2018 industry track: Automated Refactoring of Nested-IF Formulae in Spreadsheets, by Jie Zhang, Shi Han, Dan Hao, Lu Zhang, Dongmei Zhang
I got the Outstanding PHD Graduate Award at Peking University
Research Experience
Research Fellow | March, 2019 – May, 2022 | CREST, UCL, UK | Supervisor : Prof. Mark Harman and Prof. Federica Sarro
Research Associate | February, 2018 – December, 2018 | CREST, UCL, UK | Supervisor : Prof. Mark Harman and Prof. Earl Barr
PHD student | Sep, 2015 – June, 2018 | GOSTA, Peking University, China | Supervisor : Prof. Lu Zhang and Prof. Dan Hao
Intern | June,2017-December, 2017 | Software Analysis group, Microsoft Research Asia, China | Mentor: Shi Han
Visiting student | Sep, 2016–Dec, 2016 | CREST, University College London, UK | Supervisor : Mark Harman
Honors and Awards
2018 Outstanding PHD Graduate Award, Peking University
2017 Top-ten Research Excellence Award, EECS, Peking University
2016 Fellowship at Microsoft Research Asia
2016 Lee Wai Wing Scholarship at Peking University
2015 National Scholarship
2015 Award for Scientific Research
2014 Learning Scholarship at Peking University
2014 Award for Scientific Research
2014 Innovation Award at Peking University
2013 Learning Excellence Award at Peking University