• 11. Demystifying Checker Bugs in Deep Learning Libraries
  Nima Shiri Harzevili, Mohammad Mahdi Mohajer, Jiho Shin, Moshi Wei, Gias Uddin, Jinqiu Yang, Junjie Wang, Song Wang, Zhen Ming (Jack) Jiang, Nachiappan Nagappan
  42nd International Conference on Software Maintenance and Evolution (ICSME 2026) to appear

• 10. SecVulEval: Benchmarking LLMs for Real-World C/C++ Vulnerability Detection
  Md Basim Uddin Ahmed, Nima Shiri Harzevili, Jiho Shin, Hung Viet Pham, Song Wang
  3rd ACM International Conference on AI-powered Software (AIware 2026 B&D)
  🏆 AIware Best Benchmark & Dataset Award

• 9. Retrieval-Augmented Test Generation: How Far Are We?
  Jiho Shin, Nima Shiri Harzevili, Reem Aleithan, Hadi Hemmati, Song Wang
  48th IEEE/ACM International Conference on Software Engineering (ICSE 2026)

• 8. Pre-trained Models for Bytecode Instructions
  Donggyu Kim, Taemin Kim, Jiho Shin, Song Wang, Heeyoul Choi, and Jaechang Nam
  18th IEEE International Conference on Software Testing, Verification and Validation (ICST-Short 2025) 

• 7. Prompt Engineering or Fine-Tuning: An Empirical Assessment of LLMs for Code
  Jiho Shin, Clark Tang, Tahmineh Mohati, Maleknaz Nayebi, Song Wang, Hadi Hemmati
  22nd IEEE/ACM International Conference on Mining Software Repositories (MSR 2025)

• 6. Domain Adaptation for Code Model-Based Unit Test Case Generation
  Jiho Shin, Sepehr Hashtroudi, Hadi Hemmati, Song Wang
  33rd ACM SIGSOFT International Symposium on Software Testing and Analysis (ISSTA 2024)

• 5. An Empirical Study on the Stability of Explainable Software Defect Prediction
  Jiho Shin, Reem Aleithan, Jaechang Nam, Junjie Wang, Nima Shiri Harzevili, Song Wang
  30th Asia-Pacific Software Engineering Conference (APSEC 2023)
  🏆 Distinguished Paper Award

• 4. Automatic Static Vulnerability Detection for Machine Learning Libraries: Are We There Yet?
  Nima Shiri Harzevili, Jiho Shin, Junjie Wang, Song Wang, Nachiappan Nagappan
  34th IEEE International Symposium on Software Reliability Engineering (ISSRE 2023) 

• 3. Characterizing and Understanding Software Security Vulnerabilities in Machine Learning Libraries
  Nima Shiri Harzevili, Jiho Shin, Junjie Wang, Song Wang, Nachiappan Nagappan
  20th IEEE/ACM International Conference on Mining Software Repositories (MSR 2023)

• 2. API Recommendation for Machine Learning Libraries: How Far Are We?
  Moshi Wei, Yuchao Huang, Junjie Wang, Jiho Shin, Nima Shiri Harzevili, Song Wang
  30th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE 2022)

• 1. Similar Patch Recommendation for Actionable Defect Prediction
  Jiho Shin and Jaechang Nam
  22nd Korea Conference on Software Engineering (KCSE 2020)
  🏆 Distinguished Paper Award

• 7. StaAgent: An Agentic Framework for Testing Static Analyzers
  Elijah Nnorom, Md Basim Uddin Ahmed, Jiho Shin, Hung Viet Pham, Song Wang
  ACM Transactions on Software Engineering and Methodology (TOSEM 2026) to appear

• 6. From Cool Demos to Production-Ready FMware: Core Challenges and a Technology Roadmap
  Gopi Krishnan Rajbahadur, Gustavo A. Oliva, Dayi Lin, Jiho Shin, Ahmed E. Hassan
  ACM Transactions on Software Engineering and Methodology (TOSEM 2026)

• 5. Surveying the Benchmarking Landscape of Large Language Models in Code Intelligence
  Mohammad Abdollahi, Ruixin Zhang, Nima Shiri Harzevili, Jiho Shin, Song Wang, Hadi Hemmati
  ACM Transactions on Software Engineering and Methodology (TOSEM 2026)

• 4. Toward Automated Validation of Language Model Synthesized Test Cases using Semantic Entropy
  Hamed Taherkhani, Jiho Shin, Muhammad Ammar Tahir, Md Rakib Hossain Misu, Vineet Sunil Gattani, Hadi Hemmati
  IEEE Transactions on Software Engineering (TSE 2026)

• 3. Assessing Evaluation Metrics for Neural Test Oracle Generation
  Jiho Shin, Hadi Hemmati, Moshi Wei, Song Wang
  IEEE Transactions on Software Engineering (TSE 2024 and ICSE-JF 2025)

• 2. The Good, the Bad, and the Missing: Neural Code Generation for Machine Learning Tasks
  Jiho Shin, Moshi Wei, Junjie Wang, Lin Shi, Song Wang
  ACM Transactions on Software Engineering and Methodology (TOSEM 2023)

• 1. A Survey of Automatic Code Generation from Natural Language
  Jiho Shin and Jaechang Nam
  Journal of Information Processing Systems (JIPS 2021)

• 5. Trajectory-Aware Benchmark Subset Selection for Cost-Efficient Software Engineering Agent Regression Testing
  Mahmoud Ayyad, Zehao Wang, Jiho Shin, Ying Zou, Bram Adams
  arXiv preprint 2026 (Under Review)

• 4. NEUROTESTGEN: Neuro-Symbolic Guided Test Generation with Large Language Models
  Ruixin Zhang, Jiho Shin, Hung Viet Pham, Song Wang
  arXiv preprint 2026 (Under Review)

• 3. A Large-Scale Empirical Study of Quality Assurance Practices and Gaps in AI Agents
  Wuyang Dai, Moses Openja, Jiho Shin, Hung Viet Pham, Song Wang
  arXiv preprint 2026 (Under Review)

• 2. Testing Large Vision-Language Models: A Systematic Review
  Moses Openja, Wuyang Dai, Jiho Shin, Nikta Akbarpour, Claire Davies, Alvine Boaye Belle, Hung Viet Pham, Gias Uddin, Song Wang
  HAL preprint 2026 (Under Review)

• 1. BloomAPR: A Bloom's Taxonomy-based Framework for Assessing the Capabilities of LLM-Powered APR Solutions
  Yinghang Ma, Jiho Shin, Leuson Da Silva, Zhen Ming (Jack) Jiang, Song Wang, Foutse Khomh, Shin Hwei Tan
  arXiv preprint 2025 (Under Review)

York University, Toronto 2021 ~ 2025

Dept. of EECS Ph.D.

Research Field: AI/ML for Software Engineering, Code Generation, Automated Software Testing, LLM for SE

Supervisors: Dr. Song Wang and Dr. Hadi Hemmati

Thesis: Investigating the Effectiveness of Large Language Models in Automated Software Engineering

Handong Global University, Pohang 2019 ~ 2021

Dept. of CSEE M.Sc.

Research Field: Code Generation, Actionable and Explainable Defect Prediction

Supervisor: Dr. Jaechang Nam

Thesis: Actionable Defect Prediction

Handong Global University, Pohang 2012 ~ 2019

Dept. of CSEE B.Sc.

Specialization: Web Application, Human-Computer Interaction, Computer Vision

York  University
Post-Doctoral Research Fellow May 2026 ~ Present

Queen's  University
Post-Doctoral Research Fellow Sep. 2025 ~ Apr. 2026

Turing
RLEF/CodeGenAgent Lead (Remote) Jan. 2024 ~ May 2025

HGS (Hinduja Group Companies)
Applied AI Engineering Intern (Remote) Oct. 2024 ~ Feb. 2025

York University
Graduate Research Assistant Sep. 2021 ~ Aug. 2025
Teaching Assistant Sep. 2021 ~ Apr. 2025

Handong Global University
Graduate Research Assistant Mar. 2019 ~ Feb. 2021
Teaching Assistant Sep. 2018 ~ Dec. 2020

Republic of Korea Navy
Military Interpreter (KOR/ENG) Feb. 2014 ~ Jan. 2016

Organizing Committee

[ICST’24] Web Chair, 17th IEEE International Conference on Software Testing, Verification and Validation.

[ICSME’27] Web Chair, 43rd IEEE International Conference on Software Maintenance and Evolution

Student Volunteer

[ICSE’25] SV, 50th IEEE/ACM International Conference on Software Engineering.

[ICST’24] SV, 17th IEEE International Conference on Software Testing, Verification and Validation.

PC

[ASE'26] PC - IEEE/ACM International Conference on Automated Software Engineering, Research Paper Track.

[ICST'26] PC - IEEE International Conference on Software Testing, Verification and Validation, Research Paper Track.

[MSR'26] PC - IEEE/ACM International Conference on Mining Software Repositories, Mining Challenge Track.

[FSE'26] PC - ACM Foundations of Software Engineering, Artifact Track.

[AIGC'25] PC - International Conference on AI-Generated Content, Research Paper Track.

[COMPSAC-SETA’25] PC - IEEE Symposium on Software Engineering Technologies & Applications.

[MSR’25] Junior PC - Junior PC for the IEEE/ACM MSR'25, Research Paper Track. (accept. rate: 111/262=42.4%).

[ICSE’25] Shadow PC - Shadow PC for the IEEE/ACM ICSE'25, Research Paper Track. (accept. rate: 50/299=16.7%).

Reviewer

[TSE] Reviewer - IEEE Transactions on Software Engineering.

[TOSEM] Reviewer - ACM Transactions on Software Engineering and Methodology.

[JSS] Reviewer - ScienceDirect Journal of Systems and Software.

[EMSE] Reviewer - Springer Nature Link Empirical Software Engineering.

[STVR] Reviewer - Wiley Software Testing, Verification and Reliability. 

[IEEE Software] Reviewer - IEEE Software.

[ESWA] Reviewer - ScienceDirect Expert Systems with Applications.

[PeerJ-CS] Reviewer - PeerJ Computer Science.

Handong Global University - Delivered a seminar on rethinking AI for unit test generation, Mar. 2026

Handong Global University - Delivered a talk on neuralware to promptware: unit test generation, Jan. 2026 

Korea University - Delivered a talk on neuralware to promptware: unit test generation, Jan. 2026

Handong Global University - Invited as one of the alumni panelists at CEST (CSEE undergraduate MT), Mar. 2025

Handong Global University - Delivered a talk about different code generation methods in software engineering, Jan. 2024

ICSME'26 - attended the conference to present a Technical Track paper.

FSE'26 - attended the conference (🏆 at the co-located AIware).

ICSE'26 - attended the conference to present a Technical Track paper.

MSR'25 - attended the conference to present a Technical Track paper.

ICSE'25 - attended the conference to present a Journal First paper.

AIware'24 - attended the AIware Leadership Bootcamp

ISSTA'24 - presented on Unit Test Generation with Domain Adaptation for the technical track.

ICST'24 - organized and attended the conference as a web chair and a student volunteer.

APSEC'23 - presented the XDP (eXplainable Defect Prediction) technical paper 🏆.

CSER'22-24 - attended the Consortium for Software Engineering Research for multiple presentations and posters.

KCSE'20 - presented the idea of change suggestions for actionable defect prediction 🏆.