Taekyung Heo
Senior Deep Learning Engineer @ NVIDIA
Senior Deep Learning Engineer @ NVIDIA
Hands-on computer systems engineer and researcher focused on performance optimization across hardware, system software, and AI workloads. Builds benchmarking frameworks, models complex systems with simulators, and turns research prototypes into reliable production tools. Strong background in computer architecture, system software, and large codebase comprehension. A versatile "Swiss army knife" who tracks recent trends and executes quickly.
Senior Deep Learning Engineer, NVIDIA, Nov. 2025 - Now
Senior HPC Middleware Developer, NVIDIA, Dec. 2023 - Oct. 2025
Research Engineer II, Georgia Institute of Technology, Mar. 2023 - Dec. 2023
Supervisor: Tushar Krishna
Research Advisor IV @ Meta, Magnit, Nov. 2022 - Dec. 2023
Postdoctoral Fellow, Georgia Institute of Technology, Mar. 2022 - Feb. 2023
Supervisor: Tushar Krishna
Visiting Fellow @ Microsoft Research Asia, FA Talent, Feb. 2018 - Aug. 2018
Doctor of Philosophy (Ph.D.), Computer Science, Korea Advanced Institute of Science & Technology (KAIST), Mar. 2016 - Feb. 2022
Dissertation: Redesigning Hardware and Software Stacks for Terabyte-Scale Memory Systems
Advisor: Jaehyuk Huh
Master of Science (M.Sc.), Computer Science, Korea Advanced Institute of Science & Technology (KAIST), Mar. 2014 - Feb. 2016
Thesis: Dynamic Time Slice Management Based on CPU Pooling in Virtualized Systems
Advisor: Jaehyuk Huh
Bachelor of Science (B.Sc.), Computer Engineering, Sungkyunkwan University, Mar. 2010 - Feb. 2014
Senior Thesis: Performance Analysis of the ext4 File System in Virtualization Environment
Advisor: Young Ik Eom
"Cross-Model KV Cache Transfer in LLM Families: A Closed-Form Linear Mapping for Prefill Reuse", arXiv, August 2026
"Training distribution determines the ceiling of drug-blind cancer sensitivity prediction", arXiv, May 2026
"MLcommons Chakra: Advancing Performance Benchmarking And Co-Design Using Standardized Execution Traces", Conference on Machine Learning and Systems (MLSys), May 2026
"Supporting Trusted Virtual Machines with Hardware-based Secure Remote Memory", International Symposium on Memory Management (ISMM), June 2024
"ASTRA-sim2.0: Modeling Hierarchical Networks and Disaggregated Systems for Large-model Training at Scale", International Symposium on Performance Analysis of Systems and Software (ISPASS), April 2023 [slides, video]
"COMET: A Comprehensive Cluster Design Methodology for Distributed Deep Learning Training", arXiv, November 2022
"InnerSP: A Memory Efficient Sparse Matrix Multiplication Accelerator with Locality-aware Inner Product Processing", International Conference on Parallel Architectures and Compilation Techniques (PACT), September 2021 [slides]
"Adaptive Page Migration Policy with Huge Pages in Tiered Memory Systems", IEEE Transactions on Computers [code]
"Accelerating Critical OS Services in Virtualized Systems with Flexible Micro-sliced Cores", European Conference on Computer Systems (EuroSys), April 2018 [slides, video, code]
“Hybrid TLB Coalescing: Improving TLB Translation Coverage under Diverse Fragmented Memory Allocations”, International Symposium on Computer Architecture (ISCA), June 2017 [slides]
“Efficient Synonym Filtering and Scalable Delayed Translation for Hybrid Virtual Caching”, International Symposium on Computer Architecture (ISCA), June 2016 [slides]
"Chakra: Advancing Performance Benchmarking and Co-design using Standardized Execution Traces", Workshop on Modeling & Simulation of Systems and Applications (ModSim), August 2023 [slides, poster]
"Exploring Memory Expansion Designs for Training Mixture-of-Experts Models", Workshop on Hot Topics in System Infrastructure (HotInfra), June 2023 [slides]
"Chakra: Advancing Performance Benchmarking and Co-design using Standardized Execution Traces", Workshop on Benchmarking Machine Learning Workloads on Emerging Hardware (MLBench), June 2023 [slides]
"FastSwtich: Enabling Real-time DNN Switching via Weight-Sharing", Workshop on Architecture, Compiler, and System Support for Multi-Model DNN Workloads (ACSMD), June 2022
“Chakra and ASTRA-sim: An Open-source Ecosystem for Advancing Co-design for Future AI Systems”, AI & Systems Co-design Faculty Summit on behalf of Tushar Krishna, October 2023
"Chakra and ASTRA-sim: An Open-source Ecosystem for Advancing Co-design for Future AI Systems", ACE Monthly Meeting, September 2023
"Designing Multi-Tensor Core Systems in SST", SST User Group Meeting, September 2023
"Execution Trace (ET) Execution Through Simulator", Chakra Working Group Meeting, August 2023
"ASTRA-sim2.0: Modeling Hierarchical Networks and Disaggregated Systems for Large-model Training at Scale", SRC Combined CADT/AIHW Annual Review, May 2023
"ASTRA-sim Tutorial", International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS), March 2023
"ASTRA-sim Tutorial", Conference on Machine Learning and Systems (MLSys), August 2022
"ASTRA-sim Tutorial", International Symposium on Computer Architecture (ISCA), June 2022
"ASTRA-sim Tutorial", International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS), February 2022
"Hybrid TLB Coalescing: Improving TLB Translation Coverage under Diverse Fragmented Memory Allocations", Korea Software Congress, December 2017
"Apparatus and Method for Accelerating Critical Service in Virtualized System", KR 1021157380000, Granted: May 21st, 2020
"Method and System to Improve TLB Coverage by Using Chunks of Contiguous Memory", KR 1019426630000, Granted: Jan. 21st, 2019
Ethics Reviewer (NeurIPS 2026)
Program Committee (Light PC, MICRO 2026)
Program Committee (Light PC, HPCA 2024)
Artifact Evaluation Committee (MLSys 2022)
Dr. Sudhakar Yalamanchili Award, ModSim, Aug. 2023
Stars of Tomorrow (Award of Excellence), Microsoft Research Asia, Aug. 2018
Excellent Teaching Assistant Award, KAIST, Mar. 2018
KFAS Scholarship, Korea Foundation for Advanced Studies, 2017-2019
National Scholarship, KAIST, 2014 - 2021
Dean's List, College of Information & Communication Engineering, Apr. 2012, Oct. 2012, Apr. 2013, Oct. 2013
National Scholarship for Science and Engineering, Korea Student Aid Foundation (KOSAF), 2010-2013
Programming Languages: C, C++, Python, CUDA
System Software: Linux Kernel Development, Linux System Administration
Architecture Simulators: Structural Simulation Toolkit (SST), Gem5, NVMain, Pin, MARSSx86
FPGA: Vivado, Vitis HLS, Verilog, Tcl
Machine Learning Frameworks: PyTorch, TensorFlow
Student Representative, Department of Computer Science, KAIST, Feb 2016 - Dec 2016
Student, Korea Information Technology Research Institute, Jul. 2013 - Feb. 2014
President, Computer Security Research Club, Sungkuynkwan University, Jul 2011 - Feb 2012
Vice President, Computer Security Research Club, Sungkyunkwan University, Mar 2011 - Jun 2011
Teaching Assistant for Computer Organization, KAIST, Fall 2017
Teaching Assistant for System Programming, KAIST, Spring 2017
Teaching Assistant for Introduction to Computer Application, KAIST, Fall 2015
Teaching Assistant for Digital System and Lab, KAIST, Spring 2015
Teaching Assistant for System Programming, KAIST, Fall 2014
Teaching Assistant for Introduction to Programming (Python), KAIST, Spring 2014
CV updated on 2026-Aug-6th