Activities / Publications

Conference Proceedings

"HetPipe: Enabling Large DNN Training on (Whimpy) Heterogeneous GPU Clusters through Integration of Pipelined Model Parallelism and Data Parallelism",
    - USENIX ATC 2020 (acceptance rate: 18.6%) [TOP-TIER] (paper, slide, arXiv version)
    - Jay H. Park, Gyeongchan Yun, Chang M. Yi, Nguyen T. Nguyen, Seungmin Lee, Jaesik Choi, Sam H. Noh, Young-ri Choi

"µSnap: Embracing Traditional Programming Models for Persistent Memory through OS Support",
    - IEEE NVMSA 2018 [Best Paper Award] (paper)
    - J. Hyun Kim, Young Je Moon, Hyunsub Song, Jay H. Park, Sam H. Noh

Preprints

"Accelerated Training for CNN Distributed Deep Learning through Automatic Resource-Aware Layer Placement",
    - arXiv 2019 https://arxiv.org/abs/1901.05803 (paper)
    - Jay H. Park, Sunghwan Kim, Jinwon Lee, Myeongjae Jeon, Sam H. Noh

Projects

"대규모 DNN 모델의 분산 학습을 위한 GPU 메모리 관리 연구",
    - 한국연구재단 - 학문후속세대지원사업, 2021.09 ~ 2022.02,
    - Amount of Funding: KRW 120,000,000
    - Role: Principal Investigator

Poster Presentations

"Alleviating the Network Bottleneck for CNN Distributed Training through Automatic Resource-Aware Layer Placement",
    - USENIX NSDI 2019 Poster (abstract, poster)
    - Jay H. Park, Sunghwan Kim, Jinwon Lee, Myeongjae Jeon, Sam H. Noh

"Improving Performance of Distributed TensorFlow using CNN Characteristics Exploiting Model Parallelism",
    - ACM EuroSys 2018 Poster (abstract, poster)
    - Jay H. Park, Jinwon Lee, Sam H. Noh

Journals

"On Providing OS Support to Allow Transparent Use of Traditional Programming Models for Persistent Memory",
    - ACM Journal on Emerging Technologies in Computing Systems (JETC) 16 (3), 1-24, 2020 (paper)
    - J. Hyun Kim, Youngje  Moon, Hyunsub  Song, Jay H. Park, Sam H. Noh

Conference Proceedings (Korean)

"Analysis of Auxiliary Resource Aware Allocation of Deep Learning Jobs",
   - KCC 2022 (paper)
   - Jaewoo Maeng, Jayeon Yi,  Jay H. Park, Byung-Gon Chun

"Fine-Grained Process Checkpointing through P-process in New Memory based Systems",
    - KCC 2016 [Best Paper] (paper)
    - Jay H. Park, Young Je Moon, Sam H. Noh

"Hiding Device Driver Faults through Virtual Device Drivers",
    - Korean Conference on Semiconductors 2016
    - Jay H. Park, Young Je Moon, Sam H. Noh

"Hiding Device Driver Faults through Soft Devices",
    - KCC 2015 (paper)
    - Jae Hyeong Park, Young Je Moon, Sam H. Noh

"A Survey of Fault-tolerance Techniques for Device Drivers",
    - KCC 2014 (paper)
    - Jae Hyeong Park, Young Je Moon, Hyeon Ho Song, Sam H. Noh

"High speed booting system in hybrid memory architecture using New Memory",
    - KCC 2014 [Best Paper] (paper)
    - Hyeon Ho Song, Young Je Moon, Jae Hyeong Park, Sam H. Noh

"Experimental Evaluation of a New Memory/SSD Hybrid Cache",
    - Institute of Embedded Engineering of Korea Fall Conference 2013
    - Hyunsub Song, Jae Hyeong Park, Young Je Moon, Taejin Kim, Sam H. Noh

Journals (Korean) 

"Efficient Process Checkpointing through Fine-Grained COW Management in New Memory based Systems",
    - Journal of KIISE, Vol. 44, No. 2, pp. 132-138, 2017.2 (paper)
    - Jay H. Park, Young Je Moon, Sam H. Noh

"A Study of a Fast Booting Technique for a New memory+DRAM Hybrid Memory System",
    - Journal of KIISE, Vol. 42, No. 4, pp. 434-441, 2015.4 [Best Paper] (paper)
    - Hyeon Ho Song, Young Je Moon, Jae Hyeong Park, Sam H. Noh

Thesis

"Efficient Distributed DNN Training through Resource-Aware Hybrid Parallelism",
    - UNIST,  Ph.D. degree, Aug. 2021. (thesis)
    - Jay H. Park

"Improving process resiliency through fine-grained COW management in new memory based systems",
    - Hongik University, MS degree, 2016. (thesis)
    - Jay H. Park

Patents 

<European Patent Filed>
"Electronic Device and Method of Controlling The Same" [Application Number: 17189290.4] Filed: 4 September 2017
<United States Patent Filed>
"Electronic Device and Method of Controlling The Same" [Application Number: 15/693,961] Filed: 1 September 2017
<China Patent Filed>
"Electronic Device and Method of Controlling The Same" [Application Number: 107797885A] Filed: 4 September 2017
<Korean Patents>
전자 장치 및 제어 방법 [출원번호: 10-2017-0048313 (10-2016-0114917호의 국내우선권주장 출원)] (출원일: 2017.04.14)
시스템 내구성을 위한 컴퓨팅 시스템 및 방법 [출원번호: 10-2016-0114917] (출원일: 2016.09.07)
고속부팅 방법 및 이를 위한 컴퓨팅 장치 [등록번호: 10-1566612] (등록일: 2015.10.02.)
메모리 읽기 전용화 방법 및 이를 위한 컴퓨팅 장치 [등록번호: 10-1553157] (등록일: 2015.09.08.)
업데이트 데이터 처리 방법 및 이를 위한 컴퓨팅 장치 [등록번호: 10-1542323] (등록일: 2015.07.30.)

Open Source Contributions

Facebook Research – DLRM (Deep Learning Recommendation Model)
    - Parallelizing the pre-processing of the dataset (+166 -73)
Google TensorFlow – TensorFlow 프레임워크, 벤치마크
    - Edit typo (+2 -2)

Academic Activities

External Reviewer, IEEE Transactions on Parallel and Distributed Systems (Verified peer reviews)

Awards

2020 NAVER Ph.D. Fellowship Award  (Scholarship  Amount: KRW 5,000,000)
2018 IEEE NVMSA'18 Conference Best Paper Award
2016 국가슈퍼컴퓨팅 프로그래밍 경진대회 공헌상 수상
2016 한국컴퓨터종합학술대회 컴퓨터시스템 부분 우수논문 선정
2016 정보과학회논문지 시스템 및 이론 부분의 2016년도 우수논문 선정
2014 한국컴퓨터종합학술대회 컴퓨터시스템 부분 우수논문 선정
USENIX Student Grants, File and Storage Technologies (FAST) 2015, 2016, 2020
USENIX Student Grants, Operating Systems Design and Implementation (OSDI) 2014

Posters