Recent Preprints (Last 12 Months) 🗒️
(P: Preprint, *: Equal Contribution)
(P: Preprint, *: Equal Contribution)
[P1] AttSVD: Prompt-Adaptive Low-Rank KV Cache Compression via Attention-Guided SVD
Sara Abdali, Jongwoo Ko, Pashmina Cameron
Preprint. 2026. [paper]
(J: Journal, C: Conference, W: Workshop, *: Equal Contribution (1st Authors), ^: Equal Advising)
2026
[W9] Eliciting Weak-to-Strong Generalization with On-Policy Reverse Distillation
Youngrok Park*, Sangmin Bae*, Hojung Jung, Jongwoo Ko, Yunseon Choi, Young Jin Kim, Pashmina Cameron, Aaron Courville, Se-Young Yun
NeurIPS 2026 Workshop on Continual Learning in the Era of Foundation Models and Embodied Agents (CL4FMAgents). 2026. Sydney [paper]
[C18/W8] Scaling Reasoning Efficiently via Relaxed On-Policy Distillation
Jongwoo Ko, Sara Abdali, Young Jin Kim, Tianyi Chen, Pashmina Cameron
The Fortieth Annual Conference on Neural Information Processing Systems (NeurIPS). 2026. Sydney
ICML 2026 Workshop on Resource-Adaptive Foundation Model Inference (AdaptFM). 2026. Seoul [paper]
[W7] CUA-Skill: Develop Skills for Computer Using Agent
Tianyi Chen*, Yinheng Li*, Michael Solodko*, Sen Wang*, Nan Jiang, Junheng Hao, Tigyuan Cui, Jongwoo Ko, Sara Abdali, Suzhen Zheng, Pashmina Cameron, Justin Wagle, Kazuhito Koishida
ICML 2026 Workshop on Compositional Learning: Safety, Interpretability, and Agents (CompLearn). 2026. Seoul [paper]
[C17/W6] WINA: Weighted Informed Neuron Activation for Accelerating Large Language Model Inference
[J3/W5] From Belief Entrenchment to Robust Reasoning in LLM Agents
2025
[C16/W8] Flex-Judge: Text-Only Reasoning Unleashes Zero-Shot Multimodal Evaluators
[C15] DistiLLM-2: A Contrastive Approach Boosts the Distillation of LLMs
[C14] SeRA: Self-Reviewing and Alignment of LLMs using Implicit Reward Margins
Jongwoo Ko, Saket Dingliwal, Bhavana Ganesh, Sailik Sengupta, Sravan Bodapati, Aram Galstyan
The Thirteenth International Conference on Learning Representations (ICLR). 2025. Singapore [paper]
[C13] Beyond Correlation: The Impact of Human Uncertainty in Measuring the Effectiveness of Automatic Evaluation and LLM-as-a-Judge
Aparna Elangovan, Lei Xu, Jongwoo Ko, Mahsa Elyasi, Ling Liu, Sravan Bodapati, Dan Roth
The Thirteenth International Conference on Learning Representations (ICLR). 2025. Singapore [paper]
2024
[C10] DistiLLM: Towards Streamlined Distillation for Large Language Models
[C9] Fine-tuning Pre-trained Models for Robustness Under Noisy Labels
Sumyeong Ahn, Sihyeon Kim, Jongwoo Ko, Se-Young Yun.
International Joint Conference on Artificial Intelligence (IJCAI). 2024. Jeju [paper]
2023
[C8] NASH: A Simple Unified Framework of Structured Pruning for Accelerating Encoder-Decoder Language Models
[C7] Fast and Robust Early-Exiting Framework for Autoregressive Language Models with Synchronized Parallel Decoding
[C6] Revisiting Intermediate Layer Distillation for Compressing Language Models: An Overfitting Perspective
[C5/W2/W3] CUDA: Curriculum of Data Augmentation for Long-tailed Recognition
Sumyeong Ahn*, Jongwoo Ko*, Se-Young Yun
[C5] The Eleventh International Conference on Learning Representations (ICLR). 2023. Kigali. (Notable-Top-25%) [paper] [code]
[W2] NeurIPS 2022 Workshop on Distribution Shifts (DistShift). 2022. New Orleans [paper] [website]
[W3] NeurIPS 2022 ML Safety Workshop (MLSW). 2022. New Orleans [paper] [website]
[C3/W1] A Gift from Label Smoothing: Robust Training with Adaptive Label Smoothing via Auxiliary Classifier under Label Noise
2022
[J2] Deep Learning-Based Cataract Detection and Grading from Slit-Lamp and Retro-Illumination Photographs: Model Development and Validation Study
Ki Young Son*, Jongwoo Ko*, Eunseok Kim, Si Young Lee, Min-Ji Kim, Jisang Han, Eunhae Shin, Tae-Young Chung, Dong Hui Lim
Ophthalmology Science. 2(2). 100147 [paper]
2021
[C1] FINE Samples for Learning with Noisy Labels