Hi! I am Jiazhan (Jamie) Feng, a Ph.D. student at the School of Intelligence Science and Technology, Peking University, advised by Prof. Dongyan Zhao and Prof. Rui Yan. I am also a Visiting (Recognised) Student at the University of Oxford, advised by Prof. Yee Whye Teh. Before that, I was a research intern at Microsoft Research Asia (MSRA), and a research intern at Microsoft Azure AI, Redmond, advised by Dr. Ruochen Xu, Dr. Yelong Shen and Dr. Weizhu Chen.
Feel free to email me for any form of academic cooperation. Cheers! ^_^
Research Interest
I am fascinated by real-world problems related to natural language processing, especially how to usher conversational AI models into the world of human knowledge. Now I am conducting research on the following problems:
Large Language Models (LLMs): empowering LLMs to follow complex instructions (ICLR '24), LLMs with IR (Arxiv '23), logical reasoning with LLMs (NAACL '24)
Knowledge-Grounded Dialogues: zero-resource response selection (ACL '21), knowledge selection in KGC (COLING '22, NLPCC '22), content distillation (TOIS '23)
Multi-Modal Dialogues: multi-modal dialogue dataset (ACL '23), dialog-to-image generation (Arxiv '23)
Retrieval-based Dialogue Systems: learning a robust matching model from noisy training data (ACL '19), dialogue representation (TOIS '21, EMNLP '22), detailed survey (IJCAI '21), cooperative training of retriever-reranker (ACL '23), accelerating multi-turn response selection (ACL '23)
Document Ranking: fine-grained attention (ACL '23)
Better Use of Commonsense Knowledge: commonsense consolidation with dimension-prompts (SIGIR '23)
Preprints
A Step Closer to Comprehensive Answers: Constrained Multi-Stage Question Decomposition with Large Language Models.
Hejing Cao, Zhenwei An, Jiazhan Feng, Kun Xu, Liwei Chen and Dongyan Zhao.
[manuscript] [new]
Teaching Text-to-Image Models to Communicate.
Xiaowen Sun^*, Jiazhan Feng^, Yuxuan Wang, Yuxuan Lai, Xingyu Shen and Dongyan Zhao.
[manuscript] [new]
Synergistic Interplay between Search and Large Language Models for Information Retrieval.
Jiazhan Feng, Chongyang Tao, Xiubo Geng, Tao Shen, Can Xu, Guodong Long, Dongyan Zhao and Daxin Jiang.
[manuscript] [code] [new]
2024
Language Models can be Logical Solvers.
Jiazhan Feng, Ruochen Xu, Junheng Hao, Hiteshi Sharma, Yelong Shen, Dongyan Zhao and Weizhu Chen.
In Findings of the Association for Computational Linguistics: NAACL 2024 (NAACL 2024 Findings). [Arxiv version] [The code will be open-source soon] [new]
WizardLM: Empowering Large Pre-Trained Language Models to Follow Complex Instructions.
Can Xu, Qingfeng Sun, Kai Zheng, Xiubo Geng, Pu Zhao, Jiazhan Feng, Chongyang Tao, Qingwei Lin and Daxin Jiang.
In Twelfth International Conference on Learning Representations (ICLR 2024). [paper] [code and demo] [new]
2023
Length-Adaptive Distillation: Customizing Small Language Model for Dynamic Token Pruning.
Chang Liu, Chongyang Tao, Jianxin Liang, Jiazhan Feng, Tao Shen, Quzhe Huang and Dongyan Zhao.
In Findings of the Association for Computational Linguistics: EMNLP 2023 (EMNLP 2023 Findings). [paper]
MMDialog: A Large-scale Multi-turn Dialogue Dataset Towards Multi-modal Open-domain Conversation.
Jiazhan Feng, Qingfeng Sun, Can Xu, Pu Zhao, Yaming Yang, Chongyang Tao, Dongyan Zhao and Qingwei Lin.
In Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (ACL 2023). [paper] [project page]
CORE: Cooperative Training of Retriever-Reranker for Effective Dialogue Response Selection.
Chongyang Tao, Jiazhan Feng, Tao Shen, Chang Liu, Juntao Li, Xiubo Geng and Daxin Jiang.
In Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (ACL 2023). [paper]
FAA: Fine-grained Attention Alignment for Cascade Document Ranking.
Zhen Li*, Chongyang Tao, Jiazhan Feng, Tao Shen, Dongyan Zhao, Xiubo Geng and Daxin Jiang.
In Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (ACL 2023). [paper]
Attend, Select and Eliminate: Accelerating Multi-turn Response Selection with Dual-attention-based Content Elimination.
Jianxin Liang, Chang Liu, Chongyang Tao, Jiazhan Feng and Dongyan Zhao.
In Findings of the Association for Computational Linguistics: ACL 2023 (ACL 2023 Findings). [paper]
Dimension-Prompts Boost Commonsense Consolidation.
Jiazhan Feng, Chongyang Tao, Tao Shen, Chang Liu and Dongyan Zhao.
In 46th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR 2023). [paper]
Learning Multi-turn Response Selection in Grounded Dialogues with Reinforced Knowledge and Context Distillation.
Jiazhan Feng, Chongyang Tao, Xueliang Zhao and Dongyan Zhao.
In ACM Transactions on Information Systems, Volume 41, Issue 4 (TOIS, CCF Rank A). [paper]
2022
How to Represent Context Better? An Empirical Study on Context Modeling for Multi-turn Response Selection.
Jiazhan Feng, Chongyang Tao, Chang Liu, Rui Yan and Dongyan Zhao.
In Findings of the Association for Computational Linguistics: EMNLP 2022 (EMNLP 2022 Findings). [paper]
Rethinking Task-Specific Knowledge Distillation: Contextualized Corpus as Better Textbook.
Chang Liu, Chongyang Tao, Jianxin Liang, Tao Shen, Jiazhan Feng, Quzhe Huang and Dongyan Zhao.
In Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing (EMNLP 2022). [paper]
Reciprocal Learning of Knowledge Retriever and Response Ranker for Knowledge-Grounded Conversations.
Jiazhan Feng, Chongyang Tao, Zhen Li*, Chang Liu, Tao Shen and Dongyan Zhao.
In Proceedings of the 29th International Conference on Computational Linguistics (COLING 2022). [paper]
Training Two-Stage Knowledge-grounded Dialogues with Attention Feedback.
Zhen Li*, Jiazhan Feng, Chongyang Tao and Dongyan Zhao.
In 11th CCF International Conference on Natural Language Processing and Chinese Computing (NLPCC 2022). [paper]
Multi-Granularity Structural Knowledge Distillation for Language Model Compression.
Chang Liu, Chongyang Tao, Jiazhan Feng and Dongyan Zhao.
In Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (ACL 2022). [paper]
2021
A Pre-training Strategy for Zero-Resource Response Selection in Knowledge-Grounded Conversations.
Chongyang Tao, Changyu Chen, Jiazhan Feng, Ji-Rong Wen and Rui Yan.
In Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics (ACL 2021). [paper]
Response Ranking with Multi-Types of Deep Interactive Representations in Retrieval-based Dialogues.
Ruijian Xu, Chongyang Tao, Jiazhan Feng, Wei Wu, Rui Yan and Dongyan Zhao.
In ACM Transactions on Information Systems, Volume 39, Issue 4 (TOIS, CCF Rank A). [paper]
A Survey on Response Selection for Retrieval-based Dialogues.
Chongyang Tao, Jiazhan Feng, Rui Yan, Wei Wu and Daxin Jiang.
In Proceedings of the Thirtieth International Joint Conference on Artificial Intelligence (IJCAI 2021). [paper]
2019
Learning a Matching Model with Co-teaching for Multi-turn Response Selection in Retrieval-based Dialogue Systems.
Jiazhan Feng, Chongyang Tao, Wei Wu, Yansong Feng, Dongyan Zhao and Rui Yan.
In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics (ACL 2019). [paper]
Professional Services
Program Committee (Reviewer): ACL 2021-24, EMNLP 2022-23, NAACL 2022, COLING 2024, IJCAI 2021, ACL Rolling Review.