Natural Language Processing
[2023.03.17] Sangam Lee (presentation link) Keyword: Text-to-Text framework, LLM , Google T5
• Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer. Journal of Machine Learning Research 21 (2020) (link)[2023.03.24] Taeyup Noh (presentation link) Keyword: Reinforcement learning with prompt, LLM , Open AI Instruct GPT
• Training language models to follow instructions with human feedback. Advances in Neural Information Processing Systems 35 pre-proceedings (2022) (link)[2023.03.31] Nayoung Kim (presentation link) Keyword: PLM, Memorization, Generalization
• Memorisation versus Generalisation in Pre-trained Language Models. In Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (2022) (link)[2023.05.12] Dareen Eom (presentation link) Keyword: Fourier Transforms, Efficient transformer, FNet
• FNet: Mixing Tokens with Fourier Transforms. Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pages 4296-4313 (2022) (link)[2023.05.19] Chaiho Shin (presentation link) Keyword: Text as visual recognition task, ViT-MAE, PIXEL
• Language Modelling with Pixels. Eleventh International Conference on Learning Representations (2023) (link)[2023.05.26] Yena Park (presentation link) Keyword: Prompt Tuning, Scaling
• The Power of Scale for Parmeter Efficient Prompt. Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, pages 3045–3059 (link)[2023.06.16] Sangam Lee (presentation link) Keyword: Retrieval augmented language model, Black-Box
• REPLUG: Retrieval-Augmented Black-Box Language Models. arXiv preprint (2023) (link)