The first workshop on advances, resources, tools and challenges of large-scale pre-trained language models

About the Workshop

In recent years, pre-trained language models (PLM) such as BERT, GPT-2, or T5 have shown significant improvement in various NLP tasks. Trained on massive raw text available on the internet, PLMs can effectively represent human knowledge encoded in textual format. However, these models come with some challenges and concerns too. These concerns and challenges range from technical issues due to the ever-increasing size of PLMs and reformulating traditional NLP tasks to be solved by generative language models to ethical concerns due to the reflected human biases in pre-trained language models on text written by humans. This workshop provides a venue to discuss the advancements and address the remaining challenges of PLMs.

Please refer to our CFP pages for more information about the submissions.

Workshop Venue

LPLM will be hosted by the 2022 Annual Conference of the North American Chapter of the Association for Computational Linguistics to be held in Seattle, Washington, USA.

Important Dates

• Paper submission deadline: May 27, 2022

• Notification date: June 15, 2022

• Camera-ready submissions due: June 20, 2022

• LPLM workshop at NAACL 2022: July 15, 2022

All deadlines are “anywhere on earth” (UTC-12)