This shared task is collocated with INLG 2022 as part of the Generation Challenge.
In this shared task, we seek the participating teams to investigate the factors influencing the quality of the code-mixed text generation systems. We synthetically generate code-mixed Hinglish sentences using two distinct approaches and employ human annotators to rate the generation quality. We propose two subtasks, quality rating prediction and annotators’ disagreement prediction of the synthetic Hinglish dataset. The proposed subtasks will put forward the reasoning and explanation of the factors influencing the quality and human perception of the code-mixed text.
For more details contact us at: hinglisheval-inlg-2022@googlegroups.com
To participate in the competition, register your team here: https://forms.gle/qhALRqkmpYrDbJPS6
Link to the competition: https://codalab.lisn.upsaclay.fr/competitions/1688
Jan 30, 2022: Competition is live now!
Sep 22, 2021: Shared task proposal paper is available now: https://aclanthology.org/2021.inlg-1.34.pdf
Aug 8, 2021: The registration form is open. See the Instructions page for more details.
Jul 26, 2021: Shared task accepted at Generation Challenge 2021!