AcCompl-it

Overview

AcCompl-It is a task aimed at developing and evaluating methods to classify Italian sentences according to Acceptability and Complexity, which can be viewed as two “simple” numeric measures associated with linguistic productions. This is a task which is expected to attract the interest of different communities focusing on the study of language from different perspectives, whose outcome is expected to have an impact on NLP, psycholinguistics and theoretical linguistics investigations and applications.

From the NLP perspective, the renewed interest for automatic generation tasks (e.g. Machine Translation, Text Simplification, Summarization) has been recently prompted by more and more accurate systems mostly based on Deep Neural Networks algorithms (Gatt and Krahmer, 2018). In this scenario, the availability of annotated resources and systems aimed at predicting the level of grammatical acceptability or linguistic complexity of a sentence (see, among others, Warstadt et al., 2019 and Brunato et al., 2018) is becoming increasingly relevant either to evaluate automatically generated sentences or to investigate the ability of artificial neural networks to encode linguistic phenomena related to both notions in their representations.

From the theoretical linguistics perspectives, controlled datasets containing acceptability judgments and analyzed with machine learning techniques can be useful to test the extent to which syntactic and semantic deviance can be induced from corpus data alone, especially for low frequency phenomena (Chowdhury Zamparelli 2018, Gulordava et al. 2018, Wilcox et al. 2018), while the same data, seen from a psycholinguistic angle, can shed light on the relation between complexity and acceptability (Chesi & Canal 2019), and on the extent to which measures of on-line perplexity in artificial language models can track human parsing preferences (Demberg and Keller, 2008; Hale, 2001).