Task Definition

Task Design

Given a sentence and the target numeral, we formulate the problem as a binary classification task to tell if the given numeral is an in-claim numeral or not. Additionally, the target numeral's category is also included in the dataset, and participants can decide whether to use this information to design joint learning models. If they use category information in the model, they will be asked to report the performance of category classification.

For both claim detection and numeral category classification task, the micro-F1 and macro-F1 scores are adopted for evaluating the experimental results.

Evaluation: https://scikit-learn.org/stable/modules/generated/sklearn.metrics.f1_score.html