Submission Format
Example Submission files
Sample submission files are available on GitHub.
Submission Instructions
The script takes one single prediction file as input, which MUST be a compressed .json file, named "results.json", structured as follows:
{
"UUID": {
"Prediction": "Predicted label"
}}
Note: The name of the zip file can be in any format, but the name of the actual 'json' file must be in the format above.
Example Task 1 submission
{
"5bc844fc-e852-4270-bfaf-36ea9eface3d": {
"Prediction": "Contradiction"
},
"86b7cb3d-6186-4a04-9aa6-b174ab764eed": {
"Prediction": "Contradiction"
},
"dbed5471-c2fc-45b5-b26f-430c9fa37a37": {
"Prediction": "Entailment"
},
"20c35c89-8d23-4be3-b603-ac0ee0f3b4de": {
"Prediction": "Contradiction"
},
"f17cb242-419d-4f5d-bfa4-41494ed5ac0e": {
"Prediction": "Contradiction"
}
}