System Submission

The test phase of the shared task will begin on March 11 with the release of the test data. Teams have until March 19, 23:59 EST (New York City time) to submit their system predictions. Submissions are sent as attachments over email to: nlisharedtask2013@gmail.com

Your submission to the NLI Shared Task must follow the format used in "example_submission.csv" (this is found in the development directory of the tarball sent out in February, and as an attachment on this page). It is a csv file where each line contains the file id and the system's prediction for the file, separated by a comma. The first column is the name of the file (remember to keep ".txt") and the second column is the language prediction (please make sure to use the same three character country code). Do not add a header to the csv file.

Note that there are three sub-tasks:

• Closed-Training: The first and main task will be the 11-way classification task using only the TOEFL11 for training.
• Open-Training-1: The second task will be to allow the use of any amount or type of training data, excluding the TOEFL11.
• Open-Training-2: The third task will be to allow the use of TOEFL11 combined with any other additional data.

You may compete in any number of the sub-tasks, and you can make up to 5 submissions per subtask. Please use the following naming conventions for your submission files:

• Closed-Training: <teamname>-closed-N.csv
• Open-Training-1: <teamname>-open1-N.csv
• Open-Training-2: <teamname>-open2-N.csv

where N is one of 1, 2, 3, 4 or 5.