(this section updated March 21, 2013)
1. Introduction
The paper is an opportunity to describe your submissions in detail and share your insights with the rest of the NLI community! A good shared task paper includes an introduction, a motivation of your approach, details on implementation, any internal evaluations you used, any issues you dealt with when creating the system, etc. We encourage papers to include details such as parameter settings, specifics on data usage, etc. so that others may be able to replicate your work in the future. So when writing your paper, think about how you can be as helpful as possible to the rest of the NLI community. This includes descriptions of features or methodologies that proved powerful, but also equally important is information on what didn't work.
We will be writing a summary paper describing the shared task and the results at a high level. An example of such a report is Robert Dale et al.'s HOO 2012 Shared Task paper: http://aclweb.org/anthology-new/W/W12/W12-2006.pdf
As part of the NLI Summary paper, we will include a table which summarizes the approaches and features that the teams used. So the more information you provide, the easier it will be to create the table.
You can find examples of shared task papers from last year's BEA7 workshop which hosted the HOO 2012 Shared Task on Grammatical Error Correction:
http://www.cs.rochester.edu/~tetreaul/naacl-bea7.html#hoo2012posters
Because this is a shared task submission without peer review, please do not anonymize your paper. Write it as a final submission.
2. Formatting and Style Guidelines
We will be using the NAACL HLT-2013 Submissions Guidelines for the NLI Shared Task. Authors can submit a full paper describing their system with a length up to 8 pages in electronic PDF format and up to 2 additional pages for references. The papers will be reviewed by the Organizing Committee and comments may be sent back to authors with respect to format, typos and accuracy. Papers should not be anonymized.
3. Submission Information
When you are finished with your paper, please submit it through the START page used by the BEA8 workshop by April 08.
https://www.softconf.com/naacl2013/BEA8/
Click on "Make a New Submission" and then follow the directions on the subsequent pages. The Submission Page has a "Submission Categories" section, please select "NLI 2013 Shared Task".
The papers will be presented at the BEA8 workshop during the poster session. A summary paper will be created by the Organizing Committee which will review the shared task. This summary paper will also be presented at the workshop.
4. Useful Reference Links
* An additional goal of organizing the NLI Shared Task was to create a shared bibliography of related work to make it easier for people outside the field to enter. We've provided a bibliography which may be useful when writing your paper:
http://www.nlisharedtask2013.org/bibliography-of-related-work-in-nli
If you are using latex, please scroll to the bottom of the website and download "nli-relatedwork.bib".
* When discussing the TOEFL11 corpus in your paper, please reference the draft Research Report attached to this email entitled "TOEFL11" A Corpus of Non-Native English". As the version we are attaching is a draft (though fairly final), please do not distribute. We are hoping the paper will be published in the next month or so through ETS. In the interim, please use the following bib entry:
@TechReport{blanchard-tetreault-higgins-cahill-chodorow:2013:TOEFL11-RR,
author = {Blanchard, Daniel and Tetreault, Joel and Higgins, Derrick and Cahill, Aoife and Chodorow, Martin},
title = {TOEFL11: A Corpus of Non-Native English},
institution = {Educational Testing Service},
year = {2013},
}
* You will probably want to refer to the NLI Shared Task when writing your paper. Please use the following bib entry when referring to the NLI paper:
@InProceedings{tetreault-blanchard-cahill:2013:BEA, author = {Tetreault, Joel and Blanchard, Daniel and Cahill, Aoife}, title = {A Report on the First Native Language Identification Shared Task}, booktitle = {Proceedings of the Eighth Workshop on Building Educational Applications Using NLP}, month = {June}, year = {2013}, address = {Atlanta, GA, USA}, publisher = {Association for Computational Linguistics}, pages = {}, url = {} }
5. Presentation Format
All papers will be presented as posters during the poster session of the BEA8 workshop (co-located with NAACL-HLT) in Atlanta, Georgia, USA on June 13. The posterboards will be 3 ft high and 4 ft wide, slightly bending about 10 inches in at both left and right ends. They will be set on top of 4-5 foot long, 18 inch deep tables so there will be room to also hold handouts, business cards, a computer, etc. And there will be one chair at each table, as well as double-sided tape, pushpins, etc. for affixing the posters to the boards.
6. Conference Registration
Following ACL / NAACL conventions, to have your system paper published in the proceedings, an author must be registered for the BEA8 workshop and the paper must be presented at the workshop. As part of registering for the BEA workshop, you will receive a free BEA t-shirt, made possible by the BEA8 sponsors. Registration information can be found here: