Instructions for Shared Task Proposals
The task proposal should be a self-contained document of no longer than 3 pages (plus additional pages for references). Each proposal should contain the following:
Overview
Summary of the task
Why this task is needed and which communities would be interested in participating
Expected impact of the task
Data & Resources
How the training/testing data is produced. Please discuss whether existing corpora will be re-used.
Details of copyright, so that the data can be used by the research community both during the task and afterwards
How much data is produced
How data quality is ensured and evaluated
An example of what the data looks like
Assessment of any concerns for ethics, privacy, or security (e.g. personally identifiable information of private individuals; potential for systems to cause harm)
Evaluation
The evaluation methodology to be used, including clear evaluation criteria
Task organizers (max 1 page)
Names, affiliations, email addresses
(optional) brief description of relevant experience or expertise