Deadline for submission: September 16th 2018
Participants can submit up to ten different models:
For each model, each team can submit a maximum of three different versions (runs).
Format: each run will be an output file, and the format for each output file will have to be as follows:
<id> is the instance id as provided in the test files
<prediction> is one of "F" or "M"
For example, for the following instances in a Twitter test file:
<doc id="778" genre="twitter" gender="?">@edmond644 @ilsussidiario Sarebbe vero se li avessimo eletti ma, non avendolo fatto, "altri" se li meritano.</doc><doc id="2704" genre="twitter" gender="?">@GuidoCrosetto e quando ha detto"e noi? Non abbiamo rovinato l',italia mica siamo come B!!! Meno male che è fuori fa sembrare renzi-odioso</doc><doc id="1034" genre="twitter" gender="?">Mi è piaciuto un video di @YouTube da @carodexter : http:// youtu.be/Lf83YO_la5g?a GTA 5 Online - CUFFIE ROTTE DALLA RABBIA!! Wallride In</doc>you will have to produce lines as such, assuming your system has predicted male, female, male, respectively:
Optimally, you will preserve the order as provided in the test files.
File names: each team has to make sure the submitted files obey the following standardised format:
<team-name> is your team name, for instance "UniABC"
<setting> is one of either "IN" (for in-genre) or "OUT" (for cross-genre)
<target-genre> is one of "TW" (Twitter), "YT" (YouTube), "DI" (Diary), "JO" (Journalism), and "CH" (Children)
<run-number> is one of 1,2,3
For example, team "UniABC" can submit three runs for in-genre gender detection in Diaries and name the files:
For cross-genre, teams should specify the genre they are testing on, thus:
You can send your zipped runs as <team-name>.zip to gxg.evalita2018@gmail.com, by September 16th 2018