Instruction for the Submission
Prediction submission instructions:
Please separate your submissions for each Task (if you are submitting for both tasks): e.g., TeamName_RunNo_TaskA.csv
TeamName_RunNo_TaskB.csv
e.g., CIC_Run3_TaskA.csv and CIC_Run3_TaskA.csv (your Run number for each task can be different)
And submit your submission in a zip file named as TeamName_RunNo.zip, e.g., CIC_Run3.zip.
Kindly, for both tasks, follow the same structures as their training set (same column names as in their training set in a CSV file separated by ",").
Link for submission of your predictions: Submit
---------------------------------
Papers should be submitted through the following link: Submit
Participants have to register at EasyChair. After registration, the following page should appear. Select "Make a new submission":
Guidelines for Authors
---------------------------------
Note: Even if you are not sure about your plans to submit the report, please, better register early. You can withdraw later.
In order to encourage the investigation of different kinds of features, a team can submit only 3 different runs as the team want. However, the best run results will be considered as the final run.
Technical reports MUST be accompanied by the system code.
Participants may join in teams of up to 7 people including all co-authors of the paper (if desired to submit a technical report)
Once the results are available, participants will be required to provide the experiments code of the final system, an abstract and a technical report including a brief description of their approach and experiments for the publication in the FIRE Proceedings. All the working notes will be published in CEUR Workshop Proceedings. Please submit the code of the final experiments, an abstract and a technical report in a zip file should be submitted at (To be updated soon).
Teams participating in more than one track can submit one or two corresponding technical reports depending on whether the systems for each sub-task are sufficiently different.
The technical report paper length should be up to 9 pages, but not shorter than 5 pages, and we encourage you to write longer papers (up to 9 pages) while the contents justifies the length. It is mandatory to add an "Error Analyses" section for your best model, to explain the deficiencies of the approach.
All technical report submissions should be in single column CEUR format. Authors should use one of the CEUR Templates below:
Word and Latex: http://ceur-ws.org/Vol-XXX/CEURART.zip
Copyright Agreement: Each group also has to submit a copyright agreement form. This year there are two different forms:
a. copyright-ntp This agreement is to be filled by teams who have not used any third-party data/resource for their working notes. This will be the case for most of the teams. For downloading copyright-ntp, please proceed to here.
b. copyright-tp In case a group has used some third party material, they have to submit this form, which states that they have obtained the necessary permissions for use of such material. For downloading copyright-tp, please proceed to here.
The Partially filled copyright agreements are attached to this email. CEUR mandated physical signing of the forms after taking a printout. In case some participants do not have access to a printer (e.g. institute is closed due to covid-19), an alternate approach is mentioned here. A partially/incorrectly filled or digitally signed copyright form is the most common error that authors usually make, and special attention should be paid to it. Kindly ensure Date, place or title are not missing from the copyright agreement forms. For more details please read: http://ceur-ws.org/HOWTOSUBMIT.html#AUTHORAGREEMENT
These will be published with CEUR as has been the trend for the last several years. We need the following from each team:
a) Working notes
b) Copyright agreement
Common Issues
Following are some common errors that the authors must try to avoid:
- Inclusion of names of teams and tracks in titles of working notes is highly discouraged.
For instance titles like "Avengers@AILA: Legal document retrieval" should rather be written as "Legal Document Retrieval"
- Author names should not have any prefixes like Dr., Prof., etc
- Copyright information within the footer of the first page should be "Forum for Information Retrieval Evaluation, December 16-20, 2022, India" and should not be changed to include track names or any other details/modifications.
A participant team may participate in the task with as many participants as the team wants.
A team can submit only 3 different runs as they want. However, the best run will be considered for final ranking.
Apart from sending their runs, each team is given also the possibility of submitting a detailed description of their algorithm(s). The format in which runs are to be submitted will be detailed later.
Participants are NOT allowed to use any internet searches during the execution of the algorithms.