Frequently Asked Questions (FAQs)

• Q: Hello, where is the data?

  • A: https://github.com/kj2013/claff-diplomacy

• Q: Hello, how can I register?

  • A: Post a tentative abstract to our EasyChair portal. See "Upcoming Deadlines" section below.

• Q: But I haven't decided my approach yet?

  • A: Submit an abstract anyway. We're trying to figure out how many participants to expect. You can always update your abstract and system paper (when you upload it).

• Q: Oh but what are your metrics going to be?

  • A: The standard stuff in binary classification tasks -- Precision, Recall, F1-Score.

• Q: Do you really mean that everyone gets to present at AAAI 2021?

  • A: Well yes! AAAI 2021 and the workshop will both be virtual. If you submit your system runs and a system paper then you can present your paper in the poster session and have your paper in our open access proceedings. There will still be peer feedback in which you can improve your camera ready paper. You do need to be registered for the workshop.

• Q: Is there a kind of leader board to check the performance of leading models? Or could you please inform me a standard performance (e.g., baseline model’s performance a or human performance as a golden standard)?

  • A: Unfortunately, we're not releasing a leader board before the workshop itself, so no one knows what the baseline performance is. But we're encouraging maximum participation and reminding you again that if you do write up a paper and submit your system results, you can present your poster at our AAAI workshop; if you're one of the best systems, you get a slot in the main session to present your approach. We'll also let you submit more than one run and up to ten runs if you want to experiment with different parameters and submit.

• Q: Do you expect 2 separate papers for the two shared tasks?

  • A: No, just one paper.

• Q: I'm pretty sure I won't be able to attend your workshop. Can I still participate in the Shared Task?

  • A: We could play your pre-recorded video!

Upcoming deadlines

• DONE: October 14, 2020 - Unlabeled dataset, updated instructions and label descriptions released

• SOON: October 20, 2020 - Training set released

• November 4, 2020 - Abstract submission with a short system description to https://easychair.org/my/conference?conf=affconaaai21#

• November 20, 2020 - Test set released. Only released to registered participants

• December 20, 2020 - System runs due & System reports (full papers) due and peer review process begins

• January 10, 2021- Camera-ready versions due after peer feedback

• February 8/9, 2021: All participants present at the Workshop at AAAI-21

Questions?

Contact Kokil Jaidka (jaidka at nus.edu.sg) or Niyati Chhaya (nchhaya at adobe.com) and we promise to help.