Submission

Run Result

Results from one system comprise a run. Name a run file in the following format:

RITEVAL-(Team Name)-(Lang)-(Subtask Name)-(Run Number).txt

Team Name = use the same short ID used in NTCIR registration (Group ID).

Lang = CS, CT, EN, JA

Subtask Name = FV, SVBC, SVMC (for CS/CT); FV, FVsearch (for EN); FV, FVsearch, SV (for JA)

Run Number = 01, 02, …, 05

Example:

RITEVAL-NTOUA-CT-SVBC-01.txt

A run file must obey the file format described in the following each page:

• CS/CT subtasks
• EN-FV and JA-FV
• JA-SV

System Description

Complete a form for brief description of your system. Name a completed form in the following format for each run:

(Run file name)-sysdesc.txt

Example:

RITEVAL-NTOUA-CT-SVBC-01-sysdesc.txt

Example of a system description file:

1. Approach

   [ ]rule: 

   [x]statistics: SVM

   [ ]hybrid

2. Feature/Information

   [ ]Overlapping

   [x]Alignment

   [ ]Transformation

   [x]Char/Word Overlapping

   [x]Syntactic Information

   [ ]Predicate-Argument Relationship

   [x]Named Entity

   [ ]Entity/Event

   [x]Temporal/Numeric Information

   [ ]Entailment

   [ ]Modality

   [ ]Polarity

   [x]Synonym/Antonym

   [x]Hypernym/Hyponym

   [ ]Meronym/Holonym

   [ ]Entity/Event Relationship

   [ ]Entailment Rule

3. Resources: WordNet, Wikipedia

4. Tools: word segmentation, syntactic parser

Run Submission

Archive all files in zip, and send the result to rite-val-organizers -- at -- nii.ac.jp via email attachment by the end of the formal run period (Aug 7, 2014 JST23:59 for CS/CT and JA; Aug 10, 2014 JST23:59 for EN).

Specify which subtasks and languages you are participating in the mail title.

We'll email you a notification of acceptance as a reply within 24 hours of submission. Contact us if you did not receive the notification.