Entrance Exam Subtask (Japanese): While the setting of this subtask in the NTCIR-9 RITE was similar to the Binary Class (BC) task, in the NTCIR-10 RITE-2, t1 is not explicitly given. If sentences that entail given t2 are found in large-scale texts (Wikipedia or textbooks), then t2 is considered as true. The percentage of correct answers for multiple-choice questions will be used as the evaluation measure as well as the accuracy of entailment relation recognition. The process of answering will become more human-like as compared to RITE-1. We also provide the BC-like data additionally (i.e. t1 is given explicitly in the same way as RITE1), so that teams who are not interested in the search problem can also participate in this subtask.
Addition of unit-tests (Japanese): Research focusing on single linguistic phenomena in recognizing textual entailment has been considered difficult because the task usually requires various types of linguistic and semantic analyses. In order to support such research, we provide a dataset obtained from a subset of the BC data in which semantic relations are broken down into a set of single linguistic phenomena.
Providing results of basic linguistic analyses such as dependency parsing and predicate-argument structure analysis, and a generic entailment recognition tool which can be modified easily.