Embedded Files
News
News
Released Qrels fro the Subtask A and the ground truth for the Subtask B (Feb 27, 2025)
Extended the submission deadline for the Subtask A to February 20. (Feb 4, 2025)
Extended both the submission deadline and the result return for the Subtask A in the schedule, and released json files for item-level and folder-level metadata. (Jan 22, 2025)
Updated the experiment control file for the formal-run of the Subtask A. (Jan 9, 2025)
News (Archived)
News (Archived)
Released three annotation sets for the subtask B. (Dec 31, 2024)
Released Formal-Run Topics (Experiment Control File) for the subtask A. (Dec 20, 2024)
Extended the submission deadline for the subtask B (Dec 20, 2024)
Released Formal-Run Test Collection for the subtask B. (Nov 21, 2024)
Updated the schedule of the SUSHI task. We extend the registration deadline to on Jan 15, 2025 and submission deadline of the Subtask A to on Jan 24, 2025. (Nov 12, 2024)
Updated the schedule of the SUSHI task. (Oct 14, 2024)
SUSHI Dry-Run Test Collections are now available on the Test Collection page. (Jun 1, 2024)
The draft guidelines for the SUSHI task is now available. (May 28, 2024)
NTCIR-18 SUSHI (Searching Unseen Sources for Historical Information) is a shared task for searching for archival materials and analyzing them. In this time as a pilot version of the task, we introduce two subtasks:
Subtask A) Container ranking
Subtask B) Detecting archival descriptions
The draft version of the guidelines are available:
Subtask A Guideline (ver. 1.11 updated on June 8, 2024 )
You can download test collections from SUSHI Test Collection page.
Registration
Registration
To participate SUSHI task, fill out the NTCIR-18 participation form at https://research.nii.ac.jp/ntcir/ntcir-18/howto.html (indicating that you will participate in SUSHI) and also send the SUSHI organizers a quick email letting us know you have signed up at ntcir-sushi@googlegroups.com so that we can add you to our mailing list. Please let us know about the following information in the mail.
Your name, affiliation and email address
Your participant team name
Subtasks that you will participate
Schedule
Schedule
SUSHI Guidelines Release May 28, 2024
Dry-run Test Collections Release & Dry Run Start July 1, 2024
Dry-run Due August 31, 2024
Formal-run Start : Subtask B November 15, 2024 (September 15, 2024)
Formal-run Start : Subtask A December 20, 2024 (December 15, 2024)
Formal-run Due : Subtask B January 5, 2025 (December 20, 2024)
--- Currently here ---
Formal-run Due : Subtask A February 20, 2025 (February 6, 2025)
Result Return of Formal-run: Subtask B January 31, 2025
Result Return of Formal-run: Subtask A February 25, 2025 (February 10, 2025)
Evaluation Results Return & Task Overview Release February 25, 2025 (February 10, 2025)
NTCIR-18 Conference June 10 - 13, 2025
The last update date: February 4, 2025
The last update date: February 4, 2025
Contact
Contact
Please feel free to contact us anything on the SUSHI task.
Organizers
Organizers
Tokinori Suzuki (Kyushu University)
Douglas W. Oard (University of Maryland)
Emi Ishita (Kyushu University)
Yoichi Tomiura (Kyushu University)
Page updated
Google Sites
Report abuse