Shared Task of Entity Summarization @ EYRE '20
As part of the EYRE '20 workshop co-located with CIKM 2020, a shared task of entity summarization is organized, in order to assess strengths and weaknesses of existing systems, compare performance of techniques, and enhance communication among researchers and developers.
Task: Entity Summarization
An entity in a knowledge graph is involved in a set of triple-structured facts that describe the entity. When there are many facts, entity summarization is the task of selecting a size-constrained subset of triples that best represent the entity.
For this shared task, we use the Entity Summarization BenchMark (ESBM) v1.2. The benchmark has provided a Java tool for evaluating computed entity summaries based on crowdsourced ground-truth summaries. Please follow the specified train-valid-test splits and report F-measure under k=5 and k=10.
Submission Guidelines
Each participating system should submit a short paper (2-4 pages) describing the system and reporting the results. Participants should publish the outputs and source codes of their systems, and include a link to those resources in the submitted papers.
Manuscripts should be submitted electronically, as PDF formatted using the ACM camera-ready templates; please use sample-sigconf.tex as the template. Papers should be submitted through the EYRE '20 online submission system.
Papers will be reviewed by the organizers. Selected papers will be included in the workshop proceedings. At least one author of each selected paper is expected to attend the workshop and present.
Important Dates
Submission: July 24th, 2020 (Anywhere on Earth)
Notification: August 15th, 2020
Camera-ready: September 10th, 2020
Organizers
Gong Cheng, Nanjing University, China
Kalpa Gunaratna, Samsung Research America, USA
Jun Wang, University College London, UK