Shared Task of Entity Summarization @ EYRE '20

As part of the EYRE '20 workshop co-located with CIKM 2020, a shared task of entity summarization is organized, in order to assess strengths and weaknesses of existing systems, compare performance of techniques, and enhance communication among researchers and developers.

Task: Entity Summarization

An entity in a knowledge graph is involved in a set of triple-structured facts that describe the entity. When there are many facts, entity summarization is the task of selecting a size-constrained subset of triples that best represent the entity.

For this shared task, we use the Entity Summarization BenchMark (ESBM) v1.2. The benchmark has provided a Java tool for evaluating computed entity summaries based on crowdsourced ground-truth summaries. Please follow the specified train-valid-test splits and report F-measure under k=5 and k=10.

Submission Guidelines

Each participating system should submit a short paper (2-4 pages) describing the system and reporting the results. Participants should publish the outputs and source codes of their systems, and include a link to those resources in the submitted papers.

Manuscripts should be submitted electronically, as PDF formatted using the ACM camera-ready templates; please use sample-sigconf.tex as the template. Papers should be submitted through the EYRE '20 online submission system.

Papers will be reviewed by the organizers. Selected papers will be included in the workshop proceedings. At least one author of each selected paper is expected to attend the workshop and present.

Important Dates

  • Submission: July 24th, 2020 (Anywhere on Earth)

  • Notification: August 15th, 2020

  • Camera-ready: September 10th, 2020

Organizers