LLMs4OL 2026: Large Language Models for Ontology Learning
The 3rd LLMs4OL Challenge @ ISWC 2026
ISWC 2026, Bari, Italy | 25-29 October
ISWC 2026, Bari, Italy | 25-29 October
Taxonomy Learning
Definition: Given ontologies from source domains, induce a hierarchical taxonomy for an unseen domain.
Motivation: Many ontology learning systems overfit to specific domains, where methods tuned for medicine or chemistry may fail in new domains. Moreover, taxonomy learning is often domain-specific. This task tests cross-domain robustness, which is critical for real-world OL systems. LLMs, with their general world knowledge, may offer better domain transfer compared to purely statistical or rule-based methods.
Participants are required to discover a taxonomy (class hierarchy) in a target domain after training or observing ontologies from other source domains. Unlike End-to-End OL or Ontology Extension tasks, this task focuses solely on hierarchical structure discovery and tests cross-domain generalization. The participant will do the training on ontologies from domains such as medicine, engineering, or chemistry. Evaluate on an unseen domain, e.g., material science. The goal is to correctly infer is-a / subclass relationships among types in the new domain. Participants can either develop their own taxonomy discovery algorithm or adapt existing taxonomy induction methods, including LLM-based or embedding-based approaches.
A system that, starting from a given unseen ontology's types (classes) and participants, should perform:
Taxonomic Discovery (is-a/subclass)
Considering that the model learned how to create a taxonomy. Given a list of types as follows:
device
sensor
system
application
environmental condition
measurement
person
We expect the following outputs:
(sensor, is-a, device)
(system, is-a, device)
(application, is-a, device)
More information on datasets (formatting) will be available soon! Stay tuned!
Standard Metrics: Precision, Recall, F1