LLMs4OL 2026: Large Language Models for Ontology Learning
The 3rd LLMs4OL Challenge @ ISWC 2026
ISWC 2026, Bari, Italy | 25-29 October
ISWC 2026, Bari, Italy | 25-29 October
You should first sign up at https://forms.gle/2ujAHqYoj8btaHqK6 and register your team. For organizational purposes, we are required to collect the list of participants.
We are currently running the training phase of the 3rd LLMs4OL 2026 Challenge. Please download the provided training at https://github.com/sciknoworg/LLMs4OL-Challenge and proceed with training your systems.
Join our Google group (https://groups.google.com/d/forum/llms4ol-challenge) and post your questions there. Refer to the timeline for when the training phase closes and the evaluation phase begins. All evaluations will be held on Codabench. For this, the codalab evaluation page will be provided closer to the date when the evaluation phase begins.
The submission platform can be accessed via [link will be available soon]
Q. If I am part of a team, can I make submissions to the task with my personal user account?
A. Yes and no. Yes, if, as an individual person, you are submitting your own system results that are different from the team system. No, if you are merely wishing to evaluate the team system with your individual account. We have a cap on the maximum allowed tries per system in each evaluation phase, and doing this will violate that term.
Q. How do I/we include more than one score on the leaderboard?
A. Codalab allows only one score on the leaderboard per user.
Q. Can I participate in only one subtask?
A. Participation in all 3 tasks in the LLMs4OL 2026 challenge is not mandatory. Thus, participants can choose to enroll only in Task A or B or C or Task A and B, etc.
Q. Can I bring additional context from other sources?
A. Yes, additional context information from different sources, such as the World Wide Web, to enrich the training and test instances is welcome. However, a clear statement should be made in the paper on how they enriched, and also make sure the enriched data is available in the final GitHub repository of yours and also linked to the paper.
Q. What is the challenge policy?
A. Please refer to the challenge overview page; you will find the challenge policy section.
Feel free to ask any clarification questions on our challenge Google groups at https://groups.google.com/d/forum/llms4ol-challenge or contact us via llms4ol.challenge [at] gmail.com.