LLMs4OL 2025: Large Language Models for Ontology Learning
The 2nd LLMs4OL Challenge @ ISWC 2025
ISWC 2025, Nara, Japan | 2-6 November
Embedded Files
How to Participate?
How to Participate?
You should first sign up at https://forms.gle/EUYrViwD4HHqum8k6 and register your team. For organizational purposes, we are required to collect the list of participants.
We are currently running the training phase of the 2nd LLMs4OL 2025 Challenge. Please download the provided training dataset and proceed with training your systems.
Join our Google group (https://groups.google.com/d/forum/llms4ol-challenge) and post your questions there. Refer to the timeline for when the training phase closes and the evaluation phase begins. All evaluations will be held on Codalab. For this, the codalab evaluation page will be provided closer to the date when the evaluation phase begins.
The seen-eval test sets are available at https://github.com/sciknoworg/LLMs4OL-Challenge/tree/main/2025. The blind-eval sets can be downloaded directly from the challenge CodaLab evaluation platform, in the "Participate" Tab and in the "Files" section.
📢📢 The CodaLab submission platform can be accessed via: https://codalab.lisn.upsaclay.fr/competitions/23065.
FAQ
FAQ
Q. If I am part of a team, can I make submissions to the task with my personal user account?
A. Yes and no. Yes, if, as an individual person, you are submitting your own system results that are different from the team system. No, if you are merely wishing to evaluate the team system with your individual account. We have a cap on the maximum allowed tries per system in each evaluation phase, and doing this will violate that term.
Q. How do I/we include more than one score on the leaderboard?
A. Codalab allows only one score on the leaderboard per user.
Q. Can I participate in only one subtask?
A. Participation in all four tasks in the LLMs4OL 2025 challenge is not mandatory. Thus, participants can choose to enroll only in Task A or B or C or D subtasks, or Task A and B subtasks, etc.
Q. Can I bring additional context from other sources?
A. Yes, additional context information from different sources, such as the World Wide Web, to enrich the training and test instances are welcome.
Contact
Contact
Feel free to ask any clarification questions on our challenge Google groups at https://groups.google.com/d/forum/llms4ol-challenge or contact us via llms4ol.challenge [at] gmail.com.
Page updated
Google Sites
Report abuse