Understanding the gap in evaluation frameworks and metrics for RAG-based question-answering system
Nakul Mehta, Adegboyega Ojo and Edward Curry
T2S-Metrics: Unified Library for Evaluating SPARQL Queries Generated From Natural Language
Yousouf Taghzouti, Tao Jiang, Camille Juigné, Benjamin Navet, Fabien Gandon, Franck Michel and Louis Felix Nothias
A Benchmark and Field Study on the Use of LLMs and RAG for Harmonizing Job Descriptions in the Austrian Federal Administration
Nicolas Ferranti, Andreas Mild and Stefan Sobernig
Ontology Reuse in LLMs Generated Ontologies: A Comparative Evaluation Framework
Henon Mengistu Lamboro, Amel Bouzeghoub, Cécile Rabrait, Antonio Kung, Olivier Genest and Amélie Gyrard
Towards an Evaluation Framework for Generated Formal Knowledge
Maxime Haurel, Armelle Brun and Mathieu D'Aquin
Evaluating LLMs in Ontology Transformation: Study on Property Chain Shortcutting
Kateřina Haniková, Vojtěch Svátek and Ondřej Zamazal
LLM Driven Justified Alignment
Diego Conde Herreros, George Hannah, Terry Payne, Jacopo de Berardinis, Valentina Tamma, David Chaves-Fraga and Oscar Corcho
From Experts to LLMs: Evaluating the Quality of Automatically Generated Ontologies [📃PDF]
Majlinda Llugiqi, Fajar J Ekaputra and Marta Sabou
Assessing the Capability of Large Language Models for Domain-Specific Ontology Generation [📃PDF]
Anna Sofia Lippolis, Eva Blomqvist, Mohammad Javad Saeedizade, Andrea Giovanni Nuzzolese and Robin Keskisärkkä
How do Scaling Laws Apply to Knowledge Graph Engineering Tasks? The Impact of Model Size on Large Language Model Performance [📃PDF]
Desiree Heim, Lars-Peter Meyer, Markus Schröder, Johannes Frey and Andreas Dengel
Large Language Models as Knowledge Evaluation Agents [📃PDF]
George Hannah, Jacopo de Bernardinis, Terry Payne, Valentina Tamma, Andrew Mitchell, Ellen Piercy, Ewan Johnson, Andrew Ng, Harry Rostron and Boris Konev
Large Language Model for Ontology Learning In Drinking Water Distribution Network Domain [📃PDF]
Yiwen Huang, Erkan Karabulut and Victoria Degeler
Investigating Vividness Bias In Language Models Through Art Interpretations [📃PDF]
Laura Samela, Enrico Daga and Paul Mulholland
LLMs4Life: Large Language Models for Ontology Learning in Life Sciences [📃PDF]
Nadeen Fathallah, Steffen Staab and Alsayed Algergawy
From Text to Knowledge: Leveraging LLMs and RAG for Relationship Extraction in Ontologies and Thesauri [📃PDF]
Antonios Georgakopoulos, Jacco van Ossenbruggen and Lise Stork