Embedded Files
Key information (Call for Papers)
Workshop Title: Datasets and Evaluators for AI Safety
Date: March 3rd 2025
Notification for Authors: December 14th 2024
Location: Room 112, AAAI 2024 (Philadelphia, Pennsylvania, USA)
Duration: Full-day, approximately 6 hours of content, excluding breaks
Topics
This workshop welcomes contributions towards creation and improvement of datasets and benchmarks used for evaluation of safety of AI systems (in particular LLMs) according to the characteristics listed above. The work can be theoretical (new approaches to creating datasets or proving a dataset's adequacy for the task) or practical (suggesting new datasets, checking the validity of existing datasets, improving existing datasets). We also welcome contributions that use existing benchmarks to demonstrate safety or AI systems or find unsafe behaviours.
Format of Workshop
The workshop’s length is one full day.
The workshop will be a combination of invited talks, contributed talks, a panel, the winners and the runner-ups of the Kaggle challenge on AI Safety, presentations of submitted work, and poster presentations.
We will leave ample time for questions and answers at the end of each invited talk and panel session, and we will feature a poster session to encourage dialogue among authors.
The Kaggle challenge overview will be given by D. Sculley, the CEO of Kaggle and one of the workshop's co-chairs.
Attendance
The presenters of accepted papers and posters are expected to attend in person, except in special circumstances.
The invited speakers will attend in person.
The workshop welcomes participants that do not present a paper or a poster as well.
We expect around 100 participants in person. We will make arrangements for remote attendees.
Registration
Please register via AAAI: https://aaai.org/conference/aaai/aaai-25/
Call for papers
Please find the call for papers here: Call for Papers. For further details please see the 'Call for Papers' webpage.
Page updated
Google Sites
Report abuse