Programme

This is a draft programme. Details may be subject to some change.

Organiser’s Welcome

09:00 - 09:10

Description: The workshop opens with a welcome from the organisers, providing context and objectives for the day.

Speakers: Workshop organiser(s)

Invited Talk by Peter Mattson: Building an Ecosystem for Reliable, Low-Risk AI

09:10 - 09:50

Scope: How better benchmarks and a developing science of AI data supported by AI data standards and tools will enable AI products and services that deliver value

Description: This talk will explore how advancements in benchmarks and the development of a science of AI data—underpinned by robust standards and tools—can foster the creation of AI products and services that are both trustworthy and valuable. It will cover key topics, including the progress of AI as a transformative technology, the evolution of benchmarking practices, and the MLCommons approach exemplified by MLPerf, AILuminate, and MedPerf. It will also address the importance of AI data science and tooling, highlighting innovations like the MLCommons Croissant data format, and outline actionable steps for the AI community to build a secure and reliable AI ecosystem.

Speakers: Dr. Peter Mattson, Google Research & MLCommons

Deep Dive into AI Safety: Lora Aroyo & Gopal Ramchurn

09:50 - 10:30

Description: This session features two 20-minute presentations focusing on AI safety. Lora Aroyo will discuss methodologies for evaluating AI systems, emphasising the importance of diverse perspectives in data to ensure trustworthiness and reliability. Gopal Ramchurn will explore the safety and security of autonomous systems, addressing challenges in human-machine teaming and responsible AI deployment

Speakers:


Coffee break

10:30 - 11:00

Showcase: submitted work and posters

Panel 1: Safety Challenges in Multimodal AI

11:00 - 12:00

Description: A panel discussion featuring experts on the unique safety challenges posed by multimodal AI systems, such as bias, interpretability, and transparency.

Speakers:

Lightning Talks – "Advancements in Datasets and Evaluators for AI Safety"

12:00 - 12:30

Description: Authors of 4 of the accepted papers will present brief lightning talks summarising their research contributions. Each presenter will have approximately 15 minutes to provide a concise overview of their work related to creating and improving datasets and benchmarks for AI safety. Topics range from theoretical approaches to practical implementations and evaluations of AI systems.

Speakers: Various authors

Lunch Break

12:30 - 14:00

Description: Attendees can enjoy lunch while engaging with poster presentations of contributed work. This session provides an excellent opportunity for networking and in-depth discussions with researchers about their projects. Posters from the accepted papers will be displayed, and authors will be available for questions.

Panel 2: Agentic AI: Future Challenges and Opportunities

14:00 - 14:45

Description: This panel addresses safety concerns related to agentic AI systems, focusing on autonomy, trustworthiness, drift, and transparency. The discussion aims to identify emerging risks and point toward potential innovative solutions.

Speakers:

Panel 3: Standards and International Collaboration on AI Safety

14:45 - 15:30

Description: This panel examines the development and implementation of AI safety standards, highlighting the role of international cooperation among governments, academia, and industry. Discussions will cover the establishment of global AI safety institutes, the creation of legally binding AI treaties, and collaborative efforts to align AI development with human rights and democratic values. The session aims to identify best practices and frameworks for effective global AI governance.

Speakers:

Coffee Break

15:30 - 16:00

Description: A second coffee break, featuring poster presentations of contributed work. Participants can network and engage with researchers during this session.

Lightning Talks – "Advancements in Datasets and Evaluators for AI Safety"

16:00 - 16:30

Description: Authors of 4 of the accepted papers will present brief lightning talks summarising their research contributions. Each presenter will have approximately 15 minutes to provide a concise overview of their work related to creating and improving datasets and benchmarks for AI safety. Topics range from theoretical approaches to practical implementations and evaluations of AI systems.

Speakers: Various authors

Concluding Remarks

16:30 - 17:00

Description: The workshop will conclude with a summary of key insights and discussions from the day's sessions. Attendees will be invited to contribute their perspectives and discuss potential collaborative projects. Closing remarks will outline the next steps and encourage ongoing engagement within the community.

Speakers: Workshop organiser(s)