1st workshop on critical evaluation of

generative models and their impact on society

September 29, 2024 from 9:00 to 13:00

at ECCV 2024, Milan, Italy

Location: Suite 5

Visual generative models have revolutionized our ability to generate realistic images, videos, and other visual content. However, with great power comes great responsibility. While the computer vision community continues to innovate with models trained on vast datasets to improve visual quality, questions regarding the adequacy of evaluation protocols arise. Automatic measures such as CLIPScore and FID may not fully capture human perception, while human evaluation methods are costly and lack reproducibility. Alongside technical considerations, critical concerns have been raised by artists and social scientists regarding the ethical, legal, and social implications of visual generative technologies. The democratization and accessibility of these technologies exacerbate issues such as privacy, copyright violations, and the perpetuation of social biases, necessitating urgent attention from our community.

This interdisciplinary workshop aims to convene experts from computer vision, machine learning, social sciences, digital humanities, and other relevant fields. By fostering collaboration and dialogue, we seek to address the complex challenges associated with visual generative models and their evaluation, benchmarking, and auditing.

Invited speakers

John Collomosse is a principal scientist at Adobe Research, where he leads research for the Content Authenticity Initiative (CAI) and two cross-industry task forces within the C2PA open standards body for media authenticity. He is a professor at the University of Surrey, where he is the founder and director of DECaDE, the UKRI Research Centre for the Decentralized Creative Economy. His research focuses on media provenance to fight misinformation and online harms, and on improving data integrity and attribution for responsible AI.

Yukino Baba is an Associate Professor in the Graduate School of Arts and Sciences at University of Tokyo. Her research interests are in Human-AI Collaboration and Human Computation. Prior to joining the faculty at University of Tokyo, she was an Associate Professor at University of Tsukuba from 2018 to 2022, Assistant Professor at Kyoto University from 2015 to 2018, and a postdoctoral fellow at National Institute of Informatics (2014-2015) and University of Tokyo (2012-2014). She received her Ph.D. from University of Tokyo in 2012.

Debora Nozza is an Assistant Professor in Computing Sciences at Bocconi University. She was awarded a €1.5m ERC Starting Grant project 2023 for research on personalized and subjective approaches to Natural Language Processing. Her research interests mainly focus on Natural Language Processing, specifically on the detection and counter-acting of hate speech and algorithmic bias on Social Media data in multilingual context.