1st workshop on critical evaluation of 

generative models and their impact on society

September 29, 2024 from 9:00 to 13:00

at ECCV 2024, Milan, Italy

Location: Suite 5

Accepted full papers

• Manipulating and Mitigating Generative Model Biases without Retraining 

Jordan J Vice, Naveed Akhtar, Richard Hartley, Ajmal Mian

• Fake or JPEG? Revealing Common Biases in Generated Image Detection Datasets

Patrick Grommelt, Louis Weiss, Franz-Josef Pfreundt, Janis Keuper

• Generated Bias: Auditing Internal Bias Dynamics of Text-To-Image Generative Models

Abhishek Mandal, Susan Leavy, Suzanne Little

•  A semiotic methodology for assessing the compositional effectiveness of generative text-to-image models (Midjourney and DALL•E)

Enzo D'Armenio, Adrien Deliege, Maria Giulia Dondero 

• A Framework for Critical Evaluation of Text-to-Image Models: Integrating Art Historical Analysis, Artistic Exploration, and Critical Prompt Engineering.

Amalia Foka

• Civiverse: A Dataset for Analyzing User Engagement with Open-Source TTI-Models

Maria Teresa De Rosa Palmini, Laura Wagner, Eva Cetinic

• Exploring the Boundaries of Content Moderation in Text-to-Image Generation

Piera Riccio, Georgina Curto, Nuria Oliver 

• Rethinking HTG Evaluation: Bridging Generation and Recognition

Konstantina Nikolaidou, George Retsinas, Giorgos Sfikas, Marcus Liwicki

Accepted short papers

• Gender Bias Evaluation in Text-to-image Generation: A Survey

Yankun Wu, Yuta Nakashima, Noa Garcia 

Selected published papers 

• To Authenticity, and Beyond! Building Safe and Fair Generative AI upon the Three Pillars of Provenance

John Collomosse

IEEE Computer Graphics and Applications 2024

• DIG In: Evaluating Disparities in Image Generations with Indicators for Geographic Diversity

Melissa Hall, Candace Ross, Adina Williams, Nicolas Carion, Michal Drozdzal, Adriana Romero Soriano

Transactions on Machine Learning Research 2024

• Towards Geographic Inclusion in the Evaluation of Text-to-Image Models

Melissa Hall, Samuel Bell, Candace Ross, Adina Williams, Michal Drozdzal, Adriana Romero Soriano

ACM Conference on Fairness, Accountability, and Transparency 2024

• What makes a good metric? Evaluating automatic metrics for text-to-image consistency 

Candace Ross, Melissa Hall, Adriana Romero Soriano, Adina Williams

Conference on Language Modeling 2024

• Stable Diffusion Exposed: Gender Bias from Prompt to Image

Yankun Wu, Yuta Nakashima, Noa Garcia 

AAAI Conference on AI, Ethics, and Society 2024