ICLR 2023 Workshop on Mathematical and Empirical Understanding of Foundation Models (ME-FoMo)

Workshop on May 4th, 2023.

Accepted papers: https://openreview.net/group?id=ICLR.cc/2023/Workshop/ME-FoMo

Foundation models (FMs) are models that are trained on a large and diverse pool of data and can be adapted to a wide range of tasks. Recent examples of FMs include large language models (GPT-3, BERT, PaLM), image representation encoders (SimCLR), and image-text models (CLIP, DALL-E), which have all revolutionized the way models are built in their domains.


The goal of this workshop is to highlight research that aims to improve our understanding of FMs, and bring together researchers that work in the area. We liberally interpret understanding as any research ranging from purely empirical papers that highlight interesting phenomena, to those which attempt to explain or provide theoretical foundations for such phenomena in potentially simplified settings, for example in two-layer neural networks. Examples of relevant topics include, but are not limited to:



Please see the Call for Papers for important dates, links, and policies.

Papers will be submitted on OpenReview: https://openreview.net/group?id=ICLR.cc/2023/Workshop/ME-FoMo


Speakers

Sanjeev Arora

Princeton University

Yasaman Bahri

Google Brain

Danqi Chen

Princeton University

Jared Kaplan

Anthropic and Johns Hopkins University

Yann Dauphin

Google Research

Jonathan Frankle

MosaicML and Harvard University

Organizers

Ananya Kumar

Stanford University

Tiffany Vlaar

MILA/McGill University

Sang Michael Xie

Stanford University

Yamini Bansal

Google Brain

Aditi Raghunathan

Carnegie Mellon University

Tengyu Ma

Stanford University

Hanie Sedghi

Google Brain

Percy Liang

Advisor - Stanford University

Thank you to all our amazing reviewers (below)!

Aakanksha Chowdhery

Abulhair Saparov

Adam Fisch

Ahana Gangopadhyay

Aishwarya Balwani

Akhilesh Deepak Gotmare

Albert Gu

Alexander Wettig

Aman Madaan

Amir Bar

Asher Trockman

Ashish Hooda

Ashwini Pokle

Avinash Madasu

Benjamin L. Edelman

Benjamin Newman

Bilal Alsallakh

Bingchen Zhao

Charlie Victor Snell

Christina Baek

Collin Burns

Daniel Y Fu

Dingli Yu

Ellyn Ayton

Erik Jones

Hao Tan

Haokun Liu

Haonan Duan

Hong Liu

Ilija Radosavovic

Iz Beltagy

Jacob M. Springer

Jeff Z. HaoChen

Jiacheng Liu

Jianan Zhou

Jingling Li

Jinqi Luo

Kamilė Lukošiūtė

Kefan Dong

Kevin Miao

Lavinia F Pieptea

Liunian Harold Li

Lucio M. Dery

Mayee F Chen

Mengzhou Xia

Michael Zhang

Minyechi Alehegn Tefera

Mirac Suzgun

Nikhil Vyas

Nikunj Saunshi

Pang Wei Koh

Patrick Fernandes

Pradeep Dasigi

Pratyush Maini

Preetum Nakkiran

Putra Manggala

Qian Huang

Raj Ratn Pranesh

Rishi Bommasani

Rohan Taori

Rohith Kuditipudi

Ruibo Liu

Ruoqi Shen

Saachi Jain

Sachin Goyal

Sadhika Malladi

Saleh Elmohamed

Sameera Horawalavithana

Sanjay Subramanian

Sarah Masud

Saurabh Garg

Sewon Min

Shashank Shekhar

Sheng Shen

Shivam Garg

Shubham Shukla

Shulei Wang

Shuyan Zhou

Simon Kornblith

Simran Arora

Tejasri Nampally

Thao Nguyen

Tianle Cai

Tianwei Yue

Tianyu Gao

Tim Dettmers

Tomasz Korbak

Udita Patel

Vaishnavh Nagarajan

Vamsi Aribandi

Vanya Bannihatti Kumar

Vishakh Padmakumar

Wei Hu

Xiang Lisa Li

Xiang Wang

Xiangyu Yue

Xindi Wu

Xuechen Li

Yanda Chen

Yangjun Ruan

Yann Dubois

Yara Rizk

Yining Chen

Yiyuan Li

Yoonho Lee

Yossi Gandelsman

Zhiyuan Li

Zi-Yi Dou