Day 1 (Friday November 3rd)
10:00 - noon - bus from Mila to Le Grand Lodge, Tremblant
noon - 16:00 - check-in/hike
16:00 - 18:00 workshop session
Irina Rish The Large-scale AI Revolution: Breakthroughs and Challenges
Introductions and Discussion of Ongoing Projects
18:00-19:00 - free time (mountain biking; swimming pool/hot tub; hiking; visiting Mt Tremblant village - 5min drive from the Lodge)
19:00-20:30 - dinner at Le Grand Lodge
20:30-23:00 - open discussions (outdoor fireplace near the lake; then lounge/bar at the lodge)
(tentative goal: solve AI Alignment before AI becomes conscious at 2:14am EST 😂)
Day 2 (Saturday November 4th)
7:30-9:00 - breakfast
9:30-12:00 - workshop session
Irina Rish: An Overview of Our INCITE Projects on the Summit Supercomputer
Continual Pretraining of Foundation Models How to Re-Warm Your Model? in ICML2023 and NeurIPS2023 workshops)
Aligning Multimodal Models Towards ethical multimodal systems
Time-Series Foundation Models Lag-LLaMA Towards Foundation Models for Time Series Forecasting
Kshitij Gupta and Benjamin Thérien: In-depth on topic 1
12:00 - 13:00 - lunch
14:30 - 16:30 - workshop session
Maximilian Puelma Touzel: Ideology from topic mixture correlations
Saba Ahmadi: An Examination of the Robustness of Reference-Free Image Captioning Evaluation Metrics
break
16:30 - 17:30 - workshop session
Arjun Ashok: Lag-LLaMA: Foundation Model for Time-Series Forecasting (paper)
Hamza Abdelhedi and Jordan O'Byrne Brain Similarity Scaling
17:30-19:00 - free time
19:00-20:30 - dinner at Le Grand Lodge
20:30-23:00+ - fireplace at the lake
Day 3 (Sunday November 5th)
7:30-10:00 - breakfast
10:00 - 11:00 - check out
11:00 - 12:00 - workshop session
Irina Rish An Overview of Our Recent Large-Scale Model Training Efforts, Continued
Nolano.ai (w/Tejas Vaidhya, Ayush Kaushal)
Hi-NOLIN: Hindi LLM - a part of NOLANO Indic models effort - blog, tweet
Some remaining topics (time permitting)
Broken Neural Scaling Laws, Towards ethical multimodal systems
Model Compression: Low Rank Decomposition Of Monolingual Code LLMs
12:00 - 12:30 - Gabriele Prato: EpiK-Eval: Evaluation for Language Models as Epistemic Models
12:30 - 14:00 - lunch
14:00 - 15:00 - workshop session
Sonia Joseph Non-LLM and Multimodal Alignment
Open Discussion
15:00 - 18:00 - free time (visiting Mt Tremblant village; hiking)
18:00 - 20:00 - bus from Le Grand Lodge to Mila