Hands-On:
AutoML Decathlon

Abstract

While the field of machine learning has witnessed tremendous advances in domains such as computer vision and natural language processing, a wide range of areas beyond these traditional ML domains also seek to take advantage of data-driven tools. As a consequence, there is a growing need for ML systems that can adapt to diverse tasks in an efficient and automated fashion. We recently launched the NeurIPS22 AutoML Decathlon competition to help catalyze research in this area and establish a benchmark for the current state of AutoML on diverse tasks. Building on these efforts, the AutoML Fall School Hackathon provides a self-contained conceptual and hands-on introduction to the problem of AutoML for diverse tasks.

We will begin with a short overview of the underlying problem followed by technical details about the competition, which together should allow you to quickly begin crafting and testing methods. To facilitate your hands-on efforts, we will provide a starter kit of code; create scaled-down versions of the competition datasets that can be processed using free tools such as Google Colab; and be available during the event to answer questions and provide support. The aims of the hackathon are for you to (1) learn about the conceptual problem of AutoML for diverse tasks; (2) gain hands-on experience in running and evaluating AutoML methods on a diverse set of tasks; and optionally (3) make an initial submission to the competition itself. Afterwards, we hope your experience will encourage you to continue participating in AutoML Decathlon through its November 10 deadline (and win prizes)!

Recording Part I

Recording Part II

Bio