3rd ICML Workshop on Human In the Loop Learning (HILL)

July 24, 2021,

Virtual, co-located with ICML 2021

Recent years have witnessed the rising need for machine learning systems that have humans in the learning loop. Such systems can be applied to computer vision, natural language processing, robotics, and human-computer interaction. Creating and running such systems call for interdisciplinary research of artificial intelligence, machine learning, and cognitive science, which we abstract as Human in the Loop Learning (HILL). The HILL workshop aims to bring together researchers and practitioners working on the broad areas of HILL, ranging from the interactive/active learning algorithms for real-world decision-making systems (e.g., autonomous driving vehicles, robotic systems, etc.), lifelong learning systems that retain knowledge from different tasks and selectively transfer knowledge to learn new tasks over a lifetime, models with strong explainability, as well as human-inspired learning. The HILL workshop continues the previous effort to provide a platform for researchers from interdisciplinary areas to share their recent research. In this year’s workshop, a special feature is to encourage the exploration of human-inspired learning.

The topics of HILL include but are not limited to:

Interactive/Active machine learning algorithms for autonomous decision-making systems,
Lifelong learning systems that learn a sequence of tasks and leverage their shared structure to enable knowledge transfer over a lifetime,
Online learning and active learning,
Comparison of human in the loop learning and label-efficient learning,
Psychology driven human concept learning,
Explainable AI,
Human-inspired learning,
Design, testing, and assessment of interactive systems for data analytics,
Model understanding tools (debugging, visualization, introspection, etc.).

Important Dates

Submission deadline: June 27, 2021 (Anywhere on earth)
Notification: July 16, 2021
Workshop: July 24, 2021

Submission Instructions

We invite submissions of full papers as well as works-in-progress, position papers, and papers describing open problems and challenges. While original contributions are preferred, we also invite submissions of high-quality work that has recently been published in other venues or is concurrently submitted.

Papers should be 4-8 pages in length (excluding references and acknowledgements) formatted using the ICML template (in the blind non-accepted mode) and submitted online at https://cmt3.research.microsoft.com/HILL2021. We expect submissions to be 4 pages but will allow up to 8 pages.

Accepted papers will be selected for a short oral presentation or poster presentation. A non-archival proceedings will be created as an overlay on arXiv.

Previous Editions of the Workshop