Challenges in Deploying and monitoring Machine Learning Systems
ICML Workshop - VIRTUAL EVENT
Friday 23rd July 2021
OVERVIEW
Until recently, many industrial Machine Learning applications have been the remit of consulting academics, data scientists within larger companies, and a number of dedicated Machine Learning research labs within a few of the world’s most innovative tech companies. Over the last few years we have seen the dramatic rise of companies dedicated to providing Machine Learning software-as-a-service tools, with the aim of democratizing access to the benefits of Machine Learning. All these efforts have revealed major hurdles to ensuring the continual delivery of good performance from deployed Machine Learning systems. These hurdles range from challenges in MLOps, to fundamental problems with deploying certain algorithms, to solving the legal issues surrounding the ethics involved in letting algorithms make decisions for your business.
This workshop will invite papers related to the challenges in deploying and monitoring ML systems. It will encourage submission on:
subjects related to MLOps for deployed ML systems, such as
testing ML systems,
debugging ML systems,
monitoring ML systems,
debugging ML Models,
deploying ML at scale;
subjects related to the ethics around deploying ML systems, such as
ensuring fairness, trust and transparency of ML systems
providing privacy and security on ML Systems;
useful tools and programming languages for deploying ML systems;
specific challenges relating to
deploying reinforcement learning in ML systems
performing continual learning and providing continual delivery in ML systems;
and finally data challenges for deployed ML systems.
INVITED SPEAKERS
Stanford University
Model-less Inference Serving for ease-to-use and cost-efficiency
Makerere University
Deploying end-to-end machine learning systems for social impact
PANEL ON OPEN PROBLEMS - APPLICATIONS IN THE LEGAL SYSTEM
Chair: JOHN ARMOUR, University of Oxford
Panellists: Jessica Montgomery, University of Cambridge. Teresa Scantamburlo, European Centre for Living Technology. Charles Brecque, Legislate.tech.
PANEL ON OPEN PROBLEMS - DEPLOYMENT AND MONITORING ON DEVICES AND CONSTRAINED HARDWARE
Chair: STEPHEN ROBERTS, University of Oxford
Panellists: Partha Maji, ARM. Cecilia Mascolo, University of Cambridge. Ivan Kiskin, University of Oxford. Yunpeng Li, University of Surrey. Maria Nyamukuru, Dartmouth College.
Workshop organizers
Alessandra Tosi, Mind Foundry
Nathan Korda, Mind Foundry
Stephen Roberts, University of Oxford
Michael Osborne, University of Oxford
Andrei Paleyes, University of Cambridge
Fariba Yousefi, University of Sheffield
Program committee
Zhenwen Dai, Mi Zhang, Ting-Wu Chin, Stephanie Wang, Jack Parker-Holder, Morrie Doulaty, Justin Noel, Oscar Saz, Yulan Liu
CONTACT
For any query please contact dmmlsys@gmail.com
Previous editions: ICML 2020 Workshop