CVPR 2022 Tutorial on
Vision-based Robot Learning

When: June 20th, 9am to 12pm.

Where: Both in-person (R06-R09) and online (zoom - please join through CVPR virtual website)

Colab link!

Video recording of the Tutorial!

Objective

(1) Introduce research on Computer Vision for Robotics.

(2) Provide hands-on experience for participants to directly run a simulated robotics environment via Colab notebook in a browser.

Program [video]

(times are in New Orleans time -- CDT, GMT /UTC - 06:00)

9:00 Introduction

9:15 Interactive Tutorial (with colab walkthrough!) -- Learning Visuomotor Policies Together with Language and Visual-Language Models

  • Part 1: Introduction to models, environments, data, and begin training.

10:00 Coffee Break

10:15 Talk: "All the Good Stuff" -- A Toolkit for Vision-Based Robot Learning

10:45 Talk: "Recipes(?) from a Vision Researcher" -- What I Wish I Knew, Starting to Work on Robotics [slides]

  • Self-supervised learning and reinforcement Learning

11:15 Talk: "Do We Even Need to Train Anymore?" -- Zero-Shotting Robotics

11:45 Interactive Tutorial (with colab walkthrough!) -- Learning Visuomotor Policies Together with Language and Visual-Language Models

  • Part 2: Deploy policies, interactive, Q&A

12:15 End!

Example Colab Tutorial Walkthrough: Interactive Visuomotor Policies with Language Models and Visual-Language Models


Organizers

Michael S. Ryoo

Robotics at Google;
Stony Brook University

Andy Zeng

Robotics at Google

Pete Florence

Robotics at Google

Shuran Song

Columbia University

Samir Gadre

Columbia University