Tutorial Start Time: 10 am PT
Event/Session
Speaker(s)
Start Time
Introduction and getting started:
- An introduction to GPU-accelerated simulation
- Overview of Isaac Gym’s tensor API
- Isaac Gym: installation and setup, running examples
Gavriel State 10 am
Lukasz Wawrzyniak
Viktor Makoviychuk
Short break
5 min
RL training and benchmarks:
- Review of the training environments
- Standard training environments: Mujoco Ant, Humanoid - implementation, training result and live demo
- Advanced use cases: Shadow and Allegro Hand environments, OpenAI
- Trifinger robotic manipulation project: environment and benchmarks, how-to tips - implementation, sim-to-real results
Viktor Makoviychuk 10.50 am
Arthur Allshire
Short break
5 min
Isaac Gym in academic labs:
- Robotic manipulation projects from the Intelligent Autonomous
Manipulation lab at Carnegie Mellon
- Sim-to-real transfer for legged robots locomotion on non-even terrain, ETH Zurich
Jacky Liang 11.50 am
Nikita Rudin
Additional topics:
- Scalable Adaptive Domain Randomization with BayesSimIG
- GPU-accelerated operational space controllers
Adding controllers to GPU-pipeline
OSC controller -- what, why
OSC showcase -- Kendama
- Deformable object simulation via the finite element method
BioTac simulations, real-world validation
3D deformable object grasping
Rika Antonova 12.20 pm
Josiah Wong
Yashraj Narang
Isabella Huang
Short break
5 min
New frontiers:
- Roadmap for future development of Isaac Gym
- New PhysX simulation features: FEM soft-bodies and cloth, liquids, MPM simulation
- Training with vision; multi-camera path-traced sensors
Gavriel State 1.30 pm
Viktor Makoviychuk
Wrap up:
- Further resources, forums, code sharing sites
Viktor Makoviychuk 1.45 pm
Gavriel State
Breakout room for additional Q&A:
- Beginners’ room, RL room, physics room, vision room
Viktor Makoviychuk 1.55 pm
Gavriel State