Overview
Use sensors to understand the surrounding:
2D: Use camera for object detection and segmentation. (Traffic lights, traffic signs, lane types, general objects)
3D: Use LiDAR for object detection and tracking (cars, pedestrians, determine whether we've seen this object before)
Pipeline: Build robust pipeline that integrates 2D + 3D detection, tracking, post processing modules
Perception Team Lead: Tai-Yu (Daniel) Pan, Russell Zhu
What will you learn?
Work in an Agile Development Environment
Modify/develop a robust perception pipeline
Learn state-of-the-art algorithms
Data manipulation and processing
Desired skills:
Python (advanced)
Python Libraries (NumPy, PyTorch, OpenCV, etc)
Docker
Experience with Ohio Supercomputer Center (OSC)
Dataset manipulation, training and evaluating models
Robot Operating System (ROS 2)