ESP18: Fundamentals of Event Sensor Signal Processing
To develop fundamental theory and algorithms for event sensor signal processing that will allow event sensor application at limits of low signal to noise, e.g. in low light conditions, bioimaging, space applications, etc.
- Can we lay a practical mathematical foundation that allows deriving efficient event-driven signal processing algorithms, analogous to the Z-transform of DSP?
- Can we find (and quantify) better noise reduction (NR) algorithms than existing ones?
- Can we find general methods for adaptively controlling sensor parameters like threshold, bandwidth, and refractory period?
- Can we find better input representations for event camera data for CNNs?
- What can we do to combine DVS events with color vision?
Confirmed Invited Participants
- Prof. Yiannis Andreopoulus, (University College London) - signal processing on frame-free representations with event cameras
- Dr. David Mascarenas (Los Alamos Natl Labs) — dynamic structural analysis with DVS
- Prof. Cornelia Fermuller, Univ. Maryland
- Dr. Francisco Barranco, Univ. of Grenada
- Prof. Ryad Benosman, UPMC Paris
- Dr. Garrick Orchard, Natl Univ. of Singapore
- Greg Burman, inivation.com
- Alex Zhu, U Penn
- Formulate theory of linear signal processing in event-driven form.
- Record moving object (e.g. pendulum, people) under range of lighting conditions ranging from bright light to nearly completely dark, and understand how to dynamically control event filtering and bias control to maximize tracking accuracy.
- Apply results to space satellite tracking and analysis of Ca++ fluorescence in vitro recordings.
- Apply adaptive filtering to real-world driving recordings to understand impact of filtering on steering wheel prediction accuracy.
- A variety of prototype event cameras from the sensors group at INI and inivation.
- Software toolboxes, including jAER, cEAR, ROS, and a tryout of a brand new real time python sensor interface
- The new SLASHER Traxxas fast stadium racer RC car platform
- A new stereo pan tilt DVS rig to explore task-based stereo tracking accuracy