I am currently working with EE Dept. IIT Madras.
I work on problems of online auctions, restless multi-armed bandits, sequential decision problems, reinforcement learning. Its applications to communication systems, recommendation systems, intelligent transport systems and robotics.
Recent works:
Hierarchical decentralized stochastic control for cyber physical systems (Joint work with Kesav Kaza and Ramachandran A.)