Manali Dutta and Rahul Singh, "Optimal Risk-Sensitive Scheduling Policies for Remote Estimation of Autoregressive Markov Processes," IEEE Control System Letters (IEEE L-CSS). (to appear)
Guojun Xiong, Shufan Wang, Jian Li, Rahul Singh, "Whittle Index based Q-Learning for Wireless Edge Caching with Linear Function Approximation," IEEE/ACM Transactions on Networking (IEEE/ACM TON), vol. 32, no. 5, pp. 4286-4301, October 2024.
Avik Kar, Rahul Singh, Fang Liu, Xin Liu, and Ness Shroff, "Linear Bandits with Side Observations on Networks," IEEE/ACM Transactions on Networking, vol. 32, no. 5, pp. 4222-4237, October 2024.
Rahul Singh, Fang Liu, Yin Sun and Ness Shroff, "Multi-Armed Bandits with Dependent Arms,'' Machine Learning, November 2023, Volume 113, pages 45–71.
Rahul Singh, Abhishek Gupta and Ness Shroff , "Learning in Constrained Markov Decision Processes.'' IEEE Transactions on Control of Network Systems, March 2023, Volume 10, Issue 1.
G. Yao, M. Hashemi, R. Singh, and N. B. Shroff, "Delay-Optimal Scheduling for Integrated mmWave Sub-6 GHz Systems with Markovian Blockage Model.'' IEEE Transactions on Mobile Computing, 2022.
A. Bedewy, Y. Sun, Rahul Singh, N. Shroff, "Low-Power Status Updates via Sleep-Wake Scheduling," IEEE/ACM Transactions on Networking, vol. 29, Issue 5, October 2021, pp. 2129 - 2141.
R. Singh and P.R. Kumar, "Adaptive CSMA for Decentralized Scheduling of Multi-Hop Networks with End-to-End Deadline Constraints," IEEE/ACM Transactions on Networking, vol. 29, Issue 3, March 2021, pp. 1224 - 1237.
R. Singh, W. Ren, F. Liu, D. Xuan, Z. Lin, N. Shroff, "A Blueprint for Effective Pandemic Mitigation," ITU Journal on Future and Evolving Technologies, Volume 1 (2020), Issue 1, 15 December 2020.
R. Singh, P.R. Kumar, and L. Xie, "Decentralized Control via Dynamic Stochastic Prices: The Independent System Operator Problem," IEEE Transactions on Automatic Control, vol. 63, issue 10, pp. 3206-3220, October 2018. pdf
R. Singh and P.R. Kumar, "Throughput optimal decentralized scheduling of multi-hop networks with end-to-end deadline constraints: Unreliable links," IEEE Transactions on Automatic Control, vol. 64, no. 1, January 2019.
I. Kadota, A. Sinha, E. Uysal-Biyikoglu, R. Singh, and E. Modiano, "Scheduling policies for minimizing age of information in broadcast wireless networks," IEEE/ACM Transactions on Networking, vol. 26, no. 6, December 2018. pdf
X. Guo, R. Singh, P.R. Kumar, and Z. Niu, "A risk-sensitive approach for packet inter-delivery time optimization in networked cyber-physical systems," IEEE/ACM Transactions on Networking, vol. 26, issue 4, pp. 1976-1989, August 2018. pdf
G. Nigam, R. Singh, A.K. Chaturvedi, "Finite duration root Nyquist pulses with maximum in-band fractional energy," IEEE Communications Letters, vol. 14, issue 9, pp. 797-799, September 2010.
Avik Kar and Rahul Singh, "Provably Adaptive Average Reward Reinforcement Learning for Metric Spaces," The Conference on Uncertainty in Artificial Intelligence (UAI), 2025.
Manali Dutta and Rahul Singh, "Optimal Risk-Sensitive Scheduling Policies for Remote Estimation of Autoregressive Markov Processes," American Control Conference (ACC) 2025.
Rahul Singh, Akshay Mete, Avik Kar, and P. R. Kumar, "Finite Time Logarithmic Regret Bounds for Self-Tuning Regulation," ICML 2024.
Manali Dutta, and Rahul Singh. "Optimal Scheduling Policies for Remote Estimation of Autoregressive Markov Processes over Time-Correlated Fading Channel.'' IEEE Conference on Decision and Control, 2023.
Akshay Mete, Rahul Singh, and P. R. Kumar. "The Reward Biased Method: An Optimism based Approach for Reinforcement Learning.'' 59-th Annual Allerton Conference on Communication, Control, and Computing (Allerton), IEEE, 2023.
G. Xiong, X. Qin, B. Li, R. Singh, and J. Li, "Index-aware reinforcement learning for adaptive video streaming at the wireless edge,'' Proceedings of the Twenty-Third International Symposium on Theory, Algorithmic Foundations, and Protocol Design for Mobile Networks and Mobile Computing (Mobihoc), 2022. (Acceptance rate 17%).
A. Mete, R. Singh and P. R. Kumar, "Augmented RBMLE-UCB Approach for Adaptive Control of Linear Quadratic Systems,'' NeurIPS 2022. (Acceptance rate 25.6 %).
A. Mete, R. Singh and P. R. Kumar, "The RBMLE method for Reinforcement Learning,'' 56-th Annual Conference on Information Sciences and Systems (CISS-2022), Princeton University.
G. Xiong, J. Li, Rahul Singh, "Reinforcement Learning Augmented Asymptotically Optimal Index Policy for Finite-Horizon Restless Bandits," Thirty-Sixth AAAI Conference on Artificial Intelligence (AAAI-2022). (Oral presentation, acceptance rate = 4.6%)
Akshay Mete, Rahul Singh and P. R. Kumar, "Reward Biased Maximum Likelihood Estimation for Reinforcement Learning", Learning for Dynamics & Control, 2021, pp. 815-827.
A.M. Bedewy, Yin Sun, Rahul Singh, and Ness B. Shroff, "Optimizing Information Freshness using Low-Power Status Updates via Sleep-Wake Scheduling", ACM Mobihoc, 2020. (acceptance rate = 15%)
Rahul Singh, Gopal Krishna Kamath and P. R. Kumar, "Optimal Information Updating based on Value of Information," 57th Annual Allerton Conference on Communication, Control, and Computing (Allerton), 2019. pdf
R. Singh, X. Guo and E. Modiano, "Risk-sensitive optimal control of queues," in Proceedings of 2017 IEEE CDC, Melbourne, Australia, December 12-15, 2017.
I. Kadota, E. Uysal-Biyikoglu, R. Singh, and E. Modiano, "Minimizing the Age of Information in Broadcast Wireless Networks," 54th Annual Allerton Conference on Communication, Control, and Computing (Allerton), Sept 27-30, 2016. pdf
X. Guo, R. Singh, T. Zhao, and Z. Niu, "An index based task assignment policy for achieving optimal power-delay trade-o in edge cloud systems," in Proceedings of 2016 IEEE International Conference on Communications (ICC), Kuala Lumpur, Malaysia, 23-27 May 2016.
R. Singh and A. Stolyar, "Maxweight scheduling: "smoothness" of the service process," in Proceedings of 2016 IEEE INFOCOM, San Francisco, USA, 10-15 April 2016. pdf
R. Singh and A. Stolyar, "Maxweight scheduling: Asymptotic behavior of unscaled queue-differentials in heavy traffic," in Proceedings of 2015 ACM SIGMETRICS, Portland, Oregon, USA, June 15-19, 2015.
Rahul Singh, P. R. Kumar and Le Xie, “The ISO problem: Decentralized stochastic control via bidding schemes,” in Proceedings of 53rd Annual Allerton Conference on Communication, Control, and Computing (Allerton), October 2015.
R. Singh and P.R. Kumar, "Optimizing quality of experience of dynamic video streaming over fading wireless networks," in Proceedings of 2015 IEEE CDC, Osaka, Japan, December 15-18, 2015. pdf
R. Singh and P.R. Kumar, "Decentralized throughput maximizing policies for deadline-constrained wireless networks," in Proceedings of 2015 IEEE CDC, Osaka, Japan, December 15-18, 2015. pdf
R. Singh, K. Ma, A. A. Thatte, P.R. Kumar, and L. Xie, "A theory for the economic operation of a smart grid with stochastic renewables, demand response and storage," in Proceedings of 2015 IEEE CDC, Osaka, Japan, December 15-18, 2015. pdf
X. Guo, R. Singh, P.R. Kumar, and Z. Niu, "A high reliability asymptotic approach for packet inter-delivery time optimization in cyber-physical systems," in Proceedings of the 16th ACM International Symposium on Mobile Ad Hoc Networking and Computing (MobiHoc), Hangzhou, China, June 22 - 25, 2015. pdf
X. Guo, R. Singh, P. R. Kumar, and Z. Niu, "Optimal energy-efficient regular delivery of packets in cyber-physical systems," in Proceedings of 2015 IEEE International Conference on Communications (ICC), London, UK, 8-12 June, 2015. pdf
R. Singh, X. Guo, and P. R. Kumar, "Index policies for optimal mean-variance trade-off of inter-delivery times in real-time sensor networks," in Proceedings of 2015 IEEE Conference on Computer Communications (INFOCOM), Hong Kong, April 26-May 1, 2015. pdf
R. Singh, I.H. Hou, and P.R. Kumar, "Fluctuation analysis of debt based policies for wireless networks with hard delay constraints," in Proceedings of 2014 IEEE Conference on Computer Communications (INFOCOM), Toronto, Canada, April 27- May 2, 2014. pdf
R. Singh, I.H. Hou and P.R. Kumar, "Pathwise performance of debt based policies for wireless networks with hard delay constraints," in Proceedings of 2013 IEEE CDC, Florence, Italy, December 10-13, 2013. pdf
I. Hou, R. Singh, "Scheduling of access points for multiple live video streams," in Proceedings of 2013 ACM MobiHoc, Bangalore, India, July 29 - August 01, 2013. pdf
P. T. Akhil, R. Singh and R. Sundaresan, "A Polymatroid Approach to Separable Convex Optimization with Linear Ascending Constraints," in Proceedings of 2014 IEEE National Conference on Communications (NCC), 28 Feb.-2 March 2014, Kanpur, India. pdf
R. Singh and V. Gupta, "On LQR control with asynchronous clocks," in Proceedings of IEEE Conference on Decision and Control and European Control Conference, December 12-15, 2011. pdf