Publications

1. Journal Publications

R. Meshram, D. Manjunath and A. Gopalan "On the Whittle index for restless multi-armed hidden Markov bandits", in IEEE Transaction on Automatic Control, 2018
V. Mehta, R. Meshram, K. Kaza, S. N. Merchant, U. B. Desai "Rested and Restless Bandits With Constrained Arms and Hidden States: Applications in Social Networks and 5G Networks," in IEEE Access, Year: 2018, Volume: 6, Pages: 56782 - 56799.
K. Kaza, R. Meshram, V. Mehta, S. N. Merchant "Sequential Decision Making with Limited Observation Capability: Application to Wireless Networks," in IEEE Transactions on Cognitive Communications and Networking, Year: 2019, Volume: 5, Issue: 2.

2. Conference Publications

R Meshram, K. Kaza, V. Mehta and S. N. Merchant, "Restless Bandits for Sensor Scheduling in Energy Constrained Networks," in IEEE Eighth Indian Control Conference (ICC-8), IIT Madras, 2022.
R. Meshram and K. Kaza,"Indexability and Rollout Policy for Multi-State Partially Observable Restless Bandits," in IEEE Conference on Decision and Control (CDC), 2021.
R. Meshram and K. Kaza, "Monte Carlo Rollout Policy for Recommendation Systems with Dynamic User Behavior," in IEEE COMSNETS, January, Bangalore, India, 2021.
R. Meshram, D. Manjunath and N. Karamchandani "Learning Recommendations While Influencing Interests," in 57th IEEE Conference on Decision and Control (CDC), 17-19 December, Miami Beach, Florida, USA, 2018.
K. Kaza, V. Mehta, R. Meshram and S. N. Merchant "Restless Bandits With Cumulative Feedback: Applications in Wireless Networks," in IEEE Wireless Communications and Networking Conference (WCNC), 15-18 April, Barcelona, Spain, 2018.
K. Kaza, R. Meshram and S. N. Merchant "Relay Employment Problem for Unacknowledged Transmissions: Myopic Policy and Structure," in IEEE International Conference on Communication (ICC), 21-25 May, Paris, France, 2017
R. Meshram, A. Gopalan and D. Manjunath "Restless Bandits That Hide their Hand and Recommendation Systems," in The Ninth International Conference on Communication and Networks (COMSNETS), 4-8 January, Bangalore, India, 2017.
R. Meshram, A. Gopalan and D. Manjunath "Optimal Recommendation to Users that React: Online Learning for a Class of POMDPs," in 55th IEEE Conference on Decision and Control (CDC), 12-14 December, Las Vegas, USA, 2016.
R. Meshram "Power Control Over Gilbert-Elliot Channel With No Observable States," in IEEE Twenty Second National Conference on Communications (NCC), 4-6 March, Guwahati, India, 2016.
R. Meshram, D. Manjunath and A. Gopalan "A Restless Bandit With No Observable States for Recommendation Systems and Communication Link Scheduling," in 54th IEEE Conference on Decision and Control (CDC), 15-18 December, Osaka, Japan, 2015.
R. Meshram "In-Network Online Asynchronous Regression Over a Wireless Network," in IEEE Twentieth National Conference on Communications (NCC), 28th Feb.-2nd March, Kanpur, India, 2014. (Shortlisted for Best Paper Award in Networks Track)
H. Vangala, R. Meshram, and V. Sharma "Joint routing, scheduling and power control in multihop MIMO networks with MAC and Broadcast links," in IEEE Wireless Communications and Networking Conference (WCNC),1-4 April, Paris, France, 2012.
R. Meshram, V. S. Borkar, and D. Manjunath "Problem-aware Scheduling of In-Network Computation Over Multi-hop Wireless Networks," in IEEE International Conference on Signal Processing and Communications (SPCOM), 22-25 July, Bangalore, India, 2012.
H. Vangala, R. Meshram, and V. Sharma "Joint Routing, Scheduling And Power Control For Multihop Wireless Networks With Multiple Antennas," in IEEE Eighteenth National Conference on Communications (NCC), 3-5 February, Kharagpur,India, 2012.
R. Meshram, and N. B. Mehta \Implication Of The Half-Duplex Constraint On Relay-Aided Cooperation Using Rateless Codes," in IEEE Sixteenth National Conference on Communications (NCC), 29-31 January, Chennai, India, 2010.

3. Book Chapter

R. Meshram, A. Gopalan and D. Manjunath "A Hidden Markov Restless Multi-armed Bandit Model for Playout Recommendation Systems," in Lecture Notes in Computer Science(LNCS), Springer, Also available on Arxiv, 2017.

4. Miscellaneous

R Meshram and U. V. Sankar "Channel Allocation in 5G Wireless Networks Using First Price Auctions," Tech. Report, 2022.
V. Mehta, K. Kaza, R. Meshram, and S. N. Merchant "Restless Bandits With Constrained Arms: Application to 5G Small Cell Selection," Poster Presentation at IEEE Wireless Communications and Networking Conference (WCNC), 15-18 April, Barcelona, Spain, 2018.
R. Meshram, and H. Ajmera "Revenue Maximization via Personalized Online Recommendation," Poster Presentation at Xerox Research, XRCI, 2014.