We study the codebook selection problem through a multi-armed bandit (MAB) formulation in mmWave networks with rapidly-varying channels. We develop multiple novel Thompson Sampling-based algorithms for our setting given different codebook structures with theoretical guarantees on regret.
Yi Zhang, Soumya Basu, Sanjay Shakkottai, and Robert W. Heath Jr. 2021. MmWave Codebook Selection in Rapidly-Varying Channels via Multinomial Thompson Sampling. In Mobihoc '21: The Twenty-Second ACM International Symposium on Mobile Ad Hoc Networking and Computing, July 26, 2021, Shanghai, China. ACM, New York, NY, USA. 10 pages. (Best Paper Award Runners-up) [Link][Full version][Slides][Talk]