Towards Self-Driving Radios: Physical-Layer Control using Deep Reinforcement Learning

Modern radios, such as 5G NewRadio, feature a large set of physicallayer control knobs in order to support an increasing number of communication scenarios spanning multiple use cases, device categories and wireless environments. The challenge however is that each scenario requires a diferent control algorithm to optimally determine how these knobs are adapted to the varying operating conditions. The traditional approach of manually designing diferent algorithms for diferent scenarios is increasingly becoming not just diicult to repeat but also suboptimal for new scenarios that previous-generation radios were not designed for. In this paper, we ask: can we make a radio automatically learn the optimal physical-layer control algorithm for any scenario given only high-level design speciications for the scenario, i.e., can we design a self-driving radio? We describe howrecent advances in deep reinforcement learning can be applied to train a self-driving radio for several illustrative scenarios, and show that such a learningbased approach not only is easily repeatable but also performs closer to optimal than the current state of the art.