Reinforcement and deep reinforcement learning for wireless Internet of Things: A survey

Mohamed Said Frikha (1) , Sonia Mettali Gammar (1) , Abdelkader Lahmadi (2) , Laurent Andrey (2)

1 CRISTAL - Centre de Recherche Réseau Image SysTème Architecture et MuLtimédia
2 RESIST - Resilience and Elasticity for Security and ScalabiliTy of dynamic networked systems

Nowadays, many research studies and industrial investigations have allowed the integration of the Internet of Things (IoT) in current and future networking applications by deploying a diversity of wireless-enabled devices ranging from smartphones, wearables, to sensors, drones, and connected vehicles. The growing number of IoT devices, the increasing complexity of IoT systems, and the large volume of generated data have made the monitoring and management of these networks extremely difficult. Numerous research papers have applied Reinforcement Learning (RL) and Deep Reinforcement Learning (DRL) techniques to overcome these difficulties by building IoT systems with effective and dynamic decision-making mechanisms, dealing with incomplete information related to their environments. The paper first reviews pre-existing surveys covering the application of RL and DRL techniques in IoT communication technologies and networking. The paper then analyzes the research papers that apply these techniques in wireless IoT to resolve issues related to routing, scheduling, resource allocation, dynamic spectrum access, energy, mobility, and caching. Finally, a discussion of the proposed approaches and their limits is followed by the identification of open issues to establish grounds for future research directions proposal.

Mots clés: Internet of Things; Reinforcement learning; Deep reinforcement learning; Wireless Networks

Domaines: Modélisation et simulation; Réseaux et télécommunications [cs.NI]; Intelligence artificielle [cs.AI]

Mohamed Said Frikha, Sonia Mettali Gammar, Abdelkader Lahmadi, Laurent Andrey. Reinforcement and deep reinforcement learning for wireless Internet of Things: A survey. Computer Communications, 2021, 178, pp.98-113. ⟨10.1016/j.comcom.2021.07.014⟩. ⟨hal-03409798⟩