The growing network density and unprecedented increase in network traffic, caused by the
massively expanding number of connected devices and online services, require intelligent …

Abstract The 3rd Generation Partnership Project (3GPP) has specified the 5G Authentication
and Key Agreement (5G AKA) protocol for handover authentication. However, this protocol is …

A novel reinforcement learning algorithm is introduced for multiarmed restless bandits with
average reward, using the paradigms of Q-learning and Whittle index. Specifically, we …

The exponential growth of data traffic from mobile devices leads to a need of heterogeneous
networks (HetNets) which integrate multiple radio access technologies (multi-RATs) to …

To overcome the curses of dimensionality and modeling of dynamic programming methods
to solve Markov decision process problems, reinforcement learning (RL) methods are …

Integrating LTE sub-6 GHz and millimeter wave (mmWave) bands brings great benefit in
increasing communication bandwidth, reliability, and better coverage of future smart …

In today's wireless networks, a variety of Radio Access Technologies (RATs) are present.
However, each RAT being controlled individually leads to suboptimal utilization of network …

We propose a method to first identify users who have the most negative impact on the
overall network performance, and then offload them to an orthogonal channel. The feasibility …

We revisit the Whittle index policy for scheduling web crawlers for ephemeral content
proposed in Avrachenkov and Borkar, IEEE Trans. Control of Network Systems 5 (1), 2016 …

Heterogeneous wireless networks (HWNs) are capable of integrating the different radio
access technologies that make it possible to connect mobile users based on the …