Job dispatching policies for queueing systems with unknown service rates

T Choudhury, G Joshi, W Wang… - Proceedings of the Twenty …, 2021 - dl.acm.org
In multi-server queueing systems where there is no central queue holding all incoming jobs,
job dispatching policies are used to assign incoming jobs to the queue at one of the servers …

Stability enforced bandit algorithms for channel selection in remote state estimation of Gauss-Markov processes

AS Leong, DE Quevedo, W Liu - IEEE Transactions on …, 2023 - ieeexplore.ieee.org
In this article, we consider the problem of remote state estimation of a Gauss–Markov
process, where a sensor can, at each discrete time instant, transmit on one out of M different …

Efficient learning-based scheduling for information freshness in wireless networks

B Li - IEEE INFOCOM 2021-IEEE Conference on Computer …, 2021 - ieeexplore.ieee.org
Motivated by the recent trend of integrating artificial intelligence into the Internet-of-Things
(IoT), we consider the problem of scheduling packets from multiple sensing sources to a …

Achieving Regular and Fair Learning in Combinatorial Multi-Armed Bandit

X Wu, B Li - IEEE INFOCOM 2024-IEEE Conference on …, 2024 - ieeexplore.ieee.org
Combinatorial multi-armed bandit refers to the model that aims to maximize cumulative
rewards in the presence of uncertainty. Motivated by two important wireless network …

Aging bandits: Regret analysis and order-optimal learning algorithm for wireless networks with stochastic arrivals

EU Atay, I Kadota, E Modiano - arXiv preprint arXiv:2012.08682, 2020 - arxiv.org
We consider a single-hop wireless network with sources transmitting time-sensitive
information to the destination over multiple unreliable channels. Packets from each source …

Distribution-oblivious online algorithms for age-of-information penalty minimization

CH Tsai, CC Wang - IEEE/ACM Transactions on Networking, 2023 - ieeexplore.ieee.org
The ever-increasing needs of supporting real-time applications have spurred new studies on
minimizing Age-of-Information (AoI), a novel metric characterizing the data freshness of the …

Thompson sampling for networked control over unknown channels

W Liu, AS Leong, DE Quevedo - Automatica, 2024 - Elsevier
We consider a networked control system where information is transmitted over lossy
communication channels on both the uplink (sensor to controller) and downlink (controller to …

Regret of Age-of-Information Bandits in Nonstationary Wireless Networks

Z Song, T Yang, X Wu, H Feng… - IEEE Wireless …, 2022 - ieeexplore.ieee.org
We consider a wireless network with a source periodically generating time-sensitive
information and transmitting it to a destination via one of non-stationary orthogonal wireless …

Aging wireless bandits: Regret analysis and order-optimal learning algorithm

EU Atay, I Kadota, E Modiano - … in Mobile, Ad hoc, and Wireless …, 2021 - ieeexplore.ieee.org
We consider a single-hop wireless network with sources transmitting time-sensitive
information to the destination over multiple unreliable channels. Packets from each source …

Adaptive Sampling for Age of Information in Non-Stationary Network Traffic

Y Gu, Z Quan - IEEE Transactions on Mobile Computing, 2024 - ieeexplore.ieee.org
Real-time status updates play an important role in low-latency cyber-physical systems, in
which the real network traffic statistics (ie, transmission delay and/or error rate) are often …