Markovian restless bandits and index policies: A review

J Niño-Mora - Mathematics, 2023 - mdpi.com
The restless multi-armed bandit problem is a paradigmatic modeling framework for optimal
dynamic priority allocation in stochastic models of wide-ranging applications that has been …

Learning and communications co-design for remote inference systems: Feature length selection and transmission scheduling

MKC Shisher, B Ji, IH Hou, Y Sun - IEEE Journal on Selected …, 2023 - ieeexplore.ieee.org
In this paper, we consider a remote inference system, where a neural network is used to
infer a time-varying target (eg, robot movement), based on features (eg, video clips) that are …

Minimizing age of incorrect information over a channel with random delay

Y Chen, A Ephremides - IEEE/ACM Transactions on …, 2024 - ieeexplore.ieee.org
We consider a transmitter-receiver pair in a slotted-time system. The transmitter observes a
dynamic source and sends updates to a remote receiver through an error-free …

Age of incorrect information with hybrid ARQ under a resource constraint for N-ary symmetric Markov sources

K Bountrogiannis, A Ephremides, P Tsakalides… - arXiv preprint arXiv …, 2023 - arxiv.org
The Age of Incorrect Information (AoII) is a recently proposed metric for real-time remote
monitoring systems. In particular, AoII measures the time the information at the monitor is …

A game of age of incorrect information against an adversary injecting false data

V Bonagura, S Panzieri, F Pascucci… - 2023 IEEE International …, 2023 - ieeexplore.ieee.org
Remote sensing enables fast and cost-effective data collection and monitoring, but can be
subject to the injection of false data by adversaries. We consider a remote transmitter that is …

Machine learning misclassification within status update optimization

A Buratto, B Yivli, L Badia - 2023 IEEE International …, 2023 - ieeexplore.ieee.org
This paper explores the optimization of status updates in sensing systems, focusing on
misclassification in machine learning (ML) models. Previous research has primarily tackled …

Context-aware Status Updating: Wireless Scheduling for Maximizing Situational Awareness in Safety-critical Systems

TZ Ornee, MKC Shisher, C Kam… - MILCOM 2023-2023 …, 2023 - ieeexplore.ieee.org
In this study, we investigate a context-aware status updating system consisting of multiple
sensor-estimator pairs. A centralized monitor pulls status updates from multiple sensors that …

Optimization of aoii and qaoii in multi-user links

M Ayik, ET Ceran, E Uysal - IEEE INFOCOM 2023-IEEE …, 2023 - ieeexplore.ieee.org
We consider a network with multiple sources and a base station that send time-sensitive
information to remote clients. The Age of Incorrect Information (AoII) captures the freshness …

Coexistence between task-and data-oriented communications: A whittle's index guided multi-agent reinforcement learning approach

R Li, C Huang, X Qin, S Jiang, N Ma… - IEEE Internet of Things …, 2023 - ieeexplore.ieee.org
We investigate the coexistence of task-oriented and data-oriented communications in an
Internet of Things system that shares a group of channels, and study the scheduling problem …

Wireless scheduling to optimize age of information based on earliest update time

Q Liu, C Li, YT Hou, W Lou, JH Reed… - IEEE Internet of …, 2022 - ieeexplore.ieee.org
Recently, has been recognized that there is a practical limitation with the original notion of
Age of Information (AoI) metric in terms of quantifying the freshness of information content. A …