Whittle index policy for dynamic multichannel allocation in remote state estimation

J Wang, X Ren, Y Mo, L Shi - IEEE Transactions on Automatic …, 2019 - ieeexplore.ieee.org
In this paper, we consider dynamic channel allocation for remote state estimation of
multiagent systems. For each subsystem, a sensor measures its state and transmits the data …

Stability enforced bandit algorithms for channel selection in remote state estimation of Gauss-Markov processes

AS Leong, DE Quevedo, W Liu - IEEE Transactions on …, 2023 - ieeexplore.ieee.org
In this article, we consider the problem of remote state estimation of a Gauss–Markov
process, where a sensor can, at each discrete time instant, transmit on one out of M different …

Attack allocation on remote state estimation in multi-systems: Structural results and asymptotic solution

X Ren, J Wu, S Dey, L Shi - Automatica, 2018 - Elsevier
This paper considers optimal attack attention allocation on remote state estimation in multi-
systems. Suppose there are M independent systems, each of which has a remote sensor …

Multi-channel transmission scheduling with hopping scheme under uncertain channel states

Y Song, D Ye - Journal of the Franklin Institute, 2023 - Elsevier
This paper investigates the multi-channel transmission scheduling problem for remote state
estimation based on a hopping scheme in cyber-physical systems. The smart sensor sends …

Multiagent online source seeking using bandit algorithm

B Du, K Qian, C Claudel, D Sun - IEEE Transactions on …, 2022 - ieeexplore.ieee.org
This article presents a learning-based algorithm for solving the online source-seeking
problem with a multiagent system under an unknown dynamical environment. Our algorithm …

A Whittle index policy for the remote estimation of multiple continuous Gauss-Markov processes over parallel channels

TZ Ornee, Y Sun - Proceedings of the Twenty-fourth International …, 2023 - dl.acm.org
In this paper, we study a sampling and transmission scheduling problem for multi-source
remote estimation, where a scheduler determines when to take samples from multiple …

A dynamic observation strategy for multi-agent multi-armed bandit problem

U Madhushani, NE Leonard - 2020 European control …, 2020 - ieeexplore.ieee.org
We define and analyze a multi-agent multi-armed bandit problem in which decision-making
agents can observe the choices and rewards of their neighbors under a linear observation …

Indexability of restless bandit problems and optimality of whittle index for dynamic multichannel access

K Liu, Q Zhao - IEEE Transactions on Information Theory, 2010 - ieeexplore.ieee.org
In this paper, we consider a class of restless multiarmed bandit processes (RMABs) that
arises in dynamic multichannel access, user/server scheduling, and optimal activation in …

Remote estimation over a packet-drop channel with Markovian state

J Chakravorty, A Mahajan - IEEE Transactions on Automatic …, 2019 - ieeexplore.ieee.org
We investigate a remote estimation problem in which a transmitter observes a Markov
source and chooses the power level to transmit it over a time-varying packet-drop channel …

Remote Estimation of Markov Processes over Costly Channels: On the Benefits of Implicit Information

ED Santi, T Soleymani, D Gunduz - arXiv preprint arXiv:2401.17999, 2024 - arxiv.org
In this paper, we study the remote estimation problem of a Markov process over a channel
with a cost. We formulate this problem as an infinite horizon optimization problem with two …