Whittle index policy is a heuristic to the intractable restless multi-armed bandits (RMAB)
problem. Although it is provably asymptotically optimal, finding Whittle indices remains …

We consider the online restless bandits with average-reward and multiple actions, where the
state of each arm evolves according to a Markov decision process (MDP), and the reward of …

We study adaptive video streaming for multiple users in wireless access edge networks with
unreliable channels. The key challenge is to jointly optimize the video bitrate adaptation and …

Collaborative perception systems leverage multiple edge devices, such as surveillance
cameras or autonomous cars, to enhance sensing quality and eliminate blind spots. Despite …

Restless multi-armed bandits (RMAB) have been widely used to model sequential decision
making problems with constraints. The decision maker (DM) aims to maximize the expected …

AI for social impact (AI4SI) offers significant potential for addressing complex societal
challenges in areas such as public health, agriculture, education, conservation, and public …

Restless multi-armed bandits (RMAB) has been widely used to model constrained
sequential decision making problems, where the state of each restless arm evolves …

Many crowdsourcing platforms are emerging, leveraging the resources of recruited workers
to execute various outsourcing tasks, mainly for those computing-intensive video analytics …

Caching can be leveraged to significantly improve network performance and mitigate
congestion. However, characterizing the optimal tradeoff between routing cost and cache …

We consider the problem of content caching at the wireless edge to serve a set of end users
via unreliable wireless channels so as to minimize the average latency experienced by end …