Finite-time analysis of on-policy heterogeneous federated reinforcement learning

C Zhang, H Wang, A Mitra, J Anderson - arXiv preprint arXiv:2401.15273, 2024 - arxiv.org
Federated reinforcement learning (FRL) has emerged as a promising paradigm for reducing
the sample complexity of reinforcement learning tasks by exploiting information from …

Asynchronous federated reinforcement learning with policy gradient updates: Algorithm design and convergence analysis

G Lan, DJ Han, A Hashemi, V Aggarwal… - arXiv preprint arXiv …, 2024 - arxiv.org
To improve the efficiency of reinforcement learning, we propose a novel asynchronous
federated reinforcement learning framework termed AFedPG, which constructs a global …

Federated offline reinforcement learning: Collaborative single-policy coverage suffices

J Woo, L Shi, G Joshi, Y Chi - arXiv preprint arXiv:2402.05876, 2024 - arxiv.org
Offline reinforcement learning (RL), which seeks to learn an optimal policy using offline data,
has garnered significant interest due to its potential in critical applications where online data …

Fedhql: Federated heterogeneous q-learning

FX Fan, Y Ma, Z Dai, C Tan, BKH Low… - arXiv preprint arXiv …, 2023 - arxiv.org
Federated Reinforcement Learning (FedRL) encourages distributed agents to learn
collectively from each other's experience to improve their performance without exchanging …

Federated temporal difference learning with linear function approximation under environmental heterogeneity

H Wang, A Mitra, H Hassani, GJ Pappas… - arXiv preprint arXiv …, 2023 - arxiv.org
We initiate the study of federated reinforcement learning under environmental heterogeneity
by considering a policy evaluation problem. Our setup involves $ N $ agents interacting with …

[PDF][PDF] Federated natural policy gradient methods for multi-task reinforcement learning

T Yang, S Cen, Y Wei, Y Chen… - arXiv preprint arXiv …, 2023 - yuxinchen2020.github.io
Federated reinforcement learning (RL) enables collaborative decision making of multiple
distributed agents without sharing local data trajectories. In this work, we consider a multi …

Compressed Federated Reinforcement Learning with a Generative Model

A Beikmohammadi, S Khirirat, S Magnússon - arXiv preprint arXiv …, 2024 - arxiv.org
Reinforcement learning has recently gained unprecedented popularity, yet it still grapples
with sample inefficiency. Addressing this challenge, federated reinforcement learning …

Fault-tolerant federated reinforcement learning with theoretical guarantee

X Fan, Y Ma, Z Dai, W Jing, C Tan… - Advances in Neural …, 2021 - proceedings.neurips.cc
The growing literature of Federated Learning (FL) has recently inspired Federated
Reinforcement Learning (FRL) to encourage multiple agents to federatively build a better …

Dimension-free rates for natural policy gradient in multi-agent reinforcement learning

C Alfano, P Rebeschini - arXiv preprint arXiv:2109.11692, 2021 - arxiv.org
Cooperative multi-agent reinforcement learning is a decentralized paradigm in sequential
decision making where agents distributed over a network iteratively collaborate with …

Improved communication efficiency in federated natural policy gradient via admm-based gradient updates

G Lan, H Wang, J Anderson, C Brinton… - arXiv preprint arXiv …, 2023 - arxiv.org
Federated reinforcement learning (FedRL) enables agents to collaboratively train a global
policy without sharing their individual data. However, high communication overhead …