Rethinking Bayesian learning for data analysis: The art of prior and inference in sparsity-aware modeling

L Cheng, F Yin, S Theodoridis… - IEEE Signal …, 2022 - ieeexplore.ieee.org
Sparse modeling for signal processing and machine learning, in general, has been at the
focus of scientific research for over two decades. Among others, supervised sparsity-aware …

Federated learning over wireless device-to-device networks: Algorithms and convergence analysis

H Xing, O Simeone, S Bi - IEEE Journal on Selected Areas in …, 2021 - ieeexplore.ieee.org
The proliferation of Internet-of-Things (IoT) devices and cloud-computing applications over
siloed data centers is motivating renewed interest in the collaborative training of a shared …

Nonconvex min-max optimization: Applications, challenges, and recent theoretical advances

M Razaviyayn, T Huang, S Lu… - IEEE Signal …, 2020 - ieeexplore.ieee.org
The min-max optimization problem, also known as the<; i> saddle point problem<;/i>, is a
classical optimization problem that is also studied in the context of zero-sum games. Given a …

Decentralized policy gradient descent ascent for safe multi-agent reinforcement learning

S Lu, K Zhang, T Chen, T Başar, L Horesh - Proceedings of the AAAI …, 2021 - ojs.aaai.org
This paper deals with distributed reinforcement learning problems with safety constraints. In
particular, we consider that a team of agents cooperate in a shared environment, where …

Decentralized federated learning via SGD over wireless D2D networks

H Xing, O Simeone, S Bi - 2020 IEEE 21st international …, 2020 - ieeexplore.ieee.org
Federated Learning (FL), an emerging paradigm for fast intelligent acquisition at the network
edge, enables joint training of a machine learning model over distributed data sets and …

A survey of distributed optimization methods for multi-robot systems

T Halsted, O Shorinwa, J Yu, M Schwager - arXiv preprint arXiv …, 2021 - arxiv.org
Distributed optimization consists of multiple computation nodes working together to minimize
a common objective function through local computation iterations and network-constrained …

Dinno: Distributed neural network optimization for multi-robot collaborative learning

J Yu, JA Vincent, M Schwager - IEEE Robotics and Automation …, 2022 - ieeexplore.ieee.org
We present DiNNO, a distributed algorithm that enables a group of robots to collaboratively
optimize a deep neural network model while communicating over a mesh network. Each …

Fast decentralized nonconvex finite-sum optimization with recursive variance reduction

R Xin, UA Khan, S Kar - SIAM Journal on Optimization, 2022 - SIAM
This paper considers decentralized minimization of N:=nm smooth nonconvex cost functions
equally divided over a directed network of n nodes. Specifically, we describe a stochastic …

Decentralized stochastic gradient tracking for non-convex empirical risk minimization

J Zhang, K You - arXiv preprint arXiv:1909.02712, 2019 - arxiv.org
This paper studies a decentralized stochastic gradient tracking (DSGT) algorithm for non-
convex empirical risk minimization problems over a peer-to-peer network of nodes, which is …

Federated generalized bayesian learning via distributed stein variational gradient descent

R Kassab, O Simeone - IEEE Transactions on Signal …, 2022 - ieeexplore.ieee.org
This paper introduces Distributed Stein Variational Gradient Descent (DSVGD), a non-
parametric generalized Bayesian inference framework for federated learning. DSVGD …