A communication-efficient decentralized newton's method with provably faster convergence

H Liu, J Zhang, AMC So, Q Ling - IEEE Transactions on Signal …, 2023 - ieeexplore.ieee.org
In this article, we consider a strongly convex finite-sum minimization problem over a
decentralized network and propose a communication-efficient decentralized Newton's …

A Newton tracking algorithm with exact linear convergence for decentralized consensus optimization

J Zhang, Q Ling, AMC So - IEEE Transactions on Signal and …, 2021 - ieeexplore.ieee.org
This paper considers the problem of decentralized consensus optimization over a network,
where each node holds a strongly convex and twice-differentiable local objective function …

DIN: A decentralized inexact Newton algorithm for consensus optimization

A Ghalkha, CB Issaid, A Elgabli… - IEEE Transactions on …, 2024 - ieeexplore.ieee.org
This paper tackles a challenging decentralized consensus optimization problem defined
over a network of interconnected devices. The devices work collaboratively to solve a …

An exact quantized decentralized gradient descent algorithm

A Reisizadeh, A Mokhtari, H Hassani… - IEEE Transactions on …, 2019 - ieeexplore.ieee.org
We consider the problem of decentralized consensus optimization, where the sum of n
smooth and strongly convex functions are minimized over n distributed agents that form a …

Communication-censored ADMM for decentralized consensus optimization

Y Liu, W Xu, G Wu, Z Tian, Q Ling - IEEE Transactions on Signal …, 2019 - ieeexplore.ieee.org
In this paper, we devise a communication-efficient decentralized algorithm, named as
communication-censored alternating direction method of multipliers (ADMM)(COCA), to …

On the convergence of nested decentralized gradient methods with multiple consensus and gradient steps

AS Berahas, R Bollapragada… - IEEE Transactions on …, 2021 - ieeexplore.ieee.org
In this paper, we consider minimizing a sum of local convex objective functions in a
distributed setting, where the cost of communication and/or computation can be expensive …

Communication Efficient Distributed Newton Method over Unreliable Networks

M Wen, C Liu, Y Xu - Proceedings of the AAAI Conference on Artificial …, 2024 - ojs.aaai.org
Distributed optimization in resource constrained devices demands both communication
efficiency and fast convergence rates. Newton-type methods are getting preferable due to …

Variance-reduced stochastic quasi-newton methods for decentralized learning

J Zhang, H Liu, AMC So, Q Ling - IEEE Transactions on Signal …, 2023 - ieeexplore.ieee.org
In this work, we investigate stochastic quasi-Newton methods for minimizing a finite sum of
cost functions over a decentralized network. We first develop a general algorithmic …

A Hessian inversion-free exact second order method for distributed consensus optimization

D Jakovetić, N Krejić, NK Jerinkić - IEEE Transactions on signal …, 2022 - ieeexplore.ieee.org
We consider a standard distributed consensus optimization problem where a set of agents
connected over an undirected network minimize the sum of their individual (local) strongly …

DINE: Decentralized Inexact Newton With Exact Linear Convergence Rate

H Ye, S He, X Chang - IEEE Transactions on Signal Processing, 2023 - ieeexplore.ieee.org
Decentralized learning has recently attracted much research attention because of its
robustness and user privacy advantages. Decentralized algorithms play central roles in …