Adaptation, learning, and optimization over networks

AH Sayed - Foundations and Trends® in Machine Learning, 2014 - nowpublishers.com
This work deals with the topic of information processing over graphs. The presentation is
largely self-contained and covers results that relate to the analysis and design of multi-agent …

Diffusion strategies for adaptation and learning over networks: an examination of distributed strategies and network behavior

AH Sayed, SY Tu, J Chen, X Zhao… - IEEE Signal Processing …, 2013 - ieeexplore.ieee.org
Nature provides splendid examples of real-time learning and adaptation behavior that
emerges from highly localized interactions among agents of limited capabilities. For …

Diffusion adaptation over networks

AH Sayed - Academic Press Library in Signal Processing, 2014 - Elsevier
Adaptive networks are well-suited to perform decentralized information processing and
optimization tasks and to model various types of self-organized and complex behavior …

Heterogeneous and multitask wireless sensor networks—Algorithms, applications, and challenges

J Plata-Chaves, A Bertrand, M Moonen… - IEEE Journal of …, 2017 - ieeexplore.ieee.org
Unlike traditional homogeneous single-task wireless sensor networks (WSNs),
heterogeneous and multitask WSNs allow the cooperation among multiple heterogeneous …

Adaptive penalty-based distributed stochastic convex optimization

ZJ Towfic, AH Sayed - IEEE Transactions on Signal Processing, 2014 - ieeexplore.ieee.org
In this work, we study the task of distributed optimization over a network of learners in which
each learner possesses a convex cost function, a set of affine equality constraints, and a set …

Diffusion LMS with communication delays: Stability and performance analysis

F Hua, R Nassif, C Richard, H Wang… - IEEE Signal …, 2020 - ieeexplore.ieee.org
We study the problem of distributed estimation over adaptive networks where
communication delays exist between nodes. In particular, we investigate the diffusion Least …

Diffusion moving-average adaptation over networks

Y Peng, S Zhang, Z Zhou, H Chen… - IEEE Transactions on …, 2024 - ieeexplore.ieee.org
Recently, the diffusion moving-average (D-MA) scheme has been proposed as a way to
combat noisy links over adaptive networks. However, the current theoretical results focus on …

Frequency-domain diffusion adaptation over networks

S Zhang, F Zhang, H Chen, R Merched… - IEEE Transactions on …, 2021 - ieeexplore.ieee.org
This paper analyzes the implementation of least-mean-squares (LMS)-based, adaptive
diffusion algorithms over networks in the frequency-domain (FD). We focus on a scenario of …

Sparse Diffusion Least Mean-Square Algorithm with Hard Thresholding over Networks

HS Lee, C Jin, C Shin, SE Kim - Mathematics, 2023 - mdpi.com
This paper proposes a distributed estimation technique utilizing the diffusion least mean-
square (LMS) algorithm, specifically designed for sparse systems in which many coefficients …

Diffusion LMS with correlated regressors I: Realization-wise stability

MJ Piggott, V Solo - IEEE Transactions on Signal Processing, 2016 - ieeexplore.ieee.org
There has been considerable development of distributed adaptive algorithms in recent years
with diffusion algorithms offering very attractive features, but their performance analysis has …