On adaptive stochastic heavy ball momentum for solving linear systems

Y Zeng, D Han, Y Su, J Xie - SIAM Journal on Matrix Analysis and Applications, 2024 - SIAM
The stochastic heavy ball momentum (SHBM) method has gained considerable popularity
as a scalable approach for solving large-scale optimization problems. However, one …

Randomized Douglas–Rachford Methods for Linear Systems: Improved Accuracy and Efficiency

D Han, Y Su, J Xie - SIAM Journal on Optimization, 2024 - SIAM
The Douglas–Rachford (DR) method is a widely used method for finding a point in the
intersection of two closed convex sets (feasibility problem). However, the method converges …

Randomized iterative methods for generalized absolute value equations: Solvability and error bounds

J Xie, H Qi, D Han - arXiv preprint arXiv:2405.04091, 2024 - arxiv.org
Randomized iterative methods, such as the Kaczmarz method and its variants, have gained
growing attention due to their simplicity and efficiency in solving large-scale linear systems …

Randomized Kaczmarz method with adaptive stepsizes for inconsistent linear systems

Y Zeng, D Han, Y Su, J Xie - Numerical Algorithms, 2023 - Springer
We investigate the randomized Kaczmarz method that adaptively updates the stepsize using
readily available information for solving inconsistent linear systems. A novel geometric …

Fast stochastic dual coordinate descent algorithms for linearly constrained convex optimization

Y Zeng, D Han, Y Su, J Xie - arXiv preprint arXiv:2307.16702, 2023 - arxiv.org
The problem of finding a solution to the linear system $ Ax= b $ with certain minimization
properties arises in numerous scientific and engineering areas. In the era of big data, the …

The linear convergence of the greedy randomized Kaczmarz method is deterministic

Y Su, D Han, Y Zeng, J Xie - arXiv preprint arXiv:2307.01988, 2023 - arxiv.org
To improve the convergence property of the randomized Kaczmarz (RK) method for solving
linear systems, Bai and Wu (SIAM J. Sci. Comput., 40 (1): A592--A606, 2018) originally …

On the adaptive deterministic block Kaczmarz method with momentum for solving large-scale consistent linear systems

L Tan, X Guo, M Deng, J Chen - Journal of Computational and Applied …, 2025 - Elsevier
The Kaczmarz method is a traditional and widely used iterative algorithm for solving large-
scale consistent linear systems, while its improved block Kaczmarz-type methods have …

On adaptive stochastic extended iterative methods for solving least squares

Y Zeng, D Han, Y Su, J Xie - arXiv preprint arXiv:2405.19044, 2024 - arxiv.org
In this paper, we propose a novel adaptive stochastic extended iterative method, which can
be viewed as an improved extension of the randomized extended Kaczmarz (REK) method …

A simple linear convergence analysis of the reshuffling Kaczmarz method

D Han, J Xie - arXiv preprint arXiv:2410.01140, 2024 - arxiv.org
The Kaczmarz method and its variants, which are types of stochastic gradient descent (SGD)
methods, have been extensively studied for their simplicity and efficiency in solving linear …

On the adaptive deterministic block coordinate descent methods with momentum for solving large linear least-squares problems

LZ Tan, MY Deng, JL Qiu, XP Guo - arXiv preprint arXiv:2410.20108, 2024 - arxiv.org
In this work, we first present an adaptive deterministic block coordinate descent method with
momentum (mADBCD) to solve the linear least-squares problem, which is based on …