A comprehensive survey on regularization strategies in machine learning

Y Tian, Y Zhang - Information Fusion, 2022 - Elsevier
In machine learning, the model is not as complicated as possible. Good generalization
ability means that the model not only performs well on the training data set, but also can …

Recent advances in stochastic gradient descent in deep learning

Y Tian, Y Zhang, H Zhang - Mathematics, 2023 - mdpi.com
In the age of artificial intelligence, the best approach to handling huge amounts of data is a
tremendously motivating and hard problem. Among machine learning models, stochastic …

Best subset selection via a modern optimization lens

D Bertsimas, A King, R Mazumder - 2016 - projecteuclid.org
Best subset selection via a modern optimization lens Page 1 The Annals of Statistics 2016, Vol.
44, No. 2, 813–852 DOI: 10.1214/15-AOS1388 © Institute of Mathematical Statistics, 2016 …

Infrared Small Target Detection via Non-Convex Rank Approximation Minimization Joint l2,1 Norm

L Zhang, L Peng, T Zhang, S Cao, Z Peng - Remote Sensing, 2018 - mdpi.com
To improve the detection ability of infrared small targets in complex backgrounds, a novel
method based on non-convex rank approximation minimization joint l 2, 1 norm (NRAM) was …

Accelerated proximal gradient methods for nonconvex programming

H Li, Z Lin - Advances in neural information processing …, 2015 - proceedings.neurips.cc
Nonconvex and nonsmooth problems have recently received considerable attention in
signal/image processing, statistics and machine learning. However, solving the nonconvex …

An iterative threshold algorithm of log-sum regularization for sparse problem

X Zhou, X Liu, G Zhang, L Jia, X Wang… - IEEE Transactions on …, 2023 - ieeexplore.ieee.org
The log-sum function as a penalty has always been drawing widespread attention in the
field of sparse problems. However, it brings a non-convex, non-smooth and non-Lipschitz …

[图书][B] MM optimization algorithms

K Lange - 2016 - SIAM
Algorithms have never been more important. As the recipes of computer programs,
algorithms rule our lives. Although they can be forces for both good and evil, this is not a …

Enhancing one-class support vector machines for unsupervised anomaly detection

M Amer, M Goldstein, S Abdennadher - Proceedings of the ACM …, 2013 - dl.acm.org
Support Vector Machines (SVMs) have been one of the most successful machine learning
techniques for the past decade. For anomaly detection, also a semi-supervised variant, the …

[图书][B] Statistical foundations of data science

J Fan, R Li, CH Zhang, H Zou - 2020 - taylorfrancis.com
Statistical Foundations of Data Science gives a thorough introduction to commonly used
statistical models, contemporary statistical machine learning techniques and algorithms …

Nonconvex nonsmooth low rank minimization via iteratively reweighted nuclear norm

C Lu, J Tang, S Yan, Z Lin - IEEE Transactions on Image …, 2015 - ieeexplore.ieee.org
The nuclear norm is widely used as a convex surrogate of the rank function in compressive
sensing for low rank matrix recovery with its applications in image recovery and signal …