New analysis of linear convergence of gradient-type methods via unifying error bound conditions

H Zhang - Mathematical Programming, 2020 - Springer
This paper reveals that a common and central role, played in many error bound (EB)
conditions and a variety of gradient-type methods, is a residual measure operator. On one …

The condition number of a function relative to a set

DH Gutman, JF Pena - Mathematical Programming, 2021 - Springer
The condition number of a differentiable convex function, namely the ratio of its smoothness
to strong convexity constants, is closely tied to fundamental properties of the function. In …

Efficient distributed hessian free algorithm for large-scale empirical risk minimization via accumulating sample strategy

M Jahani, X He, C Ma, A Mokhtari… - International …, 2020 - proceedings.mlr.press
In this paper, we propose a Distributed Accumulated Newton Conjugate gradiEnt (DANCE)
method in which sample size is gradually increasing to quickly obtain a solution whose …

A minibatch proximal stochastic recursive gradient algorithm using a trust-region-like scheme and Barzilai–Borwein stepsizes

T Yu, XW Liu, YH Dai, J Sun - IEEE Transactions on Neural …, 2020 - ieeexplore.ieee.org
We consider the problem of minimizing the sum of an average of a large number of smooth
convex component functions and a possibly nonsmooth convex function that admits a simple …

SONIA: a symmetric blockwise truncated optimization algorithm

M Jahani, M Nazari, R Tappenden… - International …, 2021 - proceedings.mlr.press
This work presents a new optimization algorithm for empirical risk minimization. The
algorithm bridges the gap between first-and second-order methods by computing a search …

The condition of a function relative to a polytope

DH Gutman, JF Pena - arXiv preprint arXiv:1802.00271, 2018 - arxiv.org
The condition number of a smooth convex function, namely the ratio of its smoothness to
strong convexity constants, is closely tied to fundamental properties of the function. In …

[PDF][PDF] Alr Leakage Measurements of the Exterlor Walls of Tgll Bulldlngs

DM Sander, GT Tamura - aivc.org
Le present expose decrit une methode experimentale, concue dans le but de determiner les
caracteristiques de fuite d'air des murs exterieurs d'un Bdifice. Cette methode consiste B …

[PDF][PDF] Grow Your Samples and Optimize Better via Distributed Newton CG and Accumulating Strategy

M Jahani, X He, C Ma, A Mokhtari, D Mudigere… - engineering.lehigh.edu
In this work1, we propose a Distributed Accumulated Newton Conjugate gradiEnt (DANCE)
method in which sample size is gradually increasing to quickly obtain a solution whose …

[PDF][PDF] First-Order Methods in Convex Optimization: Acceleration, Conditioning, and Rescaling

D Gutman - 2019 - kilthub.cmu.edu
This thesis focuses on three themes related to the mathematical theory of first-order methods
for convex minimization: acceleration, conditioning, and rescaling. Chapters 1 and 2 explore …

[PDF][PDF] Distributed Algorithms in Large-scaled Empirical Risk Minimization: Non-convexity, Adaptive Sampling, and Matrix-free Second-order Methods

X He - 2019 - core.ac.uk
Abstract 1 1 Dual Free Adaptive Mini-batch SDCA for Empirical Risk Minimization 3 1.1
Introduction..................................... 3 1.1. 1 Contributions................................ 5 1.1. 2 …