Complete dictionary recovery over the sphere I: Overview and the geometric picture

J Sun, Q Qu, J Wright - IEEE Transactions on Information …, 2016 - ieeexplore.ieee.org
We consider the problem of recovering a complete (ie, square and invertible) matrix A 0,
from Y∈ R n× p with Y= A 0 X 0, provided X 0 is sufficiently sparse. This recovery problem is …

A statistical perspective on algorithmic leveraging

P Ma, M Mahoney, B Yu - International conference on …, 2014 - proceedings.mlr.press
One popular method for dealing with large-scale data sets is sampling. Using the empirical
statistical leverage scores as an importance sampling distribution, the method of algorithmic …

Sparse modeling for image and vision processing

J Mairal, F Bach, J Ponce - Foundations and Trends® in …, 2014 - nowpublishers.com
In recent years, a large amount of multi-disciplinary research has been conducted on sparse
models and their applications. In statistics and machine learning, the sparsity principle is …

Generalization error in deep learning

D Jakubovitz, R Giryes, MRD Rodrigues - Compressed Sensing and Its …, 2019 - Springer
Deep learning models have lately shown great performance in various fields such as
computer vision, speech recognition, speech translation, and natural language processing …

Phase transitions and sample complexity in Bayes-optimal matrix factorization

Y Kabashima, F Krzakala, M Mézard… - … on information theory, 2016 - ieeexplore.ieee.org
We analyze the matrix factorization problem. Given a noisy measurement of a product of two
matrices, the problem is to estimate back the original matrices. It arises in many applications …

Sparse and spurious: dictionary learning with noise and outliers

R Gribonval, R Jenatton, F Bach - IEEE Transactions on …, 2015 - ieeexplore.ieee.org
A popular approach within the signal processing and machine learning communities
consists in modeling signals as sparse linear combinations of atoms selected from a learned …

Complete dictionary recovery over the sphere

J Sun, Q Qu, J Wright - 2015 International Conference on …, 2015 - ieeexplore.ieee.org
We consider the problem of recovering a complete (ie, square and invertible) dictionary A 0,
from Y= A 0 X 0 with Y ϵ R n× p. This recovery setting is central to the theoretical …

Global Identifiability of -based Dictionary Learning via Matrix Volume Optimization

J Hu, K Huang - Advances in Neural Information Processing …, 2023 - proceedings.neurips.cc
We propose a novel formulation for dictionary learning that minimizes the determinant of the
dictionary matrix, also known as its volume, subject to the constraint that each row of the …

Using task descriptions in lifelong machine learning for improved performance and zero-shot transfer

M Rostami, D Isele, E Eaton - Journal of Artificial Intelligence Research, 2020 - jair.org
Abstract Knowledge transfer between tasks can improve the performance of learned models,
but requires an accurate estimate of inter-task relationships to identify the relevant …

Large-cone nonnegative matrix factorization

T Liu, M Gong, D Tao - IEEE transactions on neural networks …, 2016 - ieeexplore.ieee.org
Nonnegative matrix factorization (NMF) has been greatly popularized by its parts-based
interpretation and the effective multiplicative updating rule for searching local solutions. In …