[PDF][PDF] Adaptive subgradient methods for online learning and stochastic optimization.

J Duchi, E Hazan, Y Singer - Journal of machine learning research, 2011 - jmlr.org
We present a new family of subgradient methods that dynamically incorporate knowledge of
the geometry of the data observed in earlier iterations to perform more informative gradient …

The convexification effect of Minkowski summation

M Fradelizi, M Madiman, A Marsiglietti… - EMS Surveys in …, 2018 - ems.press
Minkowski summation is a basic and ubiquitous operation on sets. Indeed, the Minkowski
sum ACBD fa C b W a 2 A; b 2 Bg of sets A and B makes sense as long as A and B are …

The number of independent sets in a regular graph

Y Zhao - Combinatorics, Probability and Computing, 2010 - cambridge.org
We show that the number of independent sets in an N-vertex, d-regular graph is at most (2d+
1− 1) N/2d, where the bound is sharp for a disjoint union of complete d-regular bipartite …

Entropic inequalities and marginal problems

T Fritz, R Chaves - IEEE transactions on information theory, 2012 - ieeexplore.ieee.org
A marginal problem asks whether a given family of marginal distributions for some set of
random variables arises from some joint distribution of these variables. Here, we point out …

Measuring dependence with matrix-based entropy functional

S Yu, F Alesiani, X Yu, R Jenssen… - Proceedings of the AAAI …, 2021 - ojs.aaai.org
Measuring the dependence of data plays a central role in statistics and machine learning. In
this work, we summarize and generalize the main idea of existing information-theoretic …

Sumset estimates in convex geometry

M Fradelizi, M Madiman… - International Mathematics …, 2024 - academic.oup.com
Sumset estimates, which provide bounds on the cardinality of sumsets of finite sets in a
group, form an essential part of the toolkit of additive combinatorics. In recent years …

Multivariate mutual information inspired by secret-key agreement

C Chan, A Al-Bashabsheh, JB Ebrahimi… - Proceedings of the …, 2015 - ieeexplore.ieee.org
The capacity for multiterminal secret-key agreement inspires a natural generalization of
Shannon's mutual information from two random variables to multiple random variables …

On the entropy of sums

M Madiman - 2008 IEEE Information Theory Workshop, 2008 - ieeexplore.ieee.org
It is shown that the entropy of a sum of independent random vectors is a submodular set
function, and upper bounds on the entropy of sums are obtained as a result in both discrete …

Three tutorial lectures on entropy and counting

D Galvin - arXiv preprint arXiv:1406.7872, 2014 - arxiv.org
Three tutorial lectures on entropy and counting arXiv:1406.7872v1 [math.CO] 30 Jun 2014
Page 1 Three tutorial lectures on entropy and counting 1 David Galvin2 1st Lake Michigan …

On the volume of the Minkowski sum of zonoids

M Fradelizi, M Madiman, M Meyer, A Zvavitch - Journal of Functional …, 2024 - Elsevier
We explore some inequalities in convex geometry restricted to the class of zonoids. We
show the equivalence, in the class of zonoids, between a local Alexandrov-Fenchel …