Optimization algorithms for multi-species spherical spin glasses

B Huang, M Sellke - Journal of Statistical Physics, 2024 - Springer
This paper develops approximate message passing algorithms to optimize multi-species
spherical spin glasses. We first show how to efficiently achieve the algorithmic threshold …

Nonconvex interactions in mean-field spin glasses

JC Mourrat - Probability and Mathematical Physics, 2021 - msp.org
We propose a conjecture for the limit free energy of mean-field spin glasses with a bipartite
structure, and show that the conjectured limit is an upper bound. The conjectured limit is …

Dense Hebbian neural networks: a replica symmetric picture of supervised learning

E Agliari, L Albanese, F Alemanno… - Physica A: Statistical …, 2023 - Elsevier
We consider dense, associative neural-networks trained by a teacher (ie, with supervision)
and we investigate their computational capabilities analytically, via statistical-mechanics …

Free energy in multi-species mixed p-spin spherical models

E Bates, Y Sohn - Electronic Journal of Probability, 2022 - projecteuclid.org
We prove a Parisi formula for the limiting free energy of multi-species spherical spin glasses
with mixed p-spin interactions. The upper bound involves a Guerra-style interpolation and …

Exponential growth of random determinants beyond invariance

G Ben Arous, P Bourgade, B McKenna - Probability and Mathematical …, 2023 - msp.org
We give simple criteria to identify the exponential order of magnitude of the absolute value of
the determinant for wide classes of random matrix models, not requiring the assumption of …

The solution of the deep Boltzmann machine on the Nishimori line

D Alberici, F Camilli, P Contucci, E Mingione - … in Mathematical Physics, 2021 - Springer
The deep Boltzmann machine on the Nishimori line with a finite number of layers is exactly
solved by a theorem that expresses its pressure through a finite dimensional variational …

Complexity of bipartite spherical spin glasses

B McKenna - Annales de l'Institut Henri Poincare (B) Probabilites …, 2024 - projecteuclid.org
This paper characterizes the annealed complexity of bipartite spherical spin glasses, both
pure and mixed. This means we give exact variational formulas for the asymptotics of the …

TAP approach for multispecies spherical spin glasses II: The free energy of the pure models

E Subag - The Annals of Probability, 2023 - projecteuclid.org
In a companion paper we developed the generalized TAP approach for general
multispecies spherical mixed p-spin models. In this paper we use it to compute the limit of …

Phase diagram of restricted Boltzmann machines and generalized Hopfield networks with arbitrary priors

A Barra, G Genovese, P Sollich, D Tantari - Physical Review E, 2018 - APS
Restricted Boltzmann machines are described by the Gibbs measure of a bipartite spin
glass, which in turn can be seen as a generalized Hopfield network. This equivalence allows …

Concentration of the complexity of spherical pure p-spin models at arbitrary energies

E Subag, O Zeitouni - Journal of mathematical physics, 2021 - pubs.aip.org
We consider critical points of the spherical pure p-spin spin glass model with Hamiltonian
HN σ= 1 N p− 1/2∑ i 1,…, ip= 1 NJ i 1,…, ip σ i 1… σ ip⁠, where σ= σ 1,…, σ N∈ SN− 1≔ …