Theory of overparametrization in quantum neural networks

M Larocca, N Ju, D García-Martín, PJ Coles… - Nature Computational …, 2023 - nature.com
The prospect of achieving quantum advantage with quantum neural networks (QNNs) is
exciting. Understanding how QNN properties (for example, the number of parameters M) …

[HTML][HTML] Theoretical guarantees for permutation-equivariant quantum neural networks

L Schatzki, M Larocca, QT Nguyen, F Sauvage… - npj Quantum …, 2024 - nature.com
Despite the great promise of quantum machine learning models, there are several
challenges one must overcome before unlocking their full potential. For instance, models …

The lazy neuron phenomenon: On emergence of activation sparsity in transformers

Z Li, C You, S Bhojanapalli, D Li, AS Rawat… - arXiv preprint arXiv …, 2022 - arxiv.org
This paper studies the curious phenomenon for machine learning models with Transformer
architectures that their activation maps are sparse. By activation map we refer to the …

Sequence-to-sequence learning with latent neural grammars

Y Kim - Advances in Neural Information Processing …, 2021 - proceedings.neurips.cc
Sequence-to-sequence learning with neural networks has become the de facto standard for
sequence modeling. This approach typically models the local distribution over the next …

Lie-algebraic classical simulations for variational quantum computing

ML Goh, M Larocca, L Cincio, M Cerezo… - arXiv preprint arXiv …, 2023 - arxiv.org
Classical simulation of quantum dynamics plays an important role in our understanding of
quantum complexity, and in the development of quantum technologies. Compared to other …

Evaluation of colorectal cancer subtypes and cell lines using deep learning

J Ronen, S Hayat, A Akalin - Life science alliance, 2019 - life-science-alliance.org
Colorectal cancer (CRC) is a common cancer with a high mortality rate and a rising
incidence rate in the developed world. Molecular profiling techniques have been used to …

Control prefixes for parameter-efficient text generation

J Clive, K Cao, M Rei - arXiv preprint arXiv:2110.08329, 2021 - arxiv.org
Prefix-tuning is a powerful lightweight technique for adapting a large pre-trained language
model to a downstream application. However, it uses the same dataset-level tuned prompt …

Effects of noise on the overparametrization of quantum neural networks

D García-Martín, M Larocca, M Cerezo - Physical Review Research, 2024 - APS
Overparametrization is one of the most surprising and notorious phenomena in machine
learning. Recently, there have been several efforts to study if, and how, quantum neural …

PCFGs can do better: Inducing probabilistic context-free grammars with many symbols

S Yang, Y Zhao, K Tu - arXiv preprint arXiv:2104.13727, 2021 - arxiv.org
Probabilistic context-free grammars (PCFGs) with neural parameterization have been shown
to be effective in unsupervised phrase-structure grammar induction. However, due to the …

Multi-prototypes convex merging based k-means clustering algorithm

D Li, S Zhou, T Zeng, RH Chan - IEEE Transactions on …, 2023 - ieeexplore.ieee.org
K-Means algorithm is a popular clustering method. However, it has two limitations: 1) it gets
stuck easily in spurious local minima, and 2) the number of clusters has to be given a priori …