Learning gaussian mixtures with generalized linear models: Precise asymptotics in high-dimensions

B Loureiro, G Sicuro, C Gerbelot… - Advances in …, 2021 - proceedings.neurips.cc
Generalised linear models for multi-class classification problems are one of the fundamental
building blocks of modern machine learning tasks. In this manuscript, we characterise the …

On the precise error analysis of support vector machines

A Kammoun, MS AlouiniFellow - IEEE Open Journal of Signal …, 2021 - ieeexplore.ieee.org
This paper investigates the asymptotic behavior of the soft-margin and hard-margin support
vector machine (SVM) classifiers for simultaneously high-dimensional and numerous data …

Quantum kernels for real-world predictions based on electronic health records

Z Krunic, FF Flöther, G Seegan… - IEEE Transactions …, 2022 - ieeexplore.ieee.org
Research on near-term quantum machine learning has explored how classical machine
learning algorithms endowed with access to quantum kernels (similarity measures) can …

On the inherent regularization effects of noise injection during training

O Dhifallah, Y Lu - International Conference on Machine …, 2021 - proceedings.mlr.press
Randomly perturbing networks during the training process is a commonly used approach to
improving generalization performance. In this paper, we present a theoretical study of one …

Gaussian universality of perceptrons with random labels

F Gerace, F Krzakala, B Loureiro, L Stephan… - Physical Review E, 2024 - APS
While classical in many theoretical settings—and in particular in statistical physics-inspired
works—the assumption of Gaussian iid input data is often perceived as a strong limitation in …

Mitigating Group Bias in Federated Learning for Heterogeneous Devices

K Selialia, Y Chandio, FM Anwar - The 2024 ACM Conference on …, 2024 - dl.acm.org
Federated learning is emerging as a privacy-preserving model training approach in
distributed edge applications. As such, most edge deployments are heterogeneous in …

Gaussian universality of perceptrons with random labels

F Gerace, F Krzakala, B Loureiro, L Stephan… - arXiv preprint arXiv …, 2022 - arxiv.org
While classical in many theoretical settings-and in particular in statistical physics-inspired
works-the assumption of Gaussian iid input data is often perceived as a strong limitation in …

Large scale analysis of generalization error in learning using margin based classification methods

H Huang, Q Yang - Journal of Statistical Mechanics: Theory and …, 2020 - iopscience.iop.org
Large-margin classifiers are popular methods for classification. We derive the asymptotic
expression for the generalization error of a family of large-margin classifiers in the limit of …

Fast support vector classifier with generalization-memorization kernel

G Wen-wen, Y Lv, Y Jia-yu, Z Wang… - Procedia Computer …, 2022 - Elsevier
Abstract Recently, Vladimir Vapnik et al. proposed a generalization-memorization kernel for
SVC, which significantly improves the memorization and generalization performance of …

Large dimensional analysis of general margin based classification methods

H Huang, Q Yang - Journal of Statistical Mechanics: Theory and …, 2021 - iopscience.iop.org
Margin-based classifiers have been popular in both machine learning and statistics for
classification problems. Since a large number of classifiers are available, one natural …