The theory behind overfitting, cross validation, regularization, bagging, and boosting: tutorial

B Ghojogh, M Crowley - arXiv preprint arXiv:1905.12787, 2019 - arxiv.org
In this tutorial paper, we first define mean squared error, variance, covariance, and bias of
both random variables and classification/predictor models. Then, we formulate the true and …

Generative adversarial networks and adversarial autoencoders: Tutorial and survey

B Ghojogh, A Ghodsi, F Karray, M Crowley - arXiv preprint arXiv …, 2021 - arxiv.org
This is a tutorial and survey paper on Generative Adversarial Network (GAN), adversarial
autoencoders, and their variants. We start with explaining adversarial learning and the …

[图书][B] Elements of dimensionality reduction and manifold learning

B Ghojogh, M Crowley, F Karray, A Ghodsi - 2023 - Springer
Dimensionality reduction, also known as manifold learning, is an area of machine learning
used for extracting informative features from data for better representation of data or …

Factor analysis, probabilistic principal component analysis, variational inference, and variational autoencoder: Tutorial and survey

B Ghojogh, A Ghodsi, F Karray, M Crowley - arXiv preprint arXiv …, 2021 - arxiv.org
This is a tutorial and survey paper on factor analysis, probabilistic Principal Component
Analysis (PCA), variational inference, and Variational Autoencoder (VAE). These methods …

Restricted boltzmann machine and deep belief network: Tutorial and survey

B Ghojogh, A Ghodsi, F Karray, M Crowley - arXiv preprint arXiv …, 2021 - arxiv.org
This is a tutorial and survey paper on Boltzmann Machine (BM), Restricted Boltzmann
Machine (RBM), and Deep Belief Network (DBN). We start with the required background on …

Data representativity for machine learning and AI systems

LH Clemmensen, RD Kjærsgaard - arXiv preprint arXiv:2203.04706, 2022 - arxiv.org
Data representativity is crucial when drawing inference from data through machine learning
models. Scholars have increased focus on unraveling the bias and fairness in models, also …

Spectral, probabilistic, and deep metric learning: Tutorial and survey

B Ghojogh, A Ghodsi, F Karray, M Crowley - arXiv preprint arXiv …, 2022 - arxiv.org
This is a tutorial and survey paper on metric learning. Algorithms are divided into spectral,
probabilistic, and deep metric learning. We first start with the definition of distance metric …

Probabilistic design of optimal sequential decision-making algorithms in learning and control

É Garrabé, G Russo - Annual Reviews in Control, 2022 - Elsevier
This survey is focused on certain sequential decision-making problems that involve
optimizing over probability functions. We discuss the relevance of these problems for …

A two-stage Bayesian learning-based probabilistic fuzzy interpreter for uncertainty modeling

XB Meng, HX Li, CLP Chen - Applied Soft Computing, 2022 - Elsevier
In practical applications, there are usually complex stochastic and vague uncertainties
caused by inherent randomness and unknown dynamics. How to model uncertainty and …

Deep metric learning

B Ghojogh, M Crowley, F Karray, A Ghodsi - Elements of Dimensionality …, 2023 - Springer
It was mentioned in Chap. 11 that metric learning can be divided into spectral, probabilistic,
and deep metric learning. Chapters 11 and 13 explained that both spectral and probabilistic …