Some notes concerning a generalized KMM-type optimization method for density ratio estimation

CD Alecsa - arXiv preprint arXiv:2309.07887, 2023 - arxiv.org
In the present paper we introduce new optimization algorithms for the task of density ratio
estimation. More precisely, we consider extending the well-known KMM method using the …

Condition number analysis of kernel-based density ratio estimation

T Kanamori, T Suzuki, M Sugiyama - arXiv preprint arXiv:0912.2800, 2009 - arxiv.org
The ratio of two probability densities can be used for solving various machine learning tasks
such as covariate shift adaptation (importance sampling), outlier detection (likelihood-ratio …

On the improvement of density ratio estimation via probabilistic classifier: theoretical study and its applications

J Yin - 2023 - open.library.ubc.ca
Density ratio estimation has a broad application in the world of machine learning and data
science, especially in transfer learning and contrastive learning. This work mainly focuses …

Optimal cross-validation in density estimation with the -loss

A Celisse - 2014 - projecteuclid.org
Optimal cross-validation in density estimation with the L2-loss Page 1 The Annals of Statistics
2014, Vol. 42, No. 5, 1879–1910 DOI: 10.1214/14-AOS1240 © Institute of Mathematical …

Density Ratio Estimation with Doubly Strong Robustness

R Nagumo, H Fujisawa - Forty-first International Conference on Machine … - openreview.net
We develop two density ratio estimation (DRE) methods with robustness to outliers. These
are based on the divergence with a weight function to weaken the adverse effects of outliers …

Approximate stein classes for truncated density estimation

DJ Williams, S Liu - International Conference on Machine …, 2023 - proceedings.mlr.press
Estimating truncated density models is difficult, as these models have intractable
normalising constants and hard to satisfy boundary conditions. Score matching can be …

Computational complexity of kernel-based density-ratio estimation: A condition number analysis

T Kanamori, T Suzuki, M Sugiyama - Machine Learning, 2013 - Springer
In this study, the computational properties of a kernel-based least-squares density-ratio
estimator are investigated from the viewpoint of condition numbers. The condition number of …

GBHT: Gradient boosting histogram transform for density estimation

J Cui, H Hang, Y Wang, Z Lin - International Conference on …, 2021 - proceedings.mlr.press
In this paper, we propose a density estimation algorithm called\textit {Gradient Boosting
Histogram Transform}(GBHT), where we adopt the\textit {Negative Log Likelihood} as the …

Constructive setting of the density ratio estimation problem and its rigorous solution

V Vapnik, I Braga, R Izmailov - arXiv preprint arXiv:1306.0407, 2013 - arxiv.org
We introduce a general constructive setting of the density ratio estimation problem as a
solution of a (multidimensional) integral equation. In this equation, not only its right hand …

Choice of V for V-fold cross-validation in least-squares density estimation

S Arlot, M Lerasle - Journal of Machine Learning Research, 2016 - jmlr.org
This paper studies V-fold cross-validation for model selection in least-squares density
estimation. The goal is to provide theoretical grounds for choosing V in order to minimize the …