Test time augmentation meets post-hoc calibration: uncertainty quantification under real-world conditions

A Hekler, TJ Brinker, F Buettner - … of the AAAI Conference on Artificial …, 2023 - ojs.aaai.org
Communicating the predictive uncertainty of deep neural networks transparently and reliably
is important in many safety-critical applications such as medicine. However, modern neural …

Benchmarking uncertainty disentanglement: Specialized uncertainties for specialized tasks

B Mucsányi, M Kirchhof, SJ Oh - arXiv preprint arXiv:2402.19460, 2024 - arxiv.org
Uncertainty quantification, once a singular task, has evolved into a spectrum of tasks,
including abstained prediction, out-of-distribution detection, and aleatoric uncertainty …

How to leverage predictive uncertainty estimates for reducing catastrophic forgetting in online continual learning

G Serra, B Werner, F Buettner - arXiv preprint arXiv:2407.07668, 2024 - arxiv.org
Many real-world applications require machine-learning models to be able to deal with non-
stationary data distributions and thus learn autonomously over an extended period of time …

Rethinking Uncertainty Estimation in Natural Language Generation

L Aichberger, K Schweighofer, S Hochreiter - arXiv preprint arXiv …, 2024 - arxiv.org
Large Language Models (LLMs) are increasingly employed in real-world applications,
driving the need to evaluate the trustworthiness of their generated text. To this end, reliable …

On Information-Theoretic Measures of Predictive Uncertainty

K Schweighofer, L Aichberger, M Ielanskyi… - arXiv preprint arXiv …, 2024 - arxiv.org
Reliable estimation of predictive uncertainty is crucial for machine learning applications,
particularly in high-stakes scenarios where hedging against risks is essential. Despite its …

Federated Continual Learning Goes Online: Leveraging Uncertainty for Modality-Agnostic Class-Incremental Learning

G Serra, F Buettner - arXiv preprint arXiv:2405.18925, 2024 - arxiv.org
Given the ability to model more realistic and dynamic problems, Federated Continual
Learning (FCL) has been increasingly investigated recently. A well-known problem …

A Bias-Variance-Covariance Decomposition of Kernel Scores for Generative Models

SG Gruber, F Buettner - arXiv preprint arXiv:2310.05833, 2023 - arxiv.org
Generative models, like large language models, are becoming increasingly relevant in our
daily lives, yet a theoretical framework to assess their generalization behavior and …

On the Structure of Information

S Gottwald, DA Braun - arXiv preprint arXiv:2409.20331, 2024 - arxiv.org
Shannon information and Shannon entropy are undoubtedly the most commonly used
quantitative measures of information, cropping up in the literature across a broad variety of …

[PDF][PDF] Reliable uncertainty estimation via proper scores

F Buettner - iasc-isi.org
With model trustworthiness being crucial for sensitive real-world applications, practitioners
are putting more and more focus on improving the uncertainty awareness of deep neural …