Model-agnostic feature importance and effects with dependent features: a conditional subgroup approach

C Molnar, G König, B Bischl, G Casalicchio - Data Mining and Knowledge …, 2024 - Springer
The interpretation of feature importance in machine learning models is challenging when
features are dependent. Permutation feature importance (PFI) ignores such dependencies …

Beyond generalization: a theory of robustness in machine learning

T Freiesleben, T Grote - Synthese, 2023 - Springer
The term robustness is ubiquitous in modern Machine Learning (ML). However, its meaning
varies depending on context and community. Researchers either focus on narrow technical …

Relating the partial dependence plot and permutation feature importance to the data generating process

C Molnar, T Freiesleben, G König, J Herbinger… - World Conference on …, 2023 - Springer
Scientists and practitioners increasingly rely on machine learning to model data and draw
conclusions. Compared to statistical modeling approaches, machine learning makes fewer …

Dear XAI community, we need to talk! Fundamental misconceptions in current XAI research

T Freiesleben, G König - World Conference on Explainable Artificial …, 2023 - Springer
Despite progress in the field, significant parts of current XAI research are still not on solid
conceptual, ethical, or methodological grounds. Unfortunately, these unfounded parts are …

An alternative to cognitivism: computational phenomenology for deep learning

P Beckmann, G Köstner, I Hipólito - Minds and Machines, 2023 - Springer
We propose a non-representationalist framework for deep learning relying on a novel
method computational phenomenology, a dialogue between the first-person perspective …

Towards compositional interpretability for xai

S Tull, R Lorenz, S Clark, I Khan, B Coecke - arXiv preprint arXiv …, 2024 - arxiv.org
Artificial intelligence (AI) is currently based largely on black-box machine learning models
which lack interpretability. The field of eXplainable AI (XAI) strives to address this major …

Initialization noise in image gradients and saliency maps

AC Woerl, J Disselhoff, M Wand - Proceedings of the IEEE …, 2023 - openaccess.thecvf.com
In this paper, we examine gradients of logits of image classification CNNs by input pixel
values. We observe that these fluctuate considerably with training randomness, such as the …

Decomposing global feature effects based on feature interactions

J Herbinger, MN Wright, T Nagler, B Bischl… - arXiv preprint arXiv …, 2023 - arxiv.org
Global feature effect methods, such as partial dependence plots, provide an intelligible
visualization of the expected marginal feature effect. However, such global feature effect …

Ultra-marginal feature importance: Learning from data with causal guarantees

J Janssen, V Guan, E Robeva - International conference on …, 2023 - proceedings.mlr.press
Scientists frequently prioritize learning from data rather than training the best possible
model; however, research in machine learning often prioritizes the latter. Marginal …

Theoretical Insights into Neural Networks and Deep Learning: Advancing Understanding, Interpretability, and Generalization

UA Usmani, MU Usmani - 2023 World Conference on …, 2023 - ieeexplore.ieee.org
This work aims to provide profound insights into neural networks and deep learning,
focusing on their functioning, interpretability, and generalization capabilities. It explores …