NBDT: Neural-backed decision trees

A Wan, L Dunlap, D Ho, J Yin, S Lee, H Jin… - arXiv preprint arXiv …, 2020 - arxiv.org
Machine learning applications such as finance and medicine demand accurate and
justifiable predictions, barring most deep learning methods from use. In response, previous …

Training decision trees as replacement for convolution layers

W Fuhl, G Kasneci, W Rosenstiel… - Proceedings of the AAAI …, 2020 - ojs.aaai.org
We present an alternative layer to convolution layers in convolutional neural networks
(CNNs). Our approach reduces the complexity of convolutions by replacing it with binary …

Decision forests, convolutional networks and the models in-between

Y Ioannou, D Robertson, D Zikic… - arXiv preprint arXiv …, 2016 - arxiv.org
This paper investigates the connections between two state of the art classifiers: decision
forests (DFs, including decision jungles) and convolutional neural networks (CNNs) …

Decision trees for decision-making under the predict-then-optimize framework

AN Elmachtoub, JCN Liang… - … conference on machine …, 2020 - proceedings.mlr.press
We consider the use of decision trees for decision-making problems under the predict-then-
optimize framework. That is, we would like to first use a decision tree to predict unknown …

Characterizing the decision boundary of deep neural networks

H Karimi, T Derr, J Tang - arXiv preprint arXiv:1912.11460, 2019 - arxiv.org
Deep neural networks and in particular, deep neural classifiers have become an integral
part of many modern applications. Despite their practical success, we still have limited …

Deep neural decision trees

Y Yang, IG Morillo, TM Hospedales - arXiv preprint arXiv:1806.06988, 2018 - arxiv.org
Deep neural networks have been proven powerful at processing perceptual data, such as
images and audio. However for tabular data, tree-based models are more popular. A nice …

Learning credible deep neural networks with rationale regularization

M Du, N Liu, F Yang, X Hu - 2019 IEEE International …, 2019 - ieeexplore.ieee.org
Recent explainability related studies have shown that state-of-the-art DNNs do not always
adopt correct evidences to make decisions. It not only hampers their generalization but also …

Interpretable deep learning: Interpretation, interpretability, trustworthiness, and beyond

X Li, H Xiong, X Li, X Wu, X Zhang, J Liu, J Bian… - … and Information Systems, 2022 - Springer
Deep neural networks have been well-known for their superb handling of various machine
learning and artificial intelligence tasks. However, due to their over-parameterized black-box …

Neural networks are decision trees

C Aytekin - arXiv preprint arXiv:2210.05189, 2022 - arxiv.org
In this manuscript, we show that any neural network with any activation function can be
represented as a decision tree. The representation is equivalence and not an …

Decision jungles: Compact and rich models for classification

J Shotton, T Sharp, P Kohli… - Advances in neural …, 2013 - proceedings.neurips.cc
Randomized decision trees and forests have a rich history in machine learning and have
seen considerable success in application, perhaps particularly so for computer vision …