Database meets deep learning: Challenges and opportunities

W Wang, M Zhang, G Chen, HV Jagadish, BC Ooi… - ACM Sigmod …, 2016 - dl.acm.org
Deep learning has recently become very popular on account of its incredible success in
many complex datadriven applications, including image classification and speech …

Bao: Making learned query optimization practical

R Marcus, P Negi, H Mao, N Tatbul… - Proceedings of the …, 2021 - dl.acm.org
Recent efforts applying machine learning techniques to query optimization have shown few
practical gains due to substantive training overhead, inability to adapt to changes, and poor …

Neo: A learned query optimizer

R Marcus, P Negi, H Mao, C Zhang, M Alizadeh… - arXiv preprint arXiv …, 2019 - arxiv.org
Query optimization is one of the most challenging problems in database systems. Despite
the progress made over the past decades, query optimizers remain extremely complex …

Learned cardinalities: Estimating correlated joins with deep learning

A Kipf, T Kipf, B Radke, V Leis, P Boncz… - arXiv preprint arXiv …, 2018 - arxiv.org
We describe a new deep learning approach to cardinality estimation. MSCN is a multi-set
convolutional network, tailored to representing relational query plans, that employs set …

Deepdb: Learn from data, not from queries!

B Hilprecht, A Schmidt, M Kulessa, A Molina… - arXiv preprint arXiv …, 2019 - arxiv.org
The typical approach for learned DBMS components is to capture the behavior by running a
representative set of queries and use the observations to train a machine learning model …

Deep unsupervised cardinality estimation

Z Yang, E Liang, A Kamsetty, C Wu, Y Duan… - arXiv preprint arXiv …, 2019 - arxiv.org
Cardinality estimation has long been grounded in statistical tools for density estimation. To
capture the rich multivariate distributions of relational tables, we propose the use of a new …

Learning to optimize join queries with deep reinforcement learning

S Krishnan, Z Yang, K Goldberg, J Hellerstein… - arXiv preprint arXiv …, 2018 - arxiv.org
Exhaustive enumeration of all possible join orders is often avoided, and most optimizers
leverage heuristics to prune the search space. The design and implementation of heuristics …

Are we ready for learned cardinality estimation?

X Wang, C Qu, W Wu, J Wang, Q Zhou - arXiv preprint arXiv:2012.06743, 2020 - arxiv.org
Cardinality estimation is a fundamental but long unresolved problem in query optimization.
Recently, multiple papers from different research groups consistently report that learned …

Learning state representations for query optimization with deep reinforcement learning

J Ortiz, M Balazinska, J Gehrke, SS Keerthi - Proceedings of the Second …, 2018 - dl.acm.org
We explore the idea of using deep reinforcement learning for query optimization. The
approach is to build queries incrementally by encoding properties of subqueries using a …

A survey on advancing the dbms query optimizer: Cardinality estimation, cost model, and plan enumeration

H Lan, Z Bao, Y Peng - Data Science and Engineering, 2021 - Springer
Query optimizer is at the heart of the database systems. Cost-based optimizer studied in this
paper is adopted in almost all current database systems. A cost-based optimizer introduces …