Quantum machine learning for join order optimization using variational quantum circuits

T Winker, U Çalikyilmaz, L Gruenwald… - Proceedings of the …, 2023 - dl.acm.org
The optimization of queries speeds up query processing in databases. One of the most time-
consuming tasks in query processing is the join operation, where the order of the joins plays …

Accurate summary-based cardinality estimation through the lens of cardinality estimation graphs

J Chen, Y Huang, M Wang, S Salihoglu… - Proceedings of the VLDB …, 2022 - dl.acm.org
This paper is an experimental and analytical study of two classes of summary-based
cardinality estimators that use statistics about input relations and small-size joins in the …

Fine-grained modeling and optimization for intelligent resource management in big data processing

C Lyu, Q Fan, F Song, A Sinha, Y Diao, W Chen… - arXiv preprint arXiv …, 2022 - arxiv.org
Big data processing at the production scale presents a highly complex environment for
resource optimization (RO), a problem crucial for meeting performance goals and budgetary …

[PDF][PDF] Exploration of Approaches for In-Database ML.

S Kläbe, S Hagedorn, KU Sattler - EDBT, 2023 - openproceedings.org
Database systems are no longer used only for the storage of plain structured data and basic
analyses. An increasing role is also played by the integration of ML models, eg, neural …

Quantum data management and quantum machine learning for data management: State-of-the-art and open challenges

S Groppe, J Groppe, U Çalıkyılmaz, T Winker… - … on Intelligent Systems …, 2022 - Springer
Quantum computing is an emerging technology and has yet to be exploited by industries to
implement practical applications. Research has already laid the foundation for figuring out …

A Spark Optimizer for Adaptive, Fine-Grained Parameter Tuning

C Lyu, Q Fan, P Guyard, Y Diao - arXiv preprint arXiv:2403.00995, 2024 - arxiv.org
As Spark becomes a common big data analytics platform, its growing complexity makes
automatic tuning of numerous parameters critical for performance. Our work on Spark …

Aggregate-based training phase for ML-based cardinality estimation

L Woltmann, C Hartmann, D Habich, W Lehner - Datenbank-Spektrum, 2022 - Springer
Cardinality estimation is a fundamental task in database query processing and optimization.
As shown in recent papers, machine learning (ML)-based approaches may deliver more …

[PDF][PDF] Blue Elephants Inspecting Pandas

ME Schüle, L Scalerandi, A Kemper, T Neumann - Proc. of EDBT'23, 2023 - db.in.tum.de
Data preprocessing, the step of transforming data into a suitable format for training a model,
rarely happens within database systems but rather in external Python libraries and thus …

Accurate Summary-based Cardinality Estimation Through the Lens of Cardinality Estimation Graphs

J Chen, Y Huang, M Wang, S Salihoglu… - ACM SIGMOD …, 2023 - dl.acm.org
We study two classes of summary-based cardinality estimators that use statistics about input
relations and small-size joins:(i) optimistic estimators, which were defined in the context of …

Multi-Objective Optimization for Data Analytics in the Cloud

Q Fan - 2024 - theses.hal.science
Big data query processing has become increasingly important, prompting the development
and cloud deployment of numerous systems. However, automatically tuning the numerous …