Bao: Making learned query optimization practical

R Marcus, P Negi, H Mao, N Tatbul… - Proceedings of the …, 2021 - dl.acm.org
Recent efforts applying machine learning techniques to query optimization have shown few
practical gains due to substantive training overhead, inability to adapt to changes, and poor …

Ansor: Generating {High-Performance} tensor programs for deep learning

L Zheng, C Jia, M Sun, Z Wu, CH Yu, A Haj-Ali… - … USENIX symposium on …, 2020 - usenix.org
High-performance tensor programs are crucial to guarantee efficient execution of deep
neural networks. However, obtaining performant tensor programs for different operators on …

Programl: A graph-based program representation for data flow analysis and compiler optimizations

C Cummins, ZV Fisches, T Ben-Nun… - International …, 2021 - proceedings.mlr.press
Abstract Machine learning (ML) is increasingly seen as a viable approach for building
compiler optimization heuristics, but many ML methods cannot replicate even the simplest of …

Large language models for compiler optimization

C Cummins, V Seeker, D Grubisic, M Elhoushi… - arXiv preprint arXiv …, 2023 - arxiv.org
We explore the novel application of Large Language Models to code optimization. We
present a 7B-parameter transformer model trained from scratch to optimize LLVM assembly …

Compilergym: Robust, performant compiler optimization environments for ai research

C Cummins, B Wasti, J Guo, B Cui… - 2022 IEEE/ACM …, 2022 - ieeexplore.ieee.org
Interest in applying Artificial Intelligence (AI) techniques to compiler optimizations is
increasing rapidly, but compiler research has a high entry barrier. Unlike in other domains …

Programl: Graph-based deep learning for program optimization and analysis

C Cummins, ZV Fisches, T Ben-Nun, T Hoefler… - arXiv preprint arXiv …, 2020 - arxiv.org
The increasing complexity of computing systems places a tremendous burden on optimizing
compilers, requiring ever more accurate and aggressive optimizations. Machine learning …

IR2VEC LLVM IR Based Scalable Program Embeddings

S VenkataKeerthy, R Aggarwal, S Jain… - ACM Transactions on …, 2020 - dl.acm.org
We propose IR2Vec, a Concise and Scalable encoding infrastructure to represent programs
as a distributed embedding in continuous space. This distributed embedding is obtained by …

Mlgo: a machine learning guided compiler optimizations framework

M Trofin, Y Qian, E Brevdo, Z Lin… - arXiv preprint arXiv …, 2021 - arxiv.org
Leveraging machine-learning (ML) techniques for compiler optimizations has been widely
studied and explored in academia. However, the adoption of ML in general-purpose …

MQT predictor: Automatic device selection with device-specific circuit compilation for quantum computing

N Quetschlich, L Burgholzer, R Wille - ACM Transactions on Quantum …, 2023 - dl.acm.org
Fueled by recent accomplishments in quantum computing hardware and software, an
increasing number of problems from various application domains are being explored as …

Machine learning in compilers: Past, present and future

H Leather, C Cummins - 2020 Forum for Specification and …, 2020 - ieeexplore.ieee.org
Writing optimising compilers is difficult. The range of programs that may be presented to the
compiler is huge and the systems on which they run are complex, heterogeneous, non …