Learning performance-improving code edits

A Shypula, A Madaan, Y Zeng, U Alon… - arXiv preprint arXiv …, 2023 - arxiv.org
With the waning of Moore's law, optimizing program performance has become a major focus
of software research. However, high-level optimizations such as API and algorithm changes …

ECCO: Can We Improve Model-Generated Code Efficiency Without Sacrificing Functional Correctness?

S Waghjale, V Veerendranath, ZZ Wang… - arXiv preprint arXiv …, 2024 - arxiv.org
Although large language models (LLMs) have been largely successful in generating
functionally correct programs, conditioning models to produce efficient solutions while …

Learning to superoptimize real-world programs

A Shypula, P Yin, J Lacomis, CL Goues… - arXiv preprint arXiv …, 2021 - arxiv.org
Program optimization is the process of modifying software to execute more efficiently.
Superoptimizers attempt to find the optimal program by employing significantly more …

Ayudante: A Deep Reinforcement Learning Approach to Assist Persistent Memory Programming

H Huang, Z Wang, J Kim, S Swanson… - 2021 USENIX Annual …, 2021 - usenix.org
Nonvolatile random-access memories (NVRAMs) are envisioned as a new tier of memory in
future server systems. They enable a promising persistent memory (PM) technique, with …

Enabling transformers to understand low-level programs

ZC Guo, WS Moses - 2022 IEEE High Performance Extreme …, 2022 - ieeexplore.ieee.org
Unlike prior approaches to machine learning, Transformer models can first be trained on a
large corpus of unlabeled data with a generic objective and then on a smaller task-specific …

[PDF][PDF] Enhancing Language Models with Structured Reasoning

A Madaan - 2023 - madaan.github.io
The rapid growth in the areas of language generation and reasoning has been significantly
facilitated by the availability of user-friendly libraries wrapped around large language …

[HTML][HTML] WikiDT: Visual-based table recognition and question answering dataset

H Shi, Y Xie, L Goncalves, S Gao, J Zhao - 2024 - amazon.science
Companies and organizations grapple with the daily burden of document processing. As
manual handling is tedious and error-prune, automating this process is a significant goal. In …