Enabling resource-efficient aiot system with cross-level optimization: A survey

S Liu, B Guo, C Fang, Z Wang, S Luo… - … Surveys & Tutorials, 2023 - ieeexplore.ieee.org
The emerging field of artificial intelligence of things (AIoT, AI+ IoT) is driven by the
widespread use of intelligent infrastructures and the impressive success of deep learning …

A graph placement methodology for fast chip design

A Mirhoseini, A Goldie, M Yazgan, JW Jiang… - Nature, 2021 - nature.com
Chip floorplanning is the engineering task of designing the physical layout of a computer
chip. Despite five decades of research 1, chip floorplanning has defied automation, requiring …

Full stack optimization of transformer inference: a survey

S Kim, C Hooper, T Wattanawong, M Kang… - arXiv preprint arXiv …, 2023 - arxiv.org
Recent advances in state-of-the-art DNN architecture design have been moving toward
Transformer models. These models achieve superior accuracy across a wide range of …

Evaluating language models for efficient code generation

J Liu, S Xie, J Wang, Y Wei, Y Ding, L Zhang - arXiv preprint arXiv …, 2024 - arxiv.org
We introduce Differential Performance Evaluation (DPE), a framework designed to reliably
evaluate Large Language Models (LLMs) for efficient code generation. Traditional coding …

Surco: Learning linear surrogates for combinatorial nonlinear optimization problems

AM Ferber, T Huang, D Zha… - International …, 2023 - proceedings.mlr.press
Optimization problems with nonlinear cost functions and combinatorial constraints appear in
many real-world applications but remain challenging to solve efficiently compared to their …

Hasco: Towards agile hardware and software co-design for tensor computation

Q Xiao, S Zheng, B Wu, P Xu, X Qian… - 2021 ACM/IEEE 48th …, 2021 - ieeexplore.ieee.org
Tensor computations overwhelm traditional general-purpose computing devices due to the
large amounts of data and operations of the computations. They call for a holistic solution …

A learned performance model for tensor processing units

S Kaufman, P Phothilimthana, Y Zhou… - Proceedings of …, 2021 - proceedings.mlsys.org
Accurate hardware performance models are critical to efficient code generation. They can be
used by compilers to make heuristic decisions, by superoptimizers as a minimization …

A full-stack search technique for domain optimized deep learning accelerators

D Zhang, S Huda, E Songhori, K Prabhu, Q Le… - Proceedings of the 27th …, 2022 - dl.acm.org
The rapidly-changing deep learning landscape presents a unique opportunity for building
inference accelerators optimized for specific datacenter-scale workloads. We propose Full …

Robust scheduling with gflownets

DW Zhang, C Rainone, M Peschl… - arXiv preprint arXiv …, 2023 - arxiv.org
Finding the best way to schedule operations in a computation graph is a classical NP-hard
problem which is central to compiler optimization. However, evaluating the goodness of a …

Piper: Multidimensional planner for dnn parallelization

JM Tarnawski, D Narayanan… - Advances in Neural …, 2021 - proceedings.neurips.cc
The rapid increase in sizes of state-of-the-art DNN models, and consequently the increase in
the compute and memory requirements of model training, has led to the development of …