A survey on deep learning benchmarks: Do we still need new ones?

Q Zhang, L Zha, J Lin, D Tu, M Li, F Liang… - … , and Optimizing: First …, 2019 - Springer
Deep Learning has recently been gaining popularity. From the micro-architecture field to the
upper-layer end applications, a lot of research work has been proposed in the literature to …

DLBench: an experimental evaluation of deep learning frameworks

N Mahmoud, Y Essam, R Elshawi… - 2019 IEEE International …, 2019 - ieeexplore.ieee.org
Recently, deep learning has become one of the most disruptive trends in the technology
world. Deep learning techniques are increasingly achieving significant results in different …

Accounting for variance in machine learning benchmarks

X Bouthillier, P Delaunay, M Bronzi… - Proceedings of …, 2021 - proceedings.mlsys.org
Strong empirical evidence that one machine-learning algorithm A outperforms another one
B, ideally calls for multiple trials optimizing the learning pipeline over sources of variation …

Deep learning—a first meta-survey of selected reviews across scientific disciplines, their commonalities, challenges and research impact

J Egger, A Pepe, C Gsaxner, Y Jin, J Li… - PeerJ Computer …, 2021 - peerj.com
Deep learning belongs to the field of artificial intelligence, where machines perform tasks
that typically require some kind of human intelligence. Deep learning tries to achieve this by …

[PDF][PDF] Deep learning toolbox

MH Beale, MT Hagan, HB Demuth - R2018b User's Guide; The …, 2018 - research.iaun.ac.ir
The software described in this document is furnished under a license agreement. The
software may be used or copied only under the terms of the license agreement. No part of …

A modular benchmarking infrastructure for high-performance and reproducible deep learning

T Ben-Nun, M Besta, S Huber… - 2019 IEEE …, 2019 - ieeexplore.ieee.org
We introduce Deep500: the first customizable benchmarking infrastructure that enables fair
comparison of the plethora of deep learning frameworks, algorithms, libraries, and …

On empirical comparisons of optimizers for deep learning

D Choi, CJ Shallue, Z Nado, J Lee… - arXiv preprint arXiv …, 2019 - arxiv.org
Selecting an optimizer is a central step in the contemporary deep learning pipeline. In this
paper, we demonstrate the sensitivity of optimizer comparisons to the hyperparameter tuning …

Loss functions and metrics in deep learning. A review

J Terven, DM Cordova-Esparza… - arXiv preprint arXiv …, 2023 - arxiv.org
One of the essential components of deep learning is the choice of the loss function and
performance metrics used to train and evaluate models. This paper reviews the most …

A detailed comparative study of open source deep learning frameworks

G Al-Bdour, R Al-Qurran, M Al-Ayyoub… - arXiv preprint arXiv …, 2019 - arxiv.org
Deep Learning (DL) is one of the hottest trends in machine learning as DL approaches
produced results superior to the state-of-the-art in problematic areas such as image …

The design and implementation of a scalable deep learning benchmarking platform

C Li, A Dakkak, J Xiong, W Hwu - 2020 IEEE 13th International …, 2020 - ieeexplore.ieee.org
The current Deep Learning (DL) landscape is fast-paced and is rife with non-uniform
models, hardware/software (HW/SW) stacks. Currently, there is no DL benchmarking …