Dataperf: Benchmarks for data-centric ai development

M Mazumder, C Banbury, X Yao… - Advances in …, 2024 - proceedings.neurips.cc
Abstract Machine learning research has long focused on models rather than datasets, and
prominent datasets are used for common ML tasks without regard to the breadth, difficulty …

[HTML][HTML] Flood detection using real-time image segmentation from unmanned aerial vehicles on edge-computing platform

D Hernández, JM Cecilia, JC Cano, CT Calafate - Remote Sensing, 2022 - mdpi.com
With the proliferation of unmanned aerial vehicles (UAVs) in different contexts and
application areas, efforts are being made to endow these devices with enough intelligence …

Dynamic GPU energy optimization for machine learning training workloads

F Wang, W Zhang, S Lai, M Hao… - IEEE Transactions on …, 2021 - ieeexplore.ieee.org
GPUs are widely used to accelerate the training of machine learning workloads. As modern
machine learning models become increasingly larger, they require a longer time to train …

[HTML][HTML] A BenchCouncil view on benchmarking emerging and future computing

J Zhan - BenchCouncil Transactions on Benchmarks, Standards …, 2022 - Elsevier
The measurable properties of the artifacts or objects in the computer, management, or
finance disciplines are extrinsic, not inherent—dependent on their problem definitions and …

Flbench: A benchmark suite for federated learning

Y Liang, Y Guo, Y Gong, C Luo, J Zhan… - Intelligent Computing and …, 2021 - Springer
Federated learning is a new machine learning paradigm. The goal is to build a machine
learning model from the data sets distributed on multiple devices–so-called an isolated data …

Scenario-based AI benchmark evaluation of distributed cloud/edge computing systems

T Hao, K Hwang, J Zhan, Y Li… - IEEE Transactions on …, 2022 - ieeexplore.ieee.org
Distributed cloud/edge (DCE) platform has become popular in recent years. This paper
proposes a new AI benchmark suite for assessing the performance of DCE platforms in …

[HTML][HTML] Understanding hot interconnects with an extensive benchmark survey

Y Li, H Qi, G Lu, F Jin, Y Guo, X Lu - BenchCouncil Transactions on …, 2022 - Elsevier
Understanding the designs and performance characterizations of hot interconnects on
modern data center and high-performance computing (HPC) clusters is a fruitful research …

Hpc ai500 v2. 0: The methodology, tools, and metrics for benchmarking hpc ai systems

Z Jiang, W Gao, F Tang, L Wang… - 2021 IEEE …, 2021 - ieeexplore.ieee.org
Recent years witness a trend of applying large-scale distributed deep learning algorithms
(HPC AI) in both business and scientific computing areas, whose goal is to speed up the …

Comprehensive complexity assessment of emerging learned image compression on cpu and gpu

F Pakdaman, M Gabbouj - ICASSP 2023-2023 IEEE …, 2023 - ieeexplore.ieee.org
Learned Compression (LC) is the emerging technology for compressing image and video
content, using deep neural networks. Despite being new, LC methods have already gained …

[HTML][HTML] Call for establishing benchmark science and engineering

J Zhan - BenchCouncil Transactions on Benchmarks, Standards …, 2021 - Elsevier
Currently, there is no consistent benchmarking across multi-disciplines. Even no previous
work tries to relate different categories of benchmarks in multi-disciplines. This article …