Benchcouncil's view on benchmarking ai and other emerging workloads

J Zhan, L Wang, W Gao, R Ren - arXiv preprint arXiv:1912.00572, 2019 - arxiv.org
This paper outlines BenchCouncil's view on the challenges, rules, and vision of
benchmarking modern workloads like Big Data, AI or machine learning, and Internet …

[HTML][HTML] 2022 BenchCouncil International Symposium on benchmarking, measuring and optimizing (Bench 2022) call for papers

C Luo, W Gao - BenchCouncil Transactions on Benchmarks, Standards …, 2022 - Elsevier
Sponsored and organized by the International Open Benchmark Council (BenchCouncil),
the Bench conference encompasses a wide range of topics in benchmarking, measurement …

Benchmarking AI inference: where we are in 2020

M Hodak, D Ellison, A Dholakia - Technology Conference on Performance …, 2020 - Springer
AI is continuing to emerge as an important workload across enterprise and academia.
Benchmarking is an essential tool to understand its computational requirements and to …

Requirements for an enterprise AI benchmark

C Bourrasset, F Boillod-Cerneux, L Sauge… - … and Benchmarking for …, 2019 - Springer
Artificial Intelligence (AI) is now the center of attention for many industries, ranging from
private companies to academic institutions. While domains of interest and AI applications …

Ai based performance benchmarking & analysis of big data and cloud powered applications: An in depth view

J Vemulapati, AS Khastgir, C Savalgi - Proceedings of the 2019 ACM …, 2019 - dl.acm.org
Big data analytics platforms on cloud are becoming mainstream technology enabling cost-
effective rapid deployment of customer's Big Data applications delivering quicker insights …

[图书][B] Benchmarking, Measuring, and Optimizing

C Zheng, J Zhan - 2019 - Springer
The past decade witnessed many innovative techniques as they evolved our economy and
society. The innovative techniques in Datacenter, AI, dedicated processors, and IoT are …

[图书][B] Benchmarking, Measuring, and Optimizing: Second BenchCouncil International Symposium, Bench 2019, Denver, CO, USA, November 14–16, 2019, Revised …

W Gao, J Zhan, G Fox, X Lu, D Stanzione - 2020 - books.google.com
This volume contains a selection of revised papers presented at Bench 2019: the Second
BenchCouncil International Symposium, held in November, 2019, in Denver, CO, USA. To …

AIBench: an industry standard internet service AI benchmark suite

W Gao, F Tang, L Wang, J Zhan, C Lan, C Luo… - arXiv preprint arXiv …, 2019 - arxiv.org
Today's Internet Services are undergoing fundamental changes and shifting to an intelligent
computing era where AI is widely employed to augment services. In this context, many …

AIBench training: Balanced industry-standard AI training benchmarking

F Tang, W Gao, J Zhan, C Lan, X Wen… - … Analysis of Systems …, 2021 - ieeexplore.ieee.org
Earlier-stage evaluations of a new AI architecture/system need affordable AI benchmarks.
Only using a few AI component benchmarks like MLPerf alone in the other stages may lead …

Ready for rain? A view from SPEC research on the future of cloud metrics

N Herbst, R Krebs, G Oikonomou, G Kousiouris… - arXiv preprint arXiv …, 2016 - arxiv.org
In the past decade, cloud computing has emerged from a pursuit for a service-driven
information and communication technology (ICT), into a signifcant fraction of the ICT market …