Scenario-based AI benchmark evaluation of distributed cloud/edge computing systems

T Hao, K Hwang, J Zhan, Y Li… - IEEE Transactions on …, 2022 - ieeexplore.ieee.org
Distributed cloud/edge (DCE) platform has become popular in recent years. This paper
proposes a new AI benchmark suite for assessing the performance of DCE platforms in …

Olxpbench: Real-time, semantically consistent, and domain-specific are essential in benchmarking, designing, and implementing htap systems

G Kang, L Wang, W Gao, F Tang… - 2022 IEEE 38th …, 2022 - ieeexplore.ieee.org
As real-time analysis on the fresh data become in-creasingly compelling, more
organizations deploy Hybrid Trans-actional/Analytical Processing (HTAP) systems to …

[HTML][HTML] A BenchCouncil view on benchmarking emerging and future computing

J Zhan - BenchCouncil Transactions on Benchmarks, Standards …, 2022 - Elsevier
The measurable properties of the artifacts or objects in the computer, management, or
finance disciplines are extrinsic, not inherent—dependent on their problem definitions and …

[HTML][HTML] Three laws of technology rise or fall

J Zhan - BenchCouncil Transactions on Benchmarks, Standards …, 2022 - Elsevier
Newton's laws of motion perfectly explain or approximate physical phenomena in our
everyday life. Are there any laws that explain or approximate technology's rise or fall? After …

[HTML][HTML] Edge AIBench 2.0: A scalable autonomous vehicle benchmark for IoT–Edge–Cloud systems

T Hao, W Gao, C Lan, F Tang, Z Jiang… - … on Benchmarks, Standards …, 2022 - Elsevier
Abstract Many emerging IoT–Edge–Cloud computing systems are not yet implemented or
are too confidential to share the code or even tricky to replicate its execution environment …

[HTML][HTML] IoTBench: a data centrical and configurable IoT benchmark suite

S Chen, C Luo, W Gao, L Wang - BenchCouncil Transactions on …, 2022 - Elsevier
Abstract As the Internet of Things (IoT) industry expands, the demand for microprocessors
and microcontrollers used in IoT systems has increased steadily. Benchmarks provide a …

OpenPerf: A Benchmarking Framework for the Sustainable Development of the Open-Source Ecosystem

F Bi, F Han, S Zhao, J Li, Y Zhang, W Wang - arXiv preprint arXiv …, 2023 - arxiv.org
Benchmarking involves designing scientific test methods, tools, and frameworks to
quantitatively and comparably assess specific performance indicators of certain test …

[HTML][HTML] HPC AI500 V3. 0: A scalable HPC AI benchmarking framework

Z Jiang, C Luo, W Gao, L Wang, J Zhan - BenchCouncil Transactions on …, 2022 - Elsevier
In recent years, the convergence of High Performance Computing (HPC) and artificial
intelligence (AI) makes the community desperately need a benchmark to guide the design of …

[HTML][HTML] Open-source computer systems initiative: The motivation, essence, challenges, and methodology

J Zhan - BenchCouncil Transactions on Benchmarks, Standards …, 2022 - Elsevier
The global community faces many pressing and uncertain challenges like pandemics and
global climate change. Information technology (IT) infrastructure has become the enabler to …

[HTML][HTML] Training, testing and benchmarking medical AI models using clinical aibench

Y Huang, X Miao, R Zhang, L Ma, W Liu… - BenchCouncil …, 2022 - Elsevier
AI technology has been used in many clinical research fields, but most AI technologies are
difficult to land in real-world clinical settings. In most current clinical AI research settings, the …