TSB-UAD: an end-to-end benchmark suite for univariate time-series anomaly detection

J Paparrizos, Y Kang, P Boniol, RS Tsay… - Proceedings of the …, 2022 - dl.acm.org
The detection of anomalies in time series has gained ample academic and industrial
attention. However, no comprehensive benchmark exists to evaluate time-series anomaly …

Exathlon: A benchmark for explainable anomaly detection over time series

V Jacob, F Song, A Stiegler, B Rad, Y Diao… - arXiv preprint arXiv …, 2020 - arxiv.org
Access to high-quality data repositories and benchmarks have been instrumental in
advancing the state of the art in many experimental research domains. While advanced …

TPCx-AI-An Industry Standard Benchmark for Artificial Intelligence and Machine Learning Systems

C Brücke, P Härtling, RDE Palacios, H Patel… - Proceedings of the …, 2023 - dl.acm.org
Artificial intelligence (AI) and machine learning (ML) techniques have existed for years, but
new hardware trends and advances in model training and inference have radically improved …

A Comparative Performance Evaluation of Multi-Model NoSQL Databases and Polyglot Persistence

D Van Landuyt, J Benaouda, V Reniers… - Proceedings of the 38th …, 2023 - dl.acm.org
Multi-model databases support different NoSQL data models at once, typically a
combination of relational, key-value, document, and graph models. Their expected benefits …

Tpcx-ai on nvidia jetsons

R Bayer, JV Tøttrup, P Tözün - Technology Conference on Performance …, 2022 - Springer
Despite their resource-and power-constrained nature, edge devices also exhibit an increase
in the available compute and memory resources and heterogeneity, similar to the evolution …

Preliminary Scaling Characterization of TPCx-AI

H Patel, K Ufa, S Nah, A Raina, R Escobar - Technology Conference on …, 2022 - Springer
TPCx-AI is the latest TPC benchmark addressing some of the numerous challenges in AI
benchmarking. It has the ability to scale datasets, to emulate machine learning and deep …

A demonstration of the exathlon benchmarking platform for explainable anomaly detection

V Jacob, F Song, A Stiegler, B Rad, Y Diao… - Proceedings of the …, 2021 - hal.science
In this demo, we introduce Exathlon-a new benchmarking platform for explainable anomaly
detection over high-dimensional time series. We designed Exathlon to support data …

Benchmarking AI inference: where we are in 2020

M Hodak, D Ellison, A Dholakia - Technology Conference on Performance …, 2020 - Springer
AI is continuing to emerge as an important workload across enterprise and academia.
Benchmarking is an essential tool to understand its computational requirements and to …

[PDF][PDF] Comparison of benchmarks for machine learning cloud infrastructures

M Madan, C Reich - CLOUD COMPUTING, 2021 - researchgate.net
Training of neural networks requires often high computational power and large memory on
Graphics Processing Unit (GPU) hardware. Many cloud providers such as Ama zon, Azure …

[PDF][PDF] Platform-Aware Resource Allocation for Inference on Multi-Accelerator Edge Devices

R Sivakumar, S Tangri, S Srivastava - The 6th EMC2-Energy Efficient …, 2020 - emc2-ai.org
With the fast pace of innovation in deep learning (DL) and machine learning (ML)
algorithms, large datasets, and capable hardware, real-world applications are adopting …