Rethinking algorithm performance metrics for artificial intelligence in diagnostic medicine

MA Reyna, EO Nsoesie, GD Clifford - JAMA, 2022 - jamanetwork.com
metric was designed to reward or penalize algorithms, … This metric provided high scores
for early sepsis predictions to … However, the common framework that traditional metrics

… of artificial intelligence algorithms into endoscopy practice: recommendations from the American Society for Gastrointestinal Endoscopy Artificial Intelligence Task …

S Parasa, A Repici, T Berzin, C Leggett… - Gastrointestinal …, 2023 - Elsevier
framework for all stakeholders in the endoscopy AI ecosystem regarding the standards,
metrics… We provide a framework for the metrics used for AI algorithm development during internal …

Peering into the black box of artificial intelligence: evaluation metrics of machine learning methods

GS Handelman, HK Kok, RV Chandra… - American Journal of …, 2019 - Am Roentgen Ray Soc
metric of a particular algorithm can quickly see that metric and compare that algorithm with
other algorithms. … positives and negatives; the remaining metrics can be calculated from these …

Performance metrics for artificial intelligence (AI) algorithms adopted in prognostics and health management (PHM) of mechanical systems

S Ochella, M Shafiee - Journal of Physics: Conference Series, 2021 - iopscience.iop.org
… forecasting metrics but also incorporates other metrics developed by PHM researchers.
The proposed classification framework for PHM performance metrics is shown in Figure 1. …

Error metrics and performance fitness indicators for artificial intelligence and machine learning in engineering and sciences

MZ Naser, AH Alavi - Architecture, Structures and Construction, 2023 - Springer
… and error metrics for regression and classification algorithms, … metrics (PFEMs).
Performance and error measures are vital elements in the process of evaluating ML models/frameworks. …

Regulatory frameworks for development and evaluation of artificial intelligence–based diagnostic imaging algorithms: summary and recommendations

DB Larson, H Harvey, DL Rubin, N Irani… - Journal of the American …, 2021 - Elsevier
… prevent algorithms from being fully trusted. In this article, we review the major regulatory
frameworks … AI algorithms. We identify the following major shortcomings of the current regulatory …

Reliance on metrics is a fundamental challenge for AI

RL Thomas, D Uminsky - Patterns, 2022 - cell.com
… The success of current artificial intelligence (AI) approaches … a framework for the healthier
use of metrics that includes: … “error” of our algorithms that explicitly links metrics in the use of AI. …

Artificial intelligence methods and artificial intelligence-enabled metrics for surgical education: a multidisciplinary consensus

SS Vedula, A Ghazi, JW Collins, C Pugh… - Journal of the …, 2022 - journals.lww.com
… , artificial intelligence (AI) methods and AI-enabled metricsalgorithms. A few studies
evaluated the effectiveness of providing metrics and other feedback derived from machine learning

Evaluation metrics research for explainable artificial intelligence global methods using synthetic data

A Oblizanov, N Shevskaya, A Kazak… - Applied System …, 2023 - mdpi.com
metric is a measure that allows one to obtain the numerical value of some property of the
algorithm, … To evaluate the methods of explainable artificial intelligence, a variety of metrics from …

Evaluation metrics in explainable artificial intelligence (XAI)

L Coroama, A Groza - International conference on advanced research in …, 2022 - Springer
… Performance aspects refer to metrics such as computational cost which can be highly
expensive or even stopping the execution of the algorithm for very large datasets. Model …