Problems and opportunities in training deep learning software systems: An analysis of variance

HV Pham, S Qian, J Wang, T Lutellier… - Proceedings of the 35th …, 2020 - dl.acm.org
Deep learning (DL) training algorithms utilize nondeterminism to improve models' accuracy
and training efficiency. Hence, multiple identical training runs (eg, identical training data …

An empirical study of pre-trained model reuse in the hugging face deep learning model registry

W Jiang, N Synovic, M Hyatt… - 2023 IEEE/ACM 45th …, 2023 - ieeexplore.ieee.org
Deep Neural Networks (DNNs) are being adopted as components in software systems.
Creating and specializing DNNs from scratch has grown increasingly difficult as state-of-the …

Deep learning models for diagnosis of schizophrenia using EEG signals: emerging trends, challenges, and prospects

R Ranjan, BC Sahana, AK Bhandari - Archives of Computational Methods …, 2024 - Springer
Schizophrenia (ScZ) is a chronic neuropsychiatric disorder characterized by disruptions in
cognitive, perceptual, social, emotional, and behavioral functions. In the traditional …

Demystifying learning rate policies for high accuracy training of deep neural networks

Y Wu, L Liu, J Bae, KH Chow, A Iyengar… - … conference on big …, 2019 - ieeexplore.ieee.org
Learning Rate (LR) is an important hyper-parameter to tune for effective training of deep
neural networks (DNNs). Even for the baseline of a constant learning rate, it is non-trivial to …

An empirical study towards characterizing deep learning development and deployment across different frameworks and platforms

Q Guo, S Chen, X Xie, L Ma, Q Hu, H Liu… - 2019 34th IEEE/ACM …, 2019 - ieeexplore.ieee.org
Deep Learning (DL) has recently achieved tremendous success. A variety of DL frameworks
and platforms play a key role to catalyze such progress. However, the differences in …

CRADLE: cross-backend validation to detect and localize bugs in deep learning libraries

HV Pham, T Lutellier, W Qi, L Tan - 2019 IEEE/ACM 41st …, 2019 - ieeexplore.ieee.org
Deep learning (DL) systems are widely used in domains including aircraft collision
avoidance systems, Alzheimer's disease diagnosis, and autonomous driving cars. Despite …

Microscopy cell nuclei segmentation with enhanced U-Net

F Long - BMC bioinformatics, 2020 - Springer
Background Cell nuclei segmentation is a fundamental task in microscopy image analysis,
based on which multiple biological related analysis can be performed. Although deep …

Audee: Automated testing for deep learning frameworks

Q Guo, X Xie, Y Li, X Zhang, Y Liu, X Li… - Proceedings of the 35th …, 2020 - dl.acm.org
Deep learning (DL) has been applied widely, and the quality of DL system becomes crucial,
especially for safety-critical applications. Existing work mainly focuses on the quality …

Reveal training performance mystery between TensorFlow and PyTorch in the single GPU environment

H Dai, X Peng, X Shi, L He, Q Xiong, H Jin - Science China Information …, 2022 - Springer
Deep learning has gained tremendous success in various fields while training deep neural
networks (DNNs) is very compute-intensive, which results in numerous deep learning …

A comparative measurement study of deep learning as a service framework

Y Wu, L Liu, C Pu, W Cao, S Sahin… - IEEE Transactions on …, 2019 - ieeexplore.ieee.org
Big data powered Deep Learning (DL) and its applications have blossomed in recent years,
fueled by three technological trends: a large amount of digitized data openly accessible, a …