Abstract Machine learning (ML) has emerged as a transformative subject, using various
algorithms to help systems analyze data and make predictions. Deep Learning (DL) uses …

Large language models (LLM) have recently attracted significant attention in the field of
artificial intelligence. However, the training process of these models poses significant …

When running deep learning training jobs, in order to prevent training loss due to
softwarelhardware failures, a checkpointing mechanism is usually used to periodically store …