Fusionai: Decentralized training and deploying llms with massive consumer-level gpus

Z Tang, Y Wang, X He, L Zhang, X Pan, Q Wang… - arXiv preprint arXiv …, 2023 - arxiv.org
The rapid growth of memory and computation requirements of large language models
(LLMs) has outpaced the development of hardware, hindering people who lack large-scale …

FusionAI: Decentralized Training and Deploying LLMs with Massive Consumer-Level GPUs

Z Tang, Y Wang, X He, L Zhang, X Pan… - arXiv e …, 2023 - ui.adsabs.harvard.edu
The rapid growth of memory and computation requirements of large language models
(LLMs) has outpaced the development of hardware, hindering people who lack large-scale …