Achieving Peak Performance for Large Language Models: A Systematic Review

ZRK Rostam, S Szénási, G Kertész - IEEE Access, 2024 - ieeexplore.ieee.org
In recent years, large language models (LLMs) have achieved remarkable success in
natural language processing (NLP). LLMs require an extreme amount of parameters to …

Memory Is All You Need: An Overview of Compute-in-Memory Architectures for Accelerating Large Language Model Inference

C Wolters, X Yang, U Schlichtmann… - arXiv preprint arXiv …, 2024 - arxiv.org
Large language models (LLMs) have recently transformed natural language processing,
enabling machines to generate human-like text and engage in meaningful conversations …

Performance modeling and workload analysis of distributed large language model training and inference

J Kundu, W Guo, A BanaGozar… - 2024 IEEE …, 2024 - ieeexplore.ieee.org
Aligning future system design with the ever-increasing compute needs of large language
models (LLMs) is undoubtedly an important problem in today's world. Here, we propose a …

Demystifying Platform Requirements for Diverse LLM Inference Use Cases

A Bambhaniya, R Raj, G Jeong, S Kundu… - arXiv preprint arXiv …, 2024 - arxiv.org
Large language models (LLMs) have shown remarkable performance across a wide range
of applications, often outperforming human experts. However, deploying these parameter …

Development and Evaluation of an AI-Powered Virtual Coach for an E-Health Tool for Fall Prevention: Open-Source vs Closed-Source LLMs in E-Health Applications

J Liljedahl - 2024 - diva-portal.org
This thesis addresses the important issue of fall prevention through the development of the
PRE-fall project, focusing on creating a smartphone application that acts as a virtual coach …

[PDF][PDF] Hardware Design and Verification with Large Language Models: A Literature Survey, Challenges, and Open Issues

M Abdollahi, SF Yeganli, MA Baharloo, A Baniasadi - 2024 - preprints.org
Large Language Models (LLMs) are emerging as promising tools in hardware design and
verification, with recent advancements suggesting they could fundamentally reshape …