A survey of large language models
Language is essentially a complex, intricate system of human expressions governed by
grammatical rules. It poses a significant challenge to develop capable AI algorithms for …
grammatical rules. It poses a significant challenge to develop capable AI algorithms for …
Fit: Flexible vision transformer for diffusion model
Nature is infinitely resolution-free. In the context of this reality, existing diffusion models, such
as Diffusion Transformers, often face challenges when processing image resolutions outside …
as Diffusion Transformers, often face challenges when processing image resolutions outside …
Flooding Spread of Manipulated Knowledge in LLM-Based Multi-Agent Communities
The rapid adoption of large language models (LLMs) in multi-agent systems has highlighted
their impressive capabilities in various applications, such as collaborative problem-solving …
their impressive capabilities in various applications, such as collaborative problem-solving …
D-CPT Law: Domain-specific Continual Pre-Training Scaling Law for Large Language Models
Continual Pre-Training (CPT) on Large Language Models (LLMs) has been widely used to
expand the model's fundamental understanding of specific downstream domains (eg, math …
expand the model's fundamental understanding of specific downstream domains (eg, math …
Two Stones Hit One Bird: Bilevel Positional Encoding for Better Length Extrapolation
In this work, we leverage the intrinsic segmentation of language sequences and design a
new positional encoding method called Bilevel Positional Encoding (BiPE). For each …
new positional encoding method called Bilevel Positional Encoding (BiPE). For each …
Context Length Extension via Generalized Extrapolation Scale
L Li, Z Huaping - Findings of the Association for Computational …, 2024 - aclanthology.org
Context length expansion of transformer models is considered a key challenge, especially
when handling context beyond the training length during inference stage. In this paper, we …
when handling context beyond the training length during inference stage. In this paper, we …
Institutional Platform for Secure Self-Service Large Language Model Exploration
VK Bumgardner, MA Klusty, WV Logan… - arXiv preprint arXiv …, 2024 - arxiv.org
This paper introduces a user-friendly platform developed by the University of Kentucky
Center for Applied AI, designed to make large, customized language models (LLMs) more …
Center for Applied AI, designed to make large, customized language models (LLMs) more …