Recent advancements in spoken dialogue models, exemplified by systems like GPT-4o,
have captured significant attention in the speech domain. Compared to traditional three-tier …

Large Language Models (LLMs) exhibit strong contextual understanding and remarkable
multi-task performance. Therefore, researchers have been seeking to integrate LLMs in the …

Speech language models have recently demonstrated great potential as universal speech
processing systems. Such models have the ability to model the rich acoustic information …

The success of large language models (LLMs) has prompted efforts to integrate speech and
audio data, aiming to create general foundation models capable of processing both textual …

Amphion is an open-source toolkit for Audio, Music, and Speech Generation, designed to
lower the entry barrier for junior researchers and engineers in these fields. It provides a …

With the rapid development of large language models, researchers have created
increasingly advanced spoken dialogue systems that can naturally converse with humans …

In recent years, we have observed a rapid advancement in speech language models
(SpeechLLMs), catching up with humans' listening and reasoning abilities. SpeechLLMs …

The substantial data present in spoken language is classified into two categories in our
work: background and speaking. The speaking part is then divided into two subcategories …

An ideal multimodal agent should be aware of the quality of its input modalities. Recent
advances have enabled large language models (LLMs) to incorporate auditory systems for …