Wavchat: A survey of spoken dialogue models
Recent advancements in spoken dialogue models, exemplified by systems like GPT-4o,
have captured significant attention in the speech domain. Compared to traditional three-tier …
have captured significant attention in the speech domain. Compared to traditional three-tier …
Generative expressive conversational speech synthesis
Conversational Speech Synthesis (CSS) aims to express a target utterance with the proper
speaking style in a user-agent conversation setting. Existing CSS methods employ effective …
speaking style in a user-agent conversation setting. Existing CSS methods employ effective …
Unistyle: Unified style modeling for speaking style captioning and stylistic speech synthesis
Understanding the speaking style, such as the emotion of the interlocutor's speech, and
responding with speech in an appropriate style is a natural occurrence in human …
responding with speech in an appropriate style is a natural occurrence in human …
Style-talker: Finetuning audio language model and style-based text-to-speech model for fast spoken dialogue generation
The rapid advancement of large language models (LLMs) has significantly propelled the
development of text-based chatbots, demonstrating their capability to engage in coherent …
development of text-based chatbots, demonstrating their capability to engage in coherent …
Re-evaluating the Command-and-Control Paradigm in Conversational Search Interactions
Conversational assistants are becoming prevalent among the wider population due to their
simplicity and increasing utility. However, the shortcomings of these tools are as renowned …
simplicity and increasing utility. However, the shortcomings of these tools are as renowned …
MinMo: A Multimodal Large Language Model for Seamless Voice Interaction
Recent advancements in large language models (LLMs) and multimodal speech-text
models have laid the groundwork for seamless voice interactions, enabling real-time …
models have laid the groundwork for seamless voice interactions, enabling real-time …
Align-SLM: Textless Spoken Language Models with Reinforcement Learning from AI Feedback
While textless Spoken Language Models (SLMs) have shown potential in end-to-end
speech-to-speech modeling, they still lag behind text-based Large Language Models …
speech-to-speech modeling, they still lag behind text-based Large Language Models …
Frozen Large Language Models Can Perceive Paralinguistic Aspects of Speech
As speech becomes an increasingly common modality for interacting with large language
models (LLMs), it is becoming desirable to develop systems where LLMs can take into …
models (LLMs), it is becoming desirable to develop systems where LLMs can take into …
Intra-and Inter-modal Context Interaction Modeling for Conversational Speech Synthesis
Z Jia, R Liu - arXiv preprint arXiv:2412.18733, 2024 - arxiv.org
Conversational Speech Synthesis (CSS) aims to effectively take the multimodal dialogue
history (MDH) to generate speech with appropriate conversational prosody for target …
history (MDH) to generate speech with appropriate conversational prosody for target …
Building a Taiwanese Mandarin Spoken Language Model: A First Attempt
This technical report presents our initial attempt to build a spoken large language model
(LLM) for Taiwanese Mandarin, specifically tailored to enable real-time, speech-to-speech …
(LLM) for Taiwanese Mandarin, specifically tailored to enable real-time, speech-to-speech …