A comprehensive survey on pretrained foundation models: A history from bert to chatgpt
Pretrained Foundation Models (PFMs) are regarded as the foundation for various
downstream tasks with different data modalities. A PFM (eg, BERT, ChatGPT, and GPT-4) is …
downstream tasks with different data modalities. A PFM (eg, BERT, ChatGPT, and GPT-4) is …
Recent advances in deep learning based dialogue systems: A systematic survey
Dialogue systems are a popular natural language processing (NLP) task as it is promising in
real-life applications. It is also a complicated task since many NLP tasks deserving study are …
real-life applications. It is also a complicated task since many NLP tasks deserving study are …
A survey on text classification: From traditional to deep learning
Text classification is the most fundamental and essential task in natural language
processing. The last decade has seen a surge of research in this area due to the …
processing. The last decade has seen a surge of research in this area due to the …
Towards scalable multi-domain conversational agents: The schema-guided dialogue dataset
Virtual assistants such as Google Assistant, Alexa and Siri provide a conversational
interface to a large number of services and APIs spanning multiple domains. Such systems …
interface to a large number of services and APIs spanning multiple domains. Such systems …
Multiwoz--a large-scale multi-domain wizard-of-oz dataset for task-oriented dialogue modelling
Even though machine learning has become the major scene in dialogue research
community, the real breakthrough has been blocked by the scale of data available. To …
community, the real breakthrough has been blocked by the scale of data available. To …
Neural approaches to conversational AI
This tutorial surveys neural approaches to conversational AI that were developed in the last
few years. We group conversational systems into three categories:(1) question answering …
few years. We group conversational systems into three categories:(1) question answering …
A survey on text classification: From shallow to deep learning
Text classification is the most fundamental and essential task in natural language
processing. The last decade has seen a surge of research in this area due to the …
processing. The last decade has seen a surge of research in this area due to the …
Sequicity: Simplifying task-oriented dialogue systems with single sequence-to-sequence architectures
Existing solutions to task-oriented dialogue systems follow pipeline designs which
introduces architectural complexity and fragility. We propose a novel, holistic, extendable …
introduces architectural complexity and fragility. We propose a novel, holistic, extendable …
Sequential short-text classification with recurrent and convolutional neural networks
JY Lee, F Dernoncourt - arXiv preprint arXiv:1603.03827, 2016 - arxiv.org
Recent approaches based on artificial neural networks (ANNs) have shown promising
results for short-text classification. However, many short texts occur in sequences (eg …
results for short-text classification. However, many short texts occur in sequences (eg …
Find or classify? dual strategy for slot-value predictions on multi-domain dialog state tracking
Dialog state tracking (DST) is a core component in task-oriented dialog systems. Existing
approaches for DST mainly fall into one of two categories, namely, ontology-based and …
approaches for DST mainly fall into one of two categories, namely, ontology-based and …