Topic modeling algorithms and applications: A survey

A Abdelrazek, Y Eid, E Gawish, W Medhat, A Hassan - Information Systems, 2023 - Elsevier
Topic modeling is used in information retrieval to infer the hidden themes in a collection of
documents and thus provides an automatic means to organize, understand and summarize …

A survey of knowledge-enhanced text generation

W Yu, C Zhu, Z Li, Z Hu, Q Wang, H Ji… - ACM Computing …, 2022 - dl.acm.org
The goal of text-to-text generation is to make machines express like a human in many
applications such as conversation, summarization, and translation. It is one of the most …

Pre-training is a hot topic: Contextualized document embeddings improve topic coherence

F Bianchi, S Terragni, D Hovy - arXiv preprint arXiv:2004.03974, 2020 - arxiv.org
Topic models extract groups of words from documents, whose interpretation as a topic
hopefully allows for a better understanding of the data. However, the resulting word groups …

Topic modelling meets deep neural networks: A survey

H Zhao, D Phung, V Huynh, Y Jin, L Du… - arXiv preprint arXiv …, 2021 - arxiv.org
Topic modelling has been a successful technique for text analysis for almost twenty years.
When topic modelling met deep neural networks, there emerged a new and increasingly …

Large language models are latent variable models: Explaining and finding good demonstrations for in-context learning

X Wang, W Zhu, M Saxon… - Advances in Neural …, 2024 - proceedings.neurips.cc
In recent years, pre-trained large language models (LLMs) have demonstrated remarkable
efficiency in achieving an inference-time few-shot learning capability known as in-context …

Semi-amortized variational autoencoders

Y Kim, S Wiseman, A Miller… - … on Machine Learning, 2018 - proceedings.mlr.press
Amortized variational inference (AVI) replaces instance-specific local inference with a global
inference network. While AVI has enabled efficient training of deep generative models such …

T-bertsum: Topic-aware text summarization based on bert

T Ma, Q Pan, H Rong, Y Qian, Y Tian… - IEEE Transactions on …, 2021 - ieeexplore.ieee.org
In the era of social networks, the rapid growth of data mining in information retrieval and
natural language processing makes automatic text summarization necessary. Currently …

Topic memory networks for short text classification

J Zeng, J Li, Y Song, C Gao, MR Lyu, I King - arXiv preprint arXiv …, 2018 - arxiv.org
Many classification models work poorly on short texts due to data sparsity. To address this
issue, we propose topic memory networks for short text classification with a novel topic …

Short text topic modelling approaches in the context of big data: taxonomy, survey, and analysis

BAH Murshed, S Mallappa, J Abawajy… - Artificial Intelligence …, 2023 - Springer
Social media platforms such as (Twitter, Facebook, and Weibo) are being increasingly
embraced by individuals, groups, and organizations as a valuable source of information …

Contrastive learning for neural topic model

T Nguyen, AT Luu - Advances in neural information …, 2021 - proceedings.neurips.cc
Recent empirical studies show that adversarial topic models (ATM) can successfully capture
semantic patterns of the document by differentiating a document with another dissimilar …