The evolution of topic modeling

R Churchill, L Singh - ACM Computing Surveys, 2022 - dl.acm.org
Topic models have been applied to everything from books to newspapers to social media
posts in an effort to identify the most prevalent themes of a text corpus. We provide an in …

A survey on neural topic models: methods, applications, and challenges

X Wu, T Nguyen, AT Luu - Artificial Intelligence Review, 2024 - Springer
Topic models have been prevalent for decades to discover latent topics and infer topic
proportions of documents in an unsupervised fashion. They have been widely used in …

Topic modelling meets deep neural networks: A survey

H Zhao, D Phung, V Huynh, Y Jin, L Du… - arXiv preprint arXiv …, 2021 - arxiv.org
Topic modelling has been a successful technique for text analysis for almost twenty years.
When topic modelling met deep neural networks, there emerged a new and increasingly …

Topic-level sentiment analysis of social media data using deep learning

AR Pathak, M Pandey, S Rautaray - Applied Soft Computing, 2021 - Elsevier
Due to the inception of Web 2.0 and freedom to facilitate the dissemination of information,
sharing views, expressing opinions with regards to current world level events, services …

Is neural topic modelling better than clustering? An empirical study on clustering with contextual embeddings for topics

Z Zhang, M Fang, L Chen, MR Namazi-Rad - arXiv preprint arXiv …, 2022 - arxiv.org
Recent work incorporates pre-trained word embeddings such as BERT embeddings into
Neural Topic Models (NTMs), generating highly coherent topics. However, with high-quality …

Contrastive learning for neural topic model

T Nguyen, AT Luu - Advances in neural information …, 2021 - proceedings.neurips.cc
Recent empirical studies show that adversarial topic models (ATM) can successfully capture
semantic patterns of the document by differentiating a document with another dissimilar …

Effective neural topic modeling with embedding clustering regularization

X Wu, X Dong, TT Nguyen… - … Conference on Machine …, 2023 - proceedings.mlr.press
Topic models have been prevalent for decades with various applications. However, existing
topic models commonly suffer from the notorious topic collapsing: discovered topics …

Is automated topic model evaluation broken? the incoherence of coherence

A Hoyle, P Goel, A Hian-Cheong… - Advances in neural …, 2021 - proceedings.neurips.cc
Topic model evaluation, like evaluation of other unsupervised methods, can be contentious.
However, the field has coalesced around automated estimates of topic coherence, which …

Short text topic modeling with topic distribution quantization and negative sampling decoder

X Wu, C Li, Y Zhu, Y Miao - … of the 2020 Conference on Empirical …, 2020 - aclanthology.org
Topic models have been prevailing for many years on discovering latent semantics while
modeling long documents. However, for short texts they generally suffer from data sparsity …

Mitigating data sparsity for short text topic modeling by topic-semantic contrastive learning

X Wu, AT Luu, X Dong - arXiv preprint arXiv:2211.12878, 2022 - arxiv.org
To overcome the data sparsity issue in short text topic modeling, existing methods commonly
rely on data augmentation or the data characteristic of short texts to introduce more word co …