Ammus: A survey of transformer-based pretrained models in natural language processing
KS Kalyan, A Rajasekharan, S Sangeetha - arXiv preprint arXiv …, 2021 - arxiv.org
Transformer-based pretrained language models (T-PTLMs) have achieved great success in
almost every NLP task. The evolution of these models started with GPT and BERT. These …
almost every NLP task. The evolution of these models started with GPT and BERT. These …
End-to-end transformer-based models in textual-based NLP
A Rahali, MA Akhloufi - AI, 2023 - mdpi.com
Transformer architectures are highly expressive because they use self-attention
mechanisms to encode long-range dependencies in the input sequences. In this paper, we …
mechanisms to encode long-range dependencies in the input sequences. In this paper, we …
Impact of tokenization on language models: An analysis for turkish
Tokenization is an important text preprocessing step to prepare input tokens for deep
language models. WordPiece and BPE are de facto methods employed by important …
language models. WordPiece and BPE are de facto methods employed by important …
IndoNLG: Benchmark and resources for evaluating Indonesian natural language generation
Natural language generation (NLG) benchmarks provide an important avenue to measure
progress and develop better NLG systems. Unfortunately, the lack of publicly available NLG …
progress and develop better NLG systems. Unfortunately, the lack of publicly available NLG …
Typhoon: Thai large language models
K Pipatanakul, P Jirabovonvisut, P Manakul… - arXiv preprint arXiv …, 2023 - arxiv.org
Typhoon is a series of Thai large language models (LLMs) developed specifically for the
Thai language. This technical report presents challenges and insights in developing Thai …
Thai language. This technical report presents challenges and insights in developing Thai …
Setar: Stacking ensemble learning for thai sentiment analysis using roberta and hybrid feature representation
P Thiengburanathum, P Charoenkwan - IEEE Access, 2023 - ieeexplore.ieee.org
Sentiment classification of social media posts is among the most challenging and time-
consuming tasks for analysts. This is particularly true when applied to languages that …
consuming tasks for analysts. This is particularly true when applied to languages that …
Offensive language and hate speech detection using deep learning in football news live streaming chat on YouTube in Thailand
P Pookpanich, T Siriborvornratanakul - Social Network Analysis and …, 2024 - Springer
Today, hate speech is frequently seen on Thai social media platforms such as Facebook,
Twitter, and even online video platforms such as YouTube. In live video broadcasts of …
Twitter, and even online video platforms such as YouTube. In live video broadcasts of …
Multi-label classification of symptom terms from free-text bilingual adverse drug reaction reports using natural language processing
S Chaichulee, C Promchai, T Kaewkomon… - PLoS …, 2022 - journals.plos.org
Allergic reactions to medication range from mild to severe or even life-threatening. Proper
documentation of patient allergy information is critical for safe prescription, avoiding drug …
documentation of patient allergy information is critical for safe prescription, avoiding drug …
An efficient deep learning for Thai sentiment analysis
N Khamphakdee, P Seresangtakul - Data, 2023 - mdpi.com
The number of reviews from customers on travel websites and platforms is quickly
increasing. They provide people with the ability to write reviews about their experience with …
increasing. They provide people with the ability to write reviews about their experience with …
Hidden emotional trends on social media regarding the Thailand–China high-speed railway project: A deep learning approach with ChatGPT integration
M Nokkaew, K Nongpong, T Yeophantong… - Social Network Analysis …, 2024 - Springer
Leveraging sentiment analysis on social media reveals hidden emotional trends by
providing deep insights into the public's collective opinions and feelings because social …
providing deep insights into the public's collective opinions and feelings because social …