In recent years, the growth in size of Transformer-based language models has accelerated
significantly. Global technology companies are training larger and larger models that require …

Recent large language models (LLM) exhibit sub-optimal performance on low-resource
languages, as the training data of these models is usually dominated by English and other …

Kivonat Az utóbbi években rendkívüli mértékben felgyorsult a Transformer alapú
nyelvmodellek méretének a növekedése. A globális technológiai cégek nagyobbnál …

Abstract The Winograd Schema Challenge (WSC, proposed by Levesque, Davis &
Morgenstern 2012) is considered to be the novel Turing Test to examine machine …

This paper explores the effectiveness of prompt programming in the fine-tuning process of a
Hungarian language model. The study builds on the prior success of prompt engineering in …

There are many important tasks in a conventional software development process which can
be supported by different analysis techniques. P4 is a high level domain-specific language …

In recent months, large language models have gained significant attention, with companies
striving to develop models capable of solving various natural language processing tasks …

Transformer-based NLP models have achieved state-of-the-art results in many NLP tasks
including text classification and text generation. However, the layers of these models do not …

In this paper, we introduce a machine reading comprehension model and how we built this
model from scratch. Reading comprehension is a crucial requisite for artificial intelligence …

Kivonat Hazánkban is megnőtt az érdeklődés a transzformer modellek alkalmazása iránt.
Éppen ezért a modern előtanítási standardoknak megfelelően (pl. dinamikus maszkolás …