BERTimbau: pretrained BERT models for Brazilian Portuguese

F Souza, R Nogueira, R Lotufo - … 2020, Rio Grande, Brazil, October 20–23 …, 2020 - Springer
Recent advances in language representation using neural networks have made it viable to
transfer the learned internal states of large pretrained language models (LMs) to …

BERT models for Brazilian Portuguese: Pretraining, evaluation and tokenization analysis

FC Souza, RF Nogueira, RA Lotufo - Applied Soft Computing, 2023 - Elsevier
Recent advances in language representation using neural networks have made it viable to
transfer the learned internal states of large pretrained language models (LMs) to …

Harnessing hybrid deep learning approach for personalized retrieval in e-learning

S Tahir, Y Hafeez, M Humayun, F Ahmad, M Khan… - PloS one, 2024 - journals.plos.org
The current worldwide pandemic has significantly increased the need for online learning
platforms, hence presenting difficulty in choosing appropriate course materials from the vast …

Impact of text specificity and size on word embeddings performance: An empirical evaluation in brazilian legal domain

TR Dal Pont, IC Sabo, JF Hübner, AJ Rover - Brazilian Conference on …, 2020 - Springer
Word embeddings is a text representation technique capable of capturing syntactic and
semantic linguistic patterns and of representing each word as an n-dimensional dense …

The HoPE model architecture: A novel approach to pregnancy information retrieval based on conversational agents

JLZ Montenegro, CA Da Costa - Journal of Healthcare Informatics …, 2022 - Springer
Conversational agents are used to communicating with humans in a friendly manner. To
achieve the highest level of performance, agents need to respond assertively and fastly …

A Use Case of Patent Classification Using Deep Learning with Transfer Learning

R Henriques, A Ferreira, M Castelli - Journal of Data and Information …, 2022 - sciendo.com
Purpose: Patent classification is one of the areas in Intellectual Property Analytics (IPA), and
a growing use case since the number of patent applications has been increasing worldwide …

User intent classification in noisy texts: an investigation on neural language models

P Blackman Sphaier, A Paes - Neural Computing and Applications, 2022 - Springer
User-generated content is a fundamental source of information to aid the decision-making in
several tasks, such as online marketing and follow-up intent response. Nonetheless, they …

Tracing semantic change in Portuguese: A distributional approach to adversative connectives

P Amaral, Z Tian, D Jarrett… - Journal of Historical …, 2023 - jbe-platform.com
This study uses word embeddings to investigate the semantic changes underlying the
creation of two adversative connectives in Portuguese, porém and mas 'but, however'. For …

Comparing contextual embeddings for semantic textual similarity in portuguese

JE Andrade Junior, J Cardoso-Silva… - Intelligent Systems: 10th …, 2021 - Springer
Semantic textual similarity (STS) measures how semantically similar two sentences are. In
the context of the Portuguese language, STS literature is still incipient but includes important …