Bringing order into the realm of Transformer-based language models for artificial intelligence and law

CM Greco, A Tagarelli - Artificial Intelligence and Law, 2023 - Springer
Transformer-based language models (TLMs) have widely been recognized to be a cutting-
edge technology for the successful development of deep-learning-based solutions to …

Extracting decision trees from medical texts: an overview of the Text2DT track in CHIP2022

W Zhu, W Li, X Wang, W Ji, Y Wu, J Chen… - China Health …, 2022 - Springer
This paper presents an overview of the Text2DT shared task 1 held in the CHIP-2022 shared
tasks. The shared task addresses the challenging topic of automatically extracting the …

Mer 2024: Semi-supervised learning, noise robustness, and open-vocabulary multimodal emotion recognition

Z Lian, H Sun, L Sun, Z Wen, S Zhang, S Chen… - Proceedings of the 2nd …, 2024 - dl.acm.org
Multimodal emotion recognition is an important research topic in artificial intelligence.
However, due to problems such as complex environments and inaccurate annotations …

Lert: A linguistically-motivated pre-trained language model

Y Cui, W Che, S Wang, T Liu - arXiv preprint arXiv:2211.05344, 2022 - arxiv.org
Pre-trained Language Model (PLM) has become a representative foundation model in the
natural language processing field. Most PLMs are trained with linguistic-agnostic pre …

Integrated mRNA sequence optimization using deep learning

H Gong, J Wen, R Luo, Y Feng, JJ Guo… - Briefings in …, 2023 - academic.oup.com
The coronavirus disease of 2019 pandemic has catalyzed the rapid development of mRNA
vaccines, whereas, how to optimize the mRNA sequence of exogenous gene such as …

A novel feature integration and entity boundary detection for named entity recognition in cybersecurity

X Wang, J Liu - Knowledge-Based Systems, 2023 - Elsevier
Owing to continuous cyberattacks, a large amount of threat intelligence is generated online
every day. However, threat intelligence is mostly unstructured and multisource …

Merbench: A unified evaluation benchmark for multimodal emotion recognition

Z Lian, L Sun, Y Ren, H Gu, H Sun, L Chen… - arXiv preprint arXiv …, 2024 - arxiv.org
Multimodal emotion recognition plays a crucial role in enhancing user experience in human-
computer interaction. Over the past few decades, researchers have proposed a series of …

Contrastive knowledge integrated graph neural networks for Chinese medical text classification

G Lan, M Hu, Y Li, Y Zhang - Engineering Applications of Artificial …, 2023 - Elsevier
This paper aims at medical text classification, where texts describe medicines, diseases, or
other medical topics. This field is still challenging since medical texts contain intensive …

Position prediction as an effective pretraining strategy

S Zhai, N Jaitly, J Ramapuram, D Busbridge… - arXiv preprint arXiv …, 2022 - arxiv.org
Transformers have gained increasing popularity in a wide range of applications, including
Natural Language Processing (NLP), Computer Vision and Speech Recognition, because of …

IDOL: indicator-oriented logic pre-training for logical reasoning

Z Xu, Z Yang, Y Cui, S Wang - arXiv preprint arXiv:2306.15273, 2023 - arxiv.org
In the field of machine reading comprehension (MRC), existing systems have surpassed the
average performance of human beings in many tasks like SQuAD. However, there is still a …