A survey of active learning for natural language processing

Z Zhang, E Strubell, E Hovy - arXiv preprint arXiv:2210.10109, 2022 - arxiv.org
In this work, we provide a survey of active learning (AL) for its applications in natural
language processing (NLP). In addition to a fine-grained categorization of query strategies …

Conditionally adaptive multi-task learning: Improving transfer learning in nlp using fewer parameters & less data

J Pilault, A Elhattami, C Pal - arXiv preprint arXiv:2009.09139, 2020 - arxiv.org
Multi-Task Learning (MTL) networks have emerged as a promising method for transferring
learned knowledge across different tasks. However, MTL must deal with challenges such as …

On the importance of effectively adapting pretrained language models for active learning

K Margatina, L Barrault, N Aletras - arXiv preprint arXiv:2104.08320, 2021 - arxiv.org
Recent Active Learning (AL) approaches in Natural Language Processing (NLP) proposed
using off-the-shelf pretrained language models (LMs). In this paper, we argue that these LMs …

Semantic Role Labeling for Information Extraction on Indonesian Texts: A Literature Review

ADP Ariyanto, C Fatichah… - … International Seminar on …, 2023 - ieeexplore.ieee.org
The information extraction process includes Semantic Role Labeling (SRL) as one of its sub-
tasks. SRL aims to determine the semantic role of each entity within a sentence by …

Multi-task consistency for active learning

A Hekimoglu, P Friedrich, W Zimmer… - Proceedings of the …, 2023 - openaccess.thecvf.com
Learning-based solutions for vision tasks require a large amount of labeled training data to
ensure their performance and reliability. In single-task vision-based settings, inconsistency …

A Survey on Deep Active Learning: Recent Advances and New Frontiers

D Li, Z Wang, Y Chen, R Jiang, W Ding… - IEEE Transactions on …, 2024 - ieeexplore.ieee.org
Active learning seeks to achieve strong performance with fewer training samples. It does this
by iteratively asking an oracle to label newly selected samples in a human-in-the-loop …

MTAAL: multi-task adversarial active learning for medical named entity recognition and normalization

B Zhou, X Cai, Y Zhang, W Guo, X Yuan - Proceedings of the AAAI …, 2021 - ojs.aaai.org
Automated medical named entity recognition and normalization are fundamental for
constructing knowledge graphs and building QA systems. When it comes to medical text, the …

Multi-task active learning for pre-trained transformer-based models

G Rotman, R Reichart - Transactions of the Association for …, 2022 - direct.mit.edu
Multi-task learning, in which several tasks are jointly learned by a single model, allows NLP
models to share information from multiple annotations and may facilitate better predictions …

Bayesian active learning with pretrained language models

K Margatina, L Barrault, N Aletras - arXiv, 2021 - eprints.whiterose.ac.uk
Active Learning (AL) is a method to iteratively select data for annotation from a pool of
unlabeled data, aiming to achieve better model performance than random selection …

Combining Active Learning and Task Adaptation with BERT for Cost-Effective Annotation of Social Media Datasets

J Lemmens, W Daelemans - Proceedings of the 13th Workshop on …, 2023 - aclanthology.org
Social media provide a rich source of data that can be mined and used for a wide variety of
research purposes. However, annotating this data can be expensive, yet necessary for state …