[PDF][PDF] Evaluating discourse annotation: Some recent insights and new approaches

J Hoek, M Scholman - Proceedings of the 13th Joint ISO-ACL …, 2017 - aclanthology.org
Annotated data is an important resource for the linguistics community, which is why
researchers need to be sure that such data are reliable. However, arriving at sufficiently …

QADiscourse--Discourse Relations as QA Pairs: Representation, Crowdsourcing and Baselines

V Pyatkin, A Klein, R Tsarfaty, I Dagan - arXiv preprint arXiv:2010.02815, 2020 - arxiv.org
Discourse relations describe how two propositions relate to one another, and identifying
them automatically is an integral part of natural language understanding. However …

[PDF][PDF] Discogem: A crowdsourced corpus of genre-mixed implicit discourse relations

M Scholman, D Tianai, F Yung… - the 13th Language …, 2022 - pure.mpg.de
DiscoGeM: A Crowdsourced Corpus of Genre-Mixed Implicit Discourse Relations Page 1
Proceedings of the 13th Conference on Language Resources and Evaluation (LREC 2022) …

Design choices for crowdsourcing implicit discourse relations: revealing the biases introduced by task design

V Pyatkin, F Yung, MCJ Scholman… - Transactions of the …, 2023 - direct.mit.edu
Disagreement in natural language annotation has mostly been studied from a perspective of
biases introduced by the annotators and the annotation frameworks. Here, we propose to …

KWJA: A unified Japanese analyzer based on foundation models

N Ueda, K Omura, T Kodama, H Kiyomaru… - Proceedings of the …, 2023 - aclanthology.org
We present KWJA, a high-performance unified Japanese text analyzer based on foundation
models. KWJA supports a wide range of tasks, including typo correction, word segmentation …

Examples and specifications that prove a point: Identifying elaborative and argumentative discourse relations

MCJ Scholman, V Demberg - Dialogue & Discourse, 2017 - journals.uic.edu
Examples and specifications occur frequently in text, but not much is known about how they
function in discourse and how readers interpret them. Looking at how they're annotated in …

Contextualized and generalized sentence representations by contrastive self-supervised learning: A case study on discourse relation analysis

H Kiyomaru, S Kurohashi - … of the 2021 Conference of the North …, 2021 - aclanthology.org
We propose a method to learn contextualized and generalized sentence representations
using contrastive self-supervised learning. In the proposed method, a model is given a text …

Crowdsourcing discourse relation annotations by a two-step connective insertion task

F Yung, V Demberg, M Scholman - Proceedings of the 13th …, 2019 - aclanthology.org
The perspective of being able to crowd-source coherence relations bears the promise of
acquiring annotations for new texts quickly, which could then increase the size and variety of …

Crowdsourcing discourse interpretations: On the influence of context and the reliability of a connective insertion task

M Scholman, V Demberg - Proceedings of the 11th linguistic …, 2017 - aclanthology.org
Traditional discourse annotation tasks are considered costly and time-consuming, and the
reliability and validity of these tasks is in question. In this paper, we investigate whether …

Design choices in crowdsourcing discourse relation annotations: The effect of worker selection and training

M Scholman, V Pyatkin, F Yung, I Dagan… - Proceedings of the …, 2022 - aclanthology.org
Obtaining linguistic annotation from novice crowdworkers is far from trivial. A case in point is
the annotation of discourse relations, which is a complicated task. Recent methods have …