Can machine translation systems be evaluated by the crowd alone

Y Graham, T Baldwin, A Moffat, J Zobel - Natural Language …, 2017 - cambridge.org
Crowd-sourced assessments of machine translation quality allow evaluations to be carried
out cheaply and on a large scale. It is essential, however, that the crowd's work be filtered to …

Generrate: Generating errors for use in grammatical error detection

J Foster, ØE Andersen - 2009 - doras.dcu.ie
This paper explores the issue of automatically generated ungrammatical data and its use in
error detection, with a focus on the task of classifying a sentence as grammatical or …

Reference-less measure of faithfulness for grammatical error correction

L Choshen, O Abend - arXiv preprint arXiv:1804.03824, 2018 - arxiv.org
We propose USim, a semantic measure for Grammatical Error Correction (GEC) that
measures the semantic faithfulness of the output to the source, thereby complementing …

Judging grammaticality: Experiments in sentence classification

J Wagner, J Foster, J van Genabith - Calico Journal, 2009 - JSTOR
ABSTRACT A classifier which is capable of distinguishing a syntactically well formed
sentence from a syntactically ill formed one has the potential to be useful in an L2 language …

Treebanks gone bad: Parser evaluation and retraining using a treebank of ungrammatical sentences

J Foster - International Journal of Document Analysis and …, 2007 - Springer
This article describes how a treebank of ungrammatical sentences can be created from a
treebank of well-formed sentences. The treebank creation procedure involves the automatic …

[PDF][PDF] An evaluation of parser robustness for ungrammatical sentences

HB Hashemi, R Hwa - Proceedings of the 2016 Conference on …, 2016 - aclanthology.org
For many NLP applications that require a parser, the sentences of interest may not be well-
formed. If the parser can overlook problems such as grammar mistakes and produce a parse …

[PS][PS] Good reasons for noting bad grammar: Empirical investigations into the parsing of ungrammatical written English

J Foster - 2005 - scss.tcd.ie
This thesis is concerned with the parsing of ungrammatical written English sentences. Over
a period of eighteen months, a 20,000 word corpus was developed which consists of …

[图书][B] Framework and resources for natural language parser evaluation

T Kakkonen - 2007 - books.google.com
Because of the wide variety of contemporary practices used in the automatic syntactic
parsing of natural languages, it has become necessary to analyze and evaluate the …

Robustness evaluation of two CCG, a PCFG and a link grammar parsers

T Kakkonen - arXiv preprint arXiv:0801.3817, 2008 - arxiv.org
Robustness in a parser refers to an ability to deal with exceptional phenomena. A parser is
robust if it deals with phenomena outside its normal range of inputs. This paper reports on a …

Automatic and unsupervised methods in natural language processing

J Bigert - 2005 - diva-portal.org
Natural language processing (NLP) means the computer-aided processing of language
produced by a human. But human language is inherently irregular and the most reliable …