This comprehensive state-of-the-art book is the first devoted to the important and timely
issue of evaluating NLP systems. It addresses the whole area of NLP system evaluation …

Abstract Machine Translation (MT) is being deployed for a range of use-cases by millions of
people on a daily basis. There should, therefore, be no doubt as to the utility of MT …

The TSNLP project has investigated various aspects of the construction, maintenance and
application of systematic test suites as diagnostic and evaluation tools for NLP applications …

Big data analytics (BDA) is an advanced analytic technique used with very large and diverse
sets of data from different sources. Natural language processing (NLP) is a technology that …

We present an analysis of 16 state-of-the-art MT systems on German-English based on a
linguistically-motivated test suite. The test suite has been devised manually by a team of …

Given the growing number of natural language applications, there is an increasing demand
for reference data other than the type of data found in large collections of text corpora. Test …

With the constant growth of user-generated content (UGC) online, the demand for quick
translations of large volumes of texts increases. This is often met with a combination of …

While there is general agreement about the basic features of machine translation (MT)
evaluation (as reflected in general introductory texts Lehrberger & Bourbeau, 1988; Hutchins …

Given the rich body of technical developments and a relatively long history of industrial use
of Machine Translation (MT), it is astonishing of how little interest the topic of MT quality has …

In the past few years, free and readily available Webbased machine translation (MT)
services have appeared that can meet the needs of fast, informal translation needs …