A survey of controllable text generation using transformer-based pre-trained language models
Controllable Text Generation (CTG) is an emerging area in the field of natural language
generation (NLG). It is regarded as crucial for the development of advanced text generation …
generation (NLG). It is regarded as crucial for the development of advanced text generation …
A survey on task assignment in crowdsourcing
Quality improvement methods are essential to gathering high-quality crowdsourced data,
both for research and industry applications. A popular and broadly applicable method is task …
both for research and industry applications. A popular and broadly applicable method is task …
All that's' human'is not gold: Evaluating human evaluation of generated text
Human evaluations are typically considered the gold standard in natural language
generation, but as models' fluency improves, how well can evaluators detect and judge …
generation, but as models' fluency improves, how well can evaluators detect and judge …
Evaluation of text generation: A survey
A Celikyilmaz, E Clark, J Gao - arXiv preprint arXiv:2006.14799, 2020 - arxiv.org
The paper surveys evaluation methods of natural language generation (NLG) systems that
have been developed in the last few years. We group NLG evaluation methods into three …
have been developed in the last few years. We group NLG evaluation methods into three …
Exposing flaws of generative model evaluation metrics and their unfair treatment of diffusion models
We systematically study a wide variety of generative models spanning semantically-diverse
image datasets to understand and improve the feature extractors and metrics used to …
image datasets to understand and improve the feature extractors and metrics used to …
Empath: Understanding topic signals in large-scale text
Human language is colored by a broad range of topics, but existing text analysis tools only
focus on a small number of them. We present Empath, a tool that can generate and validate …
focus on a small number of them. We present Empath, a tool that can generate and validate …
Revolt: Collaborative crowdsourcing for labeling machine learning datasets
Crowdsourcing provides a scalable and efficient way to construct labeled datasets for
training machine learning systems. However, creating comprehensive label guidelines for …
training machine learning systems. However, creating comprehensive label guidelines for …
Credbank: A large-scale social media corpus with associated credibility annotations
Social media has quickly risen to prominence as a news source, yet lingering doubts remain
about its ability to spread rumor and misinformation. Systematically studying this …
about its ability to spread rumor and misinformation. Systematically studying this …
Street-level algorithms: A theory at the gaps between policy and decisions
A Alkhatib, M Bernstein - Proceedings of the 2019 CHI Conference on …, 2019 - dl.acm.org
Errors and biases are earning algorithms increasingly malignant reputations in society. A
central challenge is that algorithms must bridge the gap between high-level policy and on …
central challenge is that algorithms must bridge the gap between high-level policy and on …
A comprehensive study of image classification model sensitivity to foregrounds, backgrounds, and visual attributes
While datasets with single-label supervision have propelled rapid advances in image
classification, additional annotations are necessary in order to quantitatively assess how …
classification, additional annotations are necessary in order to quantitatively assess how …