Improved image captioning via policy gradient optimization of spider

S Liu, Z Zhu, N Ye, S Guadarrama… - Proceedings of the …, 2017 - openaccess.thecvf.com
Current image captioning methods are usually trained via maximum likelihood estimation.
However, the log-likelihood score of a caption does not correlate well with human …

Learning to evaluate image captioning

Y Cui, G Yang, A Veit, X Huang… - Proceedings of the …, 2018 - openaccess.thecvf.com
Abstract Evaluation metrics for image captioning face two challenges. Firstly, commonly
used metrics such as CIDEr, METEOR, ROUGE and BLEU often do not correlate well with …

Discriminability objective for training descriptive captions

R Luo, B Price, S Cohen… - Proceedings of the …, 2018 - openaccess.thecvf.com
One property that remains lacking in image captions generated by contemporary methods is
discriminability: being able to tell two images apart given the caption for one of them. We …

Exploring nearest neighbor approaches for image captioning

J Devlin, S Gupta, R Girshick, M Mitchell… - arXiv preprint arXiv …, 2015 - arxiv.org
We explore a variety of nearest neighbor baseline approaches for image captioning. These
approaches find a set of nearest neighbor images in the training set from which a caption …

Describing like humans: on diversity in image captioning

Q Wang, AB Chan - … of the IEEE/CVF Conference on …, 2019 - openaccess.thecvf.com
Recently, the state-of-the-art models for image captioning have overtaken human
performance based on the most popular metrics, such as BLEU, METEOR, ROUGE and …

Deep reinforcement learning-based image captioning with embedding reward

Z Ren, X Wang, N Zhang, X Lv… - Proceedings of the IEEE …, 2017 - openaccess.thecvf.com
Image captioning is a challenging problem owing to the complexity in understanding the
image content and diverse ways of describing it in natural language. Recent advances in …

Rich image captioning in the wild

K Tran, X He, L Zhang, J Sun, C Carapcea… - Proceedings of the …, 2016 - cv-foundation.org
We present an image caption system that addresses new challenges of automatically
describing images in the wild. The challenges include generating high quality caption with …

Boosting image captioning with attributes

T Yao, Y Pan, Y Li, Z Qiu, T Mei - Proceedings of the IEEE …, 2017 - openaccess.thecvf.com
Automatically describing an image with a natural language has been an emerging
challenge in both fields of computer vision and natural language processing. In this paper …

Language models for image captioning: The quirks and what works

J Devlin, H Cheng, H Fang, S Gupta, L Deng… - arXiv preprint arXiv …, 2015 - arxiv.org
Two recent approaches have achieved state-of-the-art results in image captioning. The first
uses a pipelined process where a set of candidate words is generated by a convolutional …

Attend to you: Personalized image captioning with context sequence memory networks

C Chunseong Park, B Kim… - Proceedings of the IEEE …, 2017 - openaccess.thecvf.com
We address personalization issues of image captioning, which have not been discussed yet
in previous research. For a query image, we aim to generate a descriptive sentence …