Boosting image captioning with attributes

T Yao, Y Pan, Y Li, Z Qiu, T Mei - Proceedings of the IEEE …, 2017 - openaccess.thecvf.com
Automatically describing an image with a natural language has been an emerging
challenge in both fields of computer vision and natural language processing. In this paper …

Incorporating copying mechanism in image captioning for learning novel objects

T Yao, Y Pan, Y Li, T Mei - Proceedings of the IEEE …, 2017 - openaccess.thecvf.com
Image captioning often requires a large set of training image-sentence pairs. In practice,
however, acquiring sufficient training pairs is always expensive, making the recent …

Exploring visual relationship for image captioning

T Yao, Y Pan, Y Li, T Mei - Proceedings of the European …, 2018 - openaccess.thecvf.com
It is always well believed that modeling relationships between objects would be helpful for
representing and eventually describing an image. Nevertheless, there has not been …

Areas of attention for image captioning

M Pedersoli, T Lucas, C Schmid… - Proceedings of the …, 2017 - openaccess.thecvf.com
Abstract We propose" Areas of Attention", a novel attention-based model for automatic
image captioning. Our approach models the dependencies between image regions, caption …

Rich image captioning in the wild

K Tran, X He, L Zhang, J Sun, C Carapcea… - Proceedings of the …, 2016 - cv-foundation.org
We present an image caption system that addresses new challenges of automatically
describing images in the wild. The challenges include generating high quality caption with …

[PDF][PDF] Show, Observe and Tell: Attribute-driven Attention Model for Image Captioning.

H Chen, G Ding, Z Lin, S Zhao, J Han - IJCAI, 2018 - ijcai.org
Attribute-based approaches and attention-based approaches have been proven to be
effective in image captioning. However, most attribute-based approaches simply predict …

A comprehensive survey of deep learning for image captioning

MDZ Hossain, F Sohel, MF Shiratuddin… - ACM Computing Surveys …, 2019 - dl.acm.org
Generating a description of an image is called image captioning. Image captioning requires
recognizing the important objects, their attributes, and their relationships in an image. It also …

Deep reinforcement learning-based image captioning with embedding reward

Z Ren, X Wang, N Zhang, X Lv… - Proceedings of the IEEE …, 2017 - openaccess.thecvf.com
Image captioning is a challenging problem owing to the complexity in understanding the
image content and diverse ways of describing it in natural language. Recent advances in …

Reference based LSTM for image captioning

M Chen, G Ding, S Zhao, H Chen, Q Liu… - Proceedings of the AAAI …, 2017 - ojs.aaai.org
Image captioning is an important problem in artificial intelligence, related to both computer
vision and natural language processing. There are two main problems in existing methods …

Deep compositional captioning: Describing novel object categories without paired training data

LA Hendricks, S Venugopalan… - Proceedings of the …, 2016 - openaccess.thecvf.com
While recent deep neural network models have achieved promising results on the image
captioning task, they rely largely on the availability of corpora with paired image and …