… to generate image caption with impressive progress. To summarize the recent advances
in image captioning, we present a comprehensive review on image captioning, covering both …

… we associated a set of five textual descriptions: the first is the alternative text written by
the human contributors to the online encyclopedia Footnote 25 , while the other four are the …

… image captioning with human in the loop. Different from automated image captioning
where a given test image … , we have access to both the test image and a sequence of (incomplete) …

… As some alttexts are too long, we split them up by punctuation marks, such as period and
exclamation mark, and select the longest part. To filter out some rare or misspelled words, we …

… We measure CLIP-S’s capacity to reconstruct a set of 2.8K human judgments of alttext …
Each alt-text was rated on a scale of 0 to 3 in terms of its probable utility as an alt-text. While the …

… In this study, we explore contextual differences in image captioning based on the domain, …
general feedback about the process of image captioning, image captions, and the study, we …

… set a new SOTA for news image captioning. Our model can incorporate real-world knowledge
about entities across different modalities and generate text with better linguistic diversity. …

… image captioning models how “to read”, ie, allow us to design and train image captioning
algorithms which are able to process and include information from the text in the image. In …

… These problems are further exacerbated when models are trained directly on image-alt
text pairs collected from the internet. In this work, we show that it is possible to generate more …

… SMALLCAP, an image captioning model, prompted with captions retrieved from an external
datastore of text, based on the input image. This formulation of image captioning enables a …