CIDEr-R: Robust consensus-based image description evaluation

GO Santos, EL Colombini, S Avila - arXiv preprint arXiv:2109.13701, 2021 - arxiv.org
CIDEr-D, a traditional evaluation metric for image description, … We also show that CIDEr-D
has performance hampered by … lem, we introduce CIDEr-R, which improves CIDEr-D, making …

Image description generation algorithm based on improved attention mechanism

W LI, S ZENG, J WANG - Journal of Computer Applications, 2021 - joca.cn
… , the proposed improved image description generation model with attention … image
description task, and this model is better than the traditional model on all the four evaluation

[PDF][PDF] Human consensus-oriented image captioning

Z Wang, Z Huang, Y Luo - Proceedings of the Twenty-Ninth International …, 2021 - ijcai.org
… The consensus loss can be implemented in most of the image captioning models trained by
cross entropy loss. In this section, we briefly introduce two consensus-based models built on …

Technical Report of NICE Challenge at CVPR 2024: Caption Re-ranking Evaluation Using Ensembled CLIP and Consensus Scores

K Jeong, W Lee, W Nam, M Ma… - Proceedings of the …, 2024 - openaccess.thecvf.com
Cider: Consensus-based image description evaluation. In Proceedings of the IEEE … From
image descriptions to visual denotations: New similarity metrics for semantic inference over …

Consensus graph representation learning for better grounded image captioning

W Zhang, H Shi, S Tang, J Xiao, Q Yu… - Proceedings of the AAAI …, 2021 - ojs.aaai.org
… We design a consensus based method that aligns the visual graph to language graph
through a novel generative adversarial structure network, which aims to maintain the semantic …

Vision-enhanced and consensus-aware transformer for image captioning

S Cao, G An, Z Zheng, Z Wang - IEEE Transactions on Circuits …, 2022 - ieeexplore.ieee.org
… In this section, we briefly review existing works, mainly 141 focusing on three categories:
RNN-based image captioning, 142 Transformer-based image captioning, and knowledge-…

On diversity in image captioning: Metrics and methods

Q Wang, J Wan, AB Chan - IEEE Transactions on Pattern …, 2020 - ieeexplore.ieee.org
… In this section we review image captioning methods and their evaluation metrics. Compared
… more evaluation metric scores, such as L2E [32] and word mover distance (WMD) [38], [39]. …

Can audio captions be evaluated with image caption metrics?

Z Zhou, Z Zhang, X Xu, Z Xie, M Wu… - ICASSP 2022-2022 …, 2022 - ieeexplore.ieee.org
… Parikh, “Cider: Consensus-based image description evaluation,” in Proceedings of the IEEE
… Gould, “Spice: Semantic propositional image caption evaluation,” in European conference …

Compare and reweight: Distinctive image captioning using similar images sets

J Wang, W Xu, Q Wang, AB Chan - … , Glasgow, UK, August 23–28, 2020 …, 2020 - Springer
… the distinctiveness of image captions through training with sets of similar images. First… CIDEr
(CIDErBtw) to evaluate the distinctiveness of a caption with respect to those of similar images

Video description: Datasets & evaluation metrics

M Rafiq, G Rafiq, GS Choi - IEEE Access, 2021 - ieeexplore.ieee.org
… Encouraged by the accomplishment of image captioning and machine translation tasks, the
CIDEr is an evaluation protocol proposed to evaluate image description that uses human …