Imagereward: Learning and evaluating human preferences for text-to-image generation
We present a comprehensive solution to learn and improve text-to-image models from
human preference feedback. To begin with, we build ImageReward---the first general …
human preference feedback. To begin with, we build ImageReward---the first general …
Holistic evaluation of text-to-image models
The stunning qualitative improvement of text-to-image models has led to their widespread
attention and adoption. However, we lack a comprehensive quantitative understanding of …
attention and adoption. However, we lack a comprehensive quantitative understanding of …
Vbench: Comprehensive benchmark suite for video generative models
Video generation has witnessed significant advancements yet evaluating these models
remains a challenge. A comprehensive evaluation benchmark for video generation is …
remains a challenge. A comprehensive evaluation benchmark for video generation is …
Fetv: A benchmark for fine-grained evaluation of open-domain text-to-video generation
Recently, open-domain text-to-video (T2V) generation models have made remarkable
progress. However, the promising results are mainly shown by the qualitative cases of …
progress. However, the promising results are mainly shown by the qualitative cases of …
Exposing flaws of generative model evaluation metrics and their unfair treatment of diffusion models
G Stein, J Cresswell, R Hosseinzadeh… - Advances in …, 2024 - proceedings.neurips.cc
We systematically study a wide variety of generative models spanning semantically-diverse
image datasets to understand and improve the feature extractors and metrics used to …
image datasets to understand and improve the feature extractors and metrics used to …
[HTML][HTML] Investigating students' cognitive processes in generative AI-assisted digital multimodal composing and traditional writing
Recently, generative artificial intelligence (AI)-powered chatbots such as ChatGPT and Bing
Chat have garnered increasing attention on a global scale. Previous studies have focused …
Chat have garnered increasing attention on a global scale. Previous studies have focused …
Evaluating text-to-visual generation with image-to-text generation
Despite significant progress in generative AI, comprehensive evaluation remains
challenging because of the lack of effective metrics and standardized benchmarks. For …
challenging because of the lack of effective metrics and standardized benchmarks. For …
Evaluating and Improving Compositional Text-to-Visual Generation
While text-to-visual models now produce photo-realistic images and videos they struggle
with compositional text prompts involving attributes relationships and higher-order …
with compositional text prompts involving attributes relationships and higher-order …
Rich human feedback for text-to-image generation
Abstract Recent Text-to-Image (T2I) generation models such as Stable Diffusion and Imagen
have made significant progress in generating high-resolution images based on text …
have made significant progress in generating high-resolution images based on text …
DOCCI: Descriptions of Connected and Contrasting Images
Vision-language datasets are vital for both text-to-image (T2I) and image-to-text (I2T)
research. However, current datasets lack descriptions with fine-grained detail that would …
research. However, current datasets lack descriptions with fine-grained detail that would …