Generative Visual Instruction Tuning
J Hernandez, R Villegas, V Ordonez - arXiv preprint arXiv:2406.11262, 2024 - arxiv.org
We propose to use machine-generated instruction-following data to improve the zero-shot
capabilities of a large multimodal model with additional support for generative and image …
capabilities of a large multimodal model with additional support for generative and image …
Visual instruction tuning
Instruction tuning large language models (LLMs) using machine-generated instruction-
following data has been shown to improve zero-shot capabilities on new tasks, but the idea …
following data has been shown to improve zero-shot capabilities on new tasks, but the idea …
Stablellava: Enhanced visual instruction tuning with synthesized image-dialogue data
The remarkable multimodal capabilities demonstrated by OpenAI's GPT-4 have sparked
significant interest in the development of multimodal Large Language Models (LLMs). A …
significant interest in the development of multimodal Large Language Models (LLMs). A …
Mimic-it: Multi-modal in-context instruction tuning
High-quality instructions and responses are essential for the zero-shot performance of large
language models on interactive natural language tasks. For interactive vision-language …
language models on interactive natural language tasks. For interactive vision-language …
Behind the magic, merlim: Multi-modal evaluation benchmark for large image-language models
Large Vision and Language Models have enabled significant advances in fully supervised
and zero-shot vision tasks. These large pre-trained architectures serve as the baseline to …
and zero-shot vision tasks. These large pre-trained architectures serve as the baseline to …
CoDi-2: In-Context Interleaved and Interactive Any-to-Any Generation
Abstract We present CoDi-2 a Multimodal Large Language Model (MLLM) for learning in-
context interleaved multimodal representations. By aligning modalities with language for …
context interleaved multimodal representations. By aligning modalities with language for …
Pandagpt: One model to instruction-follow them all
We present PandaGPT, an approach to emPower large lANguage moDels with visual and
Auditory instruction-following capabilities. Our pilot experiments show that PandaGPT can …
Auditory instruction-following capabilities. Our pilot experiments show that PandaGPT can …
Guiding instruction-based image editing via multimodal large language models
Instruction-based image editing improves the controllability and flexibility of image
manipulation via natural commands without elaborate descriptions or regional masks …
manipulation via natural commands without elaborate descriptions or regional masks …
Kosmos-g: Generating images in context with multimodal large language models
Recent advancements in text-to-image (T2I) and vision-language-to-image (VL2I)
generation have made significant strides. However, the generation from generalized vision …
generation have made significant strides. However, the generation from generalized vision …
MiniGPT-Reverse-Designing: Predicting Image Adjustments Utilizing MiniGPT-4
V Azizi, F Koochaki - arXiv preprint arXiv:2406.00971, 2024 - arxiv.org
Vision-Language Models (VLMs) have recently seen significant advancements through
integrating with Large Language Models (LLMs). The VLMs, which process image and text …
integrating with Large Language Models (LLMs). The VLMs, which process image and text …