Mm-llms: Recent advances in multimodal large language models
In the past year, MultiModal Large Language Models (MM-LLMs) have undergone
substantial advancements, augmenting off-the-shelf LLMs to support MM inputs or outputs …
substantial advancements, augmenting off-the-shelf LLMs to support MM inputs or outputs …
A survey on hallucination in large vision-language models
Recent development of Large Vision-Language Models (LVLMs) has attracted growing
attention within the AI landscape for its practical implementation potential. However,`` …
attention within the AI landscape for its practical implementation potential. However,`` …
Vila: On pre-training for visual language models
Visual language models (VLMs) rapidly progressed with the recent success of large
language models. There have been growing efforts on visual instruction tuning to extend the …
language models. There have been growing efforts on visual instruction tuning to extend the …
Mitigating object hallucinations in large vision-language models through visual contrastive decoding
Abstract Large Vision-Language Models (LVLMs) have advanced considerably intertwining
visual recognition and language understanding to generate content that is not only coherent …
visual recognition and language understanding to generate content that is not only coherent …
Rlhf-v: Towards trustworthy mllms via behavior alignment from fine-grained correctional human feedback
Abstract Multimodal Large Language Models (MLLMs) have recently demonstrated
impressive capabilities in multimodal understanding reasoning and interaction. However …
impressive capabilities in multimodal understanding reasoning and interaction. However …
Dress: Instructing large vision-language models to align and interact with humans via natural language feedback
We present DRESS a large vision language model (LVLM) that innovatively exploits Natural
Language feedback (NLF) from Large Language Models to enhance its alignment and …
Language feedback (NLF) from Large Language Models to enhance its alignment and …
LLaVA-: Efficient Multi-Modal Assistant with Small Language Model
In this paper, we introduce LLaVA-$\phi $(LLaVA-Phi), an efficient multi-modal assistant that
harnesses the power of the recently advanced small language model, Phi-2, to facilitate …
harnesses the power of the recently advanced small language model, Phi-2, to facilitate …
Hallucination of multimodal large language models: A survey
This survey presents a comprehensive analysis of the phenomenon of hallucination in
multimodal large language models (MLLMs), also known as Large Vision-Language Models …
multimodal large language models (MLLMs), also known as Large Vision-Language Models …
Risk taxonomy, mitigation, and assessment benchmarks of large language model systems
Large language models (LLMs) have strong capabilities in solving diverse natural language
processing tasks. However, the safety and security issues of LLM systems have become the …
processing tasks. However, the safety and security issues of LLM systems have become the …
Aligning modalities in vision large language models via preference fine-tuning
Instruction-following Vision Large Language Models (VLLMs) have achieved significant
progress recently on a variety of tasks. These approaches merge strong pre-trained vision …
progress recently on a variety of tasks. These approaches merge strong pre-trained vision …