Llava-onevision: Easy visual task transfer
We present LLaVA-OneVision, a family of open large multimodal models (LMMs) developed
by consolidating our insights into data, models, and visual representations in the LLaVA …
by consolidating our insights into data, models, and visual representations in the LLaVA …
On the hidden mystery of ocr in large multimodal models
Large models have recently played a dominant role in natural language processing and
multimodal vision-language learning. However, their effectiveness in text-related visual …
multimodal vision-language learning. However, their effectiveness in text-related visual …
Mathematics intelligent tutoring systems with handwritten input: A scoping review
Abstract Intelligent Tutoring Systems (ITS) have been widely used to enhance math learning,
wherein teacher's involvement is prominent to achieve their full potential. Usually, ITSs …
wherein teacher's involvement is prominent to achieve their full potential. Usually, ITSs …
When counting meets HMER: counting-aware network for handwritten mathematical expression recognition
Recently, most handwritten mathematical expression recognition (HMER) methods adopt
the encoder-decoder networks, which directly predict the markup sequences from formula …
the encoder-decoder networks, which directly predict the markup sequences from formula …
Expanding performance boundaries of open-source multimodal models with model, data, and test-time scaling
We introduce InternVL 2.5, an advanced multimodal large language model (MLLM) series
that builds upon InternVL 2.0, maintaining its core model architecture while introducing …
that builds upon InternVL 2.0, maintaining its core model architecture while introducing …
Mmt-bench: A comprehensive multimodal benchmark for evaluating large vision-language models towards multitask agi
Large Vision-Language Models (LVLMs) show significant strides in general-purpose
multimodal applications such as visual dialogue and embodied navigation. However …
multimodal applications such as visual dialogue and embodied navigation. However …
Nvlm: Open frontier-class multimodal llms
We introduce NVLM 1.0, a family of frontier-class multimodal large language models (LLMs)
that achieve state-of-the-art results on vision-language tasks, rivaling the leading proprietary …
that achieve state-of-the-art results on vision-language tasks, rivaling the leading proprietary …
Exploring ocr capabilities of gpt-4v (ision): A quantitative and in-depth evaluation
This paper presents a comprehensive evaluation of the Optical Character Recognition
(OCR) capabilities of the recently released GPT-4V (ision), a Large Multimodal Model …
(OCR) capabilities of the recently released GPT-4V (ision), a Large Multimodal Model …
A survey on handwritten mathematical expression recognition: The rise of encoder-decoder and GNN models
Recognition of handwritten mathematical expressions (HMEs) has attracted growing interest
due to steady progress in handwriting recognition techniques and the rapid emergence of …
due to steady progress in handwriting recognition techniques and the rapid emergence of …
Texthawk2: A large vision-language model excels in bilingual ocr and grounding with 16x fewer tokens
Reading dense text and locating objects within images are fundamental abilities for Large
Vision-Language Models (LVLMs) tasked with advanced jobs. Previous LVLMs, including …
Vision-Language Models (LVLMs) tasked with advanced jobs. Previous LVLMs, including …