Turning a clip model into a scene text detector

W Yu, Y Liu, W Hua, D Jiang… - Proceedings of the …, 2023 - openaccess.thecvf.com
The recent large-scale Contrastive Language-Image Pretraining (CLIP) model has shown
great potential in various downstream tasks via leveraging the pretrained vision and …

Towards robust real-time scene text detection: From semantic to instance representation learning

X Qin, P Lyu, C Zhang, Y Zhou, K Yao… - Proceedings of the 31st …, 2023 - dl.acm.org
Due to the flexible representation of arbitrary-shaped scene text and simple pipeline, bottom-
up segmentation-based methods begin to be mainstream in real-time scene text detection …

Clipter: Looking at the bigger picture in scene text recognition

A Aberdam, D Bensaïd, A Golts… - Proceedings of the …, 2023 - openaccess.thecvf.com
Reading text in real-world scenarios often requires understanding the context surrounding it,
especially when dealing with poor-quality text. However, current scene text recognizers are …

Turning a clip model into a scene text spotter

W Yu, Y Liu, X Zhu, H Cao, X Sun… - IEEE Transactions on …, 2024 - ieeexplore.ieee.org
We exploit the potential of the large-scale Contrastive Language-Image Pretraining (CLIP)
model to enhance scene text detection and spotting tasks, transforming it into a robust …

Perceiving ambiguity and semantics without recognition: an efficient and effective ambiguous scene text detector

Y Shu, W Wang, Y Zhou, S Liu, A Zhang… - Proceedings of the 31st …, 2023 - dl.acm.org
Ambiguous scene text detection is an extremely challenging task. Existing text detectors that
rely solely on visual cues often suffer from confusion due to being evenly distributed in …

Less is more: Removing text-regions improves clip training efficiency and robustness

L Cao, B Zhang, C Chen, Y Yang, X Du… - arXiv preprint arXiv …, 2023 - arxiv.org
The CLIP (Contrastive Language-Image Pre-training) model and its variants are becoming
the de facto backbone in many applications. However, training a CLIP model from hundreds …

SCOB: Universal Text Understanding via Character-wise Supervised Contrastive Learning with Online Text Rendering for Bridging Domain Gap

D Kim, Y Kim, DH Kim, Y Lim… - Proceedings of the …, 2023 - openaccess.thecvf.com
Inspired by the great success of language model (LM)-based pre-training, recent studies in
visual document understanding have explored LM-based pre-training methods for modeling …

Hierarchical visual-semantic interaction for scene text recognition

L Diao, X Tang, J Wang, G Xie, J Hu - Information Fusion, 2024 - Elsevier
Proper interaction between visual and semantic features is crucial to obtain a powerful
feature representation for scene text recognition (STR). The existing interaction methods …

End-to-end semi-supervised approach with modulated object queries for table detection in documents

I Ehsan, T Shehzadi, D Stricker, MZ Afzal - International Journal on …, 2024 - Springer
Table detection, a pivotal task in document analysis, aims to precisely recognize and locate
tables within document images. Although deep learning has shown remarkable progress in …

Masked Text Modeling: A Self-Supervised Pre-training Method for Scene Text Detection

K Wang, H Xie, Y Wang, D Zhang, Y Qu, Z Gao… - Proceedings of the 31st …, 2023 - dl.acm.org
Scene text detection has made great progress recently with the wide use of pre-training.
Nonetheless, existing scene text detection methods still suffer from two problems: 1) Limited …