Vision-language pre-training: Basics, recent advances, and future trends
This monograph surveys vision-language pre-training (VLP) methods for multimodal
intelligence that have been developed in the last few years. We group these approaches …
intelligence that have been developed in the last few years. We group these approaches …
Recent advances and clinical applications of deep learning in medical image analysis
Deep learning has received extensive research interest in developing new medical image
processing algorithms, and deep learning based models have been remarkably successful …
processing algorithms, and deep learning based models have been remarkably successful …
Tip-adapter: Training-free adaption of clip for few-shot classification
Abstract Contrastive Vision-Language Pre-training, known as CLIP, has provided a new
paradigm for learning visual representations using large-scale image-text pairs. It shows …
paradigm for learning visual representations using large-scale image-text pairs. It shows …
Perceiver io: A general architecture for structured inputs & outputs
A central goal of machine learning is the development of systems that can solve many
problems in as many data domains as possible. Current architectures, however, cannot be …
problems in as many data domains as possible. Current architectures, however, cannot be …
Tip-adapter: Training-free clip-adapter for better vision-language modeling
Contrastive Vision-Language Pre-training, known as CLIP, has provided a new paradigm for
learning visual representations by using large-scale contrastive image-text pairs. It shows …
learning visual representations by using large-scale contrastive image-text pairs. It shows …
Frozen in time: A joint video and image encoder for end-to-end retrieval
Our objective in this work is video-text retrieval-in particular a joint embedding that enables
efficient text-to-video retrieval. The challenges in this area include the design of the visual …
efficient text-to-video retrieval. The challenges in this area include the design of the visual …
4d-fy: Text-to-4d generation using hybrid score distillation sampling
Recent breakthroughs in text-to-4D generation rely on pre-trained text-to-image and text-to-
video models to generate dynamic 3D scenes. However current text-to-4D methods face a …
video models to generate dynamic 3D scenes. However current text-to-4D methods face a …
Chatcad: Interactive computer-aided diagnosis on medical image using large language models
Large language models (LLMs) have recently demonstrated their potential in clinical
applications, providing valuable medical knowledge and advice. For example, a large dialog …
applications, providing valuable medical knowledge and advice. For example, a large dialog …
A comprehensive survey on community detection with deep learning
Detecting a community in a network is a matter of discerning the distinct features and
connections of a group of members that are different from those in other communities. The …
connections of a group of members that are different from those in other communities. The …
From show to tell: A survey on deep learning-based image captioning
Connecting Vision and Language plays an essential role in Generative Intelligence. For this
reason, large research efforts have been devoted to image captioning, ie describing images …
reason, large research efforts have been devoted to image captioning, ie describing images …