Extracting training data from diffusion models

N Carlini, J Hayes, M Nasr, M Jagielski… - 32nd USENIX Security …, 2023 - usenix.org
Image diffusion models such as DALL-E 2, Imagen, and Stable Diffusion have attracted
significant attention due to their ability to generate high-quality synthetic images. In this work …

Stablerep: Synthetic images from text-to-image models make strong visual representation learners

Y Tian, L Fan, P Isola, H Chang… - Advances in Neural …, 2024 - proceedings.neurips.cc
We investigate the potential of learning visual representations using synthetic images
generated by text-to-image models. This is a natural question in the light of the excellent …

Fake it till you make it: Learning transferable representations from synthetic imagenet clones

MB Sarıyıldız, K Alahari, D Larlus… - Proceedings of the …, 2023 - openaccess.thecvf.com
Recent image generation models such as Stable Diffusion have exhibited an impressive
ability to generate fairly realistic images starting from a simple text prompt. Could such …

Is synthetic data from generative models ready for image recognition?

R He, S Sun, X Yu, C Xue, W Zhang, P Torr… - arXiv preprint arXiv …, 2022 - arxiv.org
Recent text-to-image generation models have shown promising results in generating high-
fidelity photo-realistic images. Though the results are astonishing to human eyes, how …

Effective data augmentation with diffusion models

B Trabucco, K Doherty, M Gurinas… - arXiv preprint arXiv …, 2023 - arxiv.org
Data augmentation is one of the most prevalent tools in deep learning, underpinning many
recent advances, including those from classification, generative models, and representation …

Scaling laws of synthetic images for model training... for now

L Fan, K Chen, D Krishnan, D Katabi… - Proceedings of the …, 2024 - openaccess.thecvf.com
Recent significant advances in text-to-image models unlock the possibility of training vision
systems using synthetic images potentially overcoming the difficulty of collecting curated …

Learning vision from models rivals learning vision from data

Y Tian, L Fan, K Chen, D Katabi… - Proceedings of the …, 2024 - openaccess.thecvf.com
We introduce SynCLR a novel approach for learning visual representations exclusively from
synthetic images without any real data. We synthesize a large dataset of image captions …

Freemask: Synthetic images with dense annotations make stronger segmentation models

L Yang, X Xu, B Kang, Y Shi… - Advances in Neural …, 2024 - proceedings.neurips.cc
Semantic segmentation has witnessed tremendous progress due to the proposal of various
advanced network architectures. However, they are extremely hungry for delicate …

Leaving reality to imagination: Robust classification via generated datasets

H Bansal, A Grover - arXiv preprint arXiv:2302.02503, 2023 - arxiv.org
Recent research on robustness has revealed significant performance gaps between neural
image classifiers trained on datasets that are similar to the test set, and those that are from a …

Gan-supervised dense visual alignment

W Peebles, JY Zhu, R Zhang… - Proceedings of the …, 2022 - openaccess.thecvf.com
Abstract We propose GAN-Supervised Learning, a framework for learning discriminative
models and their GAN-generated training data jointly end-to-end. We apply our framework to …