To compress or not to compress—self-supervised learning and information theory: A review

R Shwartz Ziv, Y LeCun - Entropy, 2024 - mdpi.com
Deep neural networks excel in supervised learning tasks but are constrained by the need for
extensive labeled data. Self-supervised learning emerges as a promising alternative …

Factorized contrastive learning: Going beyond multi-view redundancy

PP Liang, Z Deng, MQ Ma, JY Zou… - Advances in …, 2024 - proceedings.neurips.cc
In a wide range of multimodal tasks, contrastive learning has become a particularly
appealing approach since it can successfully learn representations from abundant …

Anomaly detection requires better representations

T Reiss, N Cohen, E Horwitz, R Abutbul… - European Conference on …, 2022 - Springer
Anomaly detection seeks to identify unusual phenomena, a central task in science and
industry. The task is inherently unsupervised as anomalies are unexpected and unknown …

An information-theoretic perspective on variance-invariance-covariance regularization

R Shwartz-Ziv, R Balestriero, K Kawaguchi… - arXiv preprint arXiv …, 2023 - arxiv.org
In this paper, we provide an information-theoretic perspective on Variance-Invariance-
Covariance Regularization (VICReg) for self-supervised learning. To do so, we first …

ObjectDrop: Bootstrapping Counterfactuals for Photorealistic Object Removal and Insertion

D Winter, M Cohen, S Fruchter, Y Pritch… - arXiv preprint arXiv …, 2024 - arxiv.org
Diffusion models have revolutionized image editing but often generate images that violate
physical laws, particularly the effects of objects on the scene, eg, occlusions, shadows, and …

Invariant anomaly detection under distribution shifts: a causal perspective

J Carvalho, M Zhang, R Geyer… - Advances in …, 2024 - proceedings.neurips.cc
Anomaly detection (AD) is the machine learning task of identifying highly discrepant
abnormal samples by solely relying on the consistency of the normal training samples …

Red PANDA: Disambiguating image anomaly detection by removing nuisance factors

N Cohen, J Kahana, Y Hoshen - The Eleventh International …, 2023 - openreview.net
Anomaly detection methods strive to discover patterns that differ from the norm in a
meaningful way. This goal is ambiguous as different human operators may find different …

Red panda: Disambiguating anomaly detection by removing nuisance factors

N Cohen, J Kahana, Y Hoshen - arXiv preprint arXiv:2207.03478, 2022 - arxiv.org
Anomaly detection methods strive to discover patterns that differ from the norm in a semantic
way. This goal is ambiguous as a data point differing from the norm by an attribute eg, age …

Foundations of Multisensory Artificial Intelligence

PP Liang - arXiv preprint arXiv:2404.18976, 2024 - arxiv.org
Building multisensory AI systems that learn from multiple sensory inputs such as text,
speech, video, real-world sensors, wearable devices, and medical data holds great promise …

Transferring disentangled representations: bridging the gap between synthetic and real images

J Dapueto, N Noceti, F Odone - arXiv preprint arXiv:2409.18017, 2024 - arxiv.org
Developing meaningful and efficient representations that separate the fundamental structure
of the data generation mechanism is crucial in representation learning. However …