Natural images, Gaussian mixtures and dead leaves

D Zoran, Y Weiss - Advances in Neural Information …, 2012 - proceedings.neurips.cc
Abstract Simple Gaussian Mixture Models (GMMs) learned from pixels of natural image
patches have been recently shown to be surprisingly strong performers in modeling the …

[PDF][PDF] Efficient learning and planning with compressed predictive states

W Hamilton, MM Fard, J Pineau - The Journal of Machine Learning …, 2014 - jmlr.org
Predictive state representations (PSRs) offer an expressive framework for modelling partially
observable systems. By compactly representing systems as functions of observable …

Unsupervised learning models of primary cortical receptive fields and receptive field plasticity

M Bhand, R Mudur, B Suresh… - Advances in neural …, 2011 - proceedings.neurips.cc
The efficient coding hypothesis holds that neural receptive fields are adapted to the statistics
of the environment, but is agnostic to the timescale of this adaptation, which occurs on both …

[PDF][PDF] A truncated EM approach for spike-and-slab sparse coding

AS Sheikh, JA Shelton, J Lücke - The Journal of Machine Learning …, 2014 - jmlr.org
We study inference and learning based on a sparse coding model with 'spike-and-slab'prior.
As in standard sparse coding, the model used assumes independent latent sources that …

[PDF][PDF] The Hierarchical Beta Process for Convolutional Factor Analysis and Deep Learning.

B Chen, G Polatkan, G Sapiro, DB Dunson, L Carin - ICML, 2011 - academia.edu
A convolutional factor-analysis model is developed, with the number of filters (factors)
inferred via the beta process (BP) and hierarchical BP, for single-task and multi-task …

Generic unsupervised optimization for a latent variable model with exponential family observables

H Mousavi, J Drefs, F Hirschberger, J Lücke - Journal of machine learning …, 2023 - jmlr.org
Latent variable models (LVMs) represent observed variables by parameterized functions of
latent variables. Prominent examples of LVMs for unsupervised learning are probabilistic …

Sparse coding models can exhibit decreasing sparseness while learning sparse codes for natural images

J Zylberberg, MR DeWeese - PLoS computational biology, 2013 - journals.plos.org
The sparse coding hypothesis has enjoyed much success in predicting response properties
of simple cells in primary visual cortex (V1) based solely on the statistics of natural scenes …

Spatio-chromatic adaptation via higher-order canonical correlation analysis of natural images

MU Gutmann, V Laparra, A Hyvärinen, J Malo - PloS one, 2014 - journals.plos.org
Independent component and canonical correlation analysis are two general-purpose
statistical methods with wide applicability. In neuroscience, independent component …

STRFs in primary auditory cortex emerge from masking-based statistics of natural sounds

AS Sheikh, NS Harper, J Drefs, Y Singer… - PLoS computational …, 2019 - journals.plos.org
We investigate how the neural processing in auditory cortex is shaped by the statistics of
natural sounds. Hypothesising that auditory cortex (A1) represents the structural primitives …

Autonomous document cleaning—a generative approach to reconstruct strongly corrupted scanned texts

Z Dai, J Luecke - IEEE transactions on pattern analysis and …, 2014 - ieeexplore.ieee.org
We study the task of cleaning scanned text documents that are strongly corrupted by dirt
such as manual line strokes, spilled ink, etc. We aim at autonomously removing such …