We propose a lensless diffuser-based microscope for 3D fluorescence microscopy from a single exposure. We use compressed sensing and a local convolution model to account for the system’s spatially-varying point spread functions in a computationally efficient manner.