We consider a layered system of fermionic molecules with permanent dipole moments aligned perpendicular to the layers by an external field. The dipole interactions between fermions in adjacent layers are attractive and induce interlayer pairing. Because of the competition for pairing among adjacent layers, the mean-field ground state of the layered system is a dimerized superfluid, with pairing only between every other layer. We construct an effective Ising- lattice model that describes the interplay between dimerization and superfluid phase fluctuations. In addition to the dimerized superfluid ground state, and high-temperature normal state, at intermediate temperature, we find an unusual dimerized “pseudogap” state with only short-range phase coherence. We propose light-scattering experiments to detect dimerization.