Recovery of quantum states from measurements is an essential component in quantum information processing. In quantum optical systems, which naturally offer low decoherence and easy manipulation, quantum states are characterized by correlation measurements. When the states comprise more photons so as to encode more qubits, high-order correlation measurements are required. However, high-order correlations are hard to measure in experiments, as the rate of high-order coincidences decreases very fast when increasing the correlation order. This results in a poor signal-to-noise ratio. Likewise, the number of measurements required to characterize a quantum state increases exponentially with the increase in the number of qubits. Here, we use structure, present in most quantum states of interest (for quantum computing, cryptography, boson sampling, etc.), to recover the full quantum state of three photons from two-fold correlations in a single experimental setup.