In this paper, we introduce a physical Internet architecture for fresh food distribution networks with the goal of meeting the key challenges of maximizing the freshness of the delivered product and minimizing waste. The physical Internet (PI) architecture is based on the fundamental assumptions of infrastructure sharing among various parties, standardized addressing of all entities and modularized operations. In this paper, we enhance the PI architecture by including a freshness metric and the space-efficient loading/unloading of heterogeneous perishable goods onto the trucks depending on their delivery requirements. We also discuss mechanisms for reducing empty miles of trucks and the carbon footprint of the logistics while reducing the driver’s away-from-home time for long distance delivery. Via extensive simulations, the paper shows that the proposed architecture reduces the driver’s away-from-home time by ∼93%, whereas it improves the food delivery freshness by ∼5%. We show that there is a clear tradeoff between the transportation efficiency of the trucks and the delivery freshness of the food packages.