Polycrystalline graphene is a patchwork of coalescing graphene grains of varying lattice orientations and size, resulting from the chemical vapor deposition (CVD) growth at random nucleation sites on metallic substrates. The morphology of grain boundaries has become an important topic given its fundamental role in limiting the mobility of charge carriers in polycrystalline graphene, as compared to mechanically exfoliated samples. Here we report new insights to the current understanding of charge transport in polycrystalline geometries. We created realistic models of large CVD-grown graphene samples and then computed the corresponding charge carrier mobilities as a function of the average grain size and the coalescence quality between the grains. Our results reveal a remarkably simple scaling law for the mean free path and conductivity, correlated to atomic-scale charge density fluctuations along grain boundaries.