Root‐associated fungi could play a role in determining both the positive relationship between plant diversity and productivity in experimental grasslands, and its strengthening over time. This hypothesis assumes that specialized pathogenic and mutualistic fungal communities gradually assemble over time, enhancing plant growth more in species‐rich than in species‐poor plots. To test this hypothesis, we used high‐throughput amplicon sequencing to characterize root‐associated fungal communities in experimental grasslands of 1 and 15 years of age with varying levels of plant species richness. Specifically, we tested whether the relationship between fungal communities and plant richness and productivity becomes stronger with the age of the experimental plots. Our results showed that fungal diversity increased with plant diversity, but this relationship weakened rather than strengthened over the two time points. Contrastingly, fungal community composition showed increasing associations with plant diversity over time, suggesting a gradual build‐up of specific fungal assemblages. Analyses of different fungal guilds showed that these changes were particularly marked in pathogenic fungi, whose shifts in relative abundance are consistent with the pathogen dilution hypothesis in diverse plant communities. Our results suggest that root‐associated fungal pathogens play more specific roles in determining the diversity–productivity relationship than other root‐associated plant symbionts.