Heavy metals have always been a research hotspot due to their persistence, hazard and bioaccumulation. Microorganisms are highly sensitive to heavy metal pollution and play an important role in the material cycling and energy flow of the ecosystem. In order to further explore the influence of heavy metals on the diversity, composition, and function of microbial communities in the wetland sediment ecosystem, and to find suitable indicators to reflect heavy metal pollution status, we collected sediments from Huangjinxia nature reserve and determined the physicochemical properties, heavy metal (Cu, Cr, Ni, Pb, Zn, and Mn) concentrations, and microbial information. We found that: the contamination status of the study area stood at a moderate level evaluated by the pollution load index (PLI); heavy metals explained more of microbial community variation than the sediment physicochemical properties; in particular, Cr and Mn negatively affected microbial α-diversity; heavy metals significantly affected the structure of microbial communities, elements Cr, Pb, and Zn showed uniformly negative associations with the relative abundance of bacteria Nitrospirae (including class Nitrospira and order Nitrospirales), Bacteroidetes (including class Bacteroidia), and Verrucomicrobia; moreover, heavy metals affected predicted functions of microbial communities, including metabolic functions, genetic information processes, and functions related to the carbon cycle and the nitrogen cycle. Based on the relative abundance of sensitive microbial taxa and predicted functions, bioindicators [Bacteroidia], 1/[Nitrospira], 1/[Nitrification], and 1/[Aerobic nitrite oxidation] were established to reflect and predict the contamination status of heavy metals in sediments. Our in-depth research on the effects of heavy metals on microorganisms and the establishment of bioindicators provide references and new perspectives for environmental monitoring and management.