Tanzania is one of the African countries endowed with diverse rangeland’s biological resources hosting 6 out of 25 globally known biodiversity hotspots. Despite, government efforts on biodiversity conservation, the pressures on rangelands’ biodiversity utilization are growing in line with increasing human population. With little recognition of contribution of local knowledge in biodiversity conservation, the current paper reviewed the potential of available indigenous knowledge in Tanzania and challenges limiting adoption of this vital knowledge on rangeland’s biodiversity conservation. This review established that, the country has rich indigenous knowledge potential for rangeland management and biodiversity conservation. Traditional enclosures and pastoral mobility are among the important indigenous practices used for rehabilitation of degraded rangelands and conservation of fragile ecosystems. The coexistence of local communities with complex ecosystems offers them excellent experiences on rangelands’ biodiversity conservation. However, increasingly loss of rangelands’ biodiversity in the country is attributed to ignoring the contribution of local communities which are rich in indigenous knowledge and skills on rangelands management. Among of the challenges hindering the adoption and involvement of indigenous knowledge to conservation are; scientific bias toward pastoral communities, loss of local expertise, poor knowledge inheritance systems, poverty, conflicts and emergence of pandemic diseases. For effective and sustainable utilisation of indigenous knowledge, the following are recommended; fully engagement of local communities in conservation process, empowering local communities to reduce poverty and conflicts, mainstreaming the indigenous knowledge to conservation education, emphasising on livelihoods diversification to reduce reliance on biological resources and promoting studies to document existing indigenous knowledge.