In this article, modification of carbon fiber surface by carbon based nanofillers (multi‐walled carbon nanotubes [CNT], carbon nanofibers, and multi‐layered graphene) has been achieved by electrophoretic deposition technique to improve its interfacial bonding with epoxy matrix, with a target to improve the mechanical performance of carbon fiber reinforced polymer composites. Flexural and short beam shear properties of the composites were studied at extreme temperature conditions; in‐situ cryo, room and elevated temperature (−196, 30, and 120°C respectively). Laminate reinforced with CNT grafted carbon fibers exhibited highest delamination resistance with maximum improvement in flexural strength as well as in inter‐laminar shear strength (ILSS) among all the carbon fiber reinforced epoxy (CE) composites at all in‐situ temperatures. CNT modified CE composite showed increment of 9% in flexural strength and 17.43% in ILSS when compared to that of unmodified CE composite at room temperature (30°C). Thermomechanical properties were investigated using dynamic mechanical analysis. Fractography was also carried out to study different modes of failure of the composites.