Broad-scale modification of natural ecosystems associated with urbanisation often leads to localised extinctions and reduced species richness. Despite this, habitats within the urban matrix are still capable of supporting biodiversity to varying degrees. As species have different responses to anthropogenic habitat modification, the species composition of urban areas can depend greatly on the habitat characteristics of the local and surrounding areas. The aim of this study was to compare the community composition of spiders in private gardens, urban parks, patches of remnant vegetation and continuous bushland sites, so as to identify habitat variables associated with variation in spider populations along and within the urban gradient and matrix. Overall spider abundances and richness were highest in remnant vegetation patches and were associated with increased vegetation cover at microhabitat and landscape-scales. While gardens were not as diverse as remnant patches, they did support a surprisingly high diversity of spiders. We also found that species composition differed significantly between gardens and other urban green spaces. Higher richness within gardens was also associated with greater vegetation cover, indicating the importance of private management decisions on local biodiversity. Differences in community composition between land-use types were driven by a small number of urban-tolerant species, and spider guilds showed different responses to habitat traits such as vegetation cover and human population densities. This study demonstrates that urban land-uses support unique spider communities and that maintaining vegetation cover within the urban matrix is essential in order to support diverse spider communities in cities.