It has been argued that the human cognitive system is capable of using spatial indexes or oculomotor coordinates to relieve working memory load (Ballard, D. H., Hayhoe, M. M., Pook, P. K., & Rao, R. P. N. (1997). Behavioral and Brain Sciences, 20(4), 723), track multiple moving items through occlusion (Scholl, D. J., & Pylyshyn, Z. W. (1999). Cognitive Psychology, 38, 259) or link incompatible cognitive and sensorimotor codes (Bridgeman, B., & Huemer, V. (1998). Consciousness and Cognition, 7, 454). Here we examine the use of such spatial information in memory for semantic information. Previous research has often focused on the role of task demands and the level of automaticity in the encoding of spatial location in memory tasks. We present five experiments where location is irrelevant to the task, and participants' encoding of spatial information is measured implicitly by their looking behavior during recall. In a paradigm developed from Spivey and Geng (Spivey, M. J., & Geng, J. (2000). submitted for publication), participants were presented with pieces of auditory, semantic information as part of an event occurring in one of four regions of a computer screen. In front of a blank grid, they were asked a question relating to one of those facts. Under certain conditions it was found that during the question period participants made significantly more saccades to the empty region of space where the semantic information had been previously presented. Our findings are discussed in relation to previous research on memory and spatial location, the dorsal and ventral streams of the visual system, and the notion of a cognitive-perceptual system using spatial indexes to exploit the stability of the external world.