In this paper, we show that speckle averaging helps to improve adaptive-optics (AO) performance in closed loop as a result of reduced measurement error associated with a Shack–Hartmann wavefront sensor (SHWFS); however, this reduction is rendered ineffective with increasing beacon anisoplanatism. We do so operating in a weak-scintillation regime, where the SHWFS offers robust performance, and using in-plane translation of the illuminated rough surface to accomplish frame-to-frame speckle diversity. Understanding these trade-space limitations is critical when performing AO with non-cooperative, extended-source beacons.