Recent work has shown that object-based video coding can provide higher coding gain than common H.264/AVC for single-view and the MVC standard based on H.264 for multi-view (MVC). The use of background sprites outperformes the AVC/MVC especially in sequences containing rotating camera motion and moving foreground objects. The coding performance strongly relies on the preprocessing steps, e.g. sprite generation and object segmentation. In this paper, we present an enhanced background sprite generation algorithm for object-based single- and multi-view video coding (OBVC/OBMVC). It is a new feature for our OBVC/OBMVC recently proposed. We produce multiple background sprites based on camera motion characterization and physical camera parameter estimation. Experimental results show how these multiple sprites increase the coding performance for single- and multi-view sequences.