With the recent advances in the wireless network technologies as well as the explosive usage of small handheld appliances, multimedia streaming services for these appliances have become increasingly important. Caching in a multimedia streaming server is an effective way to improve the performance of streaming systems and reduce the service latency. In this paper, we propose a new multimedia data cache management scheme for different digital multimedia devices such as set-top box, personal digital assistants, etc. Our new scheme exploits the reference popularity of multimedia objects as well as the inter-arrival time between two consecutive requests on an identical object. It also considers the streaming rate of objects to provide QoS (quality of service) adaptive streaming service for various appliances. Through trace-driven simulations, we show that the proposed scheme improves the performance of multimedia streaming systems significantly.