In this article, we present an effective real–time video surveillance system for real-life outdoor surveillance scenarios. The system integrates two different camera's behaviors: a static and a moving one. Static camera subsystem operates multiple object tracking and classification. Abnormal behaviors are detected using information about objects' routes. In case of a probable collision scenario, the operation of the moving camera subsystem initiates and a PID controller gives instructions at a pan/tilt mechanism in order to rotate the camera and record the activity. The approaches employed address properly the challenges that might arise in a typical outdoor scene, such as local and global lighting changes, variations in objects' appearance and occlusions.