Intelligent visual surveillance system is quite different from traditional video surveillance. The most prominent characteristic of intelligent visual surveillance system is that it can reduce human interaction in maximal degree, enhance the efficiency of surveillance, and release the load of related people. Visual surveillance system in dynamic scenes consists of object detection, tracking, classification, recognition and abnormal behavior detection in real time.