Detection and tracking in the IBM people vision system

The detection and tracking of people lie at the heart of many current and near-future applications of computer vision. In this paper we describe a background subtraction system designed to detect moving objects in a wide variety of conditions, and a second system to detect objects moving in front of moving backgrounds. Detected foreground regions are tracked with a tracking system which can initiate real-time alarms and generates a Smart Surveillance Index which can be searched to nd interesting events in stored video.