Low Resolution Person Detection with a Moving Thermal Infrared Camera by Hot Spot Classification

Conference paper


Michael Teutsch
Thomas Müller
Marco Huber
Jürgen Beyerer


Proceedings of the 27th IEEE International Conference of Computer Vision and Pattern Recognition Workshops (CVPRW), 2014.


10th IEEE Workshop on Perception Beyond the Visible Spectrum (PBVS) in conjunction with CVPR 2014, Columbus, OH, USA, June 23 - 28, 2014

In many visual surveillance applications the task of person detection and localization can be solved easier by using thermal long-wave infrared (LWIR) cameras which are less affected by changing illumination or background texture than visual-optical cameras. Especially in outdoor scenes where usually only few hot spots appear in thermal infrared imagery, humans can be detected more reliably due to their prominent infrared signature. We propose a two-stage person recognition approach for LWIR images: (1) the application of Maximally Stable Extremal Regions (MSER) to detect hot spots instead of background subtraction or sliding window and (2) the verification of the detected hot spots using a Discrete Cosine Transform (DCT) based descriptor and a modified Random Naive Bayes (RNB) classifier. The main contributions are the novel modified RNB classifier and the generality of our method. We achieve high detection rates for several different LWIR datasets with low resolution videos in real-time. While many papers in this topic are dealing with strong constraints such as considering only one dataset, assuming a stationary camera, or detecting only moving persons, we aim at avoiding such constraints to make our approach applicable with moving platforms such as Unmanned Ground Vehicles (UGV).