Abstract-With a large number of video surveillance systems installed for the requirement from industrial security, the task of object tracking, which aims to locate objects of interest in videos, is very important. Although numerous tracking algorithms for RGB videos have been developed in the decade, the tracking performance and robustness of these systems may be degraded dramatically when the information from RGB video is unreliable (e.g., poor illumination conditions or very low resolution). To address this issue, this paper presents a new tracking system, which aims to combine the information from RGB and infrared modalities for object tracking. The proposed tracking systems is based on our proposed machine learning model. Particularly, the learning model can alleviate the modality discrepancy issue under the proposed modality consistency constraint from both representation patterns and discriminability, and generate discriminative feature templates for collaborative representations and discrimination in heterogeneous modalities. Experiments on a variety of challenging RGB-infrared videos demonstrate the effectiveness of the proposed algorithm. Index Terms-Multimodal sensor fusion, tracking system, video surveillance system.
Although gender recognition based on human body was not performed, previous research proposed a new tracking system which aims at fusing the information from RGB and infrared modalities based on machine learning model for object tracking REF .
Learning Modality-Consistency Feature Templates: A Robust RGB-Infrared Tracking System
IEEE Transactions on Industrial Electronics
IEEE Transactions on Industrial Electronics
Engineering Computer Science