TY - JOUR
T1 - Online multi-object tracking with efficient track drift and fragmentation handling
AU - Ju, Jaeyong
AU - Kim, Daehun
AU - Ku, Bonhwa
AU - Han, David K.
AU - Ko, Hanseok
N1 - Funding Information:
Brain Korea 21 Plus Project; Korea University (KU); Office of Naval Research Global (ONRG) (N62909-16-1-2185).
Publisher Copyright:
© 2017 Optical Society of America.
PY - 2017/2/1
Y1 - 2017/2/1
N2 - This paper addresses the problem of multi-object tracking in complex scenes by a single, static, uncalibrated camera. Tracking-by-detection is a widely used approach for multi-object tracking. Challenges still remain in complex scenes, however, when this approach has to deal with occlusions, unreliable detections (e.g., inaccurate position/size, false positives, or false negatives), and sudden object motion/appearance changes, among other issues. To handle these problems, this paper presents a novel online multi-object tracking method, which can be fully applied to real-time applications. First, an object tracking process based on frame-by-frame association with a novel affinity model and an appearance update that does not rely on online learning is proposed to effectively and rapidly assign detections to tracks. Second, a two-stage drift handling method with novel track confidence is proposed to correct drifting tracks caused by the abrupt motion change of objects under occlusion and prolonged inaccurate detections. In addition, a fragmentation handling method based on a track-to-track association is proposed to solve the problem in which an object trajectory is broken into several tracks due to long-term occlusions. Based on experimental results derived from challenging public data sets, the proposed method delivers an impressive performance compared with other state-of-the-art methods. Furthermore, additional performance analysis demonstrates the effect and usefulness of each component of the proposed method.
AB - This paper addresses the problem of multi-object tracking in complex scenes by a single, static, uncalibrated camera. Tracking-by-detection is a widely used approach for multi-object tracking. Challenges still remain in complex scenes, however, when this approach has to deal with occlusions, unreliable detections (e.g., inaccurate position/size, false positives, or false negatives), and sudden object motion/appearance changes, among other issues. To handle these problems, this paper presents a novel online multi-object tracking method, which can be fully applied to real-time applications. First, an object tracking process based on frame-by-frame association with a novel affinity model and an appearance update that does not rely on online learning is proposed to effectively and rapidly assign detections to tracks. Second, a two-stage drift handling method with novel track confidence is proposed to correct drifting tracks caused by the abrupt motion change of objects under occlusion and prolonged inaccurate detections. In addition, a fragmentation handling method based on a track-to-track association is proposed to solve the problem in which an object trajectory is broken into several tracks due to long-term occlusions. Based on experimental results derived from challenging public data sets, the proposed method delivers an impressive performance compared with other state-of-the-art methods. Furthermore, additional performance analysis demonstrates the effect and usefulness of each component of the proposed method.
UR - http://www.scopus.com/inward/record.url?scp=85011909709&partnerID=8YFLogxK
U2 - 10.1364/JOSAA.34.000280
DO - 10.1364/JOSAA.34.000280
M3 - Article
C2 - 28157856
AN - SCOPUS:85011909709
VL - 34
SP - 283
EP - 290
JO - Journal of the Optical Society of America A: Optics and Image Science, and Vision
JF - Journal of the Optical Society of America A: Optics and Image Science, and Vision
SN - 1084-7529
IS - 2
ER -