Please use this identifier to cite or link to this item:
Title: Semantics-aware visual object tracking
Authors: Shen, Chunhua
Yao, Rui
Lin, Guosheng
Zhang, Yanning
Shi, Qinfeng
Keywords: Semantics
Engineering::Computer science and engineering
Visual Object Tracking
Issue Date: 2018
Source: Yao, R., Lin, G., Shen, C., Zhang, Y., & Shi, Q. (2019). Semantics-aware visual object tracking. IEEE Transactions on Circuits and Systems for Video Technology, 29(6), 1687-1700. doi:10.1109/TCSVT.2018.2848358
Series/Report no.: IEEE Transactions on Circuits and Systems for Video Technology
Abstract: In this paper, we propose a semantics-aware visual object tracking method, which introduces semantics into the tracking procedure and extends the model of an object with explicit semantics prior to enhancing the robustness of three key aspects of the tracking framework, i.e., appearance model, search scheme, and scale adaptation. We first present a semantic object proposal generation method for video sequences to generate high-quality category-oriented object proposals. Then, a hybrid semantics-aware tracking algorithm with semantic compatibility is proposed. This algorithm takes full advantages of globally sparse semantic object proposal prediction and locally dense prediction with a template model and semantic distractor-aware color appearance model. Furthermore, we propose to exploit semantics to localize object accurately via an energy minimization framework-based scale adaptation method, which jointly integrates dense location prior, instance-specific color, and category-specific semantic information. Extensive experiments are conducted on two widely used benchmarks, and the results demonstrate that our method achieves the state-of-the-art performance.
ISSN: 1051-8215
DOI: 10.1109/TCSVT.2018.2848358
Rights: © 2018 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works. The published version is available at:
Fulltext Permission: open
Fulltext Availability: With Fulltext
Appears in Collections:SCSE Journal Articles

Files in This Item:
File Description SizeFormat 
Semantics-Aware Visual Object Tracking.pdf9.47 MBAdobe PDFThumbnail

Google ScholarTM




Items in DR-NTU are protected by copyright, with all rights reserved, unless otherwise indicated.