Please use this identifier to cite or link to this item:
https://hdl.handle.net/10356/80911
Title: | YoTube : searching action proposal via recurrent and static regression networks | Authors: | Zhu, Hongyuan Vial, Romain Lu, Shijian Peng, Xi Fu, Huazhu Tian, Yonghong Cao, Xianbin |
Keywords: | Object Detection DRNTU::Engineering::Computer science and engineering Image Sequence Analysis |
Issue Date: | 2018 | Source: | Zhu, H., Vial, R., Lu, S., Peng, X., Fu, H., Tian, Y., & Cao, X. (2018). YoTube : searching action proposal via recurrent and static regression networks. IEEE Transactions on Image Processing, 27(6), 2609-2622. doi:10.1109/TIP.2018.2806279 | Series/Report no.: | IEEE Transactions on Image Processing | Abstract: | In this paper, we propose YoTube-a novel deep learning framework for generating action proposals in untrimmed videos, where each action proposal corresponds to a spatial-temporal tube that potentially locates one human action. Most of the existing works generate proposals by clustering low-level features or linking image proposals, which ignore the interplay between long-term temporal context and short-term cues. Different from these works, our method considers the interplay by designing a new recurrent YoTube detector and static YoTube detector. The recurrent YoTube detector sequentially regresses candidate bounding boxes using Recurrent Neural Network learned long-term temporal contexts. The static YoTube detector produces bounding boxes using rich appearance cues in every single frame. To fully exploit the complementary appearance, motion, and temporal context, we train the recurrent and static detector using RGB (Color) and flow information. Moreover, we fuse the corresponding outputs of the detectors to produce accurate and robust proposal boxes and obtain the final action proposals by linking the proposal boxes using dynamic programming with a novel path trimming method. Benefiting from the pipeline of our method, the untrimmed video could be effectively and efficiently handled. Extensive experiments on the challenging UCF-101, UCF-Sports, and JHMDB datasets show superior performance of the proposed method compared with the state of the arts. | URI: | https://hdl.handle.net/10356/80911 http://hdl.handle.net/10220/48139 |
ISSN: | 1057-7149 | DOI: | 10.1109/TIP.2018.2806279 | Schools: | School of Computer Science and Engineering | Rights: | © 2018 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works. The published version is available at: https://doi.org/10.1109/TIP.2018.2806279. | Fulltext Permission: | open | Fulltext Availability: | With Fulltext |
Appears in Collections: | SCSE Journal Articles |
Files in This Item:
File | Description | Size | Format | |
---|---|---|---|---|
YoTube Searching Action Proposal via Recurrent and Static Regression Networks.pdf | 4.14 MB | Adobe PDF | View/Open |
SCOPUSTM
Citations
10
43
Updated on Mar 10, 2024
Web of ScienceTM
Citations
10
42
Updated on Oct 26, 2023
Page view(s)
333
Updated on Mar 18, 2024
Download(s) 50
107
Updated on Mar 18, 2024
Google ScholarTM
Check
Altmetric
Items in DR-NTU are protected by copyright, with all rights reserved, unless otherwise indicated.