Please use this identifier to cite or link to this item: https://hdl.handle.net/10356/157646
Title: Towards robust video frame interpolation with long-term propagation
Authors: Huang, Ziqi
Keywords: Engineering::Electrical and electronic engineering
Engineering::Computer science and engineering
Issue Date: 2022
Publisher: Nanyang Technological University
Source: Huang, Z. (2022). Towards robust video frame interpolation with long-term propagation. Final Year Project (FYP), Nanyang Technological University, Singapore. https://hdl.handle.net/10356/157646
Abstract: Video frame interpolation aims at synthesizing non-existent frames between two consecutive frames in a video, and its importance can be seen from its wide applications in computer vision. The key to video frame interpolation is predicting the intermediate motions between two given frames so that the synthesized frames are coherent to the input video. The existing approaches of imposing assumptions on motions, such as linear and quadratic trajectories, are not generalizable to complex motions in real-world videos. In this project, we consider a different paradigm for robust and general motion prediction. To more thoroughly understand the motion trajectories, we propose to implicitly track the motion paths through long-term propagation. The motion features are then used to refine the motion predicted from the primitive motion assumptions. Our idea of motion propagation can be easily incorporated into existing video frame interpolation approaches. Quantitative and qualitative results demonstrate that our module is able to improve the performance of existing frame interpolation methods. In addition, we conduct analytical experiments to study the mechanism, advantages, and disadvantages of long-term propagation in video frame interpolation to inspire future works.
URI: https://hdl.handle.net/10356/157646
Fulltext Permission: restricted
Fulltext Availability: With Fulltext
Appears in Collections:EEE Student Reports (FYP/IA/PA/PI)

Files in This Item:
File Description SizeFormat 
HuangZiqi_FYP_Final_Report.pdf
  Restricted Access
4.43 MBAdobe PDFView/Open

Page view(s)

58
Updated on Dec 1, 2022

Download(s) 50

20
Updated on Dec 1, 2022

Google ScholarTM

Check

Items in DR-NTU are protected by copyright, with all rights reserved, unless otherwise indicated.