Please use this identifier to cite or link to this item:
Title: Towards robust video frame interpolation with long-term propagation
Authors: Huang, Ziqi
Keywords: Engineering::Electrical and electronic engineering
Engineering::Computer science and engineering
Issue Date: 2022
Publisher: Nanyang Technological University
Source: Huang, Z. (2022). Towards robust video frame interpolation with long-term propagation. Final Year Project (FYP), Nanyang Technological University, Singapore.
Abstract: Video frame interpolation aims at synthesizing non-existent frames between two consecutive frames in a video, and its importance can be seen from its wide applications in computer vision. The key to video frame interpolation is predicting the intermediate motions between two given frames so that the synthesized frames are coherent to the input video. The existing approaches of imposing assumptions on motions, such as linear and quadratic trajectories, are not generalizable to complex motions in real-world videos. In this project, we consider a different paradigm for robust and general motion prediction. To more thoroughly understand the motion trajectories, we propose to implicitly track the motion paths through long-term propagation. The motion features are then used to refine the motion predicted from the primitive motion assumptions. Our idea of motion propagation can be easily incorporated into existing video frame interpolation approaches. Quantitative and qualitative results demonstrate that our module is able to improve the performance of existing frame interpolation methods. In addition, we conduct analytical experiments to study the mechanism, advantages, and disadvantages of long-term propagation in video frame interpolation to inspire future works.
Schools: School of Electrical and Electronic Engineering 
Fulltext Permission: restricted
Fulltext Availability: With Fulltext
Appears in Collections:EEE Student Reports (FYP/IA/PA/PI)

Files in This Item:
File Description SizeFormat 
  Restricted Access
4.43 MBAdobe PDFView/Open

Page view(s)

Updated on Apr 18, 2024

Download(s) 50

Updated on Apr 18, 2024

Google ScholarTM


Items in DR-NTU are protected by copyright, with all rights reserved, unless otherwise indicated.