Please use this identifier to cite or link to this item:
Title: Classification of deepfakes and ‘beautified’ media
Authors: Addi, Debashree
Keywords: Engineering::Computer science and engineering::Computing methodologies::Image processing and computer vision
Issue Date: 2021
Publisher: Nanyang Technological University
Source: Addi, D. (2021). Classification of deepfakes and ‘beautified’ media. Final Year Project (FYP), Nanyang Technological University, Singapore.
Project: SCSE20-0195
Abstract: Recently, videos and images have known to be manipulated using deep learning to generate fake videos and images which appear to be real, widely known as deepfakes. These deepfakes are a cause for high concern as they tend to disrupt the integrity of videos in the form of financial frauds, hoaxes and fake news. A lot of technologies have been developed to detect a video’s legitimacy, with relatively high accuracy. However, with upcoming increasingly intelligent AI systems to generate deepfakes, technology has proven to be inadequate to detect them. Along with deepfakes, another category, known as ‘beautified’ media, has also arisen as a result of digital manipulation. This media consists of images or videos that have been processed through addition of filters, makeup or smoothened skin. This ‘beautified’ media may be mistakenly classified as a deepfake, by deepfake detector algorithms whereas they are just real videos and images with an added filter. This creates a need to develop a model to accurately differentiate between ‘real’, ‘fake’ and ‘beautified’ media. In this study, the Keras-Xception model, which provides high accuracy, was used to attempt to classify digital media. The model was trained on the FaceForensics++ dataset, which comprises of both original and manipulated YouTube video sequences. The dataset was additionally augmented with ‘beautified’ versions of the same data, using the BeautyCamera application, to facilitate classification into the three main categories – ‘real’, ‘fake’ and ‘beautified’. Multiple Xception models were trained on different kinds of preprocessing of the FaceForensics++ dataset in order to make model comparisons and declare the best performing model. Finally, the classifier was developed with a high model accuracy of 89 percent and further tested on unseen data. Keywords - Deepfake detector, ‘beautified’ media, Keras-Xception model, BeautyCamera application
Fulltext Permission: restricted
Fulltext Availability: With Fulltext
Appears in Collections:SCSE Student Reports (FYP/IA/PA/PI)

Files in This Item:
File Description SizeFormat 
  Restricted Access
8.44 MBAdobe PDFView/Open

Page view(s)

Updated on May 17, 2022

Download(s) 50

Updated on May 17, 2022

Google ScholarTM


Items in DR-NTU are protected by copyright, with all rights reserved, unless otherwise indicated.