Please use this identifier to cite or link to this item: https://hdl.handle.net/10356/78003
Title: Text-based image retrieval using image captioning
Authors: Tan, Kah Hwa
Keywords: DRNTU::Engineering::Electrical and electronic engineering
Issue Date: 2019
Abstract: Photo taking with smartphones has become a habitual act of the new generation of people. The newer smartphone models have huge storage capacity that we no longer need to organize the photo gallery. Each smartphone user could easily have a thousand or more photos accumulated throughout the years in their gallery which makes finding a photo a daunting task. This project aimed to develop a textual visual search for images utilizing Image Captioning. A thorough literature review was conducted to understand the latest techniques used in Image Captioning. A few comparisons were made before selecting the technique that is most reasonable and feasible to do. The model was trained, and evaluation was performed on well-known metrics to prove its feasibility. Next, A web-based photo gallery application was created with Django using the trained Image Captioning model as the backbone to realize the visual retrieval capability. The retrieval through the web application was develop with a robust searching function to handle human errors. The web application is also integrated with different recognition models to improve the relevancy of the images retrieved. The report contains the experimental results, the steps to develop the web application, how the integration is done between the graphical user interface (GUI) of the web application and Image Captioning model, the difficulties encountered while performing the tasks and a comparison of different searching function to retrieve relevant images. It concludes by discussing the potential of image captioning in performing visual retrieval task, the current limitations and possible future works.
URI: http://hdl.handle.net/10356/78003
Rights: Nanyang Technological University
Fulltext Permission: restricted
Fulltext Availability: With Fulltext
Appears in Collections:EEE Student Reports (FYP/IA/PA/PI)

Files in This Item:
File Description SizeFormat 
TanKahHwa_FYP_Final.pdf
  Restricted Access
Final FYP Report2.73 MBAdobe PDFView/Open

Google ScholarTM

Check

Items in DR-NTU are protected by copyright, with all rights reserved, unless otherwise indicated.