Please use this identifier to cite or link to this item: https://hdl.handle.net/10356/162992
Title: World model with PSR components
Authors: Tng, Jun Wei
Keywords: Engineering::Computer science and engineering::Computing methodologies::Artificial intelligence
Issue Date: 2022
Publisher: Nanyang Technological University
Source: Tng, J. W. (2022). World model with PSR components. Final Year Project (FYP), Nanyang Technological University, Singapore. https://hdl.handle.net/10356/162992
Project: SCSE21-0788
Abstract: The world model framework is a successful and compact model that can quickly learn the spatial and temporal representation of the environment and then the policy to solve the task. It comprises of three components – a VAE that compresses visual information to abstract representations, an internal model for predicting the next observation frame, and a controller that decides on an action based on its policy. We investigate the use of PSRNN as an alternative internal model for the world model framework. The model was evaluated on two different environments and its performance was compared to that of MDN-RNN. It was found that when visual data was encoded to small latent spaces, PSRNN performed better than MDN-RNN on both environments. However, both agents did not manage to solve the tasks in both environments, which were likely due to the limitation of the controller model in the world model framework.
URI: https://hdl.handle.net/10356/162992
Fulltext Permission: restricted
Fulltext Availability: With Fulltext
Appears in Collections:SCSE Student Reports (FYP/IA/PA/PI)

Files in This Item:
File Description SizeFormat 
FYP_TngJunWei.pdf
  Restricted Access
1.52 MBAdobe PDFView/Open

Page view(s)

17
Updated on Dec 3, 2022

Download(s)

1
Updated on Dec 3, 2022

Google ScholarTM

Check

Items in DR-NTU are protected by copyright, with all rights reserved, unless otherwise indicated.