Please use this identifier to cite or link to this item:
Title: Simulation with vision for embodied AI
Authors: Ye, Jieyi
Keywords: Engineering::Computer science and engineering::Software
Engineering::Computer science and engineering::Computer applications
Issue Date: 2022
Publisher: Nanyang Technological University
Source: Ye, J. (2022). Simulation with vision for embodied AI. Final Year Project (FYP), Nanyang Technological University, Singapore.
Abstract: This project is an embodied AI simulator development project, and it is divided into three stages: unity 3D simulator, C# webserver, and python API/GUI. The main objective of this project is to create an interactive platform as a testbed to conduct some cognitive experiments in an environment that simulates the real world. In the project’s first stage, a unity 3D simulator is proposed and developed to create a simulated multi-agent platform for virtual agents to navigate around and interact with the objects within. The simulator is embedded with a physics engine and contains models that replicate real-life objects. For the project’s next stage, a webserver is designed and developed to receive external requests to alter the simulator in real-time. The webserver is attached to the simulator and starts with the simulator to constantly monitor network requests and handle the requests correspondingly. For accessible communication with the simulator externally, a python API is created to allow interactions with the simulator via Python commands. A python GUI is designed to enable sending commands over by clicking buttons instead of explicitly writing codes to control the environment. Lastly, integrating the simulator, the webserver and the Python API is accomplished. By combining all the individual available actions in the simulator, two different modes are created – active learning mode and teaching mode to experiment with whether the baby agent will learn differently in those two modes.
Schools: School of Electrical and Electronic Engineering 
Organisations: Institute of Materials Research and Engineering, A*STAR
Fulltext Permission: restricted
Fulltext Availability: With Fulltext
Appears in Collections:EEE Student Reports (FYP/IA/PA/PI)

Files in This Item:
File Description SizeFormat 
  Restricted Access
3.11 MBAdobe PDFView/Open

Page view(s)

Updated on Sep 26, 2023


Updated on Sep 26, 2023

Google ScholarTM


Items in DR-NTU are protected by copyright, with all rights reserved, unless otherwise indicated.