Please use this identifier to cite or link to this item: https://hdl.handle.net/10356/174532
Title: Towards human-level artificial intelligence agents
Authors: Leung, Jonathan Cyril
Keywords: Computer and Information Science
Issue Date: 2024
Publisher: Nanyang Technological University
Source: Leung, J. C. (2024). Towards human-level artificial intelligence agents. Doctoral thesis, Nanyang Technological University, Singapore. https://hdl.handle.net/10356/174532
Abstract: Deep learning has provided a method to train large neural networks to learn a representation of data that best solves a given task without the need for manual feature engineering. The combination of Reinforcement Learning (RL) and deep learning, often referred to as Deep Reinforcement Learning (DRL), has resulted in agents that have achieved superhuman performance in some games. However, DRL can be difficult to apply in practice as it suffers from issues such as sample inefficiency, learning in sparse reward environments, and correct definition of reward functions. The removal of human intervention from the agent's training process has also led to agent behaviour that is unpredictable, uninterpretable, and potentially unsafe. In this work, we use Goal Net, a goal-oriented agent modelling methodology, as a way for agent designers to define an agent's goals and incorporate their prior knowledge about how an agent should achieve goals. As agents become more intelligent, the scenarios in which they can be used will increase, thus increasing the number of potential agent developers and designers. Goal Net uses goals as an abstraction of agent behaviour that can be understood by stakeholders who may have little knowledge about how to implement an agent. Goal Nets can be defined graphically, easing the design process for those who are unfamiliar with programming. We survey recent methods on defining and achieving goals, which include methods related to goal modelling and RL, and identify how the two areas are related. This is followed by an introduction of Goal Net in which we present a method for using Goal Nets for the customization of virtual assistants. Then, we present our method of combining Goal Net and DRL that addresses some of the issues with DRL discussed previously. Experimental results show that our method achieves better results than other methods that incorporate the same level of human knowledge. We then adapt and apply our method to a negotiation dialogue agent. We perform both automatic and human evaluation, and include ChatGPT in the human evaluation as a powerful language generation model to which we can compare. We identify problems with ChatGPT with regards to controllability and usability, and highlight how our proposed method helps mitigate these issues. Finally, we discuss potential future directions for this work and challenges that these directions may pose.
URI: https://hdl.handle.net/10356/174532
DOI: 10.32657/10356/174532
Schools: School of Computer Science and Engineering 
Research Centres: Joint NTU-UBC Research Centre of Excellence in Active Living for the Elderly (LILY) 
Rights: This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License (CC BY-NC 4.0).
Fulltext Permission: open
Fulltext Availability: With Fulltext
Appears in Collections:SCSE Theses

Files in This Item:
File Description SizeFormat 
thesis_jonathan_leung.pdf4.77 MBAdobe PDFThumbnail
View/Open

Page view(s)

169
Updated on Jul 20, 2024

Download(s)

196
Updated on Jul 20, 2024

Google ScholarTM

Check

Altmetric


Plumx

Items in DR-NTU are protected by copyright, with all rights reserved, unless otherwise indicated.