Please use this identifier to cite or link to this item:
Title: A multi-agent reinforcement learning approach for flight speed control systems
Authors: Kanupriya, Malhotra
Keywords: Engineering::Aeronautical engineering::Air navigation
Engineering::Computer science and engineering::Computing methodologies::Simulation and modeling
Issue Date: 2022
Publisher: Nanyang Technological University
Source: Kanupriya, M. (2022). A multi-agent reinforcement learning approach for flight speed control systems. Final Year Project (FYP), Nanyang Technological University, Singapore.
Project: C053
Abstract: With increasing air traffic, there is an ever-growing need for Air Traffic Controllers (ATCO) to efficiently manage air traffic and congestion. Congestion often leads to increase in delays in the Terminal Maneuvering Area (TMA), which is one of the primary challenges that is being faced by ATCO. Introduction of approaches such as the Extended Arrival Manager (E-AMAN) propose solutions whereby flights are scheduled early, much before they enter the TMA, to absorb flight delays in the TMA that could potentially cause large amounts of fuel burn and have detrimental environmental impacts. However, for practical implications of such an approach, a speed management system is required, whereby, flights can coordinate to effectively absorb system-level delays in their en-route phase. This report proposes a Multi-Agent System (MAS) approach using Deep Reinforcement Learning to model and train flights as agents which can coordinate with each other to effectively absorb system-level delays. The simulations use MultiAgent POsthumous Credit Assignment (MA-POCA) in Unity to model flights as agents that are part of a cooperative MAS. Two reward approaches have been compared, where flights are either provided with complete penalty for exceeding the required delay, or partial penalty for exceeding the required delay. Findings highlight the percentage of maximum delay absorbed by each flight, along with the distribution of flight delay absorption in the flight plan. Initial testings reveal an average of 3.3 minutes of system-level delay absorptions from a required 4 minutes of delay.
Schools: School of Mechanical and Aerospace Engineering 
Research Centres: Air Traffic Management Research Institute 
Fulltext Permission: restricted
Fulltext Availability: With Fulltext
Appears in Collections:MAE Student Reports (FYP/IA/PA/PI)

Files in This Item:
File Description SizeFormat 
  Restricted Access
6.44 MBAdobe PDFView/Open

Page view(s)

Updated on Feb 21, 2024

Download(s) 50

Updated on Feb 21, 2024

Google ScholarTM


Items in DR-NTU are protected by copyright, with all rights reserved, unless otherwise indicated.