Please use this identifier to cite or link to this item:
Title: Reinforcement learning for two-aircraft conflict resolution in the presence of uncertainty
Authors: Pham, Duc-Thinh
Tran, Ngoc Phu
Goh, Sim Kuan
Alam, Sameer
Duong, Vu
Keywords: Engineering::Aeronautical engineering
Issue Date: 2019
Source: Pham, D.-T., Tran, N. P., Goh, S. K., Alam, S., & Duong, V. (2019). Reinforcement learning for two-aircraft conflict resolution in the presence of uncertainty. Proceedings of the 2019 IEEE-RIVF International Conference on Computing and Communication Technologies (RIVF), 1-6. doi:10.1109/RIVF.2019.8713624
Abstract: Recently, the advances in reinforcement learning have enabled an artificial intelligent agent to solve many challenging problems (e.g. AlphaGo) at unprecedented levels. However, the robustness of reinforcement learning in safety critical operation remains unclear. In this work, the applicability of reinforcement learning in Air Traffic Control was explored. We focus on building an algorithm to automate flight conflict resolution which is the ultimate goal of air traffic control. For that purpose, a simulator, that provides a learning environment for reinforcement learning, was developed to simulate a variety of air traffic scenarios. We propose a variant of the reinforcement learning approach to resolve conflict in airspace and investigate the performance of the method in achieving that. A reinforcement learning model, specifically a deep deterministic policy gradient, was adopted to learn the conflict resolution with continuous action spaces. Experimental results demonstrate that our proposed method is effective in resolving the conflict between two aircraft even in the presence of uncertainty. The accuracy of our model is 87% at different uncertainty levels. Our findings suggest that reinforcement learning is a promising approach to conflict resolution.
ISBN: 978-1-5386-9313-1
DOI: 10.1109/RIVF.2019.8713624
Rights: © 2019 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work is available at:
Fulltext Permission: open
Fulltext Availability: With Fulltext
Appears in Collections:ATMRI Conference Papers

Files in This Item:
File Description SizeFormat 
RIVF19_RLforCR.pdf557.68 kBAdobe PDFThumbnail

Page view(s)

Updated on Jun 23, 2022

Download(s) 20

Updated on Jun 23, 2022

Google ScholarTM




Items in DR-NTU are protected by copyright, with all rights reserved, unless otherwise indicated.