Please use this identifier to cite or link to this item:
Title: Dynamically growing neural network architecture for lifelong deep learning on the edge
Authors: Piyasena, Duvindu
Thathsara, Miyuru
Kanagarajah, Sathursan
Wu, Meiqing
Keywords: Embedded System
Engineering::Computer science and engineering
Issue Date: 2020
Source: Piyasena, D., Thathsara, M., Kanagarajah, S., Lam, S.-K., & Wu, M. (2020). Dynamically growing neural network architecture for lifelong deep learning on the edge. Proceedings of the 2020 30th International Conference on Field-Programmable Logic and Applications (FPL), 262-268. doi:10.1109/FPL50879.2020.00051
metadata.dc.contributor.conference: 2020 30th International Conference on Field-Programmable Logic and Applications (FPL)
Abstract: Conventional deep learning models are trained once and deployed. However, models deployed in agents operating in dynamic environments need to constantly acquire new knowledge, while preventing catastrophic forgetting of previous knowledge. This ability is commonly referred to as lifelong learning. In this paper, we address the performance and resource challenges for realizing lifelong learning on edge devices. We propose a FPGA based architecture for a Self-Organization Neural Network (SONN), that in combination with a Convolutional Neural Network (CNN) can perform class-incremental lifelong learning for object classification. The proposed SONN architecture is capable of performing unsupervised learning on input features from the CNN by dynamically growing neurons and connections. In order to meet the tight constraints of edge computing, we introduce efficient scheduling methods to maximize resource reuse and parallelism, as well as approximate computing strategies. Experiments based on the Core50 dataset for continuous object recognition from video sequences demonstrated that the proposed FPGA architecture significantly outperforms CPU and GPU based implementations.
ISBN: 9781728199023
DOI: 10.1109/FPL50879.2020.00051
Schools: School of Computer Science and Engineering 
Organisations: Technical University of Munich (TUM)
Research Centres: Campus for Research Excellence and Technological Enterprise (CREATE)
Rights: © 2020 IEEE. All rights reserved.
Fulltext Permission: none
Fulltext Availability: No Fulltext
Appears in Collections:SCSE Conference Papers

Citations 50

Updated on May 27, 2023

Web of ScienceTM
Citations 50

Updated on May 29, 2023

Page view(s)

Updated on May 31, 2023

Google ScholarTM




Items in DR-NTU are protected by copyright, with all rights reserved, unless otherwise indicated.