Please use this identifier to cite or link to this item:
Title: TinyNAD: tiny network with augmentation and distillation on point cloud learning model
Authors: Yang, Zhiyuan
Keywords: Engineering::Electrical and electronic engineering
Issue Date: 2022
Publisher: Nanyang Technological University
Source: Yang, Z. (2022). TinyNAD: tiny network with augmentation and distillation on point cloud learning model. Master's thesis, Nanyang Technological University, Singapore.
Abstract: The development of practical applications, such as autonomous driving and robotics, has brought 3D point cloud data from LiDAR or RGB-D cameras to work as a good supplement to the sense of the environment than pure images. The utilization of point clouds with deep learning models is referred to as point-cloud learning. However, it is crucial work to deploy point-cloud learning models in IoT or edged devices with limited memory and computational resource. Rather than efficient network designing, our work applies model compression techniques to directly compress existing models with little accuracy drops. We propose a two-stage tiny model with Network Augmentation and Distillation (TinyNAD) and find that the tiny model after network augmentation is much easier for a teacher to distill. Compared with shrinking the parameters step by step like pruning or quantization, TinyNAD is pre-defining a tiny model and trying to improve its performance by introducing auxiliary supervision from augmented networks and the original model. We verify our method on PointNet++ using ModelNet40 3D shape classification dataset. Our tiny model is 58 times smaller than the original model, but with only 1.4% accuracy descent.
Schools: School of Electrical and Electronic Engineering 
Fulltext Permission: embargo_restricted_20240623
Fulltext Availability: With Fulltext
Appears in Collections:EEE Theses

Files in This Item:
File Description SizeFormat 
  Until 2024-06-23
3.29 MBAdobe PDFUnder embargo until Jun 23, 2024

Page view(s)

Updated on Feb 27, 2024

Google ScholarTM


Items in DR-NTU are protected by copyright, with all rights reserved, unless otherwise indicated.