Please use this identifier to cite or link to this item:
Title: Collaborative semantic understanding and mapping framework for autonomous systems
Authors: Yue, Yufeng
Zhao, Chunyang
Wu, Zhenyu
Yang, Chule
Wang, Yuanzhe
Wang, Danwei
Keywords: Engineering::Electrical and electronic engineering
Issue Date: 2020
Source: Yue, Y., Zhao, C., Wu, Z., Yang, C., Wang, Y. & Wang, D. (2020). Collaborative semantic understanding and mapping framework for autonomous systems. IEEE/ASME Transactions On Mechatronics, 26(2), 978-989.
Journal: IEEE/ASME Transactions on Mechatronics
Abstract: Performing collaborative semantic mapping is a critical challenge for cooperative robots to enhance their comprehensive contextual understanding of the surroundings. This paper bridges the gap between the advances in collaborative geometry mapping that relies on pure geometry information fusion, and single robot semantic mapping that focuses on integrating continuous raw sensor data. In this paper, a novel hierarchical collaborative probabilistic semantic mapping framework is proposed, where the problem is formulated in a distributed setting. The key novelty of this work is the modelling of the hierarchical semantic map fusion framework and its mathematical derivation of its probability decomposition. At the single robot level, the semantic point cloud is obtained by combining information from heterogeneous sensors and used to generate local semantic maps. At the collaborative robots level, local maps are shared among robots for global semantic map fusion. Since the voxel correspondence is unknown between local maps, an Expectation-Maximization approach is proposed to estimate the hidden data association. Then, Bayesian rule is applied to perform semantic and occupancy probability update. Experimental results on the UAV (Unmanned Aerial Vehicle) and the UGV (Unmanned Ground Vehicle) platforms show the high quality of global semantic maps, demonstrating the accuracy andutility in practical missions.
ISSN: 1083-4435
DOI: 10.1109/TMECH.2020.3015054
Schools: School of Electrical and Electronic Engineering 
Research Centres: ST Engineering-NTU Corporate Lab 
Rights: © 2020 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works. The published version is available at:
Fulltext Permission: open
Fulltext Availability: With Fulltext
Appears in Collections:EEE Journal Articles

Citations 20

Updated on Dec 8, 2023

Web of ScienceTM
Citations 10

Updated on Oct 28, 2023

Page view(s)

Updated on Dec 7, 2023

Download(s) 50

Updated on Dec 7, 2023

Google ScholarTM




Items in DR-NTU are protected by copyright, with all rights reserved, unless otherwise indicated.