Please use this identifier to cite or link to this item:
|A computer vision sensor for efficient object detection under varying lighting conditions
Lau, Genevieve Pui Shan
Tsao, Hoi Nok
|Cuhadar, C., Lau, G. P. S. & Tsao, H. N. (2021). A computer vision sensor for efficient object detection under varying lighting conditions. Advanced Intelligent Systems, 3(9), 2100055-. https://dx.doi.org/10.1002/aisy.202100055
|Advanced Intelligent Systems
|Convolutional neural networks (CNNs) have attracted much attention in recent years due to their outstanding performance in image classification. However, changes in lighting conditions can corrupt image segmentation conducted by CNN, leading to false object detection. Even though this problem can be mitigated using a more extensive CNN training set, the immense computational and energy resources required to continuously run CNNs during always-on applications, such as surveillance or self-navigation, pose a serious challenge for battery-reliant mobile systems. To tackle this longstanding problem, a vision sensor capable of autonomously correcting for sudden variations in light exposure, without invoking any complex object detection software, is proposed. Such video preprocessing is efficiently achieved using photovoltaic pixels tailored to be insensitive to specific ranges of light intensity alterations. In this way, the pixels behave similarly to neurons, wherein the execution of object detection software is only triggered when light intensities shift above a certain threshold value. This proof-of-concept device allows for efficient fault-tolerant object detection to be implemented with reduced training data as well as minimal energy and computational costs and demonstrates how hardware engineering can complement software algorithms to improve the overall energy efficiency of computer vision.
|School of Physical and Mathematical Sciences
|© 2021 The Authors. Advanced Intelligent Systems published by Wiley-VCH GmbH. This is an open access article under the terms of the Creative Commons Attribution License, which permits use, distribution and reproduction in any medium, provided the original work is properly cited.
|Appears in Collections:
|SPMS Journal Articles
Files in This Item:
|Advanced Intelligent Systems - 2021 - Cuhadar - A Computer Vision Sensor for Efficient Object Detection Under Varying.pdf
Web of ScienceTM
Updated on Oct 26, 2023
Updated on Feb 29, 2024
Updated on Feb 29, 2024
Items in DR-NTU are protected by copyright, with all rights reserved, unless otherwise indicated.