Please use this identifier to cite or link to this item: https://hdl.handle.net/10356/162843
Title: Vision-based tangible maths tutor
Authors: Toh, Jun Wei
Keywords: Engineering::Computer science and engineering
Issue Date: 2022
Publisher: Nanyang Technological University
Source: Toh, J. W. (2022). Vision-based tangible maths tutor. Final Year Project (FYP), Nanyang Technological University, Singapore. https://hdl.handle.net/10356/162843
Abstract: Object detection techniques have been improving over the past several years and they have seen many applications in various domains. However, the early childhood education domain is one that has been relatively unexplored. This project contributes by exploring the use of object detection in early childhood education. A tangible user interface-based learning system was developed for young children to learn mathematics from. The system, called VTMT, uses a set of tangible manipulatives for interacting with the system. A YOLOv4-tiny object detection model was trained to detect these tangible manipulatives and deployed in a mobile application. The model was able to achieve a very high accuracy of more than 95%, thus ensuring the reliability of the system for learning. The mobile application serves as a tutor, recognising the manipulatives children had placed in a work area and providing relevant auditory feedback. Exploratory-based, practice-based, and assessment-based activities were developed as part of the learning activities of the system. Multiple ways of interacting with the system using the tangible manipulatives were implemented. Such methods differed in (1) the use of special manipulatives for controlling the system and (2) the main tangible manipulatives used for learning. An informal user study was conducted with the primary objective of determining the usability of each method. Results from the user study showed no clear preference in the different usages of the special manipulatives, while participants generally favoured using numbers as the main tangible manipulatives.
URI: https://hdl.handle.net/10356/162843
Fulltext Permission: restricted
Fulltext Availability: With Fulltext
Appears in Collections:SCSE Student Reports (FYP/IA/PA/PI)

Files in This Item:
File Description SizeFormat 
Final Report.pdf
  Restricted Access
2.6 MBAdobe PDFView/Open

Page view(s)

14
Updated on Dec 3, 2022

Download(s)

2
Updated on Dec 3, 2022

Google ScholarTM

Check

Items in DR-NTU are protected by copyright, with all rights reserved, unless otherwise indicated.