Please use this identifier to cite or link to this item: https://hdl.handle.net/10356/171850
Title: Tangible figurine story composer and narrator
Authors: Choo, Jin He
Keywords: Engineering::Computer science and engineering
Issue Date: 2023
Publisher: Nanyang Technological University
Source: Choo, J. H. (2023). Tangible figurine story composer and narrator. Final Year Project (FYP), Nanyang Technological University, Singapore. https://hdl.handle.net/10356/171850
Project: SCSE22-0901 
Abstract: Tangible User Interfaces (TUIs) hold promise for enhancing learning, particularly among children, including those with Autism Spectrum Conditions (ASC). This report addresses challenges in ASC-focused TUIs, including cost and standardization issues. It reviews two ASC TUI projects, highlighting innovations and limitations. A novel project is introduced, aiming to develop affordable TUIs designed for teaching social interactions to children with autism. It leverages machine learning, specifically Convolutional Neural Networks, to facilitate real-time object detection of LEGO Minifigures. The integration of this technology into a mobile application, known as TFSCAN, opens doors for generating interactive experiences. A comprehensive user study was conducted, involving a demonstration phase followed by story creation using two application versions. The results show that participants with no prior stop-motion background found both versions, designed for storytelling and story composition, more engaging than users with prior experience. Furthermore, the findings underline a strong preference for Version 2, which involves camera-based composition, in terms of ease of use, engagement levels, and intuitiveness when compared to Version 1, which relies on user interfaces. The study not only underscores the potential of this project but also its significant role in teaching social skills to children with ASC.
URI: https://hdl.handle.net/10356/171850
Schools: School of Computer Science and Engineering 
Fulltext Permission: restricted
Fulltext Availability: With Fulltext
Appears in Collections:SCSE Student Reports (FYP/IA/PA/PI)

Files in This Item:
File Description SizeFormat 
Choo Jin He - SCSE22-0901 FYP Report (Amended).pdf
  Restricted Access
Undergraduate project report4.48 MBAdobe PDFView/Open

Page view(s)

80
Updated on Jul 15, 2024

Download(s)

8
Updated on Jul 15, 2024

Google ScholarTM

Check

Items in DR-NTU are protected by copyright, with all rights reserved, unless otherwise indicated.