Social feedback through Vuzix smart glasses

Abstract

In this project, a real-time system for Android Operating Platform based Vuzix Smart Glasses is introduced. This system presents a service providing real-time feedbacks to

speakers of group meeting. The speaking percentage, text with icons, as well as three classification results, namely, interest, dominance and impedance, are visualized on the screen of Vuzix glasses as real-time social feedbacks. Through the feedbacks, speakers can consciously adjust the talking mannerisms to make them mutually compatible or aligned, thus increasing the effectiveness of meetings

To achieve this work, various speech statistics such as speaking length, speaker turns and speaking turn duration are computed by computed in Matlab. Such analysis are always conducted to deduce the human characteristics and talking mannerisms in offline fashion, whereas this work is done in real-time in this system so as to provide real-time social feedbacks about an ongoing meeting.

Here, an Android program has been developed to enable a real-time feedback display. It acquired real-time output wirelessly while the computer kept computing speech statistics automatically, where the TCP communication socket programming was utilized. Then, the delivered data were converted to real-time social feedbacks displayed via Vuzix glasses. The testing results showed that the application was fully functional and usable running on Vuzix System with no major issues or bugs.