Please use this identifier to cite or link to this item:
Title: Optimizing quality of experience for adaptive bitrate streaming via viewer interest inference
Authors: Gao, Guanyu
Zhang, Huaizheng
Hu, Han
Wen, Yonggang
Cai, Jianfei
Luo, Chong
Zeng, Wenjun
Keywords: Engineering::Computer science and engineering
Issue Date: 2018
Source: Gao, G., Zhang, H., Hu, H., Wen, Y., Cai, J., Luo, C. & Zeng, W. (2018). Optimizing quality of experience for adaptive bitrate streaming via viewer interest inference. IEEE Transactions On Multimedia, 20(12), 3399-3413.
Journal: IEEE Transactions on Multimedia
Abstract: Rate adaptation is widely adopted in video streaming to improve the quality of experience (QoE). However, most of the existing rate adaptation approaches neglect the underlying video semantic information. In fact, influenced by video semantics and viewer preferences, the viewer may have different degrees of interest on different parts of a video. The interesting parts of a video can draw more visual attention from the viewer and have higher visual importance. As such, delivering the parts of a video that are interesting to the viewer in a higher quality can improve the perceptual video quality, compared with the semantics-agnostic approaches that treat each part of a video equally. Thus, it is natural to wonder: how to allocate bitrate budgets temporally over a video session under time-varying bandwidth while considering viewer interest? As an exploratory study, we propose an interest-aware rate adaptation approach for improving QoE by inferring viewer interest based on video semantics. We adopt the deep learning method to recognize the scenes of video frames and leverage the term frequency-inverse document frequency method to analyze the degrees of an individual viewer's interest on different types of scenes. The bandwidth, buffer occupancy, and viewer interest are jointly considered under the model predictive control framework for selecting appropriate bitrates for maximizing QoE. The objective and subjective evaluations measured in a real environment show that our method can achieve a higher QoE compared with the semantics-agnostic approaches.
ISSN: 1520-9210
DOI: 10.1109/TMM.2018.2838330
Rights: © 2018 IEEE. All rights reserved.
Fulltext Permission: none
Fulltext Availability: No Fulltext
Appears in Collections:SCSE Journal Articles

Page view(s)

Updated on May 23, 2022

Google ScholarTM




Items in DR-NTU are protected by copyright, with all rights reserved, unless otherwise indicated.