Optimal QoE Scheduling in MPEG-DASH Video Streaming.

Shin Hung Chang; Min Lun Tsai; Meng Huang Lee; Jan Ming Ho

doi:10.9781/ijimai.2021.06.003

Authors

Shin Hung Chang Fu Jen Catholic University
Min Lun Tsai Fu Jen Catholic University
Meng Huang Lee Shih Chien University
Jan Ming Ho Academia Sinica

DOI:

https://doi.org/10.9781/ijimai.2021.06.003

Keywords:

Integer Programming, MPEG-DASH, Motion Vector, Quality Of Experience (QoE), Video Streaming

Abstract

DASH is a popular technology for video streaming over the Internet. However, the quality of experience (QoE), a measure of humans’ perceived satisfaction of the quality of these streamed videos, is their subjective opinion, which is difficult to evaluate. Previous studies only considered network-based indices and focused on them to provide smooth video playback instead of improving the true QoE experienced by humans. In this study, we designed a series of click density experiments to verify whether different resolutions could affect the QoE for different video scenes. We observed that, in a single video segment, different scenes with the same resolution could affect the viewer’s QoE differently. It is true that the user’s satisfaction as a result of watching high-resolution video segments is always greater than that when watching low-resolution video segments of the same scenes. However, the most important observation is that low-resolution video segments yield higher viewing QoE gain in slow motion scenes than in fast motion scenes. Thus, the inclusion of more high-resolution segments in the fast motion scenes and more low-resolution segments in the slow motion scenes would be expected to maximize the user’s viewing QoE. In this study, to evaluate the user’s true experience, we convert the viewing QoE into a satisfaction quality score, termed the Q-score, for scenes with different resolutions in each video segment. Additionally, we developed an optimal segment assignment (OSA) algorithm for Q-score optimization in environments characterized by a constrained network bandwidth. Our experimental results show that application of the OSA algorithm to the playback schedule significantly improved users’ viewing satisfaction.

Downloads

Download data is not yet available.

References

A. C. Begen, T. Akgul, and M. Baugher, “Watching video over the web: Part 1: Streaming protocols,” IEEE Internet Computing, vol. 15, no. 2, pp. 54–63, 2010.

I. Sodagar, “MPEG-DASH standard for multimedia streaming over the internet,” IEEE Multimedia, vol. 18, no. 4, pp. 62–67, 2011.

T. Stockhammer, “Dynamic Adaptive Streaming over HTTP - Standards and design principles,” in Proceedings of the 2nd Annual ACM Conference on Multimedia Systems, pp. 133–144, 2011.

Pantos and May, Apple, Inc., “HTTP live streaming,” IETF RFC 8216, July, 2017. [online] Available: http://tools.ietf.org/html/draft-pantos-http-livestreaming-23

A. M. Tekalp, “Digital Video Processing,” 2nd edition, Prentice Hall Press Upper Saddle River, NJ, USA, 2015.

U. Reiter, K. Brunnström, K. D. Moor, M. C. Larabi, M. Pereira, A. Pinheiro, J. You, and A. Zgank, “Factors influencing quality of experience,” Quality of Experience, Advanced Concepts, Applications and Methods, pp. 55–72, 2014.

C. Müller, S. Lederer and C. Timmerer, “An Evaluation of Dynamic Adaptive Streaming over HTTP in Vehicular Environments,” in Proceedings of the 4th ACM International Multimedia Conference on Mobile Video, pp. 37–42, 2012.

A. Zambelli, “IIS smooth streaming technical overview,” Microsoft documentation, Microsoft Inc., vol. 3, 2009.

M. Levkov, “Video encoding and transcoding recommendations for HTTP dynamic streaming on the Adobe Flash platform,” White Paper, Adobe Systems, Inc., 2010.

A. Schrijver,” Theory of Linear and Integer Programming,” John Wiley & Sons Inc., ISBN 978-0-471-90854-8, 1986.

R. Sakamoto, T. Shobudani, R. Hotchi, and R. Kubo, “QoE-Aware Stable Adaptive Video Streaming Using Proportional Derivative Controller for MPEG-DASH“, IEICE Transactions on Communications, vol. E104.B, no. 3, pp. 286–294, 2021.

C. Cetinkaya, K. Herguner, C. Hellge, and M. Sayit, “Segmentaware dynamic routing for DASH flows over software-defined networks,” International Journal of Network Management, vol. 30, issue 4, 2020.

Y. Gao, X. Wei, L. Zhou, “Personalized QoE improvement for networking video service,” IEEE Journal on Selected Areas in Communications, vol. 38, no. 10, pp. 2311–2323, 2020.

Bentaleb, Abdelhak, A. C. Begen, and R. Zimmermann. “SDNDASH: Improving QoE of HTTP adaptive streaming using software defined networking,” in Proceedings of the 24th ACM International Conference on Multimedia, pp.1296–1305, 2016.

C. L. Li, L. Toni, J. Zou, H. Xiong, and P. Frossard, “QoE-driven mobile edge caching placement for adaptive video streaming,” IEEE Transactions on Multimedia, vol. 20, no. 4, pp. 965–984, 2017.

S. Zhao, Z. Li, D. Medhi, P. L. Lai, and S. Liu, “Study of user QoE improvement for dynamic adaptive streaming over HTTP (MPEGDASH),“ in Proceedings of the IEEE International Conference on Computing, Networking and Communications (ICNC), pp. 566–570, 2017.

S. H. Lee, E. Lee, and H. W. Lee, “Quality adaptation scheme for improving QoE of MPEG DASH,” in Proceedings of IEEE International Conference on Information and Communication Technology Convergence (ICTC), pp. 368–370, 2016.

Y. M. Cao, X. Q. You, J. Wang, and L. Song, “A QoE Friendly Rate Adaption Method for DASH,” in Proceedings of IEEE International Symposium on Broadband Multimedia Systems and Broadcasting, pp. 1–6, 2014.

I. R. Alzahrani, N. Ramzan, S. Katsigiannis, and A. Amira, “Use of Machine Learning for Rate Adaptation in MPEG-DASH for Quality of Experience Improvement,” in Proceedings of the 5th International Symposium on Data Mining Applications, pp. 3–11, 2018.

W. W. Huang, Y. P. Zhou, X. Y. Xie, D. Wu, M. Chen, and E. Ngai, “Buffer State is Enough: Simplifying the Design of QoE-Aware HTTP Adaptive Video Streaming”, IEEE Transactions on Broadcasting, vol. 64, no. 2, pp. 590–601, 2018.

X. Q. Yin, A. Jindal, V. Sekar, and B. Sinopoli, “A Control-Theoretic Approach for Dynamic Adaptive Video Streaming over HTTP,” in Proceedings of the ACM SIGCOMM, pp. 325–338, 2015.

W. Xin, P. Chuan, L. Zhou and Y. Qian, “QoE Oriented Chunk Scheduling in P2P-VoD Streaming System,” IEEE Transactions on Vehicular Technology, vol. 68, no. 8, pp. 8012–8025, 2019.

K. T. Chen, C. C. Tu, and W. C. Xiao, “OneClick: A framework for measuring network quality of experience,” in Proceedings of IEEE INFOCOM, pp. 702–710, 2009.

T. Yue, H. Wang, S. Chen, and J. Shao, “Deep learning based QoE evaluation for internet video,” Neurocomputing, vol. 386, pp. 179–190, 2020.

G. Dimopoulos, I. Leontiadis, P. B. Ros, and K. Papagiannaki, “Measuring video QoE from encrypted traffic,” in Proceedings of the Internet Measurement Conference, pp. 513–526, 2016.

T. Zhao, Q. Liu, and C. W. Chen, “QoE in video transmission: A user experience-driven strategy,” IEEE Communications Surveys & Tutorials, vol. 19, no. 1, pp. 285–302, 2017.

U. Engelke, D. P. Darcy, G. H. Mulliken, S. Bosse, M. G. Martini, S. Arndt, J. N. Antons, K. Y. Chan, N. Ramzan, and K. Brunnstro, “Psychophysiology-based QoE assessment: A survey,” IEEE Journal of Selected Topics in Signal Processing, vol. 11, no. 1, pp. 6–21, 2016.

S. H. Hu, L. F. Sun, C. X. Xiao, and C. Gui, “Semantic-aware adaptation scheme for soccer video over MPEG-DASH,” in Proceedings of the IEEE International Conference on Multimedia and Expo (ICME), pp. 493-498, 2017.

A. Barjatya, ”Block matching algorithms for motion estimation,” IEEE Transactions on Evolution Computation. vol. 8. pp. 225–239, 2004.

Hosur, P. Irappa, and K. K. Ma. “Motion vector field adaptive fast motion estimation.” in Proceedings of the 2nd International Conference on Information, Communications and Signal Processing (ICICS’99), pp. 7–10, 1999.

A. M. Tourapis, O. C. L. Au, and M. L. Liou, “Predictive motion vector field adaptive search technique (PMVFAST): enhancing block-based motion estimation,” Visual Communications and Image Processing, vol. 4310, pp. 883–892, 2001.

S. Arora, K. Khanna, and N. Rajpal,” A Novel Hybrid Approach for Fast Block Based Motion Estimation,” International Journal of Interactive Multimedia and Artificial Intelligence, vol. 4, no. 6, pp. 24–30, 2017.

S. Kamble, N. Thakur, A. Samdurkar, and A. Patharkar, “Object Detection and Tracking using Modified Diamond Search Block Matching Motion Estimation Algorithm,” International Journal of Interactive Multimedia and Artificial Intelligence, vol. 5, no. 1, pp. 73–85, 2018.

D. K. Krishnappa, D. Bhat, and M. Zink, “DASHing YouTube: An analysis of using DASH in YouTube video service,” in Proceedings of the 38th Annual IEEE Conference on Local Computer Networks, pp. 407–415, 2013.

YouTube genres and categories. [online] Available: https://developers.google.com/youtube/v3/live/guides/encoding-with-dash