Skip to main content
EURASIP Journal on Advances in Signal Processing
Download PDF
  • Research Article
  • Open access
  • Published:

A Complexity-Aware Video Adaptation Mechanism for Live Streaming Systems

EURASIP Journal on Advances in Signal Processing volume 2007, Article number: 047921 (2007) Cite this article

Abstract

The paradigm shift of network design from performance-centric to constraint-centric has called for new signal processing techniques to deal with various aspects of resource-constrained communication and networking. In this paper, we consider the computational constraints of a multimedia communication system and propose a video adaptation mechanism for live video streaming of multiple channels. The video adaptation mechanism includes three salient features. First, it adjusts the computational resource of the streaming server block by block to provide a fine control of the encoding complexity. Second, as far as we know, it is the first mechanism to allocate the computational resource to multiple channels. Third, it utilizes a complexity-distortion model to determine the optimal coding parameter values to achieve global optimization. These techniques constitute the basic building blocks for a successful application of wireless and Internet video to digital home, surveillance, IPTV, and online games.

References

  1. Chiang T, Zhang Y-Q: A new rate control scheme using quadratic rate distortion model. IEEE Transactions on Circuits and Systems for Video Technology 1997,7(1):246-250. 10.1109/76.554439

    Article  Google Scholar 

  2. He Z, Mitra SK: A unified rate-distortion analysis framework for transform coding. IEEE Transactions on Circuits and Systems for Video Technology 2001,11(12):1221-1236. 10.1109/76.974677

    Article  Google Scholar 

  3. He Z, Mitra SK: A linear source model and a unified rate control algorithm for DCT video coding. IEEE Transactions on Circuits and Systems for Video Technology 2002,12(11):970-982. 10.1109/TCSVT.2002.805511

    Article  Google Scholar 

  4. Ribas-Corbera J, Lei S: Rate control in DCT video coding for low-delay communications. IEEE Transactions on Circuits and Systems for Video Technology 1999,9(1):172-185. 10.1109/76.744284

    Article  Google Scholar 

  5. Tai P-L, Huang S-Y, Liu C-T, Wang J-S: Computation-aware scheme for software-based block motion estimation. IEEE Transactions on Circuits and Systems for Video Technology 2003,13(9):901-913. 10.1109/TCSVT.2003.816510

    Article  Google Scholar 

  6. Chen C-Y, Huang Y-W, Lee C-L, Chen L-G: One-pass computation-aware motion estimation with adaptive search strategy. IEEE Transactions on Multimedia 2006,8(4):698-706.

    Article  Google Scholar 

  7. Zhao Y, Richardson IEG: Complexity management for video encoders. Proceedings of the 10th ACM International Multimedia Conference, December 2002, Juan les Pins, France 647–649.

    Google Scholar 

  8. Zhong Z, Chen Y: Complexity regulation for real-time video encoding. Proceedings of IEEE International Conference on Image Processing (ICIP '02), September 2002, Rochester, NY, USA 1: 737–740.

    Article  Google Scholar 

  9. He Z, Liang Y, Chen L, Ahmad I, Wu D: Power-rate-distortion analysis for wireless video communication under energy constraints. IEEE Transactions on Circuits and Systems for Video Technology 2005,15(5):645-658.

    Article  Google Scholar 

  10. Stottrup-Andersen J, Forchhammer S, Aghito SM: Rate-distortion-complexity optimization of fast motion estimation in H.264/MPEG-4 AVC. Proceedings of IEEE International Conference on Image Processing (ICIP '04), October 2004, Singapore 1: 111–114.

    Google Scholar 

  11. van der Schaar M, Turaga D, Akella V: Rate-distortion-complexity adaptive video compression and streaming. Proceedings of IEEE International Conference on Image Processing (ICIP '04), October 2004, Singapore 3: 2051–2054.

    Google Scholar 

  12. van der Schaar M, Andreonoulos Y, Li O: Real-time ubiquitous multimedia streaming using rate-distortion-complexity models. Proceedings of IEEE Global Telecommunications Conference (GLOBECOM '04), November-December 2004, Dallas, Tex, USA 2: 639–643.

    Article  Google Scholar 

  13. Landge G, van der Schaar M, Akella V: Complexity metric driven energy optimization framework for implementing MPEG-21 scalable video decoders. Proceedings of IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP '05), March 2005, Philadelphia, Pa, USA 2: 1141–1144.

    Google Scholar 

  14. van der Schaar M, Andreopoulos Y: Rate-distortion-complexity modeling for network and receiver aware adaptation. IEEE Transactions on Multimedia 2005,7(3):471-479.

    Article  Google Scholar 

  15. Lin S-F, Lu M-T, Chen HH, Pan C-H: Fast multi-frame motion estimation for H.264 and its applications to complexity-aware streaming. Proceedings of IEEE International Symposium on Circuits and Systems (ISCAS '05), May 2005, Kobe, Japan 2: 1505–1508.

    Google Scholar 

  16. Lu M-T, Lin C-K, Yao JJ, Chen HH: Complexity-aware live streaming system. Proceedings of IEEE International Conference on Image Processing (ICIP '05), September 2005, Genova, Italy 1: 193–196.

    Google Scholar 

  17. Lu M-T, Lin C-K, Yao JJ, Chen HH: A complexity-aware live streaming system with bit rate adjustment. Proceedings of the 7th IEEE International Symposium on Multimedia (ISM '05), December 2005, Irvine, Calif, USA 431–437.

    Google Scholar 

  18. Lu M-T, Lin C-K, Yao JJ, Chen HH: Block-based computation adjustment for complexity-aware live streaming systems. Proceedings of the Picture Coding Symposium, April 2006, Beijing, China

    Google Scholar 

  19. Schulzrinne H, Casner S, Frederick R, Jacobson V: RTP: a Transport Protocol for Real-Time Applications. Request for Comments 3550, IETF Network Working Group, July 2003

    Google Scholar 

  20. Efficient Algorithms for K-Means Clustering https://doi.org/www.cs.umd.edu/~mount/Projects/KMeans/

  21. Kanungo T, Mount DM, Netanyahu NS, Piatko CD, Silverman R, Wu AY: An efficient k-means clustering algorithms: analysis and implementation. IEEE Transactions on Pattern Analysis and Machine Intelligence 2002,24(7):881-892. 10.1109/TPAMI.2002.1017616

    Article  Google Scholar 

  22. Kanungo T, Mount DM, Netanyahu NS, Piatko CD, Silverman R, Wu AY: A local search approximation algorithm for k-means clustering. Proceedings of the 18th Annual Symposium on Computational Geometry (SCG '02), June 2002, Barcelona, Spain 10–18.

    Chapter  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Electrical Engineering, Graduate Institute of Communication Engineering, National Taiwan University, Taipei, 10617, Taiwan

    Meng-Ting Lu & Jason J. Yao

  2. Department of Electrical Engineering, Graduate Institute of Communication Engineering, and Graduate Institute of Networking and Multimedia, National Taiwan University, Taipei, 10617, Taiwan

    Homer H. Chen

Authors
  1. Meng-Ting Lu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jason J. Yao
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Homer H. Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Meng-Ting Lu.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 2.0 International License (https://doi.org/creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Reprints and permissions

About this article

Cite this article

Lu, MT., Yao, J.J. & Chen, H.H. A Complexity-Aware Video Adaptation Mechanism for Live Streaming Systems. EURASIP J. Adv. Signal Process. 2007, 047921 (2007). https://doi.org/10.1155/2007/47921

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1155/2007/47921

Keywords