Skip to main content
EURASIP Journal on Advances in Signal Processing
Download PDF
  • Research Article
  • Open access
  • Published:

Content-Aware Video Adaptation under Low-Bitrate Constraint

EURASIP Journal on Advances in Signal Processing volume 2007, Article number: 017179 (2007) Cite this article

Abstract

With the development of wireless network and the improvement of mobile device capability, video streaming is more and more widespread in such an environment. Under the condition of limited resource and inherent constraints, appropriate video adaptations have become one of the most important and challenging issues in wireless multimedia applications. In this paper, we propose a novel content-aware video adaptation in order to effectively utilize resource and improve visual perceptual quality. First, the attention model is derived from analyzing the characteristics of brightness, location, motion vector, and energy features in compressed domain to reduce computation complexity. Then, through the integration of attention model, capability of client device and correlational statistic model, attractive regions of video scenes are derived. The information object- (IOB-) weighted rate distortion model is used for adjusting the bit allocation. Finally, the video adaptation scheme dynamically adjusts video bitstream in frame level and object level. Experimental results validate that the proposed scheme achieves better visual quality effectively and efficiently.

References

  1. Fox A, Brewer EA: Reducing WWW latency and bandwidth requirements by real-time distillation. Proceeding of the 5th International Conference on World Wide Web, May 1996, Paris, France

    Google Scholar 

  2. Smith JR, Mohan R, Li C-S: Scalable multimedia delivery for pervasive computing. Proceedings of the 7th ACM International Multimedia Conference (MULTIMEDIA '99), October-November 1999, Orlando, Fla, USA 1: 131–140.

    Google Scholar 

  3. Vetro A, Christopoulos C, Sun H: Video transcoding architectures and techniques: an overview. IEEE Signal Processing Magazine 2003,20(2):18-29. 10.1109/MSP.2003.1184336

    Article  Google Scholar 

  4. Chang S-F, Vetro A: Video adaptation: concepts, technologies, and open issues. Proceedings of the IEEE 2005,93(1):148-158.

    Article  Google Scholar 

  5. Lai W, Gu X-D, Wang R-H, Dai L-R, Zhang H-J: Perceptual video streaming by adaptive spatial-temporal scalability. Proceedings of the 5th Pacific Rim Conference on Multimedia (PCM '04), November-December 2004, Tokyo, Japan 431–438.

    Google Scholar 

  6. Chang S-F, Bocheck P: Principles and applications of content-aware video communication. Proceedings of the IEEE Internaitonal Symposium on Circuits and Systems (ISCAS '00), May 2000, Geneva, Switzerland 4: 33–36.

    Google Scholar 

  7. Wang H, Divakaran A, Vetro A, Chang S-F, Sun H: Survey of compressed-domain features used in audio-visual indexing and analysis. Journal of Visual Communication and Image Representation 2003,14(2):150-183. 10.1016/S1047-3203(03)00019-1

    Article  Google Scholar 

  8. Chen D-Y, Lee S-Y, Liao H-YM: Robust video sequence retrieval using a novel object-based T2D-histogram descriptor. Journal of Visual Communication and Image Representation 2005,16(2):212-232. 10.1016/j.jvcir.2004.08.003

    Article  Google Scholar 

  9. Chen D-Y, Hsiao M-H, Lee S-Y: Automatic closed caption detection and filtering in MPEG videos for video structuring. Journal of Information Science and Engineering 2006,22(5):1145-1162.

    Google Scholar 

  10. Wu H-C, Chen Y-W, Hsiao M-H, Lee S-Y: Robust video retrieval using a temporal edge pattern descriptor. Proceedings of the 19th IPPR Conference on Computer Vision, Graphics, and Image Processing (CVGIP '06), August 2006, Taoyuan, Taiwan 253–260.

    Google Scholar 

  11. Ma Y-F, Lu L, Zhang H-J, Li M: A user attention model for video summarization. Proceedings of the 10th ACM International Conference of Multimedia (MULTIMEDIA '02), December 2002, Juan les Pins, France 533–542.

    Chapter  Google Scholar 

  12. Chang SF: Content-based video summarization and adaptation for ubiquitous media access. Proceeding of the 12th International Conference on Image Analysis and Processing (ICIAP '03), September 2003, Mantova, Italy 494–496.

    Google Scholar 

  13. Lai W, Gu X-D, Wang R-H, Ma W-Y, Zhang H-J: A content-based bit allocation model for video streaming. Proceedings of IEEE International Conference on Multimedia and Expo (ICME '04), June 2004, Taipei, Taiwan 2: 1315–1318.

    Google Scholar 

  14. Xie X, Ma W-Y, Zhang H-J: Maximizing information throughput for multimedia browsing on small displays. Proceedings of IEEE International Conference on Multimedia and Expo (ICME '04), June 2004, Taipei, Taiwan 3: 2143–2146.

    Google Scholar 

  15. Chou C-H, Chen C-W: A perceptually optimized 3-D subband codec for video communication over wireless channels. IEEE Transactions on Circuits and Systems for Video Technology 1996,6(2):143-156. 10.1109/76.488822

    Article  Google Scholar 

  16. Chou C-H, Li Y-C: Perceptually tuned subband image coder based on the measure of just-noticeable-distortion profile. IEEE Transactions on Circuits and Systems for Video Technology 1995,5(6):467-476. 10.1109/76.475889

    Article  Google Scholar 

  17. Gulliver SR, Ghinea G: Region of interest displays: addressing a perceptual problem? Proceedings of 6th IEEE International Symposium on Multimedia Software Engineering (ISMSE '04), December 2004, Miami, Fla, USA 2–9.

    Chapter  Google Scholar 

  18. Lee MH, Nepal S, Srinivasan U: Edge-based semantic classification of sports video sequences. Proceedings of International Conference on Multimedia and Expo (ICME '03), July 2003, Baltimore, Md, USA 1: 157–160.

    Google Scholar 

  19. Lee MH, Nepal S, Srinivasan U: Role of edge detection in video semantics. Proceedings of Pan-Sydney Area Workshop on Visual Information Processing (VIP '02), 2002, Sydney, Australia, Conferences in Research and Practice in Information Technology 22: 59–68.

    Google Scholar 

  20. Yuan Y, Feng D, Zhong Y: A mixed scheme to improve subjective quality in low bitrate video. Proceedings of IEEE Wireless Communications and Networking Conference (WCNC '04), March 2004, Atlanta, Ga, USA 3: 1754–1759.

    Google Scholar 

  21. Ding W, Liu B: Rate control of MPEG video coding and recording by rate-quantization modeling. IEEE Transactions on Circuits and Systems for Video Technology 1996,6(1):12-20. 10.1109/76.486416

    Article  Google Scholar 

  22. ISO/IEC JTC1/SC29/WG11/N2466 : Licensing Agreement for the MPEG-7 Content Set. Atlantic City, NJ, USA, 1998

Download references

Author information

Authors and Affiliations

  1. College of Computer Science, National Chiao Tung University, 1001 Ta-Hsueh Road, Hsinchu, 300, Taiwan

    Ming-Ho Hsiao, Yi-Wen Chen, Hua-Tsung Chen, Kuan-Hung Chou & Suh-Yin Lee

Authors
  1. Ming-Ho Hsiao
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yi-Wen Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Hua-Tsung Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Kuan-Hung Chou
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Suh-Yin Lee
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Ming-Ho Hsiao.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 2.0 International License (https://doi.org/creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Reprints and permissions

About this article

Cite this article

Hsiao, MH., Chen, YW., Chen, HT. et al. Content-Aware Video Adaptation under Low-Bitrate Constraint. EURASIP J. Adv. Signal Process. 2007, 017179 (2007). https://doi.org/10.1155/2007/17179

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1155/2007/17179

Keywords