Skip to content

Advertisement

  • Research Article
  • Open Access

Content-Aware Video Adaptation under Low-Bitrate Constraint

  • 1Email author,
  • 1,
  • 1,
  • 1 and
  • 1
EURASIP Journal on Advances in Signal Processing20072007:017179

https://doi.org/10.1155/2007/17179

  • Received: 1 September 2006
  • Accepted: 14 May 2007
  • Published:

Abstract

With the development of wireless network and the improvement of mobile device capability, video streaming is more and more widespread in such an environment. Under the condition of limited resource and inherent constraints, appropriate video adaptations have become one of the most important and challenging issues in wireless multimedia applications. In this paper, we propose a novel content-aware video adaptation in order to effectively utilize resource and improve visual perceptual quality. First, the attention model is derived from analyzing the characteristics of brightness, location, motion vector, and energy features in compressed domain to reduce computation complexity. Then, through the integration of attention model, capability of client device and correlational statistic model, attractive regions of video scenes are derived. The information object- (IOB-) weighted rate distortion model is used for adjusting the bit allocation. Finally, the video adaptation scheme dynamically adjusts video bitstream in frame level and object level. Experimental results validate that the proposed scheme achieves better visual quality effectively and efficiently.

Keywords

  • Motion Vector
  • Video Streaming
  • Perceptual Quality
  • Attention Model
  • Rate Distortion

[12345678910111213141516171819202122]

Authors’ Affiliations

(1)
College of Computer Science, National Chiao Tung University, 1001 Ta-Hsueh Road, Hsinchu, 300, Taiwan

References

  1. Fox A, Brewer EA: Reducing WWW latency and bandwidth requirements by real-time distillation. Proceeding of the 5th International Conference on World Wide Web, May 1996, Paris, FranceGoogle Scholar
  2. Smith JR, Mohan R, Li C-S: Scalable multimedia delivery for pervasive computing. Proceedings of the 7th ACM International Multimedia Conference (MULTIMEDIA '99), October-November 1999, Orlando, Fla, USA 1: 131-140.Google Scholar
  3. Vetro A, Christopoulos C, Sun H: Video transcoding architectures and techniques: an overview. IEEE Signal Processing Magazine 2003,20(2):18-29. 10.1109/MSP.2003.1184336View ArticleGoogle Scholar
  4. Chang S-F, Vetro A: Video adaptation: concepts, technologies, and open issues. Proceedings of the IEEE 2005,93(1):148-158.View ArticleGoogle Scholar
  5. Lai W, Gu X-D, Wang R-H, Dai L-R, Zhang H-J: Perceptual video streaming by adaptive spatial-temporal scalability. Proceedings of the 5th Pacific Rim Conference on Multimedia (PCM '04), November-December 2004, Tokyo, Japan 431-438.Google Scholar
  6. Chang S-F, Bocheck P: Principles and applications of content-aware video communication. Proceedings of the IEEE Internaitonal Symposium on Circuits and Systems (ISCAS '00), May 2000, Geneva, Switzerland 4: 33-36.Google Scholar
  7. Wang H, Divakaran A, Vetro A, Chang S-F, Sun H: Survey of compressed-domain features used in audio-visual indexing and analysis. Journal of Visual Communication and Image Representation 2003,14(2):150-183. 10.1016/S1047-3203(03)00019-1View ArticleGoogle Scholar
  8. Chen D-Y, Lee S-Y, Liao H-YM: Robust video sequence retrieval using a novel object-based T2D-histogram descriptor. Journal of Visual Communication and Image Representation 2005,16(2):212-232. 10.1016/j.jvcir.2004.08.003View ArticleGoogle Scholar
  9. Chen D-Y, Hsiao M-H, Lee S-Y: Automatic closed caption detection and filtering in MPEG videos for video structuring. Journal of Information Science and Engineering 2006,22(5):1145-1162.Google Scholar
  10. Wu H-C, Chen Y-W, Hsiao M-H, Lee S-Y: Robust video retrieval using a temporal edge pattern descriptor. Proceedings of the 19th IPPR Conference on Computer Vision, Graphics, and Image Processing (CVGIP '06), August 2006, Taoyuan, Taiwan 253-260.Google Scholar
  11. Ma Y-F, Lu L, Zhang H-J, Li M: A user attention model for video summarization. Proceedings of the 10th ACM International Conference of Multimedia (MULTIMEDIA '02), December 2002, Juan les Pins, France 533-542.View ArticleGoogle Scholar
  12. Chang SF: Content-based video summarization and adaptation for ubiquitous media access. Proceeding of the 12th International Conference on Image Analysis and Processing (ICIAP '03), September 2003, Mantova, Italy 494-496.Google Scholar
  13. Lai W, Gu X-D, Wang R-H, Ma W-Y, Zhang H-J: A content-based bit allocation model for video streaming. Proceedings of IEEE International Conference on Multimedia and Expo (ICME '04), June 2004, Taipei, Taiwan 2: 1315-1318.Google Scholar
  14. Xie X, Ma W-Y, Zhang H-J: Maximizing information throughput for multimedia browsing on small displays. Proceedings of IEEE International Conference on Multimedia and Expo (ICME '04), June 2004, Taipei, Taiwan 3: 2143-2146.Google Scholar
  15. Chou C-H, Chen C-W: A perceptually optimized 3-D subband codec for video communication over wireless channels. IEEE Transactions on Circuits and Systems for Video Technology 1996,6(2):143-156. 10.1109/76.488822View ArticleGoogle Scholar
  16. Chou C-H, Li Y-C: Perceptually tuned subband image coder based on the measure of just-noticeable-distortion profile. IEEE Transactions on Circuits and Systems for Video Technology 1995,5(6):467-476. 10.1109/76.475889View ArticleGoogle Scholar
  17. Gulliver SR, Ghinea G: Region of interest displays: addressing a perceptual problem? Proceedings of 6th IEEE International Symposium on Multimedia Software Engineering (ISMSE '04), December 2004, Miami, Fla, USA 2-9.View ArticleGoogle Scholar
  18. Lee MH, Nepal S, Srinivasan U: Edge-based semantic classification of sports video sequences. Proceedings of International Conference on Multimedia and Expo (ICME '03), July 2003, Baltimore, Md, USA 1: 157-160.Google Scholar
  19. Lee MH, Nepal S, Srinivasan U: Role of edge detection in video semantics. Proceedings of Pan-Sydney Area Workshop on Visual Information Processing (VIP '02), 2002, Sydney, Australia, Conferences in Research and Practice in Information Technology 22: 59-68.Google Scholar
  20. Yuan Y, Feng D, Zhong Y: A mixed scheme to improve subjective quality in low bitrate video. Proceedings of IEEE Wireless Communications and Networking Conference (WCNC '04), March 2004, Atlanta, Ga, USA 3: 1754-1759.Google Scholar
  21. Ding W, Liu B: Rate control of MPEG video coding and recording by rate-quantization modeling. IEEE Transactions on Circuits and Systems for Video Technology 1996,6(1):12-20. 10.1109/76.486416MathSciNetView ArticleGoogle Scholar
  22. ISO/IEC JTC1/SC29/WG11/N2466 : Licensing Agreement for the MPEG-7 Content Set. Atlantic City, NJ, USA, 1998Google Scholar

Copyright

© Ming-Ho Hsiao et al. 2007

This article is published under license to BioMed Central Ltd. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Advertisement