Skip to main content

Advertisement

Content-Aware Video Adaptation under Low-Bitrate Constraint

Article metrics

  • 903 Accesses

  • 4 Citations

Abstract

With the development of wireless network and the improvement of mobile device capability, video streaming is more and more widespread in such an environment. Under the condition of limited resource and inherent constraints, appropriate video adaptations have become one of the most important and challenging issues in wireless multimedia applications. In this paper, we propose a novel content-aware video adaptation in order to effectively utilize resource and improve visual perceptual quality. First, the attention model is derived from analyzing the characteristics of brightness, location, motion vector, and energy features in compressed domain to reduce computation complexity. Then, through the integration of attention model, capability of client device and correlational statistic model, attractive regions of video scenes are derived. The information object- (IOB-) weighted rate distortion model is used for adjusting the bit allocation. Finally, the video adaptation scheme dynamically adjusts video bitstream in frame level and object level. Experimental results validate that the proposed scheme achieves better visual quality effectively and efficiently.

References

  1. 1.

    Fox A, Brewer EA: Reducing WWW latency and bandwidth requirements by real-time distillation. Proceeding of the 5th International Conference on World Wide Web, May 1996, Paris, France

  2. 2.

    Smith JR, Mohan R, Li C-S: Scalable multimedia delivery for pervasive computing. Proceedings of the 7th ACM International Multimedia Conference (MULTIMEDIA '99), October-November 1999, Orlando, Fla, USA 1: 131–140.

  3. 3.

    Vetro A, Christopoulos C, Sun H: Video transcoding architectures and techniques: an overview. IEEE Signal Processing Magazine 2003,20(2):18-29. 10.1109/MSP.2003.1184336

  4. 4.

    Chang S-F, Vetro A: Video adaptation: concepts, technologies, and open issues. Proceedings of the IEEE 2005,93(1):148-158.

  5. 5.

    Lai W, Gu X-D, Wang R-H, Dai L-R, Zhang H-J: Perceptual video streaming by adaptive spatial-temporal scalability. Proceedings of the 5th Pacific Rim Conference on Multimedia (PCM '04), November-December 2004, Tokyo, Japan 431–438.

  6. 6.

    Chang S-F, Bocheck P: Principles and applications of content-aware video communication. Proceedings of the IEEE Internaitonal Symposium on Circuits and Systems (ISCAS '00), May 2000, Geneva, Switzerland 4: 33–36.

  7. 7.

    Wang H, Divakaran A, Vetro A, Chang S-F, Sun H: Survey of compressed-domain features used in audio-visual indexing and analysis. Journal of Visual Communication and Image Representation 2003,14(2):150-183. 10.1016/S1047-3203(03)00019-1

  8. 8.

    Chen D-Y, Lee S-Y, Liao H-YM: Robust video sequence retrieval using a novel object-based T2D-histogram descriptor. Journal of Visual Communication and Image Representation 2005,16(2):212-232. 10.1016/j.jvcir.2004.08.003

  9. 9.

    Chen D-Y, Hsiao M-H, Lee S-Y: Automatic closed caption detection and filtering in MPEG videos for video structuring. Journal of Information Science and Engineering 2006,22(5):1145-1162.

  10. 10.

    Wu H-C, Chen Y-W, Hsiao M-H, Lee S-Y: Robust video retrieval using a temporal edge pattern descriptor. Proceedings of the 19th IPPR Conference on Computer Vision, Graphics, and Image Processing (CVGIP '06), August 2006, Taoyuan, Taiwan 253–260.

  11. 11.

    Ma Y-F, Lu L, Zhang H-J, Li M: A user attention model for video summarization. Proceedings of the 10th ACM International Conference of Multimedia (MULTIMEDIA '02), December 2002, Juan les Pins, France 533–542.

  12. 12.

    Chang SF: Content-based video summarization and adaptation for ubiquitous media access. Proceeding of the 12th International Conference on Image Analysis and Processing (ICIAP '03), September 2003, Mantova, Italy 494–496.

  13. 13.

    Lai W, Gu X-D, Wang R-H, Ma W-Y, Zhang H-J: A content-based bit allocation model for video streaming. Proceedings of IEEE International Conference on Multimedia and Expo (ICME '04), June 2004, Taipei, Taiwan 2: 1315–1318.

  14. 14.

    Xie X, Ma W-Y, Zhang H-J: Maximizing information throughput for multimedia browsing on small displays. Proceedings of IEEE International Conference on Multimedia and Expo (ICME '04), June 2004, Taipei, Taiwan 3: 2143–2146.

  15. 15.

    Chou C-H, Chen C-W: A perceptually optimized 3-D subband codec for video communication over wireless channels. IEEE Transactions on Circuits and Systems for Video Technology 1996,6(2):143-156. 10.1109/76.488822

  16. 16.

    Chou C-H, Li Y-C: Perceptually tuned subband image coder based on the measure of just-noticeable-distortion profile. IEEE Transactions on Circuits and Systems for Video Technology 1995,5(6):467-476. 10.1109/76.475889

  17. 17.

    Gulliver SR, Ghinea G: Region of interest displays: addressing a perceptual problem? Proceedings of 6th IEEE International Symposium on Multimedia Software Engineering (ISMSE '04), December 2004, Miami, Fla, USA 2–9.

  18. 18.

    Lee MH, Nepal S, Srinivasan U: Edge-based semantic classification of sports video sequences. Proceedings of International Conference on Multimedia and Expo (ICME '03), July 2003, Baltimore, Md, USA 1: 157–160.

  19. 19.

    Lee MH, Nepal S, Srinivasan U: Role of edge detection in video semantics. Proceedings of Pan-Sydney Area Workshop on Visual Information Processing (VIP '02), 2002, Sydney, Australia, Conferences in Research and Practice in Information Technology 22: 59–68.

  20. 20.

    Yuan Y, Feng D, Zhong Y: A mixed scheme to improve subjective quality in low bitrate video. Proceedings of IEEE Wireless Communications and Networking Conference (WCNC '04), March 2004, Atlanta, Ga, USA 3: 1754–1759.

  21. 21.

    Ding W, Liu B: Rate control of MPEG video coding and recording by rate-quantization modeling. IEEE Transactions on Circuits and Systems for Video Technology 1996,6(1):12-20. 10.1109/76.486416

  22. 22.

    ISO/IEC JTC1/SC29/WG11/N2466 : Licensing Agreement for the MPEG-7 Content Set. Atlantic City, NJ, USA, 1998

Download references

Author information

Correspondence to Ming-Ho Hsiao.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 2.0 International License (https://doi.org/creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Reprints and Permissions

About this article

Cite this article

Hsiao, M., Chen, Y., Chen, H. et al. Content-Aware Video Adaptation under Low-Bitrate Constraint. EURASIP J. Adv. Signal Process. 2007, 017179 (2007) doi:10.1155/2007/17179

Download citation

Keywords

  • Motion Vector
  • Video Streaming
  • Perceptual Quality
  • Attention Model
  • Rate Distortion