Skip to content


  • Research Article
  • Open Access

Adaptive Resolution Upconversion for Compressed Video Using Pixel Classification

EURASIP Journal on Advances in Signal Processing20072007:071432

  • Received: 22 August 2006
  • Accepted: 3 May 2007
  • Published:


A novel adaptive resolution upconversion algorithm that is robust to compression artifacts is proposed. This method is based on classification of local image patterns using both structure information and activity measure to explicitly distinguish pixels into content or coding artifacts. The structure information is represented by adaptive dynamic-range coding and the activity measure is the combination of local entropy and dynamic range. For each pattern class, the weighting coefficients of upscaling are optimized by a least-mean-square (LMS) training technique, which trains on the combination of the original images and the compressed downsampled versions of the original images. Experimental results show that our proposed upconversion approach outperforms other classification-based upconversion and artifact reduction techniques in concatenation.


  • Entropy
  • Structure Information
  • Original Image
  • Activity Measure
  • Reduction Technique

Authors’ Affiliations

Video Processing and Analysis Group, Philips Research Laboratories, High Tech Campus 36, Eindhoven, 5656 AE, The Netherlands


  1. Kondo T, Node Y, Fujiwara T, Okumura Y: Picture conversion apparatus, picture conversion method, learning apparatus and learning method. US patent: no. 6,323,905, November 2001Google Scholar
  2. Atkins CB, Bouman CA, Allebach JP: Optimal image scaling using pixel classification. Proceedings of IEEE International Conference on Image Processing (ICIP '01), October 2001, Thessaloniki, Greece 3: 864–867.Google Scholar
  3. Li X, Orchard MT: New edge-directed interpolation. IEEE Transactions on Image Processing 2001,10(10):1521–1527. 10.1109/83.951537View ArticleGoogle Scholar
  4. Tegenbosch JAP, Hofman PM, Bosma MK: Improving non-linear up-scaling by adapting to the local edge orientation. Visual Communications and Image Processing, January 2004, San Jose, Calif, USA, Proceedings of SPIE 5308: 1181–1190.Google Scholar
  5. Plaziac N: Image interpolation using neural networks. IEEE Transactions on Image Processing 1999,8(11):1647-1651. 10.1109/83.799893View ArticleGoogle Scholar
  6. Keys RG: Cubic convolution interpolation for digital image processing. IEEE Transactions on Acoustics, Speech, and Signal Processing 1981,29(6):1153-1160. 10.1109/TASSP.1981.1163711MathSciNetView ArticleGoogle Scholar
  7. Greenspan H, Anderson CH, Akber S: Image enhancement by nonlinear extrapolation in frequency space. IEEE Transactions on Image Processing 2000,9(6):1035-1048. 10.1109/83.846246MathSciNetView ArticleGoogle Scholar
  8. Shao L, Kirenko I: Content adaptive coding artifact reduction for decompressed video and Images. Proceedings of International Conference on Consumer Electronics (ICCE '07), January 2007, Las Vegas, Nev, USA 1–2.Google Scholar
  9. Shao L: Unified compression artifacts removal based on adaptive learning on activity measure. to appear in Digital Signal ProcessingGoogle Scholar
  10. Kirenko I, Muijs R, Shao L: Coding artifact reduction using non-reference block grid visibility measure. Proceedings of IEEE International Conference on Multimedia and Expo (ICME '06), July 2006, Toronto, Ontario, Canada 469–472.Google Scholar
  11. Yuen M, Wu HR: Reconstruction artifacts in digital video compression. Digital Video Compression: Algorithms and Technologies, February 1995, San Jose, Calif, USA, Proceedings of SPIE 2419: 455–465.Google Scholar
  12. Freeman WT, Pasztor EC: Markov networks for super-resolution. Proceedings of the 34th Annual Conference on Information Sciences and Systems (CISS '00), March 2000, Princeton, NJ, USAGoogle Scholar
  13. Baker S, Kanade T: Limits on super-resolution and how to break them. Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR '00), June 2000, Hilton Head Island, SC, USA 2: 372–379.Google Scholar
  14. Kondo T, Fujimori Y, Ghosal S, Carrig JJ: Method and apparatus for adaptive filter tap selection according to a class. US patent: no. 6,192,161 B1, February 2001Google Scholar
  15. Zhao M, Kneepkens REJ, Hofman PM, de Haan G: Content adaptive image de-blocking. Proceedings of IEEE International Symposium on Consumer Electronics (ISCE '04), September 2004, Reading, Mass, USA 299–304.Google Scholar


© Ling Shao 2007

This article is published under license to BioMed Central Ltd. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.