Open Access

Adaptive Outlier Rejection in Image Super-resolution

  • Mejdi Trimeche1Email author,
  • Radu Ciprian Bilcu1 and
  • Jukka Yrjänäinen2
EURASIP Journal on Advances in Signal Processing20062006:038052

https://doi.org/10.1155/ASP/2006/38052

Received: 29 November 2004

Accepted: 27 May 2005

Published: 20 February 2006

Abstract

One critical aspect to achieve efficient implementations of image super-resolution is the need for accurate subpixel registration of the input images. The overall performance of super-resolution algorithms is particularly degraded in the presence of persistent outliers, for which registration has failed. To enhance the robustness of processing against this problem, we propose in this paper an integrated adaptive filtering method to reject the outlier image regions. In the process of combining the gradient images due to each low-resolution image, we use adaptive FIR filtering. The coefficients of the FIR filter are updated using the LMS algorithm, which automatically isolates the outlier image regions by decreasing the corresponding coefficients. The adaptation criterion of the LMS estimator is the error between the median of the samples from the LR images and the output of the FIR filter. Through simulated experiments on synthetic images and on real camera images, we show that the proposed technique performs well in the presence of motion outliers. This relatively simple and fast mechanism enables to add robustness in practical implementations of image super-resolution, while still being effective against Gaussian noise in the image formation model.

[12345678910111213141516171819]

Authors’ Affiliations

(1)
Multimedia Technologies Laboratory, Nokia Research Center
(2)
Symbian Product Platforms, Nokia Technology Platforms

References

  1. Tsai RY, Huang TS: Multiframe image restoration and registration. In Advances in Computer Vision and Image Processing. Volume 1. JAI Press, Greenwich, Conn, USA; 1984:317-339. chapter 7Google Scholar
  2. Chaudhuri S (Ed): Super-Resolution Imaging. Kluwer Academic, Boston, Mass, USA; 2001.Google Scholar
  3. Park SC, Park MK, Kang MG: Super-resolution image reconstruction: a technical overview. IEEE Signal Processing Magazine 2003, 20(3):21-36. 10.1109/MSP.2003.1203207View ArticleGoogle Scholar
  4. Baker S, Kanade T: Super-resolution optical flow. In Tech. Rep. CMU-RI-TR-99-36. Robotics Institute, Carnegie Mellon University, Pittsburgh, Pa, USA; 1999.Google Scholar
  5. Schultz RR, Stevenson RL: Extraction of high-resolution frames from video sequences. IEEE Transactions on Image Processing 1996, 5(6):996-1011. 10.1109/83.503915View ArticleGoogle Scholar
  6. Hardie RC, Barnard KJ, Armstrong EE: Joint MAP registration and high-resolution image estimation using a sequence of undersampled images. IEEE Transactions on Image Processing 1997, 6(12):1621-1633. 10.1109/83.650116View ArticleGoogle Scholar
  7. Lee ES, Kang MG: Regularized adaptive high-resolution image reconstruction considering inaccurate subpixel registration. IEEE Transactions on Image Processing 2003, 12(7):826-837. 10.1109/TIP.2003.811488MathSciNetView ArticleGoogle Scholar
  8. Baker S, Kanade T: Limits on super-resolution and how to break them. IEEE Transactions on Pattern Analysis and Machine Intelligence 2002, 24(9):1167-1183. 10.1109/TPAMI.2002.1033210View ArticleGoogle Scholar
  9. Farsiu S, Robinson D, Elad M, Milanfar P: Robust shift and add approach to super-resolution. Applications of Digital Image Processing XXVI, August 2003, San Diego, Calif, USA, Proceedings of SPIE 5203: 121-130.View ArticleGoogle Scholar
  10. Farsiu S, Robinson MD, Elad M, Milanfar P: Fast and robust multiframe super-resolution. IEEE Transactions on Image Processing 2004, 13(10):1327-1344. 10.1109/TIP.2004.834669View ArticleGoogle Scholar
  11. Zomet A, Rav-Acha A, Peleg S: Robust super-resolution. Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR '01), December 2001, Kauai, Hawaii, USA 1: 645-650.Google Scholar
  12. Astola J, Kuosmanen P: Fundamentals of Nonlinear Digital Filtering. CRC Press, New York, NY, USA; 1997.MATHGoogle Scholar
  13. Trimeche M, Yrjänäinen J: Order filters in super-resolution image reconstruction. Image Processing: Algorithms and Systems II, January 2003, Santa Clara, Calif, USA, Proceedings of SPIE 5014: 190-200.Google Scholar
  14. Capel D, Zisserman A: Super-resolution from multiple views using learnt image models. Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR '01), December 2001, Kauai, Hawaii, USA 2: 627-634.Google Scholar
  15. Elad M, Feuer A: Super-resolution reconstruction of image sequences. IEEE Transactions on Pattern Analysis and Machine Intelligence 1999, 21(9):817-834. 10.1109/34.790425View ArticleGoogle Scholar
  16. Bertero M, Boccacci P: Introduction to Inverse Problems in Imaging. Institute of Physics Publishing (IOP), Bristol, UK; 1998. chapter 6MATHView ArticleGoogle Scholar
  17. Haykin S: Adaptive Filter Theory. 3rd edition. Prentice-Hall, Englewood Cliffs, NJ, USA; 1996.MATHGoogle Scholar
  18. Max N: Visualizing Hilbert curves. Proceedings of IEEE Visualization '98, October 1998, Research Triangle Park, NC, USA 447-450, 564.Google Scholar
  19. Perez A, Kamata S, Kawaguchi E: Peano scanning of arbitrary size images. Proceedings of 11th IAPR-IEEE International Conference on Pattern Recognition (ICPR '92), August–September 1992, The Hague, the Netherlands 3: 565-568.Google Scholar

Copyright

© Mejdi Trimeche et al. 2006

This article is published under license to BioMed Central Ltd. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.