Skip to main content
EURASIP Journal on Advances in Signal Processing
Download PDF
  • Research Article
  • Open access
  • Published:

Classification-Based Spatial Error Concealment for Visual Communications

EURASIP Journal on Advances in Signal Processing volume 2006, Article number: 013438 (2006) Cite this article

Abstract

In an error-prone transmission environment, error concealment is an effective technique to reconstruct the damaged visual content. Due to large variations of image characteristics, different concealment approaches are necessary to accommodate the different nature of the lost image content. In this paper, we address this issue and propose using classification to integrate the state-of-the-art error concealment techniques. The proposed approach takes advantage of multiple concealment algorithms and adaptively selects the suitable algorithm for each damaged image area. With growing awareness that the design of sender and receiver systems should be jointly considered for efficient and reliable multimedia communications, we proposed a set of classification-based block concealment schemes, including receiver-side classification, sender-side attachment, and sender-side embedding. Our experimental results provide extensive performance comparisons and demonstrate that the proposed classification-based error concealment approaches outperform the conventional approaches.

References

  1. Wang Y, Zhu Q-F: Error control and concealment for video communication: a review. Proceedings of the IEEE 1998, 86(5):974–997. 10.1109/5.664283

    Article  Google Scholar 

  2. Kwok W, Sun H: Multi-directional interpolation for spatial error concealment. IEEE Transactions on Consumer Electronics 1993, 39(3):455–460. 10.1109/30.234620

    Article  Google Scholar 

  3. Sun H, Kwok W: Concealment of damaged block transform coded images using projections onto convex sets. IEEE Transactions on Image Processing 1995, 4(4):470–477. 10.1109/83.370675

    Article  Google Scholar 

  4. Wang Y, Zhu Q-F, Shaw L: Maximally smooth image recovery in transform coding. IEEE Transactions on Communications 1993, 41(10):1544–1551. 10.1109/26.237889

    Article  Google Scholar 

  5. Zeng W, Liu B: Geometric-structure-based error concealment with novel applications in block-based low-bit-rate coding. IEEE Transactions on Circuits and Systems for Video Technology 1999, 9(4):648–665. 10.1109/76.767129

    Article  Google Scholar 

  6. Li X, Orchard MT: Novel sequential error-concealment techniques using orientation adaptive interpolation. IEEE Transactions on Circuits and Systems for Video Technology 2002, 12(10):857–864. 10.1109/TCSVT.2002.804882

    Article  Google Scholar 

  7. Zhang D, Wang Z: Image information restoration based on long-range correlation. IEEE Transactions on Circuits and Systems for Video Technology 2002, 12(5):331–341. 10.1109/TCSVT.2002.1003472

    Article  MathSciNet  Google Scholar 

  8. Bertalmio M, Vese L, Sapiro G, Osher S: Simultaneous structure and texture image inpainting. IEEE Transactions on Image Processing 2003, 12(8):882–889. 10.1109/TIP.2003.815261

    Article  Google Scholar 

  9. Yin P, Liu B, Yu HH: Error concealment using data hiding. Proceedings of IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP '01), May 2001, Salt Lake City, Utah, USA 3: 1453–1456.

    Google Scholar 

  10. Yin P, Wu M, Liu B: Robust error-resilient approach for MPEG video transmission over Internet. Visual Communications and Image Processing (VCIP '02), January 2002, San Jose, Calif, USA, Proceedings of SPIE 4671: 103–111.

    Google Scholar 

  11. Liu Y, Li Y: Error concealment of digital images using data hiding. Proceeding of 9th IEEE DSP Workshop, October 2000, Hunt, Tex, USA

    Google Scholar 

  12. Jung K-H, Chang J-H, Lee CW: Error concealment technique using projection data for block-based image coding. Visual Communications and Image Processing (VCIP '94), September 1994, Chicago, Ill, USA, Proceedings of SPIE 2308, part 3: 1466–1476.

    Article  Google Scholar 

  13. Duda RO, Hart PE, Stork DG: Pattern Classification. 2nd edition. John Wiley & Sons, New York, NY, USA; 2001.

    MATH  Google Scholar 

  14. Joachims T: Text categorization with support vector machines: learning with many relevant features. Proceedings of 10th European Conference on Machine Learning (ECML '98), April 1998, Chemnitz, Germany 137–142.

    Google Scholar 

  15. Burges CJC: A tutorial on support vector machines for pattern recognition. Data Mining and Knowledge Discovery 1998, 2(2):121–167. 10.1023/A:1009715923555

    Article  Google Scholar 

  16. Vapnik VN: The Nature of Statistical Learning Theory. Springer, Berlin, Germany; 1995.

    Book  Google Scholar 

  17. Smola AJ, Bartlett P, Schölkopf B, Schuurmans D: Advances in Large Margin Classifiers. MIT Press, Cambridge, Mass, USA; 1999.

    MATH  Google Scholar 

  18. Joachims T: Support Vector Machine V5.00. 2002.https://doi.org/svmlight.joachims.org

    Google Scholar 

  19. Joachims T: Making large-scale SVM learning practical. In Advances in Kernel Methods—Support Vector Learning. Edited by: Schölkopf B, Burges CJC, Smola AJ. MIT Press, Cambridge, Mass, USA; 1999:169–184.

    Google Scholar 

  20. Wu M, Liu B: Multimedia Data Hiding. Springer, New York, NY, USA; 2002.

    MATH  Google Scholar 

  21. Wu M, Liu B: Data hiding in image and video: Part-I Fundamental issues and solutions. IEEE Transactions on Image Processing 2003, 12(6):685–695. 10.1109/TIP.2003.810588

    Article  MathSciNet  Google Scholar 

  22. Wu M, Yu HH, Gelman A: Multi-level data hiding for digital image and video. Multimedia Systems and Applications II, September 1999, Boston, Mass, USA, Proceedings of SPIE 3845: 10–21.

    Article  Google Scholar 

  23. Dovrolis C, Tull D, Ramanathan P: Hybrid spatial/temporal loss concealment for packet video. Proceedings of the 9th International Packet Video Workshop (PVW '99), April 1999, New York, NY, USA

    Google Scholar 

  24. Lee Y-C, Altunbasak Y, Mersereau RM: A temporal error concealment method for MPEG coded video using a multi-frame boundary matching algorithm. Proceedings of IEEE International Conference on Image Processing (ICIP '01), October 2001, Thessaloniki, Greece 1: 990–993.

    Google Scholar 

  25. Chen M, He Y, Lagendijk RL: A fragile watermark error detection scheme for wireless video communications. IEEE Transactions on Multimedia 2005, 7(2):201–211.

    Article  Google Scholar 

  26. Chen M, Wu M, Zheng Y: Classification-based spatial error concealment for images. Proceedings of IEEE International Conference on Image Processing (ICIP '03), September 2003, Barcelona, Spain 2: 675–678.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Electrical and Computer Engineering, University of Maryland, College Park, MD, 20742, USA

    Meng Chen, Yefeng Zheng & Min Wu

Authors
  1. Meng Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yefeng Zheng
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Min Wu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Meng Chen.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 2.0 International License ( https://creativecommons.org/licenses/by/2.0 ), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Reprints and permissions

About this article

Cite this article

Chen, M., Zheng, Y. & Wu, M. Classification-Based Spatial Error Concealment for Visual Communications. EURASIP J. Adv. Signal Process. 2006, 013438 (2006). https://doi.org/10.1155/ASP/2006/13438

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1155/ASP/2006/13438

Keywords