Skip to content


  • Research Article
  • Open Access

Classification-Based Spatial Error Concealment for Visual Communications

EURASIP Journal on Advances in Signal Processing20062006:013438

  • Received: 1 March 2005
  • Accepted: 22 August 2005
  • Published:


In an error-prone transmission environment, error concealment is an effective technique to reconstruct the damaged visual content. Due to large variations of image characteristics, different concealment approaches are necessary to accommodate the different nature of the lost image content. In this paper, we address this issue and propose using classification to integrate the state-of-the-art error concealment techniques. The proposed approach takes advantage of multiple concealment algorithms and adaptively selects the suitable algorithm for each damaged image area. With growing awareness that the design of sender and receiver systems should be jointly considered for efficient and reliable multimedia communications, we proposed a set of classification-based block concealment schemes, including receiver-side classification, sender-side attachment, and sender-side embedding. Our experimental results provide extensive performance comparisons and demonstrate that the proposed classification-based error concealment approaches outperform the conventional approaches.


  • Lost
  • Spatial Error
  • Extensive Performance
  • Visual Content
  • Visual Communication

Authors’ Affiliations

Department of Electrical and Computer Engineering, University of Maryland, College Park, MD 20742, USA


  1. Wang Y, Zhu Q-F: Error control and concealment for video communication: a review. Proceedings of the IEEE 1998, 86(5):974–997. 10.1109/5.664283View ArticleGoogle Scholar
  2. Kwok W, Sun H: Multi-directional interpolation for spatial error concealment. IEEE Transactions on Consumer Electronics 1993, 39(3):455–460. 10.1109/30.234620View ArticleGoogle Scholar
  3. Sun H, Kwok W: Concealment of damaged block transform coded images using projections onto convex sets. IEEE Transactions on Image Processing 1995, 4(4):470–477. 10.1109/83.370675View ArticleGoogle Scholar
  4. Wang Y, Zhu Q-F, Shaw L: Maximally smooth image recovery in transform coding. IEEE Transactions on Communications 1993, 41(10):1544–1551. 10.1109/26.237889View ArticleGoogle Scholar
  5. Zeng W, Liu B: Geometric-structure-based error concealment with novel applications in block-based low-bit-rate coding. IEEE Transactions on Circuits and Systems for Video Technology 1999, 9(4):648–665. 10.1109/76.767129View ArticleGoogle Scholar
  6. Li X, Orchard MT: Novel sequential error-concealment techniques using orientation adaptive interpolation. IEEE Transactions on Circuits and Systems for Video Technology 2002, 12(10):857–864. 10.1109/TCSVT.2002.804882View ArticleGoogle Scholar
  7. Zhang D, Wang Z: Image information restoration based on long-range correlation. IEEE Transactions on Circuits and Systems for Video Technology 2002, 12(5):331–341. 10.1109/TCSVT.2002.1003472MathSciNetView ArticleGoogle Scholar
  8. Bertalmio M, Vese L, Sapiro G, Osher S: Simultaneous structure and texture image inpainting. IEEE Transactions on Image Processing 2003, 12(8):882–889. 10.1109/TIP.2003.815261View ArticleGoogle Scholar
  9. Yin P, Liu B, Yu HH: Error concealment using data hiding. Proceedings of IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP '01), May 2001, Salt Lake City, Utah, USA 3: 1453–1456.Google Scholar
  10. Yin P, Wu M, Liu B: Robust error-resilient approach for MPEG video transmission over Internet. Visual Communications and Image Processing (VCIP '02), January 2002, San Jose, Calif, USA, Proceedings of SPIE 4671: 103–111.Google Scholar
  11. Liu Y, Li Y: Error concealment of digital images using data hiding. Proceeding of 9th IEEE DSP Workshop, October 2000, Hunt, Tex, USAGoogle Scholar
  12. Jung K-H, Chang J-H, Lee CW: Error concealment technique using projection data for block-based image coding. Visual Communications and Image Processing (VCIP '94), September 1994, Chicago, Ill, USA, Proceedings of SPIE 2308, part 3: 1466–1476.View ArticleGoogle Scholar
  13. Duda RO, Hart PE, Stork DG: Pattern Classification. 2nd edition. John Wiley & Sons, New York, NY, USA; 2001.MATHGoogle Scholar
  14. Joachims T: Text categorization with support vector machines: learning with many relevant features. Proceedings of 10th European Conference on Machine Learning (ECML '98), April 1998, Chemnitz, Germany 137–142.Google Scholar
  15. Burges CJC: A tutorial on support vector machines for pattern recognition. Data Mining and Knowledge Discovery 1998, 2(2):121–167. 10.1023/A:1009715923555View ArticleGoogle Scholar
  16. Vapnik VN: The Nature of Statistical Learning Theory. Springer, Berlin, Germany; 1995.View ArticleGoogle Scholar
  17. Smola AJ, Bartlett P, Schölkopf B, Schuurmans D: Advances in Large Margin Classifiers. MIT Press, Cambridge, Mass, USA; 1999.MATHGoogle Scholar
  18. Joachims T: Support Vector Machine V5.00. 2002. Scholar
  19. Joachims T: Making large-scale SVM learning practical. In Advances in Kernel Methods—Support Vector Learning. Edited by: Schölkopf B, Burges CJC, Smola AJ. MIT Press, Cambridge, Mass, USA; 1999:169–184.Google Scholar
  20. Wu M, Liu B: Multimedia Data Hiding. Springer, New York, NY, USA; 2002.MATHGoogle Scholar
  21. Wu M, Liu B: Data hiding in image and video: Part-I Fundamental issues and solutions. IEEE Transactions on Image Processing 2003, 12(6):685–695. 10.1109/TIP.2003.810588MathSciNetView ArticleGoogle Scholar
  22. Wu M, Yu HH, Gelman A: Multi-level data hiding for digital image and video. Multimedia Systems and Applications II, September 1999, Boston, Mass, USA, Proceedings of SPIE 3845: 10–21.View ArticleGoogle Scholar
  23. Dovrolis C, Tull D, Ramanathan P: Hybrid spatial/temporal loss concealment for packet video. Proceedings of the 9th International Packet Video Workshop (PVW '99), April 1999, New York, NY, USAGoogle Scholar
  24. Lee Y-C, Altunbasak Y, Mersereau RM: A temporal error concealment method for MPEG coded video using a multi-frame boundary matching algorithm. Proceedings of IEEE International Conference on Image Processing (ICIP '01), October 2001, Thessaloniki, Greece 1: 990–993.Google Scholar
  25. Chen M, He Y, Lagendijk RL: A fragile watermark error detection scheme for wireless video communications. IEEE Transactions on Multimedia 2005, 7(2):201–211.View ArticleGoogle Scholar
  26. Chen M, Wu M, Zheng Y: Classification-based spatial error concealment for images. Proceedings of IEEE International Conference on Image Processing (ICIP '03), September 2003, Barcelona, Spain 2: 675–678.Google Scholar


© Chen et al. 2006