Skip to main content


Classification-Based Spatial Error Concealment for Visual Communications

Article metrics

  • 741 Accesses

  • 10 Citations


In an error-prone transmission environment, error concealment is an effective technique to reconstruct the damaged visual content. Due to large variations of image characteristics, different concealment approaches are necessary to accommodate the different nature of the lost image content. In this paper, we address this issue and propose using classification to integrate the state-of-the-art error concealment techniques. The proposed approach takes advantage of multiple concealment algorithms and adaptively selects the suitable algorithm for each damaged image area. With growing awareness that the design of sender and receiver systems should be jointly considered for efficient and reliable multimedia communications, we proposed a set of classification-based block concealment schemes, including receiver-side classification, sender-side attachment, and sender-side embedding. Our experimental results provide extensive performance comparisons and demonstrate that the proposed classification-based error concealment approaches outperform the conventional approaches.


  1. 1.

    Wang Y, Zhu Q-F: Error control and concealment for video communication: a review. Proceedings of the IEEE 1998, 86(5):974–997. 10.1109/5.664283

  2. 2.

    Kwok W, Sun H: Multi-directional interpolation for spatial error concealment. IEEE Transactions on Consumer Electronics 1993, 39(3):455–460. 10.1109/30.234620

  3. 3.

    Sun H, Kwok W: Concealment of damaged block transform coded images using projections onto convex sets. IEEE Transactions on Image Processing 1995, 4(4):470–477. 10.1109/83.370675

  4. 4.

    Wang Y, Zhu Q-F, Shaw L: Maximally smooth image recovery in transform coding. IEEE Transactions on Communications 1993, 41(10):1544–1551. 10.1109/26.237889

  5. 5.

    Zeng W, Liu B: Geometric-structure-based error concealment with novel applications in block-based low-bit-rate coding. IEEE Transactions on Circuits and Systems for Video Technology 1999, 9(4):648–665. 10.1109/76.767129

  6. 6.

    Li X, Orchard MT: Novel sequential error-concealment techniques using orientation adaptive interpolation. IEEE Transactions on Circuits and Systems for Video Technology 2002, 12(10):857–864. 10.1109/TCSVT.2002.804882

  7. 7.

    Zhang D, Wang Z: Image information restoration based on long-range correlation. IEEE Transactions on Circuits and Systems for Video Technology 2002, 12(5):331–341. 10.1109/TCSVT.2002.1003472

  8. 8.

    Bertalmio M, Vese L, Sapiro G, Osher S: Simultaneous structure and texture image inpainting. IEEE Transactions on Image Processing 2003, 12(8):882–889. 10.1109/TIP.2003.815261

  9. 9.

    Yin P, Liu B, Yu HH: Error concealment using data hiding. Proceedings of IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP '01), May 2001, Salt Lake City, Utah, USA 3: 1453–1456.

  10. 10.

    Yin P, Wu M, Liu B: Robust error-resilient approach for MPEG video transmission over Internet. Visual Communications and Image Processing (VCIP '02), January 2002, San Jose, Calif, USA, Proceedings of SPIE 4671: 103–111.

  11. 11.

    Liu Y, Li Y: Error concealment of digital images using data hiding. Proceeding of 9th IEEE DSP Workshop, October 2000, Hunt, Tex, USA

  12. 12.

    Jung K-H, Chang J-H, Lee CW: Error concealment technique using projection data for block-based image coding. Visual Communications and Image Processing (VCIP '94), September 1994, Chicago, Ill, USA, Proceedings of SPIE 2308, part 3: 1466–1476.

  13. 13.

    Duda RO, Hart PE, Stork DG: Pattern Classification. 2nd edition. John Wiley & Sons, New York, NY, USA; 2001.

  14. 14.

    Joachims T: Text categorization with support vector machines: learning with many relevant features. Proceedings of 10th European Conference on Machine Learning (ECML '98), April 1998, Chemnitz, Germany 137–142.

  15. 15.

    Burges CJC: A tutorial on support vector machines for pattern recognition. Data Mining and Knowledge Discovery 1998, 2(2):121–167. 10.1023/A:1009715923555

  16. 16.

    Vapnik VN: The Nature of Statistical Learning Theory. Springer, Berlin, Germany; 1995.

  17. 17.

    Smola AJ, Bartlett P, Schölkopf B, Schuurmans D: Advances in Large Margin Classifiers. MIT Press, Cambridge, Mass, USA; 1999.

  18. 18.

    Joachims T: Support Vector Machine V5.00. 2002.

  19. 19.

    Joachims T: Making large-scale SVM learning practical. In Advances in Kernel Methods—Support Vector Learning. Edited by: Schölkopf B, Burges CJC, Smola AJ. MIT Press, Cambridge, Mass, USA; 1999:169–184.

  20. 20.

    Wu M, Liu B: Multimedia Data Hiding. Springer, New York, NY, USA; 2002.

  21. 21.

    Wu M, Liu B: Data hiding in image and video: Part-I Fundamental issues and solutions. IEEE Transactions on Image Processing 2003, 12(6):685–695. 10.1109/TIP.2003.810588

  22. 22.

    Wu M, Yu HH, Gelman A: Multi-level data hiding for digital image and video. Multimedia Systems and Applications II, September 1999, Boston, Mass, USA, Proceedings of SPIE 3845: 10–21.

  23. 23.

    Dovrolis C, Tull D, Ramanathan P: Hybrid spatial/temporal loss concealment for packet video. Proceedings of the 9th International Packet Video Workshop (PVW '99), April 1999, New York, NY, USA

  24. 24.

    Lee Y-C, Altunbasak Y, Mersereau RM: A temporal error concealment method for MPEG coded video using a multi-frame boundary matching algorithm. Proceedings of IEEE International Conference on Image Processing (ICIP '01), October 2001, Thessaloniki, Greece 1: 990–993.

  25. 25.

    Chen M, He Y, Lagendijk RL: A fragile watermark error detection scheme for wireless video communications. IEEE Transactions on Multimedia 2005, 7(2):201–211.

  26. 26.

    Chen M, Wu M, Zheng Y: Classification-based spatial error concealment for images. Proceedings of IEEE International Conference on Image Processing (ICIP '03), September 2003, Barcelona, Spain 2: 675–678.

Download references

Author information

Correspondence to Meng Chen.

Rights and permissions

Reprints and Permissions

About this article


  • Lost
  • Spatial Error
  • Extensive Performance
  • Visual Content
  • Visual Communication