Research Article | Open | Published:
Classification-Based Spatial Error Concealment for Visual Communications
EURASIP Journal on Advances in Signal Processingvolume 2006, Article number: 013438 (2006)
In an error-prone transmission environment, error concealment is an effective technique to reconstruct the damaged visual content. Due to large variations of image characteristics, different concealment approaches are necessary to accommodate the different nature of the lost image content. In this paper, we address this issue and propose using classification to integrate the state-of-the-art error concealment techniques. The proposed approach takes advantage of multiple concealment algorithms and adaptively selects the suitable algorithm for each damaged image area. With growing awareness that the design of sender and receiver systems should be jointly considered for efficient and reliable multimedia communications, we proposed a set of classification-based block concealment schemes, including receiver-side classification, sender-side attachment, and sender-side embedding. Our experimental results provide extensive performance comparisons and demonstrate that the proposed classification-based error concealment approaches outperform the conventional approaches.
Wang Y, Zhu Q-F: Error control and concealment for video communication: a review. Proceedings of the IEEE 1998, 86(5):974–997. 10.1109/5.664283
Kwok W, Sun H: Multi-directional interpolation for spatial error concealment. IEEE Transactions on Consumer Electronics 1993, 39(3):455–460. 10.1109/30.234620
Sun H, Kwok W: Concealment of damaged block transform coded images using projections onto convex sets. IEEE Transactions on Image Processing 1995, 4(4):470–477. 10.1109/83.370675
Wang Y, Zhu Q-F, Shaw L: Maximally smooth image recovery in transform coding. IEEE Transactions on Communications 1993, 41(10):1544–1551. 10.1109/26.237889
Zeng W, Liu B: Geometric-structure-based error concealment with novel applications in block-based low-bit-rate coding. IEEE Transactions on Circuits and Systems for Video Technology 1999, 9(4):648–665. 10.1109/76.767129
Li X, Orchard MT: Novel sequential error-concealment techniques using orientation adaptive interpolation. IEEE Transactions on Circuits and Systems for Video Technology 2002, 12(10):857–864. 10.1109/TCSVT.2002.804882
Zhang D, Wang Z: Image information restoration based on long-range correlation. IEEE Transactions on Circuits and Systems for Video Technology 2002, 12(5):331–341. 10.1109/TCSVT.2002.1003472
Bertalmio M, Vese L, Sapiro G, Osher S: Simultaneous structure and texture image inpainting. IEEE Transactions on Image Processing 2003, 12(8):882–889. 10.1109/TIP.2003.815261
Yin P, Liu B, Yu HH: Error concealment using data hiding. Proceedings of IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP '01), May 2001, Salt Lake City, Utah, USA 3: 1453–1456.
Yin P, Wu M, Liu B: Robust error-resilient approach for MPEG video transmission over Internet. Visual Communications and Image Processing (VCIP '02), January 2002, San Jose, Calif, USA, Proceedings of SPIE 4671: 103–111.
Liu Y, Li Y: Error concealment of digital images using data hiding. Proceeding of 9th IEEE DSP Workshop, October 2000, Hunt, Tex, USA
Jung K-H, Chang J-H, Lee CW: Error concealment technique using projection data for block-based image coding. Visual Communications and Image Processing (VCIP '94), September 1994, Chicago, Ill, USA, Proceedings of SPIE 2308, part 3: 1466–1476.
Duda RO, Hart PE, Stork DG: Pattern Classification. 2nd edition. John Wiley & Sons, New York, NY, USA; 2001.
Joachims T: Text categorization with support vector machines: learning with many relevant features. Proceedings of 10th European Conference on Machine Learning (ECML '98), April 1998, Chemnitz, Germany 137–142.
Burges CJC: A tutorial on support vector machines for pattern recognition. Data Mining and Knowledge Discovery 1998, 2(2):121–167. 10.1023/A:1009715923555
Vapnik VN: The Nature of Statistical Learning Theory. Springer, Berlin, Germany; 1995.
Smola AJ, Bartlett P, Schölkopf B, Schuurmans D: Advances in Large Margin Classifiers. MIT Press, Cambridge, Mass, USA; 1999.
Joachims T: Support Vector Machine V5.00. 2002.https://doi.org/svmlight.joachims.org
Joachims T: Making large-scale SVM learning practical. In Advances in Kernel Methods—Support Vector Learning. Edited by: Schölkopf B, Burges CJC, Smola AJ. MIT Press, Cambridge, Mass, USA; 1999:169–184.
Wu M, Liu B: Multimedia Data Hiding. Springer, New York, NY, USA; 2002.
Wu M, Liu B: Data hiding in image and video: Part-I Fundamental issues and solutions. IEEE Transactions on Image Processing 2003, 12(6):685–695. 10.1109/TIP.2003.810588
Wu M, Yu HH, Gelman A: Multi-level data hiding for digital image and video. Multimedia Systems and Applications II, September 1999, Boston, Mass, USA, Proceedings of SPIE 3845: 10–21.
Dovrolis C, Tull D, Ramanathan P: Hybrid spatial/temporal loss concealment for packet video. Proceedings of the 9th International Packet Video Workshop (PVW '99), April 1999, New York, NY, USA
Lee Y-C, Altunbasak Y, Mersereau RM: A temporal error concealment method for MPEG coded video using a multi-frame boundary matching algorithm. Proceedings of IEEE International Conference on Image Processing (ICIP '01), October 2001, Thessaloniki, Greece 1: 990–993.
Chen M, He Y, Lagendijk RL: A fragile watermark error detection scheme for wireless video communications. IEEE Transactions on Multimedia 2005, 7(2):201–211.
Chen M, Wu M, Zheng Y: Classification-based spatial error concealment for images. Proceedings of IEEE International Conference on Image Processing (ICIP '03), September 2003, Barcelona, Spain 2: 675–678.