- Research Article
- Open Access
Stereo Image Coder Based on the MRF Model for Disparity Compensation
EURASIP Journal on Advances in Signal Processing volume 2006, Article number: 073950 (2006)
This paper presents a stereoscopic image coder based on the MRF model and MAP estimation of the disparity field. The MRF model minimizes the noise of disparity compensation, because it takes into account the residual energy, smoothness constraints on the disparity field, and the occlusion field. Disparity compensation is formulated as an MAP-MRF problem in the spatial domain, where the MRF field consists of the disparity vector and occlusion fields. The occlusion field is partitioned into three regions by an initial double-threshold setting. The MAP search is conducted in a block-based sense on one or two of the three regions, providing faster execution. The reference and residual images are decomposed by a discrete wavelet transform and the transform coefficients are encoded by employing the morphological representation of wavelet coefficients algorithm. As a result of the morphological encoding, the reference and residual images together with the disparity vector field are transmitted in partitions, lowering total entropy. The experimental evaluation of the proposed scheme on synthetic and real images shows beneficial performance over other stereoscopic coders in the literature.
Yamaguchi H, Tatehira Y, Akiyama K, Kobayashi Y: Stereoscopic images disparity for predictive coding. Proceedings of IEEE International Conference on Acoustics Speech and Signal Processing (ICASSP '89), May 1989, Glasgow, Scotland, UK 3: 1976–1979.
Lucas BD, Kanade T: An iterative image registration technique with an application to stereo vision. Proceedings of 7th International Joint Conference on Artificial Intelligence (IJCAI '81), August 1981, Vancouver, BC, Canada 674–679.
Woo W, Ortega A: Overlapped block disparity compensation with adaptive windows for stereo image coding. IEEE Transactions on Circuits and Systems for Video Technology 2000, 10(2):194–200. 10.1109/76.825718
Jiang J, Edirisinghe EA: A hybrid scheme for low bit-rate coding of stereo images. IEEE Transactions on Image Processing 2002, 11(2):123–134. 10.1109/83.982820
Sethuraman S, Jordan A, Siegel M: Multiresolution based hierarchical disparity estimation for stereo image pair compression. Proceedings of Symposium on Applications of Subbands and Wavelets, March 1994, Newark, NJ, USA
Woo W, Ortega A: Stereo image compression with disparity compensation using the MRF model. Visual Communications and Image Processing (VCIP '96), March 1996, Orlando, Fla, USA, Proceedings of SPIE 2727: 28–41.
Yamaguchi H, Tatehira Y, Akiyama K, Kobayashi Y: Data compression and depth shape reproduction of stereoscopic images. Systems and Computers in Japan 1991, 22(12):53–64. 10.1002/scj.4690221205
Boulgouris NV, Strintzis MG: A family of wavelet-based stereo image coders. IEEE Transactions on Circuits and Systems for Video Technology 2002, 12(10):898–903. 10.1109/TCSVT.2002.804895
Frajka T, Zeger K: Residual image coding for stereo image compression. Optical Engineering 2003, 42(1):182–189. 10.1117/1.1526492
Ellinas JN, Sangriotis MS: Stereo image compression using wavelet coefficients morphology. Image and Vision Computing 2004, 22(4):281–290. 10.1016/j.imavis.2003.09.017
Perkins MG: Data compression of stereopairs. IEEE Transactions on Communications 1992, 40(4):684–696. 10.1109/26.141424
Aydinoglu H, Hayes MH: Stereo image coding: a projection approach. IEEE Transactions on Image Processing 1998, 7(4):506–516. 10.1109/83.663495
Geman S, Geman D: Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images. IEEE Transactions on Pattern Analysis and Machine Intelligence 1984, 6(6):721–741.
Konrad J, Dubois E: Bayesian estimation of motion vector fields. IEEE Transactions on Pattern Analysis and Machine Intelligence 1992, 14(9):910–927. 10.1109/34.161350
Zhang J, Hanauer GG: The application of mean field theory to image motion estimation. IEEE Transactions on Image Processing 1995, 4(1):19–33. 10.1109/83.350816
Wei J, Li Z-N: An efficient two-pass MAP-MRF algorithm for motion estimation based on mean field theory. IEEE Transactions on Circuits and Systems for Video Technology 1999, 9(6):960–972. 10.1109/76.785734
Ellinas JN, Sangriotis MS: Stereo image coder based on MRF analysis for disparity estimation and morphological encoding. Proceedings of 2nd IEEE International Symposium on 3D Data Processing, Visualization and Transmission (3DPVT '04), September 2004, Thessaloniki, Greece 852–859.
Servetto SD, Ramchandran K, Orchard MT: Image coding based on a morphological representation of wavelet data. IEEE Transactions on Image Processing 1999, 8(9):1161–1174. 10.1109/83.784429
Lukacs M: Predictive coding of multi-view point image sets. Proceedings of IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP '86), April 1986, Tokyo, Japan 11: 521–524.
Starck J-L, Murtagh FD, Bijaoui A: Image Processing and Data Analysis: The Multiscale Approach. Cambridge University Press, Cambridge, UK; 1998.
Li SZ: Markov Random Field Modeling in Computer Vision. Springer, Tokyo, Japan; 1995.
Li SZ: Markov random field models in computer vision. Proceedings of 3rd European Conference on Computer Vision (ECCV '94), May 1994, Stockholm, Sweden 2: 361–370.
Besag J: Spatial interaction and the statistical analysis of lattice systems. Journal of the Royal Statistical Society B 1974, 36: 192–225.
Antonini M, Barlaud M, Mathieu P, Daubechies I: Image coding using wavelet transform. IEEE Transactions on Image Processing 1992, 1(2):205–220. 10.1109/83.136597
Shapiro JM: Embedded image coding using zero trees of wavelet coefficients. IEEE Transactions on Signal Processing 1993, 41(12):3445–3462. 10.1109/78.258085
Said A, Pearlman WA: A new, fast, and efficient image codec based on set partitioning in hierarchical trees. IEEE Transactions on Circuits and Systems for Video Technology 1996, 6(3):243–250. 10.1109/76.499834
Chai B-B, Vass J, Zhuang X: Significance-linked connected component analysis for wavelet image coding. IEEE Transactions on Image Processing 1999, 8(6):774–784. 10.1109/83.766856
Dubois E, Konrad J: Estimation of 2-D motion fields from image sequences with application to motion-compensated processing. In Motion Analysis and Image Sequence Processing. Edited by: Sezan MI, Lagendijk RL. Kluwer Academic, Boston, Mass, USA; 1993:53–87.
Stereo images from Bonn University, available from: https://doi.org/www-dbv.cs.uni-bonn.de
Stereo images from Carnegie Mellon University, Pittsburgh, Pa, USA, available from: https://doi.org/www-2.cs.cmu.edu/afs/cs.cmu.edu/project/sensor-9/ftp/
Usevitch BE: A tutorial on modern lossy wavelet image compression: foundations of JPEG 2000. IEEE Signal Processing Magazine 2001, 18(5):22–35. 10.1109/79.952803
Adams MD, Man H, Kossentini F, Ebrahimi T: JPEG 2000: The next generation still image compression standard. ISO/IEC JTC 1/SC 29/WG 1 N 1734, 2000
Woo W, Ortega A: Optimal blockwise dependent quantization for stereo image coding. IEEE Transactions on Circuits and Systems for Video Technology 1999, 9(6):861–867. 10.1109/76.785724
Woo W, Ortega A, Iwadate Y: Stereo image coding using hierarchical MRF model and selective overlapped block disparity compensation. Proceedings of IEEE International Conference on Image Processing (ICIP '99), October 1999, Kobe, Japan 2: 467–471.
About this article
Cite this article
Ellinas, J.N., Sangriotis, M.S. Stereo Image Coder Based on the MRF Model for Disparity Compensation. EURASIP J. Adv. Signal Process. 2006, 073950 (2006). https://doi.org/10.1155/ASP/2006/73950
- Wavelet Coefficient
- Residual Energy
- Stereo Image
- Total Entropy
- Image Coder