Open Access

Content-Based Object Movie Retrieval and Relevance Feedbacks

  • Cheng-Chieh Chiang1, 2Email author,
  • Li-Wei Chan3,
  • Yi-Ping Hung4 and
  • Greg C. Lee5
EURASIP Journal on Advances in Signal Processing20072007:089691

https://doi.org/10.1155/2007/89691

Received: 26 January 2006

Accepted: 13 May 2007

Published: 2 July 2007

Abstract

Object movie refers to a set of images captured from different perspectives around a 3D object. Object movie provides a good representation of a physical object because it can provide 3D interactive viewing effect, but does not require 3D model reconstruction. In this paper, we propose an efficient approach for content-based object movie retrieval. In order to retrieve the desired object movie from the database, we first map an object movie into the sampling of a manifold in the feature space. Two different layers of feature descriptors, dense and condensed, are designed to sample the manifold for representing object movies. Based on these descriptors, we define the dissimilarity measure between the query and the target in the object movie database. The query we considered can be either an entire object movie or simply a subset of views. We further design a relevance feedback approach to improving retrieved results. Finally, some experimental results are presented to show the efficacy of our approach.

[12345678910111213141516171819202122232425]

Authors’ Affiliations

(1)
Graduate Institute of Information and Computer Education, College of Education, National Taiwan Normal University
(2)
Department of Information Technology, Takming College
(3)
Department of Computer Science and Information Engineering, College of Electrical Engineering and Computer Science, National Taiwan University
(4)
Graduate Institute of Networking and Multimedia, College of Electrical Engineering and Computer Science, National Taiwan University
(5)
Department of Computer Science and Information Engineering, College of Science, National Taiwan Normal University

References

  1. Chen SE: QuickTime VR—an image-based approach to virtual environment navigation. Proceedings of the 22nd Annual ACM Conference on Computer Graphics and Interactive Techniques, August 1995, Los Angeles, Calif, USA 29-38.Google Scholar
  2. Hung Y-P, Chen C-S, Tsai Y-P, Lin S-W: Augmenting panoramas with object movies by generating novel views with disparity-based view morphing. Journal of Visualization and Computer Animation 2002,13(4):237-247. 10.1002/vis.292View ArticleMATHGoogle Scholar
  3. Gortler SJ, Grzeszczuk R, Szeliski R, Cohen MF: The lumigraph. Proceedings of the 23rd Annual Conference on Computer Graphics (SIGGRAPH '96), August 1996, New Orleans, La, USA 43-54.Google Scholar
  4. Levoy M, Hanrahan P: Light field rendering. Proceedings of the 23rd Annual Conference on Computer Graphics (SIGGRAPH '96), August 1996, New Orleans, La, USA 31-42.Google Scholar
  5. McMillan L, Bishop G: Plenoptic modeling: an image-based rendering system. Proceedings of the 22nd Annual Conference on Computer Graphics (SIGGRAPH '95), August 1995, Los Angeles, Calif, USA 39-46.Google Scholar
  6. Zhang C, Chen T: A survey on image-based rendering—representation, sampling and compression. Signal Processing: Image Communication 2004,19(1):1-28. 10.1016/j.image.2003.07.001Google Scholar
  7. Castelli V, Bergman LD: Image Databases: Search and Retrieval of Digital Imagery. John Wiley & Sons, New York, NY, USA; 2002.Google Scholar
  8. Datta R, Li J, Wang JZ: Content-based image retrieval: approaches and trends of the new age. Proceedings of the 7th ACM SIGMM International Workshop on Multimedia Information Retrieval (MIR '05), November 2005, Singapore 253-262.View ArticleGoogle Scholar
  9. Zhang R, Zhang Z, Li M, Ma W-Y, Zhang H-J: A probabilistic semantic model for image annotation and multi-modal image retrieval. Proceedings of the 10th IEEE International Conference on Computer Vision (ICCV '05), October 2005, Beijing, China 1: 846-851.View ArticleGoogle Scholar
  10. Chen D-Y, Tian X-P, Shen Y-T, Ouhyoung M: On visual similarity based 3D model retrieval. Computer Graphics Forum 2003,22(3):223-232. 10.1111/1467-8659.00669View ArticleGoogle Scholar
  11. Funkhouser T, Min P, Kazhdan M, et al.: A search engine for 3D models. ACM Transactions on Graphics 2003,22(1):83-105. 10.1145/588272.588279View ArticleGoogle Scholar
  12. Shilane P, Min P, Kazhdan M, Funkhouser T: The Princeton shape Benchmark. Proceedings of Shape Modeling International (SMI '04), June 2004, Genova, Italy 167-178.Google Scholar
  13. Zhang C, Chen T: An active learning framework for content-based information retrieval. IEEE Transactions on Multimedia 2002,4(2):260-268. 10.1109/TMM.2002.1017738View ArticleGoogle Scholar
  14. Atmosukarto I, Leow WK, Huang Z: Feature combination and relevance feedback for 3D model retrieval. Proceedings of the 11th International Multimedia Modelling Conference (MMM '05), January 2005, Melbourne, Australia 334-339.View ArticleGoogle Scholar
  15. Cyr CM, Kimia BB: 3D object recognition using shape similarity-based aspect graph. Proceedings of the 8th International Conference on Computer Vision (ICCV '01), July 2001, Vancouver, BC, USA 1: 254-261.Google Scholar
  16. Selinger A, Nelson RC: Appearance-based object recognition using multiple views. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR '01), December 2001, Kauai, Hawaii, USA 1: 905-911.Google Scholar
  17. Mahmoudi S, Daoudi M: 3D models retrieval by using characteristic views. Proceedings of the 16th International Conference on Pattern Recognition (ICPR '02), August 2002, Quebec, Canada 2: 457-460.Google Scholar
  18. Stricker MA, Orengo M: Similarity of color images. Storage and Retrieval for Image and Video Databases III, February 1995, San Jose, Calif, USA, Proceedings of SPIE 2420: 381-392.View ArticleGoogle Scholar
  19. Zhang DS, Lu G: A comparative study of Fourier descriptors for shape representation and retrieval. Proceedings of the 5th Asian Conference on Computer Vision (ACCV '02), January 2002, Melbourne, Australia 646-651.Google Scholar
  20. Khotanzad A, Hong YH: Invariant image recognition by Zernike moments. IEEE Transactions on Pattern Analysis and Machine Intelligence 1990,12(5):489-497. 10.1109/34.55109View ArticleGoogle Scholar
  21. Hse H, Newton AR: Sketched symbol recognition using Zernike moments. Proceedings of the 17th International Conference on Pattern Recognition (ICPR '04), August 2004, Cambridge, UK 1: 367-370.View ArticleGoogle Scholar
  22. Rui Y, Huang TS, Mehrotra S: Content-based image retrieval with relevance feedback in MARS. Proceedings of IEEE International Conference on Image Processing, October 1997, Santa Barbara, Calif, USA 2: 815-818.View ArticleGoogle Scholar
  23. Su Z, Zhang H, Li S, Ma S: Relevance feedback in content-based image retrieval: Bayesian framework, feature subspaces, and progressive learning. IEEE Transactions on Image Processing 2003,12(8):924-937. 10.1109/TIP.2003.815254View ArticleGoogle Scholar
  24. Zhou XS, Huang TS: Relevance feedback in image retrieval: a comprehensive review. Multimedia Systems 2003,8(6):536-544. 10.1007/s00530-002-0070-3View ArticleGoogle Scholar
  25. Cox IJ, Miller ML, Omohundro SM, Yianilos PN: PicHunter: Bayesian relevance feedback for image retrieval. Proceedings of the 13th International Conference on Pattern Recognition (ICPR '96), August 1996, Vienna, Austria 3: 361-369.View ArticleGoogle Scholar

Copyright

© Cheng-Chieh Chiang et al. 2007

This article is published under license to BioMed Central Ltd. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.