Skip to main content

Advertisement

EURASIP Journal on Advances in Signal Processing
EURASIP Journal on Advances in Signal Processing Cover Image
Download PDF

Content-Based Object Movie Retrieval and Relevance Feedbacks

EURASIP Journal on Advances in Signal Processing volume 2007, Article number: 089691 (2007) Cite this article

Abstract

Object movie refers to a set of images captured from different perspectives around a 3D object. Object movie provides a good representation of a physical object because it can provide 3D interactive viewing effect, but does not require 3D model reconstruction. In this paper, we propose an efficient approach for content-based object movie retrieval. In order to retrieve the desired object movie from the database, we first map an object movie into the sampling of a manifold in the feature space. Two different layers of feature descriptors, dense and condensed, are designed to sample the manifold for representing object movies. Based on these descriptors, we define the dissimilarity measure between the query and the target in the object movie database. The query we considered can be either an entire object movie or simply a subset of views. We further design a relevance feedback approach to improving retrieved results. Finally, some experimental results are presented to show the efficacy of our approach.

References

  1. 1.

    Chen SE: QuickTime VR—an image-based approach to virtual environment navigation. Proceedings of the 22nd Annual ACM Conference on Computer Graphics and Interactive Techniques, August 1995, Los Angeles, Calif, USA 29–38.

  2. 2.

    Hung Y-P, Chen C-S, Tsai Y-P, Lin S-W: Augmenting panoramas with object movies by generating novel views with disparity-based view morphing. Journal of Visualization and Computer Animation 2002,13(4):237-247. 10.1002/vis.292

  3. 3.

    Gortler SJ, Grzeszczuk R, Szeliski R, Cohen MF: The lumigraph. Proceedings of the 23rd Annual Conference on Computer Graphics (SIGGRAPH '96), August 1996, New Orleans, La, USA 43–54.

  4. 4.

    Levoy M, Hanrahan P: Light field rendering. Proceedings of the 23rd Annual Conference on Computer Graphics (SIGGRAPH '96), August 1996, New Orleans, La, USA 31–42.

  5. 5.

    McMillan L, Bishop G: Plenoptic modeling: an image-based rendering system. Proceedings of the 22nd Annual Conference on Computer Graphics (SIGGRAPH '95), August 1995, Los Angeles, Calif, USA 39–46.

  6. 6.

    Zhang C, Chen T: A survey on image-based rendering—representation, sampling and compression. Signal Processing: Image Communication 2004,19(1):1-28. 10.1016/j.image.2003.07.001

  7. 7.

    Castelli V, Bergman LD: Image Databases: Search and Retrieval of Digital Imagery. John Wiley & Sons, New York, NY, USA; 2002.

  8. 8.

    Datta R, Li J, Wang JZ: Content-based image retrieval: approaches and trends of the new age. Proceedings of the 7th ACM SIGMM International Workshop on Multimedia Information Retrieval (MIR '05), November 2005, Singapore 253–262.

  9. 9.

    Zhang R, Zhang Z, Li M, Ma W-Y, Zhang H-J: A probabilistic semantic model for image annotation and multi-modal image retrieval. Proceedings of the 10th IEEE International Conference on Computer Vision (ICCV '05), October 2005, Beijing, China 1: 846–851.

  10. 10.

    Chen D-Y, Tian X-P, Shen Y-T, Ouhyoung M: On visual similarity based 3D model retrieval. Computer Graphics Forum 2003,22(3):223-232. 10.1111/1467-8659.00669

  11. 11.

    Funkhouser T, Min P, Kazhdan M, et al.: A search engine for 3D models. ACM Transactions on Graphics 2003,22(1):83-105. 10.1145/588272.588279

  12. 12.

    Shilane P, Min P, Kazhdan M, Funkhouser T: The Princeton shape Benchmark. Proceedings of Shape Modeling International (SMI '04), June 2004, Genova, Italy 167–178.

  13. 13.

    Zhang C, Chen T: An active learning framework for content-based information retrieval. IEEE Transactions on Multimedia 2002,4(2):260-268. 10.1109/TMM.2002.1017738

  14. 14.

    Atmosukarto I, Leow WK, Huang Z: Feature combination and relevance feedback for 3D model retrieval. Proceedings of the 11th International Multimedia Modelling Conference (MMM '05), January 2005, Melbourne, Australia 334–339.

  15. 15.

    Cyr CM, Kimia BB: 3D object recognition using shape similarity-based aspect graph. Proceedings of the 8th International Conference on Computer Vision (ICCV '01), July 2001, Vancouver, BC, USA 1: 254–261.

  16. 16.

    Selinger A, Nelson RC: Appearance-based object recognition using multiple views. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR '01), December 2001, Kauai, Hawaii, USA 1: 905–911.

  17. 17.

    Mahmoudi S, Daoudi M: 3D models retrieval by using characteristic views. Proceedings of the 16th International Conference on Pattern Recognition (ICPR '02), August 2002, Quebec, Canada 2: 457–460.

  18. 18.

    Stricker MA, Orengo M: Similarity of color images. Storage and Retrieval for Image and Video Databases III, February 1995, San Jose, Calif, USA, Proceedings of SPIE 2420: 381–392.

  19. 19.

    Zhang DS, Lu G: A comparative study of Fourier descriptors for shape representation and retrieval. Proceedings of the 5th Asian Conference on Computer Vision (ACCV '02), January 2002, Melbourne, Australia 646–651.

  20. 20.

    Khotanzad A, Hong YH: Invariant image recognition by Zernike moments. IEEE Transactions on Pattern Analysis and Machine Intelligence 1990,12(5):489-497. 10.1109/34.55109

  21. 21.

    Hse H, Newton AR: Sketched symbol recognition using Zernike moments. Proceedings of the 17th International Conference on Pattern Recognition (ICPR '04), August 2004, Cambridge, UK 1: 367–370.

  22. 22.

    Rui Y, Huang TS, Mehrotra S: Content-based image retrieval with relevance feedback in MARS. Proceedings of IEEE International Conference on Image Processing, October 1997, Santa Barbara, Calif, USA 2: 815–818.

  23. 23.

    Su Z, Zhang H, Li S, Ma S: Relevance feedback in content-based image retrieval: Bayesian framework, feature subspaces, and progressive learning. IEEE Transactions on Image Processing 2003,12(8):924-937. 10.1109/TIP.2003.815254

  24. 24.

    Zhou XS, Huang TS: Relevance feedback in image retrieval: a comprehensive review. Multimedia Systems 2003,8(6):536-544. 10.1007/s00530-002-0070-3

  25. 25.

    Cox IJ, Miller ML, Omohundro SM, Yianilos PN: PicHunter: Bayesian relevance feedback for image retrieval. Proceedings of the 13th International Conference on Pattern Recognition (ICPR '96), August 1996, Vienna, Austria 3: 361–369.

Download references

Author information

Affiliations

  1. Graduate Institute of Information and Computer Education, College of Education, National Taiwan Normal University, Taipei, 106, Taiwan
    • Cheng-Chieh Chiang
  2. Department of Information Technology, Takming College, Taipei, 114, Taiwan
    • Cheng-Chieh Chiang
  3. Department of Computer Science and Information Engineering, College of Electrical Engineering and Computer Science, National Taiwan University, Taipei, 106, Taiwan
    • Li-Wei Chan
  4. Graduate Institute of Networking and Multimedia, College of Electrical Engineering and Computer Science, National Taiwan University, Taipei, 106, Taiwan
    • Yi-Ping Hung
  5. Department of Computer Science and Information Engineering, College of Science, National Taiwan Normal University, Taipei, 106, Taiwan
    • Greg C. Lee
Authors
  1. Cheng-Chieh Chiang
    View author publications
    You can also search for this author in
  2. Li-Wei Chan
    View author publications
    You can also search for this author in
  3. Yi-Ping Hung
    View author publications
    You can also search for this author in
  4. Greg C. Lee
    View author publications
    You can also search for this author in

Corresponding author

Correspondence to Cheng-Chieh Chiang.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 2.0 International License (https://doi.org/creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Reprints and Permissions

About this article

Cite this article

Chiang, C., Chan, L., Hung, Y. et al. Content-Based Object Movie Retrieval and Relevance Feedbacks. EURASIP J. Adv. Signal Process. 2007, 089691 (2007). https://doi.org/10.1155/2007/89691

Download citation

Keywords

  • Manifold
  • Feature Space
  • Quantum Information
  • Good Representation
  • Physical Object