Skip to main content
EURASIP Journal on Advances in Signal Processing
Download PDF
  • Research Article
  • Open access
  • Published:

Determining Vision Graphs for Distributed Camera Networks Using Feature Digests

EURASIP Journal on Advances in Signal Processing volume 2007, Article number: 057034 (2006) Cite this article

Abstract

We propose a decentralized method for obtaining the vision graph for a distributed, ad-hoc camera network, in which each edge of the graph represents two cameras that image a sufficiently large part of the same environment. Each camera encodes a spatially well-distributed set of distinctive, approximately viewpoint-invariant feature points into a fixed-length "feature digest" that is broadcast throughout the network. Each receiver camera robustly matches its own features with the decompressed digest and decides whether sufficient evidence exists to form a vision graph edge. We also show how a camera calibration algorithm that passes messages only along vision graph edges can recover accurate 3D structure and camera positions in a distributed manner. We analyze the performance of different message formation schemes, and show that high detection rates () can be achieved while maintaining low false alarm rates () using a simulated 60-node outdoor camera network.

References

  1. Davis L, Borovikov E, Cutler R, Harwood D, Horprasert T: Multi-perspective analysis of human action. Proceedings of the 3rd International Workshop on Cooperative Distributed Vision, November 1999, Kyoto, Japan

    Google Scholar 

  2. Kanade T, Rander P, Narayanan P: Virtualized reality: constructing virtual worlds from real scenes. IEEE Multimedia, Immersive Telepresence 1997,4(1):34–47.

    Article  Google Scholar 

  3. Devarajan D, Radke R: Distributed metric calibration for large-scale camera networks. Proceedings of the 1st Workshop on Broadband Advanced Sensor Networks (BASENETS '04), October 2004, San Jose, Calif, USA (in conjunction with BroadNets 2004)

    Google Scholar 

  4. Antone M, Teller S: Scalable extrinsic calibration of omni-directional image networks. International Journal of Computer Vision 2002,49(2–3):143–174.

    Article  Google Scholar 

  5. Sharp G, Lee S, Wehe D: Multiview registration of 3-D scenes by minimizing error between coordinate frames. Proceedings of the European Conference on Computer Vision (ECCV '02), May 2002, Copenhagen, Denmark 587–597.

    Google Scholar 

  6. Huber DF: Automatic 3D modeling using range images obtained from unknown viewpoints. Proceedings of the 3rd International Conference on 3D Digital Imaging and Modeling (3DIM '01), May 2001, Quebec City, Quebec, Canada 153–160.

    Chapter  Google Scholar 

  7. Stamos I, Leordeanu M: Automated feature-based range registration of urban scenes of large scale. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR '03), June 2003, Madison, Wis, USA 2: 555–561.

    Google Scholar 

  8. Kang E, Cohen I, Medioni G: A graph-based global registration for 2D mosaics. Proceedings of the 15th International Conference on Pattern Recognition (ICPR '00), September 2000, Barcelona, Spain 257–260.

    Chapter  Google Scholar 

  9. Marzotto R, Fusiello A, Murino V: High resolution video mosaicing with global alignment. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR '04), June–July 2004, Washington, DC, USA 1: 692–698.

    Google Scholar 

  10. Sawhney H, Hsu S, Kumar R: Robust video mosaicing through topology inference and local to global alignment. Proceedings of the European Conference on Computer Vision (ECCV '98), June 1998, Freiburg, Germany 103–119.

    Google Scholar 

  11. Calderara S, Vezzani R, Prati A, Cucchiara R: Entry edge of field of view for multi-camera tracking in distributed video surveillance. Proceedings of the IEEE International Conference on Advanced Video and Signal-Based Surveillance (AVSS '05), September 2005, Como, Italy 93–98.

    Google Scholar 

  12. Khan S, Shah M: Consistent labeling of tracked objects in multiple cameras with overlapping fields of view. IEEE Transactions on Pattern Analysis and Machine Intelligence 2003,25(10):1355–1360. 10.1109/TPAMI.2003.1233912

    Article  Google Scholar 

  13. Brown M, Lowe DG: Recognising panoramas. Proceedings of the IEEE International Conference on Computer Vision (ICCV '03), October 2003, Nice, France 2: 1218–1225.

    Article  Google Scholar 

  14. Brown M, Szeliski R, Winder S: Multi-image matching using multi-scale oriented patches. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR '05), June 2005, San Diego, Calif, USA 1: 510–517.

    Google Scholar 

  15. Schaffalitzky F, Zisserman A: Multi-view matching for unordered image sets. Proceedings of the European Conference on Computer Vision (ECCV '02), May 2002, Copenhagen, Denmark 414–431.

    Google Scholar 

  16. Avidan S, Moses Y, Moses Y: Probabilistic multi-view correspondence in a distributed setting with no central server. Proceedings of the 8th European Conference on Computer Vision (ECCV '04), May 2004, Prague, Czech Republic 428–441.

    Google Scholar 

  17. Harris C, Stephens M: A combined corner and edge detector. Proceedings of the 4th Alvey Vision Conference, August-September 1988, Manchester, UK 147–151.

    Google Scholar 

  18. Mikolajczyk K, Schmid C: Indexing based on scale invariant interest points. Proceedings of the IEEE International Conference on Computer Vision (ICCV '01), July 2001, Vancouver, BC, Canada 1: 525–531.

    Google Scholar 

  19. Lindeberg T: Detecting salient blob-like image structures and their scales with a scale-space primal sketch: a method for focus-of-attention. International Journal of Computer Vision 1994,11(3):283–318.

    Article  Google Scholar 

  20. Lowe DG: Distinctive image features from scale-invariant keypoints. International Journal of Computer Vision 2004,60(2):91–110.

    Article  MathSciNet  Google Scholar 

  21. Mikolajczyk K, Schmid C: Scale & affine invariant interest point detectors. International Journal of Computer Vision 2004,60(1):63–86.

    Article  Google Scholar 

  22. Schmid C, Mohr R: Local grayvalue invariants for image retrieval. IEEE Transactions on Pattern Analysis and Machine Intelligence 1997,19(5):530–535. 10.1109/34.589215

    Article  Google Scholar 

  23. Baumberg A: Reliable feature matching across widely separated views. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR '00), June 2000, Hilton Head Island, SC, USA 1: 774–781.

    Google Scholar 

  24. Mikolajczyk K, Schmid C: A performance evaluation of local descriptors. IEEE Transactions on Pattern Analysis and Machine Intelligence 2005,27(10):1615–1630.

    Article  Google Scholar 

  25. Duda RO, Hart PE, Stork DG: Pattern Classification. John Wiley & Sons, New York, NY, USA; 2000.

    MATH  Google Scholar 

  26. Siva Ram Murthy C, Manoj B: Ad Hoc Wireless Networks: Architectures and Protocols. Prentice Hall PTR, Upper Saddle River, NJ, USA; 2004.

    Google Scholar 

  27. Heinzelman W, Kulik J, Balakrishnan H: Adaptive protocols for information dissemination in wireless sensor networks. Proceedings of the 5th Annual ACM International Conference on Mobile Computing and Networking (MobiCom '99), August 1999, Seattle, Wash, USA 174–185.

    Chapter  Google Scholar 

  28. Heinzelman W, Chandrakasan A, Balakrishnan H: An application-specific protocol architecture for wireless microsensor networks. IEEE Transaction on Wireless Communications 2000,1(4):660–670.

    Article  Google Scholar 

  29. Freidman JH, Bentley JL, Finkel RA: An algorithm for finding best matches in logarithmic expected time. ACM Transactions on Mathematical Software 1977,3(3):209–226. 10.1145/355744.355745

    Article  Google Scholar 

  30. Hartley RI, Zisserman A: Multiple View Geometry in Computer Vision. Cambridge University Press, Cambridge, UK; 2000.

    MATH  Google Scholar 

  31. Sturm P, Triggs B: A factorization based algorithm for multi-image projective structure and motion. Proceedings of the European Conference on Computer Vision (ECCV '96), April 1996, Cambridge, UK 709–720.

    Google Scholar 

  32. Pollefeys M, Koch R, Van Gool L: Self-calibration and metric reconstruction in spite of varying and unknown internal camera parameters. Proceedings of the IEEE International Conference on Computer Vision (ICCV '98), January 1998, Bombay, India 90–95.

    Google Scholar 

  33. Andersson M, Betsis D: Point reconstruction from noisy images. Journal of Mathematical Imaging and Vision 1995,5(1):77–90. 10.1007/BF01250254

    Article  Google Scholar 

  34. Fischler MA, Bolles RC: Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Communications of the ACM 1981,24(6):381–395. 10.1145/358669.358692

    Article  MathSciNet  Google Scholar 

  35. Triggs B, McLauchlan P, Hartley R, Fitzgibbon A: Bundle adjustment—a modern synthesis. In Vision Algorithms: Theory and Practice, Lecture Notes in Computer Science. Edited by: Triggs W, Zisserman A, Szeliski R. Springer, New York, NY, USA; 2000:298–375.

    Chapter  Google Scholar 

  36. Poor HV: An Introduction to Signal Detection and Estimation. Springer, New York, NY, USA; 1998.

    Google Scholar 

  37. Sivic J, Zisserman A: Video google: a text retrieval approach to object matching in videos. Proceedings of the IEEE International Conference on Computer Vision (ICCV '03), October 2003, Nice, France 2: 1470–1477.

    Article  Google Scholar 

  38. Gerla M, Tsai J: Multicluster, mobile, multimedia radio network. Journal of Wireless Networks 1955,1(3):255–265.

    Article  Google Scholar 

  39. Cai Z, Lu M, Wang X: Distributed initialization algorithms for single-hop ad hoc networks with minislotted carrier sensing. IEEE Transactions on Parallel and Distributed Systems 2003,14(5):516–528. 10.1109/TPDS.2003.1199068

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Electrical, Computer, and Systems Engineering, Rensselaer Polytechnic Institute, Troy, NY, 12180, USA

    Zhaolin Cheng, Dhanya Devarajan & Richard J. Radke

Authors
  1. Zhaolin Cheng
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Dhanya Devarajan
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Richard J. Radke
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Zhaolin Cheng.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 2.0 International License (https://doi.org/creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Reprints and permissions

About this article

Cite this article

Cheng, Z., Devarajan, D. & Radke, R.J. Determining Vision Graphs for Distributed Camera Networks Using Feature Digests. EURASIP J. Adv. Signal Process. 2007, 057034 (2006). https://doi.org/10.1155/2007/57034

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1155/2007/57034

Keywords