Skip to main content
EURASIP Journal on Advances in Signal Processing
Download PDF
  • Research Article
  • Open access
  • Published:

Incremental Support Vector Machine Framework for Visual Sensor Networks

EURASIP Journal on Advances in Signal Processing volume 2007, Article number: 064270 (2006) Cite this article

Abstract

Motivated by the emerging requirements of surveillance networks, we present in this paper an incremental multiclassification support vector machine (SVM) technique as a new framework for action classification based on real-time multivideo collected by homogeneous sites. The technique is based on an adaptation of least square SVM (LS-SVM) formulation but extends beyond the static image-based learning of current SVM methodologies. In applying the technique, an initial supervised offline learning phase is followed by a visual behavior data acquisition and an online learning phase during which the cluster head performs an ensemble of model aggregations based on the sensor nodes inputs. The cluster head then selectively switches on designated sensor nodes for future incremental learning. Combining sensor data offers an improvement over single camera sensing especially when the latter has an occluded view of the target object. The optimization involved alleviates the burdens of power consumption and communication bandwidth requirements. The resulting misclassification error rate, the iterative error reduction rate of the proposed incremental learning, and the decision fusion technique prove its validity when applied to visual sensor networks. Furthermore, the enabled online learning allows an adaptive domain knowledge insertion and offers the advantage of reducing both the model training time and the information storage requirements of the overall system which makes it even more attractive for distributed sensor networks communication.

References

  1. Zhao F: Challenges in designing information sensor processing networks. Talk at NSF Workshop on Networking of Sensor Systems, February 2004, Marina Del Ray, Calif, USA

    Google Scholar 

  2. Chong C-Y, Kumar SP: Sensor networks: evolution, opportunities, and challenges. Proceedings of the IEEE 2003,91(8):1247–1256. 10.1109/JPROC.2003.814918

    Article  Google Scholar 

  3. Akyildiz IF, Su W, Sankarasubramaniam Y, Cayirci E: A survey on sensor networks. IEEE Communications Magazine 2002,40(8):102–105. 10.1109/MCOM.2002.1024422

    Article  Google Scholar 

  4. Duda R, Hart P, Stock D: Pattern Classification. 2nd edition. John Willy & Sons, New York, NY, USA; 2001.

    Google Scholar 

  5. Hampapur A, Brown L, Connell J, Pankanti S, Senior A, Tian Y: Smart surveillance: applications, technologies and implications. Proceedings of the 4th International Conference on the Communications and Signal Processing, and the 4th Pacific Rim Conference on Multimedia, December 2003, Singapore, Republic of Singapore 2: 1133–1138.

    Google Scholar 

  6. Haritaoglu I, Flickner M: Detection and tracking of shopping groups in stores. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR '01), December 2001, Kauai, Hawaii, USA 1: 431–438.

    Google Scholar 

  7. Zurn JB, Hohmann D, Dworkin SI, Motai Y: A real-time rodent tracking system for both light and dark cycle behavior analysis. Proceedings of the IEEE Workshop on Applications of Computer Vision, January 2005, Breckenridge, Colo, USA 87–92.

    Google Scholar 

  8. Cristianini N, Shawe-Taylor J: An Introduction to Support Vector Machines and Other kernel-Based Learning Methods. Cambridge University Press, Cambridge, Mass, USA; 2000.

    Book  Google Scholar 

  9. Vapnik V, Mukherjee S: Support vector method for multivariant density estimation. Advances in Neural Information Processing Systems (NIPS '99), November–December 1999, Denver, Colo, USA 659–665.

    Google Scholar 

  10. Herbrich R, Graepel T, Campbell C: Bayes point machines: estimating the Bayes point in kernel space. Proceedings of International Joint Conference on Artificial Intelligence Workshop on Support Vector Machines (IJCAI '99), July–August 1999, Stockholm, Sweden 23–27.

    Google Scholar 

  11. Platt J: Fast training of support vector machines using sequential minimal optimization. In Advances in Kernel Methods-Support Vector Learning. MIT Press, Cambridge, Mass, USA; 1999:185–208.

    Google Scholar 

  12. Suykens JAK, Vandewalle J: Least squares support vector machine classifiers. Neural Processing Letters 1999,9(3):293–300. 10.1023/A:1018628609742

    Article  Google Scholar 

  13. Schölkopf B, Smola AJ: Learning with Kernels. MIT Press, Cambridge, Mass, USA; 2002.

    MATH  Google Scholar 

  14. Ralaivola L, d'Alch'e-Buc F: Incremental support vector machine learning: a local approach. Proceedings of the International Conference on Artificial Neural Networks (ICANN '01), August 2001, Vienna, Austria 322–330.

    Google Scholar 

  15. Cauwenberghs G, Poggio T: Incremental and decremental support vector machine learning. Advances in Neural Information Processing Systems (NIPS '00), December 2000, Denver, Colo, USA 409–415.

    Google Scholar 

  16. Forsyth DA, Ponce J: Computer Vision: A Modern Approach. Prentice Hall, Upper Saddle River, NJ, USA; 2003.

    Google Scholar 

  17. Hsu C-W, Lin C: A comparison of methods for multiclass support vector machines. IEEE Transactions on Neural Networks 2002,13(2):415–425. 10.1109/72.991427

    Article  Google Scholar 

  18. Matrix algebra; https://doi.org/www.ec-securehost.com/SIAM/ot71.html

  19. Heinzelman WR, Chandrakasan A, Balakrishnan H: Energy-efficient communication protocol for wireless microsensor networks. Proceedings of the 33rd Annual Hawaii International Conference on System Sciences (HICSS '33), January 2000, Maui, Hawaii, USA 2: 10.

    Article  Google Scholar 

  20. Antony R: Principles of Data Fusion Automation. Artech House, Boston, Mass, USA; 1995.

    Google Scholar 

  21. https://doi.org/www.ptgrey.com

  22. Newsan S, Testic J, Wang L, Manjunah BS: Issues in managing image and video data. Storage and Retrieval Methods and Applications for Multimedia, January 2004, San Jose, Calif, USA, Proceedings of SPIE 5307: 280–291.

    Google Scholar 

  23. Zelikovitz S: Mining for features to improve classification. Proceedings of the International Conference on Machine Learning; Models, Technologies and Applications (MLMTA '03), June 2003, Las Vegas, Nevada, USA 108–114.

    Google Scholar 

  24. Trivedi MM, Mikic I, Kogut G: Distributed video networks for incident detection and management. Proceedings of IEEE Conference on Intelligent Transportation Systems (ITSC '00), October 2000, Dearborn, Mich, USA 155–160.

    Google Scholar 

  25. Matsuyama T, Hiura S, Wada T, Murase K, Yoshioka A: Dynamic memory: architecture for real time integration of visual perception, camera action, and network communication. Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR '00), June 2000, Hilton Head Island, SC, USA 2: 728–735.

    Google Scholar 

  26. Haritaoglu I, Harwood D, Davis LS:: a real time system for detecting and tracking people. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, June 1998, Santa Barbara, Calif, USA 962–962.

    Google Scholar 

  27. Nakazawa A, Kato H, Inokuchi S: Human tracking using distributed vision systems. Proceedings of 14th International Conference on Pattern Recognition, August 1998, Brisbane, Australia 1: 593–596.

    Google Scholar 

  28. Sogo T, Ishiguro H, Trivedi MM: N-ocular stereo for real-time human tracking. In Panoramic Vision: Sensors, Theory and Applications. Springer, New York, NY, USA; 2000.

    Google Scholar 

  29. Al-Ani A, Deriche M: A new technique for combining multiple classifiers using the Dempster-Shafer theory of evidence. Journal of Artificial Intelligence Research 2002, 17: 333–361.

    Article  MathSciNet  Google Scholar 

  30. Jiang X, Motai Y: Incremental on-line PCA for automatic motion learning of eigen behavior. special issue of automatic learning and real-time, to appear in International Journal of Intelligent Systems Technologies and Applications

  31. Belongie S, Malik J, Puzicha J: Shape matching and object recognition using shape contexts. IEEE Transactions on Pattern Analysis and Machine Intelligence 2002,24(4):509–522. 10.1109/34.993558

    Article  Google Scholar 

  32. Watanachaturaporn P, Arora MK: SVM for classification of multi—and hyperspectral data. In Advanced Image Processing Techniques for Remotely Sensed Hyperspectral Data. Edited by: Varshney PK, Arora MK. Springer, New York, NY, USA; 2004.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. IBM Systems and Technology Group, Department 7t Foundry, Essex Junction, VT, 05452, USA

    Mariette Awad

  2. Department of Electrical and Computer Engineering, The University of Vermont, Burlington, VT, 05405, USA

    Mariette Awad, Xianhua Jiang & Yuichi Motai

Authors
  1. Mariette Awad
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Xianhua Jiang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Yuichi Motai
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Mariette Awad.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 2.0 International License (https://doi.org/creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Reprints and permissions

About this article

Cite this article

Awad, M., Jiang, X. & Motai, Y. Incremental Support Vector Machine Framework for Visual Sensor Networks. EURASIP J. Adv. Signal Process. 2007, 064270 (2006). https://doi.org/10.1155/2007/64270

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1155/2007/64270

Keywords