Skip to main content

Advertisement

Reliability-Based Decision Fusion in Multimodal Biometric Verification Systems

Abstract

We present a methodology of reliability estimation in the multimodal biometric verification scenario. Reliability estimation has shown to be an efficient and accurate way of predicting and correcting erroneous classification decisions in both unimodal (speech, face, online signature) and multimodal (speech and face) systems. While the initial research results indicate the high potential of the proposed methodology, the performance of the reliability estimation in a multimodal setting has not been sufficiently studied or evaluated. In this paper, we demonstrate the advantages of using the unimodal reliability information in order to perform an efficient biometric fusion of two modalities. We further show the presented method to be superior to state-of-the-art multimodal decision-level fusion schemes. The experimental evaluation presented in this paper is based on the popular benchmarking bimodal BANCA database.

References

  1. 1.

    Short J, Kittler J, Messer K: A comparison of photometric normalisation algorithms for face verification. Proceedings of the 6th IEEE International Conference on Automatic Face and Gesture Recognition (FGR '04), May 2004, Seoul, South Korea 254–259.

  2. 2.

    Barras C, Gauvain J-L: Feature and score normalization for speaker verification of cellular data. Proceedings of IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP '03), April 2003, Hong Kong 2: 49–52.

  3. 3.

    Ross A, Jain AK, Qian J-Z: Information fusion in biometrics. Proceedings of the 3rd International Conference on Audio- and Video-Based Biometric Person Authentication (AVBPA '01), June 2001, Halmstad, Sweden 354–359.

  4. 4.

    Roli F, Kittler J, Fumera G, Muntoni D: An experimental comparison of classifier fusion rules for multimodal personal identity verification systems. Proceedings of the 3rd International Workshop Multiple Classifier Systems (MCS '02), June 2002, Cagliari, Italy 325–336.

  5. 5.

    Bigun J, Fierrez-Aguilar J, Ortega-Garcia J, Gonzalez-Rodriguez J: Multimodal biometric authentication using quality signals in mobile communications. Proceedings of the 12th International Conference on Image Analysis and Processing (ICIAP '03), September 2003, Mantova, Italy 2–11.

  6. 6.

    Richiardi J, Prodanov P, Drygajlo A: A probabilistic measure of modality reliability in speaker verification. Proceedings of IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP '05), March 2005, Philadelphia, Pa, USA 1: 709–712.

  7. 7.

    Kryszczuk K, Richiardi J, Prodanov P, Drygajlo A: Error handling in multimodal biometric systems using reliability measures. Proceedings of the 13th European Signal Processing Conference (EUSIPCO '05), September 2005, Antalya, Turkey

  8. 8.

    Poh N, Bengio S: Improving fusion with margin-derived confidence in biometric authentication tasks. Proceedings of the 5th International Conference on Audio- and Video-Based Biometric Person Authentication (AVBPA '05), July 2005, Hilton Rye Town, NY, USA 474–483.

  9. 9.

    Brümmer N, du Preez J: Application-independent evaluation of speaker detection. Computer Speech & Language 2006,20(2-3):230-275. 10.1016/j.csl.2005.08.001

  10. 10.

    Fredouille C, Bonastre J-F, Merlin T: Similarity normalization method based on world model and a posteriori probability for speaker verification. Proceedings of the 6th European Conference on Speech Communication and Technology (EUROSPEECH '99), September 1999, Budapest, Hungary 983–986.

  11. 11.

    Murphy K: Dynamic Bayesian networks: representation, inference and learning, Ph.D. thesis. Computer Science Division, University of California - Berkeley, Berkeley, Calif, USA; 2002.

  12. 12.

    Richiardi J, Prodanov P, Drygajlo A: Speaker verification with confidence and reliability measures. Proceedings of IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP '06), May 2006, Toulouse, France 1: 641–644.

  13. 13.

    Bailly-Bailliére E, Bengio S, Bimbot F, et al.: The BANCA database and evaluation protocol. In Proceedings of the 4th International Conference on Audio- and Video-Based Biometric Person Authentication (AVBPA '03), June 2003, Guildford, UK, Lecture Notes in Computer Science Edited by: Kittler J, Nixon M. 2688: 625–638.

  14. 14.

    Bonastre J-F, Wils F, Meignier S: ALIZE, a free toolkit for speaker recognition. Proceedings of IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP '05), March 2005, Philadelphia, Pa, USA 1: 737–740.

  15. 15.

    Reynolds D: A Gaussian mixture modeling approach to text-independent speaker identification, Ph.D. thesis. Georgia Institute of Technology, Atlanta, Ga, USA; 1992.

  16. 16.

    Kryszczuk K, Drygajlo A: On face image quality measures. Proceedings of the 2nd Workshop on Multimodal User Authentication, May 2006, Toulouse, France

  17. 17.

    Messer K, Kittler J, Sadeghi M, et al.: Face authentication competition on the BANCA database. Proceedings of the 1st International Conference on Biometric Authentication (ICBA '04), July 2004, Hong Kong 8–15.

  18. 18.

    Sanderson C, Bengio S: Robust features for frontal face authentication in difficult image conditions. Proceedings of the 4th International Conference on Audio- and Video-Based Biometric Person Authentication (AVBPA '03), June 2003, Guildford, UK 495–504.

Download references

Author information

Correspondence to Krzysztof Kryszczuk.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 2.0 International License (https://doi.org/creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Reprints and Permissions

About this article

Keywords

  • Information Technology
  • Experimental Evaluation
  • Quantum Information
  • Reliability Estimation
  • Reliability Information