FIR signature verification system characterizing dynamics of handwriting features
© Thumwarin et al.; licensee Springer. 2013
Received: 31 May 2012
Accepted: 25 November 2013
Published: 11 December 2013
This paper proposes an online signature verification method based on the finite impulse response (FIR) system characterizing time-frequency characteristics of dynamic handwriting features. First, the barycenter determined from both the center point of signature and two adjacent pen-point positions in the signing process, instead of one pen-point position, is used to reduce the fluctuation of handwriting motion. In this paper, among the available dynamic handwriting features, motion pressure and area pressure are employed to investigate handwriting behavior. Thus, the stable dynamic handwriting features can be described by the relation of the time-frequency characteristics of the dynamic handwriting features. In this study, the aforesaid relation can be represented by the FIR system with the wavelet coefficients of the dynamic handwriting features as both input and output of the system. The impulse response of the FIR system is used as the individual feature for a particular signature. In short, the signature can be verified by evaluating the difference between the impulse responses of the FIR systems for a reference signature and the signature to be verified. The signature verification experiments in this paper were conducted using the SUBCORPUS MCYT-100 signature database consisting of 5,000 signatures from 100 signers. The proposed method yielded equal error rate (EER) of 3.21% on skilled forgeries.
Now the need for biometric authentication systems is on the rise because of the ease of use without a password or keycard required. Signature verification is one of the biometrics based on handwriting behavior. In several parts of the world, a signature is the customary way to verify an individual in daily activities, such as withdrawing cash from a bank account and entering a contract. Although visual examination is a popular method for signature verification, it usually takes a long time to process and there are occasions in which examiners make mistakes. To effectively verify the signature, an automatic system for signature verification is required. Signature verification methods are largely classified into two classes: One is the offline method based only on static visual information, and the other is the online method based on the dynamics of handwriting process with a major advantage over the first method in that it is very difficult to forge or copy the dynamics which are invisible. It is well known that handwriting is a highly individual entry depending on such many factors as country, age, habits, psychological or mental state, physical, and practical conditions. For instance, size of scripts, location of scripts, shape of scripts, and duration time in handwriting process of scripts written by the same writer are never precisely the same due to the fluctuation of handwriting. Although the handwriting has many fluctuations described above, it is necessary to extract the feature of handwriting which is more consistent and not likely to be changed, for online signature verification. Such a feature is considered as a stable feature of handwriting. Hence, the preprocessing and feature extraction are very important for online signature verification. Furthermore, in the signature verification, the registration requirement of a large number of signatures of one same individual is impractical. Therefore, to extract the stable handwriting feature from the limited number of signatures is one of the important problems of online signature verification. The issues, i.e., unstable handwriting features and large number of signatures required in the registration process, make the development of online signature verification complicated. Moreover, it is desirable that the feature of handwriting should carry only the essential information of a particular signature and the size of the handwriting feature should be as minimal as possible.
In this paper, signatures are written on a graphical tablet. The horizontal component, vertical component, and pen pressure of pen-point position at a time, t = n τ(≡ t n ), in the signing process are represented as x(t n ), y(t n ), and p(t n ) respectively, where τ is a constant sampling rate. In order to reduce the fluctuation of handwriting, three types of normalization with respect to size, location, and duration time in the signing process are performed with the details described in the following subsections.
2.1 Normalization of size
and N is the total number of sampled points of pen-point positions.
2.2 Normalization of location
2.3 Trajectory of barycenter
3 Feature extraction
3.1 Dynamic handwriting features
It is assumed here that the individual signing feature can be described by the following eight features:
Horizontal direction r x (t n ) of the barycenter trajectory in signing process.
Vertical direction r y (t n ) of the barycenter trajectory in signing process.
Areal velocity a v (t n ), which is the area swept out per unit time by the pen-point moving along the barycenter trajectory of handwriting script. The a v (t n ) is computed from(5)
Displacement s(t n ), which is the distance from the center of signature to barycenter trajectory at time t n . The s(t n ) can be calculated as(6)
Magnitude of velocity v(t n ) of the barycenter trajectory. The v(t n ) is computed from(7)where
The direction change θ(t n ) of the barycenter trajectory. The θ(t n ) can be calculated by(8)
It is known that the pen pressure is one of the important features for signature verification. In this paper, two features related to the pen pressure are introduced as follows:
Area pressure a p (t n ) as shown in Figure5b, which is the area of triangle consisting of pen pressure, pen-point position, and center of signature in the signing process. The a p (t n ) is computed from(9)
Motion pressure m p (t n ) as shown in Figure5b, which is distance of the diagonal between two adjacent pen-point positions and the pen pressure. The m p (t n ) is computed from(10)where
3.2 Time-frequency characteristic of the dynamic handwriting features
3.3 FIR system characterizing the dynamics of handwriting features
The FIR system is designed as follows:
4 Signature verification
In this section, the impulse responses obtained in the preceding section are used to verify signature. The algorithm is given as follows.
4.1 Training process
The following are the steps in the training process:
First, the member register their name and sign their signatures five times used for reference data and training process.
Second, the obtained signatures are preprocessed using method in Section 2.
Third, the eight dynamic handwriting features as described in Section 3.1 are calculated.
Fourth, after normalization of duration time, they are expanded into wavelet series to determine the time-frequency characteristics of their features. In this step, the suitable level of the time-frequency characteristics which represent the stability of their handwriting feature is determined by using the standard deviation of each level. We select the level of their standard deviations less than the predetermined threshold values as the stable handwriting feature. Therefore, these parameters are the individual features for a particular person.
Fifth, the obtained time-frequency characteristics of the eight features are used to determine the handwriting system using the FIR systems as described in Section 3.3. In this case, the order of the FIR systems (M) for each particular person can be determined by using standard deviation of the impulse responses. We choose the maximum value of the parameter M that its standard deviation is less than the predetermined threshold value. Then, the obtained impulse responses are combined as(29)
The obtained feature vector (), level of the time-frequency characteristics, and order of the FIR system are used as the individual feature for signature verification for a particular person.
4.2 Testing process
In the testing process, the following steps must be undertaken:
First, test persons put their registered name and sign their signatures.
Second, the test signature is preprocessed using the method in Section 2.
Third, after normalization of duration time and using the registered name corresponding to the test name, the number level of the registered person is used to determine the time-frequency characteristics of their features.
Fourth, the obtained time-frequency characteristics of the eight features are used to determine the handwriting system using the FIR systems as described in Section 3.3. In this case, the order of the FIR systems (M) of the registered name corresponding to the test name is used to calculate the impulse responses. Then the obtained impulse responses are combined as(31)
where ∥·∥ is Euclidean norm, and η is a predetermined threshold value determined by using the experiments with the training data for a particular signature.
5 Experimental result
In this paper, we proposed an online signature verification method based on the FIR system characterizing the time-frequency characteristics of dynamic handwriting features. The stable time-frequency characteristics of the dynamic feature were determined by selecting the suitable level of wavelet coefficients. The FIR system was realized by considering the selected wavelet coefficients of the dynamic features as the input and output of the system, respectively. The obtained impulse response was used as the individual feature for signature verification. It was found from our experiments that the proposed method is useful for online signature verification. In this research, a graphical tablet was used as the data acquisition system. Thus, the pen-point position was used to describe the handwriting feature in signing process. However, the graphical tablet can acquire such features as pen pressure and pen inclination. As such, the incorporation of such features into signature verification remains our future work.
This research was in part supported by the Thailand Research Fund (TRF) and the Commission on Higher Education (CHE) for research no. MRG5080378. The authors would like to express profound appreciation to J. Ortega-Garcia et al. for sharing the MCYT-100 public database and to W. Surakampontorn and P. Sooraksa for their kind and useful suggestions.
- Plamondon R, Lorette G: Automatic signature verification and writer identification-the state of the art. Pattern Recognit 1989, 22(2):107-131.View ArticleGoogle Scholar
- Leclerc F, Plamondon R: Automatic signature verification: the state of the art-1989-1993. Int. J. Pattern Recognit. Artif. Intell 1994, 8(3):643-659.View ArticleGoogle Scholar
- Impedovo D, Pirlo G: Automatic signature verification: the state of art. IEEE Trans. Syst. Man Cybernatics-Part C: Appl. Rev 2008, 38(5):609-635.View ArticleGoogle Scholar
- Faundez-Zanuy M: Signature recognition state-of-the art. IEEE A & E system magazine 2005, 20(7):28-32.View ArticleGoogle Scholar
- Plamondon R, Srihari SN: On-line and off-line handwriting recognition: a comprehensive survey. IEEE Trans. Pattern Anal. Mach. Intell 2000, 22(1):63-84.View ArticleGoogle Scholar
- Yoshimura M, Kato Y, Matsuda S, Yoshimura I: On-line signature verification incorporating the direction of pen movement. IEICE Trans 1991, E74(7):2083-2092.Google Scholar
- Zhao P, Higashi A, Sato Y: On-line signature verification by adaptively weighted DP matching. IEICE Trans 1996, E79-D(5):535-541.Google Scholar
- Jain AK, Griess FD, Connell SD: On-line signature verification. Pattern Recognit 2002, 35: 2963-2972.View ArticleMATHGoogle Scholar
- Feng H, Choong Wah C: Online signature verification using a new extreme points warping technique. Pattern Recognit. Lett 2003, 24: 2943-2951.View ArticleGoogle Scholar
- Huang K, Yan H: Stability and style-variation modeling for on-line signature verification. Pattern Recognit 2003, 36: 2253-2270.View ArticleMATHGoogle Scholar
- Faundez-Zanuy M: On-line signature recognition based on VQ-DTW. Patt. Recognit 2007, 40: 981-992.View ArticleMATHGoogle Scholar
- Ly Van B, Garcia-Salicetti S, Dorizzi B: On using the Viterbi path along with HMM likelihood information for online signature verification. IEEE Trans. Syst. Man Cybernetics-part B 2007, 37(5):1237-1247.View ArticleGoogle Scholar
- Fierrez J, Ortega-Garcia J, Ramos D, Gonzalez-Rrodriguez J: HMM-based on-line signature verification: feature extraction and signature modeling. Patt. Recognit. Lett 2007, 28: 2325-2334.View ArticleGoogle Scholar
- Thumwarin P, Matsuura T: On-line writer recognition for Thai numeral. IEICE Trans 2003, E86-A(10):2535-2541.Google Scholar
- Thumwarin P: On-line writer recognition for Thai based on impulse response of FIR system characterizing handwriting motion,. Thesis, Tokai University, 2004Google Scholar
- Thumwarin P, Matsuura T: On-line writer recognition for Thai based on velocity of bary center of pen-point movement. In IEEE International Conference on Image Processing. Singapore; 24–27 October 2004:889-892.Google Scholar
- Fuentes M, Garcia-Salicetti S, Dorizzi B: On-line signature verification: fusion of hidden of Markov model and neural network via a support vector machine. In Proceedings of Eighth International Workshop on Frontiers in Handwriting Recognition. Canada; 6–8 August 2002:253-258.View ArticleGoogle Scholar
- Gruber C, Gruber T, Krinnger S, Sick B: Online signature verification with support vector machines based on LCSS kernel functions. IEEE Trans. Syst. Man Cybernetics-part B 2009, 40: 1-4.Google Scholar
- Thumwarin P, Pernwong J, Wakayaphattaramanus N, Matsuura T: On-line signature verification base on FIR System characterizing velocity and direction change of barycenter trajectory. In IEEE International Conference on Progress in Informatics and Computing. Shanghai; 10–12 December 2010:31-35.Google Scholar
- Thumwarin P, Pernwong J, Matsuura T: On-line signature verification base on FIR system characterizing motion pressure. In ACM SIGGRAPH Conference on Virtual-Reality Continuum and its Applications to Industry. Hong Kong; 11–12 December 2011:565-568.Google Scholar
- Yanikoglu B, Kholmatov A: Online signature verification using fourier descriptors. EURASIP J. Adv. Signal Process doi:10.1155/2009/260516 (2009)Google Scholar
- Lejtman DZ, George E: On-line handwritten signature verification using wavelets and back-propagation neural networks. In IEEE 6th International Conference on Document Analysis and Recognition (ICDAR 2001). Seattle; 10–13 September 2001:992-996.Google Scholar
- Jayadeven R, Subbaraman S, Patil PM: Verification of hand printed signature images using discrete dyadic wavelet transform. In IEEE Second International Conference on Industrial and Information Systems (ICIIS 2007). Penadeniya; 9–11 August 2007:314-345.Google Scholar
- Wang K, Wang Y, Zhang Z: On-line signature verification using wavelet packet. In IEEE International Joint Conference on Biometrics (IJCB). Washington, DC; 11–13 October 2011:1-6.Google Scholar
- Thumwarin P, Khem S, Janchitraponvej K, Matsuura T: On-line writer dependent character recognition for Khmer based on FIR system characterizing handwriting motion. In 5th International Conference on Electrical Engineering/Electronics, Computer, Telecommunications and Information Technology (ECTI-CON 2008), vol. 1. Krabi; 14–17 May 2008:541-544.View ArticleGoogle Scholar
- Ortega-Garcia J, Fierrez-Augilar J, Simon D, Gonzalez J, Faundez-Zanuy M, Espinosa V, Satue A, Hernaez I, Igarza J-J, Vivaracho C, Escudero D, Moro Q-I: MCYT baseline corpus: a bimodal biometric database. IEEE Proc. Vis. Image Signal Process 2003, 150(6):395-401.View ArticleGoogle Scholar
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.