Skip to main content

A Method for Assessment of Segmentation Success Considering Uncertainty in the Edge Positions


A method for segmentation assessment is proposed. The technique is based on a comparison of the segmentation produced by an algorithm with an ideal segmentation. The procedure to obtain the ideal segmentation is described in detail. Uncertainty regarding the edge positions is accounted for in the discrepancy calculation of each edge using fuzzy reasoning. The uncertainty measurement consists of a generalization, using fuzzy membership functions, of the similarity metrics used by well-known assessment methods. Several alternatives for the fuzzy membership functions, based on statistical properties of the possible positions of each edge, are defined. The proposed uncertainty measurement can be easily applied to other well-known methods. Finally, the segmentation assessment method is used to determine the best segmentation algorithm for thermographic images, and also to tune the optimum parameters of each algorithm.


  1. 1.

    Haralick RM, Shapiro LG: Image segmentation techniques. Computer Vision, Graphics, and Image Processing 1985, 29(1):100–132. 10.1016/S0734-189X(85)90153-7

    Article  Google Scholar 

  2. 2.

    Zhang YJ: A survey on evaluation methods for image segmentation. Pattern Recognition 1996, 29(8):1335–1346. 10.1016/0031-3203(95)00169-7

    Article  Google Scholar 

  3. 3.

    Yang L, Albregtsen F, Lønnestad T, Grøttum P: A supervised approach to the evaluation of image segmentation methods. Proc. 6th International Conference on Computer Analysis of Images and Patterns (CAIP '95), September 1995, Prague, Czech Republic 759–765.

    Chapter  Google Scholar 

  4. 4.

    Levine MD, Nazif AM: Dynamic measurement of computer generated image segmentations. IEEE Trans. Pattern Anal. Machine Intell. 1985, 7(2):155–164.

    Article  Google Scholar 

  5. 5.

    Zhang YJ, Gerbrands JJ: Segmentation evaluation using ultimate measurement accuracy. Image Processing Algorithms and Techniques III, May 1992, San Jose, Calif, USA, Proceedings of SPIE 1657: 449–460.

    Article  Google Scholar 

  6. 6.

    Román-Roldán R, Gómez Lopera JF, Atae-Allah C, Martínez-Aroza J, Luque-Escamilla PL: A measure of quality for evaluating methods of segmentation and edge detection. Pattern Recognition 2001, 34(5):969–980. 10.1016/S0031-3203(00)00052-2

    Article  Google Scholar 

  7. 7.

    Yitzhaky Y, Peli E: A method for objective edge detection evaluation and detector parameter selection. IEEE Trans. Pattern Anal. Machine Intell. 2003, 25(8):1027–1033. 10.1109/TPAMI.2003.1217608

    Article  Google Scholar 

  8. 8.

    Lee SU, Chung SY, Park RH: A comparative performance study of several global thresholding techniques for segmentation. Computer Vision, Graphics, and Image Processing 1990, 52(2):171–190. 10.1016/0734-189X(90)90053-X

    Article  Google Scholar 

  9. 9.

    Yasnoff WA, Mui WA, Bacus JW: Error measures in scene segmentation. Pattern Recognition 1977, 9(4):217–231. 10.1016/0031-3203(77)90006-1

    Article  Google Scholar 

  10. 10.

    Pratt WK: Digital Image Processing. Wiley-Interscience, New York, NY, USA; 1977.

    MATH  Google Scholar 

  11. 11.

    van der Heyden F: Evaluation of edge detection algorithms. Proc. 3rd International Conference on Image Processing and its Applications, July 1989, Warwick, UK 618–622.

    Google Scholar 

  12. 12.

    Strasters KC, Gerbrands JJ: Three-dimensional image segmentation using a split, merge and group approach. Pattern Recognition Letters 1991, 12(5):307–325. 10.1016/0167-8655(91)90414-H

    Article  Google Scholar 

  13. 13.

    Yager RR: On a general class of fuzzy connectives. Fuzzy Sets and Systems 1980, 4(3):235–242. 10.1016/0165-0114(80)90013-5

    MathSciNet  Article  Google Scholar 

  14. 14.

    Dubois D, Prade H: Fuzzy Sets and Systems: Theory and Applications. Academic Press, New York, NY, USA; 1980.

    MATH  Google Scholar 

  15. 15.

    Zadeh LA: Fuzzy sets and systems. Information and Control 1965, 8(3):338–353. 10.1016/S0019-9958(65)90241-X

    MathSciNet  Article  Google Scholar 

  16. 16.

    Usamentiaga R, García DF, López C, González JA: Algorithms for real-time acquisition and segmentation of a stream of thermographic line scans in industrial environments. Journal of Imaging Science and Technology 2005, 49(2):138–153.

    Google Scholar 

Download references

Author information



Corresponding author

Correspondence to Rubén Usamentiaga.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 2.0 International License ( ), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Reprints and Permissions

About this article

Cite this article

Usamentiaga, R., García, D.F., López, C. et al. A Method for Assessment of Segmentation Success Considering Uncertainty in the Edge Positions. EURASIP J. Adv. Signal Process. 2006, 021746 (2006).

Download citation


  • Information Technology
  • Optimum Parameter
  • Quantum Information
  • Assessment Method
  • Uncertainty Measurement