On the Evaluation of Texture and Color Features for Nondestructive Corrosion Detection
© Fátima N. S. Medeiros et al. 2010
Received: 2 January 2010
Accepted: 15 June 2010
Published: 7 July 2010
We present a methodology for automatic corrosion detection in digital images of carbon steel storage tanks and pipelines from a petroleum refinery. The database consists of optical digital images taken from equipments exposed to marine atmosphere during their operational life. This new approach focuses on color and texture descriptors to accomplish corroded and noncorroded surface area discrimination. The performance of the proposed corrosion descriptors is evaluated by using Fisher linear discriminant analysis (FLDA). This approach presents two main advantages: No refinery stoppages are required and potential-related catastrophes can be prevented.
Corrosion is the destructive attack of a metal by chemical or electrochemical reaction with its environment . The exposure of metallic surfaces structures to rust degradation during their operational life is a known problem and it affects storage tanks, steel bridges, pipelines, and ships .
Storage tanks and pipelines are commonly made of carbon steel and low alloy steel not resistant to corrosion in natural environments. Corrosion resistant paints and coatings are used in almost all applications. Despite of this protection, some steels will rust quite rapidly in humid air even though condensation is not evident .
Atmospheric corrosion causes economic losses usually due to production interruptions, replacement of expensive materials, and contamination of products. A good deal of attention should be paid to safety risks and the environment pollution due to corrosion . Therefore, corrosion monitoring is a relevant task to detect corroded regions before failures occur by using inspection methods, so that appropriate decision-making can be taken to avoid any untoward incidents.
There are different corrosion analysis methods as mechanical measurements, chemical analysis, and visual inspection by experts. Inspection usually refers to evaluation of attributes in relation to a specification. For economical and security reasons, the petroleum and gas industry requires nonintrusive or nondestructive measurement techniques to avoid disturbing their properties and performance .
Visual inspection of metallic surface is a common practice employed to identify and detect sources of failures. A tough problem associated with this task is its tedious and subjective nature. Significant refinement can be achieved if specialists have access to automatic computerized inspection methods.
In many materials, the corrosion process produces a typical rough surface. Therefore, texture analysis is highly recommended to discriminate specific surface roughness. Texture is defined as repetition of a pattern over a region as a set of small variations, generally described by a spatial function . Another issue is the random aspect of texture, because size, shape, and orientation of pattern elements can vary over a region.
The potentiality of image processing techniques for automatic rust steel detection is investigated in . The methodology introduced an iterative multivariate data analysis to examine the effects of rust steel descriptors, that is, texture and color distribution on a set of classifier algorithms. In this analysis, a selector of classifiers indicates the algorithm that provides good classification results (high sensitivity) and acceptable time response for the automation of the system .
In 1981, Itzhak et al.  employed computer image processing techniques for statistical evaluation of pitting corrosion in a plate of AISI 304L stainless steel exposed to a corrosive water solution containing 10% . The purpose of this work was to introduce and to evaluate new tools for analyzing the effects of pitting corrosion process . The algorithm was capable of estimating the number and area of pits in the binary image and therefore provided better evaluation of pitting corrosion damages.
A popular image processing algorithm for texture analysis extracts features from the gray level co-occurrence matrix (GLCM) . In this paper, we explore the power of these features to deal with the stochastic pattern of corrosion for damage detection in metallic surfaces. Parameters extracted from the GLCM can be used to define similarity properties for corrosion detection purpose in image segmentation methods based on region approach. This approach consists in determining the regions that contain neighbor pixels in the image that have similar properties, that is, gray level and spatial relationship . Two GLCM parameters, namely contrast and energy, are considered to be the most efficient for discriminating different textural patterns .
A wide variety of literature works [6, 8, 10, 11] have reported that texture features are proper to characterize corroded surfaces. In addition, typical color changes of metallic surfaces are often related to corrosion. Thus, color attributes carry out relevant information to design corrosion detection systems. Moreover, some works have reported that feature combination carries more discriminant power to applications designed on small database image samples . Methods based on neural networks and feature selection are able to handle with high data dimensionality maintaining good generalization level [13, 14].
This paper proposes a robust feature set for reliable detection of atmospheric corrosion on metallic surfaces using optical images acquired by charge-coupled device (CCD) cameras. A total of 13 attributes per image sample were computed using color and texture models: HSI (hue, saturation, and intensity) color histogram statistics and GLCM probabilities. The GLCM probabilities measure the roughness, and HSI statistics characterize the color of metallic surface samples. A sequential bottom-up feature selection procedure  was applied as a result of the small sample size and the high data dimensionality. We use Fisher linear discriminant analysis (FLDA) and receiver operating characteristic (ROC) curve to investigate the performance of the proposed approach when combining texture and color feature subsets.
The outline of the paper is as follows. In the next section, we describe the image database and give a brief overview of texture and color attributes used for corrosion characterization. Section 3 introduces the proposed methodology and aspects of feature sets evaluation. The experimental results and performance analysis are covered in Section 4. In Section 5, we draw the concluding remarks.
2. Materials and Methods
2.1. Image Database
2.2. Texture Attributes
Texture is formally defined as the set of local neighborhood properties of the gray levels of an image region . It reaches intuitive attributes as roughness, granulation, and regularity. There are four different methods for texture analysis in the literature: statistical, structural, model-based and transform-based methods.
The gray level intensity distribution of an image is based on the assumption that texture information is contained in the spatial relationship between the intensities of a pixel and its neighbor . This information is condensed in the GLCM. The gray level intensity distribution can be specified by a matrix of relative frequencies, in which two neighbor elements of texture labeled and , separated by a distance in an orientation , occur in the image, one with property and other with property .
The matrix represents GLCM and the sum index in (1) is denoted by GLCM size minus one less one. The parameters , , , and in (2) represent, respectively, the mean value and standard deviation of line and column from GLCM.
Contrast measures the dissimilarity intensity between a pixel and its neighbor over the whole image. Correlation represents how a pixel is related to its neighbor over the whole image. Energy is the sum of squared elements in GLCM, also known as uniformity of energy. Homogeneity stands for the similarity between gray level values of image pixels.
Homogeneity and contrast identify organized structures in the image. Energy and correlation characterize the complexity and nature of gray level transitions in the image. Even though these attributes contain information about image texture, it is difficult to identify which specific texture characteristic is represented by each attribute. Hence, texture attributes are stored in a feature database for further characterization by a classification process.
2.3. Color Attributes
Color is the visual perception of the spectral distribution of the light. Optical imaging uses three color channels, usually associated with red ( ), green ( ), and blue ( ), sufficient for the visual interpretation of spectra . In applications of image corrosion detection by using digital image processing and pattern recognition algorithms, it is relevant to identify the best color model to represent color attributes.
The HSI system constitutes a model that best describes how humans naturally respond to color. Thus, the HSI color space is appropriate for this purpose since it allows describing characteristics separately from brightness chrominance .
Saturation ( ) refers to the dominance of hue in the color and is given by (6). A corroded surface is normally more saturated than other areas because metallic surface is often painted in light colors as gray and white.
Color attributes are obtained by using statistical moments extracted from each HSI channel histogram. We adopted the histogram definition as a frequency for each pixel value, where and it refers to imaging quantization.
3. Methodology for Corrosion Characterization
3.1. Corrosion Descriptors
We propose a corrosion descriptor database organized into three-feature subsets: texture attributes, color attributes and a combination of texture and color attributes. GLCM has been computed by assigning the distance between pixels to 1 and orientation of neighbor pixels to . Attributes defined in (8)–(11) have been calculated for the histogram of the hue, saturation, and intensity components of the HSI color space.
3.2. Discriminant Analysis
where is the mean and the sample size of class , ; is the maximum likelihood estimates of the covariances matrices of classes ; represents the new space that maximizes the criterion. According to (13), the criterion proposed by Fisher is the ratio of between-class to within-class variances.
The regression obtained by FLDA is used to assess the discrimination performance for each feature subset. The corroded class and non corroded class separability is investigated for different subset sizes.
Confusion matrix and receiver operating characteristic (ROC) curve are used to evaluate the class separability, robustness, and reliability. This matrix consists of two rows and two columns that report the number of true negatives, false positives, false negatives, and true positives estimated by the model comparing with the previous probabilities of the validation data. True values refer to correct model estimation, while false values correspond to incorrect estimated results. Error rate is quantified by the sum of false values, while accuracy is the sum of true values.
The confusion matrix provides the general discriminant performance for each feature subset. In order to determine the more appropriated subset, we used a receiver operating characteristic (ROC) curve analysis  to estimate the expected performance of a discriminant function under varying criterion. Sensitivity, specificity, and area under curve (AUC) are properties used to assess the performance for different number of attributes. The area under ROC Curve (AUC) gauges the ranking of correct class separation. When dealing with a reduced database sample, the area under ROC convex hull (ROCCH) provides the finest grade of the separability for the corrosion classes .
4. Experimental Results
We performed both qualitative and quantitative discriminant analysis in order to evaluate the effectiveness of different feature subsets separability.
A set of 13 attributes per image sample were computed from color and texture models using HSI statistics and gray level co-occurrence matrices (GLCMs) probabilities.
The feature subsets discriminant performance was compared in terms of classification error and execution time on a 13-dimensional (two feature subsets), 2-class ( and ) image database. For sake of simplicity, the two class-conditional densities were admittedly Gaussian-like, with mean vectors and and a pooled covariance matrix defined in (12).
Confusion Matrix for corrosion characterization based on texture features.
Confusion Matrix for corrosion characterization based on color features.
Confusion Matrix for corrosion characterization based on texture and color features.
Combining feature sets leads to obtain more discriminant power without loss of generality. We achieved over hits and an appreciably reduction of false positives to less than . The combination of texture and color features reduced by the number of false negatives and false positives. The values are reported in Table 3.
In Figure 4, we compare the ROC convex hulls obtained for different numbers of attributes. We noticed that the discriminant function aggregates more separability power as the feature set grows.
In this paper, we have investigated image texture and color descriptors with the objective to address nondestructive atmospheric corrosion detection on petroleum plant equipments exposed to marine atmosphere. The idea of developing computer systems to assist specialists in corrosion inspection is to provide a tool to prevent risks for human life and environment in addition to minimizing economic losses.
Our approach integrates texture and color features to describe roughness and typical color changes in metallic surfaces. Thus, to address corrosion description, GLCM probabilities and HSI color space statistics are extracted from optical images of metallic surfaces, regardless of light and variations. Although texture and color feature subsets are likely to characterize corrosion individually, we demonstrated that when combining both of these subsets with a suboptimal sequential feature selection procedure the combination outperformed each one, that is, subset. Moreover, a linear discriminant analysis revealed that it minimized false positives and false negatives in corrosion detection.
Further work will investigate these corrosion descriptors for image segmentation in atmospheric corrosion detection systems.
The authors would like to thank ANP PRH31 for providing financial assistance.
- William J, Callister D: Fundamentals of Materials Science and Engineering. 5th edition. John Wiley & Sons, New York, NY, USA; 2001.Google Scholar
- Trujillo M, Sadki M: Sensitivity analysis for texture models applied to rust steel classification. Electronic Imaging Science and Technology, January 2004, San Jose, Calif, USA, Proceedings of SPIE 5303: 161-169.Google Scholar
- Kutz M: Handbook of Environmental Degradation of Materials. William Andrew, NewYork, NY, USA; 2007.Google Scholar
- Bardal E: Corrosion and Protection. Springer, Berlin, Germany; 2003.Google Scholar
- Roberge PR: Corrosion Inspection and Monitoring. John Wiley & Sons, New York, NY, USA; 2007.View ArticleGoogle Scholar
- Arko Lucieer AS, Fisher P: Multivariate texture-based segmentationof remotely sensed imagery for extraction of objects and theiruncertainly. International Journal of Remote Sensing 2005, 2917–2936: 610-621.Google Scholar
- Itzhak D, Dinstein I, Zilberberg T: Pitting corrosion evaluation by computer image processing. Corrosion Science 1981, 21(1):17-22. 10.1016/0010-938X(81)90059-7View ArticleGoogle Scholar
- Robert KS, Haralick RM, Dinstein I: Textural features for image classification. IEEE Transactions on Systems, Man and Cybernetics 1973, 3(6):610-621.View ArticleGoogle Scholar
- Chabrier S, Emile B, Rosenberger C, Laurent H: Unsupervised performance evaluation of image segmentation. EURASIP Journal on Applied Signal Processing 2006, 2006: 1-12.MathSciNetView ArticleGoogle Scholar
- Baraldi A, Parmiggiani F: An investigation of the textural characteristics associated with gray level cooccurrence matrix statistical parameters. IEEE Transactions on Geoscience and Remote Sensing 1995, 33(2):293-304. 10.1109/36.377929View ArticleGoogle Scholar
- Choi KY, Kim SS: Morphological analysis and classification of types of surface corrosion damage by digital image processing. Corrosion Science 2005, 47(1):1-15. 10.1016/j.corsci.2004.05.007View ArticleGoogle Scholar
- Lopes DFA, Ramalho GLB, de Medeiros FNS, Costa RCS, Araújo RTS: Combining features to improve oil spill classification in SAR images. In Structural, Syntactic, and Statistical Pattern Recognition, Lecture Notes in Computer Science. Volume 4109. Springer, Berlin, Germany; 2006:928-936. 10.1007/11815921_103View ArticleGoogle Scholar
- Ramalho GLB, Medeiros FNS: Using boosting to improve oil spill detection in SAR images. Proceedings of the 18th International Conference on Pattern Recognition (ICPR '06), August 2006 1066-1069.View ArticleGoogle Scholar
- Ramalho GLB, de Medeiros FNS: Improving reliability of oilspill detection systems using boosting for high-level feature selection. Proceedings of the International Conference on Image Analysis and Recognition, August 2007, Lecture Notes in Computer Science No. 4633 1172-1181.View ArticleGoogle Scholar
- Jain A, Zongker D: Feature selection: evaluation, application, and small sample performance. IEEE Transactions on Pattern Analysis and Machine Intelligence 1997, 19(2):153-158. 10.1109/34.574797View ArticleGoogle Scholar
- Livens S: Image analysis for material characterisation, Ph.D. dissertation. Instelling Antwerpen University; 1988.Google Scholar
- Webb AR: Statistical Pattern Recognition. 2nd edition. John Wiley & Sons, London, UK; 2002.View ArticleMATHGoogle Scholar
This article is published under license to BioMed Central Ltd. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.