- Research Article
- Open Access
Polarimetric SAR Image Object Segmentation via Level Set with Stationary Global Minimum
© Yongmin Shuai et al. 2010
- Received: 30 May 2009
- Accepted: 19 November 2009
- Published: 29 December 2009
We present a level set-based method for object segmentation in polarimetric synthetic aperture radar (PolSAR) images. In our method, a modified energy functional via active contour model is proposed based on complex Gaussian/Wishart distribution model for both single-look and multilook PolSAR images. The modified functional has two interesting properties: (1) the curve evolution does not enter into local minimum; (2) the level set function has a unique stationary convergence state. With these properties, the desired object can be segmented more accurately. Besides, the modified functional allows us to set an effective automatic termination criterion and makes the algorithm more practical. The experimental results on synthetic and real PolSAR images demonstrate the effectiveness of our method.
- Observation Model
- Curve Evolution
- Active Contour Model
- Speckle Noise
- Object Segmentation
Polarimetric synthetic aperture radar (PolSAR) is a well-established multidimensional SAR technique based on acquiring earth's surface information by means of using a pair of orthogonal polarizations for the transmitted and received electromagnetic fields [1, 2]. The object segmentation of PolSAR image plays an important role of PolSAR image understanding and analysis. In this paper, we focus on the problem of PolSAR image object segmentation. In literature, active contour model was well known to automatically recover the shape of objects from various types of images and provide a good detection of object boundaries in PolSAR images . In [4–6], several PolSAR image object segmentation methods based on the classical snake model  were proposed. But the classical snake model presents one limitation that topological changes which occur during the curve evolution are difficult. Because the snake model discretizes a curve using a set of points, this representation is hard to describe the curve topological changes.
In , a single-look PolSAR image segmentation algorithm based on level set and complex Gaussian distribution is proposed. In , a PolSAR image segmentation method is developed by embedding complex Wishart distribution into level set and active contour model. In [9, 10], these level set-based methods in [7, 8] are improved by a new multiphase method which embeds a simple partition constraint directly in curve evolution for PolSAR image segmentation. The level set-based methods can overcome topological change difficulties because level set has the significant advantage of allowing, in natural and numerically stable manner, variations in the topology of active contour .
However, the previous level set-based PolSAR image segmentation methods [7–10] may result in an unexpected state when they are used for object segmentation. That is because the corresponding energy functional which derives from Chan-Vese model  may have a local minimum. This limitation makes these algorithms may fail to detect the inside objects or the objects far from the contours. Moreover, it is difficult to set an automatic termination criterion to cease the computation automatically for these methods [7–10], since the value of level set function will not converge to a stationary state.
In , a level set-based energy functional, which is a modified version of the Chan-Vese model, has been proposed for bimodal segmentation of optical image. This functional is designed for the images which are not noisy or the images of which the noise is not too high. In , we proposed a level set-based energy functional which is a modified functional in . This functional is proposed for segmentation of SAR image which contains high level of speckle noise . The proposed functional in  is designed to overcome the influence of speckle noise in one-dimensional (1D) data for SAR image. The above two level set-based energy functional [13, 14] can get a stationary global minimum.
As illustrated in , the 1D speckle noise model cannot be extended to multidimensional SAR data directly though SAR polarimetry represents an extension to multidimensional data by the use of polarization wave diversity. PolSAR image segmentation is significantly difficult due to the complexity of the data and the occurrence of multiplicative speckle noise .
In this paper, following on from our initial effort in , we develop a level set-based bimodal segmentation method for PolSAR image object segmentation using complex Gaussian/Wishart observation models. These models are demonstrated to be effective for PolSAR image segmentation in [5, 7–10]. Besides, we improve the mathematical proof of the stationary property compared to our previous work . At last, we discuss the robustness of our method and the effectiveness of the termination criterion in the experiment.
The rest of the paper is organized as follows. In Section 2, we present the statistic observation models. In Section 3, a new energy functional for PolSAR image object segmentation is proposed. In Section 4, we prove that the functional can arrive at a stationary global minimum. In Section 5, an effective termination criterion for the proposed segmentation method is presented. In Section 6, we deduce a numerical approximation of the proposed method. In Section 7 we show the experimental results of our method on both synthetic and real PolSAR images. The conclusions are given in Section 8.
We use different statistical observation models for single-look and multilook PolSAR image case. Let be the domain of a PolSAR image and the pixel of image.
In the case of single-look PolSAR images, each pixel x of the image in a homogeneous region consists of a corresponding vector as (3).
where represents the ensemble average, and * is the complex conjugate of a complex quantity.
where represents the number of looks, and is the covariance matrix of a particular pixel defined as .
As the descriptions of the PolSAR image speckle models in Section 2, we could make the following assumptions. The PolSAR image consists, at each pixel , of a matrix . When the PolSAR image is single-look, is a complex vector as and follows a complex Gaussian distribution as (4). When the PolSAR image is multilook, is a complex matrix as and follows a complex Wishart distribution as (8).
Equation (13) indicates that the minimization of energy function (13) can obtain the correct object segmentation of . In other words, this turns the problem of object segmentation into a problem of energy function minimization.
where is regularization parameter, is the level set function, and is the 1D Heaviside function, with if or if . and are defined by and , respectively. The first term is the prior term which is the classic boundary length term  for smooth segmentation boundaries. The second and third terms are the likelihood terms which are specified by the observation model.
As , the minimization of level set-based energy functional (14) via curve evolution is equivalent to the minimization of (13). And then this turns the problem of object segmentation into the problem of energy functional minimization. That is to say, the contours of the objects can be obtained by the minimization of energy functional (14) concerning level set function .
Firstly, the minimizer, which is obtained by the minimization of energy functional (14), may become a local minimizer during curve evolution. Because the likelihood terms of functional (14) are a modified edition of Chan-Vese model , this model may sometimes enter into a local minimum, as indicated in [12, 13]. When the minimization of energy functional (14) enters into a local minimizer, the segmentation method by  based on (14) may fail to detect the inside region or the objects that are far from the initial zero level set. This situation is also shown in our experiments.
Secondly, when we minimize (14) by curve evolution with respect to for object segmentation, it is difficult to set an appropriate automatic terminate criterion based on the value of the level set function. This is because the value of the level set function cannot converge to a stationary state by the minimization of the energy functional (14) via curve evolution. In practical application, this limitation makes it hard to decide whether the desired object segmentation has been obtained and then stop the curve evolution automatically.
where is an arbitrary small positive value, and the other parameters are the same to the functional (14).
As shown in , the minimization of energy functional (15) with respect to by curve evolution is also equivalent to the minimization of energy function (6). In other words, the minimization of the functional (15) will result in a level set function whose zero level set can be the contours that separate the objects from the background.
In order to avoid the occurrence of small, isolated regions in the final segmentation, we take the same prior term as in [10, 25]. The likelihood terms, which are the second and third terms of (15), are specified by observation models. These observation models have been described in Section 2.
The minimization of energy functional (15) by curve evolution can obtain a stationary global minimum. That is to say, the corresponding final contours will detect all the objects in the PolSAR image. Moreover, the modified likelihood terms with shift Heaviside function can confine the range of , so that the solution always becomes stationary. Due to the above improvements, the objects in the PolSAR image can be fully segmented and a termination criterion can be imposed on the algorithm due to the stationary solution. We present a termination criterion in Section 5.
We prove that the minimization of (15) with respect to can arrive at a stationary global minimum in Section 4.
We have made two modifications in (14) to obtain (15), multiplying and using shifted Heaviside functions in the second and third terms of (15). By multiplying , the energy functional (15) can get a global minimum. By using shifted Heaviside functions, the values of the level set function will converge to a stationary state. These two properties will be proved as follows.
Firstly, we introduce that multiplying leads to the global minimum as follows. In (14), the likelihood terms, which are the second and third terms of (14), change only if the sign of changes during the curve evolution. However, by multiplying in the energy functional (15), the likelihood terms, which are the second and third terms of (15), can reflect the value change of , even in the absence of a sign change of . As illustrated in [13, 14], this modification of the functional can overcome the local minimum limitation of the Chan-Vese model and guarantee that a global minimum can be obtained with the energy functional (15).
Secondly, we prove that the shifted Heaviside functions can guarantee that the level set function will enter into a stationary state when the energy functional achieves the global minimum as follows.
where the values of and only depend on the zero level set. The values of and are controlled by all the level sets.
From (16), we can deduce that, during the curve evolution, every with magnitude value experiences a change such that decreases until . This fact can be concluded as Lemma 1.
If is a minimizer for energy functional (16), then whenever .
Because , we can easily find that if , the minimizer of can be obtained when ; if , the minimizer can be obtained when ; if , the image may be a homogenous region and there is no object to be obtained. Observing this fact and based on Lemma 1, we have the following theorem.
As indicated in  that an image can be approximated by a continuous function, for example, by convolving it with a Gaussian kernel. Theorem 1 will hold in this case. The proof of Theorem 1 based on Lemma 1 has been presented in . Theorem 1 can guarantee that will enter into a stationary state when is the minimizer of the functional (15). The effect of Theorem 1 is also shown in the experiments for PolSAR image object segmentation.
An effective automatic termination criterion is important for a level set-based PolSAR image object segmentation method when the PolSAR image processing system which employs this segmentation method needs to automatically determine whether the desired objects have been obtained.
There are several existing termination criteria for level set-based PolSAR image segmentation as follows. Firstly, a termination criterion bases on the comparison between the values of the current and the previous step. Secondly, terminate the curve evolution when the sign of the values does not change any more. These criteria are not suitable for they may fail to segment certain regions, for example, inside regions [13, 14].
Generally one could set a predefined number of iterations large enough to detect all the desired regions in the PolSAR image domain. However, this will bring so much unnecessary computation. What is more, the number of iterations is dependent on the initialization of and the kind of PolSAR image which make it difficult to predefine.
The level set function corresponding to these PolSAR image segmentation methods [7–10] will not be stationary when curve evolution enters into a convergence state; so it is difficult to impose a suitable termination criterion on these methods based on the value of level set function.
We can just measure the PolSDE every time step and terminate the computation automatically when the PolSDE decreases approximate to 0; for example, if , stop the curve evolution and then obtain the desired segmentation result. The effect and graph of the PolSDE are shown in our experiments.
where , , , , are central difference approximations which is defined in  as follows:
We can start with any initial level set function and then obtain the same segmentation result in the steady state because the proposed level set-based energy functional in Section 3 can arrive at the global minimum by curve evolution.
As , the steps to the implementation with an explicit finite difference scheme are as follows.
Initialize the level set function.
Compute and by (6) and (10).
Calculate the value of PolSDE by (19).
Repeat steps , , and until PolSDE is less than the threshold,
Where is defined as follows:
In the following, we present several experimental results on synthetic and real PolSAR images to show the object segmentation effect of our method. We display the span image of the PolSAR image in this paper.
We choose the parameters for the experiments as follows. We use which is defined as [12–14] with . According to Theorem 1, can be an arbitrary positive value theoretically and we set or for the following experiments. It is also shown that different values of do not affect the accuracy of segmentation in the experiments. We stop the curve evolution if PolSDE . These parameter settings are the same for all the experiments. Only the regularization parameter , which has a scaling role , is not the same in all experiments. We will give the exact value of each time in the following experiments.
The synthetic images of single-look and 4-look are both generated using the ideal segmentation image in Figure 1(a). In Figure 1, we segment single-look PolSAR image. In Figure 2, we segment 4-look PolSAR image. It can be seen that, without a stationary global minimum, the method in  fails to detect the inside region and objects that are far from the zero level set, whereas, with our method, all the regions are detected.
In the following experiments we use a very simple initial function. Half of has the value of 1 and half of has the value of 1.
The proposed algorithm is designed to extract desired objects in PolSAR images, by relying on an active contour model and level set. The resulting contours could be used for high-level PolSAR image analysis, for instance, object recognition. The experiments show that the proposed method outperforms previous level set-based approaches for PolSAR image object extraction in two senses: firstly, it can provide more accurate object extraction results; secondly, an automatic termination criterion can be easily set for the algorithm, which is useful for practical application.
There is a limitation that the accuracy of the proposed algorithm would decrease when the scenes of background are very complicated. The reason lies in the description limitation of the observation model (complex Gaussian/Wishart distribution) adopted by our level set-based method. In complicated scenes, there are several regions of which the scattering mechanisms are similar to that of the desired objects. In this case, the adopted unimodal observation models are not accurate enough to model the background and the foreground, for instance, complicated urban area. Thus, the output of our algorithm may mistake the undesired objects for the desired one because of the inaccurate adopted observation distribution.
One way to overcome this limitation is to use more accurate observation models for such scenes of PolSAR image, for example, the mixture models proposed by . An alternative solution is to introduce some known high-level cues, such as the context information, as a prior to the proposed algorithm.
We present a new level set-based bimodal method to segment the objects in PolSAR images. The method has an advantage that it can get a stationary global minimum. This means that the curve evolution will never converge to a local minimum and the value of in the converged state is predictable. Thereby, the proposed method can detect the desired objects in the PolSAR images well. Moreover, we can set a reasonable termination criterion based on the values of level set function to cease the computation automatically, and this property has practical value in PolSAR image processing.
A major limitation of our algorithm is that for the very complex scenes, the object segmentation accuracy may decrease. The fundamental cause lies in that our method adopts a simple unimodal complex observation model which may be not accurate enough to model some complicated scenes. In view of this point, our plan is to extend the proposed algorithm by using more suitable observation models including mixture model which can describe the complicated scene of PolSAR image more accurately. Also, another plan is to combine other known high-level context information with the proposed algorithm to get a more accurate object segmentation result.
The authors appreciate the supports of the National High Technology Research, Development Program of China under Grant no. 2007AA12Z155, the National Natural Science Foundation of China under Grants nos. 60872131, 40801183, and 60890074, and LIESMARS Special Research Funding. The authors also thank the editors and anonymous reviewers for their valuable comments, which improved this paper significantly.
- Ulaby FT, Elachi C: Radar Polarimetry for Geoscience Applications. Artech House, Norwood, Mass, USA; 1990.Google Scholar
- Wong Y, Posner EC: A new clustering algorithm applicable to multispectral and polarimetric SAR images. IEEE Transactions on Geoscience and Remote Sensing 1993, 31(3):634-644. 10.1109/36.225530View ArticleGoogle Scholar
- Chesnaud C, Rélrégier P, Boulet V: Statistical region snake-based segmentation adapted to different physical noise models. IEEE Transactions on Pattern Analysis and Machine Intelligence 1999, 21(11):1145-1157. 10.1109/34.809108View ArticleGoogle Scholar
- Goudail F, Réfrégier P: Target detection and segmentation in coherent active polarimetric images. Proceedings of the IEEE International Conference on Image Processing (ICIP '01), October 2001 3: 632-635.MATHGoogle Scholar
- Goudail F, Rélrégier P: Contrast definition for optical coherent polarimetric images. IEEE Transactions on Pattern Analysis and Machine Intelligence 2004, 26(7):947-951. 10.1109/TPAMI.2004.22View ArticleGoogle Scholar
- Gambini J, Mejail ME, Jacobo-Berlles J, Frery AC: Polarimetric SAR region boundary detection using B-spline deformable countours under the GH model. Proceedings of the 18th Brazilian Symposium of Computer Graphic and Image Processing (SIBGRAPI '05), October 2005 2005: 197-204.View ArticleGoogle Scholar
- Ben Ayed I, Mitiche A, Belhadj Z: Level set curve evolution partitioning of polarimetric images. Proceedings of the International Conference on Image Processing (ICIP '05), September 2005, Genova, Italy 1: 281-284.Google Scholar
- Ben Ayed I, Mitiche A, Belhadj Z: Variational unsupervised classification of polarimetric images. Proceedings of the International Geoscience and Remote Sensing Symposium (IGARSS '06), July-August 2006, Denver, Colo, USA 4198-4200.Google Scholar
- Ben Ayed I, Mitiche A, Belhadj Z: Variational unsupervised segmentation of multi-look complex polarimetric images using a Wishart observation model. Proceedings of the IEEE International Conference on Image Processing, 2006, Atlanta, Ga, USA 3: 3233-3236.Google Scholar
- Ben Ayed I, Mitiche A, Belhadj Z: Polarimetric image segmentation via maximum-likelihood approximation and efficient multiphase level-sets. IEEE Transactions on Pattern Analysis and Machine Intelligence 2006, 28(9):1493-1500.View ArticleGoogle Scholar
- Osher S, Fedkiw RP: Level Set Method and Dynamic Implicit Surfaces. Springer, New York, NY, USA; 2002.MATHGoogle Scholar
- Chan TF, Vese LA: Active contours without edges. IEEE Transactions on Image Processing 2001, 10(2):266-277. 10.1109/83.902291View ArticleMATHGoogle Scholar
- Lee S-H, Seo JK: Level set-based bimodal segmentation with stationary global minimum. IEEE Transactions on Image Processing 2006, 15(9):2843-2852.MathSciNetView ArticleGoogle Scholar
- Shuai Y, Sun H, Xu G: SAR image segmentation based on level set with stationary global minimum. IEEE Geoscience and Remote Sensing Letters 2008, 5(4):644-648.View ArticleGoogle Scholar
- Lee J-S, Grunes MR, Mango SA: Speckle reduction in multipolarization, multifrequency SAR imagery. IEEE Transactions on Geoscience and Remote Sensing 1991, 29(4):535-544. 10.1109/36.135815View ArticleGoogle Scholar
- Lopez-Martinez C, Fabregas X: Polarimetric SAR speckle noise model. IEEE Transactions on Geoscience and Remote Sensing 2003, 41(10, part 1):2232-2242. 10.1109/TGRS.2003.815240View ArticleGoogle Scholar
- López-Martínez C, Fàbregas X, Pottier E: Multidimensional speckle noise model. EURASIP Journal on Applied Signal Processing 2005, 2005(20):3259-3271. 10.1155/ASP.2005.3259View ArticleMATHGoogle Scholar
- Cloude SR, Pettier E: A review of target decomposition theorems in radar polarimetry. IEEE Transactions on Geoscience and Remote Sensing 1996, 34(2):498-518. 10.1109/36.485127View ArticleGoogle Scholar
- Ulaby FT, Elachi C: Radar Polarimetry for Geoscience Applications. Artech House, Norwood, Mass, USA; 1990.Google Scholar
- López-Martínez C, Pottier E, Cloude SR: Statistical assessment of eigenvector-based target decomposition theorems in radar polarimetry. IEEE Transactions on Geoscience and Remote Sensing 2005, 43(9):2058-2074.View ArticleGoogle Scholar
- Ferro-Famil L, Pottier E, Lee J-S: Unsupervised classification of multifrequency and fully polarimetric SAR images based on the H/A/Alpha-Wishart classifier. IEEE Transactions on Geoscience and Remote Sensing 2001, 39(11):2332-2342. 10.1109/36.964969View ArticleGoogle Scholar
- Conradsen K, Nielsen A, Schou J, Skriver H: A test statistic in the complex wishart distribution and its application to change detection in polarimetric SAR data. IEEE Transactions on Geoscience and Remote Sensing 2003, 41(1):4-19. 10.1109/TGRS.2002.808066View ArticleGoogle Scholar
- Ferro-Famil L, Reigber A, Pottier E, Boerner W-M: Scene characterization using subaperture polarimetric SAR data. IEEE Transactions on Geoscience and Remote Sensing 2003, 41(10, part 1):2264-2276. 10.1109/TGRS.2003.817188View ArticleGoogle Scholar
- Lee J-S, Grunes MR, Pottier E, Ferro-Famil L: Unsupervised terrain classification preserving polarimetric scattering characteristics. IEEE Transactions on Geoscience and Remote Sensing 2004, 42(4):722-731.View ArticleGoogle Scholar
- Mumford D, Shah J: Optimal approximation by piecewise smooth functions and associated variational problems. Communications on Pure and Applied Mathematics 1989, 42: 577-685. 10.1002/cpa.3160420503MathSciNetView ArticleMATHGoogle Scholar
- Jäger M, Reigber A, Hellwich O: Unsupervised classification of polarimetric SAR data using graph cut optimization. Proceedings of the International Geoscience and Remote Sensing Symposium (IGARSS '08), June 2008, Barcelona, Spain 2232-2235.Google Scholar
This article is published under license to BioMed Central Ltd. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.