 Research
 Open access
 Published:
A splitting algorithm for a novel regularization of PeronaMalik and application to image restoration
EURASIP Journal on Advances in Signal Processing volume 2017, Article number: 46 (2017)
Abstract
In this paper, we focus on a numerical method of a problem called the PeronaMalik inequality which we use for image denoising. This model is obtained as the limit of the PeronaMalik model and the pLaplacian operator with p→∞. In Atlas et al., (Nonlinear Anal. Real World Appl 18:57–68, 2014), the authors have proved the existence and uniqueness of the solution of the proposed model. However, in their work, they used the explicit numerical scheme for approximated problem which is strongly dependent to the parameter p. To overcome this, we use in this work an efficient algorithm which is a combination of the classical additive operator splitting and a nonlinear relaxation algorithm. At last, we have presented the experimental results in image filtering show, which demonstrate the efficiency and effectiveness of our algorithm and finally, we have compared it with the previous scheme presented in Atlas et al., (Nonlinear Anal. Real World Appl 18:57–68, 2014).
1 Introduction
Image denoising is one of the fundamental challenges in the field of image processing and computer vision. The aim is to remove noise while preserving edges, boundaries, and textures. To handle this problem, partial differential equations [1–7], variational models [8–11], energy minimization, bilateral filtering [12, 13], and wavelet thresholding [14, 15] have been proposed depending on the domain of applications. Generally, the partial differential equations use a nonlinear anisotropic diffusion to restore a degraded image which they seek to improve its quality by removing noise while preserving details and even enhancing edges.
In 1990, PeronaMalik [2] proposed a nonlinear diffusion equation that succeeded in image denoising. Although, this model is an illposed problem in analytical point of view, besides, the numerical simulations produce the staircase effect. This paradoxical result has been named as the PeronaMalik Paradox [16]. Motivated by the illposedness of the PeronaMalik model, many works (see for instance [17–19]) suggest to introducing the regularization in space and/or time. Using the spatial convolution inside the anisotropic diffusion and replacing the diffusivity by a slight variation, new modified models have been proposed, but they produce an undesirable blurring effect. Otherwise, some new class of backwardforward regularizations has been introduced. In [20], the authors combine the PeronaMalik with a Laplacian operator and develop a new effective model, and they make a generalization of their results by replacing the Laplacian with a nonlinear pLaplacian operator for p∈(1,2] (cf. [21]). Recently, in [22], the authors proposed a new regularization based on the previous interpolation of PeronaMalik and pLaplacian with large value of p. Their model is well posed, it reduces the staircase effect and avoids creating new features in the image, they have also done a study of the limiting problem. For a numerical purpose, the authors used an explicit finite difference scheme which is unstable and the condition of stability depends on the parameter p.
In this paper, we develop a numerical semiimplicit method approaching the PeronaMalik inequality by using a splitting method [23]. The idea is to decompose the limit problem into two operators:

The PeronaMalik operator which will be treated by the additive operator schemes [24].

The second is called the subdifferential flow, where we use the Euler implicit discretization as well as we develop a dual formulation associated to the minimization problem [25].
The rest of this paper is organized as follows. In the next Section 2, we provide reviews of some previous works that are PeronaMalik model, pLaplacian equation and their interpolation. In Section 3, we present a new numerical scheme using an operator splitting algorithm that splits the PeronaMalik inequality in two submodels treated by additive operator schemes and dual formulation, respectively. Finally, some numerical simulations are given to demonstrate the effectiveness of the proposed algorithm.
2 Reviews of some previous works
In this section, we recall some previous models. Let T>0 be a fixed time, f the intensity of the noisy image, u the desired clean image that was corrupted with the noise n such that f = u + n, and let Ω be a bounded picture domain with smooth boundary Γ.
2.1 PeronaMalik model
The PeronaMalik model is a powerful model and widely used in image denoising. Hence, the idea behind this model is to improve the results obtained by the PDE heat and to change the equation by introducing the edge detection process (the diffusivity coefficient). PeronaMalik problem is obtained by solving the following anisotropic diffusion equation with a Neumann boundary condition:
The diffusion function g is an edge indicator function that controls the diffusion process by reducing the effect of diffusion near edges and behaves locally as the heat equation. Typical choices of g are:
where λ>1 is a threshold parameter that determines the size of the gradients which will be preserved and g is a decreasing function worth λ where ∇u is close to 0 and tend to 0 for large ∇u. Note that if g(.)≡1, we recover the heat equation. For the diffusivity function g, it follows the flux function Φ(t)=tg(t) which satisfies Φ ^{′}(t)≥0 for t≤λ and Φ ^{′}(t)≥0 for t≤λ.
We observe from the Fig. 1 b that the Perona–Malik model is a forward parabolic type for t≥λ and a backward parabolic type for t≤λ. This model is an illposed problem from the mathematical point of view and produces an unwanted phenomena well known by staircase effect.
2.2 The pLaplacian equation
To obtain the pLaplacian equation, we merely replace the diffusion function g of the Perona–Malik equation by g(t)=t ^{p−2}. The pLaplacian equation has been proposed and studied by many authors (see for instance [26]). It plays an important role in the modeling of many phenomena in different areas such as image processing [27], sandpile [28, 29], and fluid mechanic [30]. The evolutionary pLaplacian equation can be written as:
We recall that the case p = 2, the model corresponds to a wellknown heat equation. For p = 1, the equation is called total variation and for a large p, the model is known as the infinite Laplacian.
2.3 PeronaMalik and pLaplacian model
The staircasing phenomena is a manifestation of the forwardbackward nature of the Peronamalik equation which appears in its discretization. In order to escape the backward regime, a novel kind of regularization [20–22] of the classical PeronaMalik model is proposed for image processing. This regularization still allows gradient growth while controls its maximal size which is done by combining two classical models, PeronaMalik and pLaplacian.
Indeed, the following regularization reduces the size of the backward region and the solutions can flee the backward region simply by developing small and large gradients:
This problem is well posed for a large p, and the existence and uniqueness of the asymptotic behavior as p→∞ are established in [22]. Letting p→∞, the problem (1) converges to the following model:
where
and I _{ K }(.) denotes the indicator functional of the set K, for all u∈W ^{1,r}(Ω) I _{ K } is defined by:
Thanks to Remark 3.2 of [22], for p>λ ^{2}+1, the problem (1) has a unique weak solution u _{ p } and
Moreover, \( u \in \mathcal {W} \cap \mathcal {K}^{t}\) is the unique solution of (2) in the following sense:
for any \(\phi \in \mathcal {K}^{t} = \{\xi \in L^{r}(0,T;W^{1,r}(\Omega)):\xi (t) \in K\},\) having
For further details and another sophisticated notion of solutions, we refer to [22]. We remark that the limiting problem can be rewritten as:
which is equivalent to solving the PeronaMalik problem in the region where the norm of the gradient is less than λ.
3 An operator splitting algorithm
The operator splitting methods are very useful to derive fast algorithms. It is worthwhile to be used when the problem we want to solve has an additive structure, the main idea is to split the problem into subproblems that are easier to solve by treating its summands separately in each iteration of the algorithm. To achieve this goal, we use of the operator splitting algorithm that splits the proposed model into two equations. The first one corresponds to solve the following PeronaMalik model:
The second is a diffusion equation associated to the infinity Laplacian that is given by:
Let N > 0 be given, τ = T/N be the time step, t ^{n} = n τ, n = 0,…,N, and let us consider u ^{n} an approximation of u(t ^{n}) for all n = 0,…,N.
The basic idea is to discretize the Eq. (2) by using an implicit scheme for linear terms and an explicit scheme for the remaining terms. The goal is to reduce the execution time required to solve the equations by splitting up the terms in such a way that the stable time step for the explicit discretization is significantly smaller than the largest stable time step for the semiimplicit one.
After discretizing (2) with a semiimplicit first order scheme, we should find u ^{n + 1} satisfying:
The corresponding discretization of the time splitting scheme (3)–(4) consists on finding at each time step, \( v^{n~+~\frac {1}{2}}\) satisfying:
followed by finding w ^{n + 1} satisfying:
The PeronaMalik operator has been solved by different numerical methods and techniques and methods. To improve computational efficiency, we discretize (3) by (6) and we use the additive operator splitting scheme in the numerical implementation. On the other hand, the subdifferential Eq. (4), discretized by (7), is formulated as a minimization that will be solved by the dual formulation [25]. In the sequel, the two numerical methods are presented.
3.1 PeronaMalik operator
The simplest discretization of the mdimensional Eq. (6) with reflecting boundary conditions is given by:
where pixel i represents some location x _{ i }, \(u_{i}^{n}\) and \(g_{i}^{n}\) denote, respectively, the approximation of u(x _{ i },t _{ n }) and g(∇u(x _{ i },t _{ n })), m is the dimension size and \(\mathcal {N}_{l}(i)\) consists of the two neighbors of pixel i along the l direction for all l = 1,…,m. In vectormatrix, notation (8) becomes:
The system matrix A _{ l }(u ^{n}) is defined as \(A_{l}(u^{n})~=~\left [a^{l,n}_{\mathcal {I},\mathcal {J}}\right ]\), where
Therefore, we have:
The modification applied to (9) has been introduced firstly by [24] named as additive operator splitting (AOS) scheme which leads us to:
3.2 The subdifferential flow
The discretization of the problem (7) can be written as:
where ∂ f denotes the subdifferential of a given function f.
Thanks to [25], we focus our attention on the projection \(w^{n~+~1}~=~{P}_{K}\left (w^{n~+~\frac {1}{2}}\right).\) Indeed,
with \(J(z)~=~\frac {1}{2}\left \zw^{n~+~\frac {1}{2}}\right \_{L^{2}(\Omega)}^{2}\).
The dual formulation has been used to deal with this minimization problem. The dual problem associated with (12) is given by the following functional:
In order to find the numerical solution of the functional (13), we denote by z _{ h } a minimizer of this functional and G _{ h }(z _{ h }) the approximation of G(z) (see [25] for instance):
where τ represents simplex of the partitioning of T _{ h }, τ is the area of simplex τ, and P _{ τ } is one of the vertices of τ. In image processing, τ could be seen as discretization step h ^{2} = 1.
In view of the fact that G _{ h } is nondifferentiable, we use a relaxation algorithm (see for instance [31] and the references therein) to minimize the functional (14) that can be summarized as follows:

1.
Initiate the algorithm with vector q ^{0}, set k = 0, choose a canonical direction e _{ j }∈R ^{n}.

2.
Solving the onedimensional subproblems \(\underset {t \in R }{\min } \Psi _{jk}(t)\) where Ψ _{ jk } is defined as:
$$\begin{array}{@{}rcl@{}} \begin{array}{ll} \Psi_{jk}:& R \rightarrow R\\ &t \rightarrow G_{h}\left(q^{k}+t e_{j}\right). \end{array} \end{array} $$(15) 
3.
Taking q ^{k + 1} = q ^{k}+ω t _{ jk }, where ω>0 is an overrelaxation parameter.

4.
We can use Newton algorithm to find t _{ jk }, when Ψ _{ jk } is differentiable. Else, it can be computed directly.

5.
The condition to stop this algorithm is \(\q^{k}q^{k~+~1}\_{l^{2}({R}^{n})}\leq \varepsilon \), for a given convergence tolerance ε.
At last, in the next section, results of numerical simulations are given.
4 Numerical results and simulations
This section is devoted to extensive numerical experimentations. The program will stop when it achieves our goal. Most algorithm parameters are chosen heuristically for the algorithms to perform their best. We set, the spatial size h = 1 and the parameter ω = 1,2 of the relaxation algorithm. First, we illustrate the efficiency of our proposed numerical algorithm (cf. Figs. 2, 3, 4, and 5) for filtering the images corrupted with noise. As a second experiment, we will keep the same values of the previous parameters and we test the explicit scheme of the PeronaMalik and pLaplacian (PMPL) proposed in [22] for different values of p Fig. 6. We remark that the PMPL scheme depends on the parameter p and for a large p, the restored image has been damaged. In order to avoid numerical instability, we must take a very small time step. So that, the needed simulation takes more time due to the nature of data. For that, in the third test, we evaluate the performance of our algorithm compared to PMPL scheme by using CPU time. The last experiment aims to show the dependence also of the PMPL scheme to the threshold parameter λ.
For the improvements tests, we present the restorations and the results of our algorithm by choosing the parameter λ = 20.
The restored images are clearly better than the noisy ones; to obtain an objective evaluation of the proposed method, the peak signaltonoise ratio (PSNR) is used to measure the quality of the restoration results which is defined as:
where u _{0}, u, and M × N are the original image, the restored image and the size of the image, respectively. To qualify the restoration capacity of the method under consideration, the signaltonoise ratio (SNR) is applied and denoted by:
where σ _{ u } and σ _{ n } are the signal and noise standard deviations, respectively. The value of these statistical measures indicates the strength of signal in restored images. Therefore, the value increases as the restored version of the image approaches the original one. In order to better evaluate the restoration process, PSNR and SNR values are shown in the Table 1.
Now, we are testing our method on Barbara and Rice images corrupted by Gaussian noise with zero mean and variance σ ^{2}=0.03 and using the same parameters (Fig. 5).
The previous tests show the efficiency of our method. To argue the usage of the proposed algorithm, we will test, in the second experiment, the PMPL model using the explicit scheme proposed in [22] by using the same parameters of the previous test. We take different values of p to study its impact on the image restoration.
Figure 6 shows that the PMPL method has restored the image, but when p becomes large, the images are damaged due to the problem of stability which depends on the value of the parameters p and λ as well as the initial data. In order to repair the image and avoid numerical instability, we increase the value of the parameter λ and decrease the time step size dt until finding a suitable value for which the image will not get damaged. In this case, the PMPL scheme becomes stable for d t = 10^{−3} and λ = 60. In Figs. 7 and 8, we will fix λ = 60 and we present the comparison between our algorithm with d t = 0.1 and the PMPL method with d t = 10^{−3} (Fig. 6).
The Figs. 7 and 8 show that the two methods give similar results. But in this experiment, our algorithm has restored the images in fewer time compared to the PMPL method (Table 2).
In the last test, we keep the same parameters employed in the previous experiment and change the value of the threshold λ (Figs. 9 and 10).
In this experiment, the proposed algorithm proves to be performing better than the explicit scheme where the restored images are damaged when we took a λ small and/or p large (Fig. 9). The results of this section confirm the usefulness of our method that overcomes the condition of stability; whereas, we remark that for the explicit scheme, the stability criterion is given by d t≤f(p,λ) where f is a decreasing function with respect to p and a nondecreasing with respect to λ such that
5 Conclusions
Perona and Malik proposed one of the pioneering model which represents an efficient and effective tool for image denoising. However, the numerical simulations produce a phenomenon known as the staircase effect, which causes images to look blocky. To overcome this, in [22], we have proposed a regularized model which is an interpolation of two classical models, PeronaMalik and pLaplacian with p→∞. We have also demonstrate the efficiency and effectiveness of this model compared with the method most frequently used (see [22] for more detail). However, a major drawback for the numerical scheme is that the stability condition is strongly dependent to the parameters p, λ, and dt. For that, in this work, we develop a novel algorithm based on fractional step methods. Combining the classical additive operator splitting and a nonlinear relaxation algorithm, the numerical experiments demonstrate that the proposed algorithm is accurate and effective for images restoration. Comparing with the classical explicit schemes presented in [22] which strongly depends on the regularization methods and the model parameters, our algorithm controls the problem of stability and is significantly faster.
References
M Arian, N Manjari, B Richard, Anisotropic nonlocal means denoising. Appl. Comput. Harmon. Anal. 35:, 452–482 (2013).
P Perona, J Malik, Scalespace and edge detection using anisotropic diffusion. IEEE Trans. Pattern Anal. Mach. Intell. 12(7), 629–639 (1990).
Y Wang, W Ren, H Wang, Anisotropic second and fourth order diffusion models based on convolutional virtual electric field for image denoising. Comput. Math. Appl. 66:, 1729–1742 (2013).
Y Chen, S Levin, M Rao, Variable exponent, linear growth functionals in image restoration. SIAM J. Appl. Math. 66(4), 1383–1406 (2006).
R Aboulaich, D Meskine, A Souissi, New diffusion models in image processing. Comput. Math. Appl. 56(4), 874–882 (2008).
L Afraites, A Atlas, F Karami, D Meskine, Some class of parabolic systems applied to image processing. Discrete Contin. Dyn. Syst. Ser B 21. 6:, 1671–1687 (2016).
P Guidotti, J Lambers, Two new nonlinear nonlocal diffusions for noise reduction. J. Math. Imaging Vis. 33(1), 25–37 (2009).
X Liu, L Huang, A new nonlocal total variation regularization algorithm for image denoising. Math. Comput. Simul. 97:, 224–233 (2014).
L Rudin, S Osher, E Fatemi, Nonlinear total variation based noise removal algorithms. Physica D. 60:, 259–268 (1992).
O Seungmi, W Hyenkyun, Y Sangwoon, K Myungjoo, Nonconvex hybrid total variation for image denoising. J. Vis. Commun. Image R. 24:, 332–344 (2013).
L Shao, R Yan, X Li, Y Liu, From heuristic optimization to dictionary learning: a review and comprehensive comparison of image denoising algorithms. IEEE Trans. Cybernet. 44:, 177–189 (2014).
M Elad, On the origin of the bilateral filter and ways to improve it. IEEE Trans. Image Process. 11:, 1141–1151 (2002).
R Yan, L Shao, L Liu, Y Liu, Natural image denoising using evolved local adaptive filters. Signal Process. 103:, 36–44 (2014).
SG Chang, B Yu, M Vetterli, Adaptive wavelet thresholding for image denoising and compression. IEEE Trans. Image Process. 9:, 1532–1546 (2000).
R Yan, L Shao, Y Liu, Nonlocal hierarchical dictionary learning using wavelets for image denoising. IEEE Trans. Image Process. 22:, 4689–4698 (2013).
S Kichenassamy, The PeronaMalik paradox. SIAM J. Appl. Math. 75(5), 1328–1342 (1997).
F Catte, P Lions, JM Morel, T Coll, Image selective smooting and edge detection by nonlinear diffusion. SIAM J. Numer. Anal. 29(1), 182–193 (1992).
G Aubert, P Kornprobst, Mathematical problems in image processing. Partial differential equations and the calculus of variations. Second edition, vol. 147 (With a foreword by Olivier Faugeras. Applied Mathematical Sciences, 147. Springer, New York, 2006).
H Amann, Timedelayed PeronaMalik type problems. Acta Math. Univ. Comenian. 76(1), 15–38 (2007).
P Guidotti, A backwardforward regularization of the PeronaMalik equation. J. Diff. Equat.252:, 3226–3244 (2012).
P Guidotti, Y Kim, J Lambers, Image restoration with a new class of forwardbackwardforward diffusion equations of PeronaMalik type with applications to satellite image enhancement. SIAM J. Imaging Sci. 6(3), 1416–1444 (2013).
A Atlas, F Karami, D Meskine, The PeronaMalik inequality and application to image denoising. Nonlinear Anal. Real World Appl. 18:, 57–68 (2014).
RI McLachlan, G Reinout, W Quispel, Splitting methods. Acta Numerica. 11:, 341–434 (2002).
J Weickert, BM ter Haar Romeny, MA Viergever, Efficient and reliable schemes for nonlinear diffusion filtering. IEEE Trans. Image Process. 7:, 398–410 (1998).
S Dumont, N Igbida, On a dual formulation for the growing sandpile problem. Eur. J. Appl. Math. 2:, 169–185 (2009).
E Dibendetto, Degenerate Parabolic Equations (SpringVerlag, New York, 1993).
W Wei, B Zhou, A pLaplace equation model for image denoising. Inform. Technol. J. 11:, 632–636 (2012).
F Andreu, JM Mazon, JD Rossi, J Toledo, The limit as p→∞ in a nonlocal pLaplacian evolution equation: a nonlocal approximation of a model for sandpiles. Calc. Var.3:, 279–316 (2009).
L Prigozhin, Variational model of sandpile growth. Euro. J. Appl. Math. 3:, 225–235 (2009).
R Glowinski, J Rappaz, Approximation of a nonlinear elliptic problem arising in a nonNewtonian fluid model in glaciology. M2AN Math. Model. Numer. Anal. 1:, 175–186 (2003).
N Igbida, F Karami, T Nga, Discrete collapsing sandpile model. Nonlinear Anal. Theory Methods Appl. 1:, 177–189 (2014).
Acknowledgements
The authors gratefully acknowledge the helpful comments and suggestions of the reviewers, which have improved the presentation.
Author’s contributions
All authors contributed equally to this work. All authors read and approved the final manuscript.
Competing interests
The authors declare that they have no competing interests.
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.
About this article
Cite this article
Karami, F., Ziad, L. & Sadik, K. A splitting algorithm for a novel regularization of PeronaMalik and application to image restoration. EURASIP J. Adv. Signal Process. 2017, 46 (2017). https://doi.org/10.1186/s136340170484x
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/s136340170484x