Department of Mathematics
A universal variational framework for sparsity-based image inpainting
In this paper, we extend an existing universal variational framework for image inpainting with new numerical algorithms. Given certain regularization operator Φ and denoting u the latent image, the basic model is to minimize the ℓp,(p=0,1)\) norm of Φu preserving the pixel values outside the inpainting region. Utilizing the operator splitting technique, the original problem can be approximated by a new problem with extra variable. With the alternating minimization method, the new problem can be decomposed as two subproblems with exact solutions. There are many choices for Φ in our approach such as gradient operator, wavelet transform, framelet transform, or other tight frames. Moreover, with slight modification, we can decouple our framework into two relatively independent parts: 1) denoising and 2) linear combination. Therefore, we can take any denoising method, including BM3D filter in the denoising step. The numerical experiments on various image inpainting tasks, such as scratch and text removal, randomly missing pixel filling, and block completion, clearly demonstrate the super performance of the proposed methods. Furthermore, the theoretical convergence of the proposed algorithms is proved. © 2012 IEEE.
diffusion, exemplar, frame, Image inpainting, shrinkage, sparsity
Source Publication Title
IEEE Transactions on Image Processing
Institute of Electrical and Electronics Engineers
Link to Publisher's Edition
Li, Fang, and Tieyong Zeng. "A universal variational framework for sparsity-based image inpainting." IEEE Transactions on Image Processing 23.10 (2014): 4242-4254.