LAPLACIAN PYRAMID BASED HIERARCHICAL IMAGE INPAINTING
DOI:
https://doi.org/10.14738/aivp.21.46Keywords:
Hierarchical Digital Image Inpainting, Laplacian Pyramid, Exemplar based Inpainting, Multiresolution Inpainting,Abstract
There are many real world scenarios where a portion of the image is damaged or lost. Restoring such an image
without prior knowledge or a reference image is a difficult task. Image inpainting is a method that focuses on reconstructing the damaged or missing portion of images based on the information available from undamaged areas of the same image. The existing methods fill the missing area from the boundary. Their performance varies while reconstructing the structure and texture present in the image and majorly fails for larger inpainting area. This paper attempts to segregate the structure and texture using Laplacian Pyramid and inpaint them separately using a top down approach. The images are inpainted from the
lowest spatial resolution using Exemplar based image synthesis. The results are updated before moving to the higher resolution levels. This multi resolution process ensures the coarser details being filled before the finer details. The structure propagation is better since it is handled separately. The top down approach alleviates the traditional boundary based filling and breaks the single large sized inpainting region into many smaller sized ones as we move down the pyramid. Different types of images have been experimented and the results are summarized.
References
P.J. BURT, E. H. ADELSON.,"The Laplacian Pyramid as a Compact Image Code"., IEEE Trans on Communication,vol. COM-31, no. 4, April 1983
P. PERONA AND J. MALIK, Scale-Space Edge Detection Using Anisotropic Diffusion, IEEE Transactions on Pattern Analysis and
Machine Intelligence, Vol. 12, No.7, July 1990, http://www.cs.berkeley.edu/~malik/papers/MP-aniso.pdf
D.J. HEEGER AND J.R. BERGEN, Pyramid-Based Texture Analysis/Synthesis, Proceedings of SIGGRAPH 1995, pp 229-238, September
http://www.cns.nyu.edu/~david/ftp/reprints/heeger-siggraph95.pdf
A.C. KOKARAM, R.D. MORRIS, W.J. FITZGERALD AND P.J.W. RAYNER, “Interpolation of Missing Data in Image Sequences”,IEEE
Transactions on Image Processing. Vol. 4. No.11, Nov. 1995, pp 1509-1519. URL: http://www.robinmorris.org/sigproc/interpolation.pdf
H. IGEHY AND L. PEREIRA, “Image Replacement through Texture Synthesis”,Proceedings of the IEEE International Conference on
Image Processing, October 1997.URL: http://graphics.stanford.edu/papers/texture_replace/texture_replace.pdf
J.S. DE BONET, “Multi resolution sampling procedure for analysis and synthesis of texture images”, in Proc. ACM Conference Computer
Graphics (SIGGRAPH), volume 31, pages 361–368, 1997.
V. CASELLES, J. M. MOREL, AND C. SBERT, "An Axiomatic Approach to Image Interpolation", IEEE Transactions on Image
Processing, 7, Issue 3, Mar 1998, Page(s): 376 - 386.
M. TUCERYAN AND A. K. JAIN, “Texture Analysis,” Handbook of Pattern Recognition and Computer Vision, C. H. Chan, L. F. Pau, and
P. S. P. Wang (Eds.), Ch.2, pp. 235-276, Singapore: World Scientific, 1998.
A. EFROS AND T. LEUNG. Texture synthesis by non-parametric sampling.In Proc. Int. Conf. Computer Vision, pages 1033–1038,
Kerkyra, Greece, September 1999.
M. BERTALMIO, G. SAPIRO, V. CASELLES, AND C. BALLESTER, "Image Inpainting" Proceedings of the ACM SIGGRAPH
Conference on Computer Graphics, SIGGRAPH2000, New Orleans, USA. July 2000, pp 417-424. URL:
http://www.iua.upf.es/~mbertalmio/bertalmi.pdf
M. BERTALMIO, A.L. BERTOZZI AND G. SAPIRO, “Navier-Stokes, Fluid Dynamics, and Image and Video Inpainting”, Proc. IEEE
Computer Vision and Pattern Recognition (CVPR’01), Hawaii, December 2001. http://www.iua.upf.es/~mbertalmio/final-cvpr.pdf
C. BALLESTER, M. BERTALMIO, V. CASELLES, G. SAPIRO, AND J. VERDERA, "Filling-in by Joint Interpolation of Vector Fields
and Gray Levels", IEEE Transaction on Image Processing, 10, Issue 8, Aug 2001, Page(s): 1200 - 1211.
M.M. OLIVIEIRA, B. BOWEN, R. MCKENNA AND Y.S. CHUNG, “Fast Digital Image Inpainting”, Proceedings of the International
Conference on Visualization, Imaging and Image Processing (VIIP 2001), Marbella, Spain 2001. Sep. 3-5, 2001, pp 261-266. URL:
http://www.cs.sunysb.edu/~oliveira/pubs/inpainting.pdf
T. F. CHAN AND J. SHEN, "Non-Texture Inpainting by Curvature-Driven Diffusions (CDD)", Journal Visual Communication and Image
Representation, 12, Number 4, 2001, Page(s): 436 - 449.
M. ASHIKHMIN. “Synthesizing natural textures”. In Proc. ACM Symposium on Interactive 3D Graphics, pages 217–226, Research
Triangle Park, NC, March 2001.
A. EFROS and W.T. FREEMAN, “Image quilting for texture synthesis and transfer”. In Proc. ACM Conf. Comp. Graphics (SIGGRAPH),
pages 341–346, Eugene Fiume, August 2001.
A. HERTZMANN, C. JACOBS, N. OLIVER, B. CURLESS, and D. SALESIN, “Image analogies”. In Proc. ACM Conf. Comp. Graphics
(SIGGRAPH), Eugene Fiume, August 2001.
C. BALLESTER, V. CASELLES, J. VERDERA, M. BERTALMIO, and G. SAPIRO. “A variational model for filling-in gray level and
color images”. In Proc. Int. Conf. Computer Vision, pages I: 10–16, Vancouver, Canada, June 2001.
P.Harrison, “A non-hierarchical procedure for re-synthesis of complex texture”, in Proc. Int. Conf. Central Europe Computer Graphics,
Visualization And Computer Vision, Plzen, Czech Republic, February 2001.
S. MASNOU, "Disocclusion: A Variational Approach using Level Lines", IEEE Transactions on Signal Processing, 11, Issue 2, Feb 2002,
Page(s): 68- 76.
R. BORNARD, E. LECAN, L. LABORELLI AND J-H. CHENOT, “Missing Data Correction in Still Images and Image Sequences”, ACM
Multimedia 2002, Juan-les-Pins, France, Dec. 2002. URL: http://brava.ina.fr/papers/INA_Raphael_Bornard/RBornard_mm2002_preprint.pdf
T.F. CHAN, J. SHEN AND L. VESE, “Variational PDE Models in Image Processing”, UCLA Computational and Applied Mathematics
Reports 02-61, Dec. 2002. URL: ftp://ftp.math.ucla.edu/pub/camreport/cam02-61.pdf
J. SHEN, “Inpainting and the Fundamental Problem of Image Processing”, SIAM News 36(5), June 2003.
http://www.math.ucla.edu/~imagers/htmls/internalreport/ShenSIAM.pdf
M. BERTALMIO, L. VESE, G. SAPIRO AND S. OSHER, “Simultaneous Structure and Texture Image Inpainting”, in Proc. Conference
Computer Vision Pattern Recognition, Madison, WI, 2003. Proceedings of the 2003 IEEE Computer Society Conference on Computer Vision
and Pattern Recognition (CVPR’03), volume 2, June 2003. URL: http://www.math.ucla.edu/~lvese/PAPERS/01211536.pdf
A. CRIMINISI, P. PÉRES AND K. TOYAMA, "Region Filling and Object Removal by Exemplar-Based Image Inpainting"., IEEE Trans
on Image Processing , vol. 13, NO. 9, sep 2004
I. DRORI, D. COHEN-OR AND H. YESHURUN, “Fragment-Based Image Completion”, ACM Transactions on Graphics (TOG), volume
issue 3, July 2003. URL: http://portal.acm.org
[ 27] S.PADMAVATHI, K.P.SOMAN ,Comparative Analysis of Structure and Texture based Image Inpainting Techniques, International
Journal of Electronics and Computer Science Engineering,( IJECSE )Volume 1, Number 3, June 2012, pp1062-1069
S.PADMAVATHI, N.ARCHANA, K.P.SOMAN , Hierarchical Approach For Total Variation Digital Image Inpainting,
International Journal of Computer Science, Engineering and Applications (IJCSEA), Volume 2, number 3, june 2012, PP173-182
S.PADMAVATHI, K.P.SOMAN, A Hierarchical Search Space Refinement and filling for Exemplar based Image Inpainting, International
Journal of Computer Applications (IJCA) Volume 52, number4, August 2012, pp31-37.
] S.PADMAVATHI, B. PRIYA LAKSHMI, K.P.SOMAN, Hierarchical Digital Image Inpainting using Wavelets , Signal
& Image Processing : An International Journal ( SIPIJ ) , Volume 3 , Number 4 , August 2012, pp 85-93.
