Video inpainting algorithm using Spatio-temporal consistency

Sang Heon Lee, Soon Young Lee, Jun Hee Heu, Chang-Su Kim, Sang Uk Lee

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

A new video inpainting algorithm is proposed for removing unwanted or erroneous objects from video data. The proposed algorithm fills a mask region with source blocks from unmasked areas, while keeping spatio-temporal consistency. First, a 3-dimensional graph is constructed over consecutive frames. It defines a structure of nodes over which the source blocks are pasted. Then, we form temporal block bundles using the motion information. The best block bundles, which minimize an objective function, are arranged in the 3-dimensional graph. Extensive simulation results demonstrate that the proposed algorithm can yield visually pleasing video inpainting results even for dynamic sequences.

Original languageEnglish
Title of host publicationProceedings of SPIE - The International Society for Optical Engineering
Volume7246
DOIs
Publication statusPublished - 2009
EventComputational Imaging VII - San Jose, CA, United States
Duration: 2009 Jan 192009 Jan 20

Other

OtherComputational Imaging VII
CountryUnited States
CitySan Jose, CA
Period09/1/1909/1/20

Keywords

  • Inpainting
  • Optimization
  • Restoration
  • Spatio-temporal inpainting
  • Video editing

ASJC Scopus subject areas

  • Applied Mathematics
  • Computer Science Applications
  • Electrical and Electronic Engineering
  • Electronic, Optical and Magnetic Materials
  • Condensed Matter Physics

Fingerprint Dive into the research topics of 'Video inpainting algorithm using Spatio-temporal consistency'. Together they form a unique fingerprint.

  • Cite this

    Lee, S. H., Lee, S. Y., Heu, J. H., Kim, C-S., & Lee, S. U. (2009). Video inpainting algorithm using Spatio-temporal consistency. In Proceedings of SPIE - The International Society for Optical Engineering (Vol. 7246). [72460N] https://doi.org/10.1117/12.805892