Video inpainting and implant via diversified temporal continuations

Timothy K. Shih, Nick C. Tang, Wei Sung Yeh, Ta J. Chen, Wonjun Lee

Research output: Chapter in Book/Report/Conference proceedingConference contribution

15 Citations (Scopus)

Abstract

Recent interesting issues in video inpainting are defect removal and object removal. We take one more step to replace the removed objects in a video sequence by implanting objects from another video. Before implant, we improve an exemplar-based image inpainting algorithm by using a new patch matching strategy which incorporates edge properties. The data term used in a priority computation of candidate patches is also redefined. We take varieties of temporal continuations of foreground and background into consideration. A motion compensated inpainting procedure is then proposed. The inpainted video backgrounds are visually pleasant with smooth transitions. A simple tracking algorithm is then used to produce a foreground video, which is implanted into the inpainted background video. Our results are available at http://www.mine.tku.edu.tw/inpainting.

Original languageEnglish
Title of host publicationProceedings of the 14th Annual ACM International Conference on Multimedia, MM 2006
Pages133-136
Number of pages4
DOIs
Publication statusPublished - 2006 Dec 1
Event14th Annual ACM International Conference on Multimedia, MM 2006 - Santa Barbara, CA, United States
Duration: 2006 Oct 232006 Oct 27

Other

Other14th Annual ACM International Conference on Multimedia, MM 2006
CountryUnited States
CitySanta Barbara, CA
Period06/10/2306/10/27

Fingerprint

Defects

Keywords

  • Object removal
  • Object tracking
  • Temporal continuations
  • Video implant
  • Video inpainting

ASJC Scopus subject areas

  • Computer Science(all)
  • Media Technology

Cite this

Shih, T. K., Tang, N. C., Yeh, W. S., Chen, T. J., & Lee, W. (2006). Video inpainting and implant via diversified temporal continuations. In Proceedings of the 14th Annual ACM International Conference on Multimedia, MM 2006 (pp. 133-136) https://doi.org/10.1145/1180639.1180678

Video inpainting and implant via diversified temporal continuations. / Shih, Timothy K.; Tang, Nick C.; Yeh, Wei Sung; Chen, Ta J.; Lee, Wonjun.

Proceedings of the 14th Annual ACM International Conference on Multimedia, MM 2006. 2006. p. 133-136.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Shih, TK, Tang, NC, Yeh, WS, Chen, TJ & Lee, W 2006, Video inpainting and implant via diversified temporal continuations. in Proceedings of the 14th Annual ACM International Conference on Multimedia, MM 2006. pp. 133-136, 14th Annual ACM International Conference on Multimedia, MM 2006, Santa Barbara, CA, United States, 06/10/23. https://doi.org/10.1145/1180639.1180678
Shih TK, Tang NC, Yeh WS, Chen TJ, Lee W. Video inpainting and implant via diversified temporal continuations. In Proceedings of the 14th Annual ACM International Conference on Multimedia, MM 2006. 2006. p. 133-136 https://doi.org/10.1145/1180639.1180678
Shih, Timothy K. ; Tang, Nick C. ; Yeh, Wei Sung ; Chen, Ta J. ; Lee, Wonjun. / Video inpainting and implant via diversified temporal continuations. Proceedings of the 14th Annual ACM International Conference on Multimedia, MM 2006. 2006. pp. 133-136
@inproceedings{feac356cbf6b4dcbb0c66b9c0bd662b3,
title = "Video inpainting and implant via diversified temporal continuations",
abstract = "Recent interesting issues in video inpainting are defect removal and object removal. We take one more step to replace the removed objects in a video sequence by implanting objects from another video. Before implant, we improve an exemplar-based image inpainting algorithm by using a new patch matching strategy which incorporates edge properties. The data term used in a priority computation of candidate patches is also redefined. We take varieties of temporal continuations of foreground and background into consideration. A motion compensated inpainting procedure is then proposed. The inpainted video backgrounds are visually pleasant with smooth transitions. A simple tracking algorithm is then used to produce a foreground video, which is implanted into the inpainted background video. Our results are available at http://www.mine.tku.edu.tw/inpainting.",
keywords = "Object removal, Object tracking, Temporal continuations, Video implant, Video inpainting",
author = "Shih, {Timothy K.} and Tang, {Nick C.} and Yeh, {Wei Sung} and Chen, {Ta J.} and Wonjun Lee",
year = "2006",
month = "12",
day = "1",
doi = "10.1145/1180639.1180678",
language = "English",
isbn = "1595934472",
pages = "133--136",
booktitle = "Proceedings of the 14th Annual ACM International Conference on Multimedia, MM 2006",

}

TY - GEN

T1 - Video inpainting and implant via diversified temporal continuations

AU - Shih, Timothy K.

AU - Tang, Nick C.

AU - Yeh, Wei Sung

AU - Chen, Ta J.

AU - Lee, Wonjun

PY - 2006/12/1

Y1 - 2006/12/1

N2 - Recent interesting issues in video inpainting are defect removal and object removal. We take one more step to replace the removed objects in a video sequence by implanting objects from another video. Before implant, we improve an exemplar-based image inpainting algorithm by using a new patch matching strategy which incorporates edge properties. The data term used in a priority computation of candidate patches is also redefined. We take varieties of temporal continuations of foreground and background into consideration. A motion compensated inpainting procedure is then proposed. The inpainted video backgrounds are visually pleasant with smooth transitions. A simple tracking algorithm is then used to produce a foreground video, which is implanted into the inpainted background video. Our results are available at http://www.mine.tku.edu.tw/inpainting.

AB - Recent interesting issues in video inpainting are defect removal and object removal. We take one more step to replace the removed objects in a video sequence by implanting objects from another video. Before implant, we improve an exemplar-based image inpainting algorithm by using a new patch matching strategy which incorporates edge properties. The data term used in a priority computation of candidate patches is also redefined. We take varieties of temporal continuations of foreground and background into consideration. A motion compensated inpainting procedure is then proposed. The inpainted video backgrounds are visually pleasant with smooth transitions. A simple tracking algorithm is then used to produce a foreground video, which is implanted into the inpainted background video. Our results are available at http://www.mine.tku.edu.tw/inpainting.

KW - Object removal

KW - Object tracking

KW - Temporal continuations

KW - Video implant

KW - Video inpainting

UR - http://www.scopus.com/inward/record.url?scp=34547148358&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=34547148358&partnerID=8YFLogxK

U2 - 10.1145/1180639.1180678

DO - 10.1145/1180639.1180678

M3 - Conference contribution

SN - 1595934472

SN - 9781595934475

SP - 133

EP - 136

BT - Proceedings of the 14th Annual ACM International Conference on Multimedia, MM 2006

ER -