Motion-Compensated frame interpolation based on multihypothesis motion estimation and texture optimization

Seong Gyun Jeong, Chul Lee, Chang-Su Kim

Research output: Contribution to journalArticle

37 Citations (Scopus)

Abstract

A novel motion-compensated frame interpolation (MCFI) algorithm to increase video temporal resolutions based on multihypothesis motion estimation and texture optimization is proposed in this paper. Initially, we form multiple motion hypotheses for each pixel by employing different motion estimation parameters, i.e., different block sizes and directions. Then, we determine the best motion hypothesis for each pixel by solving a labeling problem and optimizing the parameters. In the labeling problem, the cost function is composed of color, shape, and smoothness terms. Finally, we refine the motion hypothesis field based on the texture optimization technique and blend multiple source pixels to interpolate each pixel in the intermediate frame. Simulation results demonstrate that the proposed algorithm provides significantly better MCFI performance than conventional algorithms.

Original languageEnglish
Article number6567908
Pages (from-to)4497-4509
Number of pages13
JournalIEEE Transactions on Image Processing
Volume22
Issue number11
DOIs
Publication statusPublished - 2013

Keywords

  • Motion-compensated frame interpolation
  • exemplar-based texture synthesis
  • frame rate up-conversion
  • multihypothesis motion estimation
  • video segmentation

ASJC Scopus subject areas

  • Software
  • Computer Graphics and Computer-Aided Design

Fingerprint Dive into the research topics of 'Motion-Compensated frame interpolation based on multihypothesis motion estimation and texture optimization'. Together they form a unique fingerprint.

  • Cite this