Motion-compensated frame interpolation using bilateral motion estimation and adaptive overlapped block motion compensation

Byeong Doo Choi, Jong Woo Han, Chang-Su Kim, Sung-Jea Ko

Research output: Contribution to journalArticle

222 Citations (Scopus)

Abstract

In this work, we develop a new motion-compe (MC) interpolation algorithm to enhance the temporal resolution of video sequences. First, we propose the bilateral motion estimation scheme to obtain the motion field of an interpolated frame without yielding the hole and overlapping problems. Then, we partition a frame into several object regions by clustering motion vectors. We apply the variable-size block MC (VS-BMC) algorithm to object boundaries in order to reconstruct edge information with a higher quality. Finally, we use the adaptive overlapped block MC (OBMC), which adjusts the coefficients of overlapped windows based on the reliabilities of neighboring motion vectors. The adaptive OBMC (AOBMC) can overcome the limitations of the conventional OBMC, such as over-smoothing and poor de-blocking. Experimental results show that the proposed algorithm provides a better image quality than conventional methods both objectively and subjectively.

Original languageEnglish
Pages (from-to)407-415
Number of pages9
JournalIEEE Transactions on Circuits and Systems for Video Technology
Volume17
Issue number4
DOIs
Publication statusPublished - 2007 Apr 1

Fingerprint

Motion compensation
Motion estimation
Interpolation
Image quality

Keywords

  • Bilateral motion estimation (ME)
  • Frame rate up-conversion
  • MC interpolation (MCI)
  • Overlapped block motion compensation (OBMC)

ASJC Scopus subject areas

  • Electrical and Electronic Engineering

Cite this

@article{61fee73b303b4241a3659e4a06ad2b43,
title = "Motion-compensated frame interpolation using bilateral motion estimation and adaptive overlapped block motion compensation",
abstract = "In this work, we develop a new motion-compe (MC) interpolation algorithm to enhance the temporal resolution of video sequences. First, we propose the bilateral motion estimation scheme to obtain the motion field of an interpolated frame without yielding the hole and overlapping problems. Then, we partition a frame into several object regions by clustering motion vectors. We apply the variable-size block MC (VS-BMC) algorithm to object boundaries in order to reconstruct edge information with a higher quality. Finally, we use the adaptive overlapped block MC (OBMC), which adjusts the coefficients of overlapped windows based on the reliabilities of neighboring motion vectors. The adaptive OBMC (AOBMC) can overcome the limitations of the conventional OBMC, such as over-smoothing and poor de-blocking. Experimental results show that the proposed algorithm provides a better image quality than conventional methods both objectively and subjectively.",
keywords = "Bilateral motion estimation (ME), Frame rate up-conversion, MC interpolation (MCI), Overlapped block motion compensation (OBMC)",
author = "Choi, {Byeong Doo} and Han, {Jong Woo} and Chang-Su Kim and Sung-Jea Ko",
year = "2007",
month = "4",
day = "1",
doi = "10.1109/TCSVT.2007.893835",
language = "English",
volume = "17",
pages = "407--415",
journal = "IEEE Transactions on Circuits and Systems for Video Technology",
issn = "1051-8215",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
number = "4",

}

TY - JOUR

T1 - Motion-compensated frame interpolation using bilateral motion estimation and adaptive overlapped block motion compensation

AU - Choi, Byeong Doo

AU - Han, Jong Woo

AU - Kim, Chang-Su

AU - Ko, Sung-Jea

PY - 2007/4/1

Y1 - 2007/4/1

N2 - In this work, we develop a new motion-compe (MC) interpolation algorithm to enhance the temporal resolution of video sequences. First, we propose the bilateral motion estimation scheme to obtain the motion field of an interpolated frame without yielding the hole and overlapping problems. Then, we partition a frame into several object regions by clustering motion vectors. We apply the variable-size block MC (VS-BMC) algorithm to object boundaries in order to reconstruct edge information with a higher quality. Finally, we use the adaptive overlapped block MC (OBMC), which adjusts the coefficients of overlapped windows based on the reliabilities of neighboring motion vectors. The adaptive OBMC (AOBMC) can overcome the limitations of the conventional OBMC, such as over-smoothing and poor de-blocking. Experimental results show that the proposed algorithm provides a better image quality than conventional methods both objectively and subjectively.

AB - In this work, we develop a new motion-compe (MC) interpolation algorithm to enhance the temporal resolution of video sequences. First, we propose the bilateral motion estimation scheme to obtain the motion field of an interpolated frame without yielding the hole and overlapping problems. Then, we partition a frame into several object regions by clustering motion vectors. We apply the variable-size block MC (VS-BMC) algorithm to object boundaries in order to reconstruct edge information with a higher quality. Finally, we use the adaptive overlapped block MC (OBMC), which adjusts the coefficients of overlapped windows based on the reliabilities of neighboring motion vectors. The adaptive OBMC (AOBMC) can overcome the limitations of the conventional OBMC, such as over-smoothing and poor de-blocking. Experimental results show that the proposed algorithm provides a better image quality than conventional methods both objectively and subjectively.

KW - Bilateral motion estimation (ME)

KW - Frame rate up-conversion

KW - MC interpolation (MCI)

KW - Overlapped block motion compensation (OBMC)

UR - http://www.scopus.com/inward/record.url?scp=34247632622&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=34247632622&partnerID=8YFLogxK

U2 - 10.1109/TCSVT.2007.893835

DO - 10.1109/TCSVT.2007.893835

M3 - Article

AN - SCOPUS:34247632622

VL - 17

SP - 407

EP - 415

JO - IEEE Transactions on Circuits and Systems for Video Technology

JF - IEEE Transactions on Circuits and Systems for Video Technology

SN - 1051-8215

IS - 4

ER -