Efficient frame error concealment using bilateral motion estimation for low bit-rate video transmission

Dinhtrieu Duong, Min Cheol Hwang, Byeong Doo Choi, Jun Hyung Kim, Sung-Jea Ko

Research output: Contribution to journalArticle

Abstract

In low bit-rate video transmission, the payload of a single packet can often contain a whole coded frame due to the high compression ratio in both spatial and temporal domains. Thus, the loss of a single packet can lead to the loss of a whole video frame. In this paper, we propose a novel error concealment algorithm that can effectively reconstruct the lost frame and protect the quality of video streams from the degradation caused by propagation errors. The proposed algorithm employs a bilateral motion estimation scheme where the weighted sum of the received motion vectors (MVs) in the neighboring frames is utilized to construct the MV field for the concealed frame. Unlike the conventional algorithms, the proposed scheme does not produce any overlapped pixel and hole region in the reconstructed frame. The proposed algorithm can be applied not only to the case of single frame loss but also adaptively extended to the case of multiframe loss. Experimental results show that the proposed algorithm outperforms other conventional techniques in terms of both peak signal-to-noise ratio (PSNR) performance and subjective visual quality.

Original languageEnglish
Pages (from-to)461-472
Number of pages12
JournalIEICE Transactions on Communications
VolumeE92-B
Issue number2
DOIs
Publication statusPublished - 2009 Jan 1

Fingerprint

Motion estimation
Signal to noise ratio
Pixels
Degradation

Keywords

  • Frame error concealment
  • Low bit-rate video transmission
  • Multiframe loss
  • Video restoration

ASJC Scopus subject areas

  • Software
  • Computer Networks and Communications
  • Electrical and Electronic Engineering

Cite this

Efficient frame error concealment using bilateral motion estimation for low bit-rate video transmission. / Duong, Dinhtrieu; Hwang, Min Cheol; Choi, Byeong Doo; Kim, Jun Hyung; Ko, Sung-Jea.

In: IEICE Transactions on Communications, Vol. E92-B, No. 2, 01.01.2009, p. 461-472.

Research output: Contribution to journalArticle

Duong, Dinhtrieu ; Hwang, Min Cheol ; Choi, Byeong Doo ; Kim, Jun Hyung ; Ko, Sung-Jea. / Efficient frame error concealment using bilateral motion estimation for low bit-rate video transmission. In: IEICE Transactions on Communications. 2009 ; Vol. E92-B, No. 2. pp. 461-472.
@article{177e11de10fd4f49b4e9de3bcf7b10c4,
title = "Efficient frame error concealment using bilateral motion estimation for low bit-rate video transmission",
abstract = "In low bit-rate video transmission, the payload of a single packet can often contain a whole coded frame due to the high compression ratio in both spatial and temporal domains. Thus, the loss of a single packet can lead to the loss of a whole video frame. In this paper, we propose a novel error concealment algorithm that can effectively reconstruct the lost frame and protect the quality of video streams from the degradation caused by propagation errors. The proposed algorithm employs a bilateral motion estimation scheme where the weighted sum of the received motion vectors (MVs) in the neighboring frames is utilized to construct the MV field for the concealed frame. Unlike the conventional algorithms, the proposed scheme does not produce any overlapped pixel and hole region in the reconstructed frame. The proposed algorithm can be applied not only to the case of single frame loss but also adaptively extended to the case of multiframe loss. Experimental results show that the proposed algorithm outperforms other conventional techniques in terms of both peak signal-to-noise ratio (PSNR) performance and subjective visual quality.",
keywords = "Frame error concealment, Low bit-rate video transmission, Multiframe loss, Video restoration",
author = "Dinhtrieu Duong and Hwang, {Min Cheol} and Choi, {Byeong Doo} and Kim, {Jun Hyung} and Sung-Jea Ko",
year = "2009",
month = "1",
day = "1",
doi = "10.1587/transcom.E92.B.461",
language = "English",
volume = "E92-B",
pages = "461--472",
journal = "IEICE Transactions on Communications",
issn = "0916-8516",
publisher = "Maruzen Co., Ltd/Maruzen Kabushikikaisha",
number = "2",

}

TY - JOUR

T1 - Efficient frame error concealment using bilateral motion estimation for low bit-rate video transmission

AU - Duong, Dinhtrieu

AU - Hwang, Min Cheol

AU - Choi, Byeong Doo

AU - Kim, Jun Hyung

AU - Ko, Sung-Jea

PY - 2009/1/1

Y1 - 2009/1/1

N2 - In low bit-rate video transmission, the payload of a single packet can often contain a whole coded frame due to the high compression ratio in both spatial and temporal domains. Thus, the loss of a single packet can lead to the loss of a whole video frame. In this paper, we propose a novel error concealment algorithm that can effectively reconstruct the lost frame and protect the quality of video streams from the degradation caused by propagation errors. The proposed algorithm employs a bilateral motion estimation scheme where the weighted sum of the received motion vectors (MVs) in the neighboring frames is utilized to construct the MV field for the concealed frame. Unlike the conventional algorithms, the proposed scheme does not produce any overlapped pixel and hole region in the reconstructed frame. The proposed algorithm can be applied not only to the case of single frame loss but also adaptively extended to the case of multiframe loss. Experimental results show that the proposed algorithm outperforms other conventional techniques in terms of both peak signal-to-noise ratio (PSNR) performance and subjective visual quality.

AB - In low bit-rate video transmission, the payload of a single packet can often contain a whole coded frame due to the high compression ratio in both spatial and temporal domains. Thus, the loss of a single packet can lead to the loss of a whole video frame. In this paper, we propose a novel error concealment algorithm that can effectively reconstruct the lost frame and protect the quality of video streams from the degradation caused by propagation errors. The proposed algorithm employs a bilateral motion estimation scheme where the weighted sum of the received motion vectors (MVs) in the neighboring frames is utilized to construct the MV field for the concealed frame. Unlike the conventional algorithms, the proposed scheme does not produce any overlapped pixel and hole region in the reconstructed frame. The proposed algorithm can be applied not only to the case of single frame loss but also adaptively extended to the case of multiframe loss. Experimental results show that the proposed algorithm outperforms other conventional techniques in terms of both peak signal-to-noise ratio (PSNR) performance and subjective visual quality.

KW - Frame error concealment

KW - Low bit-rate video transmission

KW - Multiframe loss

KW - Video restoration

UR - http://www.scopus.com/inward/record.url?scp=77956573358&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=77956573358&partnerID=8YFLogxK

U2 - 10.1587/transcom.E92.B.461

DO - 10.1587/transcom.E92.B.461

M3 - Article

VL - E92-B

SP - 461

EP - 472

JO - IEICE Transactions on Communications

JF - IEICE Transactions on Communications

SN - 0916-8516

IS - 2

ER -