Robust MMSE video decoding: Theory and practical implementations

Chang-Su Kim, Jongwon Kim, Ioannis Katsavounidis, C. C. Jay Kuo

Research output: Contribution to journalArticle

9 Citations (Scopus)

Abstract

A novel video decoding algorithm based on the minimum mean square error (MMSE) criterion is investigated in this research. To alleviate the effect of transmission errors, we first develop an error propagation model to estimate and track the mean square error (MSE) of each pixel in the decoder. Then, the proposed video decoding algorithm adjusts the reconstruction of each pixel adaptively according to fluctuating channel conditions. More specifically, the decoder reconstructs a pixel in the kth frame Fk by using a weighted sum of two pixels in frames Fk-1 and Fk-2, respectively, where their weights are adaptively selected to minimize the MSE of the reconstructed pixel by using the error propagation model. Extensive simulation results performed on standard H.263 bit streams demonstrate that the MMSE-based concealment algorithm yields a better performance than the conventional method, even if the encoder transmits a single motion vector per block. Moreover, the proposed MMSE decoding algorithm significantly enhances the error resilient capability of the double-vector motion compensation (DMC) algorithm, where two motion vectors are sent per block.

Original languageEnglish
Pages (from-to)39-50
Number of pages12
JournalIEEE Transactions on Circuits and Systems for Video Technology
Volume15
Issue number1
DOIs
Publication statusPublished - 2005 Jan 1
Externally publishedYes

Fingerprint

Mean square error
Decoding
Pixels
Motion compensation

Keywords

  • Double-vector motion compensation
  • Error concealment
  • H.263
  • Minimum mean square error (MMSE) decoding
  • Robust video transmission

ASJC Scopus subject areas

  • Electrical and Electronic Engineering

Cite this

Robust MMSE video decoding : Theory and practical implementations. / Kim, Chang-Su; Kim, Jongwon; Katsavounidis, Ioannis; Jay Kuo, C. C.

In: IEEE Transactions on Circuits and Systems for Video Technology, Vol. 15, No. 1, 01.01.2005, p. 39-50.

Research output: Contribution to journalArticle

Kim, Chang-Su ; Kim, Jongwon ; Katsavounidis, Ioannis ; Jay Kuo, C. C. / Robust MMSE video decoding : Theory and practical implementations. In: IEEE Transactions on Circuits and Systems for Video Technology. 2005 ; Vol. 15, No. 1. pp. 39-50.
@article{8039a7c1dd7b46cca3cf4dcad4445af9,
title = "Robust MMSE video decoding: Theory and practical implementations",
abstract = "A novel video decoding algorithm based on the minimum mean square error (MMSE) criterion is investigated in this research. To alleviate the effect of transmission errors, we first develop an error propagation model to estimate and track the mean square error (MSE) of each pixel in the decoder. Then, the proposed video decoding algorithm adjusts the reconstruction of each pixel adaptively according to fluctuating channel conditions. More specifically, the decoder reconstructs a pixel in the kth frame Fk by using a weighted sum of two pixels in frames Fk-1 and Fk-2, respectively, where their weights are adaptively selected to minimize the MSE of the reconstructed pixel by using the error propagation model. Extensive simulation results performed on standard H.263 bit streams demonstrate that the MMSE-based concealment algorithm yields a better performance than the conventional method, even if the encoder transmits a single motion vector per block. Moreover, the proposed MMSE decoding algorithm significantly enhances the error resilient capability of the double-vector motion compensation (DMC) algorithm, where two motion vectors are sent per block.",
keywords = "Double-vector motion compensation, Error concealment, H.263, Minimum mean square error (MMSE) decoding, Robust video transmission",
author = "Chang-Su Kim and Jongwon Kim and Ioannis Katsavounidis and {Jay Kuo}, {C. C.}",
year = "2005",
month = "1",
day = "1",
doi = "10.1109/TCSVT.2004.839994",
language = "English",
volume = "15",
pages = "39--50",
journal = "IEEE Transactions on Circuits and Systems for Video Technology",
issn = "1051-8215",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
number = "1",

}

TY - JOUR

T1 - Robust MMSE video decoding

T2 - Theory and practical implementations

AU - Kim, Chang-Su

AU - Kim, Jongwon

AU - Katsavounidis, Ioannis

AU - Jay Kuo, C. C.

PY - 2005/1/1

Y1 - 2005/1/1

N2 - A novel video decoding algorithm based on the minimum mean square error (MMSE) criterion is investigated in this research. To alleviate the effect of transmission errors, we first develop an error propagation model to estimate and track the mean square error (MSE) of each pixel in the decoder. Then, the proposed video decoding algorithm adjusts the reconstruction of each pixel adaptively according to fluctuating channel conditions. More specifically, the decoder reconstructs a pixel in the kth frame Fk by using a weighted sum of two pixels in frames Fk-1 and Fk-2, respectively, where their weights are adaptively selected to minimize the MSE of the reconstructed pixel by using the error propagation model. Extensive simulation results performed on standard H.263 bit streams demonstrate that the MMSE-based concealment algorithm yields a better performance than the conventional method, even if the encoder transmits a single motion vector per block. Moreover, the proposed MMSE decoding algorithm significantly enhances the error resilient capability of the double-vector motion compensation (DMC) algorithm, where two motion vectors are sent per block.

AB - A novel video decoding algorithm based on the minimum mean square error (MMSE) criterion is investigated in this research. To alleviate the effect of transmission errors, we first develop an error propagation model to estimate and track the mean square error (MSE) of each pixel in the decoder. Then, the proposed video decoding algorithm adjusts the reconstruction of each pixel adaptively according to fluctuating channel conditions. More specifically, the decoder reconstructs a pixel in the kth frame Fk by using a weighted sum of two pixels in frames Fk-1 and Fk-2, respectively, where their weights are adaptively selected to minimize the MSE of the reconstructed pixel by using the error propagation model. Extensive simulation results performed on standard H.263 bit streams demonstrate that the MMSE-based concealment algorithm yields a better performance than the conventional method, even if the encoder transmits a single motion vector per block. Moreover, the proposed MMSE decoding algorithm significantly enhances the error resilient capability of the double-vector motion compensation (DMC) algorithm, where two motion vectors are sent per block.

KW - Double-vector motion compensation

KW - Error concealment

KW - H.263

KW - Minimum mean square error (MMSE) decoding

KW - Robust video transmission

UR - http://www.scopus.com/inward/record.url?scp=12344329319&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=12344329319&partnerID=8YFLogxK

U2 - 10.1109/TCSVT.2004.839994

DO - 10.1109/TCSVT.2004.839994

M3 - Article

AN - SCOPUS:12344329319

VL - 15

SP - 39

EP - 50

JO - IEEE Transactions on Circuits and Systems for Video Technology

JF - IEEE Transactions on Circuits and Systems for Video Technology

SN - 1051-8215

IS - 1

ER -