Abstract
In this work, an efficient frame loss concealment algorithm for stereoscopic video plus depth sequences is proposed. To conceal an erroneous left color frame, we extrapolate motion vectors for the temporal error concealment. To conceal a left depth frame, we exploit the motion vectors of the corresponding left color frame. To conceal a right color frame, we employ a 3D image warping technique to determine matching pixels between inter-views, and perform the reconstruction based on the similarities of the motion vectors and the intensity differences of matching pixels. Finally, to conceal a right depth frame, we use the motion vectors of the right color frame and the left color frame. Simulation results show that the proposed algorithm is more effective than conventional algorithms in recovering erroneous color and depth frames. Moreover, it is also demonstrated that the proposed algorithm can be used for efficient virtual view synthesis in error prone environments.ǎ
| Original language | English |
|---|---|
| Article number | 6018892 |
| Pages (from-to) | 1336-1344 |
| Number of pages | 9 |
| Journal | IEEE Transactions on Consumer Electronics |
| Volume | 57 |
| Issue number | 3 |
| DOIs | |
| Publication status | Published - 2011 Aug 1 |
Fingerprint
Keywords
- 3D image warping
- 3D video warping
- frameconcealment
- multi-view video
- video plus depth sequence
ASJC Scopus subject areas
- Electrical and Electronic Engineering
- Media Technology
Cite this
Frame loss concealment for stereoscopic video plus depth sequences. / Chung, Tae Young; Sull, Sanghoon; Kim, Chang-Su.
In: IEEE Transactions on Consumer Electronics, Vol. 57, No. 3, 6018892, 01.08.2011, p. 1336-1344.Research output: Contribution to journal › Article
}
TY - JOUR
T1 - Frame loss concealment for stereoscopic video plus depth sequences
AU - Chung, Tae Young
AU - Sull, Sanghoon
AU - Kim, Chang-Su
PY - 2011/8/1
Y1 - 2011/8/1
N2 - In this work, an efficient frame loss concealment algorithm for stereoscopic video plus depth sequences is proposed. To conceal an erroneous left color frame, we extrapolate motion vectors for the temporal error concealment. To conceal a left depth frame, we exploit the motion vectors of the corresponding left color frame. To conceal a right color frame, we employ a 3D image warping technique to determine matching pixels between inter-views, and perform the reconstruction based on the similarities of the motion vectors and the intensity differences of matching pixels. Finally, to conceal a right depth frame, we use the motion vectors of the right color frame and the left color frame. Simulation results show that the proposed algorithm is more effective than conventional algorithms in recovering erroneous color and depth frames. Moreover, it is also demonstrated that the proposed algorithm can be used for efficient virtual view synthesis in error prone environments.ǎ
AB - In this work, an efficient frame loss concealment algorithm for stereoscopic video plus depth sequences is proposed. To conceal an erroneous left color frame, we extrapolate motion vectors for the temporal error concealment. To conceal a left depth frame, we exploit the motion vectors of the corresponding left color frame. To conceal a right color frame, we employ a 3D image warping technique to determine matching pixels between inter-views, and perform the reconstruction based on the similarities of the motion vectors and the intensity differences of matching pixels. Finally, to conceal a right depth frame, we use the motion vectors of the right color frame and the left color frame. Simulation results show that the proposed algorithm is more effective than conventional algorithms in recovering erroneous color and depth frames. Moreover, it is also demonstrated that the proposed algorithm can be used for efficient virtual view synthesis in error prone environments.ǎ
KW - 3D image warping
KW - 3D video warping
KW - frameconcealment
KW - multi-view video
KW - video plus depth sequence
UR - http://www.scopus.com/inward/record.url?scp=80052934378&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=80052934378&partnerID=8YFLogxK
U2 - 10.1109/TCE.2011.6018892
DO - 10.1109/TCE.2011.6018892
M3 - Article
VL - 57
SP - 1336
EP - 1344
JO - IEEE Transactions on Consumer Electronics
JF - IEEE Transactions on Consumer Electronics
SN - 0098-3063
IS - 3
M1 - 6018892
ER -