TY - JOUR
T1 - Frame loss concealment for stereoscopic video plus depth sequences
AU - Chung, Tae Young
AU - Sull, Sanghoon
AU - Kim, Chang-Su
N1 - Funding Information:
This work was supported partly by Basic Science Research Program through the National Research Foundation of Korea funded by the Ministry of Education, Science and Technology (2009-0090003), and partly by the Ministry of Knowledge Economy, Korea, under the ITRC support program supervised by the NIPA (NIPA-2010-C1090-1011-0003).
PY - 2011/8
Y1 - 2011/8
N2 - In this work, an efficient frame loss concealment algorithm for stereoscopic video plus depth sequences is proposed. To conceal an erroneous left color frame, we extrapolate motion vectors for the temporal error concealment. To conceal a left depth frame, we exploit the motion vectors of the corresponding left color frame. To conceal a right color frame, we employ a 3D image warping technique to determine matching pixels between inter-views, and perform the reconstruction based on the similarities of the motion vectors and the intensity differences of matching pixels. Finally, to conceal a right depth frame, we use the motion vectors of the right color frame and the left color frame. Simulation results show that the proposed algorithm is more effective than conventional algorithms in recovering erroneous color and depth frames. Moreover, it is also demonstrated that the proposed algorithm can be used for efficient virtual view synthesis in error prone environments.ǎ
AB - In this work, an efficient frame loss concealment algorithm for stereoscopic video plus depth sequences is proposed. To conceal an erroneous left color frame, we extrapolate motion vectors for the temporal error concealment. To conceal a left depth frame, we exploit the motion vectors of the corresponding left color frame. To conceal a right color frame, we employ a 3D image warping technique to determine matching pixels between inter-views, and perform the reconstruction based on the similarities of the motion vectors and the intensity differences of matching pixels. Finally, to conceal a right depth frame, we use the motion vectors of the right color frame and the left color frame. Simulation results show that the proposed algorithm is more effective than conventional algorithms in recovering erroneous color and depth frames. Moreover, it is also demonstrated that the proposed algorithm can be used for efficient virtual view synthesis in error prone environments.ǎ
KW - 3D image warping
KW - 3D video warping
KW - frameconcealment
KW - multi-view video
KW - video plus depth sequence
UR - http://www.scopus.com/inward/record.url?scp=80052934378&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=80052934378&partnerID=8YFLogxK
U2 - 10.1109/TCE.2011.6018892
DO - 10.1109/TCE.2011.6018892
M3 - Article
AN - SCOPUS:80052934378
VL - 57
SP - 1336
EP - 1344
JO - IEEE Transactions on Consumer Electronics
JF - IEEE Transactions on Consumer Electronics
SN - 0098-3063
IS - 3
M1 - 6018892
ER -