Content-preserving video stitching method for multi-camera systems

Bo Sang Kim, Kang A. Choi, Won Jae Park, Seung Wook Kim, Sung-Jea Ko

Research output: Contribution to journalArticle

3 Citations (Scopus)

Abstract

In this paper, a novel content-preserving video stitching method is proposed. Video stitching has to deal with moving objects in the overlapped area (OA) which often cause problems of structural misalignment or ghost effect. To this end, the proposed method first finds an optimal seam that does not pass through the moving objects, by using the extended dynamic programing (DP) technique based on the energy minimization. Then the content-aware adaptive blending is performed which effectively reduces the color discontinuity while restricting the ghost effect caused by moving objects in the OA. In addition, to reduce the computational complexity, a partial seam-update (PSU) scheme is proposed, in which the seam is re-calculated only for a part of the seam passing through the moving object. Experimental results demonstrate that the proposed method is superior to the conventional ones in terms of both subjective quality and computational complexity. In addition, this method achieves real-time performance on mobile platform, making it applicable to consumer electronic devices.

Original languageEnglish
Article number8013249
Pages (from-to)109-116
Number of pages8
JournalIEEE Transactions on Consumer Electronics
Volume63
Issue number2
DOIs
Publication statusPublished - 2017 May 1

Fingerprint

Computational complexity
Cameras
Consumer electronics
Color

Keywords

  • content-preserving
  • Multi-camera systems
  • partial seam-updating
  • seam-finding
  • video stitching

ASJC Scopus subject areas

  • Media Technology
  • Electrical and Electronic Engineering

Cite this

Content-preserving video stitching method for multi-camera systems. / Kim, Bo Sang; Choi, Kang A.; Park, Won Jae; Kim, Seung Wook; Ko, Sung-Jea.

In: IEEE Transactions on Consumer Electronics, Vol. 63, No. 2, 8013249, 01.05.2017, p. 109-116.

Research output: Contribution to journalArticle

Kim, Bo Sang ; Choi, Kang A. ; Park, Won Jae ; Kim, Seung Wook ; Ko, Sung-Jea. / Content-preserving video stitching method for multi-camera systems. In: IEEE Transactions on Consumer Electronics. 2017 ; Vol. 63, No. 2. pp. 109-116.
@article{cca61ab2ee654a978ebd0fa11b44ba09,
title = "Content-preserving video stitching method for multi-camera systems",
abstract = "In this paper, a novel content-preserving video stitching method is proposed. Video stitching has to deal with moving objects in the overlapped area (OA) which often cause problems of structural misalignment or ghost effect. To this end, the proposed method first finds an optimal seam that does not pass through the moving objects, by using the extended dynamic programing (DP) technique based on the energy minimization. Then the content-aware adaptive blending is performed which effectively reduces the color discontinuity while restricting the ghost effect caused by moving objects in the OA. In addition, to reduce the computational complexity, a partial seam-update (PSU) scheme is proposed, in which the seam is re-calculated only for a part of the seam passing through the moving object. Experimental results demonstrate that the proposed method is superior to the conventional ones in terms of both subjective quality and computational complexity. In addition, this method achieves real-time performance on mobile platform, making it applicable to consumer electronic devices.",
keywords = "content-preserving, Multi-camera systems, partial seam-updating, seam-finding, video stitching",
author = "Kim, {Bo Sang} and Choi, {Kang A.} and Park, {Won Jae} and Kim, {Seung Wook} and Sung-Jea Ko",
year = "2017",
month = "5",
day = "1",
doi = "10.1109/TCE.2017.014841",
language = "English",
volume = "63",
pages = "109--116",
journal = "IEEE Transactions on Consumer Electronics",
issn = "0098-3063",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
number = "2",

}

TY - JOUR

T1 - Content-preserving video stitching method for multi-camera systems

AU - Kim, Bo Sang

AU - Choi, Kang A.

AU - Park, Won Jae

AU - Kim, Seung Wook

AU - Ko, Sung-Jea

PY - 2017/5/1

Y1 - 2017/5/1

N2 - In this paper, a novel content-preserving video stitching method is proposed. Video stitching has to deal with moving objects in the overlapped area (OA) which often cause problems of structural misalignment or ghost effect. To this end, the proposed method first finds an optimal seam that does not pass through the moving objects, by using the extended dynamic programing (DP) technique based on the energy minimization. Then the content-aware adaptive blending is performed which effectively reduces the color discontinuity while restricting the ghost effect caused by moving objects in the OA. In addition, to reduce the computational complexity, a partial seam-update (PSU) scheme is proposed, in which the seam is re-calculated only for a part of the seam passing through the moving object. Experimental results demonstrate that the proposed method is superior to the conventional ones in terms of both subjective quality and computational complexity. In addition, this method achieves real-time performance on mobile platform, making it applicable to consumer electronic devices.

AB - In this paper, a novel content-preserving video stitching method is proposed. Video stitching has to deal with moving objects in the overlapped area (OA) which often cause problems of structural misalignment or ghost effect. To this end, the proposed method first finds an optimal seam that does not pass through the moving objects, by using the extended dynamic programing (DP) technique based on the energy minimization. Then the content-aware adaptive blending is performed which effectively reduces the color discontinuity while restricting the ghost effect caused by moving objects in the OA. In addition, to reduce the computational complexity, a partial seam-update (PSU) scheme is proposed, in which the seam is re-calculated only for a part of the seam passing through the moving object. Experimental results demonstrate that the proposed method is superior to the conventional ones in terms of both subjective quality and computational complexity. In addition, this method achieves real-time performance on mobile platform, making it applicable to consumer electronic devices.

KW - content-preserving

KW - Multi-camera systems

KW - partial seam-updating

KW - seam-finding

KW - video stitching

UR - http://www.scopus.com/inward/record.url?scp=85028941017&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85028941017&partnerID=8YFLogxK

U2 - 10.1109/TCE.2017.014841

DO - 10.1109/TCE.2017.014841

M3 - Article

AN - SCOPUS:85028941017

VL - 63

SP - 109

EP - 116

JO - IEEE Transactions on Consumer Electronics

JF - IEEE Transactions on Consumer Electronics

SN - 0098-3063

IS - 2

M1 - 8013249

ER -