Advanced digital image stabilization using similarity-constrained optimization

Dong Sung Pae, Chi Gun An, Tae Koo Kang, Myo Taeg Lim

Research output: Contribution to journalArticle

Abstract

As many people have portable video devices such as cameras on cell phones and camcorders, image stabilization technique is a crucial and challenging task in computer vision applications, and many image stabilization techniques have been researched over many years. We propose a digital image stabilization method that only uses a software algorithm without additional hardware devices. Furthermore, a novel digital image stabilization method composed of three steps that use similarity-constrained nonlinear optimizer is introduced and applied to many unstabilized videos. First, a feature detection technique called moment-based speeded-up robust features (MSURF) is utilized to obtain the transformation matrix. Second, the k-means clustering algorithm is used to detect and remove some of the outliers that cause residual errors during feature matching. Third, the transformation matrix is optimized using nonlinear optimization algorithms to maintain the similarity of the transformation matrix. The experimental results prove that the proposed algorithm provides accurate image stabilization performance.

Original languageEnglish
JournalMultimedia Tools and Applications
DOIs
Publication statusAccepted/In press - 2018 Jan 1

Fingerprint

Constrained optimization
Stabilization
Video cameras
Clustering algorithms
Computer vision
Cameras
Hardware

Keywords

  • Image stabilization
  • K-means
  • MSURF

ASJC Scopus subject areas

  • Software
  • Media Technology
  • Hardware and Architecture
  • Computer Networks and Communications

Cite this

Advanced digital image stabilization using similarity-constrained optimization. / Pae, Dong Sung; An, Chi Gun; Kang, Tae Koo; Lim, Myo Taeg.

In: Multimedia Tools and Applications, 01.01.2018.

Research output: Contribution to journalArticle

@article{a7e5c69711694ee9999d42d5720226fb,
title = "Advanced digital image stabilization using similarity-constrained optimization",
abstract = "As many people have portable video devices such as cameras on cell phones and camcorders, image stabilization technique is a crucial and challenging task in computer vision applications, and many image stabilization techniques have been researched over many years. We propose a digital image stabilization method that only uses a software algorithm without additional hardware devices. Furthermore, a novel digital image stabilization method composed of three steps that use similarity-constrained nonlinear optimizer is introduced and applied to many unstabilized videos. First, a feature detection technique called moment-based speeded-up robust features (MSURF) is utilized to obtain the transformation matrix. Second, the k-means clustering algorithm is used to detect and remove some of the outliers that cause residual errors during feature matching. Third, the transformation matrix is optimized using nonlinear optimization algorithms to maintain the similarity of the transformation matrix. The experimental results prove that the proposed algorithm provides accurate image stabilization performance.",
keywords = "Image stabilization, K-means, MSURF",
author = "Pae, {Dong Sung} and An, {Chi Gun} and Kang, {Tae Koo} and Lim, {Myo Taeg}",
year = "2018",
month = "1",
day = "1",
doi = "10.1007/s11042-018-6932-2",
language = "English",
journal = "Multimedia Tools and Applications",
issn = "1380-7501",
publisher = "Springer Netherlands",

}

TY - JOUR

T1 - Advanced digital image stabilization using similarity-constrained optimization

AU - Pae, Dong Sung

AU - An, Chi Gun

AU - Kang, Tae Koo

AU - Lim, Myo Taeg

PY - 2018/1/1

Y1 - 2018/1/1

N2 - As many people have portable video devices such as cameras on cell phones and camcorders, image stabilization technique is a crucial and challenging task in computer vision applications, and many image stabilization techniques have been researched over many years. We propose a digital image stabilization method that only uses a software algorithm without additional hardware devices. Furthermore, a novel digital image stabilization method composed of three steps that use similarity-constrained nonlinear optimizer is introduced and applied to many unstabilized videos. First, a feature detection technique called moment-based speeded-up robust features (MSURF) is utilized to obtain the transformation matrix. Second, the k-means clustering algorithm is used to detect and remove some of the outliers that cause residual errors during feature matching. Third, the transformation matrix is optimized using nonlinear optimization algorithms to maintain the similarity of the transformation matrix. The experimental results prove that the proposed algorithm provides accurate image stabilization performance.

AB - As many people have portable video devices such as cameras on cell phones and camcorders, image stabilization technique is a crucial and challenging task in computer vision applications, and many image stabilization techniques have been researched over many years. We propose a digital image stabilization method that only uses a software algorithm without additional hardware devices. Furthermore, a novel digital image stabilization method composed of three steps that use similarity-constrained nonlinear optimizer is introduced and applied to many unstabilized videos. First, a feature detection technique called moment-based speeded-up robust features (MSURF) is utilized to obtain the transformation matrix. Second, the k-means clustering algorithm is used to detect and remove some of the outliers that cause residual errors during feature matching. Third, the transformation matrix is optimized using nonlinear optimization algorithms to maintain the similarity of the transformation matrix. The experimental results prove that the proposed algorithm provides accurate image stabilization performance.

KW - Image stabilization

KW - K-means

KW - MSURF

UR - http://www.scopus.com/inward/record.url?scp=85058684695&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85058684695&partnerID=8YFLogxK

U2 - 10.1007/s11042-018-6932-2

DO - 10.1007/s11042-018-6932-2

M3 - Article

AN - SCOPUS:85058684695

JO - Multimedia Tools and Applications

JF - Multimedia Tools and Applications

SN - 1380-7501

ER -