Robust digital image stabilization using the Kalman filter

Chuntao Wang, Jin Hyung Kim, Keun Yung Byun, Jiangqun Ni, Sung-Jea Ko

Research output: Contribution to journalArticle

75 Citations (Scopus)

Abstract

In this paper, we present a new digital image stabilization (DIS) algorithm based on feature point tracking. Feature points well tracked by the Kanade-Lucas-Tomasi (KLT) tracker are used to estimate the global motion between two consecutive image frames. The motion prediction with the Kalman filter (KF) is incorporated into the KLT tracker to further speed up the tracking process. Moreover, we develop an adaptive KF to better handle the intentional motion of the camera. In addition, a new scheme is also proposed to detect the scene change and automatically change the reference frame. Experimental simulation shows that the proposed DIS algorithm has the characteristics of high accuracy, good robustness to different irregular conditions.

Original languageEnglish
Pages (from-to)6-14
Number of pages9
JournalIEEE Transactions on Consumer Electronics
Volume55
Issue number1
DOIs
Publication statusPublished - 2009 May 25

Fingerprint

Kalman filters
Stabilization
Cameras

Keywords

  • Adaptive Kalman filter
  • Digital image stabilization (DIS)
  • Feature point tracking
  • KLT tracker
  • Scene change

ASJC Scopus subject areas

  • Electrical and Electronic Engineering
  • Media Technology

Cite this

Robust digital image stabilization using the Kalman filter. / Wang, Chuntao; Kim, Jin Hyung; Byun, Keun Yung; Ni, Jiangqun; Ko, Sung-Jea.

In: IEEE Transactions on Consumer Electronics, Vol. 55, No. 1, 25.05.2009, p. 6-14.

Research output: Contribution to journalArticle

Wang, Chuntao ; Kim, Jin Hyung ; Byun, Keun Yung ; Ni, Jiangqun ; Ko, Sung-Jea. / Robust digital image stabilization using the Kalman filter. In: IEEE Transactions on Consumer Electronics. 2009 ; Vol. 55, No. 1. pp. 6-14.
@article{c1ef3280faa948c5ad539361418d3946,
title = "Robust digital image stabilization using the Kalman filter",
abstract = "In this paper, we present a new digital image stabilization (DIS) algorithm based on feature point tracking. Feature points well tracked by the Kanade-Lucas-Tomasi (KLT) tracker are used to estimate the global motion between two consecutive image frames. The motion prediction with the Kalman filter (KF) is incorporated into the KLT tracker to further speed up the tracking process. Moreover, we develop an adaptive KF to better handle the intentional motion of the camera. In addition, a new scheme is also proposed to detect the scene change and automatically change the reference frame. Experimental simulation shows that the proposed DIS algorithm has the characteristics of high accuracy, good robustness to different irregular conditions.",
keywords = "Adaptive Kalman filter, Digital image stabilization (DIS), Feature point tracking, KLT tracker, Scene change",
author = "Chuntao Wang and Kim, {Jin Hyung} and Byun, {Keun Yung} and Jiangqun Ni and Sung-Jea Ko",
year = "2009",
month = "5",
day = "25",
doi = "10.1109/TCE.2009.4814407",
language = "English",
volume = "55",
pages = "6--14",
journal = "IEEE Transactions on Consumer Electronics",
issn = "0098-3063",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
number = "1",

}

TY - JOUR

T1 - Robust digital image stabilization using the Kalman filter

AU - Wang, Chuntao

AU - Kim, Jin Hyung

AU - Byun, Keun Yung

AU - Ni, Jiangqun

AU - Ko, Sung-Jea

PY - 2009/5/25

Y1 - 2009/5/25

N2 - In this paper, we present a new digital image stabilization (DIS) algorithm based on feature point tracking. Feature points well tracked by the Kanade-Lucas-Tomasi (KLT) tracker are used to estimate the global motion between two consecutive image frames. The motion prediction with the Kalman filter (KF) is incorporated into the KLT tracker to further speed up the tracking process. Moreover, we develop an adaptive KF to better handle the intentional motion of the camera. In addition, a new scheme is also proposed to detect the scene change and automatically change the reference frame. Experimental simulation shows that the proposed DIS algorithm has the characteristics of high accuracy, good robustness to different irregular conditions.

AB - In this paper, we present a new digital image stabilization (DIS) algorithm based on feature point tracking. Feature points well tracked by the Kanade-Lucas-Tomasi (KLT) tracker are used to estimate the global motion between two consecutive image frames. The motion prediction with the Kalman filter (KF) is incorporated into the KLT tracker to further speed up the tracking process. Moreover, we develop an adaptive KF to better handle the intentional motion of the camera. In addition, a new scheme is also proposed to detect the scene change and automatically change the reference frame. Experimental simulation shows that the proposed DIS algorithm has the characteristics of high accuracy, good robustness to different irregular conditions.

KW - Adaptive Kalman filter

KW - Digital image stabilization (DIS)

KW - Feature point tracking

KW - KLT tracker

KW - Scene change

UR - http://www.scopus.com/inward/record.url?scp=65649124171&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=65649124171&partnerID=8YFLogxK

U2 - 10.1109/TCE.2009.4814407

DO - 10.1109/TCE.2009.4814407

M3 - Article

VL - 55

SP - 6

EP - 14

JO - IEEE Transactions on Consumer Electronics

JF - IEEE Transactions on Consumer Electronics

SN - 0098-3063

IS - 1

ER -