Content-aware image and video resizing based on frequency domain analysis

Jun Seong Kim, Seong Gyun Jeong, Younghun Joo, Chang-Su Kim

Research output: Contribution to journalArticle

15 Citations (Scopus)

Abstract

An adaptive image and video resizing algorithm based on the frequency domain analysis is proposed in this work. Given an image, we first construct an importance map by combining the gradient and the saliency information. We partition the image into several strips so that each strip contains pixels of similar importance levels. We model the distortion, which is caused by scaling a strip, in the frequency domain. Then, we scale each strip adaptively to minimize the overall distortion of the whole image. Moreover, we extend the proposed algorithm for video resizing. We add the motion term to construct the importance map, and suppress excessive parameter variations to achieve jitter-free video resizing. Simulation results show that the proposed algorithm provides higher quality resizing results than conventional algorithms, although it requires lower computational complexity.

Original languageEnglish
Article number5955199
Pages (from-to)615-622
Number of pages8
JournalIEEE Transactions on Consumer Electronics
Volume57
Issue number2
DOIs
Publication statusPublished - 2011 May 1

Fingerprint

Frequency domain analysis
Jitter
Computational complexity
Pixels

Keywords

  • Fourier analysis
  • Image and video retargeting
  • Lagrangian multiplier technique
  • salience map

ASJC Scopus subject areas

  • Electrical and Electronic Engineering
  • Media Technology

Cite this

Content-aware image and video resizing based on frequency domain analysis. / Kim, Jun Seong; Jeong, Seong Gyun; Joo, Younghun; Kim, Chang-Su.

In: IEEE Transactions on Consumer Electronics, Vol. 57, No. 2, 5955199, 01.05.2011, p. 615-622.

Research output: Contribution to journalArticle

Kim, Jun Seong ; Jeong, Seong Gyun ; Joo, Younghun ; Kim, Chang-Su. / Content-aware image and video resizing based on frequency domain analysis. In: IEEE Transactions on Consumer Electronics. 2011 ; Vol. 57, No. 2. pp. 615-622.
@article{5077d8e718654c63892d1e1de87082ed,
title = "Content-aware image and video resizing based on frequency domain analysis",
abstract = "An adaptive image and video resizing algorithm based on the frequency domain analysis is proposed in this work. Given an image, we first construct an importance map by combining the gradient and the saliency information. We partition the image into several strips so that each strip contains pixels of similar importance levels. We model the distortion, which is caused by scaling a strip, in the frequency domain. Then, we scale each strip adaptively to minimize the overall distortion of the whole image. Moreover, we extend the proposed algorithm for video resizing. We add the motion term to construct the importance map, and suppress excessive parameter variations to achieve jitter-free video resizing. Simulation results show that the proposed algorithm provides higher quality resizing results than conventional algorithms, although it requires lower computational complexity.",
keywords = "Fourier analysis, Image and video retargeting, Lagrangian multiplier technique, salience map",
author = "Kim, {Jun Seong} and Jeong, {Seong Gyun} and Younghun Joo and Chang-Su Kim",
year = "2011",
month = "5",
day = "1",
doi = "10.1109/TCE.2011.5955199",
language = "English",
volume = "57",
pages = "615--622",
journal = "IEEE Transactions on Consumer Electronics",
issn = "0098-3063",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
number = "2",

}

TY - JOUR

T1 - Content-aware image and video resizing based on frequency domain analysis

AU - Kim, Jun Seong

AU - Jeong, Seong Gyun

AU - Joo, Younghun

AU - Kim, Chang-Su

PY - 2011/5/1

Y1 - 2011/5/1

N2 - An adaptive image and video resizing algorithm based on the frequency domain analysis is proposed in this work. Given an image, we first construct an importance map by combining the gradient and the saliency information. We partition the image into several strips so that each strip contains pixels of similar importance levels. We model the distortion, which is caused by scaling a strip, in the frequency domain. Then, we scale each strip adaptively to minimize the overall distortion of the whole image. Moreover, we extend the proposed algorithm for video resizing. We add the motion term to construct the importance map, and suppress excessive parameter variations to achieve jitter-free video resizing. Simulation results show that the proposed algorithm provides higher quality resizing results than conventional algorithms, although it requires lower computational complexity.

AB - An adaptive image and video resizing algorithm based on the frequency domain analysis is proposed in this work. Given an image, we first construct an importance map by combining the gradient and the saliency information. We partition the image into several strips so that each strip contains pixels of similar importance levels. We model the distortion, which is caused by scaling a strip, in the frequency domain. Then, we scale each strip adaptively to minimize the overall distortion of the whole image. Moreover, we extend the proposed algorithm for video resizing. We add the motion term to construct the importance map, and suppress excessive parameter variations to achieve jitter-free video resizing. Simulation results show that the proposed algorithm provides higher quality resizing results than conventional algorithms, although it requires lower computational complexity.

KW - Fourier analysis

KW - Image and video retargeting

KW - Lagrangian multiplier technique

KW - salience map

UR - http://www.scopus.com/inward/record.url?scp=79960928989&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=79960928989&partnerID=8YFLogxK

U2 - 10.1109/TCE.2011.5955199

DO - 10.1109/TCE.2011.5955199

M3 - Article

AN - SCOPUS:79960928989

VL - 57

SP - 615

EP - 622

JO - IEEE Transactions on Consumer Electronics

JF - IEEE Transactions on Consumer Electronics

SN - 0098-3063

IS - 2

M1 - 5955199

ER -