Deep Learning-Based Deblur Using Gyroscope Data

Jeongmin Lee, Seo Won Ji, Sung Jin Cho, Jun Pyo Hong, Sung Jea Ko

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Global scene blur of an image is caused by the movement of a camera during the exposure time, thus camera motion is one of the key factors in identifying blur artifacts. Among various sensors that can be utilized while taking a picture in a mobile environment, a gyroscope sensor is useful for deblurring tasks, because rotational velocities measured from the gyroscope can be processed to estimate the camera motion. For enhancement of deblurring performance in a mobile environment with an additional gyroscope sensor, this paper presents a method of using gyroscope data in a deep learning-based deblur network. The proposed method calculates homography matrices from the gyroscope data and warps the input image to imitate the camera motion. The stack of warped images aligns blur artifacts caused by camera movement channel-wise, and the network is trained to use image features related to the direction and magnitude of the blur. The proposed method shows superior performance in cases of both subtle and severe blur conditions compared to conventional gyroscope-aided deblurring network.

Original languageEnglish
Title of host publication2020 IEEE International Conference on Consumer Electronics - Asia, ICCE-Asia 2020
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781728161648
DOIs
Publication statusPublished - 2020 Nov 1
Event2020 IEEE International Conference on Consumer Electronics - Asia, ICCE-Asia 2020 - Seoul, Korea, Republic of
Duration: 2020 Nov 12020 Nov 3

Publication series

Name2020 IEEE International Conference on Consumer Electronics - Asia, ICCE-Asia 2020

Conference

Conference2020 IEEE International Conference on Consumer Electronics - Asia, ICCE-Asia 2020
CountryKorea, Republic of
CitySeoul
Period20/11/120/11/3

Keywords

  • Deblur
  • Gyroscope
  • Homography

ASJC Scopus subject areas

  • Computer Science Applications
  • Electrical and Electronic Engineering
  • Media Technology
  • Instrumentation

Fingerprint Dive into the research topics of 'Deep Learning-Based Deblur Using Gyroscope Data'. Together they form a unique fingerprint.

Cite this