Reflection Removal under Fast Forward Camera Motion

Jun Young Cheong, Christian Simon, Chang-Su Kim, In Kyu Park

Research output: Contribution to journalArticle

2 Citations (Scopus)


The image quality of an in-vehicle black box camera is often degraded by reflections of internal objects, dirt, and dust on the windshield. In this paper, we propose a novel algorithm that simultaneously removes the reflections and small dirt artifacts from in-vehicle black box videos under fast forward camera motion. The algorithm exploits the spatiotemporal coherence of the reflection and dirt, which remain stationary relative to the fast-moving background. Unlike previous algorithms, the algorithm first separates stationary reflection and then restores the background scene. To this end, we propose an average image prior, thereby imposing spatiotemporal coherence. The separation model is a two-layer model composed of stationary and background layers, where different gradient sparsity distributions are utilized in a region-based manner. Motion compensation in postprocessing is proposed to alleviate layer jitter due to vehicle vibrations. In evaluation experiments, the proposed algorithm successfully extracts the stationary layer from several real and synthetic black box videos.

Original languageEnglish
JournalIEEE Transactions on Image Processing
Publication statusAccepted/In press - 2017 Aug 31



  • Automobiles
  • Automotive components
  • average image prior
  • Black box camera
  • Cameras
  • dirt removal
  • fast forward motion
  • Glass
  • Image reconstruction
  • layer separation
  • Optical imaging
  • reflection removal
  • Videos

ASJC Scopus subject areas

  • Software
  • Medicine(all)
  • Computer Graphics and Computer-Aided Design

Cite this