Correspondence matching of multi-view video sequences using mutual information based similarity measure

Soon Young Lee, Jae Young Sim, Chang-Su Kim, Sang Uk Lee

Research output: Contribution to journalArticle

19 Citations (Scopus)

Abstract

We propose a correspondence matching algorithm for multi-view video sequences, which provides reliable performance even when the multiple cameras have significantly different parameters, such as viewing angles and positions. We use an activity vector, which represents the temporal occurrence pattern of moving foreground objects at a pixel position, as an invariant feature for correspondence matching. We first devise a novel similarity measure between activity vectors by considering the joint and individual behavior of the activity vectors. Specifically, we define random variables associated with the activity vectors and measure their similarity using the mutual information between the random variables. Moreover, to find a reliable homography transform between views, we find consistent pixel positions by employing the iterative bidirectional matching. We also refine the matching results of multiple source pixel positions by minimizing a matching cost function based on the Markov random field. Experimental results show that the proposed algorithm provides more accurate and reliable matching performance than the conventional activity-based and feature-based matching algorithms, and therefore can facilitate various applications of visual sensor networks.

Original languageEnglish
Article number6553124
Pages (from-to)1719-1731
Number of pages13
JournalIEEE Transactions on Multimedia
Volume15
Issue number8
DOIs
Publication statusPublished - 2013

Keywords

  • Correspondence matching
  • Markov random field
  • Multi-view videos
  • Mutual information based similarity measure
  • Visual sensor networks

ASJC Scopus subject areas

  • Signal Processing
  • Media Technology
  • Computer Science Applications
  • Electrical and Electronic Engineering

Fingerprint Dive into the research topics of 'Correspondence matching of multi-view video sequences using mutual information based similarity measure'. Together they form a unique fingerprint.

  • Cite this