Integrated 3D Analysis and Analysis-Guided Synthesis of Flight Image Sequences

Sanghoon Sull, Narendra Ahuja

Research output: Contribution to journalArticlepeer-review

11 Citations (Scopus)

Abstract

This paper is concerned with three-dimensional (3D) analysis, and analysis-guided syntheses, of images showing 3D motion of an observer relative to a scene. There are two objectives of the paper. First, it presents an approach to recovering 3D motion and structure parameters from multiple cues present in a monocular image sequence, such as point features, optical flow, regions, lines, texture gradient, and vanishing line. Second, it introduces the notion that the cues that contribute the most to 3D interpretation are also the ones that would yield the most realistic synthesis, thus suggesting an approach to analysis guided 3D representation. For concreteness, the paper focuses on flight image sequences of a planar, textured surface. The integration of information in these diverse cues is carried out using optimization. For reliable estimation, a sequential batch method is used to compute motion and structure. Synthesis is done by using i) image attributes extracted from the image sequence, and ii) simple, artificial image attributes which are not present in the original images. For display, real and/or artificial attributes are shown as a monocular or a binocular sequence. Performance evaluation is done through experiments with one synthetic sequence, and two real image sequences digitized from a commercially available video tape and a laserdisc. The attribute based representation of these sequences compressed their sizes by 502 and 367. The visualization sequence appears very similar to the original sequence in informal, monocular as well as stereo viewing on a workstation monitor.

Original languageEnglish
Pages (from-to)357-372
Number of pages16
JournalIEEE Transactions on Pattern Analysis and Machine Intelligence
Volume16
Issue number4
DOIs
Publication statusPublished - 1994 Apr

Keywords

  • Integrated segmentation and matching
  • analysis-guided syntheses
  • consistency of structure parameters
  • flight images
  • integrated motion and structure estimation
  • recognition of vanishing line
  • sequential-batch processing

ASJC Scopus subject areas

  • Software
  • Computer Vision and Pattern Recognition
  • Computational Theory and Mathematics
  • Artificial Intelligence
  • Applied Mathematics

Fingerprint Dive into the research topics of 'Integrated 3D Analysis and Analysis-Guided Synthesis of Flight Image Sequences'. Together they form a unique fingerprint.

Cite this