Coarse-to-Fine Deep Learning of Continuous Pedestrian Orientation Based on Spatial Co-Occurrence Feature

Sung Soo Kim, In Youb Gwak, Seong Whan Lee

Research output: Contribution to journalArticlepeer-review

1 Citation (Scopus)

Abstract

The continuous orientation estimation of a moving pedestrian is a crucial issue in autonomous driving that requires the detection of a pedestrian intending to cross a road. It is still a challenging task owing to several reasons, including the diversity of pedestrian appearances, the subtle pose difference between adjacent orientations, and similar poses with different orientations such as axisymmetric orientations. These problems render the task highly difficult. Recent studies involving convolutional neural networks (CNNs) have attempted to solve these problems. However, their performance is still far from satisfactory for application in intelligent vehicles. In this paper, we propose a CNN-based two-stream network for continuous orientation estimation. The network can learn representations based on the spatial co-occurrence of visual patterns among pedestrians. To boost estimation performance, we applied a coarse-to-fine learning approach that consists of two learning stages. We investigated continuous orientation performance on the TUD Multiview Pedestrian dataset and the KITTI dataset and compared them with the state-of-the-art methods. The results show that our method outperforms other existing methods.

Original languageEnglish
Article number8734128
Pages (from-to)2522-2533
Number of pages12
JournalIEEE Transactions on Intelligent Transportation Systems
Volume21
Issue number6
DOIs
Publication statusPublished - 2020 Jun

Keywords

  • Advanced driver assistance system
  • coarse-to-fine learning
  • continuous orientation estimation
  • convolutional neural networks

ASJC Scopus subject areas

  • Automotive Engineering
  • Mechanical Engineering
  • Computer Science Applications

Fingerprint

Dive into the research topics of 'Coarse-to-Fine Deep Learning of Continuous Pedestrian Orientation Based on Spatial Co-Occurrence Feature'. Together they form a unique fingerprint.

Cite this