RIDE: real-time massive image processing platform on distributed environment

Yoon Ki Kim, Yongsung Kim, Chang Sung Jeong

Research output: Contribution to journalArticlepeer-review

3 Citations (Scopus)

Abstract

As the demand for real-time data processing increases, a high-speed processing platform for large-scale stream data becomes necessary. For fast processing large-scale stream data, it is essential to use multiple distributed nodes. So far, there have been few studies on real-time massive image processing through efficient management and allocation of heterogeneous resources for various user-specified nodes on distributed environments. In this paper, we shall present a new platform called RIDE (Real-time massive Image processing platform on Distributed Environment) which efficiently allocates resources and executes load balancing according to the amount of stream data on distributed environments. It minimizes communication overhead by using a parallel processing strategy which handles the stream data considering both coarse-grained and fine-grained parallelism simultaneously. Coarse-grained parallelism is achieved by the automatic allocation of input streams onto partitions of broker buffer each processed by its corresponding worker node, and maximized by adaptive resource management which adjusts the number of worker nodes in a group according to the frame rate in real time. Fine-grained parallelism is achieved by parallel processing of task on each worker node and maximized by allocating heterogeneous resources such as GPU and embedded machines appropriately. Moreover, it provides a scheme of application topology which has a great advantage for higher performance by configuring the worker nodes of each stage using adaptive heterogeneous resource management. Finally, it supports dynamic fault tolerance for real-time image processing through the coordination between components in our system.

Original languageEnglish
Article number39
JournalEurasip Journal on Image and Video Processing
Volume2018
Issue number1
DOIs
Publication statusPublished - 2018 Dec 1

Keywords

  • Distributed and parallel processing
  • Heterogeneous computing
  • Image processing
  • Real-time

ASJC Scopus subject areas

  • Signal Processing
  • Information Systems
  • Electrical and Electronic Engineering

Fingerprint Dive into the research topics of 'RIDE: real-time massive image processing platform on distributed environment'. Together they form a unique fingerprint.

Cite this