Improving HDFS performance using local caching system

Sang Deok Yoon, In Yang Jung, Ki Hyun Kim, Chang Sung Jeong

Research output: Contribution to conferencePaper

3 Citations (Scopus)

Abstract

I/O performance of file system in various distributed parallel clusters can critically affect content-aware application performance. In this paper, we present a new architecture for Local Caching System which adjusts content locality between local file system and Hadoop Distributed File System by using proper cache algorithm and managing content queue and location. Also, we show that our local caching system improves the performance of content-aware application sharply.

Original languageEnglish
Pages153-156
Number of pages4
DOIs
Publication statusPublished - 2013
Event2nd International Conference on Future Generation Communication Technologies, FGCT 2013 - London, United Kingdom
Duration: 2013 Nov 122013 Nov 14

Other

Other2nd International Conference on Future Generation Communication Technologies, FGCT 2013
CountryUnited Kingdom
CityLondon
Period13/11/1213/11/14

Keywords

  • HDFS
  • cache
  • distributed file system
  • hadoop
  • locality

ASJC Scopus subject areas

  • Computer Networks and Communications

Cite this

Yoon, S. D., Jung, I. Y., Kim, K. H., & Jeong, C. S. (2013). Improving HDFS performance using local caching system. 153-156. Paper presented at 2nd International Conference on Future Generation Communication Technologies, FGCT 2013, London, United Kingdom. https://doi.org/10.1109/FGCT.2013.6767200