Extending TCP for accelerating replication on cluster file systems over sdns

Sungheon Lim, Hyogon Kim

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

This paper explores the changes required of TCP to efficiently support cluster file systems such as Hadoop Distributed File System (HDFS) where the storage nodes are connected through a software defined networking (SDN). Traditional chain replications in these file systems incur large delay and cause inefficient network use. But SDN can cooperate with the cluster file systems to address the problems by pre-Arranging a distribution tree, which opens the possibility of parallel replication. Unfortunately, it cannot be realized without extending TCP, to accommodate the parallel transfer on the transport layer. This paper discusses how to extend TCP to make it possible, and demonstrates the feasibility by implementing a prototype in the Linux kernel. The prototype saves the data replication time by 25% while substantially reducing network use.

Original languageEnglish
Title of host publicationProceedings of the 2019 IEEE Conference on Network Softwarization
Subtitle of host publicationUnleashing the Power of Network Softwarization, NetSoft 2019
EditorsFilip De Turck, Flavio Esposito, Prosper Chemouil, Olivier Festor, Stefano Secci, Christian Jacquenet, Walter Cerroni
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages48-53
Number of pages6
ISBN (Electronic)9781538693766
DOIs
Publication statusPublished - 2019 Jun 1
Event5th IEEE Conference on Network Softwarization, NetSoft 2019 - Paris, France
Duration: 2019 Jun 242019 Jun 28

Publication series

NameProceedings of the 2019 IEEE Conference on Network Softwarization: Unleashing the Power of Network Softwarization, NetSoft 2019

Conference

Conference5th IEEE Conference on Network Softwarization, NetSoft 2019
CountryFrance
CityParis
Period19/6/2419/6/28

    Fingerprint

Keywords

  • cluster file system
  • data replication
  • HDFS
  • network utilization
  • Software Defined Networking (SDN)
  • TCP extension

ASJC Scopus subject areas

  • Safety, Risk, Reliability and Quality
  • Computer Networks and Communications
  • Software

Cite this

Lim, S., & Kim, H. (2019). Extending TCP for accelerating replication on cluster file systems over sdns. In F. De Turck, F. Esposito, P. Chemouil, O. Festor, S. Secci, C. Jacquenet, & W. Cerroni (Eds.), Proceedings of the 2019 IEEE Conference on Network Softwarization: Unleashing the Power of Network Softwarization, NetSoft 2019 (pp. 48-53). [8806672] (Proceedings of the 2019 IEEE Conference on Network Softwarization: Unleashing the Power of Network Softwarization, NetSoft 2019). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/NETSOFT.2019.8806672