Impact of protocol overheads on network throughput over high-speed interconnects: Measurement, analysis, and improvement

Hyun Wook Jin, Chuck Yoo

Research output: Contribution to journalArticle

4 Citations (Scopus)

Abstract

Although extremely high-speed interconnects are available today, the traditional protocol stacks such as TCP/IP and UDP/IP are not able to utilize the maximum network bandwidth due to inherent overheads in the protocol stacks. Such overheads are a big obstacle for high-performance computing applications to exploit high-speed interconnects in cluster environments. To address this issue, many researchers have been presenting analyses of protocol overheads and suggesting a number of optimization approaches to harness the TCP/IP suite over high-speed interconnects. However, to the best of our knowledge, there is no study that analyzes and optimizes the protocol overheads thoroughly in an integrated manner. In this paper, we exploit a set of protocol optimization mechanisms in an integrated manner while dealing with the full spectrum of the protocol layers from the transport layer to the physical layer. To evaluate the impact of each protocol overhead, we apply the optimization mechanisms one by one and perform detailed analyses at each step. The thorough overhead measurements and analyses reveal the dependencies between protocol overheads. With our comprehensive optimizations, we show that UDP/IP can utilize more than 95% of the maximum network throughput a Myrinet-based experimental system can provide.

Original languageEnglish
Pages (from-to)17-40
Number of pages24
JournalJournal of Supercomputing
Volume41
Issue number1
DOIs
Publication statusPublished - 2007 Jul

Keywords

  • Clusters
  • High-speed interconnects
  • Myrinet
  • Programmable Network interface cards
  • UDP/IP

ASJC Scopus subject areas

  • Software
  • Theoretical Computer Science
  • Information Systems
  • Hardware and Architecture

Fingerprint Dive into the research topics of 'Impact of protocol overheads on network throughput over high-speed interconnects: Measurement, analysis, and improvement'. Together they form a unique fingerprint.

  • Cite this