Exploiting NIC architectural support for enhancing IP-based protocols on high-performance networks

Hyun Wook Jin, Pavan Balaji, Hyuck Yoo, Jin Young Choi, Dhabaleswar K. Panda

Research output: Contribution to journalArticle

14 Citations (Scopus)

Abstract

While a number of user-level protocols have been developed to reduce the gap between the performance capabilities of the physical network and the performance actually available, their compatibility issues with the existing sockets-based applications and IP-based infrastructure has been an area of major concern. To address these compatibility issues while maintaining a high performance, a number of researchers have been looking at alternative approaches to optimize the existing traditional protocol stacks. Broadly, previous research has broken up the overheads in the traditional protocol stack into four related aspects, namely: (i) compute requirements and contention, (ii) memory contention, (iii) I/O bus contention and (iv) system resources' idle time. While previous research dealing with some of these aspects exists, to the best of our knowledge, there is no work which deals with all these issues in an integrated manner while maintaining backward compatibility with existing applications and infrastructure. In this paper, we address each of these issues, propose solutions for minimizing these overheads by exploiting the emerging architectural features provided by modern Network Interface Cards (NICs) and demonstrate the capabilities of these solutions using an implementation based on UDP/IP over Myrinet. Our experimental results show that with our implementation of UDP, termed as E-UDP, can achieve up to 94% of the theoretical maximum bandwidth. We also present a mathematical performance model which allows us to study the scalability of our approach for different system architectures and network speeds.

Original languageEnglish
Pages (from-to)1348-1365
Number of pages18
JournalJournal of Parallel and Distributed Computing
Volume65
Issue number11
DOIs
Publication statusPublished - 2005 Nov 1

Fingerprint

Contention
Network performance
Compatibility
Interfaces (computer)
High Performance
Network protocols
Infrastructure
Performance Model
System Architecture
Scalability
Bandwidth
Optimise
Mathematical Model
Data storage equipment
Resources
Alternatives
Requirements
Experimental Results
Demonstrate
Architecture

Keywords

  • Clusters
  • Myrinet
  • Overhead pipelining
  • Protocol offload
  • UDP/IP

ASJC Scopus subject areas

  • Computer Science Applications
  • Hardware and Architecture
  • Control and Systems Engineering

Cite this

Exploiting NIC architectural support for enhancing IP-based protocols on high-performance networks. / Jin, Hyun Wook; Balaji, Pavan; Yoo, Hyuck; Choi, Jin Young; Panda, Dhabaleswar K.

In: Journal of Parallel and Distributed Computing, Vol. 65, No. 11, 01.11.2005, p. 1348-1365.

Research output: Contribution to journalArticle

@article{7140ff40b60b4f29bca7f5f687b0e47e,
title = "Exploiting NIC architectural support for enhancing IP-based protocols on high-performance networks",
abstract = "While a number of user-level protocols have been developed to reduce the gap between the performance capabilities of the physical network and the performance actually available, their compatibility issues with the existing sockets-based applications and IP-based infrastructure has been an area of major concern. To address these compatibility issues while maintaining a high performance, a number of researchers have been looking at alternative approaches to optimize the existing traditional protocol stacks. Broadly, previous research has broken up the overheads in the traditional protocol stack into four related aspects, namely: (i) compute requirements and contention, (ii) memory contention, (iii) I/O bus contention and (iv) system resources' idle time. While previous research dealing with some of these aspects exists, to the best of our knowledge, there is no work which deals with all these issues in an integrated manner while maintaining backward compatibility with existing applications and infrastructure. In this paper, we address each of these issues, propose solutions for minimizing these overheads by exploiting the emerging architectural features provided by modern Network Interface Cards (NICs) and demonstrate the capabilities of these solutions using an implementation based on UDP/IP over Myrinet. Our experimental results show that with our implementation of UDP, termed as E-UDP, can achieve up to 94{\%} of the theoretical maximum bandwidth. We also present a mathematical performance model which allows us to study the scalability of our approach for different system architectures and network speeds.",
keywords = "Clusters, Myrinet, Overhead pipelining, Protocol offload, UDP/IP",
author = "Jin, {Hyun Wook} and Pavan Balaji and Hyuck Yoo and Choi, {Jin Young} and Panda, {Dhabaleswar K.}",
year = "2005",
month = "11",
day = "1",
doi = "10.1016/j.jpdc.2005.05.025",
language = "English",
volume = "65",
pages = "1348--1365",
journal = "Journal of Parallel and Distributed Computing",
issn = "0743-7315",
publisher = "Academic Press Inc.",
number = "11",

}

TY - JOUR

T1 - Exploiting NIC architectural support for enhancing IP-based protocols on high-performance networks

AU - Jin, Hyun Wook

AU - Balaji, Pavan

AU - Yoo, Hyuck

AU - Choi, Jin Young

AU - Panda, Dhabaleswar K.

PY - 2005/11/1

Y1 - 2005/11/1

N2 - While a number of user-level protocols have been developed to reduce the gap between the performance capabilities of the physical network and the performance actually available, their compatibility issues with the existing sockets-based applications and IP-based infrastructure has been an area of major concern. To address these compatibility issues while maintaining a high performance, a number of researchers have been looking at alternative approaches to optimize the existing traditional protocol stacks. Broadly, previous research has broken up the overheads in the traditional protocol stack into four related aspects, namely: (i) compute requirements and contention, (ii) memory contention, (iii) I/O bus contention and (iv) system resources' idle time. While previous research dealing with some of these aspects exists, to the best of our knowledge, there is no work which deals with all these issues in an integrated manner while maintaining backward compatibility with existing applications and infrastructure. In this paper, we address each of these issues, propose solutions for minimizing these overheads by exploiting the emerging architectural features provided by modern Network Interface Cards (NICs) and demonstrate the capabilities of these solutions using an implementation based on UDP/IP over Myrinet. Our experimental results show that with our implementation of UDP, termed as E-UDP, can achieve up to 94% of the theoretical maximum bandwidth. We also present a mathematical performance model which allows us to study the scalability of our approach for different system architectures and network speeds.

AB - While a number of user-level protocols have been developed to reduce the gap between the performance capabilities of the physical network and the performance actually available, their compatibility issues with the existing sockets-based applications and IP-based infrastructure has been an area of major concern. To address these compatibility issues while maintaining a high performance, a number of researchers have been looking at alternative approaches to optimize the existing traditional protocol stacks. Broadly, previous research has broken up the overheads in the traditional protocol stack into four related aspects, namely: (i) compute requirements and contention, (ii) memory contention, (iii) I/O bus contention and (iv) system resources' idle time. While previous research dealing with some of these aspects exists, to the best of our knowledge, there is no work which deals with all these issues in an integrated manner while maintaining backward compatibility with existing applications and infrastructure. In this paper, we address each of these issues, propose solutions for minimizing these overheads by exploiting the emerging architectural features provided by modern Network Interface Cards (NICs) and demonstrate the capabilities of these solutions using an implementation based on UDP/IP over Myrinet. Our experimental results show that with our implementation of UDP, termed as E-UDP, can achieve up to 94% of the theoretical maximum bandwidth. We also present a mathematical performance model which allows us to study the scalability of our approach for different system architectures and network speeds.

KW - Clusters

KW - Myrinet

KW - Overhead pipelining

KW - Protocol offload

KW - UDP/IP

UR - http://www.scopus.com/inward/record.url?scp=26944481522&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=26944481522&partnerID=8YFLogxK

U2 - 10.1016/j.jpdc.2005.05.025

DO - 10.1016/j.jpdc.2005.05.025

M3 - Article

AN - SCOPUS:26944481522

VL - 65

SP - 1348

EP - 1365

JO - Journal of Parallel and Distributed Computing

JF - Journal of Parallel and Distributed Computing

SN - 0743-7315

IS - 11

ER -