Design of fast collective communication functions on clustered workstations with ethernet and myrinet

Dongyoung Kim, Dong Seung Kim

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

In cluster computing, current communication functions under MPI library are not well optimized. Especially, the performance is worse if there are multiple sources and/or destinations involved, which are the cases of collective communication. Our algorithms uses multidimensional factorization and pairwise exchange communication/dissemination methods to improve the performance. They deliver better performance than previous algorithms such as ring, recursive doubling and dissemination algorithms. Experimental results show the improvement of 50% or so over MPICH version 1.2.6 on a Linux cluster.

Original languageEnglish
Title of host publicationLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Pages105-116
Number of pages12
Volume4759 LNCS
Publication statusPublished - 2008 Feb 1
Event6th International Symposium on High Performance Computing, ISHPC 2005 and 1st International Workshop on Advanced Low Power Systems, ALPS 2006 - 6th International Symposium on High, Japan
Duration: 2005 Sep 72005 Sep 9

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume4759 LNCS
ISSN (Print)03029743
ISSN (Electronic)16113349

Other

Other6th International Symposium on High Performance Computing, ISHPC 2005 and 1st International Workshop on Advanced Low Power Systems, ALPS 2006
CountryJapan
City6th International Symposium on High
Period05/9/705/9/9

Fingerprint

Collective Communication
Ethernet
Communication
Cluster computing
Cluster Computing
Linux
Doubling
Factorization
Libraries
Pairwise
Ring
Experimental Results
Design

Keywords

  • Broadcast
  • Cluster computing
  • Message passing communication
  • MPI

ASJC Scopus subject areas

  • Computer Science(all)
  • Biochemistry, Genetics and Molecular Biology(all)
  • Theoretical Computer Science

Cite this

Kim, D., & Kim, D. S. (2008). Design of fast collective communication functions on clustered workstations with ethernet and myrinet. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) (Vol. 4759 LNCS, pp. 105-116). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 4759 LNCS).

Design of fast collective communication functions on clustered workstations with ethernet and myrinet. / Kim, Dongyoung; Kim, Dong Seung.

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). Vol. 4759 LNCS 2008. p. 105-116 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 4759 LNCS).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Kim, D & Kim, DS 2008, Design of fast collective communication functions on clustered workstations with ethernet and myrinet. in Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). vol. 4759 LNCS, Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 4759 LNCS, pp. 105-116, 6th International Symposium on High Performance Computing, ISHPC 2005 and 1st International Workshop on Advanced Low Power Systems, ALPS 2006, 6th International Symposium on High, Japan, 05/9/7.
Kim D, Kim DS. Design of fast collective communication functions on clustered workstations with ethernet and myrinet. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). Vol. 4759 LNCS. 2008. p. 105-116. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).
Kim, Dongyoung ; Kim, Dong Seung. / Design of fast collective communication functions on clustered workstations with ethernet and myrinet. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). Vol. 4759 LNCS 2008. pp. 105-116 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).
@inproceedings{842490d95a814782915cba2ee59b001c,
title = "Design of fast collective communication functions on clustered workstations with ethernet and myrinet",
abstract = "In cluster computing, current communication functions under MPI library are not well optimized. Especially, the performance is worse if there are multiple sources and/or destinations involved, which are the cases of collective communication. Our algorithms uses multidimensional factorization and pairwise exchange communication/dissemination methods to improve the performance. They deliver better performance than previous algorithms such as ring, recursive doubling and dissemination algorithms. Experimental results show the improvement of 50{\%} or so over MPICH version 1.2.6 on a Linux cluster.",
keywords = "Broadcast, Cluster computing, Message passing communication, MPI",
author = "Dongyoung Kim and Kim, {Dong Seung}",
year = "2008",
month = "2",
day = "1",
language = "English",
isbn = "3540777032",
volume = "4759 LNCS",
series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",
pages = "105--116",
booktitle = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

}

TY - GEN

T1 - Design of fast collective communication functions on clustered workstations with ethernet and myrinet

AU - Kim, Dongyoung

AU - Kim, Dong Seung

PY - 2008/2/1

Y1 - 2008/2/1

N2 - In cluster computing, current communication functions under MPI library are not well optimized. Especially, the performance is worse if there are multiple sources and/or destinations involved, which are the cases of collective communication. Our algorithms uses multidimensional factorization and pairwise exchange communication/dissemination methods to improve the performance. They deliver better performance than previous algorithms such as ring, recursive doubling and dissemination algorithms. Experimental results show the improvement of 50% or so over MPICH version 1.2.6 on a Linux cluster.

AB - In cluster computing, current communication functions under MPI library are not well optimized. Especially, the performance is worse if there are multiple sources and/or destinations involved, which are the cases of collective communication. Our algorithms uses multidimensional factorization and pairwise exchange communication/dissemination methods to improve the performance. They deliver better performance than previous algorithms such as ring, recursive doubling and dissemination algorithms. Experimental results show the improvement of 50% or so over MPICH version 1.2.6 on a Linux cluster.

KW - Broadcast

KW - Cluster computing

KW - Message passing communication

KW - MPI

UR - http://www.scopus.com/inward/record.url?scp=38549095138&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=38549095138&partnerID=8YFLogxK

M3 - Conference contribution

AN - SCOPUS:38549095138

SN - 3540777032

SN - 9783540777038

VL - 4759 LNCS

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 105

EP - 116

BT - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

ER -