Enhanced collective communication functions using factorization and pairwise-exchange communication

Dongyoung Kim, Dong Seung Kim

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

This paper proposes new algorithms to enhance the collective communication functions, and reports the analysis and experimental results of them. The new algorithms use factorization and pairwise-exchange dissemination methods in broadcast, allgather and allreduce. They demand at most log2P stages, and deliver better performance than the previous algorithms such as ring, recursive doubling and dissemination algorithms. Experimental results show the improvement of 50% or so over MPICH version 1.2.6 on a Linux cluster using TCP over Fast Ethernet and Gigabit Ethernet. The algorithms are being extended to other communication functions such as all-to-all broadcast and reduce-scatter.

Original languageEnglish
Title of host publicationProceedings of the International Conference on Parallel and Distributed Systems - ICPADS
EditorsL. Barolli
Pages675-681
Number of pages7
Volume1
DOIs
Publication statusPublished - 2005 Sep 1
Event11th International Conference on Parallel and Distributed Systems Workshops, ICPADS 2005 - Fukuoka, Japan
Duration: 2005 Jul 202005 Jul 22

Other

Other11th International Conference on Parallel and Distributed Systems Workshops, ICPADS 2005
CountryJapan
CityFukuoka
Period05/7/2005/7/22

ASJC Scopus subject areas

  • Engineering(all)

Fingerprint Dive into the research topics of 'Enhanced collective communication functions using factorization and pairwise-exchange communication'. Together they form a unique fingerprint.

  • Cite this

    Kim, D., & Kim, D. S. (2005). Enhanced collective communication functions using factorization and pairwise-exchange communication. In L. Barolli (Ed.), Proceedings of the International Conference on Parallel and Distributed Systems - ICPADS (Vol. 1, pp. 675-681) https://doi.org/10.1109/ICPADS.2005.149