Enhanced collective communication functions using factorization and pairwise-exchange communication

Dongyoung Kim, Dong Seung Kim

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

This paper proposes new algorithms to enhance the collective communication functions, and reports the analysis and experimental results of them. The new algorithms use factorization and pairwise-exchange dissemination methods in broadcast, allgather and allreduce. They demand at most log2P stages, and deliver better performance than the previous algorithms such as ring, recursive doubling and dissemination algorithms. Experimental results show the improvement of 50% or so over MPICH version 1.2.6 on a Linux cluster using TCP over Fast Ethernet and Gigabit Ethernet. The algorithms are being extended to other communication functions such as all-to-all broadcast and reduce-scatter.

Original languageEnglish
Title of host publicationProceedings of the International Conference on Parallel and Distributed Systems - ICPADS
EditorsL. Barolli
Pages675-681
Number of pages7
Volume1
DOIs
Publication statusPublished - 2005 Sep 1
Event11th International Conference on Parallel and Distributed Systems Workshops, ICPADS 2005 - Fukuoka, Japan
Duration: 2005 Jul 202005 Jul 22

Other

Other11th International Conference on Parallel and Distributed Systems Workshops, ICPADS 2005
CountryJapan
CityFukuoka
Period05/7/2005/7/22

Fingerprint

Factorization
Communication
Ethernet

ASJC Scopus subject areas

  • Engineering(all)

Cite this

Kim, D., & Kim, D. S. (2005). Enhanced collective communication functions using factorization and pairwise-exchange communication. In L. Barolli (Ed.), Proceedings of the International Conference on Parallel and Distributed Systems - ICPADS (Vol. 1, pp. 675-681) https://doi.org/10.1109/ICPADS.2005.149

Enhanced collective communication functions using factorization and pairwise-exchange communication. / Kim, Dongyoung; Kim, Dong Seung.

Proceedings of the International Conference on Parallel and Distributed Systems - ICPADS. ed. / L. Barolli. Vol. 1 2005. p. 675-681.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Kim, D & Kim, DS 2005, Enhanced collective communication functions using factorization and pairwise-exchange communication. in L Barolli (ed.), Proceedings of the International Conference on Parallel and Distributed Systems - ICPADS. vol. 1, pp. 675-681, 11th International Conference on Parallel and Distributed Systems Workshops, ICPADS 2005, Fukuoka, Japan, 05/7/20. https://doi.org/10.1109/ICPADS.2005.149
Kim D, Kim DS. Enhanced collective communication functions using factorization and pairwise-exchange communication. In Barolli L, editor, Proceedings of the International Conference on Parallel and Distributed Systems - ICPADS. Vol. 1. 2005. p. 675-681 https://doi.org/10.1109/ICPADS.2005.149
Kim, Dongyoung ; Kim, Dong Seung. / Enhanced collective communication functions using factorization and pairwise-exchange communication. Proceedings of the International Conference on Parallel and Distributed Systems - ICPADS. editor / L. Barolli. Vol. 1 2005. pp. 675-681
@inproceedings{320fc396162644259318ece8773b8e5e,
title = "Enhanced collective communication functions using factorization and pairwise-exchange communication",
abstract = "This paper proposes new algorithms to enhance the collective communication functions, and reports the analysis and experimental results of them. The new algorithms use factorization and pairwise-exchange dissemination methods in broadcast, allgather and allreduce. They demand at most log2P stages, and deliver better performance than the previous algorithms such as ring, recursive doubling and dissemination algorithms. Experimental results show the improvement of 50{\%} or so over MPICH version 1.2.6 on a Linux cluster using TCP over Fast Ethernet and Gigabit Ethernet. The algorithms are being extended to other communication functions such as all-to-all broadcast and reduce-scatter.",
author = "Dongyoung Kim and Kim, {Dong Seung}",
year = "2005",
month = "9",
day = "1",
doi = "10.1109/ICPADS.2005.149",
language = "English",
isbn = "0769522815",
volume = "1",
pages = "675--681",
editor = "L. Barolli",
booktitle = "Proceedings of the International Conference on Parallel and Distributed Systems - ICPADS",

}

TY - GEN

T1 - Enhanced collective communication functions using factorization and pairwise-exchange communication

AU - Kim, Dongyoung

AU - Kim, Dong Seung

PY - 2005/9/1

Y1 - 2005/9/1

N2 - This paper proposes new algorithms to enhance the collective communication functions, and reports the analysis and experimental results of them. The new algorithms use factorization and pairwise-exchange dissemination methods in broadcast, allgather and allreduce. They demand at most log2P stages, and deliver better performance than the previous algorithms such as ring, recursive doubling and dissemination algorithms. Experimental results show the improvement of 50% or so over MPICH version 1.2.6 on a Linux cluster using TCP over Fast Ethernet and Gigabit Ethernet. The algorithms are being extended to other communication functions such as all-to-all broadcast and reduce-scatter.

AB - This paper proposes new algorithms to enhance the collective communication functions, and reports the analysis and experimental results of them. The new algorithms use factorization and pairwise-exchange dissemination methods in broadcast, allgather and allreduce. They demand at most log2P stages, and deliver better performance than the previous algorithms such as ring, recursive doubling and dissemination algorithms. Experimental results show the improvement of 50% or so over MPICH version 1.2.6 on a Linux cluster using TCP over Fast Ethernet and Gigabit Ethernet. The algorithms are being extended to other communication functions such as all-to-all broadcast and reduce-scatter.

UR - http://www.scopus.com/inward/record.url?scp=23944464462&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=23944464462&partnerID=8YFLogxK

U2 - 10.1109/ICPADS.2005.149

DO - 10.1109/ICPADS.2005.149

M3 - Conference contribution

AN - SCOPUS:23944464462

SN - 0769522815

VL - 1

SP - 675

EP - 681

BT - Proceedings of the International Conference on Parallel and Distributed Systems - ICPADS

A2 - Barolli, L.

ER -