Processor allocation and task scheduling of matrix chain products on parallel systems

Heejo Lee, Jong Kim, Sung Je Hong, Sunggu Lee

Research output: Contribution to journalArticle

21 Citations (Scopus)

Abstract

The problem of finding an optimal product sequence for sequential multiplication of a chain of matrices (the matrix chain ordering problem, MCOP) is well-known and has been studied for a long time. In this paper, we consider the problem of finding an optimal product schedule for evaluating a chain of matrix products on a parallel computer (the matrix chain scheduling problem, MCSP). The difference between the MCSP and the MCOP is that the MCOP pertains to a product sequence for single processor systems and the MCSP pertains to a sequence of concurrent matrix products for parallel systems. The approach of parallelizing each matrix product after finding an optimal product sequence for single processor systems does not always guarantee the minimum evaluation time on parallel systems since each parallelized matrix product may use processors inefficiently. We introduce a new processor scheduling algorithm for the MCSP which reduces the evaluation time of a chain of matrix products on a parallel computer, even at the expense of a slight increase in the total number of operations. Given a chain of n matrices and a matrix product utilizing at most P/k processors in a P-processor system, the proposed algorithm approaches k(n - 1)/(n + k log(k) - k) times the performance of parallel evaluation using the optimal sequence found for the MCOP. Also, experiments performed on a Fujitsu AP1000 multicomputer show that the proposed algorithm significantly decreases the time required to evaluate a chain of matrix products in parallel systems.

Original languageEnglish
Pages (from-to)394-407
Number of pages14
JournalIEEE Transactions on Parallel and Distributed Systems
Volume14
Issue number4
DOIs
Publication statusPublished - 2003 Apr 1
Externally publishedYes

Fingerprint

Task Scheduling
Parallel Systems
Scheduling
Matrix Product
Scheduling Problem
Parallel Computers
Evaluation
Multicomputers
Scheduling Algorithm
Concurrent
Multiplication
Schedule
Scheduling algorithms

Keywords

  • Matrix chain product
  • Matrix chain scheduling problem
  • Parallel matrix multiplication
  • Processor allocation
  • Task scheduling

ASJC Scopus subject areas

  • Computational Theory and Mathematics
  • Electrical and Electronic Engineering
  • Theoretical Computer Science

Cite this

Processor allocation and task scheduling of matrix chain products on parallel systems. / Lee, Heejo; Kim, Jong; Hong, Sung Je; Lee, Sunggu.

In: IEEE Transactions on Parallel and Distributed Systems, Vol. 14, No. 4, 01.04.2003, p. 394-407.

Research output: Contribution to journalArticle

@article{d4bf044dbd254a189f555437f6bb8b73,
title = "Processor allocation and task scheduling of matrix chain products on parallel systems",
abstract = "The problem of finding an optimal product sequence for sequential multiplication of a chain of matrices (the matrix chain ordering problem, MCOP) is well-known and has been studied for a long time. In this paper, we consider the problem of finding an optimal product schedule for evaluating a chain of matrix products on a parallel computer (the matrix chain scheduling problem, MCSP). The difference between the MCSP and the MCOP is that the MCOP pertains to a product sequence for single processor systems and the MCSP pertains to a sequence of concurrent matrix products for parallel systems. The approach of parallelizing each matrix product after finding an optimal product sequence for single processor systems does not always guarantee the minimum evaluation time on parallel systems since each parallelized matrix product may use processors inefficiently. We introduce a new processor scheduling algorithm for the MCSP which reduces the evaluation time of a chain of matrix products on a parallel computer, even at the expense of a slight increase in the total number of operations. Given a chain of n matrices and a matrix product utilizing at most P/k processors in a P-processor system, the proposed algorithm approaches k(n - 1)/(n + k log(k) - k) times the performance of parallel evaluation using the optimal sequence found for the MCOP. Also, experiments performed on a Fujitsu AP1000 multicomputer show that the proposed algorithm significantly decreases the time required to evaluate a chain of matrix products in parallel systems.",
keywords = "Matrix chain product, Matrix chain scheduling problem, Parallel matrix multiplication, Processor allocation, Task scheduling",
author = "Heejo Lee and Jong Kim and Hong, {Sung Je} and Sunggu Lee",
year = "2003",
month = "4",
day = "1",
doi = "10.1109/TPDS.2003.1195411",
language = "English",
volume = "14",
pages = "394--407",
journal = "IEEE Transactions on Parallel and Distributed Systems",
issn = "1045-9219",
publisher = "IEEE Computer Society",
number = "4",

}

TY - JOUR

T1 - Processor allocation and task scheduling of matrix chain products on parallel systems

AU - Lee, Heejo

AU - Kim, Jong

AU - Hong, Sung Je

AU - Lee, Sunggu

PY - 2003/4/1

Y1 - 2003/4/1

N2 - The problem of finding an optimal product sequence for sequential multiplication of a chain of matrices (the matrix chain ordering problem, MCOP) is well-known and has been studied for a long time. In this paper, we consider the problem of finding an optimal product schedule for evaluating a chain of matrix products on a parallel computer (the matrix chain scheduling problem, MCSP). The difference between the MCSP and the MCOP is that the MCOP pertains to a product sequence for single processor systems and the MCSP pertains to a sequence of concurrent matrix products for parallel systems. The approach of parallelizing each matrix product after finding an optimal product sequence for single processor systems does not always guarantee the minimum evaluation time on parallel systems since each parallelized matrix product may use processors inefficiently. We introduce a new processor scheduling algorithm for the MCSP which reduces the evaluation time of a chain of matrix products on a parallel computer, even at the expense of a slight increase in the total number of operations. Given a chain of n matrices and a matrix product utilizing at most P/k processors in a P-processor system, the proposed algorithm approaches k(n - 1)/(n + k log(k) - k) times the performance of parallel evaluation using the optimal sequence found for the MCOP. Also, experiments performed on a Fujitsu AP1000 multicomputer show that the proposed algorithm significantly decreases the time required to evaluate a chain of matrix products in parallel systems.

AB - The problem of finding an optimal product sequence for sequential multiplication of a chain of matrices (the matrix chain ordering problem, MCOP) is well-known and has been studied for a long time. In this paper, we consider the problem of finding an optimal product schedule for evaluating a chain of matrix products on a parallel computer (the matrix chain scheduling problem, MCSP). The difference between the MCSP and the MCOP is that the MCOP pertains to a product sequence for single processor systems and the MCSP pertains to a sequence of concurrent matrix products for parallel systems. The approach of parallelizing each matrix product after finding an optimal product sequence for single processor systems does not always guarantee the minimum evaluation time on parallel systems since each parallelized matrix product may use processors inefficiently. We introduce a new processor scheduling algorithm for the MCSP which reduces the evaluation time of a chain of matrix products on a parallel computer, even at the expense of a slight increase in the total number of operations. Given a chain of n matrices and a matrix product utilizing at most P/k processors in a P-processor system, the proposed algorithm approaches k(n - 1)/(n + k log(k) - k) times the performance of parallel evaluation using the optimal sequence found for the MCOP. Also, experiments performed on a Fujitsu AP1000 multicomputer show that the proposed algorithm significantly decreases the time required to evaluate a chain of matrix products in parallel systems.

KW - Matrix chain product

KW - Matrix chain scheduling problem

KW - Parallel matrix multiplication

KW - Processor allocation

KW - Task scheduling

UR - http://www.scopus.com/inward/record.url?scp=0037619247&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0037619247&partnerID=8YFLogxK

U2 - 10.1109/TPDS.2003.1195411

DO - 10.1109/TPDS.2003.1195411

M3 - Article

AN - SCOPUS:0037619247

VL - 14

SP - 394

EP - 407

JO - IEEE Transactions on Parallel and Distributed Systems

JF - IEEE Transactions on Parallel and Distributed Systems

SN - 1045-9219

IS - 4

ER -