DiSCo

Distributed scalable compilation tool for heavy compilation workload

Research output: Contribution to journalArticle

1 Citation (Scopus)

Abstract

The size and complexity of software in computer systems and even in consumer electronics is drastically and continuously increasing, thus increasing the compilation time. For example, the compilation time for building some of mobile phones' platform software takes several hours. In order to reduce the compilation time, this paper proposes a Distributed Scalable Compilation Tool, called DiSCo where full compilation passes such as preprocessing, compilation, and even linking are performed at remote machines, i.e. in parallel. To the best of our knowledge DiSCo is the first distributed compiler to support complete distributed processing in all the compilation passes. We use an extensive dependency analysis in parsing compilation commands for exploiting higher command-level parallelism, and we apply a file caching method and a network-drive protocol for reducing the remote compilation overhead and simplifying the implementation. Lastly, we minimize load imbalance and remote machine management overhead with our heuristic static scheduling method by predicting compilation time and considering the overheads invoked by the compilation process. Our evaluation using four large mobile applications and eight GNU applications shows that the performance of DiSCo is scalable and the performance is close to a profile scheduling.

Original languageEnglish
Pages (from-to)589-600
Number of pages12
JournalIEICE Transactions on Information and Systems
VolumeE96-D
Issue number3
DOIs
Publication statusPublished - 2013 Mar 1

Fingerprint

Scheduling
Consumer electronics
Mobile phones
Computer systems
Network protocols
Processing

Keywords

  • Compiler
  • Distributed compiler
  • Remote linking

ASJC Scopus subject areas

  • Electrical and Electronic Engineering
  • Software
  • Artificial Intelligence
  • Hardware and Architecture
  • Computer Vision and Pattern Recognition

Cite this

DiSCo : Distributed scalable compilation tool for heavy compilation workload. / Jo, Kyongjin; Kim, Seon Wook; Kim, Jong-Kook.

In: IEICE Transactions on Information and Systems, Vol. E96-D, No. 3, 01.03.2013, p. 589-600.

Research output: Contribution to journalArticle

@article{50610929071e41f29e25a2e29caffd73,
title = "DiSCo: Distributed scalable compilation tool for heavy compilation workload",
abstract = "The size and complexity of software in computer systems and even in consumer electronics is drastically and continuously increasing, thus increasing the compilation time. For example, the compilation time for building some of mobile phones' platform software takes several hours. In order to reduce the compilation time, this paper proposes a Distributed Scalable Compilation Tool, called DiSCo where full compilation passes such as preprocessing, compilation, and even linking are performed at remote machines, i.e. in parallel. To the best of our knowledge DiSCo is the first distributed compiler to support complete distributed processing in all the compilation passes. We use an extensive dependency analysis in parsing compilation commands for exploiting higher command-level parallelism, and we apply a file caching method and a network-drive protocol for reducing the remote compilation overhead and simplifying the implementation. Lastly, we minimize load imbalance and remote machine management overhead with our heuristic static scheduling method by predicting compilation time and considering the overheads invoked by the compilation process. Our evaluation using four large mobile applications and eight GNU applications shows that the performance of DiSCo is scalable and the performance is close to a profile scheduling.",
keywords = "Compiler, Distributed compiler, Remote linking",
author = "Kyongjin Jo and Kim, {Seon Wook} and Jong-Kook Kim",
year = "2013",
month = "3",
day = "1",
doi = "10.1587/transinf.E96.D.589",
language = "English",
volume = "E96-D",
pages = "589--600",
journal = "IEICE Transactions on Information and Systems",
issn = "0916-8532",
publisher = "Maruzen Co., Ltd/Maruzen Kabushikikaisha",
number = "3",

}

TY - JOUR

T1 - DiSCo

T2 - Distributed scalable compilation tool for heavy compilation workload

AU - Jo, Kyongjin

AU - Kim, Seon Wook

AU - Kim, Jong-Kook

PY - 2013/3/1

Y1 - 2013/3/1

N2 - The size and complexity of software in computer systems and even in consumer electronics is drastically and continuously increasing, thus increasing the compilation time. For example, the compilation time for building some of mobile phones' platform software takes several hours. In order to reduce the compilation time, this paper proposes a Distributed Scalable Compilation Tool, called DiSCo where full compilation passes such as preprocessing, compilation, and even linking are performed at remote machines, i.e. in parallel. To the best of our knowledge DiSCo is the first distributed compiler to support complete distributed processing in all the compilation passes. We use an extensive dependency analysis in parsing compilation commands for exploiting higher command-level parallelism, and we apply a file caching method and a network-drive protocol for reducing the remote compilation overhead and simplifying the implementation. Lastly, we minimize load imbalance and remote machine management overhead with our heuristic static scheduling method by predicting compilation time and considering the overheads invoked by the compilation process. Our evaluation using four large mobile applications and eight GNU applications shows that the performance of DiSCo is scalable and the performance is close to a profile scheduling.

AB - The size and complexity of software in computer systems and even in consumer electronics is drastically and continuously increasing, thus increasing the compilation time. For example, the compilation time for building some of mobile phones' platform software takes several hours. In order to reduce the compilation time, this paper proposes a Distributed Scalable Compilation Tool, called DiSCo where full compilation passes such as preprocessing, compilation, and even linking are performed at remote machines, i.e. in parallel. To the best of our knowledge DiSCo is the first distributed compiler to support complete distributed processing in all the compilation passes. We use an extensive dependency analysis in parsing compilation commands for exploiting higher command-level parallelism, and we apply a file caching method and a network-drive protocol for reducing the remote compilation overhead and simplifying the implementation. Lastly, we minimize load imbalance and remote machine management overhead with our heuristic static scheduling method by predicting compilation time and considering the overheads invoked by the compilation process. Our evaluation using four large mobile applications and eight GNU applications shows that the performance of DiSCo is scalable and the performance is close to a profile scheduling.

KW - Compiler

KW - Distributed compiler

KW - Remote linking

UR - http://www.scopus.com/inward/record.url?scp=84878244982&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84878244982&partnerID=8YFLogxK

U2 - 10.1587/transinf.E96.D.589

DO - 10.1587/transinf.E96.D.589

M3 - Article

VL - E96-D

SP - 589

EP - 600

JO - IEICE Transactions on Information and Systems

JF - IEICE Transactions on Information and Systems

SN - 0916-8532

IS - 3

ER -