Advanced job scheduler based on Markov availability model and resource selection in desktop grid computing environment

Eun Joung Byun, Sung Jin Choi, Hong Soo Kim, Chong Sun Hwang, Sang-Geun Lee

Research output: Contribution to journalArticle

1 Citation (Scopus)

Abstract

This chapter reviews dynamism in desktop Grid computing and explains the advanced stochastic scheduling scheme with the Markov Job Scheduler based on Availability (MJSA) in the environment. In recent years, Grid computing [1] has received considerable interest in the field of academics and enterprise. Numerous attempts have been made to organize cost efficient large-scale Grid computing. Desktop Grid computing [13,19,2] is a more flexible paradigm that is used to achieve high performance and high throughput with desktop resources that are less stable and has more inferior performance compared to traditional Grid. It is comprised of a diverse set of desktops interconnected with various network forms ranging from Local Area Network (LAN) to the Internet. Desktop Grid system has played a leading role in the development of large scale aggregated computing power harvested from the edge of the Internet at lower cost. The main goals of the system are to accomplish high throughput and performance by mobilizing the potential colossal computational resources of idle desktops. However, since a desktop peer is a fluctuating resource that connects to the system, performs computations and disconnects to the network at will, desktop volatility makes the system unstable and unreliable. To develop a reliable desktop Grid computing system, a scheduling scheme must consider the dynamic nature (i.e., volatility) of volunteers and a resource selection scheme should adapt to such a dynamic environment, as the selection is getting complicated due to the uncertain behavior of desktops. This chapter demonstrates desktop state change modelling and an advanced resource selection scheme, Selection of Credible Resource with Elastic Window (SCREW), to choose reliable resources in dynamic computational desktop Grid environments. Markov modelling of the dynamic state turning provides understanding of the pattern of desktop behavior while SCREW selects qualified desktops that satisfy time requirements to complete given workloads and adapts to the needs of the user and the application on the fly.

Original languageEnglish
Pages (from-to)153-171
Number of pages19
JournalStudies in Computational Intelligence
Volume146
DOIs
Publication statusPublished - 2008 Sep 18

Fingerprint

Grid computing
Availability
Scheduling
Throughput
Internet
Local area networks
Costs
Industry

Keywords

  • Desktop grid computing
  • Hidden Markov model
  • Markov modelling
  • Resource selection scheme
  • Stochastic scheduling

ASJC Scopus subject areas

  • Artificial Intelligence

Cite this

Advanced job scheduler based on Markov availability model and resource selection in desktop grid computing environment. / Byun, Eun Joung; Choi, Sung Jin; Kim, Hong Soo; Hwang, Chong Sun; Lee, Sang-Geun.

In: Studies in Computational Intelligence, Vol. 146, 18.09.2008, p. 153-171.

Research output: Contribution to journalArticle

@article{657962cb119843bda9dee04030fafec6,
title = "Advanced job scheduler based on Markov availability model and resource selection in desktop grid computing environment",
abstract = "This chapter reviews dynamism in desktop Grid computing and explains the advanced stochastic scheduling scheme with the Markov Job Scheduler based on Availability (MJSA) in the environment. In recent years, Grid computing [1] has received considerable interest in the field of academics and enterprise. Numerous attempts have been made to organize cost efficient large-scale Grid computing. Desktop Grid computing [13,19,2] is a more flexible paradigm that is used to achieve high performance and high throughput with desktop resources that are less stable and has more inferior performance compared to traditional Grid. It is comprised of a diverse set of desktops interconnected with various network forms ranging from Local Area Network (LAN) to the Internet. Desktop Grid system has played a leading role in the development of large scale aggregated computing power harvested from the edge of the Internet at lower cost. The main goals of the system are to accomplish high throughput and performance by mobilizing the potential colossal computational resources of idle desktops. However, since a desktop peer is a fluctuating resource that connects to the system, performs computations and disconnects to the network at will, desktop volatility makes the system unstable and unreliable. To develop a reliable desktop Grid computing system, a scheduling scheme must consider the dynamic nature (i.e., volatility) of volunteers and a resource selection scheme should adapt to such a dynamic environment, as the selection is getting complicated due to the uncertain behavior of desktops. This chapter demonstrates desktop state change modelling and an advanced resource selection scheme, Selection of Credible Resource with Elastic Window (SCREW), to choose reliable resources in dynamic computational desktop Grid environments. Markov modelling of the dynamic state turning provides understanding of the pattern of desktop behavior while SCREW selects qualified desktops that satisfy time requirements to complete given workloads and adapts to the needs of the user and the application on the fly.",
keywords = "Desktop grid computing, Hidden Markov model, Markov modelling, Resource selection scheme, Stochastic scheduling",
author = "Byun, {Eun Joung} and Choi, {Sung Jin} and Kim, {Hong Soo} and Hwang, {Chong Sun} and Sang-Geun Lee",
year = "2008",
month = "9",
day = "18",
doi = "10.1007/978-3-540-69277-5_6",
language = "English",
volume = "146",
pages = "153--171",
journal = "Studies in Computational Intelligence",
issn = "1860-949X",
publisher = "Springer Verlag",

}

TY - JOUR

T1 - Advanced job scheduler based on Markov availability model and resource selection in desktop grid computing environment

AU - Byun, Eun Joung

AU - Choi, Sung Jin

AU - Kim, Hong Soo

AU - Hwang, Chong Sun

AU - Lee, Sang-Geun

PY - 2008/9/18

Y1 - 2008/9/18

N2 - This chapter reviews dynamism in desktop Grid computing and explains the advanced stochastic scheduling scheme with the Markov Job Scheduler based on Availability (MJSA) in the environment. In recent years, Grid computing [1] has received considerable interest in the field of academics and enterprise. Numerous attempts have been made to organize cost efficient large-scale Grid computing. Desktop Grid computing [13,19,2] is a more flexible paradigm that is used to achieve high performance and high throughput with desktop resources that are less stable and has more inferior performance compared to traditional Grid. It is comprised of a diverse set of desktops interconnected with various network forms ranging from Local Area Network (LAN) to the Internet. Desktop Grid system has played a leading role in the development of large scale aggregated computing power harvested from the edge of the Internet at lower cost. The main goals of the system are to accomplish high throughput and performance by mobilizing the potential colossal computational resources of idle desktops. However, since a desktop peer is a fluctuating resource that connects to the system, performs computations and disconnects to the network at will, desktop volatility makes the system unstable and unreliable. To develop a reliable desktop Grid computing system, a scheduling scheme must consider the dynamic nature (i.e., volatility) of volunteers and a resource selection scheme should adapt to such a dynamic environment, as the selection is getting complicated due to the uncertain behavior of desktops. This chapter demonstrates desktop state change modelling and an advanced resource selection scheme, Selection of Credible Resource with Elastic Window (SCREW), to choose reliable resources in dynamic computational desktop Grid environments. Markov modelling of the dynamic state turning provides understanding of the pattern of desktop behavior while SCREW selects qualified desktops that satisfy time requirements to complete given workloads and adapts to the needs of the user and the application on the fly.

AB - This chapter reviews dynamism in desktop Grid computing and explains the advanced stochastic scheduling scheme with the Markov Job Scheduler based on Availability (MJSA) in the environment. In recent years, Grid computing [1] has received considerable interest in the field of academics and enterprise. Numerous attempts have been made to organize cost efficient large-scale Grid computing. Desktop Grid computing [13,19,2] is a more flexible paradigm that is used to achieve high performance and high throughput with desktop resources that are less stable and has more inferior performance compared to traditional Grid. It is comprised of a diverse set of desktops interconnected with various network forms ranging from Local Area Network (LAN) to the Internet. Desktop Grid system has played a leading role in the development of large scale aggregated computing power harvested from the edge of the Internet at lower cost. The main goals of the system are to accomplish high throughput and performance by mobilizing the potential colossal computational resources of idle desktops. However, since a desktop peer is a fluctuating resource that connects to the system, performs computations and disconnects to the network at will, desktop volatility makes the system unstable and unreliable. To develop a reliable desktop Grid computing system, a scheduling scheme must consider the dynamic nature (i.e., volatility) of volunteers and a resource selection scheme should adapt to such a dynamic environment, as the selection is getting complicated due to the uncertain behavior of desktops. This chapter demonstrates desktop state change modelling and an advanced resource selection scheme, Selection of Credible Resource with Elastic Window (SCREW), to choose reliable resources in dynamic computational desktop Grid environments. Markov modelling of the dynamic state turning provides understanding of the pattern of desktop behavior while SCREW selects qualified desktops that satisfy time requirements to complete given workloads and adapts to the needs of the user and the application on the fly.

KW - Desktop grid computing

KW - Hidden Markov model

KW - Markov modelling

KW - Resource selection scheme

KW - Stochastic scheduling

UR - http://www.scopus.com/inward/record.url?scp=51649118117&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=51649118117&partnerID=8YFLogxK

U2 - 10.1007/978-3-540-69277-5_6

DO - 10.1007/978-3-540-69277-5_6

M3 - Article

AN - SCOPUS:51649118117

VL - 146

SP - 153

EP - 171

JO - Studies in Computational Intelligence

JF - Studies in Computational Intelligence

SN - 1860-949X

ER -