Deep reinforcement learning in continuous action spaces: A case study in the game of simulated curling

Kyowoon Lee, Sol A. Kim, Jaesik Choi, Seong Whan Lee

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Citation (Scopus)

Abstract

Many real-world applications of reinforcement learning require an agent to select optimal actions from continuous action spaces. Recently, deep neural networks have successfully been applied to games with discrete actions spaces. However, deep neural networks for discrete actions are not suitable for devising strategies for games in which a very small change in an action can dramatically affect the outcome. In this paper, we present a new framework which incorporates a deep neural network that can be used to learn game strategies based on a kernel-based Monte Carlo tree search that finds actions within a continuous space. To avoid hand-crafted features, we train our network using supervised learning followed by reinforcement learning with a high-fidelity simulator for the Olympic sport of curling. The program trained under our framework outperforms existing programs equipped with several hand-crafted features and won an international digital curling competition.

Original languageEnglish
Title of host publication35th International Conference on Machine Learning, ICML 2018
EditorsJennifer Dy, Andreas Krause
PublisherInternational Machine Learning Society (IMLS)
Pages4587-4596
Number of pages10
Volume7
ISBN (Electronic)9781510867963
Publication statusPublished - 2018 Jan 1
Event35th International Conference on Machine Learning, ICML 2018 - Stockholm, Sweden
Duration: 2018 Jul 102018 Jul 15

Other

Other35th International Conference on Machine Learning, ICML 2018
CountrySweden
CityStockholm
Period18/7/1018/7/15

ASJC Scopus subject areas

  • Computational Theory and Mathematics
  • Human-Computer Interaction
  • Software

Fingerprint Dive into the research topics of 'Deep reinforcement learning in continuous action spaces: A case study in the game of simulated curling'. Together they form a unique fingerprint.

  • Cite this

    Lee, K., Kim, S. A., Choi, J., & Lee, S. W. (2018). Deep reinforcement learning in continuous action spaces: A case study in the game of simulated curling. In J. Dy, & A. Krause (Eds.), 35th International Conference on Machine Learning, ICML 2018 (Vol. 7, pp. 4587-4596). International Machine Learning Society (IMLS).