A systematic review of data-driven approaches in player modeling of educational games

Danial Hooshyar, Moslem Yousefi, Heui Seok Lim

Research output: Contribution to journalArticle

6 Citations (Scopus)

Abstract

Recent years have seen growing interest in open-ended interactive educational tools such as games. One of the most crucial aspects of developing games lies in modeling and predicting individual behavior, the study of computational models of players in games. Although model-based approaches have been considered standard for this purpose, their application is often extremely difficult due to the huge space of actions that can be created by educational games. For this reason, data-driven approaches have shown promise, in part because they are not completely reliant on expert knowledge. This study seeks to systematically review the existing research on the use of data-driven approaches in player modeling of educational games. The primary objectives of this study are to identify, classify, and bring together the relevant approaches. We have carefully surveyed a 10-year sample (2008–2017) of research studies conducted on data-driven approaches in player modeling of educational games, and thereby found 67 significant research works. However, our criteria for inclusion reduced the sample to 21 studies that addressed four primary research questions, and so we analyzed and classified the questions, methods, and findings of these published works, which we evaluated and from which we drew conclusions based on non-statistical methods. We found that there are three primary avenues along which data-driven approaches have been studied in educational games research: first, the objective of data-driven approaches in player modeling of educational games, namely behavior modeling, goal recognition, and procedural content generation; second, approaches employed in such modeling; finally, current challenges of using data-driven approaches in player modeling of educational games, namely game data, temporal forecasting in player models, statistical techniques, algorithmic efficiency, knowledge engineering, problem of generalizability, and data sparsity problem. In conclusion we addressed four critical future challenges in the area, namely, the lack of proper and rich data publicly available to the researchers, the lack of a data-driven method to identify conceptual features from log data, hybrid player modeling approaches, and data mining techniques for individual prediction.

Original languageEnglish
Pages (from-to)1-21
Number of pages21
JournalArtificial Intelligence Review
DOIs
Publication statusAccepted/In press - 2017 Dec 30

Fingerprint

Knowledge engineering
Data mining
Education
Data-driven
Systematic Review
Modeling
Players
expert knowledge
lack
inclusion
engineering
efficiency
Statistical Models
Prediction
Inclusion
Procedural
Educational Tool
Statistical Model
Computational Model
Data Mining

Keywords

  • Data-driven approach
  • Educational games
  • Player modeling
  • Systematic literature review (SLR)
  • User modeling

ASJC Scopus subject areas

  • Language and Linguistics
  • Linguistics and Language
  • Artificial Intelligence

Cite this

A systematic review of data-driven approaches in player modeling of educational games. / Hooshyar, Danial; Yousefi, Moslem; Lim, Heui Seok.

In: Artificial Intelligence Review, 30.12.2017, p. 1-21.

Research output: Contribution to journalArticle

@article{050b9ad9952d42239a8766b3ba36e89c,
title = "A systematic review of data-driven approaches in player modeling of educational games",
abstract = "Recent years have seen growing interest in open-ended interactive educational tools such as games. One of the most crucial aspects of developing games lies in modeling and predicting individual behavior, the study of computational models of players in games. Although model-based approaches have been considered standard for this purpose, their application is often extremely difficult due to the huge space of actions that can be created by educational games. For this reason, data-driven approaches have shown promise, in part because they are not completely reliant on expert knowledge. This study seeks to systematically review the existing research on the use of data-driven approaches in player modeling of educational games. The primary objectives of this study are to identify, classify, and bring together the relevant approaches. We have carefully surveyed a 10-year sample (2008–2017) of research studies conducted on data-driven approaches in player modeling of educational games, and thereby found 67 significant research works. However, our criteria for inclusion reduced the sample to 21 studies that addressed four primary research questions, and so we analyzed and classified the questions, methods, and findings of these published works, which we evaluated and from which we drew conclusions based on non-statistical methods. We found that there are three primary avenues along which data-driven approaches have been studied in educational games research: first, the objective of data-driven approaches in player modeling of educational games, namely behavior modeling, goal recognition, and procedural content generation; second, approaches employed in such modeling; finally, current challenges of using data-driven approaches in player modeling of educational games, namely game data, temporal forecasting in player models, statistical techniques, algorithmic efficiency, knowledge engineering, problem of generalizability, and data sparsity problem. In conclusion we addressed four critical future challenges in the area, namely, the lack of proper and rich data publicly available to the researchers, the lack of a data-driven method to identify conceptual features from log data, hybrid player modeling approaches, and data mining techniques for individual prediction.",
keywords = "Data-driven approach, Educational games, Player modeling, Systematic literature review (SLR), User modeling",
author = "Danial Hooshyar and Moslem Yousefi and Lim, {Heui Seok}",
year = "2017",
month = "12",
day = "30",
doi = "10.1007/s10462-017-9609-8",
language = "English",
pages = "1--21",
journal = "Artificial Intelligence Review",
issn = "0269-2821",
publisher = "Springer Netherlands",

}

TY - JOUR

T1 - A systematic review of data-driven approaches in player modeling of educational games

AU - Hooshyar, Danial

AU - Yousefi, Moslem

AU - Lim, Heui Seok

PY - 2017/12/30

Y1 - 2017/12/30

N2 - Recent years have seen growing interest in open-ended interactive educational tools such as games. One of the most crucial aspects of developing games lies in modeling and predicting individual behavior, the study of computational models of players in games. Although model-based approaches have been considered standard for this purpose, their application is often extremely difficult due to the huge space of actions that can be created by educational games. For this reason, data-driven approaches have shown promise, in part because they are not completely reliant on expert knowledge. This study seeks to systematically review the existing research on the use of data-driven approaches in player modeling of educational games. The primary objectives of this study are to identify, classify, and bring together the relevant approaches. We have carefully surveyed a 10-year sample (2008–2017) of research studies conducted on data-driven approaches in player modeling of educational games, and thereby found 67 significant research works. However, our criteria for inclusion reduced the sample to 21 studies that addressed four primary research questions, and so we analyzed and classified the questions, methods, and findings of these published works, which we evaluated and from which we drew conclusions based on non-statistical methods. We found that there are three primary avenues along which data-driven approaches have been studied in educational games research: first, the objective of data-driven approaches in player modeling of educational games, namely behavior modeling, goal recognition, and procedural content generation; second, approaches employed in such modeling; finally, current challenges of using data-driven approaches in player modeling of educational games, namely game data, temporal forecasting in player models, statistical techniques, algorithmic efficiency, knowledge engineering, problem of generalizability, and data sparsity problem. In conclusion we addressed four critical future challenges in the area, namely, the lack of proper and rich data publicly available to the researchers, the lack of a data-driven method to identify conceptual features from log data, hybrid player modeling approaches, and data mining techniques for individual prediction.

AB - Recent years have seen growing interest in open-ended interactive educational tools such as games. One of the most crucial aspects of developing games lies in modeling and predicting individual behavior, the study of computational models of players in games. Although model-based approaches have been considered standard for this purpose, their application is often extremely difficult due to the huge space of actions that can be created by educational games. For this reason, data-driven approaches have shown promise, in part because they are not completely reliant on expert knowledge. This study seeks to systematically review the existing research on the use of data-driven approaches in player modeling of educational games. The primary objectives of this study are to identify, classify, and bring together the relevant approaches. We have carefully surveyed a 10-year sample (2008–2017) of research studies conducted on data-driven approaches in player modeling of educational games, and thereby found 67 significant research works. However, our criteria for inclusion reduced the sample to 21 studies that addressed four primary research questions, and so we analyzed and classified the questions, methods, and findings of these published works, which we evaluated and from which we drew conclusions based on non-statistical methods. We found that there are three primary avenues along which data-driven approaches have been studied in educational games research: first, the objective of data-driven approaches in player modeling of educational games, namely behavior modeling, goal recognition, and procedural content generation; second, approaches employed in such modeling; finally, current challenges of using data-driven approaches in player modeling of educational games, namely game data, temporal forecasting in player models, statistical techniques, algorithmic efficiency, knowledge engineering, problem of generalizability, and data sparsity problem. In conclusion we addressed four critical future challenges in the area, namely, the lack of proper and rich data publicly available to the researchers, the lack of a data-driven method to identify conceptual features from log data, hybrid player modeling approaches, and data mining techniques for individual prediction.

KW - Data-driven approach

KW - Educational games

KW - Player modeling

KW - Systematic literature review (SLR)

KW - User modeling

UR - http://www.scopus.com/inward/record.url?scp=85039702872&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85039702872&partnerID=8YFLogxK

U2 - 10.1007/s10462-017-9609-8

DO - 10.1007/s10462-017-9609-8

M3 - Article

AN - SCOPUS:85039702872

SP - 1

EP - 21

JO - Artificial Intelligence Review

JF - Artificial Intelligence Review

SN - 0269-2821

ER -