Mining biometric data to predict programmer expertise and task difficulty

Seolhwa Lee, Danial Hooshyar, Hyesung Ji, Kichun Nam, Heui Seok Lim

Research output: Contribution to journalArticle

4 Citations (Scopus)

Abstract

Programming mistakes frequently waste software developers’ time and may lead to the introduction of bugs into their software, causing serious risks for their customers. Using the correlation between various software process metrics and defects, earlier work has traditionally attempted to spot such bug risks. However, this study departs from previous works in examining a more direct method of using psycho-physiological sensors data to detect the difficulty of program comprehension tasks and programmer level of expertise. By conducting a study with 38 expert and novice programmers, we investigated how well an electroencephalography and an eye-tracker can be utilized in predicting programmer expertise (novice/expert) and task difficulty (easy/difficult). Using data from both sensors, we could predict task difficulty and programmer level of expertise with 64.9 and 97.7% precision and 68.6 and 96.4% recall, respectively. The result shows it is possible to predict the perceived difficulty of a task and expertise level for developers using psycho-physiological sensors data. In addition, we found that while using single biometric sensor shows good results, the composition of both sensors lead to the best overall performance.

Original languageEnglish
Pages (from-to)1-11
Number of pages11
JournalCluster Computing
DOIs
Publication statusAccepted/In press - 2017 Jan 21

Fingerprint

Biometrics
Sensors
Electroencephalography
Defects
Chemical analysis

Keywords

  • Biometric data
  • Code comprehension
  • Machine learning
  • Programming expertise
  • Task difficulty

ASJC Scopus subject areas

  • Software
  • Computer Networks and Communications

Cite this

Mining biometric data to predict programmer expertise and task difficulty. / Lee, Seolhwa; Hooshyar, Danial; Ji, Hyesung; Nam, Kichun; Lim, Heui Seok.

In: Cluster Computing, 21.01.2017, p. 1-11.

Research output: Contribution to journalArticle

Lee, Seolhwa ; Hooshyar, Danial ; Ji, Hyesung ; Nam, Kichun ; Lim, Heui Seok. / Mining biometric data to predict programmer expertise and task difficulty. In: Cluster Computing. 2017 ; pp. 1-11.
@article{63ed2c09e0b643a9bf23295def8cfc8b,
title = "Mining biometric data to predict programmer expertise and task difficulty",
abstract = "Programming mistakes frequently waste software developers’ time and may lead to the introduction of bugs into their software, causing serious risks for their customers. Using the correlation between various software process metrics and defects, earlier work has traditionally attempted to spot such bug risks. However, this study departs from previous works in examining a more direct method of using psycho-physiological sensors data to detect the difficulty of program comprehension tasks and programmer level of expertise. By conducting a study with 38 expert and novice programmers, we investigated how well an electroencephalography and an eye-tracker can be utilized in predicting programmer expertise (novice/expert) and task difficulty (easy/difficult). Using data from both sensors, we could predict task difficulty and programmer level of expertise with 64.9 and 97.7{\%} precision and 68.6 and 96.4{\%} recall, respectively. The result shows it is possible to predict the perceived difficulty of a task and expertise level for developers using psycho-physiological sensors data. In addition, we found that while using single biometric sensor shows good results, the composition of both sensors lead to the best overall performance.",
keywords = "Biometric data, Code comprehension, Machine learning, Programming expertise, Task difficulty",
author = "Seolhwa Lee and Danial Hooshyar and Hyesung Ji and Kichun Nam and Lim, {Heui Seok}",
year = "2017",
month = "1",
day = "21",
doi = "10.1007/s10586-017-0746-2",
language = "English",
pages = "1--11",
journal = "Cluster Computing",
issn = "1386-7857",
publisher = "Kluwer Academic Publishers",

}

TY - JOUR

T1 - Mining biometric data to predict programmer expertise and task difficulty

AU - Lee, Seolhwa

AU - Hooshyar, Danial

AU - Ji, Hyesung

AU - Nam, Kichun

AU - Lim, Heui Seok

PY - 2017/1/21

Y1 - 2017/1/21

N2 - Programming mistakes frequently waste software developers’ time and may lead to the introduction of bugs into their software, causing serious risks for their customers. Using the correlation between various software process metrics and defects, earlier work has traditionally attempted to spot such bug risks. However, this study departs from previous works in examining a more direct method of using psycho-physiological sensors data to detect the difficulty of program comprehension tasks and programmer level of expertise. By conducting a study with 38 expert and novice programmers, we investigated how well an electroencephalography and an eye-tracker can be utilized in predicting programmer expertise (novice/expert) and task difficulty (easy/difficult). Using data from both sensors, we could predict task difficulty and programmer level of expertise with 64.9 and 97.7% precision and 68.6 and 96.4% recall, respectively. The result shows it is possible to predict the perceived difficulty of a task and expertise level for developers using psycho-physiological sensors data. In addition, we found that while using single biometric sensor shows good results, the composition of both sensors lead to the best overall performance.

AB - Programming mistakes frequently waste software developers’ time and may lead to the introduction of bugs into their software, causing serious risks for their customers. Using the correlation between various software process metrics and defects, earlier work has traditionally attempted to spot such bug risks. However, this study departs from previous works in examining a more direct method of using psycho-physiological sensors data to detect the difficulty of program comprehension tasks and programmer level of expertise. By conducting a study with 38 expert and novice programmers, we investigated how well an electroencephalography and an eye-tracker can be utilized in predicting programmer expertise (novice/expert) and task difficulty (easy/difficult). Using data from both sensors, we could predict task difficulty and programmer level of expertise with 64.9 and 97.7% precision and 68.6 and 96.4% recall, respectively. The result shows it is possible to predict the perceived difficulty of a task and expertise level for developers using psycho-physiological sensors data. In addition, we found that while using single biometric sensor shows good results, the composition of both sensors lead to the best overall performance.

KW - Biometric data

KW - Code comprehension

KW - Machine learning

KW - Programming expertise

KW - Task difficulty

UR - http://www.scopus.com/inward/record.url?scp=85009885123&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85009885123&partnerID=8YFLogxK

U2 - 10.1007/s10586-017-0746-2

DO - 10.1007/s10586-017-0746-2

M3 - Article

AN - SCOPUS:85009885123

SP - 1

EP - 11

JO - Cluster Computing

JF - Cluster Computing

SN - 1386-7857

ER -