TY - JOUR
T1 - GUI information-based interaction logging and visualization for asynchronous usability testing
AU - Jeong, Jong Wook
AU - Kim, Neung Hoe
AU - In, Hoh Peter
N1 - Funding Information:
This research was supported by the MSIP ( Ministry of Science, ICT and Future Planning ), Korea, under the ITRC (Information Technology Research Center) support program ( IITP-2016-R0992-16-1011 ) supervised by the IITP(Institute for Information & communications Technology Promotion).
PY - 2020/8/1
Y1 - 2020/8/1
N2 - Asynchronous usability testing is efficient and promising usability testing methodology. However, evaluators are required to dedicate a considerable amount of effort for identifying usability problems in asynchronous testing. Evaluators cannot observe user interactions directly; only the collected data is available to them for identifying the usability problems. To reduce the amount of effort required, this paper presents a framework and tool for interaction visualization. This framework tracing user interactions based on meaningful GUI changes. The collected interaction log is visualized in a way that is similar to the visualization of traversed path used in web domains. Using our approach, the evaluator shall be able to understand user behavior more easily. In addition, we designed a black-box-based interaction logging for minimizing the implementation costs. Our tool especially helpful when testing has a large number of interaction data to analyze. To evaluate the proposed framework and tool, user interaction data were collected, and the results were evaluated by mobile application experts. The evaluation results demonstrate that the user interaction data traced by the proposed framework accurately reflect the user interactions and that the visualization results are valid.
AB - Asynchronous usability testing is efficient and promising usability testing methodology. However, evaluators are required to dedicate a considerable amount of effort for identifying usability problems in asynchronous testing. Evaluators cannot observe user interactions directly; only the collected data is available to them for identifying the usability problems. To reduce the amount of effort required, this paper presents a framework and tool for interaction visualization. This framework tracing user interactions based on meaningful GUI changes. The collected interaction log is visualized in a way that is similar to the visualization of traversed path used in web domains. Using our approach, the evaluator shall be able to understand user behavior more easily. In addition, we designed a black-box-based interaction logging for minimizing the implementation costs. Our tool especially helpful when testing has a large number of interaction data to analyze. To evaluate the proposed framework and tool, user interaction data were collected, and the results were evaluated by mobile application experts. The evaluation results demonstrate that the user interaction data traced by the proposed framework accurately reflect the user interactions and that the visualization results are valid.
KW - Asynchronous remote usability testing
KW - Mobile application
KW - Remote usability testing
KW - Usability testing
UR - http://www.scopus.com/inward/record.url?scp=85082936567&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85082936567&partnerID=8YFLogxK
U2 - 10.1016/j.eswa.2020.113289
DO - 10.1016/j.eswa.2020.113289
M3 - Article
AN - SCOPUS:85082936567
VL - 151
JO - Expert Systems with Applications
JF - Expert Systems with Applications
SN - 0957-4174
M1 - 113289
ER -