Automated test case generation for FBD programs implementing reactor protection system software

Eunkyoung Jee, Donghwan Shin, Sungdeok Cha, Jang Soo Lee, Doo Hwan Bae

Research output: Contribution to journalArticle

16 Citations (Scopus)

Abstract

Automated and effective testing for function block diagram (FBD) programs has become an important issue, as FBD is increasingly used in implementing safety-critical systems. This work describes an automated test case generation technique for FBD programs and its associated tool-FBDTester. Given an FBD program and desired test coverage criteria, FBDTester generates test requirements and invokes the Satisfiability Modulo Theories solver iteratively to derive a set of test cases. An industrial case study using reactor protection system software shows that the automatically generated test suites detected at least 82% of the known faults, whereas manually generated test cases only detected approximately 35%. Mutation analysis revealed that the automatically generated test suites substantially outperformed manually generated ones. Although test sequence generation requires some manual effort in the current FBDTester, it is apparent that the proposed approach significantly improves the efficiency and the reliability of FBD testing.

Original languageEnglish
Pages (from-to)608-628
Number of pages21
JournalSoftware Testing Verification and Reliability
Volume24
Issue number8
DOIs
Publication statusPublished - 2014 Jan 1

Fingerprint

Testing

Cite this

Automated test case generation for FBD programs implementing reactor protection system software. / Jee, Eunkyoung; Shin, Donghwan; Cha, Sungdeok; Lee, Jang Soo; Bae, Doo Hwan.

In: Software Testing Verification and Reliability, Vol. 24, No. 8, 01.01.2014, p. 608-628.

Research output: Contribution to journalArticle

Jee, Eunkyoung ; Shin, Donghwan ; Cha, Sungdeok ; Lee, Jang Soo ; Bae, Doo Hwan. / Automated test case generation for FBD programs implementing reactor protection system software. In: Software Testing Verification and Reliability. 2014 ; Vol. 24, No. 8. pp. 608-628.
@article{5bac971c186b489ca4d7016e691428c4,
title = "Automated test case generation for FBD programs implementing reactor protection system software",
abstract = "Automated and effective testing for function block diagram (FBD) programs has become an important issue, as FBD is increasingly used in implementing safety-critical systems. This work describes an automated test case generation technique for FBD programs and its associated tool-FBDTester. Given an FBD program and desired test coverage criteria, FBDTester generates test requirements and invokes the Satisfiability Modulo Theories solver iteratively to derive a set of test cases. An industrial case study using reactor protection system software shows that the automatically generated test suites detected at least 82{\%} of the known faults, whereas manually generated test cases only detected approximately 35{\%}. Mutation analysis revealed that the automatically generated test suites substantially outperformed manually generated ones. Although test sequence generation requires some manual effort in the current FBDTester, it is apparent that the proposed approach significantly improves the efficiency and the reliability of FBD testing.",
keywords = "Automated test case generation, Function block diagram, Programmable logic controller, SMT solver",
author = "Eunkyoung Jee and Donghwan Shin and Sungdeok Cha and Lee, {Jang Soo} and Bae, {Doo Hwan}",
year = "2014",
month = "1",
day = "1",
doi = "10.1002/stvr.1548",
language = "English",
volume = "24",
pages = "608--628",
journal = "Software Testing Verification and Reliability",
issn = "0960-0833",
publisher = "John Wiley and Sons Ltd",
number = "8",

}

TY - JOUR

T1 - Automated test case generation for FBD programs implementing reactor protection system software

AU - Jee, Eunkyoung

AU - Shin, Donghwan

AU - Cha, Sungdeok

AU - Lee, Jang Soo

AU - Bae, Doo Hwan

PY - 2014/1/1

Y1 - 2014/1/1

N2 - Automated and effective testing for function block diagram (FBD) programs has become an important issue, as FBD is increasingly used in implementing safety-critical systems. This work describes an automated test case generation technique for FBD programs and its associated tool-FBDTester. Given an FBD program and desired test coverage criteria, FBDTester generates test requirements and invokes the Satisfiability Modulo Theories solver iteratively to derive a set of test cases. An industrial case study using reactor protection system software shows that the automatically generated test suites detected at least 82% of the known faults, whereas manually generated test cases only detected approximately 35%. Mutation analysis revealed that the automatically generated test suites substantially outperformed manually generated ones. Although test sequence generation requires some manual effort in the current FBDTester, it is apparent that the proposed approach significantly improves the efficiency and the reliability of FBD testing.

AB - Automated and effective testing for function block diagram (FBD) programs has become an important issue, as FBD is increasingly used in implementing safety-critical systems. This work describes an automated test case generation technique for FBD programs and its associated tool-FBDTester. Given an FBD program and desired test coverage criteria, FBDTester generates test requirements and invokes the Satisfiability Modulo Theories solver iteratively to derive a set of test cases. An industrial case study using reactor protection system software shows that the automatically generated test suites detected at least 82% of the known faults, whereas manually generated test cases only detected approximately 35%. Mutation analysis revealed that the automatically generated test suites substantially outperformed manually generated ones. Although test sequence generation requires some manual effort in the current FBDTester, it is apparent that the proposed approach significantly improves the efficiency and the reliability of FBD testing.

KW - Automated test case generation

KW - Function block diagram

KW - Programmable logic controller

KW - SMT solver

UR - http://www.scopus.com/inward/record.url?scp=84911432036&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84911432036&partnerID=8YFLogxK

U2 - 10.1002/stvr.1548

DO - 10.1002/stvr.1548

M3 - Article

AN - SCOPUS:84911432036

VL - 24

SP - 608

EP - 628

JO - Software Testing Verification and Reliability

JF - Software Testing Verification and Reliability

SN - 0960-0833

IS - 8

ER -