An empirical study on software error detection: Voting, instrumentation and Fagan inspection

Sunsup So, Yongseop Lim, Sungdeok Cha, Yong Rae Kwon

Research output: Chapter in Book/Report/Conference proceedingConference contribution

4 Citations (Scopus)

Abstract

This paper presents the results of an experiment that compared error detection capability of voting, instrumentation, and Fagan inspection methods. Several experiments have measured effectiveness of various error detection methods. However, most experiments have used different programs; consequently, the results are generally incompatible and do not allow one to make objective comparison on the cost-effectiveness of various approaches. No software can be developed using unlimited amount of resources, practitioners need empirical and objective data on the cost-effectiveness of various errw detection methods to decide which methods to use during sojbvare development. Results of this experiment is significant because these methods have been applied to the same program. Futhermore, the participant 's educational and industrial experience are comparable to that of the previous experiments.. We conprmed the previous Pnding that detecting errors in reliable programs is diBcult; none of the three methods detected more than half of all the known errors in the programs. Of the three methods employed, participants detected more errors by using Fagan inspection method than they did by voting or instrumentation. When the average number of hours needed to detect an error was compared, Fagan inspection method was shown to be more cost-effective than instrumentation method.

Original languageEnglish
Title of host publicationProceedings - 1995 Asia Pacific Software Engineering Conference, APSEC 1995
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages345-350
Number of pages6
ISBN (Electronic)0818671718, 9780818671715
DOIs
Publication statusPublished - 1995 Jan 1
Externally publishedYes
Event1995 Asia Pacific Software Engineering Conference, APSEC 1995 - Brisbane, Australia
Duration: 1995 Dec 61995 Dec 9

Publication series

NameProceedings - 1995 Asia Pacific Software Engineering Conference, APSEC 1995

Conference

Conference1995 Asia Pacific Software Engineering Conference, APSEC 1995
CountryAustralia
CityBrisbane
Period95/12/695/12/9

Fingerprint

Error detection
Inspection
Cost effectiveness
Experiments
Costs

ASJC Scopus subject areas

  • Software
  • Safety, Risk, Reliability and Quality

Cite this

So, S., Lim, Y., Cha, S., & Kwon, Y. R. (1995). An empirical study on software error detection: Voting, instrumentation and Fagan inspection. In Proceedings - 1995 Asia Pacific Software Engineering Conference, APSEC 1995 (pp. 345-350). [496983] (Proceedings - 1995 Asia Pacific Software Engineering Conference, APSEC 1995). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/APSEC.1995.496983

An empirical study on software error detection : Voting, instrumentation and Fagan inspection. / So, Sunsup; Lim, Yongseop; Cha, Sungdeok; Kwon, Yong Rae.

Proceedings - 1995 Asia Pacific Software Engineering Conference, APSEC 1995. Institute of Electrical and Electronics Engineers Inc., 1995. p. 345-350 496983 (Proceedings - 1995 Asia Pacific Software Engineering Conference, APSEC 1995).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

So, S, Lim, Y, Cha, S & Kwon, YR 1995, An empirical study on software error detection: Voting, instrumentation and Fagan inspection. in Proceedings - 1995 Asia Pacific Software Engineering Conference, APSEC 1995., 496983, Proceedings - 1995 Asia Pacific Software Engineering Conference, APSEC 1995, Institute of Electrical and Electronics Engineers Inc., pp. 345-350, 1995 Asia Pacific Software Engineering Conference, APSEC 1995, Brisbane, Australia, 95/12/6. https://doi.org/10.1109/APSEC.1995.496983
So S, Lim Y, Cha S, Kwon YR. An empirical study on software error detection: Voting, instrumentation and Fagan inspection. In Proceedings - 1995 Asia Pacific Software Engineering Conference, APSEC 1995. Institute of Electrical and Electronics Engineers Inc. 1995. p. 345-350. 496983. (Proceedings - 1995 Asia Pacific Software Engineering Conference, APSEC 1995). https://doi.org/10.1109/APSEC.1995.496983
So, Sunsup ; Lim, Yongseop ; Cha, Sungdeok ; Kwon, Yong Rae. / An empirical study on software error detection : Voting, instrumentation and Fagan inspection. Proceedings - 1995 Asia Pacific Software Engineering Conference, APSEC 1995. Institute of Electrical and Electronics Engineers Inc., 1995. pp. 345-350 (Proceedings - 1995 Asia Pacific Software Engineering Conference, APSEC 1995).
@inproceedings{987767307ba94a8db439b6482b81996e,
title = "An empirical study on software error detection: Voting, instrumentation and Fagan inspection",
abstract = "This paper presents the results of an experiment that compared error detection capability of voting, instrumentation, and Fagan inspection methods. Several experiments have measured effectiveness of various error detection methods. However, most experiments have used different programs; consequently, the results are generally incompatible and do not allow one to make objective comparison on the cost-effectiveness of various approaches. No software can be developed using unlimited amount of resources, practitioners need empirical and objective data on the cost-effectiveness of various errw detection methods to decide which methods to use during sojbvare development. Results of this experiment is significant because these methods have been applied to the same program. Futhermore, the participant 's educational and industrial experience are comparable to that of the previous experiments.. We conprmed the previous Pnding that detecting errors in reliable programs is diBcult; none of the three methods detected more than half of all the known errors in the programs. Of the three methods employed, participants detected more errors by using Fagan inspection method than they did by voting or instrumentation. When the average number of hours needed to detect an error was compared, Fagan inspection method was shown to be more cost-effective than instrumentation method.",
author = "Sunsup So and Yongseop Lim and Sungdeok Cha and Kwon, {Yong Rae}",
year = "1995",
month = "1",
day = "1",
doi = "10.1109/APSEC.1995.496983",
language = "English",
series = "Proceedings - 1995 Asia Pacific Software Engineering Conference, APSEC 1995",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
pages = "345--350",
booktitle = "Proceedings - 1995 Asia Pacific Software Engineering Conference, APSEC 1995",

}

TY - GEN

T1 - An empirical study on software error detection

T2 - Voting, instrumentation and Fagan inspection

AU - So, Sunsup

AU - Lim, Yongseop

AU - Cha, Sungdeok

AU - Kwon, Yong Rae

PY - 1995/1/1

Y1 - 1995/1/1

N2 - This paper presents the results of an experiment that compared error detection capability of voting, instrumentation, and Fagan inspection methods. Several experiments have measured effectiveness of various error detection methods. However, most experiments have used different programs; consequently, the results are generally incompatible and do not allow one to make objective comparison on the cost-effectiveness of various approaches. No software can be developed using unlimited amount of resources, practitioners need empirical and objective data on the cost-effectiveness of various errw detection methods to decide which methods to use during sojbvare development. Results of this experiment is significant because these methods have been applied to the same program. Futhermore, the participant 's educational and industrial experience are comparable to that of the previous experiments.. We conprmed the previous Pnding that detecting errors in reliable programs is diBcult; none of the three methods detected more than half of all the known errors in the programs. Of the three methods employed, participants detected more errors by using Fagan inspection method than they did by voting or instrumentation. When the average number of hours needed to detect an error was compared, Fagan inspection method was shown to be more cost-effective than instrumentation method.

AB - This paper presents the results of an experiment that compared error detection capability of voting, instrumentation, and Fagan inspection methods. Several experiments have measured effectiveness of various error detection methods. However, most experiments have used different programs; consequently, the results are generally incompatible and do not allow one to make objective comparison on the cost-effectiveness of various approaches. No software can be developed using unlimited amount of resources, practitioners need empirical and objective data on the cost-effectiveness of various errw detection methods to decide which methods to use during sojbvare development. Results of this experiment is significant because these methods have been applied to the same program. Futhermore, the participant 's educational and industrial experience are comparable to that of the previous experiments.. We conprmed the previous Pnding that detecting errors in reliable programs is diBcult; none of the three methods detected more than half of all the known errors in the programs. Of the three methods employed, participants detected more errors by using Fagan inspection method than they did by voting or instrumentation. When the average number of hours needed to detect an error was compared, Fagan inspection method was shown to be more cost-effective than instrumentation method.

UR - http://www.scopus.com/inward/record.url?scp=77957000672&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=77957000672&partnerID=8YFLogxK

U2 - 10.1109/APSEC.1995.496983

DO - 10.1109/APSEC.1995.496983

M3 - Conference contribution

AN - SCOPUS:77957000672

T3 - Proceedings - 1995 Asia Pacific Software Engineering Conference, APSEC 1995

SP - 345

EP - 350

BT - Proceedings - 1995 Asia Pacific Software Engineering Conference, APSEC 1995

PB - Institute of Electrical and Electronics Engineers Inc.

ER -