Uncertainty of Rules Extracted from Artificial Neural Networks

Hurnjoo Lee, Hyeoncheol Kim

Research output: Contribution to journalArticlepeer-review

Abstract

Artificial neural networks evolve into deep learning recently and perform well in various fields, such as image and speech recognition and translation. However, there is a problem that it is difficult for a person to understand what exactly the trained knowledge of an artificial neural network. As one of the methods for solving the problem of the artificial neural network, rule extraction methods had been devised. In this study, rules are extracted from artificial neural networks using ordered-attribute search (OAS) algorithm, which is one of the methods of extracting rules from trained neural networks, and the rules are analyzed to improve the extracted rules. As a result, we found that when the output value of the hidden layer has an intermediate value that is not close to 0 or 1 after passing through the sigmoid function, the problem of rule uncertainty occurs and affects the accuracy of the rules. In order to solve the uncertainty problem of the rules, we applied the hidden unit clarification method and suggested that it is possible to extract the efficient rule by binarizing the hidden layer output value. In addition, we extracted CDRPs (critical data routing paths) from the trained neural networks and used CDRPs to prune the extracted rules, which showed that the uncertainty problem of rules can be improved.

Original languageEnglish
Pages (from-to)589-604
Number of pages16
JournalApplied Artificial Intelligence
Volume35
Issue number8
DOIs
Publication statusPublished - 2021

ASJC Scopus subject areas

  • Artificial Intelligence

Fingerprint

Dive into the research topics of 'Uncertainty of Rules Extracted from Artificial Neural Networks'. Together they form a unique fingerprint.

Cite this