The application of control using Neuro-Dynamic Programming with a feature map

Dong Kyu Kim, Joeng Ho Ahn, Kwang Soon Lee, Dae Ryook Yang

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

For the general nonlinear processes control problem, the most rigorous approach is to use dynamic optimization. However, as the size of the problem grows, the Dynamic Programming (DP) approach is suffered from the burden of calculation which is called as 'Curse of Dimensionality'. To overcome this problem, a cost-approximator can be used to obtain the optimal control input policy minimizing the value of cost, called the Neuro-Dynamic Programming (NDP) algorithm. in this study, the NDP algorithm was applied to pH neutralization process in both simulations and experiments. A systematic approach of NDP to a pH neutralization process has been proposed and the performance of the NDP approach has been evaluated through the comparison with PI control. Also, a few related issues such as selection of approximator and a feature map of the states are investigated.

Original languageEnglish
Title of host publicationIFAC Proceedings Volumes (IFAC-PapersOnline)
Pages995-1000
Number of pages6
Volume16
Publication statusPublished - 2005 Dec 1
Event16th Triennial World Congress of International Federation of Automatic Control, IFAC 2005 - Prague, Czech Republic
Duration: 2005 Jul 32005 Jul 8

Other

Other16th Triennial World Congress of International Federation of Automatic Control, IFAC 2005
CountryCzech Republic
CityPrague
Period05/7/305/7/8

    Fingerprint

Keywords

  • Feature map
  • K-nearest neighbor method (kNN)
  • Neural network (NN)
  • pH neutralization process
  • The Neuro-Dynamic Programming (NDP)

ASJC Scopus subject areas

  • Control and Systems Engineering

Cite this

Kim, D. K., Ahn, J. H., Lee, K. S., & Yang, D. R. (2005). The application of control using Neuro-Dynamic Programming with a feature map. In IFAC Proceedings Volumes (IFAC-PapersOnline) (Vol. 16, pp. 995-1000)