The application of control using Neuro-Dynamic Programming with a feature map

Dong Kyu Kim, Joeng Ho Ahn, Kwang Soon Lee, Dae Ryook Yang

Research output: Chapter in Book/Report/Conference proceedingConference contribution


For the general nonlinear processes control problem, the most rigorous approach is to use dynamic optimization. However, as the size of the problem grows, the Dynamic Programming (DP) approach is suffered from the burden of calculation which is called as 'Curse of Dimensionality'. To overcome this problem, a cost-approximator can be used to obtain the optimal control input policy minimizing the value of cost, called the Neuro-Dynamic Programming (NDP) algorithm. in this study, the NDP algorithm was applied to pH neutralization process in both simulations and experiments. A systematic approach of NDP to a pH neutralization process has been proposed and the performance of the NDP approach has been evaluated through the comparison with PI control. Also, a few related issues such as selection of approximator and a feature map of the states are investigated.

Original languageEnglish
Title of host publicationProceedings of the 16th IFAC World Congress, IFAC 2005
PublisherIFAC Secretariat
Number of pages6
ISBN (Print)008045108X, 9780080451084
Publication statusPublished - 2005

Publication series

NameIFAC Proceedings Volumes (IFAC-PapersOnline)
ISSN (Print)1474-6670


  • Feature map
  • K-nearest neighbor method (kNN)
  • Neural network (NN)
  • The Neuro-Dynamic Programming (NDP)
  • pH neutralization process

ASJC Scopus subject areas

  • Control and Systems Engineering


Dive into the research topics of 'The application of control using Neuro-Dynamic Programming with a feature map'. Together they form a unique fingerprint.

Cite this