Adaptive Dynamic Programming - A New Tool for Intelligent Control


You are cordially invited to a talk by Prof. Derong Liu, a CIS Distinguished Lecturer.


The title of the talk is: "Adaptive Dynamic Programming - A New Tool for Intelligent Control".

The talk is sponsored by the Computational Intelligence Society under its Distinguished Lecturer Program and co-sponsored by the IEEE CIS South African Chapter.

Where and When

The talk will take place on 2 September from 11h00-12h30 at the Merensky II Library at the University of Pretoria in Hatfield, Pretoria.

Attendance is free, but registration is required. To register for the meeting, visit the following link:

More information about the talk and the speaker:


Adaptive Dynamic Programming - A New Tool for Intelligent Control


Professor Derong Liu, CIS Distinguished Lecturer, Institute of Automation, Chinese Academy of Sciences.

Adaptive Dynamic Programming (ADP) has received increasing attention recently. ADP scheme is a design that approximates dynamic programming in the general case, i.e. approximates optimal control over time in noisy, nonlinear environments. There are many engineering problems in practice which can be formulated as cost maximization or minimization problems. Dynamic programming is a very useful tool in solving these problems. However, it is often computationally untenable to run dynamic programming due to the backward numerical process required for its solutions. Over the years, progress has been made to provide approximate solutions to dynamic programming. The idea is to approximate dynamic programming solutions by using neural networks to approximate the cost function. The methodology is a very useful tool for building intelligent agents/controllers in almost any environment. This talk will review the theoretical development of ADP. Details about the training of the neural networks used in the present design will also be presented. The pole balancing (inverted pendulum) problem will be used as the benchmark in this presentation to show the applicability of ADP.

Derong Liu received the Ph.D. degree in electrical engineering from the University of Notre Dame in 1994. He was a Staff Fellow with General Motors Research and Development Center, Warren, MI, USA, from 1993 to 1995. He was an Assistant Professor in the Department of Electrical and Computer Engineering, Stevens Institute of Technology, Hoboken, NJ, USA, from 1995 to 1999. He joined the University of Illinois at Chicago in 1999, and became a Full Professor of electrical and computer engineering and of computer science in 2006. He was selected for the “100 Talents Program” by the Chinese Academy of Sciences in 2008. He has published 14 books. Currently, he is a Distinguished Lecturer of the IEEE Computational Intelligence Society and he is the Editor-in-Chief of the IEEE Transactions on Neural Networks and Learning Systems. He is the General Chair of 2014 IEEE World Congress on Computational Intelligence (Beijing, China) and the General Chair of 2016 World Congress on Intelligent Control and Automation (Guilin, China). He received the Faculty Early Career Development (CAREER) award from the National Science Foundation (1999), the University Scholar Award from University of Illinois (2006-2009), and the Overseas Outstanding Young Scholar Award from the National Natural Science Foundation of China (2008). He is a Fellow of the IEEE and a Fellow of the INNS.