Page 51 - Read Online
P. 51

Harib et al. Intell Robot 2022;2:37-71                      Intelligence & Robotics
               DOI: 10.20517/ir.2021.19



               Review                                                                        Open Access



               Evolution of adaptive learning for nonlinear dynamic

               systems: a systematic survey


                                           1
                             1
               Mouhcine Harib , Hicham Chaoui , Suruz Miah 2
               1
                Department of Electronics, Carleton University, Ottawa, ON K1S 5B6, Canada.
               2
                Electrical and Computer Engineering, Bradley University, Peoria, IL 61625, USA.
               Correspondence to: Prof. Hicham Chaoui, Department of Electronics, Carleton University, 7066 Minto Building, Ottawa, ON K1S
               5B6, Canada. E-mail: Hicham.Chaoui@carleton.ca
               How to cite this article: Harib M, Chaoui H, Miah S. Evolution of adaptive learning for nonlinear dynamic systems: a systematic
               survey. Intell Robot 2022;2:37-71. https://dx.doi.org/10.20517/ir.2021.19

               Received: 19 Dec 2021  First Decision: 20 Jan 2022  Revised: 3 Feb 2022  Accepted: 24 Feb 2022  Published: 16 Mar 2022

               Academic Editor: Simon X. Yang  Copy Editor: Xi-Jun Chen  Production Editor: Xi-Jun Chen

               Abstract
               The extreme nonlinearity of robotic systems renders the control design step harder. The consideration of adaptive
               control in robotic manipulation started in the 1970s. However, in the presence of bounded disturbances, the
               limitations of adaptive control rise considerably, which led researchers to exploit some “algorithm modifications”.
               Unfortunately, these modifications often require a priori knowledge of bounds on the parameters and the
               perturbations and noise. In the 1990s, the field of Artificial Neural Networks was hugely investigated in general, and
               for control of dynamical systems in particular. Several types of Neural Networks (NNs) appear to be promising
               candidates for control system applications. In robotics, it all boils down to making the actuator perform the desired
               action. While purely control-based robots use the system model to define their input-output relations, Artificial
               Intelligence (AI)-based robots may or may not use the system model and rather manipulate the robot based on the
               experience they have with the system while training or possibly enhance it in real-time as well. In this paper, after
               discussing the drawbacks of adaptive control with bounded disturbances and the proposed modifications to
               overcome these limitations, we focus on presenting the work that implemented AI in nonlinear dynamical systems
               and particularly in robotics. We cite some work that targeted the inverted pendulum control problem using NNs.
               Finally, we emphasize the previous research concerning RL and Deep RL-based control problems and their
               implementation in robotics manipulation, while highlighting some of their major drawbacks in the field.

               Keywords: Adaptive control, deep reinforcement learning, manipulators, neural networks, reinforcement learning,
               robotics








                           © The Author(s) 2022. Open Access This article is licensed under a Creative Commons Attribution 4.0
                           International License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, sharing,
                           adaptation, distribution and reproduction in any medium or format, for any purpose, even commercially, as
               long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and
               indicate if changes were made.

                                                                                           www.intellrobot.com
   46   47   48   49   50   51   52   53   54   55   56