Buy (600 RUB)
|Generate QR code
Open Access
Subscription or Fee Access
Structural and Parametric Synthesis of Neural Network Controllers for Control Objects with Limiters
https://doi.org/10.17587/mau.24.563-572
Abstract
The article presents a methodology for the synthesis of digital control systems for nonlinear objects with limiters under conditions of incomplete information. Closed-loop tracking systems with negative feedback are considered. Artificial neural networks are proposed to build a controller, which is included in series with the control object. This approach is effective when known classical methods do not allow to synthesize control. This is the case, for example, if the mathematical model is essentially nonlinear and is not fully defined. The developed methods allow us to expand the class of technical systems, for which the direct (without using various kinds of simplifications) synthesis of control laws that are close to optimal is possible. In addition, neural network controllers possess the properties of robustness, adaptivity, and are initially digital, i.e. those qualities, which are very much in demand in practice. In article main attention is given to such problems, as a choice of neural network structure for neural simulator and neural controller, construction of training sample, ensuring convergence of the process of weights correction. For training neural networks the method of back propagation of error is used as a basic one. The effectiveness of the proposed technique is demonstrated by the example of the synthesis of a neuroregulator for a specific technical object and its comparison with classical control systems. It should be noted that today neural network technologies are widespread enough in various spheres of activity. The successes demonstrated in sound processing, image processing, automatic translation, in navigation systems, in big data processing are impressive. However, their application in automatic control systems is not so widespread. The authors of this article believe that the potential of artificial neural networks can be used in this direction. It should be understood that the use of neural networks is effective only under certain conditions and properties of the control object.
Supporting agencies: The research was carried out at the expense of the grant of the Russian Science Foundation No. 23-29-00609.
About the Authors
S. V. Feofilov
Tula State University
Russian Federation
Russian Federation
Feofilov Sergey V., Dr. of Eng. Sc., Professor
Tula, 300012
A. V. Kozyr
Tula State University
Russian Federation
Russian Federation
Tula, 300012
D. L. Khapkin
Tula State University
Russian Federation
Russian Federation
Tula, 300012
References
1. Sünderhauf N., Brock O., Scheirer W., Hadsell R., Fox D., Leitner J., Upcroft B., Abbeel P., Burgard W., Milford M., Corke P. The Limits and Potentials of Deep Learning for Robotics, arXiv:1804.06557, arXiv, 2018.
2. Beard R. W., McLain T. W. Small Unmanned Aircraft: Theory and Practice. Small Unmanned Aircraft, Princeton University Press, 2012, pp. 317.
3. Kaess M., Johannsson H., Roberts R., Ila V., Leonard J. J., Dellaert F. iSAM2: Incremental smoothing and mapping using the Bayes tree, The International Journal of Robotics Research, 2012, vol. 31, no. 2, pp. 216—235.
4. Huang S., Papernot N., Goodfellow I., Duan Y., Abbeel P. Adversarial Attacks on Neural Network Policies, arXiv:1702.02284, arXiv, 2017.
5. Bendale A., Boult T. Towards Open World Recognition, Proceeding of 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2015, pp. 1893—1902.
6. Fabiani F., Goulart P. J. Neural network controllers for uncertain linear systems, arXiv:2204.13209, arXiv, 2022.
7. Jabali M. B. A., Kazemi M. H. Uncertain polytopic LPV modelling of robot manipulators and trajectory tracking, International Journal of Control, Automation and Systems, 2017. vol. 15, no. 2, pp. 883—891.
8. Li S., Ozturk E., De Wagter C., Croon G. C. H. E. de, Izzo D. Aggressive Online Control of a Quadrotor via Deep Network Representations of Optimality Principles, Proceeding of 2020 IEEE International Conference on Robotics and Automation (ICRA), Paris, France, IEEE. 2020, pp. 6282—6287.
9. Chernodub A. N., Dzyuba D. A. Review of methods, Problemy programmirovaniya, 2011, no 2, pp. 79—94 (In Russian).
10. Ekman M. Learning Deep Learning: Theory and Practice of Neural Networks, Computer Vision, Natural Language Processing, and Transformers Using TensorFlow. Learning Deep Learning, Addison-Wesley, 2022, 688 p.
11. Izzo D., Öztürk E. Real-Time Guidance for Low-Thrust Transfers Using Deep Neural Networks, Journal of Guidance, Control, and Dynamics, 2021, vol. 44, no. 2, pp. 315—327.
12. Reifman J., Feldman E. E. Nonlinear programming with feedforward neural networks, IJCNN’99. International Joint Conference on Neural Networks. Proceedings (Cat. No.99CH36339), 1999, vol. 1, pp. 594—598.
13. Effati S., Baymani M. A new nonlinear neural network for solving quadratic programming problems, Applied Mathematics and Computation, 2005, vol. 165, no. 3, pp. 719—729.
14. Niestroy M. Optimal feedback controller approximation using neural networks and nonlinear programming techniques, 1998 IEEE International Joint Conference on Neural Networks Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98CH36227), 1998, vol. 3, pp. 2110—2115.
15. Nakamura-Zimmerer T., Gong Q., Kang W. A Causality-Free Neural Network Method for High-Dimensional Hamilton-Jacobi-Bellman Equations, Proceeding of 2020 American Control Conference (ACC), 2020, pp. 787—793.
16. Nakamura-Zimmerer T., Gong Q., Kang W. Adaptive Deep Learning for High-Dimensional Hamilton-Jacobi-Bellman Equations, SIAM Journal on Scientific Computing, 2021, vol. 43, no. 2, pp. A1221—A1247.
17. Nakamura-Zimmerer T., Gong Q., Kang W. QRnet: Optimal Regulator Design With LQR-Augmented Neural Networks, IEEE Control Systems Letters, 2021, vol. 5, no. 4, pp. 1303—1308.
18. Yang X., Liu D., Huang Y. Neural-netw ork-based online optimal control for uncertain non-linear continuous-time systems with control constraints, IET Control Theory & Applications, 2013, vol. 7, no. 17, pp. 2037—2047.
19. Parrilo P. A. Structured Semidefinite Programs and Semialgebraic Geometry Methods in Robustness and Opti mization, California Institute of Technology, 2000, pp. 234.
20. Lofberg J. Pre- and Post-Processing Sum-of-Squares Programs in Practice, IEEE Transactions on Automatic Control, 2009, vol. 54, no 5, pp. 1007—1011.
21. Feofilov S. V., Khapkin D. L. Synthesis of neural network controllers for objects with non-linearity of the constraint type, Journal of Physics: Conference Series, 2021, vol. 1958, no. 1, pp. 012014.
22. Nair V., Hinton G. E. Rectified Linear Units Improve Restricted Boltzmann Machines, Proceedings of the 27th International Conference on International Conference on Machine Learning ICML’10, Madison, WI, USA, Omnipress, 2010, pp. 807—814.
23. Galushkin A. I. Synthesis of multilayer image recognition systems, Moscow, Energiya, 1974, 367 p. (In Russian).
24. Werbos P. J. Backpropagation through time: what it does and how to do it, Proceedings of the IEEE, 1990, vol. 78, no. 10, pp. 1550—1560.
25. Goodfellow I., Bengio Y., Courville A. Deep learning: Adaptive computation and machine learning, Cambridge, Massachusetts, The MIT Press, 2016, 775 p.
26. Kingma D. P., Ba J. A. A Method for Stochastic Optimization, arXiv:1412.6980, arXiv, 2017.
27. Hoang C. K. Optimization of volumetric power tracking hydraulic drives in terms of speed and accuracy of the tracking mode, Ph.D dissertation (05.13.01), Tula, 2006, 131 p. (In Russian).
Review
For citations:
Feofilov S.V., Kozyr A.V., Khapkin D.L. Structural and Parametric Synthesis of Neural Network Controllers for Control Objects with Limiters. Mekhatronika, Avtomatizatsiya, Upravlenie. 2023;24(11):563-572. (In Russ.) https://doi.org/10.17587/mau.24.563-572
Views:
390
.png)
Email this article 