Dialogue Control of Collaborative Robots Based on Artifi cial Neural Networks
https://doi.org/10.17587/mau.22.567-576
Abstract
Collaborative robotics progress is based on the possibility to apply robots to the wide range activity of peoples. Now the user can control the robot without any special knowledge in robotics and safe. The price of such possibilities is complication of control system of robot which now has to aquire an opportunity of autonomous behavior under human’s control, using the necessary sensors and elements of artificial intelligence. In our research we suppose the collaborative robot as mobile robotic device possible to fulfil some work under the human’s speech demands not only in the same space with the human. We also suppose the necessity of bilateral dialogue human-robot to make it clear the task, the current situation, the state as robot as human. The complex task of control, or may be the collaboration of human with his artificial partner need new means of control, situation recognition, speech dialogue management. As a mean to solve the whole complex of problems we propose the combination of different artificial neural networks. Such as convolution networks for image recognition, deep networks for speech recognition, LSTM networks for autonomous movement of robot control in current situation. Investigations in the field of mobile and manipulation robots including the human-robot control have been proceeded for some years in the department "Robotic systems and mechatronics" BMSTU celebrating now it 70th years Jubilee. The reader may find some of the works in the bibliography. In result of all these investigations we obtain the service robot model which may find a wide application.
About the Authors
A. S. Yuschenko
Bauman Moscow State Technical University (BMSTU)
Russian Federation
Russian Federation
Dr. Science Tech., Professor
Moscow, 105005, Russian Federation
Yin Shuai
Bauman Moscow State Technical University (BMSTU)
Russian Federation
Russian Federation
Moscow, 105005, Russian Federation
References
1. Mikhailov B. B., Nazarova A. V., Yuschenko A. S. Autonomous mobile robots — navigation and control, Izvestiya SFedU, Engineering Sciences, 2016, vol. 2(175), pp. 48—67.
2. Yuschenko A. S. Dialogue Mode of Robot Control on the Base of Fuzzy Logic, Transaction of the Conference Extreme Robotics, S-Pb., 2015, pp. 143—146.
3. Shuai Yin, Yuschenko A. S. Collaborative robot — surgeon assistant, Transaction of the Conference Extreme Robotics, S-Pb., 2019, pp. 568—575.
4. Shuai Yin, Yuschenko A. S. Dialogue system of controlling robot based on the theory of finite automata, Mekhatronika, Avtomatizatsiya, Upravlenie, 2019, vol. 20, no. 11, pp. 686—695.
5. Yuschenko A. S. Intelligent Planning of Work of Robots, Mekhatronika, Avtomatizatsiya, Upravlenie, 2005, no. 3, pp. 5—18.
6. Zhonin A. A. Training Algorithm for dialogue manager of a speech dialogue system, Integrated Models and Soft Calculations in Artificial Intelligence. Proceedings of International Conference, 2011, pp. 395—406.
7. Nist´er D., Naroditsky O., Bergen J. Visual odometry for ground vehicle applications, Journal of Field Robotics, 2006, vol. 23(1), pp. 3—20.
8. Devetjarikov E. A. Algorithm of the trajectory planning for a mobile robot return to operator using the visual odometer datum, Nauka i Obrasovanie, 2014, no. 12, pp. 705—715.
9. Wang X., Lian Y., Li L. Localization of Autonomous Cars Using Multi-Sensor Data, Fusion Chinese Automation Congress, 2018, pp. 4152—4155.
10. Devetjarikov E. A, Mikhailov B. B. Visual odometer, Vestnik BMSTU Priborostroenie, 2012, Special issue no. 6 "Robotic Systems", pp. 68—82.
11. Yuschenko A. S., Zenkevich S. L. Basic of the manipulation robots control, Moscow, Publishing house of BMSTU, 2004, 480 p.
12. Mellinger D., Kumar V. Minimum snap trajectory generation and control for quadrotors, IEEE International Conference on Robotics and Automation, 2011, pp. 2520—2525.
13. Carius J., Ranftl R., Koltun V., Hutter M. Trajectory Optimization with Implicit Hard Contacts, IEEE Robotics and Automation Letters, 2018, vol. 3, pp. 3326—3323.
14. Zenkevich S. L., Nazarova A. V., Zhu H. Logical Control a Group of Mobile Robots, Smart Electromechanical Systems Studies in Systems, 2019, vol. 174, pp. 32—43.
15. Zhao Z. Q., Zheng P., Xu S., Wu X. Object Detection with Deep Learning: A Review, IEEE Transactions on Neural Networks and Learning Systems, 2019, vol. 30, pp. 3212—3232.
16. Yin S., Yuschenko A. Object Recognition of the Robotic System with Using a Parallel Convolutional Neural Network, Industry 40 Issues & New Intelligent Control Paradigms, 2019, vol. 272, pp. 3—11.
17. Yin S., Yuschenko A. The application of the convolutional neural network to organize the work of a collaborative robot — surgeon assistant, Interactive Collaborative Robotics, 2019, pp. 287—297.
18. Hochreiter S., Schmidhuber J. Long short-term memory, Neural Computation, 1997, vol. 9, no. 8, pp. 1735—1780.
19. Borisov E. S. About recurrent neural networks, available at: http://mechanoid.kiev.ua/neural-net-rnn.html.
20. Yuschenko A. S. Ergonomic problems of collaborative robotics, Robototechnika i Technichskaya Kybernetika, 2019, no. 7 (2), pp. 85—93.
Review
For citations:
Yuschenko A.S., Shuai Y. Dialogue Control of Collaborative Robots Based on Artifi cial Neural Networks. Mekhatronika, Avtomatizatsiya, Upravlenie. 2021;22(11):567-576. (In Russ.) https://doi.org/10.17587/mau.22.567-576
Views:
614
.png)
Email this article 