<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Publishing DTD v1.3 20210610//EN" "JATS-journalpublishing1-3.dtd">
<article article-type="research-article" dtd-version="1.3" xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xml:lang="ru"><front><journal-meta><journal-id journal-id-type="publisher-id">novtexmech</journal-id><journal-title-group><journal-title xml:lang="ru">Мехатроника, автоматизация, управление</journal-title><trans-title-group xml:lang="en"><trans-title>Mekhatronika, Avtomatizatsiya, Upravlenie</trans-title></trans-title-group></journal-title-group><issn pub-type="ppub">1684-6427</issn><issn pub-type="epub">2619-1253</issn><publisher><publisher-name>Commercial Publisher «New Technologies»</publisher-name></publisher></journal-meta><article-meta><article-id pub-id-type="doi">10.17587/mau.17.101-109</article-id><article-id custom-type="elpub" pub-id-type="custom">novtexmech-257</article-id><article-categories><subj-group subj-group-type="heading"><subject>Research Article</subject></subj-group><subj-group subj-group-type="section-heading" xml:lang="ru"><subject>РОБОТОТЕХНИЧЕСКИЕ СИСТЕМЫ</subject></subj-group><subj-group subj-group-type="section-heading" xml:lang="en"><subject>ROBOTIC SYSTEMS</subject></subj-group></article-categories><title-group><article-title>Навигация подводного робота по стереоизображениям</article-title><trans-title-group xml:lang="en"><trans-title>Navigation of an Underwater Robot by Stereo Images</trans-title></trans-title-group></title-group><contrib-group><contrib contrib-type="author" corresp="yes"><name-alternatives><name name-style="eastern" xml:lang="ru"><surname>Бобков</surname><given-names>В. А.</given-names></name><name name-style="western" xml:lang="en"><surname>Bobkov</surname><given-names>V. A.</given-names></name></name-alternatives><email xlink:type="simple">bobkov@iacp.dvo.ru</email><xref ref-type="aff" rid="aff-1"/></contrib><contrib contrib-type="author" corresp="yes"><name-alternatives><name name-style="eastern" xml:lang="ru"><surname>Машенцев</surname><given-names>В. Ю.</given-names></name><name name-style="western" xml:lang="en"><surname>Mashentsev</surname><given-names>V. Yu.</given-names></name></name-alternatives><email xlink:type="simple">v.mashentsev@gmail.com</email><xref ref-type="aff" rid="aff-2"/></contrib></contrib-group><aff-alternatives id="aff-1"><aff xml:lang="ru"><institution>Институт автоматики и процессов управления ДВО РАН</institution><country>Россия</country></aff><aff xml:lang="en"><institution>Institute of Automation and Control Processes of the Far Eastern Branch of the Russian Academy of Sciences</institution><country>Russian Federation</country></aff></aff-alternatives><aff-alternatives id="aff-2"><aff xml:lang="ru"><institution>Дальневосточный федеральный университет</institution><country>Россия</country></aff><aff xml:lang="en"><institution>Far Eastern Federal University</institution><country>Russian Federation</country></aff></aff-alternatives><pub-date pub-type="collection"><year>2016</year></pub-date><pub-date pub-type="epub"><day>28</day><month>08</month><year>2018</year></pub-date><volume>17</volume><issue>2</issue><fpage>101</fpage><lpage>109</lpage><permissions><copyright-statement>Copyright &amp;#x00A9; Commercial Publisher «New Technologies», 2018</copyright-statement><copyright-year>2018</copyright-year><copyright-holder xml:lang="ru">Commercial Publisher «New Technologies»</copyright-holder><copyright-holder xml:lang="en">Commercial Publisher «New Technologies»</copyright-holder><license xlink:href="https://mech.novtex.ru/jour/about/submissions#copyrightNotice" xlink:type="simple"><license-p>https://mech.novtex.ru/jour/about/submissions#copyrightNotice</license-p></license></permissions><self-uri xlink:href="https://mech.novtex.ru/jour/article/view/257">https://mech.novtex.ru/jour/article/view/257</self-uri><abstract><p>Описан метод визуальной навигации автономного подводного робота по потоку стереоизображений, основанный на визуальной одометрии. Новизна предлагаемого метода заключается в реализации адаптивной методики расчета траектории робота, ориентированной на достижение высокой точности вычисляемой локализации, обеспечение режима реального времени при онлайн-обработке и на значительное сокращение вычислительных затрат при постобработке.</p></abstract><trans-abstract xml:lang="en"><p>The work is devoted to development of a visual navigation method for an autonomous underwater robot (AUR) using stereo vision. The authors describe the basic principles of implementation of the visual odometry method in accordance with the already established concept of computing, the main stages of which are comparison of the images' features and calculation of the geometric transformation between the neighboring positions of AUR. Two possible modes of operation of a computer program are considered: an on-line mode - the program runs directly on the onboard computer when AUR is moving, and it processes the captured video stream as it becomes available; and a post-processing mode - the program runs on a stationary computer and processes the saved video stream of the whole trajectory. In the first case initially we solve the problem of calculation for each position of the trajectory with the highest possible precision of AUR localization on the current limited sequence of images, and then a problem of provision of real time mode in general. In the second case the task is to ensure a high-precision calculation of AUR localization and increase the speed of calculation through the optimal selection and calculation sequence of the key frames in a path, using the existing video on the entire trajectory. Post-processing is essentially a solution to the task of a full calibration of the sequence of the key frames, which is necessary for solving of the subsequent problem of 3D reconstruction of an underwater scene. A modification of the basic method is suggested. It consists in development and application of an adaptive technique for calculation of AUR trajectory aimed at solving the above problems. It guarantees the desired area of the overlap of the adjacent frames, takes into account the shape of the trajectory and the height of its passage over the sea-floor, driving the dynamic model of AUR, and takes into account the dependence of the number of the actual incoming frames during the movement of the vehicle. Three co-operating techniques realize adaptability: a) selection of the size of the next step, depending on the degree of the overlapping areas of visibility of the stereo camera for two adjacent positions; b) reduction of the step, if the number of the matching features is smaller than the predetermined threshold; and c) cutting off those parts of the image which are not related to the overlap zone of visibility. These techniques provide an optimal way for determination of the sequence of the key frames, in which calculation of the geometric transformation for the local movements is performed. Optimality means achievement of the highest possible accuracy of localization of computation of AUR with the greatest step length in order to ensure the desired overlapping of the adjacent visibility positions. Computation of the local transformation matrixes is carried out proceeding from the condition of the minimal divergences of the points of the two matching 3D clouds. Comparative results of the computational experiments on estimation of the effectiveness of the proposed adaptive method are presented and analyzed. Alternative versions of the individual stages of the general computational scheme are also analyzed. In general, the method can be a useful addition to the traditionally used sonar navigation systems, or a good alternative to them in the conditions of local maneuvering.</p></trans-abstract><kwd-group xml:lang="ru"><kwd>автономный подводный робот</kwd><kwd>визуальная навигация</kwd><kwd>адаптивный метод</kwd><kwd>стереоизображения</kwd><kwd>autonomous underwater robot</kwd><kwd>stereo video stream</kwd><kwd>visual navigation</kwd><kwd>visual odometry</kwd><kwd>adaptive method</kwd></kwd-group></article-meta></front><back><ref-list><title>References</title><ref id="cit1"><label>1</label><citation-alternatives><mixed-citation xml:lang="ru">Щербатюк А. Ф., Дубровин Ф. С. Алгоритмы определения местоположения АНПА на основе информации о дальности до одного мобильного гидроакустического маяка // Информационно-измерительные и управляющие системы. 2012. № 9. С. 26-39.</mixed-citation><mixed-citation xml:lang="en">Щербатюк А. Ф., Дубровин Ф. С. Алгоритмы определения местоположения АНПА на основе информации о дальности до одного мобильного гидроакустического маяка // Информационно-измерительные и управляющие системы. 2012. № 9. С. 26-39.</mixed-citation></citation-alternatives></ref><ref id="cit2"><label>2</label><citation-alternatives><mixed-citation xml:lang="ru">Борейко А. А., Мун С. А., Щербатюк А. Ф. Определение движения подводного аппарата на основе обработки видео изображений // Мехатроника, автоматизация, управление. 2008. № 8. Приложение. С. 2-8.</mixed-citation><mixed-citation xml:lang="en">Борейко А. А., Мун С. А., Щербатюк А. Ф. Определение движения подводного аппарата на основе обработки видео изображений // Мехатроника, автоматизация, управление. 2008. № 8. Приложение. С. 2-8.</mixed-citation></citation-alternatives></ref><ref id="cit3"><label>3</label><citation-alternatives><mixed-citation xml:lang="ru">Kim A., Eustice R. M. Real-Time Visual SLAM for Autonomous Underwater Hull Inspection Using Visual Saliency // IEEE Transactions on Robotics. 2013. N. 29 (3). P. 719-733.</mixed-citation><mixed-citation xml:lang="en">Kim A., Eustice R. M. Real-Time Visual SLAM for Autonomous Underwater Hull Inspection Using Visual Saliency // IEEE Transactions on Robotics. 2013. N. 29 (3). P. 719-733.</mixed-citation></citation-alternatives></ref><ref id="cit4"><label>4</label><citation-alternatives><mixed-citation xml:lang="ru">Бобков В. А., Борисов Ю. С. Навигация подводного аппарата на малых дистанциях по оптической информации // Мехатроника, автоматизация, управление. 2010. № 2. С. 75-78.</mixed-citation><mixed-citation xml:lang="en">Бобков В. А., Борисов Ю. С. Навигация подводного аппарата на малых дистанциях по оптической информации // Мехатроника, автоматизация, управление. 2010. № 2. С. 75-78.</mixed-citation></citation-alternatives></ref><ref id="cit5"><label>5</label><citation-alternatives><mixed-citation xml:lang="ru">Salvi J., Petilot Y., Battle E. Visual SLAM for 3D Large - Scale Seabed Acquisition Employing Underwater Vehicles // IEEE International Conference on Intelligent Robots and Systems. 2008. P. 1011-1016.</mixed-citation><mixed-citation xml:lang="en">Salvi J., Petilot Y., Battle E. Visual SLAM for 3D Large - Scale Seabed Acquisition Employing Underwater Vehicles // IEEE International Conference on Intelligent Robots and Systems. 2008. P. 1011-1016.</mixed-citation></citation-alternatives></ref><ref id="cit6"><label>6</label><citation-alternatives><mixed-citation xml:lang="ru">Eustice R., Singh H., Leonard J., Walter M. Visually mapping the RMS Titanic: Conservative covariance estimates for SLAM information filters. International Journal of Robotics Research. 2006. N. 25 (12). P. 1223-1242.</mixed-citation><mixed-citation xml:lang="en">Eustice R., Singh H., Leonard J., Walter M. Visually mapping the RMS Titanic: Conservative covariance estimates for SLAM information filters. International Journal of Robotics Research. 2006. N. 25 (12). P. 1223-1242.</mixed-citation></citation-alternatives></ref><ref id="cit7"><label>7</label><citation-alternatives><mixed-citation xml:lang="ru">Johnson-Roberson M., Pizarro O., Williams S. B., Mahon I. Generation and visualization of large-scale three-dimensional reconstructions from underwater robotic surveys // Journal of Field Robotics, Special Issue: Three-Dimensional Mapping. Part 3. 2010. Vol. 27. P. 21-51.</mixed-citation><mixed-citation xml:lang="en">Johnson-Roberson M., Pizarro O., Williams S. B., Mahon I. Generation and visualization of large-scale three-dimensional reconstructions from underwater robotic surveys // Journal of Field Robotics, Special Issue: Three-Dimensional Mapping. Part 3. 2010. Vol. 27. P. 21-51.</mixed-citation></citation-alternatives></ref><ref id="cit8"><label>8</label><citation-alternatives><mixed-citation xml:lang="ru">Stoyanov Т., Mojtahedzadeh R., Andreasson H., Lilienthal A. J. Comparative evaluation of range sensor accuracy for indoor mobile robotics and automated logistics applications // Robotics and Autonomous Systems. 2013. Vol. 61. P. 1094-1105.</mixed-citation><mixed-citation xml:lang="en">Stoyanov Т., Mojtahedzadeh R., Andreasson H., Lilienthal A. J. Comparative evaluation of range sensor accuracy for indoor mobile robotics and automated logistics applications // Robotics and Autonomous Systems. 2013. Vol. 61. P. 1094-1105.</mixed-citation></citation-alternatives></ref><ref id="cit9"><label>9</label><citation-alternatives><mixed-citation xml:lang="ru">Bobkov V. A., Ron'shin Yu. I., Kudryashov A. P., Mashentsev V. Yu. 3D SLAM from Stereoimages // Programming and Computer Software. 2014. Vol. 40. N. 4. P. 159-165.</mixed-citation><mixed-citation xml:lang="en">Bobkov V. A., Ron'shin Yu. I., Kudryashov A. P., Mashentsev V. Yu. 3D SLAM from Stereoimages // Programming and Computer Software. 2014. Vol. 40. N. 4. P. 159-165.</mixed-citation></citation-alternatives></ref><ref id="cit10"><label>10</label><citation-alternatives><mixed-citation xml:lang="ru">Бобков В. А., Машенцев В. Ю. Визуальная навигация подводного аппарата для целей локального маневрирования // Подводные исследования и робототехника. 2013. № 2 (16). С. 33-37.</mixed-citation><mixed-citation xml:lang="en">Бобков В. А., Машенцев В. Ю. Визуальная навигация подводного аппарата для целей локального маневрирования // Подводные исследования и робототехника. 2013. № 2 (16). С. 33-37.</mixed-citation></citation-alternatives></ref><ref id="cit11"><label>11</label><citation-alternatives><mixed-citation xml:lang="ru">Бобков В. А., Морозов М. А., Багницкий А. В., Инзарцев А. В., Павин А. М., Щербатюк А. Ф. Имитационный моделирующий комплекс для обследовательского автономного подводного робота // электронный журнал "Научная визуализация". 2013. Т. 5. № 4. С. 47-70.</mixed-citation><mixed-citation xml:lang="en">Бобков В. А., Морозов М. А., Багницкий А. В., Инзарцев А. В., Павин А. М., Щербатюк А. Ф. Имитационный моделирующий комплекс для обследовательского автономного подводного робота // электронный журнал "Научная визуализация". 2013. Т. 5. № 4. С. 47-70.</mixed-citation></citation-alternatives></ref></ref-list><fn-group><fn fn-type="conflict"><p>The authors declare that there are no conflicts of interest present.</p></fn></fn-group></back></article>
