<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Publishing DTD v1.3 20210610//EN" "JATS-journalpublishing1-3.dtd">
<article article-type="research-article" dtd-version="1.3" xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xml:lang="ru"><front><journal-meta><journal-id journal-id-type="publisher-id">novtexmech</journal-id><journal-title-group><journal-title xml:lang="ru">Мехатроника, автоматизация, управление</journal-title><trans-title-group xml:lang="en"><trans-title>Mekhatronika, Avtomatizatsiya, Upravlenie</trans-title></trans-title-group></journal-title-group><issn pub-type="ppub">1684-6427</issn><issn pub-type="epub">2619-1253</issn><publisher><publisher-name>Commercial Publisher «New Technologies»</publisher-name></publisher></journal-meta><article-meta><article-id pub-id-type="doi">10.17587/mau.23.97-103</article-id><article-id custom-type="elpub" pub-id-type="custom">novtexmech-1126</article-id><article-categories><subj-group subj-group-type="heading"><subject>Research Article</subject></subj-group><subj-group subj-group-type="section-heading" xml:lang="ru"><subject>РОБОТЫ, МЕХАТРОНИКА И РОБОТОТЕХНИЧЕСКИЕ СИСТЕМЫ</subject></subj-group><subj-group subj-group-type="section-heading" xml:lang="en"><subject>ROBOT, MECHATRONICS AND ROBOTIC SYSTEMS</subject></subj-group></article-categories><title-group><article-title>Оптимизация параметров проецирования системы кругового обзора с использованием реперных меток</article-title><trans-title-group xml:lang="en"><trans-title>Optimization of Surround-View System Projection Parameters using Fiducial Markers</trans-title></trans-title-group></title-group><contrib-group><contrib contrib-type="author" corresp="yes"><name-alternatives><name name-style="eastern" xml:lang="ru"><surname>Варлашин</surname><given-names>В. В.</given-names></name><name name-style="western" xml:lang="en"><surname>Varlashin</surname><given-names>V. V.</given-names></name></name-alternatives><bio xml:lang="ru"><p>аспирант, инженер-исследователь </p><p>г. Санкт-Петербург</p></bio><bio xml:lang="en"><p>Graduate Student of the Department of Mechatronics and Robotics, Research Engineer of the SPbPU</p><p>St. Petersburg, 195251</p></bio><email xlink:type="simple">botanic-8@yandex.ru</email><xref ref-type="aff" rid="aff-1"/></contrib><contrib contrib-type="author" corresp="yes"><name-alternatives><name name-style="eastern" xml:lang="ru"><surname>Лопота</surname><given-names>А. В.</given-names></name><name name-style="western" xml:lang="en"><surname>Lopota</surname><given-names>A. V.</given-names></name></name-alternatives><bio xml:lang="ru"><p>д-р техн. наук, проф. </p><p>г. Санкт-Петербург</p></bio><bio xml:lang="en"><p>St. Petersburg, 195251</p></bio><email xlink:type="simple">alopota@rtc.ru</email><xref ref-type="aff" rid="aff-1"/></contrib></contrib-group><aff-alternatives id="aff-1"><aff xml:lang="ru"><institution>ФГАОУ ВО СПбПУ Петра Великого</institution><country>Россия</country></aff><aff xml:lang="en"><institution>Peter the Grate St. Petersburg Politechnic University (SPbPU)</institution><country>Russian Federation</country></aff></aff-alternatives><pub-date pub-type="collection"><year>2022</year></pub-date><pub-date pub-type="epub"><day>06</day><month>02</month><year>2022</year></pub-date><volume>23</volume><issue>2</issue><fpage>97</fpage><lpage>103</lpage><permissions><copyright-statement>Copyright &amp;#x00A9; Commercial Publisher «New Technologies», 2022</copyright-statement><copyright-year>2022</copyright-year><copyright-holder xml:lang="ru">Commercial Publisher «New Technologies»</copyright-holder><copyright-holder xml:lang="en">Commercial Publisher «New Technologies»</copyright-holder><license xlink:href="https://mech.novtex.ru/jour/about/submissions#copyrightNotice" xlink:type="simple"><license-p>https://mech.novtex.ru/jour/about/submissions#copyrightNotice</license-p></license></permissions><self-uri xlink:href="https://mech.novtex.ru/jour/article/view/1126">https://mech.novtex.ru/jour/article/view/1126</self-uri><abstract><p>Обсуждается проблема повышения качества воспроизведения окружающей среды системой кругового обзора мобильного робота, работающей в режиме дополненной реальности. Рассматривается вариант системы кругового обзора на базе системы телевизионных камер с перекрывающимися полями зрения. Разработана виртуальная модель, включающая в себя 3D-CAD модели мобильного робота и окружающих объектов, а также виртуальные модели телевизионных камер. Для реализации модели выбрана кроссплатформенная интегрированная среда разработки "Unity". Определены методы решения задачи отображения окружающего пространства в режиме построения вида "от третьего лица". Предложен математический критерий оценки качества воспроизведения окружающего пространства, основанный на сопоставлении точек, полученных с виртуальной модели, с точками, полученными в результате проецирования изображений с виртуальных телевизионных камер. Для получения точек использованы реперные метки типа ArUco, обеспечивающие однозначное сопоставление точек на исходном и синтезированном изображениях. Исследована зависимость значения целевой функции задачи оптимизации от параметров проецирования методом равномерного поиска. Предложен метод автоматической адаптации параметров проецирования при использовании сверхширокоугольных объективов в составе телевизионных камер и методов стереозрения. Определены направления дальнейших исследований.</p></abstract><trans-abstract xml:lang="en"><p>The paper is devoted to the problem of increasing quality of reproduction of the environment by mobile robot’s surround-view system, operating in the augmented reality mode. A variant of a surround-view system based on the cameras with over-lapping fields of view is being considered. A virtual model has been developed, it includes 3D-CAD models of a mobile robot and surrounding objects, as well as virtual models of cameras. The cross-platform integrated development environment "Unity" was chosen to implement the model. Methods for solving the problem of displaying the surrounding mobile robot space in the "third-person view" mode are determined. A mathematical criterion for assessing the quality of reproduction of the surrounding space is proposed. It is based on the comparison of points obtained from a virtual model with points obtained as a result of projection of images from virtual cameras. To obtain points, ArUco fiducial markers were used, providing an unambiguous comparison of points on the original and synthesized images. The dependence of the value of the objective function of the optimization problem on the projection parameters by the uniform search method are investigated. A method for automatic adaptation of projection parameters using fisheye lenses and stereo vision methods is proposed. Directions for further research are identified.</p></trans-abstract><kwd-group xml:lang="ru"><kwd>лазерный сенсор</kwd><kwd>3D-дальнометрическое изображение</kwd><kwd>экстремальная навигация</kwd><kwd>задача многомерной оптимизации</kwd></kwd-group><kwd-group xml:lang="en"><kwd>computer vision</kwd><kwd>surround-view system</kwd><kwd>augmented reality</kwd><kwd>virtual model</kwd></kwd-group><funding-group><funding-statement xml:lang="ru">Исследование выполнено при финансовой поддержке РФФИ в рамках научного проекта № 20-38-90094 "Исследование методов оценки расстояний до объектов окружающей среды с использованием системы кругового обзора мобильных роботов".</funding-statement><funding-statement xml:lang="en">The reported study was funded by RFBR, project number 20-38-90094 "Study of methods for estimating distances to environmental objects using a surround-view system of mobile robots".</funding-statement></funding-group></article-meta></front><back><ref-list><title>References</title><ref id="cit1"><label>1</label><citation-alternatives><mixed-citation xml:lang="ru">Shi Q., Li C., Wang C., Luo H., Huang Q., Fukuda T. Design and implementation of an omnidirectional vision system for robot perception // Mechatronics. 2017. Vol. 41. P. 58—66.</mixed-citation><mixed-citation xml:lang="en">Shi Q., Li C., Wang C., Luo H., Huang Q., Fukuda T. Design and implementation of an omnidirectional vision system for robot perception, Mechatronics, 2017, vol. 41, pp. 58—66.</mixed-citation></citation-alternatives></ref><ref id="cit2"><label>2</label><citation-alternatives><mixed-citation xml:lang="ru">Kashyap V., Agrawal P., Akhbari F. Real-time, Quasi Immersive, High Definition Automotive 3D Surround View System // Int’l Conf. IP, Comp. Vision, and Pattern Recognition. 2017. P. 10—16.</mixed-citation><mixed-citation xml:lang="en">Kashyap V., Agrawal P., Akhbari F. Real-time, Quasi Immersive, High Definition Automotive 3D Surround View System, Int’l Conf. IP, Comp. Vision, and Pattern Recognition, 2017, pp. 10—16.</mixed-citation></citation-alternatives></ref><ref id="cit3"><label>3</label><citation-alternatives><mixed-citation xml:lang="ru">Lim S., Jun S., Jung I. Wrap-around View Equipped on Mobile Robot. // World Academy of Science, Engineering and Technology, International Journal of Electrical, Computer, Energetic, Electronic and Communication Engineering. 2012. Vol. 6. P. 354—356.</mixed-citation><mixed-citation xml:lang="en">Lim S., Jun S., Jung I. Wrap-around View Equipped on Mobile Robot, World Academy of Science, Engineering and Technology, International Journal of Electrical, Computer, Energetic, Electronic and Communication Engineering, 2012, vol. 6, pp. 354—356.</mixed-citation></citation-alternatives></ref><ref id="cit4"><label>4</label><citation-alternatives><mixed-citation xml:lang="ru">Yang Z., Zhao Y., Hu X., Yin Y., Zhou L., Tao D. A flexible vehicle surround view camera system by central-around coordinate mapping model // Multimedia Tools and Applications. 2018. Vol. 78. P. 11983—12006.</mixed-citation><mixed-citation xml:lang="en">Yang Z., Zhao Y., Hu X., Yin Y., Zhou L., Tao D. A flexible vehicle surround view camera system by central-around coordinate mapping model, Multimedia Tools and Applications, 2018, vol. 78, pp. 11983—12006.</mixed-citation></citation-alternatives></ref><ref id="cit5"><label>5</label><citation-alternatives><mixed-citation xml:lang="ru">Gao Y., Lin C., Zhao Y., Wang X., Wei S., Huang Q. 3-D Surround View for Advanced Driver Assistance Systems // IEEE Transactions on Intelligent Transportation Systems. 2018. Vol. 19. P. 320—328.</mixed-citation><mixed-citation xml:lang="en">Gao Y., Lin C., Zhao Y., Wang X., Wei S., Huang Q. 3-D Surround View for Advanced Driver Assistance Systems, IEEE Transactions on Intelligent Transportation Systems, 2018, vol. 19, pp. 320—328.</mixed-citation></citation-alternatives></ref><ref id="cit6"><label>6</label><citation-alternatives><mixed-citation xml:lang="ru">Официальный сайт компании Open Source Robotics Foundation. URL: www.turtlebot.com/ (дата обращения: 01.10.2021).</mixed-citation><mixed-citation xml:lang="en">Official web site of Open Source Robotics Foundation, available at: www.turtlebot.com/ (accessed 01.10.2021).</mixed-citation></citation-alternatives></ref><ref id="cit7"><label>7</label><citation-alternatives><mixed-citation xml:lang="ru">Официальный сайт компании Unity Technologies. URL: www.unity.com/ (дата обращения: 01.10.2021).</mixed-citation><mixed-citation xml:lang="en">Official web site of Unity Technologies, available at: www.unity.com/ (accessed 01.10.2021).</mixed-citation></citation-alternatives></ref><ref id="cit8"><label>8</label><citation-alternatives><mixed-citation xml:lang="ru">Официальный сайт компании Epic Games. URL: www.unrealengine.com/ (дата обращения: 01.10.2021).</mixed-citation><mixed-citation xml:lang="en">Official web site Epic Games, available at: www.unrealengine.com/ (accessed 01.10.2021).</mixed-citation></citation-alternatives></ref><ref id="cit9"><label>9</label><citation-alternatives><mixed-citation xml:lang="ru">Официальный сайт сообщества OpenCV team. URL: www.opencv.org/ (дата обращения: 01.10.2021).</mixed-citation><mixed-citation xml:lang="en">Official web site of OpenCV team community, available at: www.opencv.org/ (accessed 01.10.2021).</mixed-citation></citation-alternatives></ref><ref id="cit10"><label>10</label><citation-alternatives><mixed-citation xml:lang="ru">Kuo T. Y., Wang Y. S., Cheng Y. J., Wan K. H. 3D Around View Monitoring System for automobiles // ICCE, IEEE. 2017. P. 271—272.</mixed-citation><mixed-citation xml:lang="en">Kuo T. Y., Wang Y. S., Cheng Y. J., Wan K. H. 3D Around View Monitoring System for automobiles, ICCE, IEEE, 2017, pp. 271—272.</mixed-citation></citation-alternatives></ref><ref id="cit11"><label>11</label><citation-alternatives><mixed-citation xml:lang="ru">Yeh Y. T., Peng C. K., Chen K. W., Chen Y. S., Hung Y. P. Driver Assistance System Providing an Intuitive Perspective View of Vehicle Surrounding // ACCV Workshops, Springer. 2014. P. 403—417.</mixed-citation><mixed-citation xml:lang="en">Yeh Y. T., Peng C. K., Chen K. W., Chen Y. S., Hung Y. P. Driver Assistance System Providing an Intuitive Perspective View of Vehicle Surrounding, ACCV Workshops, Springer, 2014, pp. 403—417.</mixed-citation></citation-alternatives></ref><ref id="cit12"><label>12</label><citation-alternatives><mixed-citation xml:lang="ru">Sung K., Lee J., An J. Chang E. Development of Image Synthesis Algorithm with Multi-Camera // VTC Spring, IEEE. 2012. P. 1—5.</mixed-citation><mixed-citation xml:lang="en">Sung K., Lee J., An J. Chang E. Development of Image Synthesis Algorithm with Multi-Camera, VTC Spring, IEEE, 2012, pp. 1—5.</mixed-citation></citation-alternatives></ref><ref id="cit13"><label>13</label><citation-alternatives><mixed-citation xml:lang="ru">Auysakul J., Xu H., Zhao W. Development of HemiCylinder Plane for Panorama View in Around View Monitor Applications // 2016 International Conference on Computational Intelligence and Applications (ICCIA). 2016. P. 26—30.</mixed-citation><mixed-citation xml:lang="en">Auysakul J., Xu H., Zhao W. Development of Hemi-Cylinder Plane for Panorama View in Around View Monitor Applications, 2016 International Conference on Computational Intelligence and Applications (ICCIA), 2016, pp. 26—30.</mixed-citation></citation-alternatives></ref><ref id="cit14"><label>14</label><citation-alternatives><mixed-citation xml:lang="ru">Варлашин В. В., Ершова М. А., Буняков В. А., Шмаков О. А. Система кругового обзора реального времени для мобильных робототехнических комплексов // Мехатроника, автоматизация, управление. 2019. Т. 20, № 3. С. 162—170.</mixed-citation><mixed-citation xml:lang="en">Varlashin V. V., Ershova M. A., Bunyakov V. A., Shmakov O. U. Real-Time Surround-View System for Mobile Robotic System, Mekhatronika, Avtomatizatsiya, Upravlenie, 2019, vol. 20(3), pp. 162—170 (in Russian).</mixed-citation></citation-alternatives></ref><ref id="cit15"><label>15</label><citation-alternatives><mixed-citation xml:lang="ru">Lowe D. G. Object recognition from local scale-invariant features // Proceedings of the Seventh IEEE International Conference on Computer Vision. 1999. Vol. 2. P. 1150—1157.</mixed-citation><mixed-citation xml:lang="en">Lowe D. G. Object recognition from local scale-invariant features, Proceedings of the Seventh IEEE International Conference on Computer Vision, 1999, vol. 2, pp. 1150—1157.</mixed-citation></citation-alternatives></ref><ref id="cit16"><label>16</label><citation-alternatives><mixed-citation xml:lang="ru">Bay H., Tuytelaars Y., Van Gool L. SURF: Speeded up robust features // Computer Vision-ECCV. 2006. Vol. 3951. P. 404—417.</mixed-citation><mixed-citation xml:lang="en">Bay H., Tuytelaars Y., Van Gool L. SURF: Speeded up robust features, Computer Vision-ECCV, 2006, vol. 3951, pp. 404—417.</mixed-citation></citation-alternatives></ref><ref id="cit17"><label>17</label><citation-alternatives><mixed-citation xml:lang="ru">Rublee E., Rabaud, V., Konolige K., Bradski G. R. ORB: An efficient alternative to SIFT or SURF // 2011 International Conference on Computer Vision. 2011. P. 2564—2571.</mixed-citation><mixed-citation xml:lang="en">Rublee E., Rabaud, V., Konolige K., Bradski G. R. ORB: An efficient alternative to SIFT or SURF, 2011 International Conference on Computer Vision, 2011, pp. 2564—2571.</mixed-citation></citation-alternatives></ref><ref id="cit18"><label>18</label><citation-alternatives><mixed-citation xml:lang="ru">Garrido-Jurado S., Muñoz-Salinas R., Madrid-Cuevas F. J., Marín-Jiménez M. J. Automatic generation and detection of highly reliable fiducial markers under occlusion // Pattern Recognition. 2014. Vol. 47. P. 2280—2292.</mixed-citation><mixed-citation xml:lang="en">Garrido-Jurado S., Muñoz-Salinas R., Madrid-Cuevas F. J., Marín-Jiménez M. J. Automatic generation and detection of highly reliable fiducial markers under occlusion, Pattern Recognition, 2014, vol. 47, pp. 2280—2292.</mixed-citation></citation-alternatives></ref></ref-list><fn-group><fn fn-type="conflict"><p>The authors declare that there are no conflicts of interest present.</p></fn></fn-group></back></article>
