{"id":558039,"date":"2023-03-01T14:10:02","date_gmt":"2023-03-01T11:10:02","guid":{"rendered":"https:\/\/en.buradabiliyorum.com\/a-new-approach-to-improve-robot-navigation-in-crowded-environments\/"},"modified":"2023-03-01T14:10:02","modified_gmt":"2023-03-01T11:10:02","slug":"a-new-approach-to-improve-robot-navigation-in-crowded-environments","status":"publish","type":"post","link":"https:\/\/buradabiliyorum.com\/en\/a-new-approach-to-improve-robot-navigation-in-crowded-environments\/","title":{"rendered":"#A new approach to improve robot navigation in crowded environments"},"content":{"rendered":"<div id=\"ez-toc-container\" class=\"ez-toc-v2_0_85 counter-hierarchy ez-toc-counter ez-toc-custom ez-toc-container-direction\">\n<p class=\"ez-toc-title\" style=\"cursor:inherit\">Table of Contents<\/p>\n<label for=\"ez-toc-cssicon-toggle-item-6a337417da455\" class=\"ez-toc-cssicon-toggle-label\"><span class=\"\"><span class=\"eztoc-hide\" style=\"display:none;\">Toggle<\/span><span class=\"ez-toc-icon-toggle-span\"><svg style=\"fill: #dd3333;color:#dd3333\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" class=\"list-377408\" width=\"20px\" height=\"20px\" viewBox=\"0 0 24 24\" fill=\"none\"><path d=\"M6 6H4v2h2V6zm14 0H8v2h12V6zM4 11h2v2H4v-2zm16 0H8v2h12v-2zM4 16h2v2H4v-2zm16 0H8v2h12v-2z\" fill=\"currentColor\"><\/path><\/svg><svg style=\"fill: #dd3333;color:#dd3333\" class=\"arrow-unsorted-368013\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"10px\" height=\"10px\" viewBox=\"0 0 24 24\" version=\"1.2\" baseProfile=\"tiny\"><path d=\"M18.2 9.3l-6.2-6.3-6.2 6.3c-.2.2-.3.4-.3.7s.1.5.3.7c.2.2.4.3.7.3h11c.3 0 .5-.1.7-.3.2-.2.3-.5.3-.7s-.1-.5-.3-.7zM5.8 14.7l6.2 6.3 6.2-6.3c.2-.2.3-.5.3-.7s-.1-.5-.3-.7c-.2-.2-.4-.3-.7-.3h-11c-.3 0-.5.1-.7.3-.2.2-.3.5-.3.7s.1.5.3.7z\"\/><\/svg><\/span><\/span><\/label><input type=\"checkbox\"  id=\"ez-toc-cssicon-toggle-item-6a337417da455\" checked aria-label=\"Toggle\" \/><nav><ul class='ez-toc-list ez-toc-list-level-1 ' ><li class='ez-toc-page-1 ez-toc-heading-level-1'><a class=\"ez-toc-link ez-toc-heading-1\" href=\"https:\/\/buradabiliyorum.com\/en\/a-new-approach-to-improve-robot-navigation-in-crowded-environments\/#%E2%80%9CA_new_approach_to_improve_robot_navigation_in_crowded_environments%E2%80%9D\" >&#8220;A new approach to improve robot navigation in crowded environments&#8221;<\/a><\/li><\/ul><\/nav><\/div>\n<h1><span class=\"ez-toc-section\" id=\"%E2%80%9CA_new_approach_to_improve_robot_navigation_in_crowded_environments%E2%80%9D\"><\/span>&#8220;A new approach to improve robot navigation in crowded environments&#8221;<span class=\"ez-toc-section-end\"><\/span><\/h1>\n<div>\n<div class=\"article-gallery lightGallery\">\n<div data-thumb=\"https:\/\/scx1.b-cdn.net\/csz\/news\/tmb\/2023\/a-new-approach-to-impr.jpg\" data-src=\"https:\/\/scx2.b-cdn.net\/gfx\/news\/hires\/2023\/a-new-approach-to-impr.jpg\" data-sub-html=\"A colliding trajectory of a robot that has been trained using a standard exploration strategy (left) and a successful trajectory of a robot that has been trained with intrinsic rewards in the same scenarios. Credit: Martinez-Baselga, Riazuelo &amp; Montano\">\n<figure class=\"article-img\"><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/scx1.b-cdn.net\/csz\/news\/800a\/2023\/a-new-approach-to-impr.jpg\" alt=\"A new approach to improve robot navigation in crowded environments\" title=\"A colliding trajectory of a robot that has been trained using a standard exploration strategy (left) and a successful trajectory of a robot that has been trained with intrinsic rewards in the same scenarios. Credit: Martinez-Baselga, Riazuelo &amp; Montano\" width=\"800\" height=\"393\"\/><figcaption class=\"text-darken text-low-up text-truncate-js text-truncate mt-3\">\n                A colliding trajectory of a robot that has been trained using a standard exploration strategy (left) and a successful trajectory of a robot that has been trained with intrinsic rewards in the same scenarios. Credit: Martinez-Baselga, Riazuelo &amp; Montano<br \/>\n            <\/figcaption><\/figure>\n<\/div>\n<\/div>\n<p>While robots have become increasingly advanced over the past few years, most of them are still unable to reliably navigate very crowded spaces, such as public areas or roads in urban environments. To be implemented on a large-scale and in the smart cities of the future, however, robots will need to be able to navigate these environments both reliably and safely, without colliding with humans or nearby objects.<\/p>\n<p>Researchers at the University of Zaragoza and the Aragon Institute of Engineering Research in Spain have recently proposed a new machine learning\u2013based <a href=\"https:\/\/buradabiliyorum.com\/en\/category\/download-scripts-themes-apps\/\" data-internallinksmanager029f6b8e52c=\"9\" title=\"Download Scripts &amp; Themes &amp; Apps\" target=\"_blank\" rel=\"noopener\">app<\/a>roach that could improve robot navigation in both indoor and outdoor crowded environments. This approach, introduced in a paper pre-published on the <i>arXiv<\/i> server, entails the use of intrinsic rewards, which are essentially &#8220;rewards&#8221; that an AI agent receives when performing behaviors that are not strictly related to the task it is trying to complete.<\/p>\n<p>&#8220;Autonomous robot navigation is an open unsolved problem, especially in unstructured and dynamic environments, where a robot has to avoid collisions with dynamic obstacles and reach the goal,&#8221; Diego Martinez Baselga, one of the researchers who carried out the study, told Tech Xplore. &#8220;Deep reinforcement learning algorithms have proven to have a high performance in terms of success rate and time to reach the goal, but there is still a lot to improve.&#8221;<\/p>\n<p>The method introduced by Martinez Baselga and his colleagues uses intrinsic rewards, rewards designed to increase an agent&#8217;s motivation to explore new &#8220;states&#8221; (i.e., interactions with its environment) or to reduce the level of uncertainty in a given scenario so that agents can better predict the consequences of their actions. In the context of their study, the researchers specifically used these rewards to encourage robots to visit unknown areas in its environment and explore its environment in different ways, so that it can learn to navigate it more effectively over time.\n<\/p>\n<div class=\"article-gallery lightGallery\">\n<div data-thumb=\"https:\/\/scx1.b-cdn.net\/csz\/news\/tmb\/2023\/a-new-approach-to-impr-1.jpg\" data-src=\"https:\/\/scx2.b-cdn.net\/gfx\/news\/hires\/2023\/a-new-approach-to-impr-1.jpg\" data-sub-html=\"Training metrics of a state-of-the-art algorithm compared to the same algorithm with ICM (intrinsic rewards) on top of it. Credit: Martinez-Baselga, Riazuelo &amp; Montano\">\n<figure class=\"article-img text-center\"><img decoding=\"async\" src=\"https:\/\/scx1.b-cdn.net\/csz\/news\/800a\/2023\/a-new-approach-to-impr-1.jpg\" alt=\"A new approach to improve robot navigation in crowded environments\" title=\"Training metrics of a state-of-the-art algorithm compared to the same algorithm with ICM (intrinsic rewards) on top of it. Credit: Martinez-Baselga, Riazuelo &amp; Montano\"\/><figcaption class=\"text-left text-darken text-truncate text-low-up mt-3\">\n                Training metrics of a state-of-the-art algorithm compared to the same algorithm with ICM (intrinsic rewards) on top of it. Credit: Martinez-Baselga, Riazuelo &amp; Montano<br \/>\n            <\/figcaption><\/figure>\n<\/div>\n<\/div>\n<p>&#8220;Most of the works of deep reinforcement learning for crowd navigation of the state-of-the-art focus on improving the networks and the processing of what the robot senses,&#8221; Martinez Baselga said. &#8220;My approach studies how to explore the environment during training to improve the learning process. In training, instead of trying random actions or the optimal ones, the robot tries to do what it thinks it may learn more from.&#8221;<\/p>\n<p>                                            <!-- Google middle Adsense block --><\/p>\n<p>                                        Martinez Baselga and his colleagues evaluated the potential of using intrinsic rewards to tackle robot navigation in crowded spaces using two distinct approaches. The first of these integrates a so-called &#8220;intrinsic curiosity module&#8221; (ICM), while the second is based on a <a href=\"https:\/\/buradabiliyorum.com\/en\/category\/watch-movies-tv-seriess\/\" data-internallinksmanager029f6b8e52c=\"8\" title=\"Watch Movies &amp; TV Series\" target=\"_blank\" rel=\"noopener\">series<\/a> of algorithms known as random encoders for efficient exploration (RE3).<\/p>\n<p>The researchers evaluated these models in a series of simulations, which were ran on the <a rel=\"nofollow noopener\" target=\"_blank\" href=\"https:\/\/github.com\/vita-epfl\/CrowdNav\">CrowdNav simulator<\/a>. They found that both of their proposed approaches integrating intrinsic rewards outperformed previously developed state-of-the-art methods for robot navigation in crowded spaces.<\/p>\n<p>In the future, this study could encourage other roboticists to use intrinsic rewards when training their robots, to improve their ability to tackle unforeseen circumstances and safely move in highly dynamic environments. In addition, the two intrinsic rewards-based models tested by Martinez Baselga and his colleagues could soon be integrated and tested in real-robots, to further validate their potential.<\/p>\n<p>&#8220;The results show that applying these smart exploration strategies, the robot learns faster and the final policy learned is better; and that they could be applied in top of existing algorithms to improve them,&#8221; Martinez Baselga added. &#8220;In my next studies, I plan to improve deep reinforcement learning in robot navigation to make it safer and more reliable, which is very important in order to use it in the real world.&#8221;\n                                                                                                                            <\/p>\n<div class=\"article-main__more p-4\">\n<p><strong>More information:<\/strong><br \/>\n                                                Diego Martinez-Baselga et al, Improving robot navigation in crowded environments using intrinsic rewards, <i>arXiv<\/i> (2023).  <a rel=\"nofollow noopener\" target=\"_blank\" data-doi=\"1\" href=\"https:\/\/dx.doi.org\/10.48550\/arxiv.2302.06554\">DOI: 10.48550\/arxiv.2302.06554<\/a><\/p>\n<div class=\"mt-3\">\n                                                    <strong>Journal information:<\/strong><br \/>\n                                                                                                            <cite>arXiv<\/cite><br \/>\n                                                        <a rel=\"nofollow noopener\" target=\"_blank\" class=\"icon_open\" href=\"http:\/\/arxiv.org\/\"><br \/>\n                                                            <svg><use href=\"https:\/\/techx.b-cdn.net\/tmpl\/v2\/img\/svg\/sprite.svg#icon_open\" x=\"0\" y=\"0\"\/><\/svg><\/a> <\/p><\/div>\n<\/p><\/div>\n<p class=\"article-main__note mt-4\">\n                                                \u00a9 2023 <a href=\"https:\/\/buradabiliyorum.com\/en\/category\/sciencee\/\" data-internallinksmanager029f6b8e52c=\"5\" title=\"Science\" target=\"_blank\" rel=\"noopener\">Science<\/a> X Network<\/p>\n<p>                                        <!-- print only --><\/p>\n<div class=\"d-none d-print-block\">\n<p>                                                <strong>Citation<\/strong>:<br \/>\n                                                A new approach to improve robot navigation in crowded environments (2023, March 1)<br \/>\n                                                retrieved 1 March 2023<br \/>\n                                                from https:\/\/techxplore.com\/<a href=\"https:\/\/buradabiliyorum.com\/en\/category\/news\/\" data-internallinksmanager029f6b8e52c=\"2\" title=\"News\" target=\"_blank\" rel=\"noopener\">news<\/a>\/2023-02-approach-robot-crowded-environments.html<\/p>\n<p>                                            This document is subject to copyright. Apart from any fair dealing for the purpose of private study or research, no<br \/>\n                                            part may be reproduced without the written permission. The content is provided for information purposes only.<\/p><\/div>\n<\/p><\/div>\n<p><script id=\"facebook-jssdk\" async=\"\" src=\"https:\/\/connect.facebook.net\/en_US\/sdk.js\"><\/script><\/p>\n<blockquote><p><strong><span style=\"color: #ff6600;\">If you liked the article, do not forget to share it with your friends. Follow us on\u00a0<span style=\"color: #ff0000;\"><a style=\"color: #ff0000;\" href=\"https:\/\/news.google.com\/publications\/CAAqBwgKMLG0nwswvr63Aw\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">Google News<\/a><\/span>\u00a0too, click on the star and choose us from your favorites.<\/span><\/strong><\/p><\/blockquote>\n<blockquote>\n<p style=\"text-align: center;\">For forums sites go to <span style=\"color: #ff9900;\"><a style=\"color: #ff9900;\" href=\"https:\/\/forum.buradabiliyorum.com\/\" target=\"_blank\" rel=\"noopener\">Forum.BuradaBiliyorum.Com<\/a><\/span><\/strong>\n<\/p><\/blockquote>\n<blockquote>\n<p style=\"text-align: center;\"><strong>If you want to read more Like this articles, you can visit our <span style=\"color: #ff9900;\"><a style=\"color: #ff9900;\" href=\"https:\/\/en.buradabiliyorum.com\/science\/\" target=\"_blank\" rel=\"noopener\">Science category.<\/a><\/span><\/strong><\/p>\n<\/blockquote>\n<p><span style=\"color: black;\"><a style=\"color: #ff9900;\" href=\"https:\/\/techxplore.com\/news\/2023-02-approach-robot-crowded-environments.html\" target=\"_blank\" rel=\"noopener\">Source<\/a><\/span><\/p>\n","protected":false},"excerpt":{"rendered":"<p>&#8220;A new approach to improve robot navigation in crowded environments&#8221; A colliding trajectory of a robot that has been trained using a standard exploration strategy (left) and a successful trajectory of a robot that has been trained with intrinsic rewards in the same scenarios. Credit: Martinez-Baselga, Riazuelo &amp; Montano While robots have become increasingly advanced&#8230;<\/p>\n","protected":false},"author":1,"featured_media":558040,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"fifu_image_url":"https:\/\/scx2.b-cdn.net\/gfx\/news\/hires\/2023\/a-new-approach-to-impr.jpg","fifu_image_alt":"","footnotes":""},"categories":[16],"tags":[],"class_list":["post-558039","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-sciencee"],"_links":{"self":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/posts\/558039","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/comments?post=558039"}],"version-history":[{"count":0,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/posts\/558039\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/media\/558040"}],"wp:attachment":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/media?parent=558039"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/categories?post=558039"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/tags?post=558039"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}