{"id":561505,"date":"2023-03-09T17:30:01","date_gmt":"2023-03-09T14:30:01","guid":{"rendered":"https:\/\/en.buradabiliyorum.com\/a-robot-that-can-autonomously-explore-real-world-environments\/"},"modified":"2023-03-09T17:30:01","modified_gmt":"2023-03-09T14:30:01","slug":"a-robot-that-can-autonomously-explore-real-world-environments","status":"publish","type":"post","link":"https:\/\/buradabiliyorum.com\/en\/a-robot-that-can-autonomously-explore-real-world-environments\/","title":{"rendered":"#A robot that can autonomously explore real-world environments"},"content":{"rendered":"<div id=\"ez-toc-container\" class=\"ez-toc-v2_0_89 counter-hierarchy ez-toc-counter ez-toc-custom ez-toc-container-direction\">\n<p class=\"ez-toc-title\" style=\"cursor:inherit\">Table of Contents<\/p>\n<label for=\"ez-toc-cssicon-toggle-item-6af3245f48319\" class=\"ez-toc-cssicon-toggle-label\"><span class=\"\"><span class=\"eztoc-hide\" style=\"display:none;\">Toggle<\/span><span class=\"ez-toc-icon-toggle-span\"><svg style=\"fill: #dd3333;color:#dd3333\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" class=\"list-377408\" width=\"20px\" height=\"20px\" viewBox=\"0 0 24 24\" fill=\"none\"><path d=\"M6 6H4v2h2V6zm14 0H8v2h12V6zM4 11h2v2H4v-2zm16 0H8v2h12v-2zM4 16h2v2H4v-2zm16 0H8v2h12v-2z\" fill=\"currentColor\"><\/path><\/svg><svg style=\"fill: #dd3333;color:#dd3333\" class=\"arrow-unsorted-368013\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"10px\" height=\"10px\" viewBox=\"0 0 24 24\" version=\"1.2\" baseProfile=\"tiny\"><path d=\"M18.2 9.3l-6.2-6.3-6.2 6.3c-.2.2-.3.4-.3.7s.1.5.3.7c.2.2.4.3.7.3h11c.3 0 .5-.1.7-.3.2-.2.3-.5.3-.7s-.1-.5-.3-.7zM5.8 14.7l6.2 6.3 6.2-6.3c.2-.2.3-.5.3-.7s-.1-.5-.3-.7c-.2-.2-.4-.3-.7-.3h-11c-.3 0-.5.1-.7.3-.2.2-.3.5-.3.7s.1.5.3.7z\"\/><\/svg><\/span><\/span><\/label><input type=\"checkbox\"  id=\"ez-toc-cssicon-toggle-item-6af3245f48319\" checked aria-label=\"Toggle\" \/><nav><ul class='ez-toc-list ez-toc-list-level-1 ' ><li class='ez-toc-page-1 ez-toc-heading-level-1'><a class=\"ez-toc-link ez-toc-heading-1\" href=\"https:\/\/buradabiliyorum.com\/en\/a-robot-that-can-autonomously-explore-real-world-environments\/#%E2%80%9CA_robot_that_can_autonomously_explore_real-world_environments%E2%80%9D\" >&#8220;A robot that can autonomously explore real-world environments&#8221;<\/a><\/li><\/ul><\/nav><\/div>\n<h1><span class=\"ez-toc-section\" id=\"%E2%80%9CA_robot_that_can_autonomously_explore_real-world_environments%E2%80%9D\"><\/span>&#8220;A robot that can autonomously explore real-world environments&#8221;<span class=\"ez-toc-section-end\"><\/span><\/h1>\n<div>\n<div class=\"article-gallery lightGallery\">\n<div data-thumb=\"https:\/\/scx1.b-cdn.net\/csz\/news\/tmb\/2023\/a-robot-that-can-auton.jpg\" data-src=\"https:\/\/scx2.b-cdn.net\/gfx\/news\/hires\/2023\/a-robot-that-can-auton.jpg\" data-sub-html=\"ALAN operating in real-world play-kitchen environments. Credit: Russell Mendonca, Shikhar Bahl, Deepak Pathak.\">\n<figure class=\"article-img\"><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/scx1.b-cdn.net\/csz\/news\/800a\/2023\/a-robot-that-can-auton.jpg\" alt=\"A robot that can autonomously explore real-world environments \" title=\"ALAN operating in real-world play-kitchen environments. Credit: Russell Mendonca, Shikhar Bahl, Deepak Pathak.\" width=\"800\" height=\"450\"\/><figcaption class=\"text-darken text-low-up text-truncate-js text-truncate mt-3\">\n                ALAN operating in real-world play-kitchen environments. Credit: Russell Mendonca, Shikhar Bahl, Deepak Pathak.<br \/>\n            <\/figcaption><\/figure>\n<\/div>\n<\/div>\n<p>Roboticists have developed many advanced systems over the past decade or so, yet most of these systems still require some degree of human supervision. Ideally, future robots should explore unknown environments autonomously and independently, continuously collecting data and learning from this data.<\/p>\n<p>Researchers at Carnegie Mellon University recently created <a rel=\"nofollow noopener\" target=\"_blank\" href=\"https:\/\/robo-explorer.github.io\/\">ALAN<\/a>, a robotic agent that can autonomously explore unfamiliar environments. This robot, introduced in a paper pre-published on <i>arXiv<\/i> and set to be presented at the International Conference of Robotics and Automation (ICRA 2023), was found to successfully complete tasks in the real-world after a brief number of exploration trials.<\/p>\n<p>&#8220;We have been interested in building an AI that learns by setting its own objectives,&#8221; Russell Mendonca, one of the researchers who carried out the study, told Tech Xplore. &#8220;By not depending on humans for supervision or guidance, such agents can keep learning in new scenarios, driven by their own curiosity. This would enable continual <a href=\"https:\/\/buradabiliyorum.com\/en\/category\/general\/\" data-internallinksmanager029f6b8e52c=\"3\" title=\"General\" target=\"_blank\" rel=\"noopener\">general<\/a>ization to different domains, and discovery of increasingly complex behavior.&#8221;<\/p>\n<p>The robotics group at Carnegie Mellon University had already introduced some autonomous agents that could perform well on new tasks with little or no additional training, including a model trained to play the Mario video-<a href=\"https:\/\/buradabiliyorum.com\/en\/category\/game\/\" data-internallinksmanager029f6b8e52c=\"7\" title=\"Game\" target=\"_blank\" rel=\"noopener\">game<\/a> and a system that could complete multi-stage object manipulation tasks. However, these systems were only trained and tested in simulated environments.<\/p>\n<figure class=\"mb-4\" itemscope=\"\" itemtype=\"http:\/\/schema.org\/VideoObject\"><meta itemprop=\"name\" content=\"A robot that can autonomously explore real-world environments\"\/><meta itemprop=\"url\" content=\"https:\/\/www.youtube.com\/watch\/?v=F-AyAXcqfM4\"\/><meta itemprop=\"description\" content=\"Credit: Deepak Pathak\"\/><meta itemprop=\"uploadDate\" content=\"2023-03-06T11:20:36-05:00\"\/><meta itemprop=\"embedUrl\" content=\"https:\/\/www.youtube.com\/embed\/F-AyAXcqfM4\"\/><meta itemprop=\"thumbnailUrl\" content=\"https:\/\/img.youtube.com\/vi\/F-AyAXcqfM4\/maxresdefault.jpg\"\/><br \/>\n             <iframe loading=\"lazy\" title=\"Curiosity-driven Robots in the Real World\" width=\"640\" height=\"360\" src=\"https:\/\/www.youtube.com\/embed\/F-AyAXcqfM4?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" referrerpolicy=\"strict-origin-when-cross-origin\" allowfullscreen><\/iframe><figcaption class=\"text-darken text-low-up mt-4\" itemprop=\"caption\">Credit: Deepak Pathak<\/figcaption><\/figure>\n<p>The key objective of the team&#8217;s recent study was to create a framework that could be <a href=\"https:\/\/buradabiliyorum.com\/en\/category\/download-scripts-themes-apps\/\" data-internallinksmanager029f6b8e52c=\"9\" title=\"Download Scripts &amp; Themes &amp; Apps\" target=\"_blank\" rel=\"noopener\">app<\/a>lied to physical robots in the world, improving their ability to explore their surroundings and complete new tasks. ALAN, the system they create, learns to explore its environment autonomously, without receiving rewards or guidance from human agents. Subsequently, it can repurpose what it learned in the past to tackle new tasks or problems.<\/p>\n<p>&#8220;ALAN learns a world model in which to plan its actions, and directs itself using environment-centric and agent-centric objectives,&#8221; Mendonca explained. &#8220;It also reduces the workspace to the area of interest using off the shelf pretrained detectors. After exploration, the robot can stitch the discovered skills to perform single and multi-stage tasks specified via goal images.&#8221;<\/p>\n<p>The researchers&#8217; robot features a visual module that can estimate the movements of objects in its surroundings. This module then uses these estimations of how objects have moved to maximize the change in objects and encourage the robot to interact with these objects.<\/p>\n<p>                                            <!-- Google middle Adsense block --><\/p>\n<p>                                        &#8220;This is an environment centric signal, since it is not dependent on the agent&#8217;s belief,&#8221; Mendonca said. &#8220;To improve its estimate of the change in objects, ALAN needs to be curious about it. For this, ALAN uses its learned model of the world to identify actions where it is uncertain about the predicted object change, and then executes them in the real world. This agent-centric signal evolves as the robot sees more data.&#8221;\n<\/p>\n<div class=\"article-gallery lightGallery\">\n<div data-thumb=\"https:\/\/scx1.b-cdn.net\/csz\/news\/tmb\/2023\/a-robot-that-can-auton-1.jpg\" data-src=\"https:\/\/scx2.b-cdn.net\/gfx\/news\/hires\/2023\/a-robot-that-can-auton-1.jpg\" data-sub-html=\"ALAN operating in real-world play-kitchen environments. Credit: Russell Mendonca, Shikhar Bahl, Deepak Pathak.\">\n<figure class=\"article-img text-center\"><img decoding=\"async\" src=\"https:\/\/scx1.b-cdn.net\/csz\/news\/800a\/2023\/a-robot-that-can-auton-1.jpg\" alt=\"A robot that can autonomously explore real-world environments \" title=\"ALAN operating in real-world play-kitchen environments. Credit: Russell Mendonca, Shikhar Bahl, Deepak Pathak.\"\/><figcaption class=\"text-left text-darken text-truncate text-low-up mt-3\">\n                ALAN operating in real-world play-kitchen environments. Credit: Russell Mendonca, Shikhar Bahl, Deepak Pathak.<br \/>\n            <\/figcaption><\/figure>\n<\/div>\n<\/div>\n<p>Previously proposed approaches for autonomous robot exploration required large amounts of training data. This prevents or significantly limits their deployment on real robots. In contrast, the learning approach proposed by Mendonca and his colleagues allows the ALAN robot to continuously and autonomously learn to complete tasks as it is exploring their surroundings.<\/p>\n<p>&#8220;We show that ALAN can learn how to manipulate objects with only around 100 trajectories in 1\u20132 hours in two distinct play kitchens, without any rewards,&#8221; Mendonca said. &#8220;Hence, using visual priors can greatly increase efficiency of robot learning. Scaled up versions of this system that are run in a 24\/7 manner will be able to continually acquire new useful skills with minimal human intervention across domains, bringing us closer to general-purpose intelligent robots.&#8221;<\/p>\n<p>In initial evaluations, the team&#8217;s robot performed remarkably well, as it was able to quickly learn to complete new manipulation tasks without any training or help from human agents. In the future, ALAN and the framework underpinning it could pave the way for the creation of better performing autonomous robotic systems for environment exploration.<\/p>\n<p>&#8220;Next we want to study how to utilize other priors to help structure the robot&#8217;s behavior, such as videos of humans performing tasks and language descriptions,&#8221; Mendonca added. &#8220;Systems that can effectively build upon this data will be able to autonomously explore better by operating in structured spaces. Further, we are interested in multi-robot systems that can pool their experience to continually learn.&#8221;\n                                                                                                                            <\/p>\n<div class=\"article-main__more p-4\">\n<p><strong>More information:<\/strong><br \/>\n                                                Russell Mendonca et al, ALAN: Autonomously Exploring Robotic Agents in the Real World, <i>arXiv<\/i> (2023).  <a rel=\"nofollow noopener\" target=\"_blank\" data-doi=\"1\" href=\"https:\/\/dx.doi.org\/10.48550\/arxiv.2302.06604\">DOI: 10.48550\/arxiv.2302.06604<\/a><\/p>\n<div class=\"mt-3\">\n                                                    <strong>Journal information:<\/strong><br \/>\n                                                                                                            <cite>arXiv<\/cite><br \/>\n                                                        <a rel=\"nofollow noopener\" target=\"_blank\" class=\"icon_open\" href=\"http:\/\/arxiv.org\/\"><br \/>\n                                                            <svg><use href=\"https:\/\/techx.b-cdn.net\/tmpl\/v2\/img\/svg\/sprite.svg#icon_open\" x=\"0\" y=\"0\"\/><\/svg><\/a> <\/p><\/div>\n<\/p><\/div>\n<p class=\"article-main__note mt-4\">\n                                                \u00a9 2023 <a href=\"https:\/\/buradabiliyorum.com\/en\/category\/sciencee\/\" data-internallinksmanager029f6b8e52c=\"5\" title=\"Science\" target=\"_blank\" rel=\"noopener\">Science<\/a> X Network<\/p>\n<p>                                        <!-- print only --><\/p>\n<div class=\"d-none d-print-block\">\n<p>                                                <strong>Citation<\/strong>:<br \/>\n                                                A robot that can autonomously explore real-world environments (2023, March 9)<br \/>\n                                                retrieved 9 March 2023<br \/>\n                                                from https:\/\/techxplore.com\/<a href=\"https:\/\/buradabiliyorum.com\/en\/category\/news\/\" data-internallinksmanager029f6b8e52c=\"2\" title=\"News\" target=\"_blank\" rel=\"noopener\">news<\/a>\/2023-03-robot-autonomously-explore-real-world-environments.html<\/p>\n<p>                                            This document is subject to copyright. Apart from any fair dealing for the purpose of private study or research, no<br \/>\n                                            part may be reproduced without the written permission. The content is provided for information purposes only.<\/p><\/div>\n<\/p><\/div>\n<p><script id=\"facebook-jssdk\" async=\"\" src=\"https:\/\/connect.facebook.net\/en_US\/sdk.js\"><\/script><\/p>\n<blockquote><p><strong><span style=\"color: #ff6600;\">If you liked the article, do not forget to share it with your friends. Follow us on\u00a0<span style=\"color: #ff0000;\"><a style=\"color: #ff0000;\" href=\"https:\/\/news.google.com\/publications\/CAAqBwgKMLG0nwswvr63Aw\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">Google News<\/a><\/span>\u00a0too, click on the star and choose us from your favorites.<\/span><\/strong><\/p><\/blockquote>\n<blockquote>\n<p style=\"text-align: center;\">For forums sites go to <span style=\"color: #ff9900;\"><a style=\"color: #ff9900;\" href=\"https:\/\/forum.buradabiliyorum.com\/\" target=\"_blank\" rel=\"noopener\">Forum.BuradaBiliyorum.Com<\/a><\/span><\/strong>\n<\/p><\/blockquote>\n<blockquote>\n<p style=\"text-align: center;\"><strong>If you want to read more Like this articles, you can visit our <span style=\"color: #ff9900;\"><a style=\"color: #ff9900;\" href=\"https:\/\/en.buradabiliyorum.com\/science\/\" target=\"_blank\" rel=\"noopener\">Science category.<\/a><\/span><\/strong><\/p>\n<\/blockquote>\n<p><span style=\"color: black;\"><a style=\"color: #ff9900;\" href=\"https:\/\/techxplore.com\/news\/2023-03-robot-autonomously-explore-real-world-environments.html\" target=\"_blank\" rel=\"noopener\">Source<\/a><\/span><\/p>\n","protected":false},"excerpt":{"rendered":"<p>&#8220;A robot that can autonomously explore real-world environments&#8221; ALAN operating in real-world play-kitchen environments. Credit: Russell Mendonca, Shikhar Bahl, Deepak Pathak. Roboticists have developed many advanced systems over the past decade or so, yet most of these systems still require some degree of human supervision. Ideally, future robots should explore unknown environments autonomously and independently,&#8230;<\/p>\n","protected":false},"author":1,"featured_media":561506,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"fifu_image_url":"https:\/\/scx2.b-cdn.net\/gfx\/news\/hires\/2023\/a-robot-that-can-auton.jpg","fifu_image_alt":"","footnotes":""},"categories":[16],"tags":[],"class_list":["post-561505","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-sciencee"],"_links":{"self":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/posts\/561505","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/comments?post=561505"}],"version-history":[{"count":0,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/posts\/561505\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/media\/561506"}],"wp:attachment":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/media?parent=561505"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/categories?post=561505"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/tags?post=561505"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}