{"id":225720,"date":"2021-04-13T16:40:02","date_gmt":"2021-04-13T13:40:02","guid":{"rendered":"https:\/\/en.buradabiliyorum.com\/a-robot-that-teaches-itself-to-walk-using-reinforcement-learning\/"},"modified":"2021-04-13T16:40:02","modified_gmt":"2021-04-13T13:40:02","slug":"a-robot-that-teaches-itself-to-walk-using-reinforcement-learning","status":"publish","type":"post","link":"https:\/\/buradabiliyorum.com\/en\/a-robot-that-teaches-itself-to-walk-using-reinforcement-learning\/","title":{"rendered":"#A robot that teaches itself to walk using reinforcement learning"},"content":{"rendered":"<p>&#8220;<strong>#A robot that teaches itself to walk using reinforcement learning<\/strong>&#8221;<\/p>\n<div>\n<div class=\"article-gallery lightGallery\">\n<div data-thumb=\"https:\/\/scx1.b-cdn.net\/csz\/news\/tmb\/2021\/60758d08131eb.jpg\" data-src=\"https:\/\/scx2.b-cdn.net\/gfx\/news\/hires\/2021\/60758d08131eb.jpg\" data-sub-html=\"Credit: arXiv:2103.14295 [cs.RO]\">\n<figure class=\"article-img\"><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/scx1.b-cdn.net\/csz\/news\/800a\/2021\/60758d08131eb.jpg\" alt=\"A robot that teaches itself to walk using reinforcement learning\" title=\"Credit: arXiv:2103.14295 [cs.RO]\" width=\"800\" height=\"458\"\/><figcaption class=\"text-darken text-low-up text-truncate-js text-truncate mt-3\">\n                Credit: arXiv:2103.14295 [cs.RO]<br \/>\n            <\/figcaption><\/figure>\n<\/div>\n<\/div>\n<p>A team of researchers at the University of California, Berkeley, has built a two-legged robot with t he ability to teach itself to walk using reinforcement learning. The team has written a paper describing their work and has uploaded it to the arXiv preprint server.<\/p>\n<p>                                                                                The work involved building a robot consisting of a pair of legs attached together and connected to a small holding frame. Currently, the robot carries out its tasks tethered to the frame, which is guided by one of the researchers. Compared to other robots, such as several made by Boston Dynamics, the robot seems primitive. But the robot, which the team has named Cassie, represents the leading edge of a new kind of <a href=\"https:\/\/buradabiliyorum.com\/en\/category\/technology\/\" data-internallinksmanager029f6b8e52c=\"4\" title=\"Technology\" target=\"_blank\" rel=\"noopener\">technology<\/a>\u2014in which a robot teaches itself to walk, rather than having it learn it through direct programming, or mimicry.<\/p>\n<p>Reinforcement learning is the kind exhibited by humans\u2014babies learn to walk by trying new movements. They do not get the whole process at once but remember steps that lead to walking. And then they build on what they have learned, adding more information that eventually leads to walking upright. But they do not stop there; they keep learning, and in so doing, grow better at it. In time, they learn new tricks, such as running, jumping or even skipping down a sidewalk.<\/p>\n<p>To help a robot learn to walk in the same way, the researchers began with a simulation of a robot in a virtual world. In the simulation, the robot was trained with information that described goals such as walking upright; an AI engine could remember and use what was learned. The simulation allowed the robot to learn to walk without damaging the actual hardware and sped the process. <\/p>\n<figure class=\"mb-4\" itemscope=\"\" itemtype=\"http:\/\/schema.org\/VideoObject\"><meta itemprop=\"name\" content=\"A robot that teaches itself to walk using reinforcement learning\"\/><meta itemprop=\"url\" content=\"https:\/\/www.youtube.com\/watch\/?v=goxCjGPQH7U\"\/><meta itemprop=\"description\" content=\"A robot that teaches itself to walk using reinforcement learning\"\/><meta itemprop=\"uploadDate\" content=\"2021-04-13T08:20:43-04:00\"\/><meta itemprop=\"embedUrl\" content=\"https:\/\/www.youtube.com\/embed\/goxCjGPQH7U\"\/><meta itemprop=\"thumbnailUrl\" content=\"https:\/\/img.youtube.com\/vi\/goxCjGPQH7U\/maxresdefault.jpg\"\/><br \/>\n             <iframe loading=\"lazy\" title=\"Reinforcement Learning for Robust Parameterized Locomotion Control of Bipedal Robots\" width=\"640\" height=\"360\" src=\"https:\/\/www.youtube.com\/embed\/goxCjGPQH7U?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" referrerpolicy=\"strict-origin-when-cross-origin\" allowfullscreen><\/iframe><\/p>\n<\/figure>\n<p>Once the robot in the simulation learned to walk, the researchers ported its knowledge to Cassie, who used it to walk in ways similar to a toddler. And just like a toddler, Cassie continued to learn. She learned how to keep from falling when slipping slightly, or to recover when shoved from the side. She also learned to compensate when two of her motors were damaged. The researchers plan to continue their work with reinforcement learning in robots to see how far they can go with it.\n                                                                                                                        <\/p>\n<hr\/>\n<div class=\"article-main__explore my-4 d-print-none\">\n<p>                                            A laser equipped robotic guide dog to lead people who are visually impaired\n                                        <\/p><\/div>\n<hr class=\"mb-4\"\/>\n<div class=\"article-main__more p-4\">\n                                                                                                <strong>More information:<\/strong><br \/>\n                                                Reinforcement Learning for Robust Parameterized Locomotion Control of Bipedal Robots, arXiv:2103.14295 [cs.RO] <a rel=\"nofollow noopener\" target=\"_blank\" href=\"https:\/\/arxiv.org\/abs\/2103.14295\">arxiv.org\/abs\/2103.14295<\/a><\/p><\/div>\n<p class=\"article-main__note mt-4\">\n                                                \u00a9 2021 <a href=\"https:\/\/buradabiliyorum.com\/en\/category\/sciencee\/\" data-internallinksmanager029f6b8e52c=\"5\" title=\"Science\" target=\"_blank\" rel=\"noopener\">Science<\/a> X Network<\/p>\n<p>                                        <!-- print only --><\/p>\n<div class=\"d-none d-print-block\">\n<p>                                                 <strong>Citation<\/strong>:<br \/>\n                                                 A robot that teaches itself to walk using reinforcement learning (2021, April 13)<br \/>\n                                                 retrieved 13 April 2021<br \/>\n                                                 from https:\/\/techxplore.com\/<a href=\"https:\/\/buradabiliyorum.com\/en\/category\/news\/\" data-internallinksmanager029f6b8e52c=\"2\" title=\"News\" target=\"_blank\" rel=\"noopener\">news<\/a>\/2021-04-robot.html<\/p>\n<p>                                            This document is subject to copyright. Apart from any fair dealing for the purpose of private study or research, no<br \/>\n                                            part may be reproduced without the written permission. The content is provided for information purposes only.<\/p><\/div>\n<\/p><\/div>\n<p><script id=\"facebook-jssdk\" async=\"\" src=\"https:\/\/connect.facebook.net\/en_US\/sdk.js\"><\/script><\/p>\n<blockquote><p><strong><span style=\"color: #ff6600;\">If you liked the article, do not forget to share it with your friends. Follow us on\u00a0<span style=\"color: #ff0000;\"><a style=\"color: #ff0000;\" href=\"https:\/\/news.google.com\/publications\/CAAqBwgKMLG0nwswvr63Aw\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">Google News<\/a><\/span>\u00a0too, click on the star and choose us from your favorites.<\/span><\/strong><\/p><\/blockquote>\n<blockquote>\n<p style=\"text-align: center;\">For forums sites go to <span style=\"color: #ff9900;\"><a style=\"color: #ff9900;\" href=\"https:\/\/forum.buradabiliyorum.com\/\" target=\"_blank\" rel=\"noopener\">Forum.BuradaBiliyorum.Com<\/a><\/span><\/strong><\/p>\n<\/blockquote>\n<blockquote>\n<p style=\"text-align: center;\"><strong>If you want to read more Like this articles, you can visit our <span style=\"color: #ff9900;\"><a style=\"color: #ff9900;\" href=\"https:\/\/en.buradabiliyorum.com\/science\/\" target=\"_blank\" rel=\"noopener\">Science category.<\/a><\/span><\/strong><\/p>\n<\/blockquote>\n<p><span style=\"color: black;\"><a style=\"color: #ff9900;\" href=\"https:\/\/techxplore.com\/news\/2021-04-robot.html\" target=\"_blank\" rel=\"noopener\">Source<\/a><\/span><\/p>\n","protected":false},"excerpt":{"rendered":"<p>&#8220;#A robot that teaches itself to walk using reinforcement learning&#8221; Credit: arXiv:2103.14295 [cs.RO] A team of researchers at the University of California, Berkeley, has built a two-legged robot with t he ability to teach itself to walk using reinforcement learning. The team has written a paper describing their work and has uploaded it to the&#8230;<\/p>\n","protected":false},"author":1,"featured_media":225721,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"fifu_image_url":"https:\/\/scx2.b-cdn.net\/gfx\/news\/hires\/2021\/60758d08131eb.jpg","fifu_image_alt":"","footnotes":""},"categories":[16],"tags":[],"class_list":["post-225720","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-sciencee"],"_links":{"self":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/posts\/225720","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/comments?post=225720"}],"version-history":[{"count":0,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/posts\/225720\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/media\/225721"}],"wp:attachment":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/media?parent=225720"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/categories?post=225720"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/tags?post=225720"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}