{"id":489572,"date":"2022-09-02T01:09:19","date_gmt":"2022-09-01T22:09:19","guid":{"rendered":"https:\/\/en.buradabiliyorum.com\/forget-chess-deepminds-training-its-new-ai-to-play-football\/"},"modified":"2022-09-02T01:09:19","modified_gmt":"2022-09-01T22:09:19","slug":"forget-chess-deepminds-training-its-new-ai-to-play-football","status":"publish","type":"post","link":"https:\/\/buradabiliyorum.com\/en\/forget-chess-deepminds-training-its-new-ai-to-play-football\/","title":{"rendered":"#Forget chess, DeepMind\u2019s training its new AI to play football"},"content":{"rendered":"<div id=\"ez-toc-container\" class=\"ez-toc-v2_0_85 counter-hierarchy ez-toc-counter ez-toc-custom ez-toc-container-direction\">\n<p class=\"ez-toc-title\" style=\"cursor:inherit\">Table of Contents<\/p>\n<label for=\"ez-toc-cssicon-toggle-item-6a3717c9b6e18\" class=\"ez-toc-cssicon-toggle-label\"><span class=\"\"><span class=\"eztoc-hide\" style=\"display:none;\">Toggle<\/span><span class=\"ez-toc-icon-toggle-span\"><svg style=\"fill: #dd3333;color:#dd3333\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" class=\"list-377408\" width=\"20px\" height=\"20px\" viewBox=\"0 0 24 24\" fill=\"none\"><path d=\"M6 6H4v2h2V6zm14 0H8v2h12V6zM4 11h2v2H4v-2zm16 0H8v2h12v-2zM4 16h2v2H4v-2zm16 0H8v2h12v-2z\" fill=\"currentColor\"><\/path><\/svg><svg style=\"fill: #dd3333;color:#dd3333\" class=\"arrow-unsorted-368013\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"10px\" height=\"10px\" viewBox=\"0 0 24 24\" version=\"1.2\" baseProfile=\"tiny\"><path d=\"M18.2 9.3l-6.2-6.3-6.2 6.3c-.2.2-.3.4-.3.7s.1.5.3.7c.2.2.4.3.7.3h11c.3 0 .5-.1.7-.3.2-.2.3-.5.3-.7s-.1-.5-.3-.7zM5.8 14.7l6.2 6.3 6.2-6.3c.2-.2.3-.5.3-.7s-.1-.5-.3-.7c-.2-.2-.4-.3-.7-.3h-11c-.3 0-.5.1-.7.3-.2.2-.3.5-.3.7s.1.5.3.7z\"\/><\/svg><\/span><\/span><\/label><input type=\"checkbox\"  id=\"ez-toc-cssicon-toggle-item-6a3717c9b6e18\" checked aria-label=\"Toggle\" \/><nav><ul class='ez-toc-list ez-toc-list-level-1 ' ><li class='ez-toc-page-1 ez-toc-heading-level-1'><a class=\"ez-toc-link ez-toc-heading-1\" href=\"https:\/\/buradabiliyorum.com\/en\/forget-chess-deepminds-training-its-new-ai-to-play-football\/#%E2%80%9CForget_chess_DeepMinds_training_its_new_AI_to_play_football%E2%80%9D\" >&#8220;Forget chess, DeepMind\u2019s training its new AI to play football&#8221;<\/a><ul class='ez-toc-list-level-4' ><li class='ez-toc-heading-level-4'><ul class='ez-toc-list-level-4' ><li class='ez-toc-heading-level-4'><ul class='ez-toc-list-level-4' ><li class='ez-toc-heading-level-4'><a class=\"ez-toc-link ez-toc-heading-2\" href=\"https:\/\/buradabiliyorum.com\/en\/forget-chess-deepminds-training-its-new-ai-to-play-football\/#Sign_up_to_the_TNW_Conference_newsletter\" >Sign up to the TNW Conference newsletter<\/a><\/li><\/ul><\/li><\/ul><\/li><\/ul><\/li><\/ul><\/nav><\/div>\n<h1><span class=\"ez-toc-section\" id=\"%E2%80%9CForget_chess_DeepMinds_training_its_new_AI_to_play_football%E2%80%9D\"><\/span>&#8220;Forget chess, DeepMind\u2019s training its new AI to play football&#8221;<span class=\"ez-toc-section-end\"><\/span><\/h1>\n<p><img decoding=\"async\" src=\"https:\/\/img-cdn.tnwcdn.com\/image?fit=796%2C417&amp;url=https%3A%2F%2Fcdn0.tnwcdn.com%2Fwp-content%2Fblogs.dir%2F1%2Ffiles%2F2022%2F09%2Fdeepmindfootball.jpg&amp;signature=b36297f3205cd11d5c366f214e1252b1\" \/><\/p>\n<div id=\"article-main-content\">\n                            Researchers from DeepMind, the UK\u2019s juggernaut AI lab, have forsaken the noble <a href=\"https:\/\/buradabiliyorum.com\/en\/category\/game\/\" data-internallinksmanager029f6b8e52c=\"7\" title=\"Game\" target=\"_blank\" rel=\"noopener\">game<\/a>s of chess and Go for a more plebeian delight: football.<\/p>\n<p>The Google sister company yesterday published a research paper and accompanying blog post detailing its new neural probabilistic motor primitives (NPMP) \u2014 a method by which artificial intelligence agents can learn to operate physical bodies.<\/p>\n<p>Per the <a rel=\"nofollow noopener\" target=\"_blank\" href=\"https:\/\/www.deepmind.com\/blog\/from-motor-control-to-embodied-intelligence\">blog post<\/a>:<\/p>\n<blockquote><p>An NPMP is a <a href=\"https:\/\/buradabiliyorum.com\/en\/category\/general\/\" data-internallinksmanager029f6b8e52c=\"3\" title=\"General\" target=\"_blank\" rel=\"noopener\">general<\/a>-purpose motor control module that translates short-horizon motor intentions to low-level control signals, and it\u2019s trained offline or via RL by imitating motion capture (MoCap) data, recorded with trackers on humans or animals performing motions of interest.<\/p>\n<\/blockquote>\n<div class=\"inarticle-wrapper channel-cta\">\n<div class=\"ica-text\">\n<h4><span class=\"ez-toc-section\" id=\"Sign_up_to_the_TNW_Conference_newsletter\"><\/span>Sign up to the TNW Conference newsletter<span class=\"ez-toc-section-end\"><\/span><\/h4>\n<p>And be the first in line for ticket offers, event <a href=\"https:\/\/buradabiliyorum.com\/en\/category\/news\/\" data-internallinksmanager029f6b8e52c=\"2\" title=\"News\" target=\"_blank\" rel=\"noopener\">news<\/a>, and more!<\/p>\n<\/div>\n<\/div>\n<p><strong>Up front:<\/strong> Essentially, the DeepMind team created an AI system that can learn how to do things inside of a physics simulator by watching videos of other agents performing those tasks.<\/p>\n<p>And, of course, if you\u2019ve got a giant physics engine and an endless supply of curious robots, the only rational thing to do is to teach it how to dribble and shoot:<\/p>\n<figure>\n<p>                <iframe loading=\"lazy\" srcdoc=\"&lt;style&gt;*{padding:0;margin:0;overflow:hidden}html,body{background:#000;height:100%}img{position:absolute;top:0;left:0;width:100%;height:100%;object-fit:cover;transition:opacity .1s cubic-bezier(0.4,0,1,1)}a:hover img+img{opacity:1!important}&lt;\/style&gt;&lt;a href=\" https:=\"\" src=\"https:\/\/img.youtube.com\/vi\/foBwHVenxeU\/hqdefault.jpg\" style=\"top: 50%;left:50%;width:68px;height:48px;transform:translate3d(-50%,-50%,0)\" height=\"240\" width=\"320\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture\" allowfullscreen=\"\" frameborder=\"0\"><\/iframe><\/p>\n<\/figure>\n<p>        <!--resp-video-container--><br \/>\nAccording to the team\u2019s <a rel=\"nofollow noopener\" target=\"_blank\" href=\"https:\/\/www.science.org\/doi\/10.1126\/scirobotics.abo0235\">research paper<\/a>:<\/p>\n<blockquote><p>We optimized teams of agents to play simulated football via reinforcement learning, constraining the solution space to that of plausible movements learned using human motion capture data.<\/p>\n<\/blockquote>\n<p><strong>Background:<\/strong> In order to train AI to operate and control robots in the world, researchers have to prepare the machines for reality. And, outside of simulations, anything can h<a href=\"https:\/\/buradabiliyorum.com\/en\/category\/download-scripts-themes-apps\/\" data-internallinksmanager029f6b8e52c=\"9\" title=\"Download Scripts &amp; Themes &amp; Apps\" target=\"_blank\" rel=\"noopener\">app<\/a>en. Agents have to deal with gravity, unexpectedly slippery surfaces, and unplanned interference from other agents.<\/p>\n<p>The point of the exercise isn\u2019t to build a better footballer \u2014 Cristiano Ronaldo has nothing to fear from the robots, for now \u2014 but instead to help the AI and its developers figure out how to optimize the agents\u2019 ability to predict outcomes.<\/p>\n<p>As the AI starts its training, it\u2019s barely able to move its physics-based humanoid avatar around the field. But, by rewarding an agent every time its team scores a goal, the model is able to get the figures up and running in around 50 hours. After several days of training, the AI begins to predict where the ball will go and how the other agents will react to its movement.<\/p>\n<p>Per the paper:<\/p>\n<blockquote><p>The result is a team of coordinated humanoid football players that exhibit complex behavior at different scales, quantified by a range of analysis and statistics, including those used in real-world sport analytics. Our work constitutes a complete demonstration of learned integrated decision-making at multiple scales in a multiagent setting.<\/p>\n<\/blockquote>\n<p><strong>Quick take:<\/strong> This work is pretty rad. But we\u2019re not so sure it represents a \u201ccomplete demonstration\u201d of anything. The model is obviously capable of operating an embodied agent. But, based on the <i>apparently cherry-picked<\/i> GIFs on the blog post, this work is still deeply in the simulation phase.<\/p>\n<p>The bottom line here, is that the AI isn\u2019t \u201clearning\u201d how to play football. It\u2019s brute-forcing movement within the boundaries of its simulation. That may seem like a minor quibble, but the results are quite evident:<\/p>\n<figure class=\"post-image post-mediaBleed aligncenter\"><video class=\"gifsnomore size-full wp-image-1391193 aligncenter \" autoplay=\"\" loop=\"\" muted=\"\"><source type=\"video\/mp4\" src=\"https:\/\/cdn0.tnwcdn.com\/wp-content\/blogs.dir\/1\/files\/2022\/09\/terrified-robots.mp4\"\/><\/video><figcaption>Credit: DeepMind<\/figcaption><\/figure>\n<p>The above AI agent looks absolutely terrified. I don\u2019t know what it\u2019s running away from, but I\u2019m certain that it\u2019s the scariest thing ever.<\/p>\n<p>It moves like an alien wearing a human suit for the first time because, unlike humans, AI cannot learn by watching. Systems like the one DeepMind trained parse thousands of hours of video and, essentially, extricate motion data about the subject their trying to \u201clearn\u201d from.<\/p>\n<p>However, it\u2019s almost certain that these models will become more robust as time goes on. We\u2019ve seen what Boston Dynamics can do with machine learning algorithms and pre-programmed choreography.<\/p>\n<p>It\u2019ll be interesting to see how more adaptive models, such as the ones being developed by DeepMind, will fare once they move beyond the laboratory environment and into actual robotics applications.\n                        <\/p><\/div>\n<blockquote><p><strong><span style=\"color: #ff6600;\">If you liked the article, do not forget to share it with your friends. Follow us on\u00a0<span style=\"color: #ff0000;\"><a style=\"color: #ff0000;\" href=\"https:\/\/news.google.com\/publications\/CAAqBwgKMLG0nwswvr63Aw\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">Google News<\/a><\/span>\u00a0too, click on the star and choose us from your favorites.<\/span><\/strong><\/p><\/blockquote>\n<blockquote>\n<p style=\"text-align: center;\">For forums sites go to <span style=\"color: #ff9900;\"><a style=\"color: #ff9900;\" href=\"https:\/\/forum.buradabiliyorum.com\/\" target=\"_blank\" rel=\"noopener\">Forum.BuradaBiliyorum.Com<\/a><\/span><\/strong>\n<\/p><\/blockquote>\n<blockquote>\n<p style=\"text-align: center;\"><strong>If you want to read more like this article, you can visit our <span style=\"color: #ff9900;\"><a style=\"color: #ff9900;\" href=\"https:\/\/en.buradabiliyorum.com\/technology\/\" target=\"_blank\" rel=\"noopener\">Technology category.<\/a><\/span><\/strong><\/p>\n<\/blockquote>\n<p><span style=\"color: black;\"><a style=\"color: #ff9900;\" href=\"https:\/\/thenextweb.com\/news\/forget-chess-deepminds-training-new-ai-play-football\" target=\"_blank\" rel=\"noopener\">Source<\/a><\/span><\/p>\n","protected":false},"excerpt":{"rendered":"<p>&#8220;Forget chess, DeepMind\u2019s training its new AI to play football&#8221; Researchers from DeepMind, the UK\u2019s juggernaut AI lab, have forsaken the noble games of chess and Go for a more plebeian delight: football. The Google sister company yesterday published a research paper and accompanying blog post detailing its new neural probabilistic motor primitives (NPMP) \u2014&#8230;<\/p>\n","protected":false},"author":1,"featured_media":489573,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"fifu_image_url":"https:\/\/img-cdn.tnwcdn.com\/image\/tnw?filter_last=1&fit=1280,640&url=https:\/\/cdn0.tnwcdn.com\/wp-content\/blogs.dir\/1\/files\/2022\/09\/deepmindfootball.jpg&signature=c9c7547e41dd0811817adb1b56c4a07d","fifu_image_alt":"","footnotes":""},"categories":[18],"tags":[],"class_list":["post-489572","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-technology"],"_links":{"self":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/posts\/489572","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/comments?post=489572"}],"version-history":[{"count":0,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/posts\/489572\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/media\/489573"}],"wp:attachment":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/media?parent=489572"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/categories?post=489572"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/tags?post=489572"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}