{"id":496114,"date":"2022-09-26T11:01:02","date_gmt":"2022-09-26T08:01:02","guid":{"rendered":"https:\/\/en.buradabiliyorum.com\/a-new-common-sense-test-for-ai-could-lead-to-smarter-machines\/"},"modified":"2022-09-26T11:01:02","modified_gmt":"2022-09-26T08:01:02","slug":"a-new-common-sense-test-for-ai-could-lead-to-smarter-machines","status":"publish","type":"post","link":"https:\/\/buradabiliyorum.com\/en\/a-new-common-sense-test-for-ai-could-lead-to-smarter-machines\/","title":{"rendered":"#A new \u2018common sense\u2019 test for AI could lead to smarter machines"},"content":{"rendered":"<div id=\"ez-toc-container\" class=\"ez-toc-v2_0_85 counter-hierarchy ez-toc-counter ez-toc-custom ez-toc-container-direction\">\n<p class=\"ez-toc-title\" style=\"cursor:inherit\">Table of Contents<\/p>\n<label for=\"ez-toc-cssicon-toggle-item-6a408725f1514\" class=\"ez-toc-cssicon-toggle-label\"><span class=\"\"><span class=\"eztoc-hide\" style=\"display:none;\">Toggle<\/span><span class=\"ez-toc-icon-toggle-span\"><svg style=\"fill: #dd3333;color:#dd3333\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" class=\"list-377408\" width=\"20px\" height=\"20px\" viewBox=\"0 0 24 24\" fill=\"none\"><path d=\"M6 6H4v2h2V6zm14 0H8v2h12V6zM4 11h2v2H4v-2zm16 0H8v2h12v-2zM4 16h2v2H4v-2zm16 0H8v2h12v-2z\" fill=\"currentColor\"><\/path><\/svg><svg style=\"fill: #dd3333;color:#dd3333\" class=\"arrow-unsorted-368013\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"10px\" height=\"10px\" viewBox=\"0 0 24 24\" version=\"1.2\" baseProfile=\"tiny\"><path d=\"M18.2 9.3l-6.2-6.3-6.2 6.3c-.2.2-.3.4-.3.7s.1.5.3.7c.2.2.4.3.7.3h11c.3 0 .5-.1.7-.3.2-.2.3-.5.3-.7s-.1-.5-.3-.7zM5.8 14.7l6.2 6.3 6.2-6.3c.2-.2.3-.5.3-.7s-.1-.5-.3-.7c-.2-.2-.4-.3-.7-.3h-11c-.3 0-.5.1-.7.3-.2.2-.3.5-.3.7s.1.5.3.7z\"\/><\/svg><\/span><\/span><\/label><input type=\"checkbox\"  id=\"ez-toc-cssicon-toggle-item-6a408725f1514\" checked aria-label=\"Toggle\" \/><nav><ul class='ez-toc-list ez-toc-list-level-1 ' ><li class='ez-toc-page-1 ez-toc-heading-level-1'><a class=\"ez-toc-link ez-toc-heading-1\" href=\"https:\/\/buradabiliyorum.com\/en\/a-new-common-sense-test-for-ai-could-lead-to-smarter-machines\/#%E2%80%9CA_new_%E2%80%98common_sense_test_for_AI_could_lead_to_smarter_machines%E2%80%9D\" >&#8220;A new \u2018common sense\u2019 test for AI could lead to smarter machines&#8221;<\/a><ul class='ez-toc-list-level-2' ><li class='ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-2\" href=\"https:\/\/buradabiliyorum.com\/en\/a-new-common-sense-test-for-ai-could-lead-to-smarter-machines\/#Greetings_humanoids\" >Greetings, humanoids<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-3\" href=\"https:\/\/buradabiliyorum.com\/en\/a-new-common-sense-test-for-ai-could-lead-to-smarter-machines\/#So_why_does_it_matter_if_we_teach_AI_common_sense\" >So why does it matter if we teach AI common sense?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-4\" href=\"https:\/\/buradabiliyorum.com\/en\/a-new-common-sense-test-for-ai-could-lead-to-smarter-machines\/#Secret_AGENT\" >Secret AGENT<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-5\" href=\"https:\/\/buradabiliyorum.com\/en\/a-new-common-sense-test-for-ai-could-lead-to-smarter-machines\/#Common_sense\" >Common sense?<\/a><\/li><\/ul><\/li><\/ul><\/nav><\/div>\n<h1><span class=\"ez-toc-section\" id=\"%E2%80%9CA_new_%E2%80%98common_sense_test_for_AI_could_lead_to_smarter_machines%E2%80%9D\"><\/span>&#8220;A new \u2018common sense\u2019 test for AI could lead to smarter machines&#8221;<span class=\"ez-toc-section-end\"><\/span><\/h1>\n<div id=\"article-main-content\">\n                            <em>Content provided by <a rel=\"nofollow noopener\" target=\"_blank\" href=\"https:\/\/www.ibm.com\/nl-en\">IBM<\/a> and TNW.<\/em><\/p>\n<p>Today\u2019s AI systems are quickly evolving to become humans\u2019 new best friend. We now have AIs that can concoct award-winning whiskey, write poetry, and help doctors perform extremely precise surgical operations. But one thing they can\u2019t do \u2014 which is, on the surface, far simpler than all those other things \u2014\u00a0is use common sense.<\/p>\n<p>Common sense is different from intelligence in that it is usually something innate and natural to humans that helps them navigate daily life, and cannot really be taught. In 1906, philosopher G. K. Chesterton <a rel=\"nofollow noopener\" target=\"_blank\" href=\"http:\/\/www.online-literature.com\/chesterton\/charlesdickens\/6\/\">wrote<\/a> that \u201ccommon sense is a wild thing, savage, and beyond rules.\u201d<\/p>\n<div class=\"inarticle-wrapper neural channel-cta hs-embed-tnw\">\n<div id=\"hs-embed-tnw\" class=\"channel-cta-wrapper\">\n<div class=\"channel-cta-img\"><img class=\"js-lazy\" https:=\"\"\/><\/div>\n<p><noscript><img decoding=\"async\" src=\"https:\/\/thenextweb.com\/news\/src=\" https:=\"\"\/><\/noscript><\/p>\n<div class=\"channel-cta-input\">\n<h2 class=\"channel-cta-title\"><span class=\"ez-toc-section\" id=\"Greetings_humanoids\"><\/span>Greetings, humanoids<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p class=\"channel-cta-tagline\">Subscribe to our <a href=\"https:\/\/buradabiliyorum.com\/en\/category\/news\/\" data-internallinksmanager029f6b8e52c=\"2\" title=\"News\" target=\"_blank\" rel=\"noopener\">news<\/a>letter now for a weekly recap of our favorite AI stories in your inbox.<\/p>\n<\/div>\n<\/div>\n<\/div>\n<p>Robots, of course, run on algorithms that are just that: rules.<\/p>\n<p>So no, robots can\u2019t use common sense \u2014 yet. But thanks to current efforts in the field, we can now measure an AI\u2019s core psychological reasoning ability, bringing us one step closer.<\/p>\n<h2><span class=\"ez-toc-section\" id=\"So_why_does_it_matter_if_we_teach_AI_common_sense\"><\/span><strong>So why does it matter if we teach AI common sense?<\/strong><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p>Really it comes down to the fact that common sense will make AI better at helping us solve real-world issues. Many argue that AI-driven solutions designed for complex problems, like <a rel=\"nofollow noopener\" target=\"_blank\" href=\"https:\/\/www.technologyreview.com\/2021\/07\/30\/1030329\/machine-learning-ai-failed-covid-hospital-diagnosis-pandemic\/\">diagnosing Covid-19 treatments<\/a> for example, often fail, as the system can\u2019t readily adapt to a real-world situation where the problems are unpredictable, vague, and not defined by rules.<\/p>\n<blockquote class=\"c-richText__pullQuote\">\n<div class=\"c-richText__pullQuoteGradient\">\n<p class=\"c-richText__pullQuoteQuote\">Common sense includes not only <a href=\"https:\/\/buradabiliyorum.com\/en\/category\/social-mediaa\/\" data-internallinksmanager029f6b8e52c=\"1\" title=\"Social Media\" target=\"_blank\" rel=\"noopener\">social<\/a> abilities and reasoning but also a \u201cnaive sense of physics.\u201d<\/p>\n<\/p><\/div>\n<\/blockquote>\n<p>Injecting common sense into AI could mean big things for humans; better customer service, where a robot can actually assist a disgruntled customer beyond sending them into an endless \u201cChoose from the following options\u201d loop. It can make autonomous cars react better to unexpected roadway incidences. It can even help the military <a rel=\"nofollow noopener\" target=\"_blank\" href=\"https:\/\/www.technologyreview.com\/2018\/10\/11\/103957\/the-us-military-wants-to-teach-ai-some-basic-common-sense\/\">draw life-or-death information<\/a> from intelligence.<\/p>\n<p>So why haven\u2019t scientists been able to crack the common sense code thus far?<\/p>\n<p>Called the \u201c<a rel=\"nofollow noopener\" target=\"_blank\" href=\"https:\/\/www.technologyreview.com\/2018\/10\/11\/103957\/the-us-military-wants-to-teach-ai-some-basic-common-sense\/\">dark matter of AI<\/a>\u201d, common sense is both crucial to AI\u2019s future development and, thus far, elusive. Equipping computers with common sense has actually been a goal of computer <a href=\"https:\/\/buradabiliyorum.com\/en\/category\/sciencee\/\" data-internallinksmanager029f6b8e52c=\"5\" title=\"Science\" target=\"_blank\" rel=\"noopener\">science<\/a> since the field\u2019s very start; in 1958, pioneering computer scientist John McCarthy <a rel=\"nofollow noopener\" target=\"_blank\" href=\"http:\/\/jmc.stanford.edu\/articles\/mcc59.html\">published a paper<\/a> titled \u201cPrograms with common sense\u201d which looked at how logic could be used as a method of representing information in computer memory. But we\u2019ve not moved much closer to making it a reality since.<\/p>\n<p>Common sense includes not only social abilities and reasoning but also a <a rel=\"nofollow noopener\" target=\"_blank\" href=\"https:\/\/theconversation.com\/an-ai-expert-explains-why-its-hard-to-give-computers-something-you-take-for-granted-common-sense-165600\">\u201cnaive sense of physics\u201d<\/a> \u2014\u00a0this means that we know certain things about physics without having to work through physics equations, like why you shouldn\u2019t put a bowling ball on a slanted surface. It also includes basic knowledge of abstract things like time and space, which lets us plan, estimate, and organize. \u201cIt\u2019s knowledge that you <em>ought<\/em> to have,\u201d <a rel=\"nofollow noopener\" target=\"_blank\" href=\"https:\/\/www.quantamagazine.org\/common-sense-comes-to-computers-20200430\/\">says<\/a> Michael Witbrock, AI researcher at the University of Auckland.<\/p>\n<p>All this means that common sense is not one precise thing, and therefore cannot be easily defined by rules.<\/p>\n<h2><span class=\"ez-toc-section\" id=\"Secret_AGENT\"><\/span><strong>Secret AGENT<\/strong><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p>We\u2019ve established that common sense requires a computer to infer things based on complex, real-world situations \u2014\u00a0something that comes easily to humans, and starts to form since infancy.<\/p>\n<p>Computer scientists are making (slow) but steady progress toward building AI agents that can infer mental states, predict future actions, and work with humans. But in order to see how close we actually are, we first need a rigorous benchmark for evaluating an AI\u2019s \u201ccommon sense,\u201d or its psychological reasoning ability.<\/p>\n<p>Researchers from\u00a0IBM, MIT, and Harvard have\u00a0created just that: AGENT, which stands for <strong>A<\/strong>ction-<strong>G<\/strong>oal-<strong>E<\/strong>fficiency-co<strong>N<\/strong>straint-u<strong>T<\/strong>ility. <a rel=\"nofollow noopener\" target=\"_blank\" href=\"https:\/\/research.ibm.com\/publications\/agent-a-benchmark-for-core-psychological-reasoning\">After testing and validation<\/a>, this benchmark is shown to be able to evaluate the core psychological reasoning ability of an AI model. This means it can actually give a sense of social awareness and could interact with humans in real-world settings.<\/p>\n<blockquote class=\"c-richText__pullQuote\">\n<div class=\"c-richText__pullQuoteGradient\">\n<p class=\"c-richText__pullQuoteQuote\">To demonstrate common sense, an AI model must have built-in representations of how humans plan.<\/p>\n<\/p><\/div>\n<\/blockquote>\n<p>So what is AGENT? AGENT is a large-scale dataset of 3D animations inspired by experiments that study cognitive development in kids. The animations depict someone interacting with different objects under different physical constraints. <a rel=\"nofollow noopener\" target=\"_blank\" href=\"https:\/\/research.ibm.com\/blog\/evaluating-common-sense-in-ai\">According to IBM<\/a>:<\/p>\n<p>\u201cThe videos comprise distinct trials, each of which includes one or more \u2018familiarization\u2019 videos of an agent\u2019s typical behavior in a certain physical environment, paired with \u2018test\u2019 videos of the same agent\u2019s behavior in a new environment, which are labeled as either \u2018expected\u2019 or \u2018surprising,\u2019 given the behavior of the agent in the corresponding familiarization videos.\u201d<\/p>\n<p>A model must then judge how surprising the agent\u2019s behaviors in the \u2018test\u2019 videos are, based on the actions it learned in the \u2018familiarization\u2019 videos. Using the AGENT benchmark, that model is then validated against large-scale human-rating trials, where humans rated the \u2018surprising\u2019 \u2018test\u2019 videos as more surprising than the \u2018expected\u2019 test videos.<\/p>\n<p><iframe loading=\"lazy\" title=\"Benchmarking an AI model's intuitive psychology ability - 3 Questions\" width=\"500\" height=\"281\" srcdoc=\"&lt;style&gt;*{padding:0;margin:0;overflow:hidden}html,body{background:#000;height:100%}img{position:absolute;top:0;left:0;width:100%;height:100%;object-fit:cover;transition:opacity .1s cubic-bezier(0.4,0,1,1)}a:hover img+img{opacity:1!important}&lt;\/style&gt;&lt;a href=\" https:=\"\" src=\"https:\/\/img.youtube.com\/vi\/brdrdrz4ve4\/hqdefault.jpg\" style=\"top: 50%;left:50%;width:68px;height:48px;transform:translate3d(-50%,-50%,0)\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture\" allowfullscreen=\"\"><\/iframe><\/p>\n<h2><span class=\"ez-toc-section\" id=\"Common_sense\"><\/span><strong>Common sense?<\/strong><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p>IBM\u2019s trial shows that to demonstrate common sense, an AI model must have built-in representations of how humans plan. This means combining both a basic sense of physics and \u2018cost-reward trade-offs\u2019, which means an understanding of how humans take actions \u201c<a rel=\"nofollow noopener\" target=\"_blank\" href=\"https:\/\/research.ibm.com\/blog\/evaluating-common-sense-in-ai\">based on utility<\/a>, trading off the rewards of its goal against the costs of reaching it.\u201d<\/p>\n<p>While not yet perfect, the findings show AGENT is a promising diagnostic tool for developing and evaluating common sense in AI, something IBM is also working on. It also shows that we can utilize similar traditional developmental psychology methods to those used to teach human children how objects and ideas relate.<\/p>\n<p>In the future, this could help significantly reduce the need for training in these models allowing businesses to save on computing energy, time, and money.<\/p>\n<p>Robots don\u2019t understand human consciousness yet \u2014\u00a0but with the development of benchmarking tools like AGENT, we\u2019ll be able to measure how close we\u2019re getting.\n                        <\/p><\/div>\n<blockquote><p><strong><span style=\"color: #ff6600;\">If you liked the article, do not forget to share it with your friends. Follow us on\u00a0<span style=\"color: #ff0000;\"><a style=\"color: #ff0000;\" href=\"https:\/\/news.google.com\/publications\/CAAqBwgKMLG0nwswvr63Aw\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">Google News<\/a><\/span>\u00a0too, click on the star and choose us from your favorites.<\/span><\/strong><\/p><\/blockquote>\n<blockquote>\n<p style=\"text-align: center;\">For forums sites go to <span style=\"color: #ff9900;\"><a style=\"color: #ff9900;\" href=\"https:\/\/forum.buradabiliyorum.com\/\" target=\"_blank\" rel=\"noopener\">Forum.BuradaBiliyorum.Com<\/a><\/span><\/strong><\/p>\n<\/blockquote>\n<blockquote>\n<p style=\"text-align: center;\"><strong>If you want to read more like this article, you can visit our <span style=\"color: #ff9900;\"><a style=\"color: #ff9900;\" href=\"https:\/\/en.buradabiliyorum.com\/technology\/\" target=\"_blank\" rel=\"noopener\">Technology category.<\/a><\/span><\/strong><\/p>\n<\/blockquote>\n<p><span style=\"color: black;\"><a style=\"color: #ff9900;\" href=\"https:\/\/thenextweb.com\/news\/common-sense-test-for-ai-smarter-machines\" target=\"_blank\" rel=\"noopener\">Source<\/a><\/span><\/p>\n","protected":false},"excerpt":{"rendered":"<p>&#8220;A new \u2018common sense\u2019 test for AI could lead to smarter machines&#8221; Content provided by IBM and TNW. Today\u2019s AI systems are quickly evolving to become humans\u2019 new best friend. We now have AIs that can concoct award-winning whiskey, write poetry, and help doctors perform extremely precise surgical operations. But one thing they can\u2019t do&#8230;<\/p>\n","protected":false},"author":1,"featured_media":496115,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"fifu_image_url":"https:\/\/img-cdn.tnwcdn.com\/image\/neural?filter_last=1&fit=1280,640&url=https:\/\/cdn0.tnwcdn.com\/wp-content\/blogs.dir\/1\/files\/2022\/09\/OL2-1.jpg&signature=6c729ac2330cc240f65fc262dad35684","fifu_image_alt":"","footnotes":""},"categories":[18],"tags":[],"class_list":["post-496114","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-technology"],"_links":{"self":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/posts\/496114","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/comments?post=496114"}],"version-history":[{"count":0,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/posts\/496114\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/media\/496115"}],"wp:attachment":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/media?parent=496114"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/categories?post=496114"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/tags?post=496114"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}