{"id":280150,"date":"2021-06-21T22:30:22","date_gmt":"2021-06-21T19:30:22","guid":{"rendered":"https:\/\/en.buradabiliyorum.com\/no-the-gpt3-ai-did-not-create-a-brand-new-video-game\/"},"modified":"2021-06-21T22:30:22","modified_gmt":"2021-06-21T19:30:22","slug":"no-the-gpt3-ai-did-not-create-a-brand-new-video-game","status":"publish","type":"post","link":"https:\/\/buradabiliyorum.com\/en\/no-the-gpt3-ai-did-not-create-a-brand-new-video-game\/","title":{"rendered":"#No the GPT3 AI did not create a brand new video game"},"content":{"rendered":"<div id=\"ez-toc-container\" class=\"ez-toc-v2_0_85 counter-hierarchy ez-toc-counter ez-toc-custom ez-toc-container-direction\">\n<p class=\"ez-toc-title\" style=\"cursor:inherit\">Table of Contents<\/p>\n<label for=\"ez-toc-cssicon-toggle-item-6a3be3c479b33\" class=\"ez-toc-cssicon-toggle-label\"><span class=\"\"><span class=\"eztoc-hide\" style=\"display:none;\">Toggle<\/span><span class=\"ez-toc-icon-toggle-span\"><svg style=\"fill: #dd3333;color:#dd3333\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" class=\"list-377408\" width=\"20px\" height=\"20px\" viewBox=\"0 0 24 24\" fill=\"none\"><path d=\"M6 6H4v2h2V6zm14 0H8v2h12V6zM4 11h2v2H4v-2zm16 0H8v2h12v-2zM4 16h2v2H4v-2zm16 0H8v2h12v-2z\" fill=\"currentColor\"><\/path><\/svg><svg style=\"fill: #dd3333;color:#dd3333\" class=\"arrow-unsorted-368013\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"10px\" height=\"10px\" viewBox=\"0 0 24 24\" version=\"1.2\" baseProfile=\"tiny\"><path d=\"M18.2 9.3l-6.2-6.3-6.2 6.3c-.2.2-.3.4-.3.7s.1.5.3.7c.2.2.4.3.7.3h11c.3 0 .5-.1.7-.3.2-.2.3-.5.3-.7s-.1-.5-.3-.7zM5.8 14.7l6.2 6.3 6.2-6.3c.2-.2.3-.5.3-.7s-.1-.5-.3-.7c-.2-.2-.4-.3-.7-.3h-11c-.3 0-.5.1-.7.3-.2.2-.3.5-.3.7s.1.5.3.7z\"\/><\/svg><\/span><\/span><\/label><input type=\"checkbox\"  id=\"ez-toc-cssicon-toggle-item-6a3be3c479b33\" checked aria-label=\"Toggle\" \/><nav><ul class='ez-toc-list ez-toc-list-level-1 ' ><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-1\" href=\"https:\/\/buradabiliyorum.com\/en\/no-the-gpt3-ai-did-not-create-a-brand-new-video-game\/#Background\" >Background<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-2\" href=\"https:\/\/buradabiliyorum.com\/en\/no-the-gpt3-ai-did-not-create-a-brand-new-video-game\/#Whats_this_about_a_video_game\" >What\u2019s this about a video game?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-3\" href=\"https:\/\/buradabiliyorum.com\/en\/no-the-gpt3-ai-did-not-create-a-brand-new-video-game\/#I_call_bullshit\" >I call bullshit<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-4\" href=\"https:\/\/buradabiliyorum.com\/en\/no-the-gpt3-ai-did-not-create-a-brand-new-video-game\/#The_real_problem\" >The real problem<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-5\" href=\"https:\/\/buradabiliyorum.com\/en\/no-the-gpt3-ai-did-not-create-a-brand-new-video-game\/#The_reality_of_the_situation\" >The reality of the situation<\/a><\/li><\/ul><\/nav><\/div>\n<p>&#8220;<strong>#No the GPT3 AI did not create a brand new video <a href=\"https:\/\/buradabiliyorum.com\/en\/category\/game\/\" data-internallinksmanager029f6b8e52c=\"7\" title=\"Game\" target=\"_blank\" rel=\"noopener\">game<\/a><\/strong>&#8221;<\/p>\n<div>GPT-3 is arguably the world\u2019s most advanced text-generator. It was trained using supercomputing clusters, a nearly internet-sized dataset, and 175 billion parameters. It\u2019s among the most impressive generative AI systems ever created.<\/p>\n<p>But it absolutely did not create a video game.<\/p>\n<p>You may have read otherwise. But it\u2019s what you didn\u2019t read that matters.<\/p>\n<h2><span class=\"ez-toc-section\" id=\"Background\"><\/span>Background<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p>GPT-3, for those who aren\u2019t in the know, is a big powerful AI system that generates text from prompts.<\/p>\n<p>At the risk of oversimplifying, you give GPT-3 a short input and ask it to generate text. So, for example, you might say \u201cWhat\u2019s the best thing about Paris?\u201d and GPT-3 might generate text saying \u201cParis is known for its majestic views and vibrant night life,\u201d and it\u2019ll keep spitting out new statements every time you ask it to generate.<\/p>\n<p>GPT-3 is pretty good at generating text that makes sense. So, if you were to keep generating new phrases based on the \u201cWhat\u2019s the best thing about Paris?\u201d input, it\u2019s likely you\u2019ll get a bunch of different outputs that mostly made grammatical sense.<\/p>\n<p>However, GPT-3 isn\u2019t actually checking its facts or Googling things. It doesn\u2019t have a database of verified information that it accesses before generating and injecting its opinion into things. It just tries to <i>imitate<\/i><span> the text its been trained on. <\/span><\/p>\n<p><span>Without filtering, GPT-3 is as likely to say something xenophobic about Parisians and\/or the French people as it is something positive. And, most importantly, it\u2019s just as likely to say something factually incorrect.<\/span><\/p>\n<p><span>GPT-3 does not think. It does not understand <\/span><i>anything<\/i><span>. It doesn\u2019t know what a dog is, it can\u2019t understand the color blue, and it has no mental capacity for continuity or sense. It\u2019s just algorithms and computer tricks. <\/span><\/p>\n<p><span>If you can imagine 175 billion monkeys banging on 175 billion typewriters you can imagine GPT-3 at work. Except, in GPT-3\u2018s case, instead of letters, the keys all have sentences and phrases on them. And for every monkey there\u2019s a human standing there changing out text templates to fit specific <a href=\"https:\/\/buradabiliyorum.com\/en\/category\/download-scripts-themes-apps\/\" data-internallinksmanager029f6b8e52c=\"9\" title=\"Download Scripts &amp; Themes &amp; Apps\" target=\"_blank\" rel=\"noopener\">theme<\/a>s. <\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"Whats_this_about_a_video_game\"><\/span><span>What\u2019s this about a video game?<\/span><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span>A gambling website called, aptly, \u201c<a rel=\"nofollow noopener\" target=\"_blank\" href=\"https:\/\/www.onlineroulette.org\/\">Online Roulette<\/a>\u201d started sending PR emails out a couple weeks ago claiming that GPT-3 had created a video game.<\/span><\/p>\n<figure class=\"post-image post-mediaBleed aligncenter\"><img loading=\"lazy\" decoding=\"async\" class=\"size-full wp-image-1357598 aligncenter js-lazy\" alt=\"\" width=\"1640\" height=\"349\" sizes=\"auto, (max-width: 1640px) 100vw, 1640px\" src=\"https:\/\/cdn0.tnwcdn.com\/wp-content\/blogs.dir\/1\/files\/2021\/06\/candyslaughterAI.jpg\" srcset=\"https:\/\/cdn0.tnwcdn.com\/wp-content\/blogs.dir\/1\/files\/2021\/06\/candyslaughterAI.jpg 1640w, https:\/\/cdn0.tnwcdn.com\/wp-content\/blogs.dir\/1\/files\/2021\/06\/candyslaughterAI-280x60.jpg 280w, https:\/\/cdn0.tnwcdn.com\/wp-content\/blogs.dir\/1\/files\/2021\/06\/candyslaughterAI-540x115.jpg 540w, https:\/\/cdn0.tnwcdn.com\/wp-content\/blogs.dir\/1\/files\/2021\/06\/candyslaughterAI-270x57.jpg 270w, https:\/\/cdn0.tnwcdn.com\/wp-content\/blogs.dir\/1\/files\/2021\/06\/candyslaughterAI-796x169.jpg 796w, https:\/\/cdn0.tnwcdn.com\/wp-content\/blogs.dir\/1\/files\/2021\/06\/candyslaughterAI-1592x339.jpg 1592w\"\/><noscript><img loading=\"lazy\" decoding=\"async\" class=\"size-full wp-image-1357598 aligncenter\" src=\"https:\/\/cdn0.tnwcdn.com\/wp-content\/blogs.dir\/1\/files\/2021\/06\/candyslaughterAI.jpg\" alt=\"\" width=\"1640\" height=\"349\" srcset=\"https:\/\/cdn0.tnwcdn.com\/wp-content\/blogs.dir\/1\/files\/2021\/06\/candyslaughterAI.jpg 1640w, https:\/\/cdn0.tnwcdn.com\/wp-content\/blogs.dir\/1\/files\/2021\/06\/candyslaughterAI-280x60.jpg 280w, https:\/\/cdn0.tnwcdn.com\/wp-content\/blogs.dir\/1\/files\/2021\/06\/candyslaughterAI-540x115.jpg 540w, https:\/\/cdn0.tnwcdn.com\/wp-content\/blogs.dir\/1\/files\/2021\/06\/candyslaughterAI-270x57.jpg 270w, https:\/\/cdn0.tnwcdn.com\/wp-content\/blogs.dir\/1\/files\/2021\/06\/candyslaughterAI-796x169.jpg 796w, https:\/\/cdn0.tnwcdn.com\/wp-content\/blogs.dir\/1\/files\/2021\/06\/candyslaughterAI-1592x339.jpg 1592w\"\/><\/noscript><\/figure>\n<p><span>Here\u2019s the thing: This wasn\u2019t a pitch for a game or even an AI-related pitch. It was a pitch for a survey about how gamers responded to a PR pitch for a game that doesn\u2019t exist that referenced text that was generated by GPT-3.<\/span><\/p>\n<p><span>So here\u2019s a few things to keep clear:<\/span><\/p>\n<ol>\n<li><span>The game doesn\u2019t actually exist<\/span><\/li>\n<li><span>All the imagery associated with the game was created by humans<\/span><\/li>\n<li><span>All of the text in the PR pitch was formatted and edited by humans<\/span><\/li>\n<\/ol>\n<h2><span class=\"ez-toc-section\" id=\"I_call_bullshit\"><\/span><span>I call bullshit<\/span><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p>This isn\u2019t to say GPT-3 can\u2019t be involved in the development of a video game. <a rel=\"nofollow noopener\" target=\"_blank\" href=\"https:\/\/play.aidungeon.io\/main\/landing\">AI Dungeon<\/a>\u00a0is a game that uses text-generating AI to create novel text-based game experiences. As anyone who\u2019s played it can attest, it\u2019s often cogent in a surreal way. But it\u2019s just as often weird and nonsensical.<\/p>\n<p>However, this marketing pitch from Online Roulette has nothing to do with the creation of an actual game.<\/p>\n<p><span>Let\u2019s start with the survey and work our way back. Here\u2019s the \u201cmethodology\u201d section <a rel=\"nofollow noopener\" target=\"_blank\" href=\"https:\/\/www.onlineroulette.org\/features\/ai-develops-a-video-game\">on the website<\/a> the original pitch refers to: <\/span><\/p>\n<blockquote>\n<p><span>We collected results from 1,000 avid gamers. The survey was designed with the intent of having them rate the storylines and characters presented to them. Respondents were not informed that the video game, storylines, and characters were AI-generated. Video game storylines and characters were generated using GPT-3, a text-generating program from OpenAI.<\/span><\/p>\n<\/blockquote>\n<p><span>Who were these \u201cavid\u201d gamers? Were they Mechanical Turk workers? Were they Online Roulette customers? Were they <a href=\"https:\/\/buradabiliyorum.com\/en\/category\/social-mediaa\/\" data-internallinksmanager029f6b8e52c=\"1\" title=\"Social Media\" target=\"_blank\" rel=\"noopener\">Twitter<\/a> respondents? We don\u2019t know.<\/span><\/p>\n<p><span>What exact images and text were the respondents exposed to? Because if they were exposed to <a rel=\"nofollow noopener\" target=\"_blank\" href=\"https:\/\/www.onlineroulette.org\/features\/ai-develops-a-video-game\">this website<\/a>, the one the above images came from, they weren\u2019t exposed to the game GPT-3 supposedly spit out. <\/span><\/p>\n<p><span>The entire website <\/span><i>describes<\/i><span> a game GPT-3 allegedly generated, but <em>nowhere<\/em> is GPT-3 quoted or is it made explicit that any of the text on the site is directly attributable to GPT-3.<\/span><\/p>\n<p><em>Exactly what did GPT-3 generate? <\/em><\/p>\n<p><span>Why weren\u2019t the survey respondents told they were evaluating a game allegedly generated by an AI? <\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"The_real_problem\"><\/span><span>The real problem<\/span><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span>For the sake of argument, let\u2019s say the images and text on the Online Roulette website were actually spit out by GPT-3 in the form we see them. They weren\u2019t. But let\u2019s just say they were. <\/span><\/p>\n<p><em>It would be useless information. <\/em><\/p>\n<p><span>It\u2019s insulting that anyone would think game development and design is such a whimsical field that a machine could randomly spit out ideas that could challenge human talent.<\/span><\/p>\n<p><span>Game developers spend lifetimes learning the industry and its fans. It takes years to gain a perspective on the $90 billion video game market. And even if you have an <em>amazing<\/em> idea, that doesn\u2019t mean it\u2019ll translate into a compelling game. <\/span><\/p>\n<p><span>Nobody is sitting around waiting for a random video game pitch-generator to spark their development careers.<\/span><\/p>\n<p><span> If coming up with a good idea was the hard part, there\u2019d be more game developers than there are players. That\u2019s like saying GPT-3 is a threat to Metallica because it can write random lyrics about things that are dark.\u00a0<\/span><\/p>\n<p><span>But it\u2019s even more insulting that, according to <a rel=\"nofollow noopener\" target=\"_blank\" href=\"https:\/\/venturebeat.com\/2021\/06\/20\/candy-shop-slaughter-is-a-video-game-concept-creatd-by-ai\/\">this article<\/a>, at least one person involved with generating the data actually expects us to believe the results from GPT-3 <\/span><i>weren\u2019t<\/i><span> cherry-picked. But that\u2019s a ludicrous claim.\u00a0<\/span><\/p>\n<blockquote class=\"twitter-tweet\" data-width=\"500\" data-dnt=\"true\">\n<p lang=\"en\" dir=\"ltr\">no. GPT-3 fundamentally does not understand the world that it talks about. Increasing corpus further will allow it to generate a more credible pastiche but not fix its fundamental lack of comprehension of the world.  Demos of GPT-4 will still require human cherry picking. <a rel=\"nofollow noopener\" target=\"_blank\" href=\"https:\/\/t.co\/6vl3ettSZk\">https:\/\/t.co\/6vl3ettSZk<\/a><\/p>\n<p>\u2014 Gary Marcus (@GaryMarcus) <a rel=\"nofollow noopener\" target=\"_blank\" href=\"https:\/\/twitter.com\/GaryMarcus\/status\/1289976322857426944?ref_src=twsrc%5Etfw\">August 2, 2020<\/a><\/p>\n<\/blockquote>\n<h2><span class=\"ez-toc-section\" id=\"The_reality_of_the_situation\"><\/span><span>The reality of the situation<\/span><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span>We don\u2019t know who was surveyed and we don\u2019t know what the respondents actually saw. We also don\u2019t know what parts of the game\u2019s marketing pitch GPT-3 actually generated.<\/span><\/p>\n<p><span>For all we know, the \u201cresearchers\u201d generated results until they found something they liked and then started using prompts specific to <em>that result<\/em> to generate dozens or hundreds of options from which they then curated, arranged, and edited to go along with the images their human artists created.\u00a0<\/span><\/p>\n<p><span>Basically, Online Roulette is asking you to believe that a sketchy marketing pitch with zero details, about a survey referencing a game that doesn\u2019t exist, highlights an example of working artificial intelligence.<\/span><\/p>\n<p><span>The only thing impressive about \u201cCandy Shop Slaughter\u201d is that we\u2019re talking about it.<\/span><\/p>\n<\/div>\n<p><script async src=\"\/\/platform.twitter.com\/widgets.js\" charset=\"utf-8\"><\/script><\/p>\n<blockquote><p><strong><span style=\"color: #ff6600;\">If you liked the article, do not forget to share it with your friends. Follow us on\u00a0<span style=\"color: #ff0000;\"><a style=\"color: #ff0000;\" href=\"https:\/\/news.google.com\/publications\/CAAqBwgKMLG0nwswvr63Aw\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">Google News<\/a><\/span>\u00a0too, click on the star and choose us from your favorites.<\/span><\/strong><\/p><\/blockquote>\n<blockquote>\n<p style=\"text-align: center;\">For forums sites go to <span style=\"color: #ff9900;\"><a style=\"color: #ff9900;\" href=\"https:\/\/forum.buradabiliyorum.com\/\" target=\"_blank\" rel=\"noopener\">Forum.BuradaBiliyorum.Com<\/a><\/span><\/strong>\n<\/p><\/blockquote>\n<blockquote>\n<p style=\"text-align: center;\"><strong>If you want to read more like this article, you can visit our <span style=\"color: #ff9900;\"><a style=\"color: #ff9900;\" href=\"https:\/\/en.buradabiliyorum.com\/technology\/\" target=\"_blank\" rel=\"noopener\">Technology category.<\/a><\/span><\/strong><\/p>\n<\/blockquote>\n<p><span style=\"color: black;\"><a style=\"color: #ff9900;\" href=\"https:\/\/thenextweb.com\/news\/artificial-intelligence-no-gpt-3-did-not-create-a-video-game\" target=\"_blank\" rel=\"noopener\">Source<\/a><\/span><\/p>\n","protected":false},"excerpt":{"rendered":"<p>&#8220;#No the GPT3 AI did not create a brand new video game&#8221; GPT-3 is arguably the world\u2019s most advanced text-generator. It was trained using supercomputing clusters, a nearly internet-sized dataset, and 175 billion parameters. It\u2019s among the most impressive generative AI systems ever created. But it absolutely did not create a video game. You may&#8230;<\/p>\n","protected":false},"author":1,"featured_media":280151,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"fifu_image_url":"https:\/\/img-cdn.tnwcdn.com\/image\/neural?filter_last=1&fit=1280,640&url=https:\/\/cdn0.tnwcdn.com\/wp-content\/blogs.dir\/1\/files\/2021\/06\/robinno.jpg&signature=5381404f939a56ffd0101e2235d30974","fifu_image_alt":"","footnotes":""},"categories":[18],"tags":[],"class_list":["post-280150","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-technology"],"_links":{"self":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/posts\/280150","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/comments?post=280150"}],"version-history":[{"count":0,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/posts\/280150\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/media\/280151"}],"wp:attachment":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/media?parent=280150"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/categories?post=280150"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/tags?post=280150"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}