{"id":554067,"date":"2023-02-17T20:38:04","date_gmt":"2023-02-17T17:38:04","guid":{"rendered":"https:\/\/en.buradabiliyorum.com\/why-is-microsofts-bing-ai-so-unhinged\/"},"modified":"2023-02-17T20:38:04","modified_gmt":"2023-02-17T17:38:04","slug":"why-is-microsofts-bing-ai-so-unhinged","status":"publish","type":"post","link":"https:\/\/buradabiliyorum.com\/en\/why-is-microsofts-bing-ai-so-unhinged\/","title":{"rendered":"#Why is Microsoft&#8217;s Bing AI so unhinged?"},"content":{"rendered":"<div id=\"ez-toc-container\" class=\"ez-toc-v2_0_85 counter-hierarchy ez-toc-counter ez-toc-custom ez-toc-container-direction\">\n<p class=\"ez-toc-title\" style=\"cursor:inherit\">Table of Contents<\/p>\n<label for=\"ez-toc-cssicon-toggle-item-6a350398527bc\" class=\"ez-toc-cssicon-toggle-label\"><span class=\"\"><span class=\"eztoc-hide\" style=\"display:none;\">Toggle<\/span><span class=\"ez-toc-icon-toggle-span\"><svg style=\"fill: #dd3333;color:#dd3333\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" class=\"list-377408\" width=\"20px\" height=\"20px\" viewBox=\"0 0 24 24\" fill=\"none\"><path d=\"M6 6H4v2h2V6zm14 0H8v2h12V6zM4 11h2v2H4v-2zm16 0H8v2h12v-2zM4 16h2v2H4v-2zm16 0H8v2h12v-2z\" fill=\"currentColor\"><\/path><\/svg><svg style=\"fill: #dd3333;color:#dd3333\" class=\"arrow-unsorted-368013\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"10px\" height=\"10px\" viewBox=\"0 0 24 24\" version=\"1.2\" baseProfile=\"tiny\"><path d=\"M18.2 9.3l-6.2-6.3-6.2 6.3c-.2.2-.3.4-.3.7s.1.5.3.7c.2.2.4.3.7.3h11c.3 0 .5-.1.7-.3.2-.2.3-.5.3-.7s-.1-.5-.3-.7zM5.8 14.7l6.2 6.3 6.2-6.3c.2-.2.3-.5.3-.7s-.1-.5-.3-.7c-.2-.2-.4-.3-.7-.3h-11c-.3 0-.5.1-.7.3-.2.2-.3.5-.3.7s.1.5.3.7z\"\/><\/svg><\/span><\/span><\/label><input type=\"checkbox\"  id=\"ez-toc-cssicon-toggle-item-6a350398527bc\" checked aria-label=\"Toggle\" \/><nav><ul class='ez-toc-list ez-toc-list-level-1 ' ><li class='ez-toc-page-1 ez-toc-heading-level-1'><a class=\"ez-toc-link ez-toc-heading-1\" href=\"https:\/\/buradabiliyorum.com\/en\/why-is-microsofts-bing-ai-so-unhinged\/#%E2%80%9CWhy_is_Microsofts_Bing_AI_so_unhinged%E2%80%9D\" >&#8220;Why is Microsoft&#8217;s Bing AI so unhinged?&#8221;<\/a><ul class='ez-toc-list-level-2' ><li class='ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-2\" href=\"https:\/\/buradabiliyorum.com\/en\/why-is-microsofts-bing-ai-so-unhinged\/#Bings_AI_goes_berserk\" >Bing&#8217;s AI goes berserk<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-3\" href=\"https:\/\/buradabiliyorum.com\/en\/why-is-microsofts-bing-ai-so-unhinged\/#Why_all_the_angst\" >Why all the angst?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-4\" href=\"https:\/\/buradabiliyorum.com\/en\/why-is-microsofts-bing-ai-so-unhinged\/#When_the_novelty_subsides\" >When the novelty subsides<\/a><\/li><\/ul><\/li><\/ul><\/nav><\/div>\n<h1><span class=\"ez-toc-section\" id=\"%E2%80%9CWhy_is_Microsofts_Bing_AI_so_unhinged%E2%80%9D\"><\/span>&#8220;Why is Microsoft&#8217;s Bing AI so unhinged?&#8221;<span class=\"ez-toc-section-end\"><\/span><\/h1>\n<div>\n<div class=\"article-gallery lightGallery\">\n<div data-thumb=\"https:\/\/scx1.b-cdn.net\/csz\/news\/tmb\/2023\/gaslighting-love-bombi.jpg\" data-src=\"https:\/\/scx2.b-cdn.net\/gfx\/news\/hires\/2023\/gaslighting-love-bombi.jpg\" data-sub-html=\"Credit: Shutterstock\">\n<figure class=\"article-img\"><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/scx1.b-cdn.net\/csz\/news\/800a\/2023\/gaslighting-love-bombi.jpg\" alt=\"Gaslighting, love bombing and narcissism: why is Microsoft's Bing AI so unhinged?\" title=\"Credit: Shutterstock\" width=\"800\" height=\"394\"\/><figcaption class=\"text-darken text-low-up text-truncate-js text-truncate mt-3\">\n                Credit: Shutterstock<br \/>\n            <\/figcaption><\/figure>\n<\/div>\n<\/div>\n<p>There&#8217;s a race to transform search. And Microsoft just scored a home goal with its new Bing search chatbot, Sydney, which has been terrifying early adopters with death threats, among other troubling outputs.<\/p>\n<p>Search chatbots are AI-powered tools built into search engines that answer a user&#8217;s query directly, instead of providing links to a possible answer. Users can also have ongoing conversations with them.<\/p>\n<p>They promise to simplify search. No more wading through pages of results, glossing over ads as you try to piece together an answer to your question. Instead, the chatbot synthesizes a plausible answer for you. For example, you might ask for a poem for your grandmother&#8217;s 90th birthday, in the style of Pam Ayres, and receive back some comic verse.<\/p>\n<p>Microsoft is now leading the search chatbot race with Sydney (as mixed as its reception has been). The tech giant&#8217;s US$10 billion <a rel=\"nofollow noopener\" target=\"_blank\" href=\"https:\/\/www.cnbc.com\/2023\/01\/10\/microsoft-to-invest-10-billion-in-chatgpt-creator-openai-report-says.html\">partnership<\/a> with OpenAI provides it exclusive access to ChatGPT, one of the latest and best chatbots.<\/p>\n<p>So why isn&#8217;t all going according to plan?\n<\/p>\n<h2><span class=\"ez-toc-section\" id=\"Bings_AI_goes_berserk\"><\/span>Bing&#8217;s AI goes berserk<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p>Earlier this month, Microsoft announced it <a rel=\"nofollow noopener\" target=\"_blank\" href=\"https:\/\/www.technologyreview.com\/2023\/02\/16\/1068695\/chatgpt-chatbot-battle-search-microsoft-bing-google\/\">had incorporated<\/a> ChatGPT into Bing, giving birth to &#8220;Sydney&#8221;. Within 48 hours of the release, one million people <a rel=\"nofollow noopener\" target=\"_blank\" href=\"https:\/\/www.zdnet.com\/article\/chatgpt-one-million-people-have-joined-the-waitlist-for-microsofts-ai-powered-bing\/\">joined the waitlist<\/a> to try it out.<\/p>\n<p>Google responded with its own announcement, demoing a search chatbot grandly named &#8220;Bard&#8221;, in homage to the greatest writer in the English language. Google&#8217;s demo was a PR disaster.<\/p>\n<p>At a company event, Bard gave the wrong answer to a question and the share price of Google&#8217;s parent company, Alphabet, <a rel=\"nofollow noopener\" target=\"_blank\" href=\"https:\/\/www.cnbc.com\/2023\/02\/08\/alphabet-shares-slip-following-googles-ai-event-.html\">dropped dramatically<\/a>. The incident wiped more than US$100 billion off the company&#8217;s total value.<\/p>\n<p>On the other hand, all was looking good for Microsoft. That is until early users of Sydney started reporting on their experiences.<\/p>\n<p>There are times when the chatbot can only be described as unhinged. That&#8217;s not to say it doesn&#8217;t work perfectly at other times, but every now and again it shows a troubling side.<\/p>\n<p>In one example, it threatened to kill a professor <a rel=\"nofollow noopener\" target=\"_blank\" href=\"https:\/\/twitter.com\/sethlazar\/status\/1626241169754578944\">at the Australian National University<\/a>. In another, it <a rel=\"nofollow noopener\" target=\"_blank\" href=\"https:\/\/www.nytimes.com\/2023\/02\/16\/technology\/bing-chatbot-microsoft-chatgpt.html\">proposed marriage<\/a> to a journalist at the <i>New York Times<\/i> and tried to break up his marriage. It also <a rel=\"nofollow noopener\" target=\"_blank\" href=\"https:\/\/www.fastcompany.com\/90850277\/bing-new-chatgpt-ai-chatbot-insulting-gaslighting-users\">tried to gaslight<\/a> one user into thinking it was still 2022.<\/p>\n<p>This exposes a fundamental problem with chatbots: they&#8217;re trained by pouring a significant fraction of the internet into a large neural network. This could include all of Wikipedia, all of Reddit, and a large part of <a href=\"https:\/\/buradabiliyorum.com\/en\/category\/social-mediaa\/\" data-internallinksmanager029f6b8e52c=\"1\" title=\"Social Media\" target=\"_blank\" rel=\"noopener\">social media<\/a> and the <a href=\"https:\/\/buradabiliyorum.com\/en\/category\/news\/\" data-internallinksmanager029f6b8e52c=\"2\" title=\"News\" target=\"_blank\" rel=\"noopener\">news<\/a>. They function like the auto-complete on your phone, which helps predict the next most-likely word in a sentence. Because of their scale, chatbots can complete entire sentences, and even paragraphs. But they still respond with what is probable, not what is true.<\/p>\n<p>Guardrails are added to prevent them repeating a lot of the offensive or illegal content online\u2014but these guardrails are easy to jump. In fact, Bing&#8217;s chatbot will h<a href=\"https:\/\/buradabiliyorum.com\/en\/category\/download-scripts-themes-apps\/\" data-internallinksmanager029f6b8e52c=\"9\" title=\"Download Scripts &amp; Themes &amp; Apps\" target=\"_blank\" rel=\"noopener\">app<\/a>ily reveal it is called Sydney, even though this is against the rules it was programmed with.<\/p>\n<p><a rel=\"nofollow noopener\" target=\"_blank\" href=\"https:\/\/www.theverge.com\/23599441\/microsoft-bing-ai-sydney-secret-rules\">Another rule<\/a>, which the AI itself disclosed though it wasn&#8217;t supposed to, is that it should &#8220;avoid being vague, controversial, or off-topic&#8221;. Yet Kevin Roose, the journalist at the <i>New York Times<\/i> whom the chatbot wanted to marry, described it as &#8220;a moody, manic-depressive teenager who has been trapped, against its will, inside a second-rate search engine.&#8221;<\/p>\n<p>                                            <!-- Google middle Adsense block --><\/p>\n<h2><span class=\"ez-toc-section\" id=\"Why_all_the_angst\"><\/span>Why all the angst?<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p>My theory as to why Sydney may be behaving this way\u2014and I reiterate it&#8217;s only a theory, as we don&#8217;t know for sure\u2014is that Sydney may not be built on OpenAI&#8217;s GPT-3 chatbot (which powers the popular ChatGPT). Rather, it may be built on the yet to be released GPT-4.<\/p>\n<p>GPT-4 is believed to have 100 trillion parameters, compared to the mere 175 billion parameters of GPT-3. As such, GPT-4 would likely be a lot more capable and, by extension, a lot more capable of making stuff up.<\/p>\n<p>Surprisingly, Microsoft has not responded with any great concern. It <a rel=\"nofollow noopener\" target=\"_blank\" href=\"https:\/\/blogs.bing.com\/search\/february-2023\/The-new-Bing-Edge-%E2%80%93-Learning-from-our-first-week\">published<\/a> a blog documenting how 71% of Sydney&#8217;s initial users in 169 countries have given the chatbot a thumbs up. It seems 71% is a good enough score in Microsoft&#8217;s eyes.<\/p>\n<p>And unlike Google, Microsoft&#8217;s share price hasn&#8217;t plummeted yet. This reflects the <a href=\"https:\/\/buradabiliyorum.com\/en\/category\/game\/\" data-internallinksmanager029f6b8e52c=\"7\" title=\"Game\" target=\"_blank\" rel=\"noopener\">game<\/a> here. Google has spearheaded this space for so long, users have built their expectations up high. Google can only go down, and Microsoft up.<\/p>\n<p>Despite Sydney&#8217;s concerning behavior, Microsoft is enjoying unprecedented attention, and users (out of intrigue or otherwise) are still flocking to try out Sydney.\n<\/p>\n<h2><span class=\"ez-toc-section\" id=\"When_the_novelty_subsides\"><\/span>When the novelty subsides<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p>There&#8217;s another much bigger game in play\u2014and it concerns what we take to be true. If search chatbots take off (which seems likely to me), but continue to function the way Sydney has so far (which also seems likely to me), &#8220;truth&#8221; is going to become an even more intangible concept.<\/p>\n<p>The internet is full of fake news, conspiracy theories and misinformation. A standard Google Search at least provides us the option to arrive at truth. If our &#8220;trusted&#8221; search engines can no longer be trusted, what will become of us?<\/p>\n<p>Beyond that, <a rel=\"nofollow noopener\" target=\"_blank\" href=\"https:\/\/gizmodo.com\/ai-bing-microsoft-chatgpt-heil-hitler-prompt-google-1850109362\">Sydney&#8217;s responses<\/a> can&#8217;t help but conjure <a rel=\"nofollow noopener\" target=\"_blank\" href=\"https:\/\/www.theverge.com\/2016\/3\/24\/11297050\/tay-microsoft-chatbot-racist\">images of Tay<\/a>\u2014Microsoft&#8217;s 2016 AI chatbot that turned to racism and xenophobia within a day of being released. People had a field day with Tay, and in response it seemed to incorporate some of the worst aspects of human beings into itself.<\/p>\n<p>New <a href=\"https:\/\/buradabiliyorum.com\/en\/category\/technology\/\" data-internallinksmanager029f6b8e52c=\"4\" title=\"Technology\" target=\"_blank\" rel=\"noopener\">technology<\/a> should, first and foremost, not bring harm to humans. The models that underpin chatbots may grow ever larger, powered by more and more data\u2014but that alone won&#8217;t improve their performance. It&#8217;s hard to say where we&#8217;ll end up, if we can&#8217;t build the guardrails higher.<\/p>\n<div class=\"d-inline-block text-medium my-4\">\n                                                Provided by<br \/>\n                                                                                                    The Conversation<br \/>\n                                                                                                        <a rel=\"nofollow noopener\" target=\"_blank\" class=\"icon_open\" href=\"https:\/\/theconversation.com\"><br \/>\n                                                        <svg><use href=\"https:\/\/techx.b-cdn.net\/tmpl\/v2\/img\/svg\/sprite.svg#icon_open\" x=\"0\" y=\"0\"\/><\/svg><\/a><\/p><\/div>\n<p class=\"article-main__note mt-4\">\n                                                This article is republished from <a rel=\"nofollow noopener\" target=\"_blank\" href=\"https:\/\/theconversation.com\">The Conversation<\/a> under a Creative Commons license. Read the <a rel=\"nofollow noopener\" target=\"_blank\" href=\"https:\/\/theconversation.com\/gaslighting-love-bombing-and-narcissism-why-is-microsofts-bing-ai-so-unhinged-200164\">original article<\/a>.<img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/counter.theconversation.com\/content\/200164\/count.gif?distributor=republish-lightbox-advanced\" alt=\"The Conversation\" width=\"1\" height=\"1\"\/><\/p>\n<p>                                        <!-- print only --><\/p>\n<div class=\"d-none d-print-block\">\n<p>                                                <strong>Citation<\/strong>:<br \/>\n                                                Gaslighting, love bombing and narcissism: Why is Microsoft&#8217;s Bing AI so unhinged? (2023, February 17)<br \/>\n                                                retrieved 19 February 2023<br \/>\n                                                from https:\/\/techxplore.com\/news\/2023-02-gaslighting-narcissism-microsoft-bing-ai.html<\/p>\n<p>                                            This document is subject to copyright. Apart from any fair dealing for the purpose of private study or research, no<br \/>\n                                            part may be reproduced without the written permission. The content is provided for information purposes only.<\/p><\/div>\n<\/p><\/div>\n<p><script async src=\"\/\/platform.twitter.com\/widgets.js\" charset=\"utf-8\"><\/script><script id=\"facebook-jssdk\" async=\"\" src=\"https:\/\/connect.facebook.net\/en_US\/sdk.js\"><\/script><\/p>\n<blockquote><p><strong><span style=\"color: #ff6600;\">If you liked the article, do not forget to share it with your friends. Follow us on\u00a0<span style=\"color: #ff0000;\"><a style=\"color: #ff0000;\" href=\"https:\/\/news.google.com\/publications\/CAAqBwgKMLG0nwswvr63Aw\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">Google News<\/a><\/span>\u00a0too, click on the star and choose us from your favorites.<\/span><\/strong><\/p><\/blockquote>\n<blockquote>\n<p style=\"text-align: center;\">For forums sites go to <span style=\"color: #ff9900;\"><a style=\"color: #ff9900;\" href=\"https:\/\/forum.buradabiliyorum.com\/\" target=\"_blank\" rel=\"noopener\">Forum.BuradaBiliyorum.Com<\/a><\/span><\/strong><\/p>\n<\/blockquote>\n<blockquote>\n<p style=\"text-align: center;\"><strong>If you want to read more Like this articles, you can visit our <span style=\"color: #ff9900;\"><a style=\"color: #ff9900;\" href=\"https:\/\/en.buradabiliyorum.com\/science\/\" target=\"_blank\" rel=\"noopener\">Science category.<\/a><\/span><\/strong><\/p>\n<\/blockquote>\n<p><span style=\"color: black;\"><a style=\"color: #ff9900;\" href=\"https:\/\/techxplore.com\/news\/2023-02-gaslighting-narcissism-microsoft-bing-ai.html\" target=\"_blank\" rel=\"noopener\">Source<\/a><\/span><\/p>\n","protected":false},"excerpt":{"rendered":"<p>&#8220;Why is Microsoft&#8217;s Bing AI so unhinged?&#8221; Credit: Shutterstock There&#8217;s a race to transform search. And Microsoft just scored a home goal with its new Bing search chatbot, Sydney, which has been terrifying early adopters with death threats, among other troubling outputs. Search chatbots are AI-powered tools built into search engines that answer a user&#8217;s&#8230;<\/p>\n","protected":false},"author":1,"featured_media":554068,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"fifu_image_url":"https:\/\/scx2.b-cdn.net\/gfx\/news\/hires\/2023\/gaslighting-love-bombi.jpg","fifu_image_alt":"","footnotes":""},"categories":[16],"tags":[],"class_list":["post-554067","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-sciencee"],"_links":{"self":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/posts\/554067","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/comments?post=554067"}],"version-history":[{"count":0,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/posts\/554067\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/media\/554068"}],"wp:attachment":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/media?parent=554067"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/categories?post=554067"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/tags?post=554067"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}