{"id":589702,"date":"2023-09-03T20:00:00","date_gmt":"2023-09-03T17:00:00","guid":{"rendered":"https:\/\/en.buradabiliyorum.com\/how-personalized-ai-could-turn-into-a-frenemy\/"},"modified":"2023-09-03T20:00:00","modified_gmt":"2023-09-03T17:00:00","slug":"how-personalized-ai-could-turn-into-a-frenemy","status":"publish","type":"post","link":"https:\/\/buradabiliyorum.com\/en\/how-personalized-ai-could-turn-into-a-frenemy\/","title":{"rendered":"#How personalized AI could turn into a \u2018frenemy\u2019"},"content":{"rendered":"<p><img decoding=\"async\" src=\"https:\/\/thehill.com\/wp-content\/uploads\/sites\/2\/2023\/09\/GettyImages-828901262.jpg?w=900\" \/><\/p>\n<div>\n<p>Google reportedly <a rel=\"nofollow noopener\" target=\"_blank\" href=\"https:\/\/www.nytimes.com\/2023\/08\/16\/technology\/google-ai-life-advice.html\">plans to create<\/a> an AI-based \u201clife coach\u201d to offer users advice on a range of life\u2019s challenges \u2014 from navigating personal dilemmas to exploring new hobbies to planning meals.<\/p>\n<p>Given that people already search the web for such advice, this may seem a natural extension of the main service Google already provides. But take it from an artificial intelligence researcher: The combination of generative AI and personalization that such an <a href=\"https:\/\/buradabiliyorum.com\/en\/category\/download-scripts-themes-apps\/\" data-internallinksmanager029f6b8e52c=\"9\" title=\"Download Scripts &amp; Themes &amp; Apps\" target=\"_blank\" rel=\"noopener\">app<\/a> represents is new and potent, and its placement in a position of intimate trust is troubling.<\/p>\n<aside class=\"ad-unit ad-unit--mr1_ab\"><\/aside>\n<p>Yes, anxiety has greeted many recent developments in AI. Since the release of <a rel=\"nofollow noopener\" target=\"_blank\" href=\"https:\/\/www.washingtonpost.com\/technology\/2022\/12\/06\/what-is-chatgpt-ai\/\">ChatGPT<\/a>, many have worried about runaway rogue AIs. In March, more than 1,000 <a href=\"https:\/\/buradabiliyorum.com\/en\/category\/technology\/\" data-internallinksmanager029f6b8e52c=\"4\" title=\"Technology\" target=\"_blank\" rel=\"noopener\">technology<\/a> professionals, many AI pioneers among them, signed an\u00a0<a rel=\"nofollow noopener\" target=\"_blank\" href=\"https:\/\/futureoflife.org\/open-letter\/pause-giant-ai-experiments\/\">open letter<\/a>\u00a0warning the public about this danger.<\/p>\n<p>But most discussions about the risks of AI imagine a future in which hyper-capable AIs outdo humans at skills we think of as our forte. The rise of AI coaches,\u00a0<a rel=\"nofollow noopener\" target=\"_blank\" href=\"https:\/\/www.psychologytoday.com\/us\/blog\/understanding-hypnosis\/202207\/could-artificial-intelligence-replace-therapists\">therapists<\/a> and\u00a0<a rel=\"nofollow noopener\" target=\"_blank\" href=\"https:\/\/www.washingtonpost.com\/technology\/2023\/03\/30\/replika-ai-chatbot-update\/\">friends<\/a>\u00a0points to a different possibility. What if the most im<a href=\"https:\/\/buradabiliyorum.com\/en\/category\/social-mediaa\/\" data-internallinksmanager029f6b8e52c=\"1\" title=\"Social Media\" target=\"_blank\" rel=\"noopener\">media<\/a>te risk from AI systems is not that they learn to outperform us, but that they become the greatest \u201cfrenemies\u201d we have ever had?<\/p>\n<p>For better or worse, AI systems are far from mastering many tasks that humans perform well. Building reliable self-driving cars has been much harder than computer scientists anticipated. ChatGPT can string together fluent paragraphs, but it isn\u2019t close to crafting high-quality magazine articles or short stories.<\/p>\n<p>On the other hand, long before ChatGPT arrived, we had behind-the-scenes AI algorithms that excelled at hooking us onto the next viral video or keeping us scrolling just a little longer. Over the last two decades, these algorithms have given us ways to entertain ourselves endlessly and changed the face of our culture.<\/p>\n<p>Personalized versions of ChatGPT-like AIs, embedded within a wide range of apps, will have the capabilities of these algorithms on steroids. Your Netflix movie recommender can only see what you do on Netflix; these AI-charged apps will also read your emails, texts, and even listen in on your private conversations. Combining this data with ChatGPT-scale artificial neural networks, they will often be able to predict your wants and needs better than your closest real-life friends. And unlike your human friends, they will always be just one click away, 24 hours a day.<\/p>\n<p>But here\u2019s the \u201cfrenemy\u201d part: Just like earlier systems for generating recommendations, these AI confidantes will be ultimately designed to create revenue for their developers. This means that they will have incentives to manipulate you into clicking on ads forever, or to make sure you never cancel that subscription.<\/p>\n<aside class=\"ad-unit ad-unit--mr2_ab\"><\/aside>\n<p>The ability of these systems to continually generate new content will worsen their harmful impact.\u00a0<\/p>\n<p>These AIs will be able to use pictures and words newly created for you personally to soothe, amuse and agitate your brain\u2019s reward and stress systems. The dopamine circuits in our brains developed through millions of years of evolution. They were not designed to resist the onslaught of continual stimulation tailored to fit your most intimate hopes and fears.<\/p>\n<p>Add to this generative AI\u2019s\u00a0<a rel=\"nofollow noopener\" target=\"_blank\" href=\"https:\/\/www.washingtonpost.com\/technology\/2023\/05\/30\/ai-chatbots-chatgpt-bard-trustworthy\/\">well-known struggles with truth<\/a>. ChatGPT is\u00a0<a rel=\"nofollow noopener\" target=\"_blank\" href=\"https:\/\/www.washingtonpost.com\/technology\/2023\/04\/05\/chatgpt-lies\/\">notorious<\/a>\u00a0for lying, and your AI frenemies will be similarly unreliable narrators. At the same time, your perceived intimacy with them could make you less likely to question their authority.<\/p>\n<aside class=\"ad-unit ad-unit--mr3_ab\"><\/aside>\n<p>Like friendships with humans who manipulate and lie, our relationships with our AI frenemies will often end in tears. Many of us could be controlled by these \u201ctools,\u201d as the line between what we genuinely want and what the AI thinks we want gets ever blurrier. A lot of us will be lost in a digital amusement park, disengaged from society or parroting AI-generated falsehoods. Meanwhile, as the AI race heats up, technology companies will be tempted to ignore the risks of their products (<a rel=\"nofollow noopener\" target=\"_blank\" href=\"https:\/\/www.nytimes.com\/2023\/08\/16\/technology\/google-ai-life-advice.html\">reportedly<\/a>, Google\u2019s AI safety team raised concerns about the AI life coach, but the project went ahead anyway).\u00a0<\/p>\n<p>We are at an inflection point as personalized generative AI begins to take off, and it is imperative that we confront these challenges directly. The Biden administration\u2019s\u00a0<a rel=\"nofollow noopener\" target=\"_blank\" href=\"https:\/\/www.whitehouse.gov\/ostp\/ai-bill-of-rights\/\">AI bill of rights<\/a>\u00a0has emphasized the right to opt out from automated systems and the need for consent in data collection. But humans manipulated by powerful AI systems may not be able to opt out or meaningfully consent, and the lawmakers need to recognize this fact.<\/p>\n<p>Designing policies that limit the harms of our AI frenemies without hurting broader AI innovation requires careful discussion. But one thing is certain: cognitive agency \u2014 the ability to act on our genuine free will \u2014 is a fundamental aspect of being human. It is essential to both our pursuit of happiness and our citizenship in a democracy. We need to make sure that we don\u2019t lose this right because of carelessly deployed technology.<\/p>\n<aside class=\"ad-unit ad-unit--mr4_ab\"><\/aside>\n<p><em>Swarat Chaudhuri is a professor of Computer <a href=\"https:\/\/buradabiliyorum.com\/en\/category\/sciencee\/\" data-internallinksmanager029f6b8e52c=\"5\" title=\"Science\" target=\"_blank\" rel=\"noopener\">Science<\/a> and the director of the Trustworthy Intelligent Systems Laboratory at the University of Texas at Austin. He is a member of the 2023 cohort of the OpEd Project Public Voices Fellowship. Follow him at <\/em><a rel=\"nofollow noopener\" target=\"_blank\" href=\"https:\/\/twitter.com\/swarat\"><em>@swarat<\/em><\/a><em>.<\/em><\/p>\n<\/div>\n<p>Copyright 2023 Nexstar Media Inc. All rights reserved. This material may not be published, broadcast, rewritten, or redistributed.<\/p>\n<p><script async src=\"\/\/platform.twitter.com\/widgets.js\" charset=\"utf-8\"><\/script><\/p>\n<blockquote><p><strong><span style=\"color: #ff6600;\">If you liked the article, do not forget to share it with your friends. Follow us on\u00a0<span style=\"color: #ff0000;\"><a style=\"color: #ff0000;\" href=\"https:\/\/news.google.com\/publications\/CAAqBwgKMLG0nwswvr63Aw\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">Google News<\/a><\/span>\u00a0too, click on the star and choose us from your favorites.<\/span><\/strong><\/p><\/blockquote>\n<blockquote>\n<p style=\"text-align: center;\">For forums sites go to <span style=\"color: #ff9900;\"><a style=\"color: #ff9900;\" href=\"https:\/\/forum.buradabiliyorum.com\/\" target=\"_blank\" rel=\"noopener\">Forum.BuradaBiliyorum.Com<\/a><\/span><\/strong><\/p>\n<\/blockquote>\n<blockquote>\n<p style=\"text-align: center;\"><strong>If you want to read more <a href=\"https:\/\/buradabiliyorum.com\/en\/category\/news\/\" data-internallinksmanager029f6b8e52c=\"2\" title=\"News\" target=\"_blank\" rel=\"noopener\">News<\/a> articles, you can visit our <span style=\"color: #ff9900;\"><a style=\"color: #ff9900;\" href=\"https:\/\/en.buradabiliyorum.com\/news\/\" target=\"_blank\" rel=\"noopener\">News category.<\/a><\/span><\/strong><\/p>\n<\/blockquote>\n<p><span style=\"color: black;\"><a style=\"color: #ff9900;\" href=\"https:\/\/thehill.com\/opinion\/technology\/4184066-how-personalized-ai-could-turn-into-a-frenemy\/\" target=\"_blank\" rel=\"noopener\">Source<\/a><\/span><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Google reportedly plans to create an AI-based \u201clife coach\u201d to offer users advice on a range of life\u2019s challenges \u2014 from navigating personal dilemmas to exploring new hobbies to planning meals. Given that people already search the web for such advice, this may seem a natural extension of the main service Google already provides. But&#8230;<\/p>\n","protected":false},"author":1,"featured_media":589703,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"fifu_image_url":"https:\/\/thehill.com\/wp-content\/uploads\/sites\/2\/2023\/09\/GettyImages-828901262.jpg?w=1280","fifu_image_alt":"","footnotes":""},"categories":[70897],"tags":[145528,145529,70937,135369,134343,138467,10574,70610,26293,145530,70289,4965],"class_list":["post-589702","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-news","tag-ai-bill-of-rights","tag-algorithms","tag-artificial-intelligence","tag-biden-administration","tag-campaign","tag-chatgpt","tag-education","tag-finance","tag-google","tag-life-coaches","tag-senate","tag-technology"],"_links":{"self":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/posts\/589702","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/comments?post=589702"}],"version-history":[{"count":0,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/posts\/589702\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/media\/589703"}],"wp:attachment":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/media?parent=589702"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/categories?post=589702"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/tags?post=589702"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}