{"id":560820,"date":"2023-03-08T00:30:04","date_gmt":"2023-03-07T21:30:04","guid":{"rendered":"https:\/\/en.buradabiliyorum.com\/ai-or-human-written-language-assumptions-mislead\/"},"modified":"2023-03-08T00:30:04","modified_gmt":"2023-03-07T21:30:04","slug":"ai-or-human-written-language-assumptions-mislead","status":"publish","type":"post","link":"https:\/\/buradabiliyorum.com\/en\/ai-or-human-written-language-assumptions-mislead\/","title":{"rendered":"#AI- or human-written language? Assumptions mislead"},"content":{"rendered":"<div id=\"ez-toc-container\" class=\"ez-toc-v2_0_84 counter-hierarchy ez-toc-counter ez-toc-custom ez-toc-container-direction\">\n<p class=\"ez-toc-title\" style=\"cursor:inherit\">Table of Contents<\/p>\n<label for=\"ez-toc-cssicon-toggle-item-6a2a2109d2d26\" class=\"ez-toc-cssicon-toggle-label\"><span class=\"\"><span class=\"eztoc-hide\" style=\"display:none;\">Toggle<\/span><span class=\"ez-toc-icon-toggle-span\"><svg style=\"fill: #dd3333;color:#dd3333\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" class=\"list-377408\" width=\"20px\" height=\"20px\" viewBox=\"0 0 24 24\" fill=\"none\"><path d=\"M6 6H4v2h2V6zm14 0H8v2h12V6zM4 11h2v2H4v-2zm16 0H8v2h12v-2zM4 16h2v2H4v-2zm16 0H8v2h12v-2z\" fill=\"currentColor\"><\/path><\/svg><svg style=\"fill: #dd3333;color:#dd3333\" class=\"arrow-unsorted-368013\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"10px\" height=\"10px\" viewBox=\"0 0 24 24\" version=\"1.2\" baseProfile=\"tiny\"><path d=\"M18.2 9.3l-6.2-6.3-6.2 6.3c-.2.2-.3.4-.3.7s.1.5.3.7c.2.2.4.3.7.3h11c.3 0 .5-.1.7-.3.2-.2.3-.5.3-.7s-.1-.5-.3-.7zM5.8 14.7l6.2 6.3 6.2-6.3c.2-.2.3-.5.3-.7s-.1-.5-.3-.7c-.2-.2-.4-.3-.7-.3h-11c-.3 0-.5.1-.7.3-.2.2-.3.5-.3.7s.1.5.3.7z\"\/><\/svg><\/span><\/span><\/label><input type=\"checkbox\"  id=\"ez-toc-cssicon-toggle-item-6a2a2109d2d26\" checked aria-label=\"Toggle\" \/><nav><ul class='ez-toc-list ez-toc-list-level-1 ' ><li class='ez-toc-page-1 ez-toc-heading-level-1'><a class=\"ez-toc-link ez-toc-heading-1\" href=\"https:\/\/buradabiliyorum.com\/en\/ai-or-human-written-language-assumptions-mislead\/#%E2%80%9CAI-_or_human-written_language_Assumptions_mislead%E2%80%9D\" >&#8220;AI- or human-written language? Assumptions mislead&#8221;<\/a><\/li><\/ul><\/nav><\/div>\n<h1><span class=\"ez-toc-section\" id=\"%E2%80%9CAI-_or_human-written_language_Assumptions_mislead%E2%80%9D\"><\/span>&#8220;AI- or human-written language? Assumptions mislead&#8221;<span class=\"ez-toc-section-end\"><\/span><\/h1>\n<div>\n<div class=\"article-gallery lightGallery\">\n<div data-thumb=\"https:\/\/scx1.b-cdn.net\/csz\/news\/tmb\/2022\/ai.jpg\" data-src=\"https:\/\/scx2.b-cdn.net\/gfx\/news\/hires\/2022\/ai.jpg\" data-sub-html=\"Datasets used to train AI algorithms may underrepresent older people. Credit: Pixabay\/CC0 Public Domain\">\n<figure class=\"article-img\"><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/scx1.b-cdn.net\/csz\/news\/800a\/2022\/ai.jpg\" alt=\"AI\" title=\"Datasets used to train AI algorithms may underrepresent older people. Credit: Pixabay\/CC0 Public Domain\" width=\"800\" height=\"530\"\/><figcaption class=\"text-darken text-low-up text-truncate-js text-truncate mt-3\">\n                Datasets used to train AI algorithms may underrepresent older people. Credit: Pixabay\/CC0 Public Domain<br \/>\n            <\/figcaption><\/figure>\n<\/div>\n<\/div>\n<p>Human assumptions regarding language usage can lead to flawed judgments of whether language was AI- or human-generated, Cornell Tech and Stanford researchers have found in a <a href=\"https:\/\/buradabiliyorum.com\/en\/category\/watch-movies-tv-seriess\/\" data-internallinksmanager029f6b8e52c=\"8\" title=\"Watch Movies &amp; TV Series\" target=\"_blank\" rel=\"noopener\">series<\/a> of experiments.<\/p>\n<p>While individuals&#8217; proficiency at detecting AI-generated language was <a href=\"https:\/\/buradabiliyorum.com\/en\/category\/general\/\" data-internallinksmanager029f6b8e52c=\"3\" title=\"General\" target=\"_blank\" rel=\"noopener\">general<\/a>ly a tossup across the board, people were consistently influenced by the same verbal cues, leading to the same flawed judgments.<\/p>\n<p>Participants could not differentiate AI-generated from human-generated language, erroneously assuming that mentions of personal experiences and the use of &#8220;I&#8221; pronouns indicated human authors. They also thought that convoluted phrasing was AI-generated.<\/p>\n<p>&#8220;We learned something about humans and what they believe to be either human or AI language,&#8221; said Mor Naaman, professor at the Jacobs Technion-Cornell Institute at Cornell Tech and of information <a href=\"https:\/\/buradabiliyorum.com\/en\/category\/sciencee\/\" data-internallinksmanager029f6b8e52c=\"5\" title=\"Science\" target=\"_blank\" rel=\"noopener\">science<\/a> at the Cornell Ann S. Bowers College of Computing and Information Science. &#8220;But we also show that AI can take advantage of that, learn from it and then produce texts that can more easily mislead people.&#8221;<\/p>\n<p>Maurice Jakesch, Ph.D., a former member of Naaman&#8217;s <a href=\"https:\/\/buradabiliyorum.com\/en\/category\/social-mediaa\/\" data-internallinksmanager029f6b8e52c=\"1\" title=\"Social Media\" target=\"_blank\" rel=\"noopener\">Social<\/a> Technologies Lab at Cornell Tech, is lead author of &#8220;Human Heuristics for AI-Generated Language Are Flawed,&#8221; published March 7 in <i>Proceedings of the National Academy of Sciences<\/i>. Naaman and Jeff Hancock, professor of communication at Stanford University, are co-authors.<\/p>\n<p>The researchers conducted three main experiments and three more to validate the findings, involving 4,600 participants and 7,600 &#8220;verbal self-presentations&#8221;\u2014profile text people used to describe themselves on social websites. The experiments were patterned after the Turing test, developed in 1950 by British mathematician Alan Turing, who devised the test to measure a machine&#8217;s ability to exhibit intelligent behavior equal to or better than a human.<\/p>\n<p>Instead of testing the machine, the new study tested humans&#8217; ability to detect whether the exhibited intelligence came from a machine or a human. The researchers trained multiple AI language models to generate text in three social contexts where trust in the sender is important: professional (job <a href=\"https:\/\/buradabiliyorum.com\/en\/category\/download-scripts-themes-apps\/\" data-internallinksmanager029f6b8e52c=\"9\" title=\"Download Scripts &amp; Themes &amp; Apps\" target=\"_blank\" rel=\"noopener\">app<\/a>lication); romantic (online dating); and hospitality (Airbnb host profiles).<\/p>\n<p>                                            <!-- Google middle Adsense block --><\/p>\n<p>                                        In the three main experiments, using two different language models, participants identified the source of a self-presentation with only 50% to 52% accuracy. But the responses, the researchers discovered, were not random, as the agreement between respondents&#8217; answers was significantly higher than chance, meaning many participants were drawing the same flawed conclusions.<\/p>\n<p>The researchers conducted an analysis of the heuristics (the process by which a conclusion is reached) participants used in deciding whether language was AI- or human-generated, first by asking participants to explain their judgments, then following up with a computational analysis that confirmed these reports. People cited mentions of family and life experiences, as well as the use of first-person pronouns, as evidence of human language.<\/p>\n<p>However, such language is equally likely to be produced by AI language models.<\/p>\n<p>&#8220;People&#8217;s intuition goes counter the current design of these language models,&#8221; Naaman said. &#8220;They produce text that is statistically probable\u2014in other words, language that is common. But people tended to associate uncommon language with AI, a behavior that AI systems can then exploit that to create language, as we call it, &#8216;more human than human.'&#8221;<\/p>\n<p>In three pre-registered validation experiments, the authors show that indeed, AI can exploit people&#8217;s heuristics to produce text that people more reliably rate as human-written than actual human-written text.<\/p>\n<p>People&#8217;s reliance on flawed heuristics in identifying AI-generated language, the authors wrote, is not necessarily indicative of increased machine intelligence. It doesn&#8217;t take superior intelligence, they said, to &#8220;fool&#8221; humans\u2014just a well-placed personal pronoun, or a mention of family.<\/p>\n<p>The authors note that while humans&#8217; ability to discern AI-generated language might be limited, language models that are &#8220;self-disclosing by design&#8221; would let the user know that the information is not human-generated while preserving the integrity of the message.<\/p>\n<p>This could be achieved either by a language that is clearly non-human (avoiding the use of informal speech) or through &#8220;AI accents&#8221;\u2014a dedicated dialect that could &#8220;facilitate and support people&#8217;s intuitive judgments without interrupting the flow of communication,&#8221; they wrote.<\/p>\n<p>Hancock, a faculty member at Cornell from 2002-15, said this work is &#8220;one of the last nails in the coffin&#8221; of the Turing test era.<\/p>\n<p>&#8220;As a way of thinking about whether something&#8217;s intelligent or not,&#8221; he said, &#8220;our data pretty clearly show that in pretty important ways of being human\u2014that is, describing yourself professionally, romantically or as a host\u2014it&#8217;s over. The machine has passed that test.&#8221;<\/p>\n<p>Naaman said this work\u2014particularly relevant with the arrival of AI tools such as ChatGPT\u2014highlights the fact that AI will increasingly be used as a tool to facilitate human-to-human communication.<\/p>\n<p>&#8220;This is about not about us talking to AI. It&#8217;s us talking to each other through AI,&#8221; he said. &#8220;And the implications that we show on trust are significant: People will be easily misled and will easily distrust each other\u2014not AI.&#8221;\n                                                                                                                            <\/p>\n<div class=\"article-main__more p-4\">\n                                                                                                <strong>More information:<\/strong><br \/>\n                                                Maurice Jakesch et al, Human heuristics for AI-generated language are flawed, <i>Proceedings of the National Academy of Sciences<\/i> (2023).  <a rel=\"nofollow noopener\" target=\"_blank\" data-doi=\"1\" href=\"https:\/\/dx.doi.org\/10.1073\/pnas.2208839120\">DOI: 10.1073\/pnas.2208839120<\/a><\/p><\/div>\n<div class=\"d-inline-block text-medium my-4\">\n                                                Provided by<br \/>\n                                                                                                    Cornell University<br \/>\n                                                                                                        <a rel=\"nofollow noopener\" target=\"_blank\" class=\"icon_open\" href=\"http:\/\/www.cornell.edu\/\"><br \/>\n                                                        <svg><use href=\"https:\/\/techx.b-cdn.net\/tmpl\/v2\/img\/svg\/sprite.svg#icon_open\" x=\"0\" y=\"0\"\/><\/svg><\/a><\/p><\/div>\n<p>                                        <!-- print only --><\/p>\n<div class=\"d-none d-print-block\">\n<p>                                                <strong>Citation<\/strong>:<br \/>\n                                                AI- or human-written language? Assumptions mislead (2023, March 7)<br \/>\n                                                retrieved 7 March 2023<br \/>\n                                                from https:\/\/techxplore.com\/<a href=\"https:\/\/buradabiliyorum.com\/en\/category\/news\/\" data-internallinksmanager029f6b8e52c=\"2\" title=\"News\" target=\"_blank\" rel=\"noopener\">news<\/a>\/2023-03-ai-human-written-language-assumptions.html<\/p>\n<p>                                            This document is subject to copyright. Apart from any fair dealing for the purpose of private study or research, no<br \/>\n                                            part may be reproduced without the written permission. The content is provided for information purposes only.<\/p><\/div>\n<\/p><\/div>\n<p><script id=\"facebook-jssdk\" async=\"\" src=\"https:\/\/connect.facebook.net\/en_US\/sdk.js\"><\/script><\/p>\n<blockquote><p><strong><span style=\"color: #ff6600;\">If you liked the article, do not forget to share it with your friends. Follow us on\u00a0<span style=\"color: #ff0000;\"><a style=\"color: #ff0000;\" href=\"https:\/\/news.google.com\/publications\/CAAqBwgKMLG0nwswvr63Aw\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">Google News<\/a><\/span>\u00a0too, click on the star and choose us from your favorites.<\/span><\/strong><\/p><\/blockquote>\n<blockquote>\n<p style=\"text-align: center;\">For forums sites go to <span style=\"color: #ff9900;\"><a style=\"color: #ff9900;\" href=\"https:\/\/forum.buradabiliyorum.com\/\" target=\"_blank\" rel=\"noopener\">Forum.BuradaBiliyorum.Com<\/a><\/span><\/strong>\n<\/p><\/blockquote>\n<blockquote>\n<p style=\"text-align: center;\"><strong>If you want to read more Like this articles, you can visit our <span style=\"color: #ff9900;\"><a style=\"color: #ff9900;\" href=\"https:\/\/en.buradabiliyorum.com\/science\/\" target=\"_blank\" rel=\"noopener\">Science category.<\/a><\/span><\/strong><\/p>\n<\/blockquote>\n<p><span style=\"color: black;\"><a style=\"color: #ff9900;\" href=\"https:\/\/techxplore.com\/news\/2023-03-ai-human-written-language-assumptions.html\" target=\"_blank\" rel=\"noopener\">Source<\/a><\/span><\/p>\n","protected":false},"excerpt":{"rendered":"<p>&#8220;AI- or human-written language? Assumptions mislead&#8221; Datasets used to train AI algorithms may underrepresent older people. Credit: Pixabay\/CC0 Public Domain Human assumptions regarding language usage can lead to flawed judgments of whether language was AI- or human-generated, Cornell Tech and Stanford researchers have found in a series of experiments. While individuals&#8217; proficiency at detecting AI-generated&#8230;<\/p>\n","protected":false},"author":1,"featured_media":560821,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"fifu_image_url":"https:\/\/scx2.b-cdn.net\/gfx\/news\/hires\/2022\/ai.jpg","fifu_image_alt":"","footnotes":""},"categories":[16],"tags":[],"class_list":["post-560820","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-sciencee"],"_links":{"self":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/posts\/560820","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/comments?post=560820"}],"version-history":[{"count":0,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/posts\/560820\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/media\/560821"}],"wp:attachment":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/media?parent=560820"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/categories?post=560820"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/tags?post=560820"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}