{"id":660053,"date":"2025-04-02T04:12:33","date_gmt":"2025-04-02T01:12:33","guid":{"rendered":"https:\/\/en.buradabiliyorum.com\/study-finds-chatgpt-mirrors-human-decision-biases-in-half-the-tests\/"},"modified":"2025-04-02T04:12:33","modified_gmt":"2025-04-02T01:12:33","slug":"study-finds-chatgpt-mirrors-human-decision-biases-in-half-the-tests","status":"publish","type":"post","link":"https:\/\/buradabiliyorum.com\/en\/study-finds-chatgpt-mirrors-human-decision-biases-in-half-the-tests\/","title":{"rendered":"Study finds ChatGPT mirrors human decision biases in half the tests"},"content":{"rendered":"<div id=\"ez-toc-container\" class=\"ez-toc-v2_0_84 counter-hierarchy ez-toc-counter ez-toc-custom ez-toc-container-direction\">\n<p class=\"ez-toc-title\" style=\"cursor:inherit\">Table of Contents<\/p>\n<label for=\"ez-toc-cssicon-toggle-item-6a2cf1593a1d8\" class=\"ez-toc-cssicon-toggle-label\"><span class=\"\"><span class=\"eztoc-hide\" style=\"display:none;\">Toggle<\/span><span class=\"ez-toc-icon-toggle-span\"><svg style=\"fill: #dd3333;color:#dd3333\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" class=\"list-377408\" width=\"20px\" height=\"20px\" viewBox=\"0 0 24 24\" fill=\"none\"><path d=\"M6 6H4v2h2V6zm14 0H8v2h12V6zM4 11h2v2H4v-2zm16 0H8v2h12v-2zM4 16h2v2H4v-2zm16 0H8v2h12v-2z\" fill=\"currentColor\"><\/path><\/svg><svg style=\"fill: #dd3333;color:#dd3333\" class=\"arrow-unsorted-368013\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"10px\" height=\"10px\" viewBox=\"0 0 24 24\" version=\"1.2\" baseProfile=\"tiny\"><path d=\"M18.2 9.3l-6.2-6.3-6.2 6.3c-.2.2-.3.4-.3.7s.1.5.3.7c.2.2.4.3.7.3h11c.3 0 .5-.1.7-.3.2-.2.3-.5.3-.7s-.1-.5-.3-.7zM5.8 14.7l6.2 6.3 6.2-6.3c.2-.2.3-.5.3-.7s-.1-.5-.3-.7c-.2-.2-.4-.3-.7-.3h-11c-.3 0-.5.1-.7.3-.2.2-.3.5-.3.7s.1.5.3.7z\"\/><\/svg><\/span><\/span><\/label><input type=\"checkbox\"  id=\"ez-toc-cssicon-toggle-item-6a2cf1593a1d8\" checked aria-label=\"Toggle\" \/><nav><ul class='ez-toc-list ez-toc-list-level-1 ' ><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-1\" href=\"https:\/\/buradabiliyorum.com\/en\/study-finds-chatgpt-mirrors-human-decision-biases-in-half-the-tests\/#AI_A_smart_assistant_with_human-like_flaws\" >AI: A smart assistant with human-like flaws<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-2\" href=\"https:\/\/buradabiliyorum.com\/en\/study-finds-chatgpt-mirrors-human-decision-biases-in-half-the-tests\/#Why_this_matters\" >Why this matters<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-3\" href=\"https:\/\/buradabiliyorum.com\/en\/study-finds-chatgpt-mirrors-human-decision-biases-in-half-the-tests\/#So_can_we_trust_AI_to_make_big_decisions\" >So, can we trust AI to make big decisions?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-4\" href=\"https:\/\/buradabiliyorum.com\/en\/study-finds-chatgpt-mirrors-human-decision-biases-in-half-the-tests\/#Whats_next\" >What&#8217;s next?<\/a><\/li><\/ul><\/nav><\/div>\n<div>\n<div class=\"article-gallery lightGallery\">\n<div data-thumb=\"https:\/\/scx1.b-cdn.net\/csz\/news\/tmb\/2024\/ai-bias.jpg\" data-src=\"https:\/\/scx2.b-cdn.net\/gfx\/news\/hires\/2024\/ai-bias.jpg\" data-sub-html=\"Credit: AI-generated image\">\n<figure class=\"article-img\">\n            <img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/scx1.b-cdn.net\/csz\/news\/800a\/2024\/ai-bias.jpg\" alt=\"AI bias\" title=\"Credit: AI-generated image\" width=\"800\" height=\"457\"\/><figcaption class=\"text-darken text-low-up text-truncate-js text-truncate mt-3\">\n                Credit: AI-generated image<br \/>\n            <\/figcaption><\/figure>\n<\/p><\/div>\n<\/div>\n<p>Can we really trust AI to make better decisions than humans? A new study says \u2026 not always. Researchers have discovered that OpenAI&#8217;s ChatGPT, one of the most advanced and popular AI models, makes the same kinds of decision-making mistakes as humans in some situations\u2014showing biases like overconfidence of hot-hand (gambler&#8217;s) fallacy\u2014yet acting inhuman in others (e.g., not suffering from base-rate neglect or sunk cost fallacies).<\/p>\n<p>Published in the <i>Manufacturing &amp; Service Operations Management<\/i> journal, <a rel=\"nofollow\" target=\"_blank\" href=\"https:\/\/pubsonline.informs.org\/doi\/10.1287\/msom.2023.0279\" target=\"_blank\">the study<\/a> reveals that ChatGPT doesn&#8217;t just crunch numbers\u2014it &#8220;thinks&#8221; in ways eerily similar to humans, including mental shortcuts and blind spots. These biases remain rather stable across different business situations but may change as AI evolves from one version to the next.<\/p>\n<h2><span class=\"ez-toc-section\" id=\"AI_A_smart_assistant_with_human-like_flaws\"><\/span>AI: A smart assistant with human-like flaws<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p>The study, &#8220;A Manager and an AI Walk into a Bar: Does ChatGPT Make Biased Decisions Like We Do?,&#8221; put ChatGPT through 18 different bias tests. The results?<\/p>\n<ul>\n<li>AI falls into human decision traps\u2014ChatGPT showed biases like overconfidence or ambiguity aversion, and conjunction fallacy (aka as the &#8220;Linda problem&#8221;), in nearly half the tests.<\/li>\n<li>AI is great at math, but struggles with judgment calls\u2014It excels at logical and probability-based problems but stumbles when decisions require subjective reasoning.<\/li>\n<li>Bias isn&#8217;t going away\u2014Although the newer GPT-4 model is more analytically accurate than its predecessor, it sometimes displayed stronger biases in judgment-based tasks.<\/li>\n<\/ul>\n<h2><span class=\"ez-toc-section\" id=\"Why_this_matters\"><\/span>Why this matters<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p>From job hiring to loan <a href=\"https:\/\/buradabiliyorum.com\/en\/category\/download-scripts-themes-apps\/\" data-internallinksmanager029f6b8e52c=\"9\" title=\"Download Scripts &amp; Themes &amp; Apps\" target=\"_blank\" rel=\"noopener\">app<\/a>rovals, AI is already shaping major decisions in business and government. But if AI mimics human biases, could it be reinforcing bad decisions instead of fixing them?<\/p>\n<p>&#8220;As AI learns from human data, it may also think like a human\u2014biases and all,&#8221; says Yang Chen, lead author and assistant professor at Western University. &#8220;Our research shows when AI is used to make judgment calls, it sometimes employs the same mental shortcuts as people.&#8221;<\/p>\n<p>The study found that ChatGPT tends to:<\/p>\n<ul>\n<li>Play it safe\u2014AI avoids risk, even when riskier choices might yield better results.<\/li>\n<li>Overestimate itself\u2014ChatGPT assumes it&#8217;s more accurate than it really is.<\/li>\n<li>Seek confirmation\u2014AI favors information that supports existing assumptions, rather than challenging them.<\/li>\n<li>Avoid ambiguity\u2014AI prefers alternatives with more certain information and less ambiguity.<\/li>\n<\/ul>\n<p>&#8220;When a decision has a clear right answer, AI nails it\u2014it is better at finding the right formula than most people are,&#8221; says Anton Ovchinnikov of Queen&#8217;s University. &#8220;But when judgment is involved, AI may fall into the same cognitive traps as people.&#8221;<\/p>\n<p>                                                                                                        <!-- TechX - News - In-article --><\/p>\n<h2><span class=\"ez-toc-section\" id=\"So_can_we_trust_AI_to_make_big_decisions\"><\/span>So, can we trust AI to make big decisions?<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p>With governments worldwide working on AI regulations, the study raises an urgent question: Should we rely on AI to make important calls when it can be just as biased as humans?<\/p>\n<p>&#8220;AI isn&#8217;t a neutral referee,&#8221; says Samuel Kirshner of UNSW Business School. &#8220;If left unchecked, it might not fix decision-making problems\u2014it could actually make them worse.&#8221;<\/p>\n<p>The researchers say that&#8217;s why businesses and policymakers need to monitor AI&#8217;s decisions as closely as they would a human decision-maker.<\/p>\n<p>&#8220;AI should be treated like an employee who makes important decisions\u2014it needs oversight and ethical guidelines,&#8221; says Meena Andiappan of McMaster University. &#8220;Otherwise, we risk automating flawed thinking instead of improving it.&#8221;<\/p>\n<h2><span class=\"ez-toc-section\" id=\"Whats_next\"><\/span>What&#8217;s next?<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p>The study&#8217;s authors recommend regular audits of AI-driven decisions and refining AI systems to reduce biases. With AI&#8217;s influence growing, making sure it improves decision-making\u2014rather than just replicating human flaws\u2014will be key.<\/p>\n<p>&#8220;The evolution from GPT-3.5 to 4.0 suggests the latest models are becoming more human in some areas, yet less human but more accurate in others,&#8221; says Tracy Jenkin of Queen&#8217;s University. &#8220;Managers must evaluate how different models perform on their decision-making use cases and regularly re-evaluate to avoid surprises. Some use cases will need significant model refinement.&#8221;<\/p>\n<div class=\"article-main__more p-4\">\n<p><strong>More information:<\/strong><br \/>\n\t\t\t\t\t\t\t\t\t\t\t\tYang Chen et al, A Manager and an AI Walk into a Bar: Does ChatGPT Make Biased Decisions Like We Do?, <i>Manufacturing &amp; Service Operations Management<\/i> (2025). <a rel=\"nofollow\" target=\"_blank\" data-doi=\"1\" href=\"https:\/\/dx.doi.org\/10.1287\/msom.2023.0279\" target=\"_blank\">DOI: 10.1287\/msom.2023.0279<\/a><\/p>\n<\/div>\n<div class=\"d-inline-block text-medium my-4\">\n                                                Provided by<br \/>\n                                                                                                    Institute for Operations Research and the Management <a href=\"https:\/\/buradabiliyorum.com\/en\/category\/sciencee\/\" data-internallinksmanager029f6b8e52c=\"5\" title=\"Science\" target=\"_blank\" rel=\"noopener\">Science<\/a>s<br \/>\n                                                    \t\t\t\t\t\t\t\t\t\t\t\t\t<a rel=\"nofollow\" target=\"_blank\" class=\"icon_open\" href=\"http:\/\/www.informs.org\/\" target=\"_blank\" rel=\"nofollow\"><br \/>\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t<svg>\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<use href=\"https:\/\/techx.b-cdn.net\/tmpl\/v2\/img\/svg\/sprite.svg#icon_open\" x=\"0\" y=\"0\"\/>\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t<\/svg><br \/>\n\t\t\t\t\t\t\t\t\t\t\t\t\t<\/a><\/p><\/div>\n<p>                                        <!-- print only --><\/p>\n<div class=\"d-none d-print-block\">\n<p>\n                                                <strong>Citation<\/strong>:<br \/>\n                                                AI thinks like us\u2014flaws and all: Study finds ChatGPT mirrors human decision biases in half the tests (2025, April 1)<br \/>\n                                                retrieved 1 April 2025<br \/>\n                                                from https:\/\/techxplore.com\/<a href=\"https:\/\/buradabiliyorum.com\/en\/category\/news\/\" data-internallinksmanager029f6b8e52c=\"2\" title=\"News\" target=\"_blank\" rel=\"noopener\">news<\/a>\/2025-04-ai-flaws-chatgpt-mirrors-human.html\n                                            <\/p>\n<p>\n                                            This document is subject to copyright. Apart from any fair dealing for the purpose of private study or research, no<br \/>\n                                            part may be reproduced without the written permission. The content is provided for information purposes only.\n                                            <\/p>\n<\/p><\/div>\n<\/p><\/div>\n<p><script id=\"facebook-jssdk\" async=\"\" src=\"https:\/\/connect.facebook.net\/en_US\/sdk.js\"><\/script><\/p>\n<blockquote><p><strong><span style=\"color: #ff6600;\">If you liked the article, do not forget to share it with your friends. Follow us on\u00a0<span style=\"color: #ff0000;\"><a style=\"color: #ff0000;\" href=\"https:\/\/news.google.com\/publications\/CAAqBwgKMN63nwsw68G3Aw\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">Google News<\/a><\/span>\u00a0too, click on the star and choose us from your favorites.<\/span><\/strong><\/p><\/blockquote>\n<blockquote>\n<p style=\"text-align: center;\"><strong>If you want to read more Like this articles, you can visit our <span style=\"color: #ff9900;\"><a style=\"color: #ff9900;\" href=\"https:\/\/en.buradabiliyorum.com\/category\/sciencee\/\" target=\"_blank\" >Science category.<\/a><\/span><\/strong><\/p>\n<\/blockquote>\n<p><span style=\"color: black;\"><a style=\"color: #ff9900;\" href=\"https:\/\/techxplore.com\/news\/2025-04-ai-flaws-chatgpt-mirrors-human.html\" target=\"_blank\" >Source<\/a><\/span><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Credit: AI-generated image Can we really trust AI to make better decisions than humans? A new study says \u2026 not always. Researchers have discovered that OpenAI&#8217;s ChatGPT, one of the most advanced and popular AI models, makes the same kinds of decision-making mistakes as humans in some situations\u2014showing biases like overconfidence of hot-hand (gambler&#8217;s) fallacy\u2014yet&#8230;<\/p>\n","protected":false},"author":1,"featured_media":660054,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"fifu_image_url":"https:\/\/scx2.b-cdn.net\/gfx\/news\/hires\/2024\/ai-bias.jpg","fifu_image_alt":"","footnotes":""},"categories":[16],"tags":[],"class_list":["post-660053","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-sciencee"],"_links":{"self":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/posts\/660053","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/comments?post=660053"}],"version-history":[{"count":0,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/posts\/660053\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/media\/660054"}],"wp:attachment":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/media?parent=660053"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/categories?post=660053"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/tags?post=660053"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}