{"id":455121,"date":"2022-05-30T18:10:53","date_gmt":"2022-05-30T15:10:53","guid":{"rendered":"https:\/\/en.buradabiliyorum.com\/ai-has-a-dangerous-bias-problem-heres-how-to-manage-it\/"},"modified":"2022-05-30T18:10:53","modified_gmt":"2022-05-30T15:10:53","slug":"ai-has-a-dangerous-bias-problem-heres-how-to-manage-it","status":"publish","type":"post","link":"https:\/\/buradabiliyorum.com\/en\/ai-has-a-dangerous-bias-problem-heres-how-to-manage-it\/","title":{"rendered":"#AI has a dangerous bias problem \u2014 here\u2019s how to manage it"},"content":{"rendered":"<div id=\"ez-toc-container\" class=\"ez-toc-v2_0_88 counter-hierarchy ez-toc-counter ez-toc-custom ez-toc-container-direction\">\n<p class=\"ez-toc-title\" style=\"cursor:inherit\">Table of Contents<\/p>\n<label for=\"ez-toc-cssicon-toggle-item-6acc6e8c04be9\" class=\"ez-toc-cssicon-toggle-label\"><span class=\"\"><span class=\"eztoc-hide\" style=\"display:none;\">Toggle<\/span><span class=\"ez-toc-icon-toggle-span\"><svg style=\"fill: #dd3333;color:#dd3333\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" class=\"list-377408\" width=\"20px\" height=\"20px\" viewBox=\"0 0 24 24\" fill=\"none\"><path d=\"M6 6H4v2h2V6zm14 0H8v2h12V6zM4 11h2v2H4v-2zm16 0H8v2h12v-2zM4 16h2v2H4v-2zm16 0H8v2h12v-2z\" fill=\"currentColor\"><\/path><\/svg><svg style=\"fill: #dd3333;color:#dd3333\" class=\"arrow-unsorted-368013\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"10px\" height=\"10px\" viewBox=\"0 0 24 24\" version=\"1.2\" baseProfile=\"tiny\"><path d=\"M18.2 9.3l-6.2-6.3-6.2 6.3c-.2.2-.3.4-.3.7s.1.5.3.7c.2.2.4.3.7.3h11c.3 0 .5-.1.7-.3.2-.2.3-.5.3-.7s-.1-.5-.3-.7zM5.8 14.7l6.2 6.3 6.2-6.3c.2-.2.3-.5.3-.7s-.1-.5-.3-.7c-.2-.2-.4-.3-.7-.3h-11c-.3 0-.5.1-.7.3-.2.2-.3.5-.3.7s.1.5.3.7z\"\/><\/svg><\/span><\/span><\/label><input type=\"checkbox\"  id=\"ez-toc-cssicon-toggle-item-6acc6e8c04be9\" checked aria-label=\"Toggle\" \/><nav><ul class='ez-toc-list ez-toc-list-level-1 ' ><li class='ez-toc-page-1 ez-toc-heading-level-1'><a class=\"ez-toc-link ez-toc-heading-1\" href=\"https:\/\/buradabiliyorum.com\/en\/ai-has-a-dangerous-bias-problem-heres-how-to-manage-it\/#%E2%80%9CAI_has_a_dangerous_bias_problem_%E2%80%94_heres_how_to_manage_it%E2%80%9D\" >&#8220;AI has a dangerous bias problem \u2014 here\u2019s how to manage it&#8221;<\/a><ul class='ez-toc-list-level-2' ><li class='ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-2\" href=\"https:\/\/buradabiliyorum.com\/en\/ai-has-a-dangerous-bias-problem-heres-how-to-manage-it\/#Greetings_humanoids\" >Greetings humanoids<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-3\" href=\"https:\/\/buradabiliyorum.com\/en\/ai-has-a-dangerous-bias-problem-heres-how-to-manage-it\/#Explainability\" >Explainability<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-4\" href=\"https:\/\/buradabiliyorum.com\/en\/ai-has-a-dangerous-bias-problem-heres-how-to-manage-it\/#Accountability\" >Accountability<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-5\" href=\"https:\/\/buradabiliyorum.com\/en\/ai-has-a-dangerous-bias-problem-heres-how-to-manage-it\/#Security\" >Security<\/a><\/li><\/ul><\/li><\/ul><\/nav><\/div>\n<h1><span class=\"ez-toc-section\" id=\"%E2%80%9CAI_has_a_dangerous_bias_problem_%E2%80%94_heres_how_to_manage_it%E2%80%9D\"><\/span>&#8220;AI has a dangerous bias problem \u2014 here\u2019s how to manage it&#8221;<span class=\"ez-toc-section-end\"><\/span><\/h1>\n<div>\n                            <span style=\"font-weight: 400;\">AI now guides numerous life-changing decisions, from assessing loan <a href=\"https:\/\/buradabiliyorum.com\/en\/category\/download-scripts-themes-apps\/\" data-internallinksmanager029f6b8e52c=\"9\" title=\"Download Scripts &amp; Themes &amp; Apps\" target=\"_blank\" rel=\"noopener\">app<\/a>lications to <a rel=\"nofollow noopener\" target=\"_blank\" href=\"https:\/\/apnews.com\/article\/artificial-intelligence-algorithm-technology-police-crime-7e3345485aa668c97606d4b54f9b6220\">determining prison sentences<\/a>.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Proponents of the approach argue that it can eliminate human prejudices, but critics warn that algorithms can amplify our biases \u2014 without even revealing how they reached the decision.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">This can result in AI systems leading to <\/span><span style=\"font-weight: 400;\">Black people being wrongfully arrested<\/span><span style=\"font-weight: 400;\">, or <\/span><span style=\"font-weight: 400;\">child services unfairly targeting poor families<\/span><span style=\"font-weight: 400;\">. The victims are frequently from groups that are already marginalized.<\/span><\/p>\n<div class=\"corona-wrapper neural-cta hs-embed-tnw\">\n<div class=\"neural-cta-wrapper\">\n<div class=\"neural-cta-img\"><img decoding=\"async\" src=\"https:\/\/s3.amazonaws.com\/events.tnw\/hardfork-2018\/uploads\/companies\/neural-newsletter_header.gif\"\/><\/div>\n<p><noscript><img decoding=\"async\" src=\"https:\/\/s3.amazonaws.com\/events.tnw\/hardfork-2018\/uploads\/companies\/neural-newsletter_header.gif\"\/><\/noscript><\/p>\n<div class=\"neural-cta-input\">\n<h2 class=\"neural-cta-title\"><span class=\"ez-toc-section\" id=\"Greetings_humanoids\"><\/span>Greetings humanoids<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p class=\"neural-cta-tagline\">Subscribe now for a weekly recap of our favorite AI stories<\/p>\n<p><!--[if lte IE 8]><![endif]--><\/div>\n<\/div>\n<\/div>\n<p><span style=\"font-weight: 400;\">Alejandro Saucedo, Chief Scientist at <a rel=\"nofollow noopener\" target=\"_blank\" href=\"https:\/\/ethical.institute\/\">The Institute for Ethical AI<\/a> and Engineering Director at ML startup <a rel=\"nofollow noopener\" target=\"_blank\" href=\"https:\/\/www.seldon.io\/\">Seldon<\/a>, warns organizations to think carefully before deploying algorithms. He told TNW his tips on mitigating the risks.<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"Explainability\"><\/span>Explainability<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">Machine learning systems need to provide transparency. This can be a challenge when using powerful AI models, whose inputs, operations, and outcomes aren\u2019t obvious to humans.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Explainability has been touted as a solution for years, but effective approaches remain elusive.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">\u201cThe machine learning explainability tools can themselves be biased,\u201d says Saucedo. \u201cIf you\u2019re not using the relevant tool or if you\u2019re using a specific tool in a way that\u2019s incorrect or not-fit for purpose, you are getting incorrect explanations. It\u2019s the usual software paradigm of garbage in, garbage out.\u201d<\/span><\/p>\n<p><span style=\"font-weight: 400;\">While there\u2019s no silver bullet, human oversight and monitoring can reduce the risks.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Saucedo recommends identifying the processes and touchpoints that require a human-in-the-loop. This involves interrogating the underlying data, the model that is used, and any biases that emerge during deployment.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">The aim is to identify the touchpoints that require human oversight at each stage of the machine learning lifecycle.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Ideally, this will ensure that the chosen system is fit-for-purpose and relevant to the use case.\u00a0<\/span><\/p>\n<figure class=\"post-image post-mediaBleed aligncenter\"><img decoding=\"async\" loading=\"lazy\" class=\"size-full wp-image-1387117 js-lazy\" alt=\"Alejandro Saucedo is discussing AI biases on July 16 at the TNW Conference\" width=\"768\" height=\"768\" sizes=\"auto, (max-width: 768px) 100vw, 768px\" src=\"https:\/\/cdn0.tnwcdn.com\/wp-content\/blogs.dir\/1\/files\/2022\/05\/Alejandro_Saucedo-2-2-NEW.jpg\" srcset=\"https:\/\/cdn0.tnwcdn.com\/wp-content\/blogs.dir\/1\/files\/2022\/05\/Alejandro_Saucedo-2-2-NEW.jpg 768w, https:\/\/cdn0.tnwcdn.com\/wp-content\/blogs.dir\/1\/files\/2022\/05\/Alejandro_Saucedo-2-2-NEW-210x210.jpg 210w, https:\/\/cdn0.tnwcdn.com\/wp-content\/blogs.dir\/1\/files\/2022\/05\/Alejandro_Saucedo-2-2-NEW-135x135.jpg 135w, https:\/\/cdn0.tnwcdn.com\/wp-content\/blogs.dir\/1\/files\/2022\/05\/Alejandro_Saucedo-2-2-NEW-96x96.jpg 96w, https:\/\/cdn0.tnwcdn.com\/wp-content\/blogs.dir\/1\/files\/2022\/05\/Alejandro_Saucedo-2-2-NEW-270x270.jpg 270w, https:\/\/cdn0.tnwcdn.com\/wp-content\/blogs.dir\/1\/files\/2022\/05\/Alejandro_Saucedo-2-2-NEW-192x192.jpg 192w\"\/><figcaption><a rel=\"nofollow noopener\" target=\"_blank\" href=\"#\" data-url=\"https:\/\/twitter.com\/intent\/tweet?url=https%3A%2F%2Feditorial.thenextweb.com%2Fneural%2F2022%2F05%2F30%2Fhow-to-manage-ai-bias-alejandro-saucedo-interview%2F&amp;via=thenextweb&amp;related=thenextweb&amp;text=Check out this picture on: Alejandro Saucedo is discussing AI biases on July 16 at the TNW Conference\" data-title=\"Share Alejandro Saucedo is discussing AI biases on July 16 at the TNW Conference on Twitter\" data-width=\"685\" data-height=\"500\" class=\"post-image-share popitup\" title=\"Share Alejandro Saucedo is discussing AI biases on July 16 at the TNW Conference on Twitter\"><i class=\"icon icon--inline icon--twitter--dark\"\/><\/a>Alejandro Saucedo is discussing AI biases on July 16 at the TNW Conference<\/figcaption><noscript><img decoding=\"async\" loading=\"lazy\" class=\"size-full wp-image-1387117\" src=\"https:\/\/cdn0.tnwcdn.com\/wp-content\/blogs.dir\/1\/files\/2022\/05\/Alejandro_Saucedo-2-2-NEW.jpg\" alt=\"Alejandro Saucedo is discussing AI biases on July 16 at the TNW Conference\" width=\"768\" height=\"768\" srcset=\"https:\/\/cdn0.tnwcdn.com\/wp-content\/blogs.dir\/1\/files\/2022\/05\/Alejandro_Saucedo-2-2-NEW.jpg 768w, https:\/\/cdn0.tnwcdn.com\/wp-content\/blogs.dir\/1\/files\/2022\/05\/Alejandro_Saucedo-2-2-NEW-210x210.jpg 210w, https:\/\/cdn0.tnwcdn.com\/wp-content\/blogs.dir\/1\/files\/2022\/05\/Alejandro_Saucedo-2-2-NEW-135x135.jpg 135w, https:\/\/cdn0.tnwcdn.com\/wp-content\/blogs.dir\/1\/files\/2022\/05\/Alejandro_Saucedo-2-2-NEW-96x96.jpg 96w, https:\/\/cdn0.tnwcdn.com\/wp-content\/blogs.dir\/1\/files\/2022\/05\/Alejandro_Saucedo-2-2-NEW-270x270.jpg 270w, https:\/\/cdn0.tnwcdn.com\/wp-content\/blogs.dir\/1\/files\/2022\/05\/Alejandro_Saucedo-2-2-NEW-192x192.jpg 192w\"\/><\/noscript><\/figure>\n<p><span style=\"font-weight: 400;\">Domain experts can also use machine learning explainers to assess the prediction of the model, but it\u2019s imperative that they first evaluate the appropriateness of the system.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">\u201cWhen I say domain experts, I don\u2019t always mean technical data scientists,\u201d says Saucedo. \u201cThey can be industry experts, policy experts, or other individuals with expertise in the challenge that\u2019s being tackled.\u201d<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"Accountability\"><\/span><b>Accountability<\/b><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">The level of human intervention should be proportionate to the risks. An algorithm that recommends songs, for instance, won\u2019t require as much oversight as one that dictates bail conditions.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">In many cases, an advanced system will only increase the risks. Deep learning models, for example, can add a layer of complexity that causes more problems than it solves.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">\u201cIf you cannot understand the ambiguities of a tool you\u2019re introducing, but you do understand that the risks have high stakes, that\u2019s telling you that it\u2019s a risk that should not be taken,\u201d says Saucedo.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">The operators of AI systems must also justify the organizational process around the models they introduce.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">This requires an assessment of the entire chain of events that leads to a decision, from procuring data to the final output.<\/span><\/p>\n<p><span style=\"font-weight: 400;\"><\/p>\n<blockquote class=\"c-richText__pullQuote\">\n<div class=\"c-richText__pullQuoteGradient\">\n<p class=\"c-richText__pullQuoteQuote\">You need a framework of accountability\n            <\/div>\n<\/blockquote>\n<p><\/span><\/p>\n<p><span style=\"font-weight: 400;\">\u201cThere is a need to ensure accountability at each step,\u201d says Saucedo. \u201cIt\u2019s important to make sure that there are best practices on not just the explainability stage, but also on what happens when something goes wrong.\u201d<\/span><\/p>\n<p><span style=\"font-weight: 400;\">This includes providing a means to analyze the pathway to the outcome, data on which domain experts were involved, and information on the sign-off process.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">\u201cYou need a framework of accountability through robust infrastructure and a robust process that involves domain experts relevant to the risk involved at every stage of the lifecycle.\u201d<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"Security\"><\/span>Security<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">When AI systems go wrong, the company that deployed them can also suffer the consequences.\u00a0\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">This can be particularly damaging when using sensitive data, which bad actors can steal or manipulate.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">\u201cIf artifacts are exploited they can be injected with malicious code,\u201d says Saucedo. \u201cThat means that when they are running in production, they can extract secrets or share environment variables.\u201d<\/span><\/p>\n<p><span style=\"font-weight: 400;\">The software supply chain adds further dangers.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Organizations that use common data <a href=\"https:\/\/buradabiliyorum.com\/en\/category\/sciencee\/\" data-internallinksmanager029f6b8e52c=\"5\" title=\"Science\" target=\"_blank\" rel=\"noopener\">science<\/a> tools such as TensorFlow and PyTorch introduce extra dependencies, which can heighten the risks.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">An upgrade could cause a machine learning system to break, and attackers can inject malware at the supply chain level.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">The consequences can exacerbate existing biases and cause catastrophic failures.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Saucedo again recommends applying best practices and human intervention to mitigate the risks.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">An AI system may promise better results than humans, but without their oversight, the results can be disastrous.<\/span><\/p>\n<p><i><span style=\"font-weight: 400;\">Did you know Alejandro Saucedo, Engineering Director at Seldon and Chief Scientist at the Institute for Ethical AI &amp; Machine Learning, is speaking at the TNW Conference on June 16? Check out the full list of speakers <\/span><\/i><i><span style=\"font-weight: 400;\">here<\/span><\/i><i><span style=\"font-weight: 400;\">.<\/span><\/i>\n                        <\/div>\n<p><script async src=\"\/\/platform.twitter.com\/widgets.js\" charset=\"utf-8\"><\/script><\/p>\n<blockquote><p><strong><span style=\"color: #ff6600;\">If you liked the article, do not forget to share it with your friends. Follow us on\u00a0<span style=\"color: #ff0000;\"><a style=\"color: #ff0000;\" href=\"https:\/\/news.google.com\/publications\/CAAqBwgKMLG0nwswvr63Aw\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">Google News<\/a><\/span>\u00a0too, click on the star and choose us from your favorites.<\/span><\/strong><\/p><\/blockquote>\n<blockquote>\n<p style=\"text-align: center;\">For forums sites go to <span style=\"color: #ff9900;\"><a style=\"color: #ff9900;\" href=\"https:\/\/forum.buradabiliyorum.com\/\" target=\"_blank\" rel=\"noopener\">Forum.BuradaBiliyorum.Com<\/a><\/span><\/strong><\/p>\n<\/blockquote>\n<blockquote>\n<p style=\"text-align: center;\"><strong>If you want to read more like this article, you can visit our <span style=\"color: #ff9900;\"><a style=\"color: #ff9900;\" href=\"https:\/\/en.buradabiliyorum.com\/technology\/\" target=\"_blank\" rel=\"noopener\">Technology category.<\/a><\/span><\/strong><\/p>\n<\/blockquote>\n<p><span style=\"color: black;\"><a style=\"color: #ff9900;\" href=\"https:\/\/thenextweb.com\/news\/how-to-manage-ai-bias-alejandro-saucedo-interview\" target=\"_blank\" rel=\"noopener\">Source<\/a><\/span><\/p>\n","protected":false},"excerpt":{"rendered":"<p>&#8220;AI has a dangerous bias problem \u2014 here\u2019s how to manage it&#8221; AI now guides numerous life-changing decisions, from assessing loan applications to determining prison sentences. Proponents of the approach argue that it can eliminate human prejudices, but critics warn that algorithms can amplify our biases \u2014 without even revealing how they reached the decision&#8230;.<\/p>\n","protected":false},"author":1,"featured_media":455122,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"fifu_image_url":"https:\/\/img-cdn.tnwcdn.com\/image\/neural?filter_last=1&fit=1280,640&url=https:\/\/cdn0.tnwcdn.com\/wp-content\/blogs.dir\/1\/files\/2022\/05\/Untitled-design-1-4.jpg&signature=3e6836f5d4ad810748775618ef83f34a","fifu_image_alt":"","footnotes":""},"categories":[18],"tags":[],"class_list":["post-455121","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-technology"],"_links":{"self":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/posts\/455121","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/comments?post=455121"}],"version-history":[{"count":0,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/posts\/455121\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/media\/455122"}],"wp:attachment":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/media?parent=455121"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/categories?post=455121"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/tags?post=455121"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}