{"id":320439,"date":"2021-08-10T16:46:45","date_gmt":"2021-08-10T13:46:45","guid":{"rendered":"https:\/\/en.buradabiliyorum.com\/twitter-image-cropping-ai-marginalizes-elderly-disabled-and-arabic\/"},"modified":"2021-08-10T16:46:45","modified_gmt":"2021-08-10T13:46:45","slug":"twitter-image-cropping-ai-marginalizes-elderly-disabled-and-arabic","status":"publish","type":"post","link":"https:\/\/buradabiliyorum.com\/en\/twitter-image-cropping-ai-marginalizes-elderly-disabled-and-arabic\/","title":{"rendered":"#Twitter image-cropping AI marginalizes elderly, disabled, and Arabic"},"content":{"rendered":"<div id=\"ez-toc-container\" class=\"ez-toc-v2_0_84 counter-hierarchy ez-toc-counter ez-toc-custom ez-toc-container-direction\">\n<p class=\"ez-toc-title\" style=\"cursor:inherit\">Table of Contents<\/p>\n<label for=\"ez-toc-cssicon-toggle-item-6a25988357b5b\" class=\"ez-toc-cssicon-toggle-label\"><span class=\"\"><span class=\"eztoc-hide\" style=\"display:none;\">Toggle<\/span><span class=\"ez-toc-icon-toggle-span\"><svg style=\"fill: #dd3333;color:#dd3333\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" class=\"list-377408\" width=\"20px\" height=\"20px\" viewBox=\"0 0 24 24\" fill=\"none\"><path d=\"M6 6H4v2h2V6zm14 0H8v2h12V6zM4 11h2v2H4v-2zm16 0H8v2h12v-2zM4 16h2v2H4v-2zm16 0H8v2h12v-2z\" fill=\"currentColor\"><\/path><\/svg><svg style=\"fill: #dd3333;color:#dd3333\" class=\"arrow-unsorted-368013\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"10px\" height=\"10px\" viewBox=\"0 0 24 24\" version=\"1.2\" baseProfile=\"tiny\"><path d=\"M18.2 9.3l-6.2-6.3-6.2 6.3c-.2.2-.3.4-.3.7s.1.5.3.7c.2.2.4.3.7.3h11c.3 0 .5-.1.7-.3.2-.2.3-.5.3-.7s-.1-.5-.3-.7zM5.8 14.7l6.2 6.3 6.2-6.3c.2-.2.3-.5.3-.7s-.1-.5-.3-.7c-.2-.2-.4-.3-.7-.3h-11c-.3 0-.5.1-.7.3-.2.2-.3.5-.3.7s.1.5.3.7z\"\/><\/svg><\/span><\/span><\/label><input type=\"checkbox\"  id=\"ez-toc-cssicon-toggle-item-6a25988357b5b\" checked aria-label=\"Toggle\" \/><nav><ul class='ez-toc-list ez-toc-list-level-1 ' ><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-1\" href=\"https:\/\/buradabiliyorum.com\/en\/twitter-image-cropping-ai-marginalizes-elderly-disabled-and-arabic\/#Twitters_algorithmic_biases\" >Twitter\u2019s algorithmic biases<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-2\" href=\"https:\/\/buradabiliyorum.com\/en\/twitter-image-cropping-ai-marginalizes-elderly-disabled-and-arabic\/#Bounty_hunting_in_AI\" >Bounty hunting in AI<\/a><\/li><\/ul><\/nav><\/div>\n<p>&#8220;<strong>#<a href=\"https:\/\/buradabiliyorum.com\/en\/category\/social-mediaa\/\" data-internallinksmanager029f6b8e52c=\"1\" title=\"Social Media\" target=\"_blank\" rel=\"noopener\">Twitter<\/a> image-cropping AI marginalizes elderly, disabled, and Arabic<\/strong>&#8221;<br \/>\n<img decoding=\"async\" src=\"https:\/\/img-cdn.tnwcdn.com\/image?fit=796%2C417&amp;url=https%3A%2F%2Fcdn0.tnwcdn.com%2Fwp-content%2Fblogs.dir%2F1%2Ffiles%2F2021%2F08%2FUntitled-design-2-3.jpg&amp;signature=3a1dd810db3d0269b5b8c28cb7410bba\" \/><\/p>\n<div>\n<p class=\"p1\"><span class=\"s1\">A Twitter algorithm that favored light-skinned faces has now been shown to perpetuate a range of further biases.<\/span><\/p>\n<p class=\"p1\"><span class=\"s1\">The algorithm estimated whom a person would want to see first in a picture so the image could be cropped to a suitable size on Twitter. But it was ditched after users found it chose white faces over Black ones.<\/span><\/p>\n<blockquote class=\"twitter-tweet\" data-width=\"500\" data-dnt=\"true\">\n<p lang=\"en\" dir=\"ltr\">Trying a horrible experiment\u2026<\/p>\n<p>Which will the Twitter algorithm pick: Mitch McConnell or Barack Obama? <a rel=\"nofollow noopener\" target=\"_blank\" href=\"https:\/\/t.co\/bR1GRyCkia\">pic.twitter.com\/bR1GRyCkia<\/a><\/p>\n<p>\u2014 Tony \u201cAbolish ICE\u201d Arcieri \ud83e\udd80 (@bascule) <a rel=\"nofollow noopener\" target=\"_blank\" href=\"https:\/\/twitter.com\/bascule\/status\/1307440596668182528?ref_src=twsrc%5Etfw\">September 19, 2020<\/a><\/p>\n<\/blockquote>\n<p class=\"p1\"><span class=\"s1\">Twitter sought to identify further potential harms in the model by launching\u00a0the industry\u2019s first algorithmic bias bounty content.\u00a0<\/span><\/p>\n<p class=\"p1\"><span class=\"s1\">The competition winners, who were announced on Monday, discovered a plethora of further issues.<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"Twitters_algorithmic_biases\"><\/span>Twitter\u2019s algorithmic biases<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p>Bogdan Kulynych, who bagged the $3,500 first-place prize, showed that the algorithm can amplify real-world biases and social expectations of beauty.<\/p>\n<p>Kulynych, a grad student at Switzerland\u2019s EPFL technical university, investigated how the algorithm predicts which region of an image people will look at.<\/p>\n<p>The researcher used a\u00a0<span>computer-vision model to generate realistic pictures of people with different physical features. He then compared which of the images the model preferred.<\/span><\/p>\n<p>Kulynych <a rel=\"nofollow noopener\" target=\"_blank\" href=\"https:\/\/github.com\/bogdan-kulynych\/saliency_bias\">said the model<\/a>\u00a0<span>favored \u201cpeople that <a href=\"https:\/\/buradabiliyorum.com\/en\/category\/download-scripts-themes-apps\/\" data-internallinksmanager029f6b8e52c=\"9\" title=\"Download Scripts &amp; Themes &amp; Apps\" target=\"_blank\" rel=\"noopener\">app<\/a>ear slim, young, of light or warm skin color and smooth skin texture, and with stereotypically feminine facial traits:\u201d<\/span><\/p>\n<blockquote>\n<p>These internal biases inherently translate into harms of under-representation when the algorithm is applied in the wild, cropping out those who do not meet the algorithm\u2019s preferences of body weight, age, skin color. This bias could result in exclusion of minoritized populations and perpetuation of stereotypical beauty standards in thousands of images.<\/p>\n<\/blockquote>\n<p>The other competition entrants exposed further potential harms.<\/p>\n<p><span>The runners-up, HALT AI, found the algorithm sometimes crops out <a rel=\"nofollow noopener\" target=\"_blank\" href=\"https:\/\/github.com\/erickmu1\/Twitter-Algorithmic-Bias\">people with grey hair, dark skin, or using wheelchairs<\/a>, while third-place winner, Roya Pakzad, showed\u00a0the model <a rel=\"nofollow noopener\" target=\"_blank\" href=\"https:\/\/github.com\/royapakzad\/image-crop-analysis\">favors Latin scripts over Arabic<\/a>.\u00a0<\/span><\/p>\n<p>The algorithm also has a racial preference when analyzing emoji.\u00a0Vincenzo di Cicco, a software engineer, found that <a rel=\"nofollow noopener\" target=\"_blank\" href=\"https:\/\/github.com\/0xNaN\/twitter-crop-bias\">emoji with lighter skin tones<\/a> are more likely to be captured.<\/p>\n<h2><span class=\"ez-toc-section\" id=\"Bounty_hunting_in_AI\"><\/span>Bounty hunting in AI<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p class=\"p1\"><span class=\"s1\">The array of potential algorithmic harms is concerning, but Twitter\u2019s approach to identifying them deserves credit.<\/span><\/p>\n<p class=\"p1\"><span class=\"s1\">There\u2019s a community of AI researchers that can help mitigate algorithmic biases, but they\u2019re rarely incentivized in the same way as whitehat security hackers.<\/span><\/p>\n<p class=\"p1\"><span class=\"s1\">\u201cIn fact, people have been doing this sort of work on their own for years, but haven\u2019t been rewarded or paid for it,\u201d\u00a0Twitter\u2019s\u00a0<span>Rumman Chowdhury told TNW before the contest.<\/span><\/span><span class=\"s1\"\/><\/p>\n<p class=\"p1\"><span class=\"s1\">The bounty hunting model could encourage more of them to investigate AI harms. It can also operate more quickly than traditional academic publishing. Contest winner Kulynych <a rel=\"nofollow noopener\" target=\"_blank\" href=\"https:\/\/twitter.com\/hiddenmarkov\/status\/1424825810641428483\">noted<\/a> that this fast pace has both flaws and strengths:<\/span><\/p>\n<blockquote>\n<p class=\"p1\"><span class=\"s1\">Unlike academic publishing, here I think there was not enough time for rigor. In particular, my submission came with plenty of limitations that future analyses using the methodology should account for. But I think that\u2019s a good thing. <\/span><\/p>\n<p class=\"p1\"><span class=\"s1\">Even if some submissions only hinted at the possibility of the harm without rigorous proofs, the \u2018bug bounty\u2019 approach would enable to detect the harms early. If this evolves in the same way as security bug bounties, this would be a much better situation for everyone. The harmful software would not sit there for years until the rigorous proofs of harm are collected.<\/span><\/p>\n<\/blockquote>\n<p class=\"p1\"><span class=\"s1\">He added that there are also limitations in the approach. Notably, algorithmic harms are often a result of design rather than mistakes. An algorithm that spreads clickbait to maximize engagement, for instance, won\u2019t necessarily have a \u201cbug\u201d that a company wants to fix.<\/span><\/p>\n<p class=\"p1\"><span class=\"s1\">\u201cWe should resist the urge of sweeping all societal and ethical concerns about algorithms into the category of bias, which is a narrow framing even if we talk about discriminatory effects,\u201d Kulynych tweeted.<\/span><\/p>\n<p class=\"p1\"><span class=\"s1\">Nonetheless, the contest showcased a promising method of mitigating algorithmic harms. It also invites a wider range of perspectives than one company can incorporate (or will want) to investigate the issues.\u00a0<\/span><\/p>\n<p class=\"p1\"><em>Greetings Humanoids! Did you know we have a <a href=\"https:\/\/buradabiliyorum.com\/en\/category\/news\/\" data-internallinksmanager029f6b8e52c=\"2\" title=\"News\" target=\"_blank\" rel=\"noopener\">news<\/a>letter all about AI? You can subscribe to it\u00a0<a rel=\"nofollow noopener\" target=\"_blank\" href=\"https:\/\/share.hsforms.com\/1kUPK28s-Ro67GKE8E65Zwg47gef\">right here<\/a>.<\/em><\/p>\n<\/div>\n<p><script async src=\"\/\/platform.twitter.com\/widgets.js\" charset=\"utf-8\"><\/script><\/p>\n<blockquote><p><strong><span style=\"color: #ff6600;\">If you liked the article, do not forget to share it with your friends. Follow us on\u00a0<span style=\"color: #ff0000;\"><a style=\"color: #ff0000;\" href=\"https:\/\/news.google.com\/publications\/CAAqBwgKMLG0nwswvr63Aw\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">Google News<\/a><\/span>\u00a0too, click on the star and choose us from your favorites.<\/span><\/strong><\/p><\/blockquote>\n<blockquote>\n<p style=\"text-align: center;\">For forums sites go to <span style=\"color: #ff9900;\"><a style=\"color: #ff9900;\" href=\"https:\/\/forum.buradabiliyorum.com\/\" target=\"_blank\" rel=\"noopener\">Forum.BuradaBiliyorum.Com<\/a><\/span><\/strong>\n<\/p><\/blockquote>\n<blockquote>\n<p style=\"text-align: center;\"><strong>If you want to read more like this article, you can visit our <span style=\"color: #ff9900;\"><a style=\"color: #ff9900;\" href=\"https:\/\/en.buradabiliyorum.com\/technology\/\" target=\"_blank\" rel=\"noopener\">Technology category.<\/a><\/span><\/strong><\/p>\n<\/blockquote>\n<p><span style=\"color: black;\"><a style=\"color: #ff9900;\" href=\"https:\/\/thenextweb.com\/news\/twitter-photo-cropping-algorithm-biased-against-elderly-disabled-arabic\" target=\"_blank\" rel=\"noopener\">Source<\/a><\/span><\/p>\n","protected":false},"excerpt":{"rendered":"<p>&#8220;#Twitter image-cropping AI marginalizes elderly, disabled, and Arabic&#8221; A Twitter algorithm that favored light-skinned faces has now been shown to perpetuate a range of further biases. The algorithm estimated whom a person would want to see first in a picture so the image could be cropped to a suitable size on Twitter. But it was&#8230;<\/p>\n","protected":false},"author":1,"featured_media":320440,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"fifu_image_url":"https:\/\/img-cdn.tnwcdn.com\/image\/neural?filter_last=1&fit=1280,640&url=https:\/\/cdn0.tnwcdn.com\/wp-content\/blogs.dir\/1\/files\/2021\/08\/Untitled-design-2-3.jpg&signature=8048eede31dcfafb1feacd07281187ea","fifu_image_alt":"","footnotes":""},"categories":[18],"tags":[],"class_list":["post-320439","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-technology"],"_links":{"self":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/posts\/320439","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/comments?post=320439"}],"version-history":[{"count":0,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/posts\/320439\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/media\/320440"}],"wp:attachment":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/media?parent=320439"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/categories?post=320439"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/tags?post=320439"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}