{"id":342389,"date":"2021-09-21T23:19:34","date_gmt":"2021-09-21T20:19:34","guid":{"rendered":"https:\/\/en.buradabiliyorum.com\/amazons-ai-is-forcing-delivery-drivers-to-make-dangerous-decisions\/"},"modified":"2021-09-21T23:19:34","modified_gmt":"2021-09-21T20:19:34","slug":"amazons-ai-is-forcing-delivery-drivers-to-make-dangerous-decisions","status":"publish","type":"post","link":"https:\/\/buradabiliyorum.com\/en\/amazons-ai-is-forcing-delivery-drivers-to-make-dangerous-decisions\/","title":{"rendered":"#Amazon\u2019s AI is forcing delivery drivers to make dangerous decisions"},"content":{"rendered":"<p>&#8220;<strong>#Amazon\u2019s AI is forcing delivery drivers to make dangerous decisions<\/strong>&#8221;<br \/>\n<img decoding=\"async\" src=\"https:\/\/img-cdn.tnwcdn.com\/image?fit=796%2C417&amp;url=https%3A%2F%2Fcdn0.tnwcdn.com%2Fwp-content%2Fblogs.dir%2F1%2Ffiles%2F2021%2F09%2Fbezosgold.jpg&amp;signature=2388efb2368f3d8159d360baa8350775\" \/><\/p>\n<div>Amazon delivery drivers were involved in <a rel=\"nofollow noopener\" target=\"_blank\" href=\"https:\/\/www.buzzfeednews.com\/article\/kenbensinger\/amazons-race-to-build-a-fast-delivery-network-the-human\">at least 60 accidents resulting in 13 deaths<\/a> between 2015 and 2019. And that was before drivers were being forced to make dangerous decisions by in-vehicle AI cameras and cr<a href=\"https:\/\/buradabiliyorum.com\/en\/category\/download-scripts-themes-apps\/\" data-internallinksmanager029f6b8e52c=\"9\" title=\"Download Scripts &amp; Themes &amp; Apps\" target=\"_blank\" rel=\"noopener\">app<\/a>y algorithms.<\/p>\n<p><strong>Up front:<\/strong> Motherboard ran <a rel=\"nofollow noopener\" target=\"_blank\" href=\"https:\/\/www.vice.com\/en\/article\/88npjv\/amazons-ai-cameras-are-punishing-drivers-for-mistakes-they-didnt-make\">a horrific article<\/a> (great reporting, horrifying topic) about Amazon\u2018s third-party driver surveillance system.<\/p>\n<p><iframe loading=\"lazy\" src=\"https:\/\/fast.wistia.net\/embed\/iframe\/l8c5ayh3on?videoFoam=true\" title=\"Whats it like to be a startup founder in Barcelona? Video\" allowtransparency=\"true\" frameborder=\"0\" scrolling=\"no\" class=\"wistia_embed\" name=\"wistia_embed\" allowfullscreen=\"\" msallowfullscreen=\"\" width=\"100%\" height=\"100%\"><\/iframe><\/p>\n<p>The skinny is that thousands of drivers across the US are being monitored by AI systems that actively watch drivers and their surroundings for \u201cevents\u201d that trigger negative feedback for the driver.<\/p>\n<p>I\u2019m being careful with how I word this because Amazon wants journalists like me to say that these systems are designed to make deliveries safer.<\/p>\n<p>But Amazon\u2018s clearly instituted these systems to cut liability and pay delivery service partners (DSPs) less. And there doesn\u2019t appear to be any evidence that such systems make deliveries safer.<\/p>\n<p>It actually looks as though they\u2019re distracting drivers and causing them to make erratic, dangerous decisions.<\/p>\n<p><strong>Background:<\/strong><a rel=\"nofollow noopener\" target=\"_blank\" href=\"https:\/\/www.cnet.com\/news\/ai-is-very-stupid-says-google-ai-leader-compared-to-humans\/\">AI is really, really stupid<\/a>. I cannot express how wrong the <a href=\"https:\/\/buradabiliyorum.com\/en\/category\/general\/\" data-internallinksmanager029f6b8e52c=\"3\" title=\"General\" target=\"_blank\" rel=\"noopener\">general<\/a> public is about what \u201cthey can do with AI these days.\u201d<\/p>\n<p>But that\u2019s not stopping Amazon from misleading people and its partners about the systems\u2019 capability.<\/p>\n<p>Per the aforementioned Motherboard article:<\/p>\n<blockquote><p>\u201cThe Netradyne cameras that Amazon installed in our vans have been nothing but a nightmare,\u201d a former Amazon delivery driver in Mobile, Alabama told Motherboard. \u201cThey watch every move we make. I have been \u2018dinged\u2019 for following too close when someone cuts me off. If I look into my mirrors to make sure I am safe to change lanes, it dings me for distraction because my face is turned to look into my mirror. I personally did not feel any more safe with a camera watching my every move.\u201d<\/p>\n<\/blockquote>\n<p>It\u2019s easy to get lost in the individual morality surrounding this issue, but the big picture effects us all. After all, there are no long term studies on the effects of constant surveillance on drivers. Even if we imagine a world where AI doesn\u2019t make mistakes, there are considerations beyond just <em>driving safely<\/em> to care about.<\/p>\n<p>What effects will these systems have on driver stress levels? Numerous employees interviewed by Motherboard expressed anxiety over the constant \u201cdinging\u201d from the system.<\/p>\n<p>And this system is far from perfect. Drivers report being dinged for glancing at their side mirrors \u2013 something that\u2019s necessary for safe driving. This means drivers have to make a choice between driving safely and earning their full paychecks and bonuses. That\u2019s a tough position to put people in.<\/p>\n<p>And the safety benefits Amazon touts? There\u2019s no evidence that this system makes drivers safer.<\/p>\n<p>Here\u2019s more from the Motherboard piece:<\/p>\n<blockquote>\n<p>Since Amazon installed Netradyne cameras in its vans \u2026 [an Amazon spokesperson] claims that accidents had decreased by 48 percent and stop sign and signal violations had decreased 77 percent. Driving without a seatbelt decreased 60 percent, following distance decreased 50 percent, and distracted driving had decreased 75 percent.<\/p>\n<\/blockquote>\n<p>Those statistics sound like facts, but they don\u2019t make a lot of sense. How can they tell exactly what percent of drivers weren\u2019t wearing their seatbelts properly before monitoring systems were installed? How does Amazon know how closely drivers were following other vehicles before external cameras and sensors were installed?<\/p>\n<p>And those aren\u2019t the only questions we should be asking. Because Amazon has no clue what\u2019s going to happen over the long term as more and more people are driving while distracted by faulty AI.<\/p>\n<p>However, I will concede one thing to Amazon\u2018s apparently made-up statistics. That is, I actually believe seatbelt violations have dropped significantly for drivers since the inception of AI monitoring. That\u2019s because drivers were incentivized against wearing their seatbelts before they were being surveilled. Now they have to choose between getting dinged, which will cost them money, or not meeting quotas, which will also cost them money.<\/p>\n<p>Per the Motherboard article:<\/p>\n<blockquote>\n<p>Drivers say that with their steep delivery quotas and the fact that they are often getting in and out of the truck, buckling and unbuckling their seatbelt dozens of times in a single neighborhood can slow down the delivery process significantly.<\/p>\n<\/blockquote>\n<p>But there are even bigger areas of concern. The system flags \u201cevents,\u201d many of which drivers don\u2019t know about, and sends them to humans for evaluation. Supposedly, every event is checked by a person.<\/p>\n<p>That may sound fair, but it\u2019s far from it.<\/p>\n<p><strong>Deeper:<\/strong> Let\u2019s set aside for a moment that the people doing the checking are incentivized to meet quotas as well and certainly have their own biases.<\/p>\n<p>Logic dictates that if one group of people generate more events than another group of people, it should be demonstrable that the first group engaged in less safe behaviors than the second. But that\u2019s not how AI works. AI is biased just like humans are.<\/p>\n<p>When an AI is purported to detect \u201cdrowsiness\u201d or \u201cdistracted driving,\u201d for example, we\u2019re getting a computer\u2019s interpretation of a human experience.<\/p>\n<p>We know for a fact that AI struggles with non-white faces. So it\u2019s almost guaranteed the systems Amazon\u2018s DSPs are using to monitor drivers score differently when evaluating minority groups against white male faces.<\/p>\n<p>This means you could get \u201cdinged\u201d for looking drowsy just because you\u2019re Black or if your face doesn\u2019t look typical enough for the AI. It means white men are likely to generate less dings than other drivers.<\/p>\n<p>And, no matter what you look like, it means you can lose money for being cut off in traffic, checking your side mirrors, or anything else an algorithm can get wrong.<\/p>\n<p><strong>Quick take:<\/strong> Forget the moral issues of surveillance. Let\u2019s just look at this pragmatically. Amazon considers its AI labs among the world\u2019s most advanced. It sold facial recognition systems to thousands of law enforcement agencies. It doesn\u2019t need to outsource this kind of stuff.<\/p>\n<p>But it does. Not because Netradyne makes better cameras or better AI than Amazon could, but because Amazon doesn\u2019t want liability for any of it. It\u2019s someone else\u2019s gear, someone else\u2019s problem, and all Amazon requires is that its metrics are followed and its quotas are met.<\/p>\n<p>Amazon is conducting large scale psychological experiments on the general public using AI, but it isn\u2019t even doing so in the name of <a href=\"https:\/\/buradabiliyorum.com\/en\/category\/sciencee\/\" data-internallinksmanager029f6b8e52c=\"5\" title=\"Science\" target=\"_blank\" rel=\"noopener\">science<\/a>. It\u2019s just trying to squeeze a few more pennies out of every delivery.<\/p>\n<p>We don\u2019t know what the effects of having a machine telling thousands upon thousands of drivers to conduct themselves unsafely on public roadways every day will be.<\/p>\n<p>Amazon believes it\u2019ll make them more efficient. But so would methamphetamines and monster trucks. There has to be a line somewhere and using algorithms to coerce people into unsafe decisions seems like a good place for it.<\/p>\n<p>Netradyne and Amazon aren\u2019t necessarily making the roads safer or making life easier for their drivers. They\u2019re optimizing arbitrary metrics that, ultimately, only measure one thing: im<a href=\"https:\/\/buradabiliyorum.com\/en\/category\/social-mediaa\/\" data-internallinksmanager029f6b8e52c=\"1\" title=\"Social Media\" target=\"_blank\" rel=\"noopener\">media<\/a>te company growth no matter the cost in human lives and livelihoods.<\/p>\n<p>Amazon\u2018s willing and able to conduct these experiments because it views employee well-being through the same financial lens US regulators view public safety.<\/p>\n<\/div>\n<blockquote><p><strong><span style=\"color: #ff6600;\">If you liked the article, do not forget to share it with your friends. Follow us on\u00a0<span style=\"color: #ff0000;\"><a style=\"color: #ff0000;\" href=\"https:\/\/news.google.com\/publications\/CAAqBwgKMLG0nwswvr63Aw\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">Google News<\/a><\/span>\u00a0too, click on the star and choose us from your favorites.<\/span><\/strong><\/p><\/blockquote>\n<blockquote>\n<p style=\"text-align: center;\">For forums sites go to <span style=\"color: #ff9900;\"><a style=\"color: #ff9900;\" href=\"https:\/\/forum.buradabiliyorum.com\/\" target=\"_blank\" rel=\"noopener\">Forum.BuradaBiliyorum.Com<\/a><\/span><\/strong>\n<\/p><\/blockquote>\n<blockquote>\n<p style=\"text-align: center;\"><strong>If you want to read more like this article, you can visit our <span style=\"color: #ff9900;\"><a style=\"color: #ff9900;\" href=\"https:\/\/en.buradabiliyorum.com\/technology\/\" target=\"_blank\" rel=\"noopener\">Technology category.<\/a><\/span><\/strong><\/p>\n<\/blockquote>\n<p><span style=\"color: black;\"><a style=\"color: #ff9900;\" href=\"https:\/\/thenextweb.com\/news\/amazon-ai-forcing-drivers-make-dangerous-decisions\" target=\"_blank\" rel=\"noopener\">Source<\/a><\/span><\/p>\n","protected":false},"excerpt":{"rendered":"<p>&#8220;#Amazon\u2019s AI is forcing delivery drivers to make dangerous decisions&#8221; Amazon delivery drivers were involved in at least 60 accidents resulting in 13 deaths between 2015 and 2019. And that was before drivers were being forced to make dangerous decisions by in-vehicle AI cameras and crappy algorithms. Up front: Motherboard ran a horrific article (great&#8230;<\/p>\n","protected":false},"author":1,"featured_media":342390,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"fifu_image_url":"https:\/\/img-cdn.tnwcdn.com\/image\/neural?filter_last=1&fit=1280,640&url=https:\/\/cdn0.tnwcdn.com\/wp-content\/blogs.dir\/1\/files\/2021\/09\/bezosgold.jpg&signature=404f5f3f8f26b0d5a8a9280fa1b74f9a","fifu_image_alt":"","footnotes":""},"categories":[18],"tags":[],"class_list":["post-342389","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-technology"],"_links":{"self":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/posts\/342389","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/comments?post=342389"}],"version-history":[{"count":0,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/posts\/342389\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/media\/342390"}],"wp:attachment":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/media?parent=342389"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/categories?post=342389"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/tags?post=342389"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}