{"id":248943,"date":"2021-05-13T19:30:31","date_gmt":"2021-05-13T16:30:31","guid":{"rendered":"https:\/\/en.buradabiliyorum.com\/how-ai-could-steal-your-data-by-lip-reading-your-keystrokes\/"},"modified":"2021-05-13T19:30:31","modified_gmt":"2021-05-13T16:30:31","slug":"how-ai-could-steal-your-data-by-lip-reading-your-keystrokes","status":"publish","type":"post","link":"https:\/\/buradabiliyorum.com\/en\/how-ai-could-steal-your-data-by-lip-reading-your-keystrokes\/","title":{"rendered":"#How AI could steal your data by \u2018lip-reading\u2019 your keystrokes"},"content":{"rendered":"

“#How AI could steal your data by \u2018lip-reading\u2019 your keystrokes<\/strong>”
\n<\/p>\n

Facial recognition isn\u2019t the only scary thing bad actors and governments can use computer recognition for. What if an AI could watch a video of us tapp<\/a>ing on our touchscreen phones and infer exactly what app we\u2019re using and what we\u2019re typing?<\/p>\n

Modern computer vision techniques have the ability to imbue us with the kind of technological super powers typically only seen in the movies<\/a>. We can load video into an AI system and tell it to zoom in on a low-resolution frame and, with a little training and some clever algorithms, we can make it \u201cenhance\u201d the image. It\u2019s like magic, only far more accessible.<\/p>\n

That might not sound very nefarious, but the same technology<\/a> Tesla uses in its driver-assistance features could be adapted for myriad purposes. We use computer vision for everything from cancer detection to counting large numbers of objects in a photograph.<\/p>\n

There\u2019s nothing stopping a clever developer from training an AI system to infer text from keystrokes or finger movement. And that\u2019s pretty scary, we\u2019ll explain why in a moment.<\/p>\n

[<\/i>Read<\/i><\/span>\u00a0<\/i>more<\/i><\/span>:\u00a0<\/i>This dude drove an EV from the Netherlands to New Zealand \u2014 here are his 3 top road trip<\/a> tips<\/i>]<\/i><\/p>\n

First, it\u2019s worth mentioning that computer vision has come a long way since 2017 when Google\u2019s AI still made simply mistakes such as confusing a turtle with a rifle<\/a>.<\/p>\n

Today\u2019s CV systems can make incredibly robust inferences with very small amounts of data. For example, researchers have demonstrated the ability for computers to authenticate users with nothing but AI-based typing biometrics<\/a> and psychologists have developed automated stress detection systems<\/a> using keystroke analysis.<\/p>\n

Researchers are even training AI to mimic human typing<\/a> so we can develop better tools to help us with spelling, grammar, and other communication techniques. The long and short of it is, we\u2019re teaching AI systems to make inferences from our finger movements that most humans couldn\u2019t.<\/p>\n

It\u2019s not much of a stretch to imagine the existence of a system capable of analyzing finger movement and interpreting it as text in much the same way\u00a0lip-readers convert mouth movement into words.<\/p>\n

We haven\u2019t seen an AI product like this yet, but that doesn\u2019t mean it\u2019s not already out there.<\/p>\n

So what\u2019s the worst that could happen?<\/p>\n

Not too long ago, before the internet was ubiquitous, \u201cshoulder surfing<\/a>\u201d was among the biggest threats faced by people for whom computer security is a big deal. Basically, the easiest way to steal someone\u2019s password is to watch them type it.<\/p>\n

That\u2019s why most password entry screens hide the password as you\u2019re typing it \u2013 you never know who can see your screen.<\/p>\n

Most humans don\u2019t have the ability to determine exactly which keys you\u2019re pressing or what numbers you\u2019re tapping on the screen. Our fingers move surprisingly fast when we know what we\u2019re doing and we\u2019ve got pretty good hand-eye coordination.<\/p>\n

But AI can be trained on these tiny movements. And almost anything is possible in the world of AI with enough data.<\/p>\n

This means, theoretically speaking, it should be relatively simple for a developer with enough resources to train up a model that could either run on an AI chip (such as those on many flagship smart phones) or connect to a cloud-based tech.<\/p>\n

In the case of the former, it would give just about anyone in the world the ability to \u201csee\u201d what other people are tapping and typing on their phones and keyboards.<\/p>\n

Hypothetically speaking, this would enable bad actors to steal passwords, ATM PINs, and entire documents (assuming you typed them in view of a camera).<\/p>\n

And, if we look at the latter idea, where we have a cloud-based infrastructure connected, we have to assume big tech and the government are involved. The idea of, say, Google or the NYPD gaining the ability to turn any camera into a keystroke detector seems horrific.<\/p>\n

Greetings Humanoids! Did you know we have a news<\/a>letter all about AI? You can subscribe to it\u00a0<\/span>right here<\/a>.<\/em><\/p>\n<\/div>\n

If you liked the article, do not forget to share it with your friends. Follow us on\u00a0Google News<\/a><\/span>\u00a0too, click on the star and choose us from your favorites.<\/span><\/strong><\/p><\/blockquote>\n

\n

For forums sites go to Forum.BuradaBiliyorum.Com<\/a><\/span><\/strong>\n<\/p><\/blockquote>\n

\n

If you want to read more like this article, you can visit our Technology category.<\/a><\/span><\/strong><\/p>\n<\/blockquote>\n

Source<\/a><\/span><\/p>\n","protected":false},"excerpt":{"rendered":"

“#How AI could steal your data by \u2018lip-reading\u2019 your keystrokes” Facial recognition isn\u2019t the only scary thing bad actors and governments can use computer recognition for. What if an AI could watch a video of us tapping on our touchscreen phones and infer exactly what app we\u2019re using and what we\u2019re typing? Modern computer vision…<\/p>\n","protected":false},"author":1,"featured_media":248944,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"fifu_image_url":"https:\/\/img-cdn.tnwcdn.com\/image\/neural?filter_last=1&fit=1280,640&url=https:\/\/cdn0.tnwcdn.com\/wp-content\/blogs.dir\/1\/files\/2020\/06\/surveillence-eyes-remote-gq.png&signature=7fb0a169a253c76d7b768189bd71508b","fifu_image_alt":"","footnotes":""},"categories":[18],"tags":[],"class_list":["post-248943","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-technology"],"_links":{"self":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/posts\/248943","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/comments?post=248943"}],"version-history":[{"count":0,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/posts\/248943\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/media\/248944"}],"wp:attachment":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/media?parent=248943"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/categories?post=248943"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/tags?post=248943"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}