{"id":385241,"date":"2021-12-23T17:48:17","date_gmt":"2021-12-23T14:48:17","guid":{"rendered":"https:\/\/en.buradabiliyorum.com\/ai-tool-detects-deepfakes-by-analyzing-light-reflections-in-the-eyes\/"},"modified":"2021-12-23T17:48:17","modified_gmt":"2021-12-23T14:48:17","slug":"ai-tool-detects-deepfakes-by-analyzing-light-reflections-in-the-eyes","status":"publish","type":"post","link":"https:\/\/buradabiliyorum.com\/en\/ai-tool-detects-deepfakes-by-analyzing-light-reflections-in-the-eyes\/","title":{"rendered":"#AI tool detects Deepfakes by analyzing light reflections in the eyes"},"content":{"rendered":"<p>&#8220;<strong>#AI tool detects Deepfakes by analyzing light reflections in the eyes<\/strong>&#8221;<\/p>\n<div>Deepfakes are being used for a range of nefarious purposes, from disinformation campaigns to inserting people into porn, and the doctored images <a rel=\"nofollow noopener\" target=\"_blank\" href=\"https:\/\/www.theguardian.com\/technology\/2021\/mar\/05\/how-started-tom-cruise-deepfake-tiktok-videos\">are getting harder to detect<\/a>.<\/p>\n<p>A new AI tool provides a surprisingly simple way of spotting them: looking at the light reflected in the eyes.<\/p>\n<p>The system was created by computer scientists from the University at Buffalo. In tests on portrait-style photos, the tool was 94% effective at detecting Deepfake images.<\/p>\n<p><em>[Read:\u00a0How do you build a\u00a0<span class=\"c-search__match\">pet<\/span>-friendly gadget? We asked experts and animal owners]<\/em><\/p>\n<p>The system exposes the fakes by analyzing the corneas, which have a mirror-like surface that generates reflective patterns when illuminated by light.<\/p>\n<p>In a photo of a real face taken by a camera, the reflection on the two eyes will be similar because they\u2019re\u00a0seeing the same thing. But Deepfake images synthesized by GANs typically\u00a0fail to accurately capture this resemblance.<\/p>\n<p>Instead, they often exhibit inconsistencies, such as different geometric shapes or mismatched locations of the reflections.<\/p>\n<figure class=\"post-image post-mediaBleed aligncenter\"><img decoding=\"async\" loading=\"lazy\" class=\"size-full wp-image-1342419 js-lazy\" alt=\"The corneal regions have much clearer differences in the deepfake image (right), likely because they're generated by combining many photos. \" width=\"982\" height=\"634\" sizes=\"auto, (max-width: 982px) 100vw, 982px\" src=\"https:\/\/cdn0.tnwcdn.com\/wp-content\/blogs.dir\/1\/files\/2021\/03\/Screenshot-2021-03-11-at-16.15.55.png\" srcset=\"https:\/\/cdn0.tnwcdn.com\/wp-content\/blogs.dir\/1\/files\/2021\/03\/Screenshot-2021-03-11-at-16.15.55.png 982w, https:\/\/cdn0.tnwcdn.com\/wp-content\/blogs.dir\/1\/files\/2021\/03\/Screenshot-2021-03-11-at-16.15.55-280x181.png 280w, https:\/\/cdn0.tnwcdn.com\/wp-content\/blogs.dir\/1\/files\/2021\/03\/Screenshot-2021-03-11-at-16.15.55-418x270.png 418w, https:\/\/cdn0.tnwcdn.com\/wp-content\/blogs.dir\/1\/files\/2021\/03\/Screenshot-2021-03-11-at-16.15.55-209x135.png 209w, https:\/\/cdn0.tnwcdn.com\/wp-content\/blogs.dir\/1\/files\/2021\/03\/Screenshot-2021-03-11-at-16.15.55-796x514.png 796w\"\/><figcaption>Credit: Lyu et. al<\/figcaption><figcaption><a rel=\"nofollow noopener\" target=\"_blank\" href=\"#\" data-url=\"https:\/\/twitter.com\/intent\/tweet?url=https%3A%2F%2Feditorial.thenextweb.com%2Fneural%2F2021%2F12%2F23%2Fai-detects-deepfakes-analyzing-light-reflections-in-the-cornea-eyes-gans-thispersondoesnotexist%2F&amp;via=thenextweb&amp;related=thenextweb&amp;text=Check out this picture on: The corneas have much bigger differences in the Deepfake image (right), likely because they\u2019re generated by combining many photos.\" data-title=\"Share The corneas have much bigger differences in the Deepfake image (right), likely because they\u2019re generated by combining many photos. on Twitter\" data-width=\"685\" data-height=\"500\" class=\"post-image-share popitup\" title=\"Share The corneas have much bigger differences in the Deepfake image (right), likely because they\u2019re generated by combining many photos. on Twitter\"><i class=\"icon icon--inline icon--twitter--dark\"\/><\/a>The corneas have much bigger differences in the Deepfake image (right), likely because they\u2019re generated by combining many photos.<\/figcaption><noscript><img decoding=\"async\" loading=\"lazy\" class=\"size-full wp-image-1342419\" src=\"https:\/\/cdn0.tnwcdn.com\/wp-content\/blogs.dir\/1\/files\/2021\/03\/Screenshot-2021-03-11-at-16.15.55.png\" alt=\"The corneal regions have much clearer differences in the deepfake image (right), likely because they're generated by combining many photos. \" width=\"982\" height=\"634\" srcset=\"https:\/\/cdn0.tnwcdn.com\/wp-content\/blogs.dir\/1\/files\/2021\/03\/Screenshot-2021-03-11-at-16.15.55.png 982w, https:\/\/cdn0.tnwcdn.com\/wp-content\/blogs.dir\/1\/files\/2021\/03\/Screenshot-2021-03-11-at-16.15.55-280x181.png 280w, https:\/\/cdn0.tnwcdn.com\/wp-content\/blogs.dir\/1\/files\/2021\/03\/Screenshot-2021-03-11-at-16.15.55-418x270.png 418w, https:\/\/cdn0.tnwcdn.com\/wp-content\/blogs.dir\/1\/files\/2021\/03\/Screenshot-2021-03-11-at-16.15.55-209x135.png 209w, https:\/\/cdn0.tnwcdn.com\/wp-content\/blogs.dir\/1\/files\/2021\/03\/Screenshot-2021-03-11-at-16.15.55-796x514.png 796w\"\/><\/noscript><\/figure>\n<p>The AI system searches for these discrepancies by m<a href=\"https:\/\/buradabiliyorum.com\/en\/category\/download-scripts-themes-apps\/\" data-internallinksmanager029f6b8e52c=\"9\" title=\"Download Scripts &amp; Themes &amp; Apps\" target=\"_blank\" rel=\"noopener\">app<\/a>ing out a face and analyzing the light reflected in each eyeball.<\/p>\n<p>It generates a score that serves as a similarity metric. The smaller the score, the more likely the face is a Deepfake.<\/p>\n<p>The system proved highly effective at detecting Deepfakes taken from\u00a0This Person Does Not Exist, a repository of images\u00a0created with the <a rel=\"nofollow noopener\" target=\"_blank\" href=\"https:\/\/github.com\/NVlabs\/stylegan2\">StyleGAN2<\/a> architecture. However,\u00a0the study authors acknowledge that it has several limitations.<\/p>\n<p>The tool\u2019s most obvious shortcoming is that it relies on a reflected source of light in both eyes. The inconsistencies in these patterns can be fixed with manual post-processing, and if one eye isn\u2019t visible in the image, the method won\u2019t work.<\/p>\n<p>It\u2019s also only proven effective on portrait images. If the face in the picture isn\u2019t looking at the camera, the system would likely produce false positives.<\/p>\n<p>The researchers plan to investigate these issues to improve the effectiveness of their method. In its current form, it\u2019s not going to detect the most sophisticated Deepfakes, but it could still spot many of the cruder ones.<\/p>\n<p>You can read the study paper <a rel=\"nofollow noopener\" target=\"_blank\" href=\"https:\/\/arxiv.org\/pdf\/2009.11924.pdf\">here<\/a> on the arXiv pre-print server.<\/p>\n<p><em>Greetings Humanoids! Did you know we have a <a href=\"https:\/\/buradabiliyorum.com\/en\/category\/news\/\" data-internallinksmanager029f6b8e52c=\"2\" title=\"News\" target=\"_blank\" rel=\"noopener\">news<\/a>letter all about AI? You can subscribe to it <a rel=\"nofollow noopener\" target=\"_blank\" href=\"https:\/\/share.hsforms.com\/1kUPK28s-Ro67GKE8E65Zwg47gef\">right here<\/a>.<\/em><\/p>\n<\/div>\n<p><script async src=\"\/\/platform.twitter.com\/widgets.js\" charset=\"utf-8\"><\/script><\/p>\n<blockquote><p><strong><span style=\"color: #ff6600;\">If you liked the article, do not forget to share it with your friends. Follow us on\u00a0<span style=\"color: #ff0000;\"><a style=\"color: #ff0000;\" href=\"https:\/\/news.google.com\/publications\/CAAqBwgKMLG0nwswvr63Aw\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">Google News<\/a><\/span>\u00a0too, click on the star and choose us from your favorites.<\/span><\/strong><\/p><\/blockquote>\n<blockquote>\n<p style=\"text-align: center;\">For forums sites go to <span style=\"color: #ff9900;\"><a style=\"color: #ff9900;\" href=\"https:\/\/forum.buradabiliyorum.com\/\" target=\"_blank\" rel=\"noopener\">Forum.BuradaBiliyorum.Com<\/a><\/span><\/strong>\n<\/p><\/blockquote>\n<blockquote>\n<p style=\"text-align: center;\"><strong>If you want to read more like this article, you can visit our <span style=\"color: #ff9900;\"><a style=\"color: #ff9900;\" href=\"https:\/\/en.buradabiliyorum.com\/technology\/\" target=\"_blank\" rel=\"noopener\">Technology category.<\/a><\/span><\/strong><\/p>\n<\/blockquote>\n<p><span style=\"color: black;\"><a style=\"color: #ff9900;\" href=\"https:\/\/thenextweb.com\/news\/ai-detects-deepfakes-analyzing-light-reflections-in-the-cornea-eyes-gans-thispersondoesnotexist\" target=\"_blank\" rel=\"noopener\">Source<\/a><\/span><\/p>\n","protected":false},"excerpt":{"rendered":"<p>&#8220;#AI tool detects Deepfakes by analyzing light reflections in the eyes&#8221; Deepfakes are being used for a range of nefarious purposes, from disinformation campaigns to inserting people into porn, and the doctored images are getting harder to detect. A new AI tool provides a surprisingly simple way of spotting them: looking at the light reflected&#8230;<\/p>\n","protected":false},"author":1,"featured_media":385242,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"fifu_image_url":"https:\/\/img-cdn.tnwcdn.com\/image\/neural?filter_last=1&fit=1280,640&url=https:\/\/cdn0.tnwcdn.com\/wp-content\/blogs.dir\/1\/files\/2021\/03\/image-2-1.jpg&signature=dda76292883900c4239ddfdb05eb5045","fifu_image_alt":"","footnotes":""},"categories":[18],"tags":[],"class_list":["post-385241","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-technology"],"_links":{"self":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/posts\/385241","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/comments?post=385241"}],"version-history":[{"count":0,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/posts\/385241\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/media\/385242"}],"wp:attachment":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/media?parent=385241"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/categories?post=385241"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/tags?post=385241"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}