{"id":413079,"date":"2022-03-07T20:25:36","date_gmt":"2022-03-07T17:25:36","guid":{"rendered":"https:\/\/en.buradabiliyorum.com\/simulated-human-eye-movement-aims-to-train-metaverse-platforms\/"},"modified":"2022-03-07T20:25:36","modified_gmt":"2022-03-07T17:25:36","slug":"simulated-human-eye-movement-aims-to-train-metaverse-platforms","status":"publish","type":"post","link":"https:\/\/buradabiliyorum.com\/en\/simulated-human-eye-movement-aims-to-train-metaverse-platforms\/","title":{"rendered":"#Simulated human eye movement aims to train metaverse platforms"},"content":{"rendered":"<div id=\"ez-toc-container\" class=\"ez-toc-v2_0_84 counter-hierarchy ez-toc-counter ez-toc-custom ez-toc-container-direction\">\n<p class=\"ez-toc-title\" style=\"cursor:inherit\">Table of Contents<\/p>\n<label for=\"ez-toc-cssicon-toggle-item-6a2bf07498c37\" class=\"ez-toc-cssicon-toggle-label\"><span class=\"\"><span class=\"eztoc-hide\" style=\"display:none;\">Toggle<\/span><span class=\"ez-toc-icon-toggle-span\"><svg style=\"fill: #dd3333;color:#dd3333\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" class=\"list-377408\" width=\"20px\" height=\"20px\" viewBox=\"0 0 24 24\" fill=\"none\"><path d=\"M6 6H4v2h2V6zm14 0H8v2h12V6zM4 11h2v2H4v-2zm16 0H8v2h12v-2zM4 16h2v2H4v-2zm16 0H8v2h12v-2z\" fill=\"currentColor\"><\/path><\/svg><svg style=\"fill: #dd3333;color:#dd3333\" class=\"arrow-unsorted-368013\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"10px\" height=\"10px\" viewBox=\"0 0 24 24\" version=\"1.2\" baseProfile=\"tiny\"><path d=\"M18.2 9.3l-6.2-6.3-6.2 6.3c-.2.2-.3.4-.3.7s.1.5.3.7c.2.2.4.3.7.3h11c.3 0 .5-.1.7-.3.2-.2.3-.5.3-.7s-.1-.5-.3-.7zM5.8 14.7l6.2 6.3 6.2-6.3c.2-.2.3-.5.3-.7s-.1-.5-.3-.7c-.2-.2-.4-.3-.7-.3h-11c-.3 0-.5.1-.7.3-.2.2-.3.5-.3.7s.1.5.3.7z\"\/><\/svg><\/span><\/span><\/label><input type=\"checkbox\"  id=\"ez-toc-cssicon-toggle-item-6a2bf07498c37\" checked aria-label=\"Toggle\" \/><nav><ul class='ez-toc-list ez-toc-list-level-1 ' ><li class='ez-toc-page-1 ez-toc-heading-level-1'><a class=\"ez-toc-link ez-toc-heading-1\" href=\"https:\/\/buradabiliyorum.com\/en\/simulated-human-eye-movement-aims-to-train-metaverse-platforms\/#%E2%80%9CSimulated_human_eye_movement_aims_to_train_metaverse_platforms%E2%80%9D\" >&#8220;Simulated human eye movement aims to train metaverse platforms&#8221;<\/a><\/li><\/ul><\/nav><\/div>\n<h1><span class=\"ez-toc-section\" id=\"%E2%80%9CSimulated_human_eye_movement_aims_to_train_metaverse_platforms%E2%80%9D\"><\/span>&#8220;Simulated human eye movement aims to train metaverse platforms&#8221;<span class=\"ez-toc-section-end\"><\/span><\/h1>\n<div>\n<div class=\"article-gallery lightGallery\">\n<div data-thumb=\"https:\/\/scx1.b-cdn.net\/csz\/news\/tmb\/2022\/simulated-human-eye-mo.jpg\" data-src=\"https:\/\/scx2.b-cdn.net\/gfx\/news\/2022\/simulated-human-eye-mo.jpg\" data-sub-html=\"Getting data on how peoples' eyes move while watching TV or reading books is an arduous process\u2014one that metaverse app developers can now skip thanks to Duke Engineering's \u201cvirtual eyes.\u201d. Credit: Maria Gorlatova, Duke University\">\n<figure class=\"article-img\">\n            <img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/scx1.b-cdn.net\/csz\/news\/800a\/2022\/simulated-human-eye-mo.jpg\" alt=\"Simulated human eye movement aims to train metaverse platforms\" title=\"Getting data on how peoples' eyes move while watching TV or reading books is an arduous process\u2014one that metaverse app developers can now skip thanks to Duke Engineering's \u201cvirtual eyes.\u201d. Credit: Maria Gorlatova, Duke University\" width=\"800\" height=\"235\"\/><figcaption class=\"text-darken text-low-up text-truncate-js text-truncate mt-3\">\n                Getting data on how peoples&#8217; eyes move while watching TV or reading books is an arduous process\u2014one that metaverse <a href=\"https:\/\/buradabiliyorum.com\/en\/category\/download-scripts-themes-apps\/\" data-internallinksmanager029f6b8e52c=\"9\" title=\"Download Scripts &amp; Themes &amp; Apps\" target=\"_blank\" rel=\"noopener\">app<\/a> developers can now skip thanks to Duke Engineering&#8217;s \u201cvirtual eyes.\u201d. Credit: Maria Gorlatova, Duke University<br \/>\n            <\/figcaption><\/figure>\n<\/p><\/div>\n<\/div>\n<p>Computer engineers at Duke University have developed virtual eyes that simulate how humans look at the world accurately enough for companies to train virtual reality and augmented reality programs. Called EyeSyn for short, the program will help developers create applications for the rapidly expanding metaverse while protecting user data.<\/p>\n<p>                                                                                The results have been accepted and will be presented at the International Conference on Information Processing in Sensor Networks (IPSN), May 4-6, 2022, a leading annual forum on research in networked sensing and control.<\/p>\n<p>&#8220;If you&#8217;re interested in detecting whether a person is reading a comic book or advanced literature by looking at their eyes alone, you can do that,&#8221; said Maria Gorlatova, the Nortel Networks Assistant Professor of Electrical and Computer Engineering at Duke.<\/p>\n<p>&#8220;But training that kind of algorithm requires data from hundreds of people wearing headsets for hours at a time,&#8221; Gorlatova added. &#8220;We wanted to develop software that not only reduces the privacy concerns that come with gathering this sort of data, but also allows smaller companies who don&#8217;t have those levels of resources to get into the metaverse <a href=\"https:\/\/buradabiliyorum.com\/en\/category\/game\/\" data-internallinksmanager029f6b8e52c=\"7\" title=\"Game\" target=\"_blank\" rel=\"noopener\">game<\/a>.&#8221;<\/p>\n<p>The poetic insight describing eyes as the windows to the soul has been repeated since at least Biblical times for good reason: The tiny movements of how our eyes move and pupils dilate provide a surprising amount of information. Human eyes can reveal if we&#8217;re bored or excited, where concentration is focused, whether or not we&#8217;re expert or novice at a given task, or even if we&#8217;re fluent in a specific language.<\/p>\n<p>&#8220;Where you&#8217;re prioritizing your vision says a lot about you as a person, too,&#8221; Gorlatova said. &#8220;It can inadvertently reveal sexual and racial biases, interests that we don&#8217;t want others to know about, and information that we may not even know about ourselves.&#8221;<\/p>\n<p>Eye movement data is invaluable to companies building platforms and software in the metaverse. For example, reading a user&#8217;s eyes allows developers to tailor content to engagement responses or reduce resolution in their peripheral vision to save computational power.<\/p>\n<p>With this wide range of complexity, creating virtual eyes that mimic how an average human responds to a wide variety of stimuli sounds like a tall task. To climb the mountain, Gorlatova and her team\u2014including former postdoctoral associate Guohao Lan, who is now an assistant professor at the Delft University of <a href=\"https:\/\/buradabiliyorum.com\/en\/category\/technology\/\" data-internallinksmanager029f6b8e52c=\"4\" title=\"Technology\" target=\"_blank\" rel=\"noopener\">Technology<\/a> in the Netherlands, and current Ph.D. student Tim Scargill\u2014dove into the cognitive <a href=\"https:\/\/buradabiliyorum.com\/en\/category\/sciencee\/\" data-internallinksmanager029f6b8e52c=\"5\" title=\"Science\" target=\"_blank\" rel=\"noopener\">science<\/a> literature that explores how humans see the world and process visual information.<\/p>\n<figure class=\"mb-4\" itemscope=\"\" itemtype=\"http:\/\/schema.org\/VideoObject\">\n    <meta itemprop=\"name\" content=\"Simulated human eye movement aims to train metaverse platforms\"\/><br \/>\n    <meta itemprop=\"url\" content=\"https:\/\/scx2.b-cdn.net\/gfx\/video\/2022\/simulated-human-eye-mo.mp4\"\/><br \/>\n    <meta itemprop=\"description\" content=\"Rather than collecting actual eye movement data, as seen here, Duke engineers have developed a set of \u201cvirtual eyes\u201d that simulate the data well enough to train new metaverse applications. Credit: Maria Gorlatova, Duke University\"\/><br \/>\n    <meta itemprop=\"uploadDate\" content=\"2022-03-07T11:41:27-05:00\"\/><br \/>\n        <meta itemprop=\"thumbnailUrl\" content=\"https:\/\/scx1.b-cdn.net\/gfx\/video_tmb\/2022\/simulated-human-eye-mo.mp4.jpg\"\/><br \/>\n    <meta itemprop=\"contentUrl\" content=\"https:\/\/scx2.b-cdn.net\/gfx\/video\/2022\/simulated-human-eye-mo.mp4\"\/><br \/>\n            <video class=\"embed-responsive embed-responsive-16by9\" id=\"jwVID68573\" controls=\"\" poster=\"https:\/\/scx1.b-cdn.net\/gfx\/video_tmb\/2022\/simulated-human-eye-mo.mp4.jpg\"><source src=\"https:\/\/scx2.b-cdn.net\/gfx\/video\/2022\/simulated-human-eye-mo.mp4\" type=\"video\/mp4\"><\/source><\/video><figcaption class=\"text-darken text-low-up mt-4\" itemprop=\"caption\">Rather than collecting actual eye movement data, as seen here, Duke engineers have developed a set of \u201cvirtual eyes\u201d that simulate the data well enough to train new metaverse applications. Credit: Maria Gorlatova, Duke University<\/figcaption><\/figure>\n<p>For example, when a person is watching someone talk, their eyes alternate between the person&#8217;s eyes, nose and mouth for various amounts of time. When developing EyeSyn, the researchers created a model that extracts where those features are on a speaker and programmed their virtual eyes to statistically emulate the time spent focusing on each region.<br \/>\n                                            <!-- Google middle Adsense block --><\/p>\n<p>&#8220;If you give EyeSyn a lot of different inputs and run it enough times, you&#8217;ll create a data set of synthetic eye movements that is large enough to train a (machine learning) classifier for a new program,&#8221; Gorlatova said.<\/p>\n<p>To test the accuracy of their synthetic eyes, the researchers turned to publicly available data. They first had the eyes &#8220;watch&#8221; videos of Dr. Anthony Fauci addressing the <a href=\"https:\/\/buradabiliyorum.com\/en\/category\/social-mediaa\/\" data-internallinksmanager029f6b8e52c=\"1\" title=\"Social Media\" target=\"_blank\" rel=\"noopener\">media<\/a> during press conferences and compared it to data from the eye movements of actual viewers. They also compared a virtual dataset of their synthetic eyes looking at art with actual datasets collected from people browsing a virtual art museum. The results showed that EyeSyn was able to closely match the distinct patterns of actual gaze signals and simulate the different ways different people&#8217;s eyes react.<\/p>\n<p>According to Gorlatova, this level of performance is good enough for companies to use it as a baseline to train new metaverse platforms and software. With a basic level of competency, commercial software can then achieve even better results by personalizing its algorithms after interacting with specific users.<\/p>\n<p>&#8220;The synthetic data alone isn&#8217;t perfect, but it&#8217;s a good starting point,&#8221; Gorlatova said. &#8220;Smaller companies can use it rather than spending the time and money of trying to build their own real-world datasets (with human subjects). And because the personalization of the algorithms can be done on local systems, people don&#8217;t have to worry about their private eye movement data becoming part of a large database.&#8221;\n                                                                                                                        <\/p>\n<hr\/>\n<div class=\"article-main__explore my-4 d-print-none\">\n<p>                                            What is the metaverse? A tech CEO who is helping build it explains\n                                        <\/p><\/div>\n<hr class=\"mb-4\"\/>\n<div class=\"article-main__more p-4\">\n                                                                                                <strong>More information:<\/strong><br \/>\n                                                Study: <a rel=\"nofollow noopener\" target=\"_blank\" href=\"https:\/\/maria.gorlatova.com\/wp-content\/uploads\/2022\/03\/EyeSyn_CR.pdf\">maria.gorlatova.com\/wp-content \u2026 022\/03\/EyeSyn_CR.pdf<\/a><br \/>\nConference: <a rel=\"nofollow noopener\" target=\"_blank\" href=\"https:\/\/ipsn.acm.org\/2022\/\">ipsn.acm.org\/2022\/<\/a><\/p>\n<\/div>\n<div class=\"d-inline-block text-medium my-4\">\n                                                Provided by<br \/>\n                                                                                                    Duke University<br \/>\n                                                                                                        <a rel=\"nofollow noopener\" target=\"_blank\" class=\"icon_open\" href=\"http:\/\/www.duke.edu\/\"><br \/>\n                                                        <svg>\n                                                            <use href=\"https:\/\/techx.b-cdn.net\/tmpl\/v2\/img\/svg\/sprite.svg#icon_open\" x=\"0\" y=\"0\"\/>\n                                                        <\/svg><br \/>\n                                                    <\/a><\/p><\/div>\n<p>                                        <!-- print only --><\/p>\n<div class=\"d-none d-print-block\">\n<p>\n                                                 <strong>Citation<\/strong>:<br \/>\n                                                 Simulated human eye movement aims to train metaverse platforms (2022, March  7)<br \/>\n                                                 retrieved  7 March 2022<br \/>\n                                                 from https:\/\/techxplore.com\/<a href=\"https:\/\/buradabiliyorum.com\/en\/category\/news\/\" data-internallinksmanager029f6b8e52c=\"2\" title=\"News\" target=\"_blank\" rel=\"noopener\">news<\/a>\/2022-03-simulated-human-eye-movement-aims.html<\/p>\n<p>                                            This document is subject to copyright. Apart from any fair dealing for the purpose of private study or research, no<br \/>\n                                            part may be reproduced without the written permission. The content is provided for information purposes only.<\/p><\/div>\n<\/p><\/div>\n<p><script id=\"facebook-jssdk\" async=\"\" src=\"https:\/\/connect.facebook.net\/en_US\/sdk.js\"><\/script><\/p>\n<blockquote><p><strong><span style=\"color: #ff6600;\">If you liked the article, do not forget to share it with your friends. Follow us on\u00a0<span style=\"color: #ff0000;\"><a style=\"color: #ff0000;\" href=\"https:\/\/news.google.com\/publications\/CAAqBwgKMLG0nwswvr63Aw\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">Google News<\/a><\/span>\u00a0too, click on the star and choose us from your favorites.<\/span><\/strong><\/p><\/blockquote>\n<blockquote>\n<p style=\"text-align: center;\">For forums sites go to <span style=\"color: #ff9900;\"><a style=\"color: #ff9900;\" href=\"https:\/\/forum.buradabiliyorum.com\/\" target=\"_blank\" rel=\"noopener\">Forum.BuradaBiliyorum.Com<\/a><\/span><\/strong>\n<\/p><\/blockquote>\n<blockquote>\n<p style=\"text-align: center;\"><strong>If you want to read more Like this articles, you can visit our <span style=\"color: #ff9900;\"><a style=\"color: #ff9900;\" href=\"https:\/\/en.buradabiliyorum.com\/science\/\" target=\"_blank\" rel=\"noopener\">Science category.<\/a><\/span><\/strong><\/p>\n<\/blockquote>\n<p><span style=\"color: black;\"><a style=\"color: #ff9900;\" href=\"https:\/\/techxplore.com\/news\/2022-03-simulated-human-eye-movement-aims.html\" target=\"_blank\" rel=\"noopener\">Source<\/a><\/span><\/p>\n","protected":false},"excerpt":{"rendered":"<p>&#8220;Simulated human eye movement aims to train metaverse platforms&#8221; Getting data on how peoples&#8217; eyes move while watching TV or reading books is an arduous process\u2014one that metaverse app developers can now skip thanks to Duke Engineering&#8217;s \u201cvirtual eyes.\u201d. Credit: Maria Gorlatova, Duke University Computer engineers at Duke University have developed virtual eyes that simulate&#8230;<\/p>\n","protected":false},"author":1,"featured_media":413080,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"fifu_image_url":"https:\/\/scx2.b-cdn.net\/gfx\/news\/2022\/simulated-human-eye-mo.jpg","fifu_image_alt":"","footnotes":""},"categories":[16],"tags":[],"class_list":["post-413079","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-sciencee"],"_links":{"self":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/posts\/413079","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/comments?post=413079"}],"version-history":[{"count":0,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/posts\/413079\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/media\/413080"}],"wp:attachment":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/media?parent=413079"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/categories?post=413079"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/tags?post=413079"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}