{"id":436358,"date":"2022-04-22T21:04:43","date_gmt":"2022-04-22T18:04:43","guid":{"rendered":"https:\/\/en.buradabiliyorum.com\/your-eyes-can-control-your-smartphone-via-new-gaze-tracking-tool\/"},"modified":"2022-04-22T21:04:43","modified_gmt":"2022-04-22T18:04:43","slug":"your-eyes-can-control-your-smartphone-via-new-gaze-tracking-tool","status":"publish","type":"post","link":"https:\/\/buradabiliyorum.com\/en\/your-eyes-can-control-your-smartphone-via-new-gaze-tracking-tool\/","title":{"rendered":"#Your eyes can control your smartphone via new gaze-tracking tool"},"content":{"rendered":"<div id=\"ez-toc-container\" class=\"ez-toc-v2_0_89 counter-hierarchy ez-toc-counter ez-toc-custom ez-toc-container-direction\">\n<p class=\"ez-toc-title\" style=\"cursor:inherit\">Table of Contents<\/p>\n<label for=\"ez-toc-cssicon-toggle-item-6af4cd3917727\" class=\"ez-toc-cssicon-toggle-label\"><span class=\"\"><span class=\"eztoc-hide\" style=\"display:none;\">Toggle<\/span><span class=\"ez-toc-icon-toggle-span\"><svg style=\"fill: #dd3333;color:#dd3333\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" class=\"list-377408\" width=\"20px\" height=\"20px\" viewBox=\"0 0 24 24\" fill=\"none\"><path d=\"M6 6H4v2h2V6zm14 0H8v2h12V6zM4 11h2v2H4v-2zm16 0H8v2h12v-2zM4 16h2v2H4v-2zm16 0H8v2h12v-2z\" fill=\"currentColor\"><\/path><\/svg><svg style=\"fill: #dd3333;color:#dd3333\" class=\"arrow-unsorted-368013\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"10px\" height=\"10px\" viewBox=\"0 0 24 24\" version=\"1.2\" baseProfile=\"tiny\"><path d=\"M18.2 9.3l-6.2-6.3-6.2 6.3c-.2.2-.3.4-.3.7s.1.5.3.7c.2.2.4.3.7.3h11c.3 0 .5-.1.7-.3.2-.2.3-.5.3-.7s-.1-.5-.3-.7zM5.8 14.7l6.2 6.3 6.2-6.3c.2-.2.3-.5.3-.7s-.1-.5-.3-.7c-.2-.2-.4-.3-.7-.3h-11c-.3 0-.5.1-.7.3-.2.2-.3.5-.3.7s.1.5.3.7z\"\/><\/svg><\/span><\/span><\/label><input type=\"checkbox\"  id=\"ez-toc-cssicon-toggle-item-6af4cd3917727\" checked aria-label=\"Toggle\" \/><nav><ul class='ez-toc-list ez-toc-list-level-1 ' ><li class='ez-toc-page-1 ez-toc-heading-level-1'><a class=\"ez-toc-link ez-toc-heading-1\" href=\"https:\/\/buradabiliyorum.com\/en\/your-eyes-can-control-your-smartphone-via-new-gaze-tracking-tool\/#%E2%80%9CYour_eyes_can_control_your_smartphone_via_new_gaze-tracking_tool%E2%80%9D\" >&#8220;Your eyes can control your smartphone via new gaze-tracking tool&#8221;<\/a><\/li><\/ul><\/nav><\/div>\n<h1><span class=\"ez-toc-section\" id=\"%E2%80%9CYour_eyes_can_control_your_smartphone_via_new_gaze-tracking_tool%E2%80%9D\"><\/span>&#8220;Your eyes can control your smartphone via new gaze-tracking tool&#8221;<span class=\"ez-toc-section-end\"><\/span><\/h1>\n<div>\n<div class=\"article-gallery lightGallery\">\n<div data-thumb=\"https:\/\/scx1.b-cdn.net\/csz\/news\/tmb\/2022\/smartphone-user.jpg\" data-src=\"https:\/\/scx2.b-cdn.net\/gfx\/news\/hires\/2022\/smartphone-user.jpg\" data-sub-html=\"Credit: Pixabay\/CC0 Public Domain\">\n<figure class=\"article-img\">\n            <img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/scx1.b-cdn.net\/csz\/news\/800a\/2022\/smartphone-user.jpg\" alt=\"smartphone user\" title=\"Credit: Pixabay\/CC0 Public Domain\" width=\"800\" height=\"530\"\/><figcaption class=\"text-darken text-low-up text-truncate-js text-truncate mt-3\">\n                Credit: Pixabay\/CC0 Public Domain<br \/>\n            <\/figcaption><\/figure>\n<\/p><\/div>\n<\/div>\n<p>As more people <a href=\"https:\/\/buradabiliyorum.com\/en\/category\/watch-movies-tv-seriess\/\" data-internallinksmanager029f6b8e52c=\"8\" title=\"Watch Movies &amp; TV Series\" target=\"_blank\" rel=\"noopener\">watch movies<\/a>, edit video, read the <a href=\"https:\/\/buradabiliyorum.com\/en\/category\/news\/\" data-internallinksmanager029f6b8e52c=\"2\" title=\"News\" target=\"_blank\" rel=\"noopener\">news<\/a> and keep up with <a href=\"https:\/\/buradabiliyorum.com\/en\/category\/social-mediaa\/\" data-internallinksmanager029f6b8e52c=\"1\" title=\"Social Media\" target=\"_blank\" rel=\"noopener\">social media<\/a> on their smartphones, these devices have grown to accommodate the bigger screens and higher processing power needed for more demanding activities.<\/p>\n<p>                                                                                The problem with unwieldy phones is they frequently require a second hand or voice commands to operate\u2014which can be cumbersome and inconvenient.<\/p>\n<p>In response, researchers in the Future Interfaces Group at Carnegie Mellon University&#8217;s Human-Computer Interaction Institute (HCII) are developing a tool called <a rel=\"nofollow noopener\" target=\"_blank\" href=\"https:\/\/karan-ahuja.com\/eyemu.html\">EyeMU<\/a>, which allows users to execute operations on a smartphone by combining gaze control and simple hand gestures.<\/p>\n<p>&#8220;We asked the question, &#8216;Is there a more natural mechanism to use to interact with the phone?&#8217; And the precursor for a lot of what we do is to look at something,&#8221; said Karan Ahuja, a doctoral student in human-computer interaction.<\/p>\n<p>Gaze analysis and prediction aren&#8217;t new, but achieving an acceptable level of functionality on a smartphone would be a noteworthy advance.<\/p>\n<p>&#8220;The eyes have what you would call the Midas touch problem,&#8221; said Chris Harrison, an associate professor in the HCII and director of the Future Interfaces Group. &#8220;You can&#8217;t have a situation in which something h<a href=\"https:\/\/buradabiliyorum.com\/en\/category\/download-scripts-themes-apps\/\" data-internallinksmanager029f6b8e52c=\"9\" title=\"Download Scripts &amp; Themes &amp; Apps\" target=\"_blank\" rel=\"noopener\">app<\/a>ens on the phone everywhere you look. Too many applications would open.&#8221;<\/p>\n<p>Software that tracks the eyes with precision can solve this problem. Andy Kong, a senior majoring in computer <a href=\"https:\/\/buradabiliyorum.com\/en\/category\/sciencee\/\" data-internallinksmanager029f6b8e52c=\"5\" title=\"Science\" target=\"_blank\" rel=\"noopener\">science<\/a>, had been interested in eye-tracking technologies since he first came to CMU. He found commercial versions pricey, so he wrote a program that used a laptop&#8217;s built-in camera to track the user&#8217;s eyes, which in turn moved the cursor around the screen\u2014an important early step toward EyeMU.<\/p>\n<figure class=\"mb-4\" itemscope=\"\" itemtype=\"http:\/\/schema.org\/VideoObject\">\n    <meta itemprop=\"name\" content=\"Your Eyes Control Your Smartphone Via New Gaze-Tracking Tool\"\/><br \/>\n    <meta itemprop=\"url\" content=\"https:\/\/www.youtube.com\/watch\/?v=-HwcmWRAsaA\"\/><br \/>\n    <meta itemprop=\"description\" content=\"CMU researchers show how gaze estimation using a phone\u2019s user-facing camera can be paired with motion gestures to enable a rapid interaction technique on handheld phones. Credit: Carnegie Mellon University\"\/><br \/>\n    <meta itemprop=\"uploadDate\" content=\"2022-04-22T13:35:42-04:00\"\/><br \/>\n        <meta itemprop=\"embedUrl\" content=\"https:\/\/www.youtube.com\/embed\/-HwcmWRAsaA\"\/><br \/>\n    <meta itemprop=\"thumbnailUrl\" content=\"https:\/\/img.youtube.com\/vi\/-HwcmWRAsaA\/maxresdefault.jpg\"\/><\/p>\n<p>             <iframe loading=\"lazy\" title=\"EyeMU Interactions: Gaze + IMU Gestures on Mobile Devices\" width=\"640\" height=\"360\" src=\"https:\/\/www.youtube.com\/embed\/-HwcmWRAsaA?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" referrerpolicy=\"strict-origin-when-cross-origin\" allowfullscreen><\/iframe><figcaption class=\"text-darken text-low-up mt-4\" itemprop=\"caption\">CMU researchers show how gaze estimation using a phone\u2019s user-facing camera can be paired with motion gestures to enable a rapid interaction technique on handheld phones. Credit: Carnegie Mellon University<\/figcaption><\/figure>\n<p>&#8220;Current phones only respond when we ask them for things, whether by speech, taps or button clicks,&#8221; Kong said. &#8220;If the phone is widely used now, imagine how much more useful it would be if we could predict what the user wanted by analyzing gaze or other biometrics.&#8221;<\/p>\n<p>It wasn&#8217;t easy to streamline the package so it could work at speed on a smartphone.<\/p>\n<p>&#8220;That&#8217;s a resource constraint. You must make sure your algorithms are fast enough,&#8221; Ahuja said. &#8220;If it takes too long, your eye will move along.&#8221;<br \/>\n                                            <!-- Google middle Adsense block --><\/p>\n<p>Kong, the paper&#8217;s lead author, presented the team&#8217;s findings with Ahuja, Harrison and Assistant Professor of HCII Mayank Goel at last year&#8217;s <i><a rel=\"nofollow noopener\" target=\"_blank\" href=\"https:\/\/icmi.acm.org\/2021\/\">International Conference on Multimodal Interaction<\/a><\/i>. Having a peer-reviewed paper accepted to a major conference was a huge achievement for Kong, an undergraduate researcher.<\/p>\n<p>Kong and Ahuja advanced that early prototype by using Google&#8217;s Face Mesh tool to study the gaze patterns of users looking at different areas of the screen and render the mapping data. Next, the team developed a gaze predictor that uses the smartphone&#8217;s front-facing camera to lock in what the viewer is looking at and register it as the target.<\/p>\n<p>The team made the tool more productive by combining the gaze predictor with the smartphone&#8217;s built-in motion sensors to enable commands. For example, a user could look at a notification long enough to secure it as a target and flick the phone to the left to dismiss it or to the right to respond to the notification. Similarly, a user might pull the phone closer to enlarge an image or move the phone away to disengage the gaze control, all while holding a large latte in the other hand.<\/p>\n<p>&#8220;The big tech companies like Google and Apple have gotten pretty close with gaze prediction, but just staring at something alone doesn&#8217;t get you there,&#8221; Harrison said. &#8220;The real innovation in this project is the addition of a second modality, such as flicking the phone left or right, combined with gaze prediction. That&#8217;s what makes it powerful. It seems so obvious in retrospect, but it&#8217;s a clever idea that makes EyeMU much more intuitive.&#8221;\n                                                                                                                        <\/p>\n<hr\/>\n<div class=\"article-main__explore my-4 d-print-none\">\n<p>                                            <a rel=\"nofollow noopener\" target=\"_blank\" class=\"text-medium text-info mt-2 d-inline-block\" href=\"https:\/\/phys.org\/news\/2015-04-techniques-eye-gaze-tracking-interaction.html\">New techniques for eye-gaze tracking could change computer interaction<\/a>\n                                        <\/div>\n<hr class=\"mb-4\"\/>\n<div class=\"article-main__more p-4\">\n                                                                                                <strong>More information:<\/strong><br \/>\n                                                Andy Kong et al, EyeMU Interactions: Gaze + IMU Gestures on Mobile Devices, <i>Proceedings of the 2021 International Conference on Multimodal Interaction<\/i> (2021).  <a rel=\"nofollow noopener\" target=\"_blank\" data-doi=\"1\" href=\"https:\/\/dx.doi.org\/10.1145\/3462244.3479938\">DOI: 10.1145\/3462244.3479938<\/a><\/p><\/div>\n<div class=\"d-inline-block text-medium my-4\">\n                                                Provided by<br \/>\n                                                                                                    Carnegie Mellon University<br \/>\n                                                                                                        <a rel=\"nofollow noopener\" target=\"_blank\" class=\"icon_open\" href=\"http:\/\/www.cmu.edu\/index.shtml\"><br \/>\n                                                        <svg>\n                                                            <use href=\"https:\/\/techx.b-cdn.net\/tmpl\/v2\/img\/svg\/sprite.svg#icon_open\" x=\"0\" y=\"0\"\/>\n                                                        <\/svg><br \/>\n                                                    <\/a><\/p><\/div>\n<p>                                        <!-- print only --><\/p>\n<div class=\"d-none d-print-block\">\n<p>                                                 <strong>Citation<\/strong>:<br \/>\n                                                 Your eyes can control your smartphone via new gaze-tracking tool (2022, April 22)<br \/>\n                                                 retrieved 23 April 2022<br \/>\n                                                 from https:\/\/techxplore.com\/news\/2022-04-eyes-smartphone-gaze-tracking-tool.html<\/p>\n<p>                                            This document is subject to copyright. Apart from any fair dealing for the purpose of private study or research, no<br \/>\n                                            part may be reproduced without the written permission. The content is provided for information purposes only.<\/p><\/div>\n<\/p><\/div>\n<p><script id=\"facebook-jssdk\" async=\"\" src=\"https:\/\/connect.facebook.net\/en_US\/sdk.js\"><\/script><\/p>\n<blockquote><p><strong><span style=\"color: #ff6600;\">If you liked the article, do not forget to share it with your friends. Follow us on\u00a0<span style=\"color: #ff0000;\"><a style=\"color: #ff0000;\" href=\"https:\/\/news.google.com\/publications\/CAAqBwgKMLG0nwswvr63Aw\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">Google News<\/a><\/span>\u00a0too, click on the star and choose us from your favorites.<\/span><\/strong><\/p><\/blockquote>\n<blockquote>\n<p style=\"text-align: center;\">For forums sites go to <span style=\"color: #ff9900;\"><a style=\"color: #ff9900;\" href=\"https:\/\/forum.buradabiliyorum.com\/\" target=\"_blank\" rel=\"noopener\">Forum.BuradaBiliyorum.Com<\/a><\/span><\/strong>\n<\/p><\/blockquote>\n<blockquote>\n<p style=\"text-align: center;\"><strong>If you want to read more Like this articles, you can visit our <span style=\"color: #ff9900;\"><a style=\"color: #ff9900;\" href=\"https:\/\/en.buradabiliyorum.com\/science\/\" target=\"_blank\" rel=\"noopener\">Science category.<\/a><\/span><\/strong><\/p>\n<\/blockquote>\n<p><span style=\"color: black;\"><a style=\"color: #ff9900;\" href=\"https:\/\/techxplore.com\/news\/2022-04-eyes-smartphone-gaze-tracking-tool.html\" target=\"_blank\" rel=\"noopener\">Source<\/a><\/span><\/p>\n","protected":false},"excerpt":{"rendered":"<p>&#8220;Your eyes can control your smartphone via new gaze-tracking tool&#8221; Credit: Pixabay\/CC0 Public Domain As more people watch movies, edit video, read the news and keep up with social media on their smartphones, these devices have grown to accommodate the bigger screens and higher processing power needed for more demanding activities. The problem with unwieldy&#8230;<\/p>\n","protected":false},"author":1,"featured_media":436359,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"fifu_image_url":"https:\/\/scx2.b-cdn.net\/gfx\/news\/hires\/2022\/smartphone-user.jpg","fifu_image_alt":"","footnotes":""},"categories":[16],"tags":[],"class_list":["post-436358","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-sciencee"],"_links":{"self":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/posts\/436358","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/comments?post=436358"}],"version-history":[{"count":0,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/posts\/436358\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/media\/436359"}],"wp:attachment":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/media?parent=436358"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/categories?post=436358"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/tags?post=436358"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}