{"id":288627,"date":"2021-07-01T17:53:49","date_gmt":"2021-07-01T14:53:49","guid":{"rendered":"https:\/\/en.buradabiliyorum.com\/chatbot-can-explain-apps-and-how-they-access-hardware-or-data\/"},"modified":"2021-07-01T17:53:49","modified_gmt":"2021-07-01T14:53:49","slug":"chatbot-can-explain-apps-and-how-they-access-hardware-or-data","status":"publish","type":"post","link":"https:\/\/buradabiliyorum.com\/en\/chatbot-can-explain-apps-and-how-they-access-hardware-or-data\/","title":{"rendered":"#Chatbot can explain apps and how they access hardware or data"},"content":{"rendered":"<p>&#8220;<strong>#Chatbot can explain <a href=\"https:\/\/buradabiliyorum.com\/en\/category\/download-scripts-themes-apps\/\" data-internallinksmanager029f6b8e52c=\"9\" title=\"Download Scripts &amp; Themes &amp; Apps\" target=\"_blank\" rel=\"noopener\">app<\/a>s and how they access hardware or data<\/strong>&#8221;<\/p>\n<div>\n<div class=\"article-gallery lightGallery\">\n<div data-thumb=\"https:\/\/scx1.b-cdn.net\/csz\/news\/tmb\/2021\/new-chatbot-can-explai.jpg\" data-src=\"https:\/\/scx2.b-cdn.net\/gfx\/news\/2021\/new-chatbot-can-explai.jpg\" data-sub-html=\"Hey GUI is a chatbot that can be used to find images or textual information about apps and their user interfaces using natural language conversations. Credit: Aalto University\">\n<figure class=\"article-img\"><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/scx1.b-cdn.net\/csz\/news\/800a\/2021\/new-chatbot-can-explai.jpg\" alt=\"New chatbot can explain apps and show you how they access hardware or data\" title=\"Hey GUI is a chatbot that can be used to find images or textual information about apps and their user interfaces using natural language conversations. Credit: Aalto University\" width=\"800\" height=\"356\"\/><figcaption class=\"text-darken text-low-up text-truncate-js text-truncate mt-3\">\n                Hey GUI is a chatbot that can be used to find images or textual information about apps and their user interfaces using natural language conversations. Credit: Aalto University<br \/>\n            <\/figcaption><\/figure>\n<\/div>\n<\/div>\n<p>Chatbots have already become a part of our everyday lives with their quick and intuitive way to complete tasks like scheduling and finding information using natural language conversations. Researchers at Aalto University have now harnessed the power of chatbots to help designers and developers develop new apps and allow end users to find information on the apps on their devices.<\/p>\n<p>                                                                                The chatbot &#8216;Hey GU&#8217;, which will be presented at ACM Designing Interactive Systems 2021 on 1 July, can answer questions by showing images and screenshots of apps, or through simple text phrases.<\/p>\n<p>&#8220;Hey GUI eliminates the need for coding skills or technical expertise. Anyone can use it to search for information on, for example, which one of my apps is asking for permission to use the camera, or where is the search button on this screen,&#8221; says postdoctoral researcher Kashyap Todi of Aalto University.<\/p>\n<p><b>Important findings for chatbot developers and researchers<\/b><\/p>\n<p>Different kinds of applications and user interfaces contain vast amounts of information, which can be used for different needs and tasks. In their study, the researchers set out to find the most desirable chatbot features and how users would have conversations with them.<\/p>\n<p>Three target groups were considered in the experiment: designers, software developers, and <a href=\"https:\/\/buradabiliyorum.com\/en\/category\/general\/\" data-internallinksmanager029f6b8e52c=\"3\" title=\"General\" target=\"_blank\" rel=\"noopener\">general<\/a> users. Over 100 designers, developers, and ordinary users responded to the survey.<\/p>\n<figure class=\"mb-4\" itemscope=\"\" itemtype=\"http:\/\/schema.org\/VideoObject\"><meta itemprop=\"name\" content=\"New chatbot can explain apps and show you how they access hardware or data\"\/><meta itemprop=\"url\" content=\"https:\/\/www.youtube.com\/watch\/?v=vB_OH-Eky-Q\"\/><meta itemprop=\"description\" content=\"Credit: Aalto University\"\/><meta itemprop=\"uploadDate\" content=\"2021-07-01T05:51:38-04:00\"\/><meta itemprop=\"embedUrl\" content=\"https:\/\/www.youtube.com\/embed\/vB_OH-Eky-Q\"\/><meta itemprop=\"thumbnailUrl\" content=\"https:\/\/img.youtube.com\/vi\/vB_OH-Eky-Q\/maxresdefault.jpg\"\/><br \/>\n             <iframe loading=\"lazy\" title=\"Conversations with GUIs\" width=\"640\" height=\"360\" src=\"https:\/\/www.youtube.com\/embed\/vB_OH-Eky-Q?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" referrerpolicy=\"strict-origin-when-cross-origin\" allowfullscreen><\/iframe><figcaption class=\"text-darken text-low-up mt-4\" itemprop=\"caption\">Credit: Aalto University<\/figcaption><\/figure>\n<p>&#8220;Our goal was to get a good understanding of what capabilities and functions different kinds of users would find most beneficial when using this new type of chatbot, as well as how they would formulate questions\u2014especially what kinds of words and phrases they would use. This is an important first step towards developing chatbots that can help users find information about apps using simple conversations,&#8221; says Kashyap.<\/p>\n<p>As a result of the survey, 21 key features and more than 1300 of the most common questions put forward by users were collected and analyzed to create Hey GUI, allowing users to find information within user interfaces using simple conversations, based on the most frequent expressions collected in the survey.<\/p>\n<p>&#8220;Designers can get inspiration, for instance, by asking Hey GUI to find good online shop designs. The chatbot responds with several screenshots from existing apps in the catalog. Software developers could ask a chatbot what typical color codes are used for login buttons, and the chatbot responds with several options,&#8221; Kashyap adds.<\/p>\n<p>In questions from ordinary users, there was a special emphasis on matters related to privacy and accessibility information, or getting help about their apps, such as asking which apps display maps.\n                                                                                                                        <\/p>\n<hr\/>\n<div class=\"article-main__explore my-4 d-print-none\">\n<p>                                            <a rel=\"nofollow noopener\" target=\"_blank\" class=\"text-medium text-info mt-2 d-inline-block\" href=\"https:\/\/medicalxpress.com\/news\/2021-06-chatbots-dementia-patients-caregivers.html\">Chatbots for dementia patients and caregivers need more work<\/a>\n                                        <\/div>\n<hr class=\"mb-4\"\/>\n<div class=\"article-main__more p-4\">\n                                                                                                <strong>More information:<\/strong><br \/>\n                                                Kashyap Todi et al, Conversations with GUIs, <i>Designing Interactive Systems Conference 2021<\/i> (2021).  <a rel=\"nofollow noopener\" target=\"_blank\" data-doi=\"1\" href=\"http:\/\/dx.doi.org\/10.1145\/3461778.3462124\">DOI: 10.1145\/3461778.3462124<\/a><\/p><\/div>\n<div class=\"d-inline-block text-medium my-4\">\n                                                Provided by<br \/>\n                                                                                                    Aalto University<br \/>\n                                                                                                        <a rel=\"nofollow noopener\" target=\"_blank\" class=\"icon_open\" href=\"http:\/\/www.aalto.fi\/en\/current\/\"><br \/>\n                                                        <svg><use href=\"https:\/\/techx.b-cdn.net\/tmpl\/v2\/img\/svg\/sprite.svg#icon_open\" x=\"0\" y=\"0\"\/><\/svg><\/a><\/p><\/div>\n<p>                                        <!-- print only --><\/p>\n<div class=\"d-none d-print-block\">\n<p>                                                 <strong>Citation<\/strong>:<br \/>\n                                                 Chatbot can explain apps and how they access hardware or data (2021, July  1)<br \/>\n                                                 retrieved  1 July 2021<br \/>\n                                                 from https:\/\/techxplore.com\/<a href=\"https:\/\/buradabiliyorum.com\/en\/category\/news\/\" data-internallinksmanager029f6b8e52c=\"2\" title=\"News\" target=\"_blank\" rel=\"noopener\">news<\/a>\/2021-07-chatbot-apps-access-hardware.html<\/p>\n<p>                                            This document is subject to copyright. Apart from any fair dealing for the purpose of private study or research, no<br \/>\n                                            part may be reproduced without the written permission. The content is provided for information purposes only.<\/p><\/div>\n<\/p><\/div>\n<p><script id=\"facebook-jssdk\" async=\"\" src=\"https:\/\/connect.facebook.net\/en_US\/sdk.js\"><\/script><\/p>\n<blockquote><p><strong><span style=\"color: #ff6600;\">If you liked the article, do not forget to share it with your friends. Follow us on\u00a0<span style=\"color: #ff0000;\"><a style=\"color: #ff0000;\" href=\"https:\/\/news.google.com\/publications\/CAAqBwgKMLG0nwswvr63Aw\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">Google News<\/a><\/span>\u00a0too, click on the star and choose us from your favorites.<\/span><\/strong><\/p><\/blockquote>\n<blockquote>\n<p style=\"text-align: center;\">For forums sites go to <span style=\"color: #ff9900;\"><a style=\"color: #ff9900;\" href=\"https:\/\/forum.buradabiliyorum.com\/\" target=\"_blank\" rel=\"noopener\">Forum.BuradaBiliyorum.Com<\/a><\/span><\/strong>\n<\/p><\/blockquote>\n<blockquote>\n<p style=\"text-align: center;\"><strong>If you want to read more Like this articles, you can visit our <span style=\"color: #ff9900;\"><a style=\"color: #ff9900;\" href=\"https:\/\/en.buradabiliyorum.com\/science\/\" target=\"_blank\" rel=\"noopener\">Science category.<\/a><\/span><\/strong><\/p>\n<\/blockquote>\n<p><span style=\"color: black;\"><a style=\"color: #ff9900;\" href=\"https:\/\/techxplore.com\/news\/2021-07-chatbot-apps-access-hardware.html\" target=\"_blank\" rel=\"noopener\">Source<\/a><\/span><\/p>\n","protected":false},"excerpt":{"rendered":"<p>&#8220;#Chatbot can explain apps and how they access hardware or data&#8221; Hey GUI is a chatbot that can be used to find images or textual information about apps and their user interfaces using natural language conversations. Credit: Aalto University Chatbots have already become a part of our everyday lives with their quick and intuitive way&#8230;<\/p>\n","protected":false},"author":1,"featured_media":288628,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"fifu_image_url":"https:\/\/scx2.b-cdn.net\/gfx\/news\/2021\/new-chatbot-can-explai.jpg","fifu_image_alt":"","footnotes":""},"categories":[16],"tags":[],"class_list":["post-288627","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-sciencee"],"_links":{"self":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/posts\/288627","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/comments?post=288627"}],"version-history":[{"count":0,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/posts\/288627\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/media\/288628"}],"wp:attachment":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/media?parent=288627"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/categories?post=288627"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/tags?post=288627"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}