{"id":532257,"date":"2022-12-29T01:25:22","date_gmt":"2022-12-28T22:25:22","guid":{"rendered":"https:\/\/en.buradabiliyorum.com\/spray-on-smart-skin-uses-ai-to-rapidly-understand-hand-tasks\/"},"modified":"2022-12-29T01:25:22","modified_gmt":"2022-12-28T22:25:22","slug":"spray-on-smart-skin-uses-ai-to-rapidly-understand-hand-tasks","status":"publish","type":"post","link":"https:\/\/buradabiliyorum.com\/en\/spray-on-smart-skin-uses-ai-to-rapidly-understand-hand-tasks\/","title":{"rendered":"#Spray-on smart skin uses AI to rapidly understand hand tasks"},"content":{"rendered":"<div id=\"ez-toc-container\" class=\"ez-toc-v2_0_89 counter-hierarchy ez-toc-counter ez-toc-custom ez-toc-container-direction\">\n<p class=\"ez-toc-title\" style=\"cursor:inherit\">Table of Contents<\/p>\n<label for=\"ez-toc-cssicon-toggle-item-6af631796b00b\" class=\"ez-toc-cssicon-toggle-label\"><span class=\"\"><span class=\"eztoc-hide\" style=\"display:none;\">Toggle<\/span><span class=\"ez-toc-icon-toggle-span\"><svg style=\"fill: #dd3333;color:#dd3333\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" class=\"list-377408\" width=\"20px\" height=\"20px\" viewBox=\"0 0 24 24\" fill=\"none\"><path d=\"M6 6H4v2h2V6zm14 0H8v2h12V6zM4 11h2v2H4v-2zm16 0H8v2h12v-2zM4 16h2v2H4v-2zm16 0H8v2h12v-2z\" fill=\"currentColor\"><\/path><\/svg><svg style=\"fill: #dd3333;color:#dd3333\" class=\"arrow-unsorted-368013\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"10px\" height=\"10px\" viewBox=\"0 0 24 24\" version=\"1.2\" baseProfile=\"tiny\"><path d=\"M18.2 9.3l-6.2-6.3-6.2 6.3c-.2.2-.3.4-.3.7s.1.5.3.7c.2.2.4.3.7.3h11c.3 0 .5-.1.7-.3.2-.2.3-.5.3-.7s-.1-.5-.3-.7zM5.8 14.7l6.2 6.3 6.2-6.3c.2-.2.3-.5.3-.7s-.1-.5-.3-.7c-.2-.2-.4-.3-.7-.3h-11c-.3 0-.5.1-.7.3-.2.2-.3.5-.3.7s.1.5.3.7z\"\/><\/svg><\/span><\/span><\/label><input type=\"checkbox\"  id=\"ez-toc-cssicon-toggle-item-6af631796b00b\" checked aria-label=\"Toggle\" \/><nav><ul class='ez-toc-list ez-toc-list-level-1 ' ><li class='ez-toc-page-1 ez-toc-heading-level-1'><a class=\"ez-toc-link ez-toc-heading-1\" href=\"https:\/\/buradabiliyorum.com\/en\/spray-on-smart-skin-uses-ai-to-rapidly-understand-hand-tasks\/#%E2%80%9CSpray-on_smart_skin_uses_AI_to_rapidly_understand_hand_tasks%E2%80%9D\" >&#8220;Spray-on smart skin uses AI to rapidly understand hand tasks&#8221;<\/a><\/li><\/ul><\/nav><\/div>\n<h1><span class=\"ez-toc-section\" id=\"%E2%80%9CSpray-on_smart_skin_uses_AI_to_rapidly_understand_hand_tasks%E2%80%9D\"><\/span>&#8220;Spray-on smart skin uses AI to rapidly understand hand tasks&#8221;<span class=\"ez-toc-section-end\"><\/span><\/h1>\n<div>\n<div class=\"article-gallery lightGallery\">\n<div data-thumb=\"https:\/\/scx1.b-cdn.net\/csz\/news\/tmb\/2022\/spray-on-smart-skin-us.jpg\" data-src=\"https:\/\/scx2.b-cdn.net\/gfx\/news\/hires\/2022\/spray-on-smart-skin-us.jpg\" data-sub-html=\"Spray-on sensory system which consists of printed, bio-compatible nanomesh directly connected with wireless Bluetooth module and further trained through meta-learning. Credit: Kyun Kyu \u201cRichard\u201d Kim, Bao Group, Stanford U.\">\n<figure class=\"article-img\"><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/scx1.b-cdn.net\/csz\/news\/800a\/2022\/spray-on-smart-skin-us.jpg\" alt=\"Spray-on smart skin uses AI to rapidly understand hand tasks\" title=\"Spray-on sensory system which consists of printed, bio-compatible nanomesh directly connected with wireless Bluetooth module and further trained through meta-learning. Credit: Kyun Kyu \u201cRichard\u201d Kim, Bao Group, Stanford U.\" width=\"800\" height=\"530\"\/><figcaption class=\"text-darken text-low-up text-truncate-js text-truncate mt-3\">\n                Spray-on sensory system which consists of printed, bio-compatible nanomesh directly connected with wireless Bluetooth module and further trained through meta-learning. Credit: Kyun Kyu \u201cRichard\u201d Kim, Bao Group, Stanford U.<br \/>\n            <\/figcaption><\/figure>\n<\/div>\n<\/div>\n<p>A new smart skin developed at Stanford University might foretell a day when people type on invisible keyboards, identify objects by touch alone, or allow users to communicate by hand gestures with <a href=\"https:\/\/buradabiliyorum.com\/en\/category\/download-scripts-themes-apps\/\" data-internallinksmanager029f6b8e52c=\"9\" title=\"Download Scripts &amp; Themes &amp; Apps\" target=\"_blank\" rel=\"noopener\">app<\/a>s in immersive environments.<\/p>\n<p>                                                                                In a just-publish paper in the journal <i>Nature Electronics <\/i>the researchers describe a new type of stretchable biocompatible material that gets sprayed on the back of the hand, like suntan spray. Integrated in the mesh is a tiny electrical network that senses as the skin stretches and bends and, using AI, the researchers can interpret myriad daily tasks from hand motions and gestures. The researchers say it could have applications and implications in fields as far-ranging as gaming, sports, telemedicine, and robotics.<\/p>\n<p>So far, several promising methods, such as measuring muscle electrical activities using wrist bands or wearable gloves, have been actively explored to enable various hand tasks and gesturing. However, these devices are bulky as multiple sensory components are needed to pinpoint movements at every single joint. Moreover, a large amount of data needs to be collected for each user and task in order to train the algorithm. These challenges make it difficult to adopt such devices as daily-use electronics. <\/p>\n<p>This work is the first practical approach that is both lean enough in form and adaptable enough in function to work for essentially any user\u2014even with limited data. Current technologies require multiple sensor components to read each joint of the finger, making them bulky. The new device also takes a leaner approach to software to allow faster learning. Such precision could be key in virtual reality applications to convey finely detailed motions for a more realistic experience. <\/p>\n<figure class=\"mb-4\" itemscope=\"\" itemtype=\"http:\/\/schema.org\/VideoObject\"><meta itemprop=\"name\" content=\"Spray-on smart skin uses AI to rapidly understand hand tasks\"\/><meta itemprop=\"url\" content=\"https:\/\/www.youtube.com\/watch\/?v=IwDLC8t0VBc\"\/><meta itemprop=\"description\" content=\"Credit:  Nature Electronics  (2022). DOI: 10.1038\/s41928-022-00888-7\"\/><meta itemprop=\"uploadDate\" content=\"2022-12-28T17:24:22-05:00\"\/><meta itemprop=\"embedUrl\" content=\"https:\/\/www.youtube.com\/embed\/IwDLC8t0VBc\"\/><meta itemprop=\"thumbnailUrl\" content=\"https:\/\/img.youtube.com\/vi\/IwDLC8t0VBc\/maxresdefault.jpg\"\/><br \/>\n             <iframe loading=\"lazy\" title=\"Spray-on smart skin uses AI to rapidly understand hand tasks\" width=\"640\" height=\"360\" src=\"https:\/\/www.youtube.com\/embed\/IwDLC8t0VBc?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" referrerpolicy=\"strict-origin-when-cross-origin\" allowfullscreen><\/iframe><figcaption class=\"text-darken text-low-up mt-4\" itemprop=\"caption\">Credit: <i>Nature Electronics<\/i> (2022). DOI: 10.1038\/s41928-022-00888-7<\/figcaption><\/figure>\n<p>The enabling innovation is a sprayable electrically sensitive mesh network embedded in polyurethane\u2014the same durable-yet-stretchable material used to make skateboard wheels and to protect hardwood floors from damage. The mesh is comprised of millions of nanowires of silver coated with gold that are in contact with each other to form dynamic electrical pathways. This mesh is electrically active, biocompatible, breathable, and stays on unless rubbed in soap and water. It conforms intimately to the wrinkles and folds of each human finger that wears it. Then a light-weight Bluetooth module can be simply attached to the mesh which can wirelessly transfer the signal changes.<br \/>\n                                            <!-- Google middle Adsense block --><\/p>\n<p>&#8220;As the fingers bend and twist, the nanowires in the mesh get squeezed together and stretched apart, changing the electrical conductivity of the mesh. These changes can be measured and analyzed to tell us precisely how a hand or a finger or a joint is moving,&#8221; explained Zhenan Bao, a K.K. Lee Professor of Chemical Engineering and senior author of the study.<\/p>\n<p>The researchers chose a spray-on approach directly on skin so that the mesh is supported without a substrate. This key engineering decision eliminated unwanted motion artifacts and allowed them to use a single trace of conductive mesh to generate multi-joint information of the fingers.<\/p>\n<div class=\"article-gallery lightGallery\">\n<div data-thumb=\"https:\/\/scx1.b-cdn.net\/csz\/news\/tmb\/2022\/spray-on-smart-skin-us-1.jpg\" data-src=\"https:\/\/scx2.b-cdn.net\/gfx\/news\/hires\/2022\/spray-on-smart-skin-us-1.jpg\" data-sub-html=\"Two-handed QWERTY keyboard typing recognition with nanomesh printed on both hands and real-time recognition of interacting objects. Credit: Kyun Kyu \u201cRichard\u201d Kim, Bao Group, Stanford U.\">\n<figure class=\"article-img text-center\"><img decoding=\"async\" src=\"https:\/\/scx1.b-cdn.net\/csz\/news\/800a\/2022\/spray-on-smart-skin-us-1.jpg\" alt=\"Spray-on smart skin uses AI to rapidly understand hand tasks\"\/><figcaption class=\"text-left text-darken text-truncate text-low-up mt-3\">\n                Two-handed QWERTY keyboard typing recognition with nanomesh printed on both hands and real-time recognition of interacting objects. Credit: Kyun Kyu \u201cRichard\u201d Kim, Bao Group, Stanford U.<br \/>\n            <\/figcaption><\/figure>\n<\/div>\n<\/div>\n<p>The spray-on nature of the device allows it to conform to any size or shaped hand, but opens the possibility that the device could be adapted to the face to capture subtle emotional cues. That might enable new approaches to computer animation or lead to new avatar-led virtual meetings with more realistic facial expressions and hand gestures.<\/p>\n<p>Machine learning then takes over. Computers monitor the changing patterns in conductivity and map those changes to specific physical tasks and gestures. Type an X on a keyboard, for instance, and the algorithm learns to recognize that task from the changing patterns in the electrical conductivity. Once the algorithm is suitably trained, the physical keyboard is no longer necessary. The same principles can be used to recognize sign language or even to recognize objects by tracing their exterior surfaces.<\/p>\n<p>And, whereas existing technologies are computationally intensive and require vast amounts of data that must be laboriously labeled by humans\u2014by hand, if you will\u2014the Stanford team has developed a learning scheme that is far more computationally efficient.<\/p>\n<p>&#8220;We brought the aspects of human learning that rapidly adapt to tasks with only a handful of trials known as &#8216;meta-learning.&#8217; This allows the device to rapidly recognize arbitrary new hand tasks and users with a few quick trials,&#8221; said Kyun Kyu &#8220;Richard&#8221; Kim, a post-doctoral scholar in Bao&#8217;s lab, who is first author of the study.<\/p>\n<p>&#8220;Moreover, it&#8217;s a surprisingly simple approach to this complex challenge that means we can achieve faster computational processing time with less data because our nanomesh captures subtle details in its signals,&#8221; Kim added. The precision with which the device can map subtle motions of the fingers is one of the leading features of this innovation. <\/p>\n<p>The researchers have built a prototype that recognizes simple objects by touch and can even do predictive two-handed typing on an invisible keyboard. The algorithm was able to type, &#8220;No legacy is so rich as honesty&#8221; from William Shakespeare and &#8220;I am the master of my fate, I am the captain of my soul&#8221; from William Ernest Henley&#8217;s poem &#8220;Invictus.&#8221;\n                                                                                                                            <\/p>\n<div class=\"article-main__more p-4\">\n                                                                                                <strong>More information:<\/strong><br \/>\n                                                Kyun Kyu Kim et al, A substrate-less nanomesh receptor with meta-learning for rapid hand task recognition, <i>Nature Electronics<\/i> (2022).  <a rel=\"nofollow noopener\" target=\"_blank\" data-doi=\"1\" href=\"https:\/\/dx.doi.org\/10.1038\/s41928-022-00888-7\">DOI: 10.1038\/s41928-022-00888-7<\/a><\/p><\/div>\n<div class=\"d-inline-block text-medium my-4\">\n                                                Provided by<br \/>\n                                                                                                    Stanford University<br \/>\n                                                                                                        <a rel=\"nofollow noopener\" target=\"_blank\" class=\"icon_open\" href=\"http:\/\/www.stanford.edu\/\"><br \/>\n                                                        <svg><use href=\"https:\/\/techx.b-cdn.net\/tmpl\/v2\/img\/svg\/sprite.svg#icon_open\" x=\"0\" y=\"0\"\/><\/svg><\/a><\/p><\/div>\n<p>                                        <!-- print only --><\/p>\n<div class=\"d-none d-print-block\">\n<p>                                                <strong>Citation<\/strong>:<br \/>\n                                                Spray-on smart skin uses AI to rapidly understand hand tasks (2022, December 28)<br \/>\n                                                retrieved 29 December 2022<br \/>\n                                                from https:\/\/techxplore.com\/<a href=\"https:\/\/buradabiliyorum.com\/en\/category\/news\/\" data-internallinksmanager029f6b8e52c=\"2\" title=\"News\" target=\"_blank\" rel=\"noopener\">news<\/a>\/2022-12-spray-on-smart-skin-ai-rapidly.html<\/p>\n<p>                                            This document is subject to copyright. Apart from any fair dealing for the purpose of private study or research, no<br \/>\n                                            part may be reproduced without the written permission. The content is provided for information purposes only.<\/p><\/div>\n<\/p><\/div>\n<p><script id=\"facebook-jssdk\" async=\"\" src=\"https:\/\/connect.facebook.net\/en_US\/sdk.js\"><\/script><\/p>\n<blockquote><p><strong><span style=\"color: #ff6600;\">If you liked the article, do not forget to share it with your friends. Follow us on\u00a0<span style=\"color: #ff0000;\"><a style=\"color: #ff0000;\" href=\"https:\/\/news.google.com\/publications\/CAAqBwgKMLG0nwswvr63Aw\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">Google News<\/a><\/span>\u00a0too, click on the star and choose us from your favorites.<\/span><\/strong><\/p><\/blockquote>\n<blockquote>\n<p style=\"text-align: center;\">For forums sites go to <span style=\"color: #ff9900;\"><a style=\"color: #ff9900;\" href=\"https:\/\/forum.buradabiliyorum.com\/\" target=\"_blank\" rel=\"noopener\">Forum.BuradaBiliyorum.Com<\/a><\/span><\/strong>\n<\/p><\/blockquote>\n<blockquote>\n<p style=\"text-align: center;\"><strong>If you want to read more Like this articles, you can visit our <span style=\"color: #ff9900;\"><a style=\"color: #ff9900;\" href=\"https:\/\/en.buradabiliyorum.com\/science\/\" target=\"_blank\" rel=\"noopener\">Science category.<\/a><\/span><\/strong><\/p>\n<\/blockquote>\n<p><span style=\"color: black;\"><a style=\"color: #ff9900;\" href=\"https:\/\/techxplore.com\/news\/2022-12-spray-on-smart-skin-ai-rapidly.html\" target=\"_blank\" rel=\"noopener\">Source<\/a><\/span><\/p>\n","protected":false},"excerpt":{"rendered":"<p>&#8220;Spray-on smart skin uses AI to rapidly understand hand tasks&#8221; Spray-on sensory system which consists of printed, bio-compatible nanomesh directly connected with wireless Bluetooth module and further trained through meta-learning. Credit: Kyun Kyu \u201cRichard\u201d Kim, Bao Group, Stanford U. A new smart skin developed at Stanford University might foretell a day when people type on&#8230;<\/p>\n","protected":false},"author":1,"featured_media":532258,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"fifu_image_url":"https:\/\/scx2.b-cdn.net\/gfx\/news\/hires\/2022\/spray-on-smart-skin-us.jpg","fifu_image_alt":"","footnotes":""},"categories":[16],"tags":[],"class_list":["post-532257","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-sciencee"],"_links":{"self":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/posts\/532257","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/comments?post=532257"}],"version-history":[{"count":0,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/posts\/532257\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/media\/532258"}],"wp:attachment":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/media?parent=532257"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/categories?post=532257"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/tags?post=532257"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}