{"id":612850,"date":"2024-03-15T13:50:01","date_gmt":"2024-03-15T10:50:01","guid":{"rendered":"https:\/\/en.buradabiliyorum.com\/a-system-that-allows-home-robots-to-cook-in-collaboration-with-humans\/"},"modified":"2024-03-15T13:50:01","modified_gmt":"2024-03-15T10:50:01","slug":"a-system-that-allows-home-robots-to-cook-in-collaboration-with-humans","status":"publish","type":"post","link":"https:\/\/buradabiliyorum.com\/en\/a-system-that-allows-home-robots-to-cook-in-collaboration-with-humans\/","title":{"rendered":"#A system that allows home robots to cook in collaboration with humans"},"content":{"rendered":"<div>\n<div class=\"article-gallery lightGallery\">\n<div data-thumb=\"https:\/\/scx1.b-cdn.net\/csz\/news\/tmb\/2024\/a-system-that-allows-h.jpg\" data-src=\"https:\/\/scx2.b-cdn.net\/gfx\/news\/hires\/2024\/a-system-that-allows-h.jpg\" data-sub-html=\"The researchers evaluated their robot on multiple recipes. Credit: Wang et al.\">\n<figure class=\"article-img\"><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/scx1.b-cdn.net\/csz\/news\/800a\/2024\/a-system-that-allows-h.jpg\" alt=\"A system that allows home robots to cook in collaboration with humans\" title=\"The researchers evaluated their robot on multiple recipes. Credit: Wang et al.\" width=\"800\" height=\"356\"\/><figcaption class=\"text-darken text-low-up text-truncate-js text-truncate mt-3\">\n                The researchers evaluated their robot on multiple recipes. Credit: Wang et al.<br \/>\n            <\/figcaption><\/figure>\n<\/div>\n<\/div>\n<p>Home robots could assist humans with the completion of various chores and manual tasks, ranging from washing dishes or doing the laundry to cooking, cleaning and tidying up. While many roboticists and computer scientists have tried to improve the skills of home robots in recent years, many of the robots developed so far are still unable to tackle more complex and creative tasks, such as cooking in collaboration with human users.<\/p>\n<p>Researchers at Cornell University have recently developed MOSAIC, a modular architecture that allows robots to perform complex household tasks that involve closely interacting with humans, including interactive cooking. This system, introduced in a paper <a rel=\"nofollow noopener\" target=\"_blank\" href=\"https:\/\/arxiv.org\/abs\/2402.18796\">published<\/a> on the <i>arXiv<\/i> preprint server, was tested in a <a href=\"https:\/\/buradabiliyorum.com\/en\/category\/watch-movies-tv-seriess\/\" data-internallinksmanager029f6b8e52c=\"8\" title=\"Watch Movies &amp; TV Series\" target=\"_blank\" rel=\"noopener\">series<\/a> of real-world experiments, showing that it could support humans with cooking various recipes.<\/p>\n<p>&#8220;We present MOSAIC, a modular architecture for home robots to perform complex collaborative tasks, such as cooking with everyday users,&#8221; Huaxiaoyue Wang, Kushal Kedia and their colleagues wrote in their paper. &#8220;MOSAIC tightly collaborates with humans, interacts with users using natural language, coordinates multiple robots, and manages an open vocabulary of everyday objects.&#8221;<\/p>\n<figure class=\"mb-4\" itemscope=\"\" itemtype=\"http:\/\/schema.org\/VideoObject\"><meta itemprop=\"name\" content=\"A system that allows home robots to cook in collaboration with humans\"\/><meta itemprop=\"url\" content=\"https:\/\/www.youtube.com\/watch\/?v=jKp-RqNlW90\"\/><meta itemprop=\"description\" content=\"A system that allows home robots to cook in collaboration with humans\"\/><meta itemprop=\"uploadDate\" content=\"2024-03-14T13:21:15-04:00\"\/><meta itemprop=\"embedUrl\" content=\"https:\/\/www.youtube.com\/embed\/jKp-RqNlW90\"\/><meta itemprop=\"thumbnailUrl\" content=\"https:\/\/img.youtube.com\/vi\/jKp-RqNlW90\/maxresdefault.jpg\"\/><br \/>\n             <iframe loading=\"lazy\" title=\"MOSAIC End-to-end Run\" width=\"640\" height=\"360\" src=\"https:\/\/www.youtube.com\/embed\/jKp-RqNlW90?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" referrerpolicy=\"strict-origin-when-cross-origin\" allowfullscreen><\/iframe><\/p>\n<\/figure>\n<p>The researchers&#8217; proposed system is modular, which means that it is comprised of different parts or modules that tackle different aspects of the task at hand. The system&#8217;s components can be broadly divided into an interactive task planner, an architecture for identifying objects and planning the movements of robots and a model designed to predict the movements of humans.<\/p>\n<p>&#8220;At its core, MOSAIC employs modularity: It leverages multiple large-scale pre-trained models for <a href=\"https:\/\/buradabiliyorum.com\/en\/category\/general\/\" data-internallinksmanager029f6b8e52c=\"3\" title=\"General\" target=\"_blank\" rel=\"noopener\">general<\/a> tasks like language and image recognition, while using streamlined modules designed for task-specific control,&#8221; the researchers explained in their paper.<\/p>\n<p>                                                                                                        <!-- TechX - News - In-article --><\/p>\n<p>                                                                                                                                            Wang, Kedia and their colleagues have so far evaluated their system&#8217;s performance in 60 experimental trials, using two different robotic systems, namely the mobile manipulator Stretch Robot RE1 and the tabletop manipulator Franka Emilka Research 3. During these trials, the two robotic manipulators closely collaborated with a human user to prepare six relatively simple recipes, including two different types of salad, three different types of soup, and a tuna sandwich.<\/p>\n<p>&#8220;We also extensively test individual modules with 180 episodes of visuomotor picking, 60 episodes of human motion forecasting and 46 online user evaluations of the task planner,&#8221; the researchers wrote. &#8220;We show that MOSAIC is able to efficiently collaborate with humans by running the overall system end-to-end with a real human user, completing 68.3%(41\/60) collaborative cooking trials of 6 different recipes with a subtask completion rate of 91.6%.&#8221;<\/p>\n<p>In the interactive cooking experiments carried out by the researchers, MOSAIC performed considerably well, successfully completing <a href=\"https:\/\/buradabiliyorum.com\/en\/category\/download-scripts-themes-apps\/\" data-internallinksmanager029f6b8e52c=\"9\" title=\"Download Scripts &amp; Themes &amp; Apps\" target=\"_blank\" rel=\"noopener\">app<\/a>roximately two-thirds of the recipes it prepared with humans. MOSAIC could soon serve as an inspiration for other research studies, thus contributing to the advancement of assistive robotic systems designed to be deployed in household environments.<\/p>\n<ul class=\"article-gallery js-article-gallery\">\n<li data-thumb=\"https:\/\/scx1.b-cdn.net\/csz\/news\/tmb\/2024\/a-system-that-allows-h-1.jpg\" data-src=\"https:\/\/scx2.b-cdn.net\/gfx\/news\/hires\/2024\/a-system-that-allows-h-1.jpg\" data-sub-html=\"Overview of the system developed by the researchers. Credit: Wang et al.\">\n<figure class=\"article-img text-center\"><img decoding=\"async\" src=\"https:\/\/scx1.b-cdn.net\/csz\/news\/800\/2024\/a-system-that-allows-h-1.jpg\" alt=\"A system that allows home robots to cook in collaboration with humans\"\/><figcaption class=\"text-left text-darken text-low-up text-truncate mt-3\">\n                    Overview of the system developed by the researchers. Credit: Wang et al.<br \/>\n                <\/figcaption><\/figure>\n<\/li>\n<li data-thumb=\"https:\/\/scx1.b-cdn.net\/csz\/news\/tmb\/2024\/a-system-that-allows-h-2.jpg\" data-src=\"https:\/\/scx2.b-cdn.net\/gfx\/news\/hires\/2024\/a-system-that-allows-h-2.jpg\" data-sub-html=\"The system's interactive task planning interface. Credit: Wang et al.\">\n<figure class=\"article-img text-center\"><img decoding=\"async\" src=\"https:\/\/scx1.b-cdn.net\/csz\/news\/800\/2024\/a-system-that-allows-h-2.jpg\" alt=\"A system that allows home robots to cook in collaboration with humans\"\/><figcaption class=\"text-left text-darken text-low-up text-truncate mt-3\">\n                    The system&#8217;s interactive task planning interface. Credit: Wang et al.<br \/>\n                <\/figcaption><\/figure>\n<\/li>\n<\/ul>\n<p>In the future, Wang, Kedia and their colleagues could further improve some of their system&#8217;s underlying components, to further boost its performance in both collaborative cooking and other interactive tasks. For instance, the system has currently been found to perform well on simple manual subtasks, such as picking up and moving objects, but it has not yet been applied to more advanced subtasks. This limitation could be tackled and improved in their next studies.<\/p>\n<p>&#8220;The extension to more intricate tasks such as cutting, rolling, and spreading is less trivial,&#8221; the researchers wrote in their paper. &#8220;While our system is tested extensively on different recipes, our experiments are restricted to one kitchen environment. Future work will attempt to measure the limits of our system&#8217;s generalization capability in the face of a wider range of kitchen environments.&#8221;<\/p>\n<div class=\"article-main__more p-4\">\n                                                                                                <strong>More information:<\/strong><br \/>\n                                                Huaxiaoyue Wang et al, MOSAIC: A Modular System for Assistive and Interactive Cooking, <i>arXiv<\/i> (2024). <a rel=\"nofollow noopener\" target=\"_blank\" data-doi=\"1\" href=\"https:\/\/dx.doi.org\/10.48550\/arxiv.2402.18796\">DOI: 10.48550\/arxiv.2402.18796<\/a><\/p>\n<div class=\"mt-3\">\n                                                    <strong>Journal information:<\/strong><br \/>\n                                                                                                            <cite>arXiv<\/cite><br \/>\n                                                        <a rel=\"nofollow noopener\" target=\"_blank\" class=\"icon_open\" href=\"http:\/\/arxiv.org\/\"><br \/>\n                                                            <svg><use href=\"https:\/\/techx.b-cdn.net\/tmpl\/v2\/img\/svg\/sprite.svg#icon_open\" x=\"0\" y=\"0\"\/><\/svg><\/a>\n                                                                                                    <\/div>\n<\/p><\/div>\n<p class=\"article-main__note mt-4\">\n                                                \u00a9 2024 <a href=\"https:\/\/buradabiliyorum.com\/en\/category\/sciencee\/\" data-internallinksmanager029f6b8e52c=\"5\" title=\"Science\" target=\"_blank\" rel=\"noopener\">Science<\/a> X Network<\/p>\n<p>                                        <!-- print only --><\/p>\n<div class=\"d-none d-print-block\">\n<p>                                                <strong>Citation<\/strong>:<br \/>\n                                                A system that allows home robots to cook in collaboration with humans (2024, March 15)<br \/>\n                                                retrieved 15 March 2024<br \/>\n                                                from https:\/\/techxplore.com\/<a href=\"https:\/\/buradabiliyorum.com\/en\/category\/news\/\" data-internallinksmanager029f6b8e52c=\"2\" title=\"News\" target=\"_blank\" rel=\"noopener\">news<\/a>\/2024-03-home-robots-cook-collaboration-humans.html<\/p>\n<p>                                            This document is subject to copyright. Apart from any fair dealing for the purpose of private study or research, no<br \/>\n                                            part may be reproduced without the written permission. The content is provided for information purposes only.<\/p><\/div>\n<\/p><\/div>\n<p><script id=\"facebook-jssdk\" async=\"\" src=\"https:\/\/connect.facebook.net\/en_US\/sdk.js\"><\/script><\/p>\n<blockquote><p><strong><span style=\"color: #ff6600;\">If you liked the article, do not forget to share it with your friends. Follow us on\u00a0<span style=\"color: #ff0000;\"><a style=\"color: #ff0000;\" href=\"https:\/\/news.google.com\/publications\/CAAqBwgKMN63nwsw68G3Aw\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">Google News<\/a><\/span>\u00a0too, click on the star and choose us from your favorites.<\/span><\/strong><\/p><\/blockquote>\n<blockquote>\n<p style=\"text-align: center;\"><strong>If you want to read more Like this articles, you can visit our <span style=\"color: #ff9900;\"><a style=\"color: #ff9900;\" href=\"https:\/\/en.buradabiliyorum.com\/science\/\" target=\"_blank\" rel=\"noopener\">Science category.<\/a><\/span><\/strong><\/p>\n<\/blockquote>\n<p><span style=\"color: black;\"><a style=\"color: #ff9900;\" href=\"https:\/\/techxplore.com\/news\/2024-03-home-robots-cook-collaboration-humans.html\" target=\"_blank\" rel=\"noopener\">Source<\/a><\/span><\/p>\n","protected":false},"excerpt":{"rendered":"<p>The researchers evaluated their robot on multiple recipes. Credit: Wang et al. Home robots could assist humans with the completion of various chores and manual tasks, ranging from washing dishes or doing the laundry to cooking, cleaning and tidying up. While many roboticists and computer scientists have tried to improve the skills of home robots&#8230;<\/p>\n","protected":false},"author":1,"featured_media":612851,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"fifu_image_url":"https:\/\/scx2.b-cdn.net\/gfx\/news\/hires\/2024\/a-system-that-allows-h.jpg","fifu_image_alt":"","footnotes":""},"categories":[16],"tags":[],"class_list":["post-612850","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-sciencee"],"_links":{"self":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/posts\/612850","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/comments?post=612850"}],"version-history":[{"count":0,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/posts\/612850\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/media\/612851"}],"wp:attachment":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/media?parent=612850"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/categories?post=612850"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/tags?post=612850"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}