{"id":283108,"date":"2021-06-24T21:37:23","date_gmt":"2021-06-24T18:37:23","guid":{"rendered":"https:\/\/en.buradabiliyorum.com\/nvidia-ai-lets-you-make-video-calls-in-your-pjs-without-anyone-knowing\/"},"modified":"2021-06-24T21:37:23","modified_gmt":"2021-06-24T18:37:23","slug":"nvidia-ai-lets-you-make-video-calls-in-your-pjs-without-anyone-knowing","status":"publish","type":"post","link":"https:\/\/buradabiliyorum.com\/en\/nvidia-ai-lets-you-make-video-calls-in-your-pjs-without-anyone-knowing\/","title":{"rendered":"#Nvidia AI lets you make video calls in your PJs without anyone knowing"},"content":{"rendered":"<div id=\"ez-toc-container\" class=\"ez-toc-v2_0_84 counter-hierarchy ez-toc-counter ez-toc-custom ez-toc-container-direction\">\n<p class=\"ez-toc-title\" style=\"cursor:inherit\">Table of Contents<\/p>\n<label for=\"ez-toc-cssicon-toggle-item-6a2f0f213f6c3\" class=\"ez-toc-cssicon-toggle-label\"><span class=\"\"><span class=\"eztoc-hide\" style=\"display:none;\">Toggle<\/span><span class=\"ez-toc-icon-toggle-span\"><svg style=\"fill: #dd3333;color:#dd3333\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" class=\"list-377408\" width=\"20px\" height=\"20px\" viewBox=\"0 0 24 24\" fill=\"none\"><path d=\"M6 6H4v2h2V6zm14 0H8v2h12V6zM4 11h2v2H4v-2zm16 0H8v2h12v-2zM4 16h2v2H4v-2zm16 0H8v2h12v-2z\" fill=\"currentColor\"><\/path><\/svg><svg style=\"fill: #dd3333;color:#dd3333\" class=\"arrow-unsorted-368013\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"10px\" height=\"10px\" viewBox=\"0 0 24 24\" version=\"1.2\" baseProfile=\"tiny\"><path d=\"M18.2 9.3l-6.2-6.3-6.2 6.3c-.2.2-.3.4-.3.7s.1.5.3.7c.2.2.4.3.7.3h11c.3 0 .5-.1.7-.3.2-.2.3-.5.3-.7s-.1-.5-.3-.7zM5.8 14.7l6.2 6.3 6.2-6.3c.2-.2.3-.5.3-.7s-.1-.5-.3-.7c-.2-.2-.4-.3-.7-.3h-11c-.3 0-.5.1-.7.3-.2.2-.3.5-.3.7s.1.5.3.7z\"\/><\/svg><\/span><\/span><\/label><input type=\"checkbox\"  id=\"ez-toc-cssicon-toggle-item-6a2f0f213f6c3\" checked aria-label=\"Toggle\" \/><nav><ul class='ez-toc-list ez-toc-list-level-1 ' ><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-1\" href=\"https:\/\/buradabiliyorum.com\/en\/nvidia-ai-lets-you-make-video-calls-in-your-pjs-without-anyone-knowing\/#GANimated_video\" >GANimated video<\/a><\/li><\/ul><\/nav><\/div>\n<p>&#8220;<strong>#Nvidia AI lets you make video calls in your PJs without anyone knowing<\/strong>&#8221;<\/p>\n<div>Nvidia has unveiled an AI model that converts a single 2D image of a person into a \u201ctalking head\u201d video.<\/p>\n<p>Known as Vid2Vid Cameo, the deep learning model is designed to improve the experience of videoconferencing.<\/p>\n<p>If you\u2019re running late for a call, you could roll out of bed in your pajamas and disheveled hair,\u00a0 upload a photo of you dressed to impress, and the AI will map your facial movements to the reference image \u2014 leaving the other attendees unaware of the chaos behind the camera. That could be a boon for the\u00a0chronically unkempt, but you should probably test the technique before you turn up in your birthday suit.<\/p>\n<p>The system can also adjust your talking head\u2019s viewpoint to show you looking straight at the screen, when secretly your eyes are fixed on a TV in the background.<\/p>\n<p><em>[Read:\u00a0<span class=\"c-message_attachment__title\"><span dir=\"auto\">Why entrepreneurship in emerging markets matters<\/span><span aria-label=\"(opens in new tab)\"\/><\/span>]<\/em><\/p>\n<p>They sound like nifty features for those of us who dread video calls, but the most useful aspect of the model may be bandwidth reduction. Nvidia says the technique can cut the bandwidth needed for video conferences by up to 10x.<\/p>\n<h2><span class=\"ez-toc-section\" id=\"GANimated_video\"><\/span>GANimated video<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p>Vid2Vid Cameo is powered by<span>\u00a0generative adversarial networks (GANs)<\/span><span>, which produce the videos by pitting two neural networks against each other:\u00a0a generator that tries to create realistic-looking samples, and a discriminator that attempts to work out whether they\u2019re real or fake.<\/span><\/p>\n<p>This enables the two networks to synthesize realistic videos from a single image of the user, which could be a real photo or a cartoon avatar. During the video call, the model will capture their real-time motion and <a href=\"https:\/\/buradabiliyorum.com\/en\/category\/download-scripts-themes-apps\/\" data-internallinksmanager029f6b8e52c=\"9\" title=\"Download Scripts &amp; Themes &amp; Apps\" target=\"_blank\" rel=\"noopener\">app<\/a>ly it to the uploaded image.<\/p>\n<p><iframe loading=\"lazy\" title=\"NVIDIA Vid2Vid Cameo Mission AI Possible: NVIDIA Researchers Stealing the Show\" width=\"640\" height=\"360\" src=\"https:\/\/www.youtube.com\/embed\/xzLHZbBvKNQ?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" referrerpolicy=\"strict-origin-when-cross-origin\" allowfullscreen><\/iframe><\/p>\n<p>The model was trained on a dataset of 180,000 talking-head videos, which taught the network to identify 20 key points that encode the location of features including the mouth, eyes, and nose.<\/p>\n<p>These points are then extracted from the image uploaded by the user to generate a video that mimics their appearance.<\/p>\n<p>The model will be available soon in the\u00a0Nvidia Maxine SDK and Nvidia Video Code SDK, but you can already try a demo of it <a rel=\"nofollow noopener\" target=\"_blank\" href=\"http:\/\/nvidia-research-mingyuliu.com\/vid2vid-cameo\/\">here<\/a>. I gave it a go, and was pretty impressed by the system\u2019s efforts \u2014 although I wouldn\u2019t let it cut my hair.<\/p>\n<figure class=\"post-image post-mediaBleed aligncenter\"><img loading=\"lazy\" decoding=\"async\" class=\"size-full wp-image-1358172 js-lazy\" alt=\"Vid2Vid Cameo is one of one of the deep learning models behind the Nvidia Maxine SDK for video conferencing.\" width=\"984\" height=\"548\" sizes=\"auto, (max-width: 984px) 100vw, 984px\" src=\"https:\/\/cdn0.tnwcdn.com\/wp-content\/blogs.dir\/1\/files\/2021\/06\/Screenshot-2021-06-24-at-17.07.50.png\" srcset=\"https:\/\/cdn0.tnwcdn.com\/wp-content\/blogs.dir\/1\/files\/2021\/06\/Screenshot-2021-06-24-at-17.07.50.png 984w, https:\/\/cdn0.tnwcdn.com\/wp-content\/blogs.dir\/1\/files\/2021\/06\/Screenshot-2021-06-24-at-17.07.50-280x156.png 280w, https:\/\/cdn0.tnwcdn.com\/wp-content\/blogs.dir\/1\/files\/2021\/06\/Screenshot-2021-06-24-at-17.07.50-485x270.png 485w, https:\/\/cdn0.tnwcdn.com\/wp-content\/blogs.dir\/1\/files\/2021\/06\/Screenshot-2021-06-24-at-17.07.50-242x135.png 242w, https:\/\/cdn0.tnwcdn.com\/wp-content\/blogs.dir\/1\/files\/2021\/06\/Screenshot-2021-06-24-at-17.07.50-796x443.png 796w\"\/><figcaption><a rel=\"nofollow noopener\" target=\"_blank\" href=\"https:\/\/thenextweb.com\/news\/#\" data-url=\"https:\/\/twitter.com\/intent\/tweet?url=https%3A%2F%2Feditorial.thenextweb.com%2Fneural%2F2021%2F06%2F24%2Fnvidias-vid2vid-cameo-ai-turns-image-into-talking-head-video-videoconferencing%2F&amp;via=thenextweb&amp;related=thenextweb&amp;text=Check out this picture on: My talking head spotted a barbershop in the distance.\" data-title=\"Share My talking head spotted a barbershop in the distance. on Twitter\" data-width=\"685\" data-height=\"500\" class=\"post-image-share popitup\" title=\"Share My talking head spotted a barbershop in the distance. on Twitter\"><i class=\"icon icon--inline icon--twitter--dark\"\/><\/a>My talking head spotted a barbershop in the distance.<\/figcaption><noscript><img loading=\"lazy\" decoding=\"async\" class=\"size-full wp-image-1358172\" src=\"https:\/\/cdn0.tnwcdn.com\/wp-content\/blogs.dir\/1\/files\/2021\/06\/Screenshot-2021-06-24-at-17.07.50.png\" alt=\"Vid2Vid Cameo is one of one of the deep learning models behind the Nvidia Maxine SDK for video conferencing.\" width=\"984\" height=\"548\" srcset=\"https:\/\/cdn0.tnwcdn.com\/wp-content\/blogs.dir\/1\/files\/2021\/06\/Screenshot-2021-06-24-at-17.07.50.png 984w, https:\/\/cdn0.tnwcdn.com\/wp-content\/blogs.dir\/1\/files\/2021\/06\/Screenshot-2021-06-24-at-17.07.50-280x156.png 280w, https:\/\/cdn0.tnwcdn.com\/wp-content\/blogs.dir\/1\/files\/2021\/06\/Screenshot-2021-06-24-at-17.07.50-485x270.png 485w, https:\/\/cdn0.tnwcdn.com\/wp-content\/blogs.dir\/1\/files\/2021\/06\/Screenshot-2021-06-24-at-17.07.50-242x135.png 242w, https:\/\/cdn0.tnwcdn.com\/wp-content\/blogs.dir\/1\/files\/2021\/06\/Screenshot-2021-06-24-at-17.07.50-796x443.png 796w\"\/><\/noscript><\/figure>\n<p>You can read a research paper on the technique <a rel=\"nofollow noopener\" target=\"_blank\" href=\"https:\/\/arxiv.org\/pdf\/2011.15126.pdf\">here<\/a>.<\/p>\n<p><em>Greetings Humanoids! Did you know we have a <a href=\"https:\/\/buradabiliyorum.com\/en\/category\/news\/\" data-internallinksmanager029f6b8e52c=\"2\" title=\"News\" target=\"_blank\" rel=\"noopener\">news<\/a>letter all about AI? You can subscribe to it\u00a0<a rel=\"nofollow noopener\" target=\"_blank\" href=\"https:\/\/share.hsforms.com\/1kUPK28s-Ro67GKE8E65Zwg47gef\">right here<\/a>.<\/em><\/p>\n<\/div>\n<p><script async src=\"\/\/platform.twitter.com\/widgets.js\" charset=\"utf-8\"><\/script><\/p>\n<blockquote><p><strong><span style=\"color: #ff6600;\">If you liked the article, do not forget to share it with your friends. Follow us on\u00a0<span style=\"color: #ff0000;\"><a style=\"color: #ff0000;\" href=\"https:\/\/news.google.com\/publications\/CAAqBwgKMLG0nwswvr63Aw\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">Google News<\/a><\/span>\u00a0too, click on the star and choose us from your favorites.<\/span><\/strong><\/p><\/blockquote>\n<blockquote>\n<p style=\"text-align: center;\">For forums sites go to <span style=\"color: #ff9900;\"><a style=\"color: #ff9900;\" href=\"https:\/\/forum.buradabiliyorum.com\/\" target=\"_blank\" rel=\"noopener\">Forum.BuradaBiliyorum.Com<\/a><\/span><\/strong>\n<\/p><\/blockquote>\n<blockquote>\n<p style=\"text-align: center;\"><strong>If you want to read more like this article, you can visit our <span style=\"color: #ff9900;\"><a style=\"color: #ff9900;\" href=\"https:\/\/en.buradabiliyorum.com\/technology\/\" target=\"_blank\" rel=\"noopener\">Technology category.<\/a><\/span><\/strong><\/p>\n<\/blockquote>\n<p><span style=\"color: black;\"><a style=\"color: #ff9900;\" href=\"https:\/\/thenextweb.com\/news\/nvidias-vid2vid-cameo-ai-turns-image-into-talking-head-video-videoconferencing\" target=\"_blank\" rel=\"noopener\">Source<\/a><\/span><\/p>\n","protected":false},"excerpt":{"rendered":"<p>&#8220;#Nvidia AI lets you make video calls in your PJs without anyone knowing&#8221; Nvidia has unveiled an AI model that converts a single 2D image of a person into a \u201ctalking head\u201d video. Known as Vid2Vid Cameo, the deep learning model is designed to improve the experience of videoconferencing. If you\u2019re running late for a&#8230;<\/p>\n","protected":false},"author":1,"featured_media":283109,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"fifu_image_url":"https:\/\/img-cdn.tnwcdn.com\/image\/neural?filter_last=1&fit=1280,640&url=https:\/\/cdn0.tnwcdn.com\/wp-content\/blogs.dir\/1\/files\/2021\/06\/Untitled-design-7-2.jpg&signature=74865486652a3c4fe4df1165be58f01a","fifu_image_alt":"","footnotes":""},"categories":[18],"tags":[],"class_list":["post-283108","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-technology"],"_links":{"self":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/posts\/283108","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/comments?post=283108"}],"version-history":[{"count":0,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/posts\/283108\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/media\/283109"}],"wp:attachment":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/media?parent=283108"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/categories?post=283108"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/tags?post=283108"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}