{"id":466223,"date":"2022-06-21T17:23:27","date_gmt":"2022-06-21T14:23:27","guid":{"rendered":"https:\/\/en.buradabiliyorum.com\/nvidias-new-ai-magic-turns-2d-photos-into-3d-graphics\/"},"modified":"2022-06-21T17:23:27","modified_gmt":"2022-06-21T14:23:27","slug":"nvidias-new-ai-magic-turns-2d-photos-into-3d-graphics","status":"publish","type":"post","link":"https:\/\/buradabiliyorum.com\/en\/nvidias-new-ai-magic-turns-2d-photos-into-3d-graphics\/","title":{"rendered":"#Nvidia\u2019s new AI magic turns 2D photos into 3D graphics"},"content":{"rendered":"<div id=\"ez-toc-container\" class=\"ez-toc-v2_0_85 counter-hierarchy ez-toc-counter ez-toc-custom ez-toc-container-direction\">\n<p class=\"ez-toc-title\" style=\"cursor:inherit\">Table of Contents<\/p>\n<label for=\"ez-toc-cssicon-toggle-item-6a3b9af718a5a\" class=\"ez-toc-cssicon-toggle-label\"><span class=\"\"><span class=\"eztoc-hide\" style=\"display:none;\">Toggle<\/span><span class=\"ez-toc-icon-toggle-span\"><svg style=\"fill: #dd3333;color:#dd3333\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" class=\"list-377408\" width=\"20px\" height=\"20px\" viewBox=\"0 0 24 24\" fill=\"none\"><path d=\"M6 6H4v2h2V6zm14 0H8v2h12V6zM4 11h2v2H4v-2zm16 0H8v2h12v-2zM4 16h2v2H4v-2zm16 0H8v2h12v-2z\" fill=\"currentColor\"><\/path><\/svg><svg style=\"fill: #dd3333;color:#dd3333\" class=\"arrow-unsorted-368013\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"10px\" height=\"10px\" viewBox=\"0 0 24 24\" version=\"1.2\" baseProfile=\"tiny\"><path d=\"M18.2 9.3l-6.2-6.3-6.2 6.3c-.2.2-.3.4-.3.7s.1.5.3.7c.2.2.4.3.7.3h11c.3 0 .5-.1.7-.3.2-.2.3-.5.3-.7s-.1-.5-.3-.7zM5.8 14.7l6.2 6.3 6.2-6.3c.2-.2.3-.5.3-.7s-.1-.5-.3-.7c-.2-.2-.4-.3-.7-.3h-11c-.3 0-.5.1-.7.3-.2.2-.3.5-.3.7s.1.5.3.7z\"\/><\/svg><\/span><\/span><\/label><input type=\"checkbox\"  id=\"ez-toc-cssicon-toggle-item-6a3b9af718a5a\" checked aria-label=\"Toggle\" \/><nav><ul class='ez-toc-list ez-toc-list-level-1 ' ><li class='ez-toc-page-1 ez-toc-heading-level-1'><a class=\"ez-toc-link ez-toc-heading-1\" href=\"https:\/\/buradabiliyorum.com\/en\/nvidias-new-ai-magic-turns-2d-photos-into-3d-graphics\/#%E2%80%9CNvidias_new_AI_magic_turns_2D_photos_into_3D_graphics%E2%80%9D\" >&#8220;Nvidia\u2019s new AI magic turns 2D photos into 3D graphics&#8221;<\/a><ul class='ez-toc-list-level-2' ><li class='ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-2\" href=\"https:\/\/buradabiliyorum.com\/en\/nvidias-new-ai-magic-turns-2d-photos-into-3d-graphics\/#Greetings_humanoids\" >Greetings, humanoids<\/a><\/li><\/ul><\/li><\/ul><\/nav><\/div>\n<h1><span class=\"ez-toc-section\" id=\"%E2%80%9CNvidias_new_AI_magic_turns_2D_photos_into_3D_graphics%E2%80%9D\"><\/span>&#8220;Nvidia\u2019s new AI magic turns 2D photos into 3D graphics&#8221;<span class=\"ez-toc-section-end\"><\/span><\/h1>\n<div id=\"article-main-content\">\n                            <span style=\"font-weight: 400;\">Nvidia has made another attempt to add depth to shallow graphics.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">After converting 2D images into 3D <\/span><span style=\"font-weight: 400;\">scenes<\/span><span style=\"font-weight: 400;\">, <\/span><span style=\"font-weight: 400;\">models<\/span><span style=\"font-weight: 400;\">, and <\/span><span style=\"font-weight: 400;\">videos<\/span><span style=\"font-weight: 400;\">, the company has turned its focus to editing.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">The GPU giant today unveiled a new AI method that transforms still photos into 3D objects that creators can alter with ease.<\/span><\/p>\n<div class=\"inarticle-wrapper neural channel-cta hs-embed-tnw\">\n<div id=\"hs-embed-tnw\" class=\"channel-cta-wrapper\">\n<div class=\"channel-cta-img\"><img decoding=\"async\" src=\"https:\/\/s3.amazonaws.com\/uploads.tnw\/uploads\/neural-newsletter_header-1.gif\"\/><\/div>\n<p><noscript><img decoding=\"async\" src=\"https:\/\/thenextweb.com\/news\/src=\" https:=\"\"\/><\/noscript><\/p>\n<div class=\"channel-cta-input\">\n<h2 class=\"channel-cta-title\"><span class=\"ez-toc-section\" id=\"Greetings_humanoids\"><\/span>Greetings, humanoids<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p class=\"channel-cta-tagline\">Subscribe to our <a href=\"https:\/\/buradabiliyorum.com\/en\/category\/news\/\" data-internallinksmanager029f6b8e52c=\"2\" title=\"News\" target=\"_blank\" rel=\"noopener\">news<\/a>letter now for a weekly recap of our favorite AI stories in your inbox.<\/p>\n<\/div>\n<\/div>\n<\/div>\n<p><span style=\"font-weight: 400;\">Dubbed 3D MoMa, the technique could give <a href=\"https:\/\/buradabiliyorum.com\/en\/category\/game\/\" data-internallinksmanager029f6b8e52c=\"7\" title=\"Game\" target=\"_blank\" rel=\"noopener\">game<\/a> studios a simple way to alter\u00a0 images and scenes. This typically relies on time-consuming photogrammetry, which takes measurements from photos.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">3D MoMa speeds up the task through inverse rendering. This process uses AI to estimate a scene\u2019s physical attributes \u2014 from geometry to lighting \u2014 by analyzing still images. The pictures are then reconstructed in a realistic 3D form.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">David Luebke, Nvidia\u2019s VP of graphics research, describes the technique as \u201ca holy grail unifying computer vision and computer graphics.\u201d<\/span><\/p>\n<p><span style=\"font-weight: 400;\">\u201cBy formulating every piece of the inverse rendering problem as a GPU-accelerated differentiable component, the NVIDIA 3D MoMa rendering pipeline uses the machinery of modern AI and the raw computational horsepower of NVIDIA GPUs to quickly produce 3D objects that creators can import, edit, and extend without limitation in existing tools,\u201d said Lubeke.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">3D MoMa generates objects as triangle meshes \u2014 a format that\u2019s straightforward to edit with widely-used tools. The models are created within an hour on a single NVIDIA Tensor Core GPU.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Materials can then be overlaid on the meshes like skins. The lighting of the scene is also predicted, which allows creators to modify its effects on the objects.<\/span><\/p>\n<figure class=\"post-image post-mediaBleed aligncenter\"><img loading=\"lazy\" class=\"size-full wp-image-1388526 js-lazy\" alt=\"Triangle meshes define the shapes used in 3D graphics and modeling.\" width=\"1238\" height=\"586\" sizes=\"auto, (max-width: 1238px) 100vw, 1238px\" https:=\"\" srcset=\"https:\/\/cdn0.tnwcdn.com\/wp-content\/blogs.dir\/1\/files\/2022\/06\/Screenshot-2022-06-21-at-15.13.31.png 1238w, https:\/\/cdn0.tnwcdn.com\/wp-content\/blogs.dir\/1\/files\/2022\/06\/Screenshot-2022-06-21-at-15.13.31-280x133.png 280w, https:\/\/cdn0.tnwcdn.com\/wp-content\/blogs.dir\/1\/files\/2022\/06\/Screenshot-2022-06-21-at-15.13.31-270x128.png 270w, https:\/\/cdn0.tnwcdn.com\/wp-content\/blogs.dir\/1\/files\/2022\/06\/Screenshot-2022-06-21-at-15.13.31-540x256.png 540w, https:\/\/cdn0.tnwcdn.com\/wp-content\/blogs.dir\/1\/files\/2022\/06\/Screenshot-2022-06-21-at-15.13.31-796x377.png 796w\"\/><figcaption><a rel=\"nofollow noopener\" target=\"_blank\" href=\"#\" data-url=\"https:\/\/twitter.com\/intent\/tweet?url=https%3A%2F%2Feditorial.thenextweb.com%2Fneural%2F2022%2F06%2F21%2Fnvidias-new-ai-magic-turns-2d-photos-into-3d-graphics%2F&amp;via=thenextweb&amp;related=thenextweb&amp;text=Check out this picture on: Triangle meshes define the shapes used in 3D graphics and modeling. Credit: Nvidia\" data-title=\"Share Triangle meshes define the shapes used in 3D graphics and modeling. Credit: Nvidia on Twitter\" data-width=\"685\" data-height=\"500\" class=\"post-image-share popitup\" title=\"Share Triangle meshes define the shapes used in 3D graphics and modeling. Credit: Nvidia on Twitter\"><i class=\"icon icon--inline icon--twitter--dark\"\/><\/a>Triangle meshes define the shapes used in 3D graphics and modeling. Credit: Nvidia<\/figcaption><noscript><img loading=\"lazy\" class=\"size-full wp-image-1388526\" https:=\"\" alt=\"Triangle meshes define the shapes used in 3D graphics and modeling.\" width=\"1238\" height=\"586\" srcset=\"https:\/\/cdn0.tnwcdn.com\/wp-content\/blogs.dir\/1\/files\/2022\/06\/Screenshot-2022-06-21-at-15.13.31.png 1238w, https:\/\/cdn0.tnwcdn.com\/wp-content\/blogs.dir\/1\/files\/2022\/06\/Screenshot-2022-06-21-at-15.13.31-280x133.png 280w, https:\/\/cdn0.tnwcdn.com\/wp-content\/blogs.dir\/1\/files\/2022\/06\/Screenshot-2022-06-21-at-15.13.31-270x128.png 270w, https:\/\/cdn0.tnwcdn.com\/wp-content\/blogs.dir\/1\/files\/2022\/06\/Screenshot-2022-06-21-at-15.13.31-540x256.png 540w, https:\/\/cdn0.tnwcdn.com\/wp-content\/blogs.dir\/1\/files\/2022\/06\/Screenshot-2022-06-21-at-15.13.31-796x377.png 796w\"\/><\/noscript><\/figure>\n<p><span style=\"font-weight: 400;\">3D MoMa was showcased at this week\u2019s <\/span><a rel=\"nofollow noopener\" target=\"_blank\" href=\"https:\/\/cvpr2022.thecvf.com\/\"><span style=\"font-weight: 400;\">Computer Vision and Pattern Recognition Conference<\/span><\/a><span style=\"font-weight: 400;\"> (CVPR) in New Orleans. In homage to the birthplace of jazz, Nvidia researchers used the technique to visually render the musical genre.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">The team first collected hundreds of pictures of trumpet, trombones, saxophones, drums, and clarinets. Next, 3D MoMa reconstructed the images into 3D representations. <\/span><\/p>\n<p><span style=\"font-weight: 400;\">The instruments were then edited and given new materials. The trumpet, for instance, was transformed from cheap plastic to lavish gold.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">The newly-edited instruments were then ready to be placed into any virtual scene. Nvidia dropped them into a Cornell box, which is used to test rendering quality.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">The company says all the instruments reacted to light as they would in the real world, from the brass instruments reflecting brightly to the drum skins absorbing light.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Finally, the 3D objects were rendered in an animated scene.<\/span><\/p>\n<figure>\n<p>                <iframe loading=\"lazy\" srcdoc=\"&lt;style&gt;*{padding:0;margin:0;overflow:hidden}html,body{background:#000;height:100%}img{position:absolute;top:0;left:0;width:100%;height:100%;object-fit:cover;transition:opacity .1s cubic-bezier(0.4,0,1,1)}a:hover img+img{opacity:1!important}&lt;\/style&gt;&lt;a href=\" https:=\"\" src=\"https:\/\/img.youtube.com\/vi\/W1VhDtoTzA4\/hqdefault.jpg\" style=\"top: 50%;left:50%;width:68px;height:48px;transform:translate3d(-50%,-50%,0)\" height=\"240\" width=\"320\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture\" allowfullscreen=\"\" frameborder=\"0\"><\/iframe><\/p>\n<\/figure>\n<p>        <!--resp-video-container--><br \/>\n<span style=\"font-weight: 400;\">3D MoMa remains under development, but Nvidia believes it could enable game devs and other designers to quickly modify 3D objects \u2014 and then add them to any virtual scene.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">That could also ease our metamorphosis into metaverse forms.<\/span><\/p>\n<p><em><span style=\"font-weight: 400;\">You can read the study paper behind 3D MoMa <a rel=\"nofollow noopener\" target=\"_blank\" href=\"https:\/\/nvlabs.github.io\/nvdiffrec\/assets\/paper.pdf\">here<\/a>.<\/span><\/em>\n                        <\/div>\n<p><script async src=\"\/\/platform.twitter.com\/widgets.js\" charset=\"utf-8\"><\/script><\/p>\n<blockquote><p><strong><span style=\"color: #ff6600;\">If you liked the article, do not forget to share it with your friends. Follow us on\u00a0<span style=\"color: #ff0000;\"><a style=\"color: #ff0000;\" href=\"https:\/\/news.google.com\/publications\/CAAqBwgKMLG0nwswvr63Aw\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">Google News<\/a><\/span>\u00a0too, click on the star and choose us from your favorites.<\/span><\/strong><\/p><\/blockquote>\n<blockquote>\n<p style=\"text-align: center;\">For forums sites go to <span style=\"color: #ff9900;\"><a style=\"color: #ff9900;\" href=\"https:\/\/forum.buradabiliyorum.com\/\" target=\"_blank\" rel=\"noopener\">Forum.BuradaBiliyorum.Com<\/a><\/span><\/strong><\/p>\n<\/blockquote>\n<blockquote>\n<p style=\"text-align: center;\"><strong>If you want to read more like this article, you can visit our <span style=\"color: #ff9900;\"><a style=\"color: #ff9900;\" href=\"https:\/\/en.buradabiliyorum.com\/technology\/\" target=\"_blank\" rel=\"noopener\">Technology category.<\/a><\/span><\/strong><\/p>\n<\/blockquote>\n<p><span style=\"color: black;\"><a style=\"color: #ff9900;\" href=\"https:\/\/thenextweb.com\/news\/nvidias-new-ai-magic-turns-2d-photos-into-3d-graphics\" target=\"_blank\" rel=\"noopener\">Source<\/a><\/span><\/p>\n","protected":false},"excerpt":{"rendered":"<p>&#8220;Nvidia\u2019s new AI magic turns 2D photos into 3D graphics&#8221; Nvidia has made another attempt to add depth to shallow graphics. After converting 2D images into 3D scenes, models, and videos, the company has turned its focus to editing. The GPU giant today unveiled a new AI method that transforms still photos into 3D objects&#8230;<\/p>\n","protected":false},"author":1,"featured_media":466224,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"fifu_image_url":"https:\/\/img-cdn.tnwcdn.com\/image\/neural?filter_last=1&fit=1280,640&url=https:\/\/cdn0.tnwcdn.com\/wp-content\/blogs.dir\/1\/files\/2022\/06\/Untitled-design-2-3.jpg&signature=5e6e1429a34631758a98e2f3b51997ce","fifu_image_alt":"","footnotes":""},"categories":[18],"tags":[],"class_list":["post-466223","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-technology"],"_links":{"self":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/posts\/466223","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/comments?post=466223"}],"version-history":[{"count":0,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/posts\/466223\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/media\/466224"}],"wp:attachment":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/media?parent=466223"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/categories?post=466223"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/tags?post=466223"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}