{"id":517544,"date":"2022-11-29T01:21:45","date_gmt":"2022-11-28T22:21:45","guid":{"rendered":"https:\/\/en.buradabiliyorum.com\/flawless-ais-true-sync-tech-is-a-revolution-for-film-dubbing\/"},"modified":"2022-11-29T01:21:45","modified_gmt":"2022-11-28T22:21:45","slug":"flawless-ais-true-sync-tech-is-a-revolution-for-film-dubbing","status":"publish","type":"post","link":"https:\/\/buradabiliyorum.com\/en\/flawless-ais-true-sync-tech-is-a-revolution-for-film-dubbing\/","title":{"rendered":"#Flawless AI&#8217;s &#8216;True Sync&#8217; tech is a revolution for film dubbing"},"content":{"rendered":"<div id=\"ez-toc-container\" class=\"ez-toc-v2_0_85 counter-hierarchy ez-toc-counter ez-toc-custom ez-toc-container-direction\">\n<p class=\"ez-toc-title\" style=\"cursor:inherit\">Table of Contents<\/p>\n<label for=\"ez-toc-cssicon-toggle-item-6a36e73ac7637\" class=\"ez-toc-cssicon-toggle-label\"><span class=\"\"><span class=\"eztoc-hide\" style=\"display:none;\">Toggle<\/span><span class=\"ez-toc-icon-toggle-span\"><svg style=\"fill: #dd3333;color:#dd3333\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" class=\"list-377408\" width=\"20px\" height=\"20px\" viewBox=\"0 0 24 24\" fill=\"none\"><path d=\"M6 6H4v2h2V6zm14 0H8v2h12V6zM4 11h2v2H4v-2zm16 0H8v2h12v-2zM4 16h2v2H4v-2zm16 0H8v2h12v-2z\" fill=\"currentColor\"><\/path><\/svg><svg style=\"fill: #dd3333;color:#dd3333\" class=\"arrow-unsorted-368013\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"10px\" height=\"10px\" viewBox=\"0 0 24 24\" version=\"1.2\" baseProfile=\"tiny\"><path d=\"M18.2 9.3l-6.2-6.3-6.2 6.3c-.2.2-.3.4-.3.7s.1.5.3.7c.2.2.4.3.7.3h11c.3 0 .5-.1.7-.3.2-.2.3-.5.3-.7s-.1-.5-.3-.7zM5.8 14.7l6.2 6.3 6.2-6.3c.2-.2.3-.5.3-.7s-.1-.5-.3-.7c-.2-.2-.4-.3-.7-.3h-11c-.3 0-.5.1-.7.3-.2.2-.3.5-.3.7s.1.5.3.7z\"\/><\/svg><\/span><\/span><\/label><input type=\"checkbox\"  id=\"ez-toc-cssicon-toggle-item-6a36e73ac7637\" checked aria-label=\"Toggle\" \/><nav><ul class='ez-toc-list ez-toc-list-level-1 ' ><li class='ez-toc-page-1 ez-toc-heading-level-1'><a class=\"ez-toc-link ez-toc-heading-1\" href=\"https:\/\/buradabiliyorum.com\/en\/flawless-ais-true-sync-tech-is-a-revolution-for-film-dubbing\/#%E2%80%9CFlawless_AIs_%E2%80%98True_Sync_tech_is_a_revolution_for_film_dubbing%E2%80%9D\" >&#8220;Flawless AI&#8217;s &#8216;True Sync&#8217; tech is a revolution for film dubbing&#8221;<\/a><ul class='ez-toc-list-level-2' ><li class='ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-2\" href=\"https:\/\/buradabiliyorum.com\/en\/flawless-ais-true-sync-tech-is-a-revolution-for-film-dubbing\/#Greetings_humanoids\" >Greetings, humanoids<\/a><\/li><\/ul><\/li><\/ul><\/nav><\/div>\n<h1><span class=\"ez-toc-section\" id=\"%E2%80%9CFlawless_AIs_%E2%80%98True_Sync_tech_is_a_revolution_for_film_dubbing%E2%80%9D\"><\/span>&#8220;Flawless AI&#8217;s &#8216;True Sync&#8217; tech is a revolution for film dubbing&#8221;<span class=\"ez-toc-section-end\"><\/span><\/h1>\n<div id=\"article-main-content\">\n                            When British director Scott Mann\u2019s latest film, Fall, was on the precipice of receiving an \u201cR\u201d rating from the MPAA over the number of \u201cF\u201d bombs dropped over its one hour and 47-minute run time, he did what any reasonable person would: he used artificial intelligence to digitally alter the actor\u2019s performances in order to change the swear words into more palatable terms. A stroke of <i>fricking<\/i><span> genius, if you ask us. <\/span><\/p>\n<p><span>For those who are curious: <a rel=\"nofollow noopener\" target=\"_blank\" href=\"https:\/\/deadline.com\/2022\/08\/director-scott-manns-ai-startup-helps-fall-nab-pg-13-rating-2-5m-open-specialty-box-office-1235091858\/\">about 35 \u201cF\u201d words<\/a> stood between a PG-13 rating and an R rating. Mann\u2019s dilemma, then, became trying to figure out how to preserve the integrity of his movie without reshooting or dubbing. This is, of course, harder than it sounds. <\/span><\/p>\n<p><span>On a traditional movie, you\u2019d just bite the bullet and do reshoots. It\u2019s costly, but it\u2019s better than having your audience lose immersion because they\u2019ve just heard a line delivered differently than what they clearly saw the actor say on screen. It\u2019s a lot easier to read lips in 4K. <\/span><\/p>\n<div class=\"inarticle-wrapper neural channel-cta hs-embed-tnw\">\n<div id=\"hs-embed-tnw\" class=\"channel-cta-wrapper\">\n<div class=\"channel-cta-img\"><img class=\"js-lazy\" https:=\"\"\/><\/div>\n<p><noscript><img decoding=\"async\" src=\"https:\/\/thenextweb.com\/news\/src=\" https:=\"\"\/><\/noscript><\/p>\n<div class=\"channel-cta-input\">\n<h2 class=\"channel-cta-title\"><span class=\"ez-toc-section\" id=\"Greetings_humanoids\"><\/span>Greetings, humanoids<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p class=\"channel-cta-tagline\">Subscribe to our <a href=\"https:\/\/buradabiliyorum.com\/en\/category\/news\/\" data-internallinksmanager029f6b8e52c=\"2\" title=\"News\" target=\"_blank\" rel=\"noopener\">news<\/a>letter now for a weekly recap of our favorite AI stories in your inbox.<\/p>\n<\/div>\n<\/div>\n<\/div>\n<p><span>But Fall isn\u2019t a traditional movie. It\u2019s a horror movie about two women who climb up a 2,000-foot\u00a0radio tower. I won\u2019t spoil anything, but it was shot practically. That means they built a giant tower and filmed their actors on the top of it. <\/span><\/p>\n<figure>\n                <iframe loading=\"lazy\" srcdoc=\"&lt;style&gt;*{padding:0;margin:0;overflow:hidden}html,body{background:#000;height:100%}img{position:absolute;top:0;left:0;width:100%;height:100%;object-fit:cover;transition:opacity .1s cubic-bezier(0.4,0,1,1)}a:hover img+img{opacity:1!important}&lt;\/style&gt;&lt;a href=\" https:=\"\" src=\"https:\/\/img.youtube.com\/vi\/THy_BWBERxs\/hqdefault.jpg\" style=\"top: 50%;left:50%;width:68px;height:48px;transform:translate3d(-50%,-50%,0)\" height=\"240\" width=\"320\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture\" allowfullscreen=\"\" frameborder=\"0\"><\/iframe><\/p>\n<\/figure>\n<p><!--resp-video-container--><span>When you think about the logistics involved, it become <a href=\"https:\/\/buradabiliyorum.com\/en\/category\/download-scripts-themes-apps\/\" data-internallinksmanager029f6b8e52c=\"9\" title=\"Download Scripts &amp; Themes &amp; Apps\" target=\"_blank\" rel=\"noopener\">app<\/a>arent why reshoots aren\u2019t really an option. Not only would they be even costlier than usual, but the vulgar language was, in many cases, ad-libbed by the actors due to the emotionality of the scene.<\/span><\/p>\n<p><span>This means Mann likely got the performances he was looking for, an accomplishment we can assume no director would willingly erase over something so trivial as some bad language. Unfortunately, R rated films typically <a rel=\"nofollow noopener\" target=\"_blank\" href=\"https:\/\/www.thewrap.com\/pg-13-vs-r-movies-how-each-rating-stacks-up-at-the-box-office\/\">only gross about half<\/a> what their PG-13 counterparts due. <\/span><\/p>\n<p><span>Luckily for Mann, he happens to be in a unique position among Hollywood directors. He\u2019s the co-CEO and co-founder of <a rel=\"nofollow noopener\" target=\"_blank\" href=\"https:\/\/www.flawlessai.com\/product\">Flawless AI<\/a>, a <a href=\"https:\/\/buradabiliyorum.com\/en\/category\/technology\/\" data-internallinksmanager029f6b8e52c=\"4\" title=\"Technology\" target=\"_blank\" rel=\"noopener\">technology<\/a> company that specializes in digitally altering video to match an actor\u2019s performance to a dubbed audio track. <\/span><\/p>\n<figure>\n                <iframe loading=\"lazy\" srcdoc=\"&lt;style&gt;*{padding:0;margin:0;overflow:hidden}html,body{background:#000;height:100%}img{position:absolute;top:0;left:0;width:100%;height:100%;object-fit:cover;transition:opacity .1s cubic-bezier(0.4,0,1,1)}a:hover img+img{opacity:1!important}&lt;\/style&gt;&lt;a href=\" https:=\"\" src=\"https:\/\/img.youtube.com\/vi\/7lX4Az4W8vo\/hqdefault.jpg\" style=\"top: 50%;left:50%;width:68px;height:48px;transform:translate3d(-50%,-50%,0)\" height=\"240\" width=\"320\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture\" allowfullscreen=\"\" frameborder=\"0\"><\/iframe><\/p>\n<\/figure>\n<p><!--resp-video-container--><span>For Fall, Mann and the Flawless\u00a0AI team had to record the actors saying alternative phrases such as \u201cfricking\u201d to replace the film\u2019s vulgar language. Then, they ran both the new audio and the video through the company\u2019s bespoke neural network, or what they call \u201cTrue Sync\u201d technology. This allows the team to, essentially, deepfake the actors faces into saying the new lines.<\/span><\/p>\n<p><span>As far as results go, with <a rel=\"nofollow noopener\" target=\"_blank\" href=\"https:\/\/www.rottentomatoes.com\/m\/fall\">a \u201ccertified fresh\u201d rating<\/a> on Rotten Tomatoes, it would seem nobody noticed the AI at work when they watched the drama unfold on the big screen. <\/span><\/p>\n<p><span>The system is not only cost-effective versus reshoots but, according to Mann, it\u2019s also relatively easy to insert into production. He told TNW via email that about 80% of the workflow is automated and that it was designed to handle everything in post \u2014 it doesn\u2019t require any special equipment or direction during film production. He even says that \u201cvubbing,\u201d or video dubbing, can save up to 50% in costs when it comes to reshoots. <\/span><\/p>\n<p><span>But Flawless AI wasn\u2019t just founded to help filmmakers save money in post-production. In fact, the company\u2019s main focus is on accessibility. According to Mann, \u201cAccessibility is super important for us because we believe in the ability to share stories as they were meant to be and preserve the performances of actors and how the directors planned for the story to be told.\u201d<\/span><\/p>\n<p><span>The company was founded after Mann watched one of his previous films, Heist, starring Rober Deniro, in traditional dubbed-over format. He found the status quo dubbing methods to be \u201climited and broken.\u201d<\/span><\/p>\n<p>\u201c<span>I saw how badly the traditional foreign dubbing harmed the movie, as the writing, performance and meaning were lost,\u201d Mann told TNW. \u201cThis led me to reading a white paper from the Max Planck Institute on neural networks and ultimately led to the founding of Flawless.\u201d<\/span><\/p>\n<p><span>Going forward, Mann and the Flawless AI team hope their work will allow storytellers to reach audiences around the world in a more intimate way. It\u2019s one thing to know what an actor is saying because you\u2019re hearing dubbed audio in a language you understand, it\u2019s an entirely different experience to see them deliver the line with all the nuance and character it was given in the original performance.<\/span><\/p>\n<p><span>We tip our hat to Mann and the Flawless AI team for using AI for good. Art is for everyone.<\/span>\n                        <\/div>\n<blockquote><p><strong><span style=\"color: #ff6600;\">If you liked the article, do not forget to share it with your friends. Follow us on\u00a0<span style=\"color: #ff0000;\"><a style=\"color: #ff0000;\" href=\"https:\/\/news.google.com\/publications\/CAAqBwgKMLG0nwswvr63Aw\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">Google News<\/a><\/span>\u00a0too, click on the star and choose us from your favorites.<\/span><\/strong><\/p><\/blockquote>\n<blockquote>\n<p style=\"text-align: center;\">For forums sites go to <span style=\"color: #ff9900;\"><a style=\"color: #ff9900;\" href=\"https:\/\/forum.buradabiliyorum.com\/\" target=\"_blank\" rel=\"noopener\">Forum.BuradaBiliyorum.Com<\/a><\/span><\/strong><\/p>\n<\/blockquote>\n<blockquote>\n<p style=\"text-align: center;\"><strong>If you want to read more like this article, you can visit our <span style=\"color: #ff9900;\"><a style=\"color: #ff9900;\" href=\"https:\/\/en.buradabiliyorum.com\/technology\/\" target=\"_blank\" rel=\"noopener\">Technology category.<\/a><\/span><\/strong><\/p>\n<\/blockquote>\n<p><span style=\"color: black;\"><a style=\"color: #ff9900;\" href=\"https:\/\/thenextweb.com\/news\/london-based-flawless-ais-true-sync-tech-is-a-revolutionary-approach-to-film-dubbing\" target=\"_blank\" rel=\"noopener\">Source<\/a><\/span><\/p>\n","protected":false},"excerpt":{"rendered":"<p>&#8220;Flawless AI&#8217;s &#8216;True Sync&#8217; tech is a revolution for film dubbing&#8221; When British director Scott Mann\u2019s latest film, Fall, was on the precipice of receiving an \u201cR\u201d rating from the MPAA over the number of \u201cF\u201d bombs dropped over its one hour and 47-minute run time, he did what any reasonable person would: he used&#8230;<\/p>\n","protected":false},"author":1,"featured_media":517545,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"fifu_image_url":"https:\/\/img-cdn.tnwcdn.com\/image\/neural?filter_last=1&fit=1280,640&url=https:\/\/cdn0.tnwcdn.com\/wp-content\/blogs.dir\/1\/files\/2022\/11\/flawless.jpg&signature=338909aace52cbd72dd0453bb06c1bdd","fifu_image_alt":"","footnotes":""},"categories":[18],"tags":[],"class_list":["post-517544","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-technology"],"_links":{"self":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/posts\/517544","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/comments?post=517544"}],"version-history":[{"count":0,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/posts\/517544\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/media\/517545"}],"wp:attachment":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/media?parent=517544"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/categories?post=517544"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/tags?post=517544"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}