{"id":620575,"date":"2024-05-15T13:11:00","date_gmt":"2024-05-15T10:11:00","guid":{"rendered":"https:\/\/en.buradabiliyorum.com\/llms-for-all-official-eu-languages-on-horizon-for-finnish-startup\/"},"modified":"2024-05-15T13:11:00","modified_gmt":"2024-05-15T10:11:00","slug":"llms-for-all-official-eu-languages-on-horizon-for-finnish-startup","status":"publish","type":"post","link":"https:\/\/buradabiliyorum.com\/en\/llms-for-all-official-eu-languages-on-horizon-for-finnish-startup\/","title":{"rendered":"#LLMs \u2018for all official EU languages\u2019 on horizon for Finnish startup"},"content":{"rendered":"<div id=\"ez-toc-container\" class=\"ez-toc-v2_0_85 counter-hierarchy ez-toc-counter ez-toc-custom ez-toc-container-direction\">\n<p class=\"ez-toc-title\" style=\"cursor:inherit\">Table of Contents<\/p>\n<label for=\"ez-toc-cssicon-toggle-item-6a348b70a30e8\" class=\"ez-toc-cssicon-toggle-label\"><span class=\"\"><span class=\"eztoc-hide\" style=\"display:none;\">Toggle<\/span><span class=\"ez-toc-icon-toggle-span\"><svg style=\"fill: #dd3333;color:#dd3333\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" class=\"list-377408\" width=\"20px\" height=\"20px\" viewBox=\"0 0 24 24\" fill=\"none\"><path d=\"M6 6H4v2h2V6zm14 0H8v2h12V6zM4 11h2v2H4v-2zm16 0H8v2h12v-2zM4 16h2v2H4v-2zm16 0H8v2h12v-2z\" fill=\"currentColor\"><\/path><\/svg><svg style=\"fill: #dd3333;color:#dd3333\" class=\"arrow-unsorted-368013\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"10px\" height=\"10px\" viewBox=\"0 0 24 24\" version=\"1.2\" baseProfile=\"tiny\"><path d=\"M18.2 9.3l-6.2-6.3-6.2 6.3c-.2.2-.3.4-.3.7s.1.5.3.7c.2.2.4.3.7.3h11c.3 0 .5-.1.7-.3.2-.2.3-.5.3-.7s-.1-.5-.3-.7zM5.8 14.7l6.2 6.3 6.2-6.3c.2-.2.3-.5.3-.7s-.1-.5-.3-.7c-.2-.2-.4-.3-.7-.3h-11c-.3 0-.5.1-.7.3-.2.2-.3.5-.3.7s.1.5.3.7z\"\/><\/svg><\/span><\/span><\/label><input type=\"checkbox\"  id=\"ez-toc-cssicon-toggle-item-6a348b70a30e8\" checked aria-label=\"Toggle\" \/><nav><ul class='ez-toc-list ez-toc-list-level-1 ' ><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-1\" href=\"https:\/\/buradabiliyorum.com\/en\/llms-for-all-official-eu-languages-on-horizon-for-finnish-startup\/#Silo_AIs_LLM_family\" >Silo AI\u2019s LLM family<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-2\" href=\"https:\/\/buradabiliyorum.com\/en\/llms-for-all-official-eu-languages-on-horizon-for-finnish-startup\/#New_parameters\" >New parameters<\/a><\/li><\/ul><\/nav><\/div>\n<p><img decoding=\"async\" src=\"https:\/\/img-cdn.tnwcdn.com\/image?fit=796%2C417&amp;url=https%3A%2F%2Fcdn0.tnwcdn.com%2Fwp-content%2Fblogs.dir%2F1%2Ffiles%2F2024%2F05%2FUntitled-design.jpeg&amp;signature=c1136848fc43d5eaaf1d739e759874a0\" \/><\/p>\n<div id=\"article-main-content\">\n                            A Finnish startup today launched a multilingual AI model that\u2019s a \u201csignificant milestone\u201d on the path to LLMs for every EU language, the company says.<\/p>\n<p>Helsinki-based Silo AI calls the new large language model Viking 7B. It covers\u00a0 Danish, Finnish, Icelandic, Norwegian, and Swedish, as well as English and programming languages. Evaluations indicate best-in-class performance in all the Nordic languages \u2014 without compromising the English outputs.<\/p>\n<p>Peter Sarlin, Silo AI\u2019s CEO, told TNW that his company is now \u201con the right track\u201d towards its ultimate goal.<\/p>\n<p>\u201cThis release marks an important step in our ongoing efforts to develop performant language models for all official EU languages,\u201d he said.<\/p>\n<div class=\"inarticle-wrapper channel-cta\">\n<div class=\"ica-text\">\n<p class=\"ica-text__title\">TNW Conference, June 20-21 &#8211; Last chance to save BIG!<\/p>\n<p>Final Price increase is this week on May 17! Startups, investors, corporates, governments, all in one place to explore the future of tech.<\/p>\n<\/div>\n<\/div>\n<p>\u201cWith the Viking model family, we reaffirm our commitment to Europe\u2019s digital sovereignty.\u201d<\/p>\n<h2><span class=\"ez-toc-section\" id=\"Silo_AIs_LLM_family\"><\/span>Silo AI\u2019s LLM family<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p>Silo specialises in low-resource languages, which<span> lack the linguistic data that\u2019s typically needed to train AI models.<\/span><\/p>\n<p><span>Without LLMs in these languages, entire communities will miss out on countless services, from machine translation to personalised healthcare.<\/span><\/p>\n<p><span>To fill the data gap, Silo <a href=\"https:\/\/buradabiliyorum.com\/en\/category\/download-scripts-themes-apps\/\" data-internallinksmanager029f6b8e52c=\"9\" title=\"Download Scripts &amp; Themes &amp; Apps\" target=\"_blank\" rel=\"noopener\">app<\/a>lies a variety of techniques. <\/span><span>One is optimising model architectures for pre-training. Another incorporates translated pairs of high- and low-resource languages.<\/span><\/p>\n<p>Several of the techniques use a cross-lingual signal, which enhances the connections between languages.<\/p>\n<p><span>\u201cIt allows the model to <a href=\"https:\/\/buradabiliyorum.com\/en\/category\/general\/\" data-internallinksmanager029f6b8e52c=\"3\" title=\"General\" target=\"_blank\" rel=\"noopener\">general<\/a>ise and apply learned patterns across different languages \u2014 even those with limited training data,\u201d Sarlin said.<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"New_parameters\"><\/span>New parameters<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p>The 7 billion-parameter Viking is the first release from a model family announced last month. Silo also plans to launch 13B and 33B versions. Checkpoints for both these LLMs were released today.<\/p>\n<p>As the parameters expand, the models will improve their understanding of prompts and their capacity for\u00a0nuanced outputs. But they will also need greater computational resources, which lead to higher costs and energy consumption.<\/p>\n<p>To conserve these resources, Silo trained Viking on <a rel=\"nofollow noopener\" target=\"_blank\" href=\"https:\/\/www.lumi-supercomputer.eu\/lumi-one-of-the-greenest-supercomputers-in-the-world\/\">LUMI<\/a> \u2014\u00a0 Europe\u2019s most powerful supercomputer and the world\u2019s third greenest on <a rel=\"nofollow noopener\" target=\"_blank\" href=\"https:\/\/top500.org\/\">the Top500<\/a> list.<\/p>\n<p>With resources under control and performance proven, Silo now plans to integrate every EU language.<\/p>\n<p>\u201cWe consider multilingual LLMs to constitute a part of Europe\u2019s digital infrastructure,\u201d Sarlin said.<span class=\"im\"\/><\/p>\n<p><i><span style=\"font-weight: 400;\">One of the themes of this year\u2019s TNW Conference is Ren-AI-ssance: The AI-Powered Rebirth. If you want to go deeper into all things artificial intelligence, or simply experience the event (and say hi to our editorial team), we\u2019ve got something special for our loyal readers. Use the code TNWX<a href=\"https:\/\/buradabiliyorum.com\/en\/category\/social-mediaa\/\" data-internallinksmanager029f6b8e52c=\"1\" title=\"Social Media\" target=\"_blank\" rel=\"noopener\">MEDIA<\/a> at checkout to get 30% off your <\/span><\/i><i><span style=\"font-weight: 400;\">business pass<\/span><\/i><i><span style=\"font-weight: 400;\">, <\/span><\/i><i><span style=\"font-weight: 400;\">investor pass<\/span><\/i><i><span style=\"font-weight: 400;\"> or startup packages (<\/span><\/i><i><span style=\"font-weight: 400;\">Bootstrap<\/span><\/i><i><span style=\"font-weight: 400;\"> &amp; <\/span><\/i><i><span style=\"font-weight: 400;\">Scaleup<\/span><\/i><i><span style=\"font-weight: 400;\">).<\/span><\/i>\n                        <\/div>\n<blockquote><p><strong><span style=\"color: #ff6600;\">If you liked the article, do not forget to share it with your friends. Follow us on\u00a0<span style=\"color: #ff0000;\"><a style=\"color: #ff0000;\" href=\"https:\/\/news.google.com\/publications\/CAAqBwgKMN63nwsw68G3Aw\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">Google News<\/a><\/span>\u00a0too, click on the star and choose us from your favorites.<\/span><\/strong><\/p><\/blockquote>\n<blockquote>\n<p style=\"text-align: center;\"><strong>If you want to read more like this article, you can visit our <span style=\"color: #ff9900;\"><a style=\"color: #ff9900;\" href=\"https:\/\/en.buradabiliyorum.com\/technology\/\" target=\"_blank\" rel=\"noopener\">Technology category.<\/a><\/span><\/strong>\n<\/p><\/blockquote>\n<p><span style=\"color: black;\"><a style=\"color: #ff9900;\" href=\"https:\/\/thenextweb.com\/news\/silo-ai-launches-multilingual-viking-llm\" target=\"_blank\" rel=\"noopener\">Source<\/a><\/span><\/p>\n","protected":false},"excerpt":{"rendered":"<p>A Finnish startup today launched a multilingual AI model that\u2019s a \u201csignificant milestone\u201d on the path to LLMs for every EU language, the company says. Helsinki-based Silo AI calls the new large language model Viking 7B. It covers\u00a0 Danish, Finnish, Icelandic, Norwegian, and Swedish, as well as English and programming languages. Evaluations indicate best-in-class performance&#8230;<\/p>\n","protected":false},"author":1,"featured_media":620576,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"fifu_image_url":"https:\/\/img-cdn.tnwcdn.com\/image\/tnw-blurple?filter_last=1&fit=1280%2C640&url=https%3A%2F%2Fcdn0.tnwcdn.com%2Fwp-content%2Fblogs.dir%2F1%2Ffiles%2F2024%2F05%2FUntitled-design.jpeg&signature=375883b0fc31f0e19c7276c58d32f0ca","fifu_image_alt":"","footnotes":""},"categories":[18],"tags":[],"class_list":["post-620575","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-technology"],"_links":{"self":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/posts\/620575","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/comments?post=620575"}],"version-history":[{"count":0,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/posts\/620575\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/media\/620576"}],"wp:attachment":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/media?parent=620575"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/categories?post=620575"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/tags?post=620575"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}