There are over 7,000 languages in the world. Yet, most large language<\/span> models (LLMs) work far more effectively in English. Naturally, this threatens to amplify language bias when it comes to access to knowledge, research, innovation \u2014 and competitive advantage for businesses.\u00a0<\/span><\/p>\n In November, Finland\u2019s Silo AI released its multilingual open European LLM Poro 34B developed in collaboration with the University of Turku. Poro, which means reindeer in Finnish, has been trained on Europe\u2019s most powerful supercomputer LUMI in Kajani, Finland. (Interestingly, LUMI runs on AMD architecture, as opposed to all-the-rage LLM-training Nvidia.)\u00a0<\/span><\/p>\n Along with Poro 1, the company unveiled a research checkpoint program that will release checkpoints as the model completes (the first three points were announced with the model last month).\u00a0<\/span><\/p>\n Now, the company, through its branch SiloGen, has trained more than 50% of the model and has just published the next two checkpoints in the program. With these five checkpoints now complete, Poro 34B has shown best-in-class performance for low-resource languages like Finnish (compared to Llama, Mistral, FinGPT, etc) \u2014 without compromising performance in English.\u00a0<\/span><\/p>\n Research Fellow Sampo Pyysalo from TurkuNLP says that they expect to have trained the model fully within the next few weeks. As the next step, the model will add support for other Nordic languages, including Swedish, Norwegian, Danish, and Icelandic.\u00a0<\/span><\/p>\n \u201cIt\u2019s imperative for Europe\u2019s digital sovereignty to have access to language models aligned with European values, culture and languages<\/span>. We\u2019re proud to see that Poro shows best-in-class performance on a low-resource language like Finnish,\u201d Silo AI\u2019s co-founder and CEO, Peter Sarlin, told TNW. \u201cIn line with the intent to cover all European languages, it\u2019s a natural step to start with an extension to the Nordic languages.\u201d\u00a0<\/span><\/p>\n Furthermore, SiloGen has commenced training Poro 2. Through a partnership with non-profit LAION (Large-scale Artificial Intelligence Open Network), it will add multimodality to the model. <\/span> \u201cIt\u2019s likewise natural to extend Poro with vision,\u201d Sarlin added. \u201cLike textual data, we see an even larger potential for generative AI to consolidate large amounts of data of different modalities.\u201d<\/span><\/p>\n LAION says it is \u201cpassionate about advancing the field of machine learning for the greater good.\u201d In keeping with Silo AI\u2019s intentions for building its GenAI model and LAION\u2019s overall mission to increase access to large-scale ML models, and datasets, Poro 2 will be freely available under the Apache 2.0 Licence. This means developers will also be able to build proprietary solutions on top.\u00a0<\/span><\/p>\n Silo AI, which calls itself \u201cEurope\u2019s largest private AI lab\u201d launched in 2017 on the idea that Europe needed an AI flagship. The company is based in Helsinki, Finland, and builds AI-driven solutions and products to enable smart devices, autonomous vehicles, industry 4.0, and smart cities. Currently, Silo AI\u00a0counts over 300 employees and also has offices in Sweden, Denmark, the Netherlands, and Canada.<\/span>\n <\/div>\n If you liked the article, do not forget to share it with your friends. Follow us on\u00a0Google News<\/a><\/span>\u00a0too, click on the star and choose us from your favorites.<\/span><\/strong><\/p><\/blockquote>\n For forums sites go to Forum.BuradaBiliyorum.Com<\/a><\/span><\/strong><\/p>\n<\/blockquote>\n If you want to read more like this article, you can visit our Technology category.<\/a><\/span><\/strong><\/p>\n<\/blockquote>\n
<\/span><\/p>\n\n
\n
![](\"https:\/\/img-cdn.tnwcdn.com\/image?fit=796%2C417&url=https%3A%2F%2Fcdn0.tnwcdn.com%2Fwp-content%2Fblogs.dir%2F1%2Ffiles%2F2023%2F12%2Fcc439f4a7d3df1ea7db79cb8c3bd0c64-e1701421703950.webp&signature=11f975659faf804ae40e3daa9256f639\")
<\/p>\n