{"id":647071,"date":"2024-12-18T01:20:20","date_gmt":"2024-12-17T22:20:20","guid":{"rendered":"https:\/\/en.buradabiliyorum.com\/bing-search-gets-faster-more-accurate-and-efficient-through-slm-models-and-tensorrt-llm\/"},"modified":"2024-12-18T01:20:20","modified_gmt":"2024-12-17T22:20:20","slug":"bing-search-gets-faster-more-accurate-and-efficient-through-slm-models-and-tensorrt-llm","status":"publish","type":"post","link":"https:\/\/buradabiliyorum.com\/en\/bing-search-gets-faster-more-accurate-and-efficient-through-slm-models-and-tensorrt-llm\/","title":{"rendered":"#Bing Search gets faster, more accurate and efficient through SLM models and TensorRT-LLM"},"content":{"rendered":"<div id=\"ez-toc-container\" class=\"ez-toc-v2_0_84 counter-hierarchy ez-toc-counter ez-toc-custom ez-toc-container-direction\">\n<p class=\"ez-toc-title\" style=\"cursor:inherit\">Table of Contents<\/p>\n<label for=\"ez-toc-cssicon-toggle-item-6a272479c431e\" class=\"ez-toc-cssicon-toggle-label\"><span class=\"\"><span class=\"eztoc-hide\" style=\"display:none;\">Toggle<\/span><span class=\"ez-toc-icon-toggle-span\"><svg style=\"fill: #dd3333;color:#dd3333\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" class=\"list-377408\" width=\"20px\" height=\"20px\" viewBox=\"0 0 24 24\" fill=\"none\"><path d=\"M6 6H4v2h2V6zm14 0H8v2h12V6zM4 11h2v2H4v-2zm16 0H8v2h12v-2zM4 16h2v2H4v-2zm16 0H8v2h12v-2z\" fill=\"currentColor\"><\/path><\/svg><svg style=\"fill: #dd3333;color:#dd3333\" class=\"arrow-unsorted-368013\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"10px\" height=\"10px\" viewBox=\"0 0 24 24\" version=\"1.2\" baseProfile=\"tiny\"><path d=\"M18.2 9.3l-6.2-6.3-6.2 6.3c-.2.2-.3.4-.3.7s.1.5.3.7c.2.2.4.3.7.3h11c.3 0 .5-.1.7-.3.2-.2.3-.5.3-.7s-.1-.5-.3-.7zM5.8 14.7l6.2 6.3 6.2-6.3c.2-.2.3-.5.3-.7s-.1-.5-.3-.7c-.2-.2-.4-.3-.7-.3h-11c-.3 0-.5.1-.7.3-.2.2-.3.5-.3.7s.1.5.3.7z\"\/><\/svg><\/span><\/span><\/label><input type=\"checkbox\"  id=\"ez-toc-cssicon-toggle-item-6a272479c431e\" checked aria-label=\"Toggle\" \/><nav><ul class='ez-toc-list ez-toc-list-level-1 ' ><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-1\" href=\"https:\/\/buradabiliyorum.com\/en\/bing-search-gets-faster-more-accurate-and-efficient-through-slm-models-and-tensorrt-llm\/#Bings_search_team_said_it_%E2%80%9Ctrained_SLM_models_100x_throughput_improvement_over_LLM_which_process_and_understand_search_queries_more_precisely%E2%80%9D\" >Bing&#8217;s search team said it &#8220;trained SLM models (~100x throughput improvement over LLM), which process and understand search queries more precisely.&#8221;<\/a><\/li><\/ul><\/nav><\/div>\n<h2 class=\"subhead\" itemprop=\"alternativeHeadline\"><span class=\"ez-toc-section\" id=\"Bings_search_team_said_it_%E2%80%9Ctrained_SLM_models_100x_throughput_improvement_over_LLM_which_process_and_understand_search_queries_more_precisely%E2%80%9D\"><\/span>Bing&#8217;s search team said it &#8220;trained SLM models (~100x throughput improvement over LLM), which process and understand search queries more precisely.&#8221;<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><\/p>\n<div class=\"bialty-container\">\n<p>The Bing Search team shared how it helped make Bing Search and Bing\u2019s Deep Search faster, more accurate and more cost-effective by transitioning to SLM models and the integration of TensorRT-LLM.<\/p>\n<p>Bing <a rel=\"nofollow\" target=\"_blank\" href=\"https:\/\/blogs.bing.com\/search-quality-insights\/December-2024\/Bing-s-Transition-to-LLM-SLM-Models-Optimizing-Search-with-TensorRT-LLM\">wrote<\/a>, \u201cto improve efficiency, we trained SLM models (~100x throughput improvement over LLM), which process and understand search queries more precisely.\u201d<\/p>\n<p><strong>The benefits. <\/strong>Bing said it has helped make search better overall by bringing these three core benefits to its searchers:<\/p>\n<ul class=\"wp-block-list\">\n<li>Faster Search Results:\u00a0With optimized inference, Bing users can enjoy quicker response times, making the Bing search experience more seamless and efficient.<\/li>\n<li>Improved Accuracy:\u00a0The enhanced capabilities of SLM models allow Microsoft to deliver more accurate and contextualized search results, helping bing searchers find the information they need more effectively.<\/li>\n<li>Cost Efficiency:\u00a0By reducing the cost of hosting and running large models, Microsoft said it can continue to invest in further innovations and improvements, ensuring that Bing remains at the forefront of search <a href=\"https:\/\/buradabiliyorum.com\/en\/category\/technology\/\" data-internallinksmanager029f6b8e52c=\"4\" title=\"Technology\" target=\"_blank\" rel=\"noopener\">technology<\/a>.<\/li>\n<\/ul>\n<p><strong>Why we care. <\/strong>A faster searcher experience and a more accurate search experience can help Bing become more trusted and useful to searchers.  This may lead to more searchers adopting Bing Search in the future, taking search market share away from bigger players like Google.<\/p>\n<\/div>\n<p><\/p>\n<div class=\"about-author\">\n<p>About the author<\/p>\n<div class=\"information\">\n<div class=\"author-module\">\n<div class=\"row\">\n<div class=\"col-12 col-lg-3 text-center\">\n<div class=\"avatar\">\n\t\t\t\t\t\t<img loading=\"lazy\" decoding=\"async\" class=\"img-fluid rounded-circle avatar-border\" alt=\"Barry Schwartz\" width=\"140\" height=\"140\" src=\"https:\/\/searchengineland.com\/images\/authors\/BarrySchwartz-lg.jpg\"><img loading=\"lazy\" decoding=\"async\" class=\"img-fluid rounded-circle avatar-border\" src=\"https:\/\/searchengineland.com\/images\/authors\/BarrySchwartz-lg.jpg\" alt=\"Barry Schwartz\" width=\"140\" height=\"140\">\n\t\t\t\t\t\t\t\t\t\t\t<\/div>\n<\/p><\/div>\n<div class=\"col-12 col-lg-9\">\n<div class=\"about\">\n<div class=\"name\">\n\t\t\t\t\t\t\t<strong>Barry Schwartz<\/strong>\n\t\t\t\t\t\t<\/div>\n<div class=\"row g-2 pt-2\">\n<div class=\"col-auto twitter\">\n\t\t\t\t\t\t\t\t\t<a rel=\"nofollow\" target=\"_blank\" href=\"https:\/\/twitter.com\/intent\/follow?original_referer=https%3A%2F%2Fsearchengineland.com%2F&amp;region=follow_link&amp;screen_name=rustybrick&amp;tw_p=followbutton&amp;variant=2.0\" rel=\"me\" target=\"_blank\" aria-label=\"opens in a new tab\"><i class=\"fab fa-x-twitter\"><\/i><\/a>\n\t\t\t\t\t\t\t<\/div>\n<div class=\"col-auto\">\n\t\t\t\t\t\t\t\t\t<a rel=\"nofollow\" target=\"_blank\" href=\"http:\/\/www.linkedin.com\/in\/rustybrick\" target=\"_blank\" aria-label=\"opens in a new tab\"><i class=\"fab fa-linkedin\"><\/i><\/a>\n\t\t\t\t\t\t\t\t<\/div>\n<\/p><\/div>\n<p>\t\t\t\t\t\tBarry Schwartz is a technologist and a Contributing Editor to Search Engine Land and a member of the programming team for SMX events. He owns <a rel=\"nofollow\" target=\"_blank\" href=\"https:\/\/www.rustybrick.com\/\" rel=\"nofollow\">RustyBrick<\/a>, a NY based web consulting firm. He also runs <a rel=\"nofollow\" target=\"_blank\" href=\"https:\/\/www.seroundtable.com\/\" rel=\"nofollow\">Search Engine Roundtable<\/a>, a popular search blog on very advanced SEM topics.<\/p>\n<p>In 2019, Barry was awarded the Outstanding Community Services Award from Search Engine Land, in 2018 he was awarded the US Search Awards the &#8220;US Search Personality Of The Year,&#8221; you can learn more over here and in 2023 he was listed as a top 50 most influential PPCer by Marketing O&#8217;Clock.<\/p>\n<p>Barry can be followed\u00a0<a rel=\"nofollow\" target=\"_blank\" href=\"https:\/\/twitter.com\/rustybrick\/\">on X here<\/a>\u00a0and you can learn more about\u00a0<a rel=\"nofollow\" target=\"_blank\" href=\"https:\/\/www.rustybrick.com\/barry\">Barry Schwartz over here<\/a> or on his <a rel=\"nofollow\" target=\"_blank\" href=\"https:\/\/www.barryschwartz.org\/\">personal site<\/a>.\t\t\t\t\t<\/div>\n<\/p><\/div>\n<\/p><\/div>\n<\/p><\/div>\n<\/p><\/div>\n<\/div>\n<p><script async src=\"https:\/\/platform.twitter.com\/widgets.js\" charset=\"utf-8\"><\/script><\/p>\n<blockquote><p><strong><span style=\"color: #ff6600;\">If you liked the article, do not forget to share it with your friends. Follow us on\u00a0<span style=\"color: #ff0000;\"><a style=\"color: #ff0000;\" href=\"https:\/\/news.google.com\/publications\/CAAqBwgKMN63nwsw68G3Aw\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">Google News<\/a><\/span>\u00a0too, click on the star and choose us from your favorites.<\/span><\/strong><\/p><\/blockquote>\n<blockquote>\n<p style=\"text-align: center;\"><strong>If you want to read more like this article, you can visit our <span style=\"color: #ff9900;\"><a style=\"color: #ff9900;\" href=\"https:\/\/en.buradabiliyorum.com\/category\/technology\/\" target=\"_blank\" >Technology<\/a><\/span> category.<\/strong><\/p>\n<\/blockquote>\n<p><span style=\"color: black;\"><a style=\"color: #ff9900;\" href=\"https:\/\/searchengineland.com\/bing-search-gets-faster-more-accurate-and-efficient-through-slm-models-and-tensorrt-llm-449427\" target=\"_blank\" >Source<\/a><\/span><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Bing&#8217;s search team said it &#8220;trained SLM models (~100x throughput improvement over LLM), which process and understand search queries more precisely.&#8221; The Bing Search team shared how it helped make Bing Search and Bing\u2019s Deep Search faster, more accurate and more cost-effective by transitioning to SLM models and the integration of TensorRT-LLM. Bing wrote, \u201cto&#8230;<\/p>\n","protected":false},"author":1,"featured_media":647072,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"fifu_image_url":"https:\/\/searchengineland.com\/wp-content\/seloads\/2024\/12\/bing-robot-glasses-1920.jpg","fifu_image_alt":"","footnotes":""},"categories":[18],"tags":[48041,78070],"class_list":["post-647071","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-technology","tag-bing","tag-seo"],"_links":{"self":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/posts\/647071","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/comments?post=647071"}],"version-history":[{"count":0,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/posts\/647071\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/media\/647072"}],"wp:attachment":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/media?parent=647071"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/categories?post=647071"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/tags?post=647071"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}