{"id":620717,"date":"2024-05-16T22:32:35","date_gmt":"2024-05-16T19:32:35","guid":{"rendered":"https:\/\/en.buradabiliyorum.com\/google-adds-two-new-googlebot-crawlers-googleother-image-and-googleother-video\/"},"modified":"2024-05-16T22:32:35","modified_gmt":"2024-05-16T19:32:35","slug":"google-adds-two-new-googlebot-crawlers-googleother-image-and-googleother-video","status":"publish","type":"post","link":"https:\/\/buradabiliyorum.com\/en\/google-adds-two-new-googlebot-crawlers-googleother-image-and-googleother-video\/","title":{"rendered":"#Google adds two new Googlebot crawlers: GoogleOther-Image\u00a0and\u00a0GoogleOther-Video"},"content":{"rendered":"<div id=\"ez-toc-container\" class=\"ez-toc-v2_0_84 counter-hierarchy ez-toc-counter ez-toc-custom ez-toc-container-direction\">\n<p class=\"ez-toc-title\" style=\"cursor:inherit\">Table of Contents<\/p>\n<label for=\"ez-toc-cssicon-toggle-item-6a2cf9a9a32c5\" class=\"ez-toc-cssicon-toggle-label\"><span class=\"\"><span class=\"eztoc-hide\" style=\"display:none;\">Toggle<\/span><span class=\"ez-toc-icon-toggle-span\"><svg style=\"fill: #dd3333;color:#dd3333\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" class=\"list-377408\" width=\"20px\" height=\"20px\" viewBox=\"0 0 24 24\" fill=\"none\"><path d=\"M6 6H4v2h2V6zm14 0H8v2h12V6zM4 11h2v2H4v-2zm16 0H8v2h12v-2zM4 16h2v2H4v-2zm16 0H8v2h12v-2z\" fill=\"currentColor\"><\/path><\/svg><svg style=\"fill: #dd3333;color:#dd3333\" class=\"arrow-unsorted-368013\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"10px\" height=\"10px\" viewBox=\"0 0 24 24\" version=\"1.2\" baseProfile=\"tiny\"><path d=\"M18.2 9.3l-6.2-6.3-6.2 6.3c-.2.2-.3.4-.3.7s.1.5.3.7c.2.2.4.3.7.3h11c.3 0 .5-.1.7-.3.2-.2.3-.5.3-.7s-.1-.5-.3-.7zM5.8 14.7l6.2 6.3 6.2-6.3c.2-.2.3-.5.3-.7s-.1-.5-.3-.7c-.2-.2-.4-.3-.7-.3h-11c-.3 0-.5.1-.7.3-.2.2-.3.5-.3.7s.1.5.3.7z\"\/><\/svg><\/span><\/span><\/label><input type=\"checkbox\"  id=\"ez-toc-cssicon-toggle-item-6a2cf9a9a32c5\" checked aria-label=\"Toggle\" \/><nav><ul class='ez-toc-list ez-toc-list-level-1 ' ><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-1\" href=\"https:\/\/buradabiliyorum.com\/en\/google-adds-two-new-googlebot-crawlers-googleother-image-and-googleother-video\/#Google_said_these_new_crawlers_are_to_%E2%80%9Cbetter_support_crawling_of_binary_data_that_may_be_used_for_research_and_development%E2%80%9D\" >Google said these new crawlers are to &#8220;better support crawling of binary data that may be used for research and development.&#8221;<\/a><\/li><\/ul><\/nav><\/div>\n<h2 class=\"subhead\" itemprop=\"alternativeHeadline\"><span class=\"ez-toc-section\" id=\"Google_said_these_new_crawlers_are_to_%E2%80%9Cbetter_support_crawling_of_binary_data_that_may_be_used_for_research_and_development%E2%80%9D\"><\/span>Google said these new crawlers are to &#8220;better support crawling of binary data that may be used for research and development.&#8221;<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><\/p>\n<div class=\"bialty-container\">\nGoogle has added two new crawlers to the Googlebot family of web crawlers:<\/p>\n<ul>\n<li>GoogleOther-Image <\/li>\n<li>GoogleOther-Video<\/li>\n<\/ul>\n<p>Google said these two new crawlers are versions of GoogleOther optimized for fetching image and video bytes. GoogleOther was added in April 2023 to be used internally by Google teams to crawl the public web and free up some resources for the main Googlebot crawlers.<\/p>\n<p><strong>GoogleOther-Image<\/strong>. GoogleOther-Image, according to the <a rel=\"nofollow noopener\" target=\"_blank\" href=\"https:\/\/developers.google.com\/search\/docs\/crawling-indexing\/overview-google-crawlers#googleother-image\">documentation<\/a>, is the version of GoogleOther optimized for fetching publicly accessible image URLs. It will go under the user agent tokens of GoogleOther-Image and GoogleOther and the full user agent string will be GoogleOther-Image\/1.0.<\/p>\n<p><!-- \/1038259\/SEL_Post-text --><\/p>\n<div id=\"div-gpt-ad-1693000027709-0\"><\/div>\n<div id=\"post-break\"><\/div>\n<p><strong>GoogleOther-Video<\/strong>. GoogleOther-Video, according to the <a rel=\"nofollow noopener\" target=\"_blank\" href=\"https:\/\/developers.google.com\/search\/docs\/crawling-indexing\/overview-google-crawlers#googleother-image\">documentation<\/a>, is the version of GoogleOther optimized for fetching publicly accessible video URLs. It will go under the user agent tokens of GoogleOther-Video and GoogleOther and the full user agent string will be GoogleOther-Video\/1.0.<\/p>\n<p><strong>Why these new crawlers. <\/strong>Google <a rel=\"nofollow noopener\" target=\"_blank\" href=\"https:\/\/developers.google.com\/search\/updates#introducing-the-googleother-image-and-googleother-video-crawlers\">said<\/a>, \u201cthe new crawlers were launched to better support crawling of binary data that may be used for research and development.\u201d<\/p>\n<p><strong>More on Google crawlers. <\/strong>The types of Googlebot crawlers include: <\/p>\n<ul>\n<li><strong>Googlebot<\/strong>\u00a0\u2013 The main crawler for Google\u2019s search products. Google says this crawler always respects robots.txt rules.<\/li>\n<li><strong>Special-case crawlers \u2013\u00a0<\/strong>Crawlers that perform specific functions (such as AdsBot), which may or may not respect robots.txt rules.<\/li>\n<li><strong>User-triggered fetchers \u2013\u00a0<\/strong>Tools and product functions where the end-user triggers a fetch. For example, Google Site Verifier acts on the request of a user or some Google Search Console tools will send Google to fetch the page based on an action a user takes.<\/li>\n<\/ul>\n<p>Google also has listed IP address ranges and reverse DNS mask for each type:<\/p>\n<ul>\n<li><strong>Googlebot<\/strong>\u00a0\u2013\u00a0<a rel=\"nofollow noopener\" target=\"_blank\" href=\"https:\/\/developers.google.com\/static\/search\/apis\/ipranges\/googlebot.json\">googlebot.json<\/a>\u00a0(crawl-<strong><em>\u2013<\/em><\/strong>\u2013<strong><em>\u2013<\/em><\/strong>.googlebot.com or geo-crawl-<strong><em>\u2013<\/em><\/strong>\u2013<strong><em>\u2013<\/em><\/strong>.geo.googlebot.com)<\/li>\n<li><strong>Special-case crawlers \u2013\u00a0<\/strong><a rel=\"nofollow noopener\" target=\"_blank\" href=\"https:\/\/developers.google.com\/static\/search\/apis\/ipranges\/special-crawlers.json\">special-crawlers.json<\/a>\u00a0(rate-limited-proxy-<strong><em>\u2013<\/em><\/strong>\u2013<strong><em>\u2013<\/em><\/strong>.google.com)<\/li>\n<li><strong>User-triggered fetchers \u2013\u00a0<\/strong><a rel=\"nofollow noopener\" target=\"_blank\" href=\"https:\/\/developers.google.com\/static\/search\/apis\/ipranges\/user-triggered-fetchers.json\">user-triggered-fetchers.json<\/a>\u00a0(<strong><em>\u2013<\/em><\/strong>\u2013<strong><em>\u2013<\/em><\/strong>.gae.googleusercontent.com)<\/li>\n<\/ul>\n<p><strong>Why we care.\u00a0<\/strong>Many of you check your crawling activities and bot activity on your website and in your log files. When you see this new GoogleOther crawlers, do not be alarmed. It is a real Googlebot.<\/p>\n<\/div>\n<p><\/p>\n<div class=\"about-author\">\n    About the author<\/p>\n<div class=\"information\">\n<div class=\"author-module\">\n<div class=\"row\">\n<div class=\"col-12 col-lg-3 text-center\">\n<div class=\"avatar\">\n                        <img loading=\"lazy\" decoding=\"async\" class=\"img-fluid rounded-circle avatar-border\" alt=\"Barry Schwartz\" width=\"140\" height=\"140\" src=\"https:\/\/searchengineland.com\/images\/authors\/BarrySchwartz-lg.jpg\"><img loading=\"lazy\" decoding=\"async\" class=\"img-fluid rounded-circle avatar-border\" src=\"https:\/\/searchengineland.com\/images\/authors\/BarrySchwartz-lg.jpg\" alt=\"Barry Schwartz\" width=\"140\" height=\"140\">\n                                            <\/div>\n<\/p><\/div>\n<div class=\"col-12 col-lg-9\">\n<div class=\"about\">\n<div class=\"name\">\n                            <strong>Barry Schwartz<\/strong>\n                        <\/div>\n<div class=\"row g-2 pt-2\">\n<div class=\"col-auto twitter\">\n                                    <a rel=\"nofollow noopener\" target=\"_blank\" href=\"https:\/\/twitter.com\/intent\/follow?original_referer=https%3A%2F%2Fsearchengineland.com%2F&amp;region=follow_link&amp;screen_name=rustybrick&amp;tw_p=followbutton&amp;variant=2.0\" aria-label=\"opens in a new tab\"><i class=\"fab fa-x-twitter\"><\/i><\/a>\n                            <\/div>\n<div class=\"col-auto\">\n                                    <a rel=\"nofollow noopener\" target=\"_blank\" href=\"http:\/\/www.linkedin.com\/in\/rustybrick\" aria-label=\"opens in a new tab\"><i class=\"fab fa-linkedin\"><\/i><\/a>\n                                <\/div>\n<\/p><\/div>\n<p>                        Barry Schwartz is a Contributing Editor to Search Engine Land and a member of the programming team for SMX events. He owns <a rel=\"nofollow noopener\" target=\"_blank\" href=\"https:\/\/www.rustybrick.com\/\">RustyBrick<\/a>, a NY based web consulting firm. He also runs <a rel=\"nofollow noopener\" target=\"_blank\" href=\"https:\/\/www.seroundtable.com\/\">Search Engine Roundtable<\/a>, a popular search blog on very advanced SEM topics. Barry can be followed <a rel=\"nofollow noopener\" target=\"_blank\" href=\"https:\/\/twitter.com\/rustybrick\/\">on Twitter here<\/a>.                  <\/div>\n<\/p><\/div>\n<\/p><\/div>\n<\/p><\/div>\n<\/p><\/div>\n<\/div>\n<p><script async src=\"https:\/\/platform.twitter.com\/widgets.js\" charset=\"utf-8\"><\/script><\/p>\n<blockquote><p><strong><span style=\"color: #ff6600;\">If you liked the article, do not forget to share it with your friends. Follow us on\u00a0<span style=\"color: #ff0000;\"><a style=\"color: #ff0000;\" href=\"https:\/\/news.google.com\/publications\/CAAqBwgKMN63nwsw68G3Aw\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">Google News<\/a><\/span>\u00a0too, click on the star and choose us from your favorites.<\/span><\/strong><\/p><\/blockquote>\n<blockquote>\n<p style=\"text-align: center;\"><strong>If you want to read more like this article, you can visit our <span style=\"color: #ff9900;\"><a style=\"color: #ff9900;\" href=\"https:\/\/en.buradabiliyorum.com\/technology\/\" target=\"_blank\" rel=\"noopener\">Technology<\/a><\/span> category.<\/strong>\n<\/p><\/blockquote>\n<p><span style=\"color: black;\"><a style=\"color: #ff9900;\" href=\"https:\/\/searchengineland.com\/google-adds-two-new-googlebot-crawlers-googleother-image-and-googleother-video-440573\" target=\"_blank\" rel=\"noopener\">Source<\/a><\/span><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Google said these new crawlers are to &#8220;better support crawling of binary data that may be used for research and development.&#8221; Google has added two new crawlers to the Googlebot family of web crawlers: GoogleOther-Image GoogleOther-Video Google said these two new crawlers are versions of GoogleOther optimized for fetching image and video bytes. GoogleOther was&#8230;<\/p>\n","protected":false},"author":1,"featured_media":620718,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"fifu_image_url":"https:\/\/searchengineland.com\/wp-content\/seloads\/2024\/05\/google-cameras-1920.jpg","fifu_image_alt":"","footnotes":""},"categories":[18],"tags":[147868,78070],"class_list":["post-620717","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-technology","tag-google-seo","tag-seo"],"_links":{"self":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/posts\/620717","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/comments?post=620717"}],"version-history":[{"count":0,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/posts\/620717\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/media\/620718"}],"wp:attachment":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/media?parent=620717"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/categories?post=620717"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/tags?post=620717"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}