{"id":750676,"date":"2026-10-31T17:10:31","date_gmt":"2026-10-31T14:10:31","guid":{"rendered":"https:\/\/buradabiliyorum.com\/en\/google-microsoft-openai-and-anthropic-back-one-ai-training-opt-out\/"},"modified":"2026-10-31T17:10:31","modified_gmt":"2026-10-31T14:10:31","slug":"google-microsoft-openai-and-anthropic-back-one-ai-training-opt-out","status":"publish","type":"post","link":"https:\/\/buradabiliyorum.com\/en\/google-microsoft-openai-and-anthropic-back-one-ai-training-opt-out\/","title":{"rendered":"Google, Microsoft, OpenAI and Anthropic back one AI training opt-out"},"content":{"rendered":"<div id=\"ez-toc-container\" class=\"ez-toc-v2_0_89 counter-hierarchy ez-toc-counter ez-toc-custom ez-toc-container-direction\">\n<p class=\"ez-toc-title\" style=\"cursor:inherit\">Table of Contents<\/p>\n<label for=\"ez-toc-cssicon-toggle-item-6aed121fe6599\" class=\"ez-toc-cssicon-toggle-label\"><span class=\"\"><span class=\"eztoc-hide\" style=\"display:none;\">Toggle<\/span><span class=\"ez-toc-icon-toggle-span\"><svg style=\"fill: #dd3333;color:#dd3333\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" class=\"list-377408\" width=\"20px\" height=\"20px\" viewBox=\"0 0 24 24\" fill=\"none\"><path d=\"M6 6H4v2h2V6zm14 0H8v2h12V6zM4 11h2v2H4v-2zm16 0H8v2h12v-2zM4 16h2v2H4v-2zm16 0H8v2h12v-2z\" fill=\"currentColor\"><\/path><\/svg><svg style=\"fill: #dd3333;color:#dd3333\" class=\"arrow-unsorted-368013\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"10px\" height=\"10px\" viewBox=\"0 0 24 24\" version=\"1.2\" baseProfile=\"tiny\"><path d=\"M18.2 9.3l-6.2-6.3-6.2 6.3c-.2.2-.3.4-.3.7s.1.5.3.7c.2.2.4.3.7.3h11c.3 0 .5-.1.7-.3.2-.2.3-.5.3-.7s-.1-.5-.3-.7zM5.8 14.7l6.2 6.3 6.2-6.3c.2-.2.3-.5.3-.7s-.1-.5-.3-.7c-.2-.2-.4-.3-.7-.3h-11c-.3 0-.5.1-.7.3-.2.2-.3.5-.3.7s.1.5.3.7z\"\/><\/svg><\/span><\/span><\/label><input type=\"checkbox\"  id=\"ez-toc-cssicon-toggle-item-6aed121fe6599\" checked aria-label=\"Toggle\" \/><nav><ul class='ez-toc-list ez-toc-list-level-1 ' ><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-1\" href=\"https:\/\/buradabiliyorum.com\/en\/google-microsoft-openai-and-anthropic-back-one-ai-training-opt-out\/#Who_starts_when\" >Who starts when<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-2\" href=\"https:\/\/buradabiliyorum.com\/en\/google-microsoft-openai-and-anthropic-back-one-ai-training-opt-out\/#What_the_signal_does_not_do\" >What the signal does not do<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-3\" href=\"https:\/\/buradabiliyorum.com\/en\/google-microsoft-openai-and-anthropic-back-one-ai-training-opt-out\/#The_European_angle\" >The European angle<\/a><\/li><\/ul><\/nav><\/div>\n<p><img decoding=\"async\" src=\"https:\/\/media.thenextweb.com\/2026\/10\/developer-two-monitors-code-editor-mac-mini.avif\" \/><\/p>\n<div id=\"article-main-content\">\n<p>Google, Microsoft, OpenAI and Anthropic will honour one shared AI training opt-out in robots.txt. It lets a website keep its content out of generative AI training with a single rule. Today, a site that wants to say no has to write separate rules for each company\u2019s crawler.<\/p>\n<p>The shared signal comes from an <a rel=\"nofollow\" target=\"_blank\" href=\"https:\/\/datatracker.ietf.org\/doc\/draft-kelley-aipref-training-preference-signal\/\" target=\"_blank\" rel=\"nofollow noopener\">IETF draft<\/a> by Kevin Kelley of Anthropic, published on Friday. The same day, <a rel=\"nofollow\" target=\"_blank\" href=\"https:\/\/developers.google.com\/search\/blog\/2026\/10\/ai-training-control\" target=\"_blank\" rel=\"nofollow noopener\">Google<\/a>, <a rel=\"nofollow\" target=\"_blank\" href=\"https:\/\/openai.com\/index\/helping-websites-express-ai-training-preferences\/\" target=\"_blank\" rel=\"nofollow noopener\">OpenAI<\/a> and <a rel=\"nofollow\" target=\"_blank\" href=\"https:\/\/blogs.bing.com\/search\/2026\/10\/your-content-your-choice-clearer-preferences-for-training-and-grounding\/\" target=\"_blank\" rel=\"nofollow noopener\">Microsoft<\/a> announced they would support it. Kelley announced the draft on the IETF\u2019s <a rel=\"nofollow\" target=\"_blank\" href=\"https:\/\/mailarchive.ietf.org\/arch\/msg\/ai-control\/mddjatOxSR0h6GmLRBWlc839c7w\/\" target=\"_blank\" rel=\"nofollow noopener\">AI preferences mailing list<\/a>.<\/p>\n<p>It works through robots.txt, the file sites already use to tell crawlers what they may fetch. A site adds a group for a new \u201cpolicy token\u201d, <code>__usage_ai-training<\/code>. It then lists the paths it does not want used for training. The draft\u2019s example blocks a whole site except its press kit.<\/p>\n<blockquote>\n<p>\u201cPublishers should not have to choose between being discoverable in Bing and deciding how generative models use their work,\u201d Krishna Madhavan, principal product manager for Microsoft Bing, wrote.<\/p>\n<\/blockquote>\n<h2><span class=\"ez-toc-section\" id=\"Who_starts_when\"><\/span>Who starts when<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p>Anthropic has already started work on it, Kelley wrote. He said it would complement Anthropic\u2019s existing crawler controls rather than replace them.<\/p>\n<blockquote>\n<p>\u201cIt\u2019ll take us some time to add support across our services and work through the inevitable complications and edge cases that I\u2019m sure we\u2019ll discover,\u201d Kelley wrote.<\/p>\n<\/blockquote>\n<p>OpenAI said it aims to implement the signal \u201cin the coming months\u201d. Its existing crawler controls, such as GPTBot, will still <a href=\"https:\/\/buradabiliyorum.com\/en\/category\/download-scripts-themes-apps\/\" data-internallinksmanager029f6b8e52c=\"9\" title=\"Download Scripts &amp; Themes &amp; Apps\" target=\"_blank\" rel=\"noopener\">app<\/a>ly, it said.<\/p>\n<p>Google said it aims to support the signal in 2027, and its crawler documentation says early 2027. Google-Extended is Google\u2019s own AI training control. If a site opts out with the token and does not mention Google-Extended, Google will treat it as a block on Google-Extended. Sites that allow Google-Extended can appear in Gemini app answers and get clicks, Google Search Advocate John Mueller wrote.<\/p>\n<p>Microsoft will honour the new preferences from 1 February 2027. They will replace the NoArchive and NoCache tags it has used since 2023. Microsoft is also adding a separate page-level setting for grounding, when an AI answer draws on a live web page. One option allows Microsoft\u2019s own products, such as Copilot. It blocks the grounding services Microsoft sells to other companies.<\/p>\n<h2><span class=\"ez-toc-section\" id=\"What_the_signal_does_not_do\"><\/span>What the signal does not do<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p>The draft says the token states a preference about how sites want their content used. It is not an order about crawling. A site with no such group has expressed no preference, and existing rules for all crawlers do not count. Private agreements between a site and an AI company can override it.<\/p>\n<p>The draft is an individual submission. The IETF\u2019s datatracker says the IETF has not endorsed it and it has no formal standing in the standards process.<\/p>\n<p>Microsoft said the new preferences \u201cdo not establish licensing or payment arrangements\u201d. Blocking AI grounding \u201cwill significantly reduce your content\u2019s visibility in AI-generated experiences\u201d, it added. It does not change a page\u2019s place in Bing search results.<\/p>\n<p>Meta communications head Andy Stone voiced support for a common signal on X, <a rel=\"nofollow\" target=\"_blank\" href=\"https:\/\/www.theverge.com\/tech\/1023763\/openai-google-microsoft-ai-scraping-standard-opt-out\" target=\"_blank\" rel=\"nofollow noopener\">The Verge reported<\/a>. He did not say whether Meta would honour it.<\/p>\n<h2><span class=\"ez-toc-section\" id=\"The_European_angle\"><\/span>The European angle<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p>Google said the proposal is consistent with the EU\u2019s Code of Practice for <a href=\"https:\/\/buradabiliyorum.com\/en\/category\/general\/\" data-internallinksmanager029f6b8e52c=\"3\" title=\"General\" target=\"_blank\" rel=\"noopener\">general<\/a>-purpose AI under the AI Act. The code recognises robots.txt as a main way for publishers to state machine-readable preferences.<\/p>\n<p>Among the people the draft thanks for shaping the discussion are staff from the Financial Times, the BBC, Bertelsmann and the European Publishers Council.<\/p>\n<p>Publishers have also pushed for payment. In July, Cloudflare told AI crawlers to pay or get blocked. Its chief executive has warned that bots could reach 1,000 times human web traffic. In Australia, the ABC and SBS want AI companies to pay for <a href=\"https:\/\/buradabiliyorum.com\/en\/category\/news\/\" data-internallinksmanager029f6b8e52c=\"2\" title=\"News\" target=\"_blank\" rel=\"noopener\">news<\/a>.<\/p>\n<\/p><\/div>\n<blockquote><p><strong><span style=\"color: #ff6600;\">If you liked the article, do not forget to share it with your friends. Follow us on\u00a0<span style=\"color: #ff0000;\"><a style=\"color: #ff0000;\" href=\"https:\/\/news.google.com\/publications\/CAAqBwgKMN63nwsw68G3Aw\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">Google News<\/a><\/span>\u00a0too, click on the star and choose us from your favorites.<\/span><\/strong><\/p><\/blockquote>\n<blockquote>\n<p style=\"text-align: center;\"><strong>If you want to read more like this article, you can visit our <span style=\"color: #ff9900;\"><a style=\"color: #ff9900;\" href=\"https:\/\/buradabiliyorum.com\/en\/category\/technology\/\" target=\"_blank\" >Technology category.<\/a><\/span><\/strong><\/p>\n<\/blockquote>\n<p><span style=\"color: black;\"><a style=\"color: #ff9900;\" href=\"https:\/\/thenextweb.com\/news\/ai-training-opt-out-robots-txt-google-openai-microsoft-anthropic\" target=\"_blank\" >Source<\/a><\/span><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Google, Microsoft, OpenAI and Anthropic will honour one shared AI training opt-out in robots.txt. It lets a website keep its content out of generative AI training with a single rule. Today, a site that wants to say no has to write separate rules for each company\u2019s crawler. The shared signal comes from an IETF draft&#8230;<\/p>\n","protected":false},"author":1,"featured_media":750677,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"fifu_image_url":"https:\/\/media.thenextweb.com\/2026\/10\/developer-two-monitors-code-editor-mac-mini.jpg","fifu_image_alt":"","footnotes":""},"categories":[18],"tags":[],"class_list":["post-750676","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-technology"],"_links":{"self":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/posts\/750676","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/comments?post=750676"}],"version-history":[{"count":0,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/posts\/750676\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/media\/750677"}],"wp:attachment":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/media?parent=750676"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/categories?post=750676"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/tags?post=750676"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}