{"id":753829,"date":"2026-11-17T02:30:43","date_gmt":"2026-11-16T23:30:43","guid":{"rendered":"https:\/\/buradabiliyorum.com\/en\/microsoft-blames-its-microsoft-365-outage-on-a-dormant-july-update-defect\/"},"modified":"2026-11-17T02:30:43","modified_gmt":"2026-11-16T23:30:43","slug":"microsoft-blames-its-microsoft-365-outage-on-a-dormant-july-update-defect","status":"publish","type":"post","link":"https:\/\/buradabiliyorum.com\/en\/microsoft-blames-its-microsoft-365-outage-on-a-dormant-july-update-defect\/","title":{"rendered":"Microsoft blames its Microsoft 365 outage on a dormant July update defect"},"content":{"rendered":"<div id=\"ez-toc-container\" class=\"ez-toc-v2_0_89 counter-hierarchy ez-toc-counter ez-toc-custom ez-toc-container-direction\">\n<p class=\"ez-toc-title\" style=\"cursor:inherit\">Table of Contents<\/p>\n<label for=\"ez-toc-cssicon-toggle-item-6afb951a2ca3e\" class=\"ez-toc-cssicon-toggle-label\"><span class=\"\"><span class=\"eztoc-hide\" style=\"display:none;\">Toggle<\/span><span class=\"ez-toc-icon-toggle-span\"><svg style=\"fill: #dd3333;color:#dd3333\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" class=\"list-377408\" width=\"20px\" height=\"20px\" viewBox=\"0 0 24 24\" fill=\"none\"><path d=\"M6 6H4v2h2V6zm14 0H8v2h12V6zM4 11h2v2H4v-2zm16 0H8v2h12v-2zM4 16h2v2H4v-2zm16 0H8v2h12v-2z\" fill=\"currentColor\"><\/path><\/svg><svg style=\"fill: #dd3333;color:#dd3333\" class=\"arrow-unsorted-368013\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"10px\" height=\"10px\" viewBox=\"0 0 24 24\" version=\"1.2\" baseProfile=\"tiny\"><path d=\"M18.2 9.3l-6.2-6.3-6.2 6.3c-.2.2-.3.4-.3.7s.1.5.3.7c.2.2.4.3.7.3h11c.3 0 .5-.1.7-.3.2-.2.3-.5.3-.7s-.1-.5-.3-.7zM5.8 14.7l6.2 6.3 6.2-6.3c.2-.2.3-.5.3-.7s-.1-.5-.3-.7c-.2-.2-.4-.3-.7-.3h-11c-.3 0-.5.1-.7.3-.2.2-.3.5-.3.7s.1.5.3.7z\"\/><\/svg><\/span><\/span><\/label><input type=\"checkbox\"  id=\"ez-toc-cssicon-toggle-item-6afb951a2ca3e\" checked aria-label=\"Toggle\" \/><nav><ul class='ez-toc-list ez-toc-list-level-1 ' ><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-1\" href=\"https:\/\/buradabiliyorum.com\/en\/microsoft-blames-its-microsoft-365-outage-on-a-dormant-july-update-defect\/#Three_things_at_once\" >Three things at once<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-2\" href=\"https:\/\/buradabiliyorum.com\/en\/microsoft-blames-its-microsoft-365-outage-on-a-dormant-july-update-defect\/#Why_recovery_took_so_long\" >Why recovery took so long<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-3\" href=\"https:\/\/buradabiliyorum.com\/en\/microsoft-blames-its-microsoft-365-outage-on-a-dormant-july-update-defect\/#Questions_in_Washington\" >Questions in Washington<\/a><\/li><\/ul><\/nav><\/div>\n<p><img decoding=\"async\" src=\"https:\/\/media.thenextweb.com\/2026\/11\/microsoft-365-apps-list-screen-outlook-teams.avif\" \/><\/p>\n<div id=\"article-main-content\">\n<p>Microsoft has traced last week\u2019s global Microsoft 365 outage to a July update for its network gateway servers. The bug lay dormant for more than three months before a surge in load and a drop in capacity set it off, according to the company\u2019s preliminary post-incident report.<\/p>\n<p>Microsoft published the report to customers in the Microsoft 365 admin centre on 15 November, <a rel=\"nofollow\" target=\"_blank\" href=\"https:\/\/www.theregister.com\/saas\/2026\/11\/16\/microsoft-blames-monster-email-outage-on-software-defect-introduced-in-july-fix\/5310026\" target=\"_blank\" rel=\"nofollow noopener\">The Register reported<\/a>. Charles Lamanna, Microsoft\u2019s executive vice president for Copilot, agents and platform, posted an abridged version on X on Monday, <a rel=\"nofollow\" target=\"_blank\" href=\"https:\/\/www.zdnet.com\/business\/microsoft-outage-outlook-teams-copilot\/\" target=\"_blank\" rel=\"nofollow noopener\">ZDNET reported<\/a>.<\/p>\n<blockquote>\n<p>\u201cA latent defect caused servers to become overwhelmed and unresponsive under certain load conditions,\u201d Lamanna wrote.<\/p>\n<\/blockquote>\n<h2><span class=\"ez-toc-section\" id=\"Three_things_at_once\"><\/span>Three things at once<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p>The July update was built specifically for the Microsoft 365 network gateway servers. It passed load testing and ran worldwide without problems, Microsoft said. But the defect caused lock contention inside an internal Windows process, which exhausted a server\u2019s CPU and memory.<\/p>\n<p>Testing missed it, because the load tests focused on weaker hardware with fewer cores, according to the report. The contention is worse on newer machines with more cores.<\/p>\n<p>Two other conditions then met. Teams failed over to the gateway that also carries Exchange Online, which raised the load. At the same time, an unrelated issue from the day before had taken nearly 14% of the gateway\u2019s server capacity out of service.<\/p>\n<p>When a server stopped responding, traffic moved to the next healthy one, which then hit the same bug. Within two hours, more than 80% of the servers were unresponsive at the lowest point, the report says.<\/p>\n<h2><span class=\"ez-toc-section\" id=\"Why_recovery_took_so_long\"><\/span>Why recovery took so long<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p>Waiting traffic overwhelmed servers again as soon as they came back online. Microsoft said its automated recovery was not designed for such a broad failure.<\/p>\n<blockquote>\n<p>\u201cSince the main code defect was a latent bug from several months previous, our normal rollback, flighting, and feature flags were unable to quickly revert the change,\u201d Lamanna wrote.<\/p>\n<\/blockquote>\n<p>Engineers instead wrote an update that returned the Windows code path to its previous state. They <a href=\"https:\/\/buradabiliyorum.com\/en\/category\/download-scripts-themes-apps\/\" data-internallinksmanager029f6b8e52c=\"9\" title=\"Download Scripts &amp; Themes &amp; Apps\" target=\"_blank\" rel=\"noopener\">app<\/a>lied it to groups of servers in turn. Teams, OneDrive, SharePoint, and the Office apps could move off the faulty gateways and came back sooner. Exchange Online could not, for scale reasons, which is why Outlook was down longest.<\/p>\n<p>The report\u2019s timeline, as published by The Register, starts with the Teams failover at 01:07 UTC on 12 November. The first support case came in at 16:33 UTC. Microsoft applied its fix from 07:20 UTC on 13 November and sent its final customer update at 04:15 UTC on 14 November.<\/p>\n<p>More than 1,000 engineers and other staff joined outage calls led by Lamanna and cloud chief Scott Guthrie, <a rel=\"nofollow\" target=\"_blank\" href=\"https:\/\/www.bloomberg.com\/news\/articles\/2026-11-13\/microsoft-says-making-progress-fixing-one-of-its-longest-outages\" target=\"_blank\" rel=\"nofollow noopener\">Bloomberg reported<\/a>. On 13 November, Microsoft apologised and said the cause was not a cyberattack or AI agents.<\/p>\n<blockquote class=\"twitter-tweet\">\n<p dir=\"ltr\" lang=\"en\">We are deeply sorry for the disruption this incident has caused our customers and partners. We know the trust they place in our services and take that responsibility extremely seriously. We are seeing broad recovery and stability across our services.<\/p>\n<p>This was a technical issue not related to cyber or AI \/ agents. The incident was introduced by an issue during an earlier network capacity upgrade that surfaced following a recent network change. We have addressed the underlying issue and continue to restore service to remaining customers and regions.<\/p>\n<p>Given the scale of demand, we restored services gradually, validating stability at each stage. While this took longer, it helped ensure a stable restoration.<\/p>\n<p>We will provide a full post-incident report once our review is complete.<\/p>\n<p>\u2014 Microsoft (@Microsoft) <a rel=\"nofollow\" target=\"_blank\" href=\"https:\/\/x.com\/Microsoft\/status\/2121282013600907325?ref_src=twsrc%5Etfw\" target=\"_blank\" rel=\"nofollow noopener\">November 13, 2026<\/a><\/p>\n<\/blockquote>\n<h2><span class=\"ez-toc-section\" id=\"Questions_in_Washington\"><\/span>Questions in Washington<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p>The outage hit governments, courts, hospitals, and businesses. Downdetector logged reports from 74 countries and territories, according to the <a rel=\"nofollow\" target=\"_blank\" href=\"https:\/\/www.nbcnews.com\/tech\/tech-news\/microsoft-says-services-fully-restored-global-outage-rcna609289\" target=\"_blank\" rel=\"nofollow noopener\">Associated Press<\/a>. TNW covered the restoration of services and Europe\u2019s sovereignty debate that followed.<\/p>\n<p>Last month, a Google Cloud outage in its London region hit services including Revolut.<\/p>\n<p>House Homeland Security Committee chair Andrew Garbarino told <a rel=\"nofollow\" target=\"_blank\" href=\"https:\/\/www.politico.com\/news\/2026\/11\/13\/microsoft-washington-scrutiny-cybersecurity-01165328\" target=\"_blank\" rel=\"nofollow noopener\">Politico<\/a> he was seeking more information from Microsoft and CISA.<\/p>\n<blockquote>\n<p>\u201cWe need to understand what happened and how to make these systems more resilient,\u201d Garbarino said.<\/p>\n<\/blockquote>\n<p>Microsoft plans to publish its final post-incident report on 20 November, according to The Register.<\/p>\n<\/p><\/div>\n<blockquote><p><strong><span style=\"color: #ff6600;\">If you liked the article, do not forget to share it with your friends. Follow us on\u00a0<span style=\"color: #ff0000;\"><a style=\"color: #ff0000;\" href=\"https:\/\/news.google.com\/publications\/CAAqBwgKMN63nwsw68G3Aw\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">Google News<\/a><\/span>\u00a0too, click on the star and choose us from your favorites.<\/span><\/strong><\/p><\/blockquote>\n<blockquote>\n<p style=\"text-align: center;\"><strong>If you want to read more like this article, you can visit our <span style=\"color: #ff9900;\"><a style=\"color: #ff9900;\" href=\"https:\/\/buradabiliyorum.com\/en\/category\/technology\/\" target=\"_blank\" >Technology category.<\/a><\/span><\/strong><\/p>\n<\/blockquote>\n<p><span style=\"color: black;\"><a style=\"color: #ff9900;\" href=\"https:\/\/thenextweb.com\/news\/microsoft-365-outage-july-defect-post-incident-report\" target=\"_blank\" >Source<\/a><\/span><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Microsoft has traced last week\u2019s global Microsoft 365 outage to a July update for its network gateway servers. The bug lay dormant for more than three months before a surge in load and a drop in capacity set it off, according to the company\u2019s preliminary post-incident report. Microsoft published the report to customers in the&#8230;<\/p>\n","protected":false},"author":1,"featured_media":753830,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"fifu_image_url":"https:\/\/media.thenextweb.com\/2026\/11\/microsoft-365-apps-list-screen-outlook-teams.jpg","fifu_image_alt":"","footnotes":""},"categories":[18],"tags":[],"class_list":["post-753829","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-technology"],"_links":{"self":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/posts\/753829","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/comments?post=753829"}],"version-history":[{"count":0,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/posts\/753829\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/media\/753830"}],"wp:attachment":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/media?parent=753829"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/categories?post=753829"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/tags?post=753829"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}