{"id":749488,"date":"2026-10-21T00:15:23","date_gmt":"2026-10-20T21:15:23","guid":{"rendered":"https:\/\/buradabiliyorum.com\/en\/meta-details-prometheus-the-ohio-supercluster-heading-for-1-million-gpus\/"},"modified":"2026-10-21T00:15:23","modified_gmt":"2026-10-20T21:15:23","slug":"meta-details-prometheus-the-ohio-supercluster-heading-for-1-million-gpus","status":"publish","type":"post","link":"https:\/\/buradabiliyorum.com\/en\/meta-details-prometheus-the-ohio-supercluster-heading-for-1-million-gpus\/","title":{"rendered":"Meta details Prometheus, the Ohio supercluster heading for 1 million GPUs"},"content":{"rendered":"<div id=\"ez-toc-container\" class=\"ez-toc-v2_0_89 counter-hierarchy ez-toc-counter ez-toc-custom ez-toc-container-direction\">\n<p class=\"ez-toc-title\" style=\"cursor:inherit\">Table of Contents<\/p>\n<label for=\"ez-toc-cssicon-toggle-item-6af6ba12eb3ed\" class=\"ez-toc-cssicon-toggle-label\"><span class=\"\"><span class=\"eztoc-hide\" style=\"display:none;\">Toggle<\/span><span class=\"ez-toc-icon-toggle-span\"><svg style=\"fill: #dd3333;color:#dd3333\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" class=\"list-377408\" width=\"20px\" height=\"20px\" viewBox=\"0 0 24 24\" fill=\"none\"><path d=\"M6 6H4v2h2V6zm14 0H8v2h12V6zM4 11h2v2H4v-2zm16 0H8v2h12v-2zM4 16h2v2H4v-2zm16 0H8v2h12v-2z\" fill=\"currentColor\"><\/path><\/svg><svg style=\"fill: #dd3333;color:#dd3333\" class=\"arrow-unsorted-368013\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"10px\" height=\"10px\" viewBox=\"0 0 24 24\" version=\"1.2\" baseProfile=\"tiny\"><path d=\"M18.2 9.3l-6.2-6.3-6.2 6.3c-.2.2-.3.4-.3.7s.1.5.3.7c.2.2.4.3.7.3h11c.3 0 .5-.1.7-.3.2-.2.3-.5.3-.7s-.1-.5-.3-.7zM5.8 14.7l6.2 6.3 6.2-6.3c.2-.2.3-.5.3-.7s-.1-.5-.3-.7c-.2-.2-.4-.3-.7-.3h-11c-.3 0-.5.1-.7.3-.2.2-.3.5-.3.7s.1.5.3.7z\"\/><\/svg><\/span><\/span><\/label><input type=\"checkbox\"  id=\"ez-toc-cssicon-toggle-item-6af6ba12eb3ed\" checked aria-label=\"Toggle\" \/><nav><ul class='ez-toc-list ez-toc-list-level-1 ' ><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-1\" href=\"https:\/\/buradabiliyorum.com\/en\/meta-details-prometheus-the-ohio-supercluster-heading-for-1-million-gpus\/#Three_generations_of_Nvidia_racks\" >Three generations of Nvidia racks<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-2\" href=\"https:\/\/buradabiliyorum.com\/en\/meta-details-prometheus-the-ohio-supercluster-heading-for-1-million-gpus\/#From_1000_interruptions_a_day\" >From 1,000 interruptions a day<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-3\" href=\"https:\/\/buradabiliyorum.com\/en\/meta-details-prometheus-the-ohio-supercluster-heading-for-1-million-gpus\/#Power_swings_of_tens_of_megawatts\" >Power swings of tens of megawatts<\/a><\/li><\/ul><\/nav><\/div>\n<p><img decoding=\"async\" src=\"https:\/\/media.thenextweb.com\/2026\/10\/meta-prometheus-data-centre-gpu-racks-aisle-new-albany.avif\" \/><\/p>\n<div id=\"article-main-content\">\n<p>Meta\u2019s Prometheus supercluster in New Albany, Ohio, already runs hundreds of thousands of Nvidia GPUs across several buildings, and Meta plans to grow it to about 1 million. The company set out the details in an <a rel=\"nofollow\" target=\"_blank\" href=\"https:\/\/engineering.fb.com\/2026\/10\/19\/data-center-engineering\/inside-prometheus-meta-gigawatt-scale-supercluster\/\" target=\"_blank\" rel=\"nofollow noopener\">engineering blog post<\/a> on Monday.<\/p>\n<p>The first phase of the gigawatt-scale cluster is finished. Meta used it to train its Muse family of models, including the Muse Wonder models. Two years ago, the site was a conventional data centre running web traffic.<\/p>\n<blockquote>\n<p>\u201cAt full scale, Prometheus will comprise roughly 1 million distributed GPUs, all functioning in lockstep,\u201d Meta wrote.<\/p>\n<\/blockquote>\n<h2><span class=\"ez-toc-section\" id=\"Three_generations_of_Nvidia_racks\"><\/span>Three generations of Nvidia racks<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p>Prometheus runs two Nvidia platforms today, both built around racks of 72 GPUs that act as one accelerator. Catalina uses the GB200 NVL72, and Clemente uses the newer GB300 NVL72. A third platform, San Miguel, will add Nvidia\u2019s Vera Rubin NVL72 racks.<\/p>\n<p>The GPUs sit in traditional data centres, AI-optimised buildings and rapid-deployment structures, linked by miles of fibre. Each building\u2019s network connects up to 20,736 GPUs. A separate aggregation network joins the buildings over distances from 2km to more than 100km. Meta also uses capacity leased from partners.<\/p>\n<h2><span class=\"ez-toc-section\" id=\"From_1000_interruptions_a_day\"><\/span>From 1,000 interruptions a day<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p>At this scale, a fault on a single machine can stop a whole training run. In mid-2025, during the first phase, interruptions peaked at nearly 1,000 events per 8,000 GPUs each day, Meta said. A year of engineering work has cut that by 99%.<\/p>\n<p>The biggest early problem was signal quality on more than 600,000 NVLink connections between GPUs. Memory faults became a larger issue as Meta scaled up the GB300 racks.<\/p>\n<p>During Muse Wonder\u2019s training, the cluster kept more than 85% of its pre-training time productive, and more than 90% for reinforcement learning. It ran about 47,000 GPU hours on average between interruptions, now above 54,000 after firmware fixes. Meta\u2019s goal is about 100,000.<\/p>\n<p>Reliability also costs hardware. Each 72-GPU rack runs a 64-GPU slice and keeps eight GPUs as spares, and Meta holds about 2% of racks in reserve. A training run on 32,768 GPUs therefore needs 37,656, about 13% more.<\/p>\n<h2><span class=\"ez-toc-section\" id=\"Power_swings_of_tens_of_megawatts\"><\/span>Power swings of tens of megawatts<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p>When tens of thousands of GPUs compute and communicate in step, the cluster\u2019s power draw swings by 30% to 40%. Starting or pausing a large job can shift tens of megawatts in seconds. Meta caps GPU power gradually with software it calls Dynamo Dimmer, backed by batteries at rack, facility and grid level.<\/p>\n<p>Meta says it pays the full cost of the energy it uses in New Albany and matches it with new clean and renewable energy. In July, it left the RE100 pact as its gas build-out for AI outpaced renewables.<\/p>\n<p>Its next supercluster, Hyperion in Richland Parish, Louisiana, is being designed with lessons from Prometheus, Meta said. Meta has also pledged $1bn to data centre communities.<\/p>\n<\/p><\/div>\n<blockquote><p><strong><span style=\"color: #ff6600;\">If you liked the article, do not forget to share it with your friends. Follow us on\u00a0<span style=\"color: #ff0000;\"><a style=\"color: #ff0000;\" href=\"https:\/\/news.google.com\/publications\/CAAqBwgKMN63nwsw68G3Aw\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">Google News<\/a><\/span>\u00a0too, click on the star and choose us from your favorites.<\/span><\/strong><\/p><\/blockquote>\n<blockquote>\n<p style=\"text-align: center;\"><strong>If you want to read more like this article, you can visit our <span style=\"color: #ff9900;\"><a style=\"color: #ff9900;\" href=\"https:\/\/buradabiliyorum.com\/en\/category\/technology\/\" target=\"_blank\" >Technology category.<\/a><\/span><\/strong><\/p>\n<\/blockquote>\n<p><span style=\"color: black;\"><a style=\"color: #ff9900;\" href=\"https:\/\/thenextweb.com\/news\/meta-prometheus-supercluster-1-million-gpus-muse\" target=\"_blank\" >Source<\/a><\/span><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Meta\u2019s Prometheus supercluster in New Albany, Ohio, already runs hundreds of thousands of Nvidia GPUs across several buildings, and Meta plans to grow it to about 1 million. The company set out the details in an engineering blog post on Monday. The first phase of the gigawatt-scale cluster is finished. Meta used it to train&#8230;<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"fifu_image_url":"","fifu_image_alt":"","footnotes":""},"categories":[18],"tags":[],"class_list":["post-749488","post","type-post","status-publish","format-standard","hentry","category-technology"],"_links":{"self":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/posts\/749488","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/comments?post=749488"}],"version-history":[{"count":0,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/posts\/749488\/revisions"}],"wp:attachment":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/media?parent=749488"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/categories?post=749488"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/tags?post=749488"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}