{"id":663181,"date":"2025-04-17T00:33:48","date_gmt":"2025-04-16T21:33:48","guid":{"rendered":"https:\/\/en.buradabiliyorum.com\/openais-latest-ai-models-have-a-new-safeguard-to-prevent-biorisks\/"},"modified":"2025-04-17T00:33:48","modified_gmt":"2025-04-16T21:33:48","slug":"openais-latest-ai-models-have-a-new-safeguard-to-prevent-biorisks","status":"publish","type":"post","link":"https:\/\/buradabiliyorum.com\/en\/openais-latest-ai-models-have-a-new-safeguard-to-prevent-biorisks\/","title":{"rendered":"OpenAI’s latest AI models have a new safeguard to prevent biorisks"},"content":{"rendered":"
\n

OpenAI says that it deployed a new system to monitor its latest AI reasoning models, o3 and o4-mini, for prompts related to biological and chemical threats. The system aims to prevent the models from offering advice that could instruct someone on carrying out potentially harmful attacks, according to OpenAI\u2019s safety report<\/a>.<\/p>\n

O3 and o4-mini represent a meaningful capability increase over OpenAI\u2019s previous models, the company says, and thus pose new risks in the hands of bad actors. According to OpenAI\u2019s internal benchmarks, o3 is more skilled at answering questions around creating certain types of biological threats in particular. For this reason \u2014 and to mitigate other risks \u2014 OpenAI created the new monitoring system, which the company describes as a \u201csafety-focused reasoning monitor.\u201d<\/p>\n

The monitor, custom-trained to reason about OpenAI\u2019s content policies, runs on top of o3 and o4-mini. It\u2019s designed to identify prompts related to biological and chemical risk and instruct the models to refuse to offer advice on those topics.<\/p>\n

To establish a baseline, OpenAI had red teamers spend around 1,000 hours flagging \u201cunsafe\u201d biorisk-related conversations from o3 and o4-mini. During a test in which OpenAI simulated the \u201cblocking logic\u201d of its safety monitor, the models declined to respond to risky prompts 98.7% of the time, according to OpenAI. <\/p>\n

OpenAI acknowledges that its test didn\u2019t account for people who might try new prompts after getting blocked by the monitor, which is why the company says it\u2019ll continue to rely in part on human monitoring.<\/p>\n

O3 and o4-mini don\u2019t cross OpenAI\u2019s \u201chigh risk\u201d threshold for biorisks, according to the company. However, compared to o1 and GPT-4, OpenAI says that early versions of o3 and o4-mini proved more helpful at answering questions around developing biological weapons.<\/p>\n

\"\"
Chart from o3 and o4-mini\u2019s system card (Screenshot: OpenAI)<\/span><\/figcaption><\/figure>\n

The company is actively tracking how its models could make it easier for malicious users to develop chemical and biological threats, according to OpenAI\u2019s recently updated Preparedness Framework<\/a>.<\/p>\n

OpenAI is increasingly relying on automated systems to mitigate the risks from its models. For example, to prevent GPT-4o\u2019s native image generator from creating child sexual abuse material (CSAM)<\/a>, OpenAI says it uses on a reasoning monitor similar to the one the company deployed for o3 and o4-mini. <\/p>\n

Yet several researchers have raised concerns OpenAI isn\u2019t prioritizing safety as much as it should. One of the company\u2019s red-teaming partners, Metr, said it had relatively little time to test o3 on a benchmark for deceptive behavior. Meanwhile, OpenAI decided not to release a safety report for its GPT-4.1 model, which launched earlier this week.<\/p>\n<\/div>\n

If you liked the article, do not forget to share it with your friends. Follow us on\u00a0Google News<\/a><\/span>\u00a0too, click on the star and choose us from your favorites.<\/span><\/strong><\/p><\/blockquote>\n

\n

If you want to read more like this article, you can visit our Technology<\/a><\/span> category.<\/strong><\/p>\n<\/blockquote>\n

Source<\/a><\/span><\/p>\n","protected":false},"excerpt":{"rendered":"

OpenAI says that it deployed a new system to monitor its latest AI reasoning models, o3 and o4-mini, for prompts related to biological and chemical threats. The system aims to prevent the models from offering advice that could instruct someone on carrying out potentially harmful attacks, according to OpenAI\u2019s safety report. O3 and o4-mini represent…<\/p>\n","protected":false},"author":1,"featured_media":663182,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"fifu_image_url":"https:\/\/techcrunch.com\/wp-content\/uploads\/2025\/01\/GettyImages-2191707579.jpg?w=1024","fifu_image_alt":"","footnotes":""},"categories":[18],"tags":[77337,152633,138467],"class_list":["post-663181","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-technology","tag-ai","tag-ai-safety","tag-chatgpt"],"_links":{"self":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/posts\/663181","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/comments?post=663181"}],"version-history":[{"count":0,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/posts\/663181\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/media\/663182"}],"wp:attachment":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/media?parent=663181"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/categories?post=663181"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/tags?post=663181"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}