{"id":694634,"date":"2025-10-13T22:50:12","date_gmt":"2025-10-13T19:50:12","guid":{"rendered":"https:\/\/buradabiliyorum.com\/en\/california-becomes-first-state-to-regulate-ai-companion-chatbots\/"},"modified":"2025-10-13T22:50:12","modified_gmt":"2025-10-13T19:50:12","slug":"california-becomes-first-state-to-regulate-ai-companion-chatbots","status":"publish","type":"post","link":"https:\/\/buradabiliyorum.com\/en\/california-becomes-first-state-to-regulate-ai-companion-chatbots\/","title":{"rendered":"California becomes first state to regulate AI companion chatbots"},"content":{"rendered":"
\n

California Governor Gavin News<\/a>om signed<\/a> a landmark bill on Monday that regulates AI companion chatbots, making it the first state in the nation to require AI chatbot operators to implement safety protocols for AI companions.<\/p>\n

The law, SB 243, is designed to protect children and vulnerable users from some of the harms associated with AI companion chatbot use. It holds companies \u2014 from the big labs like Meta and OpenAI to more focused companion startups like Character AI and Replika \u2014 legally accountable if their chatbots fail to meet the law\u2019s standards.<\/p>\n

SB 243 was introduced in January by state senators Steve Padilla and Josh Becker, and gained momentum after the\u00a0death of teenager Adam Raine, who died by suicide after a long series<\/a> of suicidal conversations with OpenAI\u2019s ChatGPT. The legislation also responds to leaked\u00a0internal documents\u00a0that reportedly showed Meta\u2019s chatbots were allowed to engage in \u201cromantic\u201d and \u201csensual\u201d chats with children.\u00a0More recently, a Colorado family has filed suit<\/a> against role-playing startup Character AI after their 13-year-old daughter took her own life following a series of problematic and sexualized conversations with the company\u2019s chatbots.<\/p>\n

\u201cEmerging technology<\/a> like chatbots and social media<\/a> can inspire, educate, and connect \u2014 but without real guardrails, technology can also exploit, mislead, and endanger our kids,\u201d Newsom said in a statement. \u201cWe\u2019ve seen some truly horrific and tragic examples of young people harmed by unregulated tech, and we won\u2019t stand by while companies continue without necessary limits and accountability. We can continue to lead in AI and technology, but we must do it responsibly \u2014 protecting our children every step of the way. Our children\u2019s safety is not for sale.\u201d<\/p>\n

SB 243 will go into effect January 1, 2026, and requires companies to implement certain features such as age verification, and warnings regarding social media and companion chatbots. The law also implements stronger penalties for those who profit from illegal deepfakes, including up to $250,000 per offense. Companies must also establish protocols to address suicide and self-harm, which will be shared with the state\u2019s Department of Public Health alongside statistics on how the service provided users with crisis center prevention notifications.<\/p>\n

Per the bill\u2019s language, platforms must also make it clear that any interactions are artificially generated, and chatbots must not represent themselves as healthcare professionals. Companies are required to offer break reminders to minors and prevent them from viewing sexually explicit images generated by the chatbot.<\/p>\n

Some companies have already begun to implement some safeguards aimed at children. For example, OpenAI recently began rolling out parental controls, content protections, and a self-harm detection system for children using ChatGPT. Replika, which is designed for adults over the age of 18, told TechCrunch it dedicates \u201csignificant resources\u201d to safety through content-filtering systems and guardrails that direct users to trusted crisis resources, and is committed to complying with current regulations.<\/p>\n

\n
\n

Techcrunch event<\/p>\n

\n

\n\t\t\t\t\t\t\t\t\tSan Francisco<\/span>
\n\t\t\t\t\t\t\t\t\t\t\t\t\t|<\/span>
\n\t\t\t\t\t\t\t\t\t\t\t\t\tOctober 27-29, 2025<\/span>\n\t\t\t\t\t\t\t<\/p>\n<\/p><\/div>\n<\/p><\/div>\n<\/div>\n

Character AI has said that its chatbot includes a disclaimer that all chats are AI-generated and fictionalized. A Character AI spokesperson told TechCrunch that the company \u201cwelcomes working with regulators and lawmakers as they develop regulations and legislation for this emerging space, and will comply with laws, including SB 243.\u201d\u00a0<\/p>\n

Senator Padilla told TechCrunch the bill was \u201ca step in the right direction\u201d towards putting guardrails in place on \u201can incredibly powerful technology.\u201d<\/p>\n

\u201cWe have to move quickly to not miss windows of opportunity before they disapp<\/a>ear,\u201d Padilla said. \u201cI hope that other states will see the risk. I think many do. I think this is a conversation happening all over the country, and I hope people will take action. Certainly the federal government has not, and I think we have an obligation here to protect the most vulnerable people among us.\u201d<\/p>\n

SB 243 is the second significant AI regulation to come out of California in recent weeks. On September 29th, Governor Newsom signed SB 53 into law, establishing new transparency requirements on large AI companies. The bill mandates that large AI labs, like OpenAI, Anthropic, Meta, and Google DeepMind, be transparent about safety protocols. It also ensures whistleblower protections for employees at those companies.<\/p>\n

Other states, like Illinois, Nevada, and Utah, have passed laws to restrict or fully ban the use of AI chatbots as a substitute for licensed mental health care.<\/p>\n

TechCrunch has reached out to Meta and OpenAI for comment.<\/p>\n

This article has been updated with comments from Senator Padilla<\/em>, Character AI, and Replika.<\/p>\n<\/div>\n

If you liked the article, do not forget to share it with your friends. Follow us on\u00a0Google News<\/a><\/span>\u00a0too, click on the star and choose us from your favorites.<\/span><\/strong><\/p><\/blockquote>\n

\n

If you want to read more like this article, you can visit our Technology<\/a><\/span> category.<\/strong><\/p>\n<\/blockquote>\n

Source<\/a><\/span><\/p>\n","protected":false},"excerpt":{"rendered":"

California Governor Gavin Newsom signed a landmark bill on Monday that regulates AI companion chatbots, making it the first state in the nation to require AI chatbot operators to implement safety protocols for AI companions. The law, SB 243, is designed to protect children and vulnerable users from some of the harms associated with AI…<\/p>\n","protected":false},"author":1,"featured_media":694635,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"fifu_image_url":"https:\/\/techcrunch.com\/wp-content\/uploads\/2025\/10\/GettyImages-2240040875.jpg?w=1024","fifu_image_alt":"","footnotes":""},"categories":[18],"tags":[77337,158213,157514,13096,73109,151537,158613],"class_list":["post-694634","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-technology","tag-ai","tag-ai-chatbots","tag-ai-companions","tag-california","tag-gavin-newsom","tag-government-policy","tag-sb-243"],"_links":{"self":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/posts\/694634","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/comments?post=694634"}],"version-history":[{"count":0,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/posts\/694634\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/media\/694635"}],"wp:attachment":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/media?parent=694634"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/categories?post=694634"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/tags?post=694634"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}