California Senate passes bill that aims to make AI chatbots safer
The Senate passed a bill that aims to make chatbots used for companionship safer after parents raised concerns that virtual characters harmed their childrens' mental health.
Read more: Teens are spilling dark thoughts to AI chatbots. Who's to blame when something goes wrong?
The legislation, which now heads to the California State Assembly, shows how state lawmakers are tackling safety concerns surrounding AI as tech companies release more AI-powered tools.
"The country is watching again for California to lead," said Sen. Steve Padilla (D-Chula Vista), one of the lawmakers who introduced the bill, on the Senate floor.
At the same time, lawmakers are trying to balance concerns that they could be hindering innovation. Groups opposed to the bill such as the Electronic Frontier Foundation say the legislation is too broad and would run into free speech issues, according to a Senate floor analysis of the bill.
Under Senate Bill 243, operators of companion chatbot platforms would remind users at least every three hours that the virtual characters aren't human. They would also disclose that companion chatbots might not be suitable for some minors.
Platforms would also need to take other steps such as implementing a protocol for addressing suicidal ideation, suicide or self-harm expressed by users. That includes showing users suicide prevention resources.
The operator of these platforms would also report the number of times a companion chatbot brought up suicide ideation or actions with a user, along with other requirements.
Dr. Akilah Weber Pierson, one of the bill's co-authors, said she supports innovation but it also must come with "ethical responsibility." Chatbots, the senator said, are engineered to hold people's attention including children.
'When a child begins to prefer interacting with AI over real human relationships, that is very concerning," said Sen. Weber Pierson (D-La Mesa).
The bill defines companion chatbots as AI systems capable of meeting the social needs of users. It excludes chatbots that businesses use for customer service.
The legislation garnered support from parents who lost their children after they started chatting with chatbots. One of those parents is Megan Garcia, a Florida mom who sued Google and Character.AI after her son Sewell Setzer III died by suicide last year.
In the lawsuit, she alleges the platform's chatbots harmed her son's mental health and failed to notify her or offer help when he expressed suicidal thoughts to these virtual characters.
Character.AI, based in Menlo Park, Calif., is a platform where people can create and interact with digital characters that mimic real and fictional people. The company has said that it takes teen safety seriously and rolled out a feature that gives parents more information about the amount of time their children are spending with chatbots on the platform.
Character.AI asked a federal court to dismiss the lawsuit, but a federal judge in May allowed the case to proceed.
Sign up for our Wide Shot newsletter to get the latest entertainment business news, analysis and insights.
This story originally appeared in Los Angeles Times.
Hashtags
Try Our AI Features
Explore what Daily8 AI can do for you:
Comments
No comments yet...
Related Articles
USA Today
2 hours ago
- USA Today
Senate confirms Trump's pick to oversee higher ed, a man tied to for-profit colleges
The Senate confirmed President Donald Trump's pick to oversee higher education policy, a man with deep ties to the for-profit college industry, by a 50-to-45 vote on August 1. Senate Majority John Thune filed cloture on Kent's nomination earlier in the week. And the education committee had already advanced Kent on a 12-11 vote without a hearing in late May. The undersecretary at the Department of Education oversees billions in federal financial aid and is charged with ensuring America's colleges provide a quality education. Education Secretary Linda McMahon had previously told USA TODAY that Kent is a 'natural leader' whose experience and concern for students 'make him the ideal selection for under secretary of education." He had won the support of several prominent university trade groups who are opposed to Trump's attacks on universities, but said they supported Kent's nomination. His confirmation comes as the Trump administration seeks to reshape higher education and has launched numerous investigations into high profile universities. Kent had already been working at the agency on the administration's initiatives like K-12 school choice. But prior to working in the government, Kent had a long history working for or close to for-profit colleges. From 2008 to the end of 2015, Kent worked for Education Affiliates, a for-profit college company. When he left, he was a vice president of legislative and regulatory affairs. In 2015, the Department of Justice announced the company had agreed to a $13 million settlement to settle accusations it had gamed the federal financial aid system. The company told USA TODAY Kent was not involved in the settlement or the allegations of fraud. Critics, including student advocacy groups and teacher unions, had called on the Senate education committee to put Kent through a public hearing to answer questions about his time working for the company. And one of the original whistleblowers tied to that case, Dorothy Thomas, expressed concern about someone from the company's leadership holding the under secretary position. Kent had also worked for Career Education Colleges and Universities, a for-profit college trade group. He developed a reputation for deep policy knowledge while speaking against regulations geared toward the for-profit college industry. That group's CEO, Jason Altmire, said Kent was not driven by partisan politics and would bring an unbiased view to the under secretary position. He then went to work for Virginia Gov. Glenn Youngkin's administration as a deputy secretary of education. Youngkin, in a prepared statement, said Kent improved how Virginia manages colleges and made them more accountable to students and families through increased transparency. Chair of the Virginia Senate's education committee, Democrat Ghazala Hashmi, told USA TODAY Kent had tried to destabilize accreditation in the state and he was aligned with efforts to dismantle consumer protections. In a departing message to the commonwealth, Kent said he was proud of reducing costs while pushing for free speech and accountability at Virginia's colleges. Chris Quintana is an investigative reporter at USA TODAY. He can be reached at cquintana@ or via Signal at 202-308-9021. He is on X at @CQuintanaDC
Politico
2 hours ago
- Politico
No nominees deal
The Senate will try to break an impasse Friday to advance three spending bills in hopes of showing progress after days of discord. A separate holdup over presidential nominations, meanwhile, could come down to direct talks between Democrats and the White House. A patchwork of objections from senators on both sides of the aisle have held up the spending legislation for days and foiled a plan for what some had hoped would be a four-bill package. But members expressed new optimism Friday that a second, more limited attempt could move forward. It's one of two pieces of major business Republican leaders are hoping to wrap up before the Senate starts its traditional summer recess. In addition to the spending bills — where they are keen to show some progress ahead of the Sept. 30 government shutdown deadline — they also want to confirm a broad tranche of President Donald Trump's nominees. The nominee conversations appear more dicey, senators said, and Senate Majority Leader John Thune said Friday that he has put Trump officials 'into conversation directly' with Minority Leader Chuck Schumer's team. Top White House staffers were also in the Capitol on Thursday night after Thune met with Trump at the White House. 'This is how this is ultimately going to get resolved,' Thune said. Meanwhile, GOP senators said leaders are running traps on a possible deal that would advance the smaller package of spending bills. Under the pending proposal, leaders would seek unanimous consent to tie together the fiscal 2026 spending bills funding the Veterans Affairs and Agriculture departments, as well as military construction projects and the FDA. A third spending bill, funding Congress itself, could be voted on separately. Senate Appropriations Chair Susan Collins said Friday morning she expects a unanimous consent request on some constellation of those three bills. The Maine Republican is eager to show progress on bipartisan spending bills before the Senate leaves for its lengthy August recess. Upon their return, members will have only a handful of session days to make further progress ahead of the shutdown deadline. Sen. John Kennedy (R-La.) has made clear he will object to including Legislative Branch funding in the package and wants the chance to vote against the $7.1 billion bill. It's the smallest of the 12 annual appropriations bills, but Kennedy maintains it still costs too much. 'They agreed to my proposal,' he told reporters Friday. 'They're going to have one vote on [Military Construction–VA] and [Agriculture-FDA] together and separate vote on [Legislative Branch] so I can vote no. Then they'll marry them up later if all three pass, as they probably will.' Coming to a nominations deal could be much trickier, given Trump's determination to get all of his 150-plus pending nominees confirmed quickly. Trump on Thursday said on Truth Social that the Senate 'must stay in Session, taking no recess' until all of the nominees are confirmed. Even if senators stay in Washington, that goal will be all but impossible to meet absent Democratic cooperation. Democrats under Schumer are exploring whether to quickly confirm a smaller subset of nominees in exchange for other concessions, such as the release of government funding they claim has been illegally 'impounded' by the Trump administration. Hailey Fuchs contributed to this report.
Fox News
3 hours ago
- Fox News
Hamas has spent years using food as a weapon, explains Tom Cotton
Sen. Tom Cotton, R-Ark., considers the international response to ongoing suffering in Gaza on 'Life, Liberty & Levin.'
